2024-09-14T08:57:15.583 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-14T08:57:15.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T08:57:15.698 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900520 branch: main description: rbd/device/{base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} email: ceph-qa@ceph.com first_in_suite: false job_id: '7900520' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi no_nested_subset: false openstack: - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 7f24e589328ae9e639c0009d93340e5b235d0a47 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: extra_packages: - rbd-nbd flavor: default sha1: 7f24e589328ae9e639c0009d93340e5b235d0a47 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - osd.0 - osd.1 - osd.2 - - mon.b - mgr.x - osd.3 - osd.4 - osd.5 - - client.0 seed: 5839 sha1: 7f24e589328ae9e639c0009d93340e5b235d0a47 sleep_before_teardown: 0 subset: 99/128 suite: rbd suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a targets: smithi116.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGd83wt8MkUNsyNzDeavoJNCFhzdBm7QijSnFW3jmUdrEnEK5Zkqmb7JqouGXvev0qIwNtSR57YXx2Z9qJNAAPs= smithi144.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFOBT61YvmuE0Cf9+s/hPknD0hTe0CADoe42XruzXGiFyumthVXW1lW1PAPNqxUqAVwNLHX0v/ALjdVWdWR7lrs= smithi148.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFDQJvHERc8rmaVKqrfefCrdLu3Mr5dDAHC9ZcxZvl/m+I4fL2Ol+G+jr+YHOjx0FmPzgd5hNLppFQD/qvvN2Lg= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - rbd_fsx: clients: - client.0 holebdy: 512 nbd: true ops: 6000 punch_holes: true readbdy: 512 truncbdy: 512 writebdy: 512 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_20:16:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-14T08:57:15.699 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa; will attempt to use it 2024-09-14T08:57:15.699 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa/tasks 2024-09-14T08:57:15.699 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-14T08:57:15.701 INFO:teuthology.task.internal:Checking packages... 2024-09-14T08:57:15.722 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '7f24e589328ae9e639c0009d93340e5b235d0a47' 2024-09-14T08:57:15.722 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-14T08:57:15.722 INFO:teuthology.packaging:ref: None 2024-09-14T08:57:15.722 INFO:teuthology.packaging:tag: None 2024-09-14T08:57:15.722 INFO:teuthology.packaging:branch: main 2024-09-14T08:57:15.722 INFO:teuthology.packaging:sha1: 7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T08:57:15.722 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-09-14T08:57:15.980 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4926.g1c941a66 2024-09-14T08:57:15.982 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-14T08:57:15.990 INFO:teuthology.task.internal:no buildpackages task found 2024-09-14T08:57:15.990 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-14T08:57:16.005 INFO:teuthology.task.internal:Saving configuration 2024-09-14T08:57:16.031 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-14T08:57:16.040 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-14T08:57:16.065 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900520', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 08:50:49.674622', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGd83wt8MkUNsyNzDeavoJNCFhzdBm7QijSnFW3jmUdrEnEK5Zkqmb7JqouGXvev0qIwNtSR57YXx2Z9qJNAAPs='} 2024-09-14T08:57:16.091 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900520', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 08:50:49.675998', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFOBT61YvmuE0Cf9+s/hPknD0hTe0CADoe42XruzXGiFyumthVXW1lW1PAPNqxUqAVwNLHX0v/ALjdVWdWR7lrs='} 2024-09-14T08:57:16.116 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900520', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 08:50:49.677194', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFDQJvHERc8rmaVKqrfefCrdLu3Mr5dDAHC9ZcxZvl/m+I4fL2Ol+G+jr+YHOjx0FmPzgd5hNLppFQD/qvvN2Lg='} 2024-09-14T08:57:16.117 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-14T08:57:16.124 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'] 2024-09-14T08:57:16.124 INFO:teuthology.task.internal:roles: ubuntu@smithi144.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5'] 2024-09-14T08:57:16.125 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['client.0'] 2024-09-14T08:57:16.125 INFO:teuthology.run_tasks:Running task console_log... 2024-09-14T08:57:16.223 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe624bafd00>, signals=[15]) 2024-09-14T08:57:16.223 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-14T08:57:16.232 INFO:teuthology.task.internal:Opening connections... 2024-09-14T08:57:16.232 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T08:57:16.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:57:16.309 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi144.front.sepia.ceph.com 2024-09-14T08:57:16.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:57:16.386 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi148.front.sepia.ceph.com 2024-09-14T08:57:16.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:57:16.463 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-14T08:57:16.471 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2024-09-14T08:57:16.490 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2024-09-14T08:57:16.490 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-09-14T08:57:16.549 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2024-09-14T08:57:16.549 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="9" 2024-09-14T08:57:16.549 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2024-09-14T08:57:16.549 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2024-09-14T08:57:16.549 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="9" 2024-09-14T08:57:16.549 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el9" 2024-09-14T08:57:16.549 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T08:57:16.550 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2024-09-14T08:57:16.550 INFO:teuthology.orchestra.run.smithi116.stdout:LOGO="fedora-logo-icon" 2024-09-14T08:57:16.550 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T08:57:16.550 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2024-09-14T08:57:16.550 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T08:57:16.550 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T08:57:16.550 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T08:57:16.551 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-09-14T08:57:16.571 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2024-09-14T08:57:16.589 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2024-09-14T08:57:16.590 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2024-09-14T08:57:16.648 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2024-09-14T08:57:16.648 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="9" 2024-09-14T08:57:16.648 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2024-09-14T08:57:16.648 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2024-09-14T08:57:16.648 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="9" 2024-09-14T08:57:16.648 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el9" 2024-09-14T08:57:16.648 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T08:57:16.648 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2024-09-14T08:57:16.648 INFO:teuthology.orchestra.run.smithi144.stdout:LOGO="fedora-logo-icon" 2024-09-14T08:57:16.648 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T08:57:16.648 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2024-09-14T08:57:16.649 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T08:57:16.649 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T08:57:16.649 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T08:57:16.649 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2024-09-14T08:57:16.670 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2024-09-14T08:57:16.690 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2024-09-14T08:57:16.690 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-09-14T08:57:16.748 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2024-09-14T08:57:16.748 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2024-09-14T08:57:16.748 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2024-09-14T08:57:16.748 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2024-09-14T08:57:16.748 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2024-09-14T08:57:16.748 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2024-09-14T08:57:16.748 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T08:57:16.748 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2024-09-14T08:57:16.749 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2024-09-14T08:57:16.749 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T08:57:16.749 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2024-09-14T08:57:16.749 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T08:57:16.749 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T08:57:16.749 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T08:57:16.749 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-09-14T08:57:16.770 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-14T08:57:16.783 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-14T08:57:16.798 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-14T08:57:16.798 DEBUG:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2024-09-14T08:57:16.801 DEBUG:teuthology.orchestra.run.smithi144:> test '!' -e /home/ubuntu/cephtest 2024-09-14T08:57:16.803 DEBUG:teuthology.orchestra.run.smithi148:> test '!' -e /home/ubuntu/cephtest 2024-09-14T08:57:16.820 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-14T08:57:16.827 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-14T08:57:16.827 DEBUG:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2024-09-14T08:57:16.858 DEBUG:teuthology.orchestra.run.smithi144:> test -z $(ls -A /var/lib/ceph) 2024-09-14T08:57:16.861 DEBUG:teuthology.orchestra.run.smithi148:> test -z $(ls -A /var/lib/ceph) 2024-09-14T08:57:16.959 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-14T08:57:17.038 INFO:teuthology.run_tasks:Running task kernel... 2024-09-14T08:57:17.054 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-14T08:57:17.054 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'client.0': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-14T08:57:17.054 DEBUG:teuthology.orchestra.run.smithi116:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T08:57:17.055 DEBUG:teuthology.orchestra.run.smithi144:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T08:57:17.055 DEBUG:teuthology.orchestra.run.smithi148:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T08:57:17.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T08:57:17.072 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2024-09-14T08:57:17.073 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T08:57:17.073 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T08:57:17.074 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-09-14T08:57:17.074 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-09-14T08:57:17.130 INFO:teuthology.orchestra.run.smithi144.stdout:5.14.0-503.el9.x86_64 2024-09-14T08:57:17.130 INFO:teuthology.task.kernel:Running kernel on smithi144: 5.14.0-503.el9.x86_64 2024-09-14T08:57:17.130 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum install -y kernel 2024-09-14T08:57:17.132 INFO:teuthology.orchestra.run.smithi148.stdout:5.14.0-503.el9.x86_64 2024-09-14T08:57:17.132 INFO:teuthology.task.kernel:Running kernel on smithi148: 5.14.0-503.el9.x86_64 2024-09-14T08:57:17.132 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum install -y kernel 2024-09-14T08:57:17.133 INFO:teuthology.orchestra.run.smithi116.stdout:5.14.0-503.el9.x86_64 2024-09-14T08:57:17.133 INFO:teuthology.task.kernel:Running kernel on smithi116: 5.14.0-503.el9.x86_64 2024-09-14T08:57:17.133 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum install -y kernel 2024-09-14T08:57:19.828 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - BaseOS 8.5 MB/s | 8.2 MB 00:00 2024-09-14T08:57:20.647 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-09-14T08:57:22.082 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 2.6 MB/s | 8.2 MB 00:03 2024-09-14T08:57:22.448 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-14T08:57:22.963 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:02 2024-09-14T08:57:23.830 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-14T08:57:26.898 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-14T08:57:27.121 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-14T08:57:28.092 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-14T08:57:28.341 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 19 kB 00:00 2024-09-14T08:57:28.730 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 19 kB 00:00 2024-09-14T08:57:29.103 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-14T08:57:29.543 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 19 kB 00:00 2024-09-14T08:57:29.635 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-14T08:57:30.280 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 37 MB/s | 23 MB 00:00 2024-09-14T08:57:34.559 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-14T08:57:35.049 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-14T08:57:35.770 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-14T08:57:36.590 INFO:teuthology.orchestra.run.smithi144.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T08:57:36.591 INFO:teuthology.orchestra.run.smithi144.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T08:57:36.688 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T08:57:36.700 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T08:57:36.700 INFO:teuthology.orchestra.run.smithi144.stdout: Package Architecture Version Repository Size 2024-09-14T08:57:36.700 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T08:57:36.700 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-14T08:57:36.700 INFO:teuthology.orchestra.run.smithi144.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T08:57:36.700 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2024-09-14T08:57:36.701 INFO:teuthology.orchestra.run.smithi144.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T08:57:36.701 INFO:teuthology.orchestra.run.smithi144.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T08:57:36.701 INFO:teuthology.orchestra.run.smithi144.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T08:57:36.701 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T08:57:36.701 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-14T08:57:36.701 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T08:57:36.701 INFO:teuthology.orchestra.run.smithi144.stdout:Install 4 Packages 2024-09-14T08:57:36.701 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T08:57:36.702 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 79 M 2024-09-14T08:57:36.702 INFO:teuthology.orchestra.run.smithi144.stdout:Installed size: 126 M 2024-09-14T08:57:36.702 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-14T08:57:37.080 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T08:57:37.080 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T08:57:37.171 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T08:57:37.180 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T08:57:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2024-09-14T08:57:37.180 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T08:57:37.180 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T08:57:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T08:57:37.180 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-14T08:57:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T08:57:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T08:57:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T08:57:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T08:57:37.180 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T08:57:37.180 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T08:57:37.181 INFO:teuthology.orchestra.run.smithi116.stdout:Install 4 Packages 2024-09-14T08:57:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T08:57:37.182 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 79 M 2024-09-14T08:57:37.182 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 126 M 2024-09-14T08:57:37.182 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T08:57:37.325 INFO:teuthology.orchestra.run.smithi116.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 185 kB/s | 23 kB 00:00 2024-09-14T08:57:37.352 INFO:teuthology.orchestra.run.smithi144.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 42 kB/s | 23 kB 00:00 2024-09-14T08:57:37.801 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T08:57:37.801 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T08:57:37.904 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T08:57:37.913 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T08:57:37.913 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-09-14T08:57:37.913 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T08:57:37.913 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-14T08:57:37.913 INFO:teuthology.orchestra.run.smithi148.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T08:57:37.913 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-14T08:57:37.913 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T08:57:37.913 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T08:57:37.914 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T08:57:37.914 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T08:57:37.914 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-14T08:57:37.914 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T08:57:37.914 INFO:teuthology.orchestra.run.smithi148.stdout:Install 4 Packages 2024-09-14T08:57:37.914 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T08:57:37.914 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 79 M 2024-09-14T08:57:37.915 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 126 M 2024-09-14T08:57:37.915 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-14T08:57:38.137 INFO:teuthology.orchestra.run.smithi148.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 129 kB/s | 23 kB 00:00 2024-09-14T08:57:38.850 INFO:teuthology.orchestra.run.smithi116.stdout:(2/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 21 MB/s | 35 MB 00:01 2024-09-14T08:57:39.534 INFO:teuthology.orchestra.run.smithi116.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 6.7 MB/s | 16 MB 00:02 2024-09-14T08:57:40.102 INFO:teuthology.orchestra.run.smithi144.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 4.7 MB/s | 16 MB 00:03 2024-09-14T08:57:40.646 INFO:teuthology.orchestra.run.smithi148.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 5.8 MB/s | 16 MB 00:02 2024-09-14T08:57:40.735 INFO:teuthology.orchestra.run.smithi144.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 8.4 MB/s | 29 MB 00:03 2024-09-14T08:57:41.045 INFO:teuthology.orchestra.run.smithi144.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 8.1 MB/s | 35 MB 00:04 2024-09-14T08:57:41.045 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-14T08:57:41.045 INFO:teuthology.orchestra.run.smithi144.stdout:Total 18 MB/s | 79 MB 00:04 2024-09-14T08:57:41.731 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-14T08:57:42.092 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-14T08:57:42.092 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-14T08:57:42.417 INFO:teuthology.orchestra.run.smithi116.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 5.6 MB/s | 29 MB 00:05 2024-09-14T08:57:42.417 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T08:57:42.417 INFO:teuthology.orchestra.run.smithi116.stdout:Total 15 MB/s | 79 MB 00:05 2024-09-14T08:57:42.463 INFO:teuthology.orchestra.run.smithi148.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 6.6 MB/s | 29 MB 00:04 2024-09-14T08:57:43.061 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-14T08:57:43.061 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-14T08:57:43.095 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T08:57:43.452 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T08:57:43.452 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T08:57:43.829 INFO:teuthology.orchestra.run.smithi148.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 5.9 MB/s | 35 MB 00:05 2024-09-14T08:57:43.830 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-14T08:57:43.830 INFO:teuthology.orchestra.run.smithi148.stdout:Total 13 MB/s | 79 MB 00:05 2024-09-14T08:57:44.410 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T08:57:44.410 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T08:57:44.512 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-14T08:57:44.853 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-14T08:57:44.853 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-14T08:57:45.513 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-14T08:57:45.795 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-14T08:57:45.795 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-14T08:57:46.157 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T08:57:46.238 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T08:57:46.844 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T08:57:47.502 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T08:57:47.592 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T08:57:48.230 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-14T08:57:48.869 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T08:57:48.963 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T08:57:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T08:57:49.173 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T08:57:50.358 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T08:57:50.487 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T08:57:51.790 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T08:57:51.922 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T08:57:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T08:57:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T08:57:55.312 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T08:57:55.438 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T08:57:56.765 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T08:57:56.883 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T08:57:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T08:58:00.268 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T08:58:01.734 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T08:58:37.213 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T08:58:37.254 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T08:58:37.521 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T08:58:37.521 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T08:58:37.521 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T08:58:37.521 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T08:58:38.354 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T08:58:38.355 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T08:58:38.355 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-14T08:58:38.355 INFO:teuthology.orchestra.run.smithi144.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T08:58:38.355 INFO:teuthology.orchestra.run.smithi144.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T08:58:38.355 INFO:teuthology.orchestra.run.smithi144.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T08:58:38.355 INFO:teuthology.orchestra.run.smithi144.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T08:58:38.355 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T08:58:38.355 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T08:58:38.617 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T08:58:38.664 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T08:58:38.744 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T08:58:38.829 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T08:58:38.830 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T08:58:38.830 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T08:58:38.830 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T08:58:38.830 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T08:58:38.830 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-14T08:58:38.830 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi144.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T08:58:38.831 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T08:58:38.889 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T08:58:38.889 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T08:58:38.889 DEBUG:teuthology.orchestra.run.smithi144:> sudo rpm -qi grub2-tools 2024-09-14T08:58:38.930 INFO:teuthology.orchestra.run.smithi144.stdout:Name : grub2-tools 2024-09-14T08:58:38.930 INFO:teuthology.orchestra.run.smithi144.stdout:Epoch : 1 2024-09-14T08:58:38.930 INFO:teuthology.orchestra.run.smithi144.stdout:Version : 2.06 2024-09-14T08:58:38.930 INFO:teuthology.orchestra.run.smithi144.stdout:Release : 82.el9 2024-09-14T08:58:38.930 INFO:teuthology.orchestra.run.smithi144.stdout:Architecture: x86_64 2024-09-14T08:58:38.930 INFO:teuthology.orchestra.run.smithi144.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T08:58:38.930 INFO:teuthology.orchestra.run.smithi144.stdout:Group : Unspecified 2024-09-14T08:58:38.930 INFO:teuthology.orchestra.run.smithi144.stdout:Size : 8274670 2024-09-14T08:58:38.930 INFO:teuthology.orchestra.run.smithi144.stdout:License : GPLv3+ 2024-09-14T08:58:38.931 INFO:teuthology.orchestra.run.smithi144.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T08:58:38.931 INFO:teuthology.orchestra.run.smithi144.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T08:58:38.931 INFO:teuthology.orchestra.run.smithi144.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T08:58:38.931 INFO:teuthology.orchestra.run.smithi144.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T08:58:38.931 INFO:teuthology.orchestra.run.smithi144.stdout:Packager : builder@centos.org 2024-09-14T08:58:38.931 INFO:teuthology.orchestra.run.smithi144.stdout:Vendor : CentOS 2024-09-14T08:58:38.931 INFO:teuthology.orchestra.run.smithi144.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T08:58:38.931 INFO:teuthology.orchestra.run.smithi144.stdout:Summary : Support tools for GRUB. 2024-09-14T08:58:38.931 INFO:teuthology.orchestra.run.smithi144.stdout:Description : 2024-09-14T08:58:38.931 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T08:58:38.931 INFO:teuthology.orchestra.run.smithi144.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T08:58:38.931 INFO:teuthology.orchestra.run.smithi144.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T08:58:38.931 INFO:teuthology.orchestra.run.smithi144.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T08:58:38.931 INFO:teuthology.orchestra.run.smithi144.stdout:hardware devices. 2024-09-14T08:58:38.932 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T08:58:38.932 INFO:teuthology.orchestra.run.smithi144.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T08:58:38.933 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T08:58:38.933 INFO:teuthology.task.kernel:Updating grub on smithi144 to boot 5.14.0-505.el9.x86_64 2024-09-14T08:58:38.933 DEBUG:teuthology.orchestra.run.smithi144:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T08:58:39.031 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T08:58:39.031 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T08:58:39.031 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T08:58:39.031 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T08:58:39.625 INFO:teuthology.orchestra.run.smithi144.stderr:Generating grub configuration file ... 2024-09-14T08:58:39.852 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T08:58:39.891 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T08:58:39.899 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T08:58:39.899 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T08:58:39.899 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T08:58:39.900 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T08:58:39.900 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T08:58:39.900 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T08:58:39.900 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T08:58:39.900 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T08:58:39.900 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T08:58:40.193 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T08:58:40.193 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T08:58:40.193 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T08:58:40.193 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T08:58:40.264 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T08:58:40.350 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T08:58:40.350 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T08:58:40.350 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T08:58:40.350 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T08:58:40.350 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T08:58:40.351 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-14T08:58:40.351 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi116.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T08:58:40.351 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T08:58:40.408 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T08:58:40.409 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T08:58:40.409 DEBUG:teuthology.orchestra.run.smithi116:> sudo rpm -qi grub2-tools 2024-09-14T08:58:40.440 INFO:teuthology.orchestra.run.smithi116.stdout:Name : grub2-tools 2024-09-14T08:58:40.440 INFO:teuthology.orchestra.run.smithi116.stdout:Epoch : 1 2024-09-14T08:58:40.440 INFO:teuthology.orchestra.run.smithi116.stdout:Version : 2.06 2024-09-14T08:58:40.440 INFO:teuthology.orchestra.run.smithi116.stdout:Release : 82.el9 2024-09-14T08:58:40.440 INFO:teuthology.orchestra.run.smithi116.stdout:Architecture: x86_64 2024-09-14T08:58:40.440 INFO:teuthology.orchestra.run.smithi116.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T08:58:40.441 INFO:teuthology.orchestra.run.smithi116.stdout:Group : Unspecified 2024-09-14T08:58:40.441 INFO:teuthology.orchestra.run.smithi116.stdout:Size : 8274670 2024-09-14T08:58:40.441 INFO:teuthology.orchestra.run.smithi116.stdout:License : GPLv3+ 2024-09-14T08:58:40.441 INFO:teuthology.orchestra.run.smithi116.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T08:58:40.441 INFO:teuthology.orchestra.run.smithi116.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T08:58:40.441 INFO:teuthology.orchestra.run.smithi116.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T08:58:40.441 INFO:teuthology.orchestra.run.smithi116.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T08:58:40.441 INFO:teuthology.orchestra.run.smithi116.stdout:Packager : builder@centos.org 2024-09-14T08:58:40.441 INFO:teuthology.orchestra.run.smithi116.stdout:Vendor : CentOS 2024-09-14T08:58:40.441 INFO:teuthology.orchestra.run.smithi116.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T08:58:40.441 INFO:teuthology.orchestra.run.smithi116.stdout:Summary : Support tools for GRUB. 2024-09-14T08:58:40.441 INFO:teuthology.orchestra.run.smithi116.stdout:Description : 2024-09-14T08:58:40.441 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T08:58:40.441 INFO:teuthology.orchestra.run.smithi116.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T08:58:40.441 INFO:teuthology.orchestra.run.smithi116.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T08:58:40.441 INFO:teuthology.orchestra.run.smithi116.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T08:58:40.442 INFO:teuthology.orchestra.run.smithi116.stdout:hardware devices. 2024-09-14T08:58:40.442 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T08:58:40.442 INFO:teuthology.orchestra.run.smithi116.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T08:58:40.442 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T08:58:40.443 INFO:teuthology.task.kernel:Updating grub on smithi116 to boot 5.14.0-505.el9.x86_64 2024-09-14T08:58:40.443 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T08:58:40.933 INFO:teuthology.orchestra.run.smithi144.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T08:58:40.981 INFO:teuthology.orchestra.run.smithi144.stderr:done 2024-09-14T08:58:40.984 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2024-09-14T08:58:41.000 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.gQIQeqCBnp 2024-09-14T08:58:41.000 DEBUG:teuthology.orchestra.run.smithi144:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.gQIQeqCBnp 2024-09-14T08:58:41.025 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T08:58:41.025 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T08:58:41.025 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-14T08:58:41.025 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T08:58:41.025 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T08:58:41.026 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T08:58:41.026 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T08:58:41.026 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T08:58:41.026 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T08:58:41.072 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.gQIQeqCBnp 2024-09-14T08:58:41.075 INFO:teuthology.orchestra.run.smithi116.stderr:Generating grub configuration file ... 2024-09-14T08:58:41.215 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.gQIQeqCBnp is 6KB 2024-09-14T08:58:41.262 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.gQIQeqCBnp 2024-09-14T08:58:41.277 DEBUG:teuthology.orchestra.run.smithi144:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T08:58:41.345 INFO:teuthology.orchestra.run.smithi144.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T08:58:41.345 INFO:teuthology.orchestra.run.smithi144.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T08:58:41.345 INFO:teuthology.orchestra.run.smithi144.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T08:58:41.345 INFO:teuthology.orchestra.run.smithi144.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T08:58:41.347 DEBUG:teuthology.orchestra.run.smithi144:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T08:58:41.402 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T08:58:41.489 DEBUG:teuthology.orchestra.run.smithi144:> sudo shutdown -r now 2024-09-14T08:58:41.490 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T08:58:41.491 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T08:58:41.491 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T08:58:41.491 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T08:58:41.491 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T08:58:41.491 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-14T08:58:41.491 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi148.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T08:58:41.491 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T08:58:41.550 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T08:58:41.550 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T08:58:41.551 DEBUG:teuthology.orchestra.run.smithi148:> sudo rpm -qi grub2-tools 2024-09-14T08:58:41.583 INFO:teuthology.orchestra.run.smithi148.stdout:Name : grub2-tools 2024-09-14T08:58:41.583 INFO:teuthology.orchestra.run.smithi148.stdout:Epoch : 1 2024-09-14T08:58:41.583 INFO:teuthology.orchestra.run.smithi148.stdout:Version : 2.06 2024-09-14T08:58:41.583 INFO:teuthology.orchestra.run.smithi148.stdout:Release : 82.el9 2024-09-14T08:58:41.583 INFO:teuthology.orchestra.run.smithi148.stdout:Architecture: x86_64 2024-09-14T08:58:41.583 INFO:teuthology.orchestra.run.smithi148.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T08:58:41.584 INFO:teuthology.orchestra.run.smithi148.stdout:Group : Unspecified 2024-09-14T08:58:41.584 INFO:teuthology.orchestra.run.smithi148.stdout:Size : 8274670 2024-09-14T08:58:41.584 INFO:teuthology.orchestra.run.smithi148.stdout:License : GPLv3+ 2024-09-14T08:58:41.584 INFO:teuthology.orchestra.run.smithi148.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T08:58:41.584 INFO:teuthology.orchestra.run.smithi148.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T08:58:41.584 INFO:teuthology.orchestra.run.smithi148.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T08:58:41.584 INFO:teuthology.orchestra.run.smithi148.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T08:58:41.584 INFO:teuthology.orchestra.run.smithi148.stdout:Packager : builder@centos.org 2024-09-14T08:58:41.584 INFO:teuthology.orchestra.run.smithi148.stdout:Vendor : CentOS 2024-09-14T08:58:41.584 INFO:teuthology.orchestra.run.smithi148.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T08:58:41.584 INFO:teuthology.orchestra.run.smithi148.stdout:Summary : Support tools for GRUB. 2024-09-14T08:58:41.584 INFO:teuthology.orchestra.run.smithi148.stdout:Description : 2024-09-14T08:58:41.584 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T08:58:41.585 INFO:teuthology.orchestra.run.smithi148.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T08:58:41.585 INFO:teuthology.orchestra.run.smithi148.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T08:58:41.585 INFO:teuthology.orchestra.run.smithi148.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T08:58:41.585 INFO:teuthology.orchestra.run.smithi148.stdout:hardware devices. 2024-09-14T08:58:41.585 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T08:58:41.585 INFO:teuthology.orchestra.run.smithi148.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T08:58:41.586 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T08:58:41.586 INFO:teuthology.task.kernel:Updating grub on smithi148 to boot 5.14.0-505.el9.x86_64 2024-09-14T08:58:41.586 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T08:58:42.235 INFO:teuthology.orchestra.run.smithi148.stderr:Generating grub configuration file ... 2024-09-14T08:58:42.406 INFO:teuthology.orchestra.run.smithi116.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T08:58:42.437 INFO:teuthology.orchestra.run.smithi116.stderr:done 2024-09-14T08:58:42.440 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2024-09-14T08:58:42.455 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.CZjoP6dUSt 2024-09-14T08:58:42.456 DEBUG:teuthology.orchestra.run.smithi116:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.CZjoP6dUSt 2024-09-14T08:58:42.522 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.CZjoP6dUSt 2024-09-14T08:58:42.667 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.CZjoP6dUSt is 6KB 2024-09-14T08:58:42.716 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.CZjoP6dUSt 2024-09-14T08:58:42.731 DEBUG:teuthology.orchestra.run.smithi116:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T08:58:42.793 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T08:58:42.793 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T08:58:42.794 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T08:58:42.794 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T08:58:42.795 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T08:58:42.946 DEBUG:teuthology.orchestra.run.smithi116:> sudo shutdown -r now 2024-09-14T08:58:43.566 INFO:teuthology.orchestra.run.smithi148.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T08:58:43.595 INFO:teuthology.orchestra.run.smithi148.stderr:done 2024-09-14T08:58:43.597 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2024-09-14T08:58:43.613 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.G7J9Mhv1q5 2024-09-14T08:58:43.613 DEBUG:teuthology.orchestra.run.smithi148:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.G7J9Mhv1q5 2024-09-14T08:58:43.688 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.G7J9Mhv1q5 2024-09-14T08:58:43.824 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.G7J9Mhv1q5 is 6KB 2024-09-14T08:58:43.873 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.G7J9Mhv1q5 2024-09-14T08:58:43.888 DEBUG:teuthology.orchestra.run.smithi148:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T08:58:43.951 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T08:58:43.951 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T08:58:43.951 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T08:58:43.951 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T08:58:43.953 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T08:58:44.108 DEBUG:teuthology.orchestra.run.smithi148:> sudo shutdown -r now 2024-09-14T08:59:11.495 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-14T08:59:11.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-14T08:59:11.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:59:12.951 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-14T08:59:12.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-14T08:59:12.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:59:14.112 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-14T08:59:14.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-14T08:59:14.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:59:29.981 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2024-09-14T08:59:31.517 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-09-14T08:59:32.545 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-09-14T08:59:38.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-14T08:59:38.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:59:40.519 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-14T08:59:40.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:59:41.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-14T08:59:41.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:59:42.045 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2024-09-14T08:59:43.585 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-09-14T08:59:44.609 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-09-14T08:59:54.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-14T08:59:54.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:59:55.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-14T08:59:55.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T08:59:56.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-14T08:59:56.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T09:00:12.477 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2024-09-14T09:00:15.037 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-09-14T09:00:27.389 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-09-14T09:00:27.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-14T09:00:27.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T09:00:27.862 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-09-14T09:00:27.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-14T09:00:27.909 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-14T09:00:27.912 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-09-14T09:00:27.962 INFO:teuthology.orchestra.run.smithi116.stdout:5.14.0-505.el9.x86_64 2024-09-14T09:00:27.962 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T09:00:27.962 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T09:00:27.962 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T09:00:28.282 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-14T09:00:28.282 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-14T09:00:28.282 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2024-09-14T09:00:28.297 INFO:teuthology.orchestra.run.smithi144.stdout:5.14.0-505.el9.x86_64 2024-09-14T09:00:28.297 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T09:00:28.297 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T09:00:28.298 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T09:00:28.963 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-14T09:00:28.963 DEBUG:teuthology.orchestra.run.smithi116:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T09:00:29.031 INFO:teuthology.orchestra.run.smithi116.stdout:ttyS1 2024-09-14T09:00:29.066 DEBUG:teuthology.parallel:result is None 2024-09-14T09:00:29.299 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-14T09:00:29.299 DEBUG:teuthology.orchestra.run.smithi144:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T09:00:29.405 INFO:teuthology.orchestra.run.smithi144.stdout:ttyS1 2024-09-14T09:00:29.431 DEBUG:teuthology.parallel:result is None 2024-09-14T09:00:30.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-14T09:00:30.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T09:00:30.462 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-09-14T09:00:30.875 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-14T09:00:30.875 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-14T09:00:30.875 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-09-14T09:00:30.890 INFO:teuthology.orchestra.run.smithi148.stdout:5.14.0-505.el9.x86_64 2024-09-14T09:00:30.890 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T09:00:30.890 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T09:00:30.891 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T09:00:31.891 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2024-09-14T09:00:31.892 DEBUG:teuthology.orchestra.run.smithi148:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T09:00:32.003 INFO:teuthology.orchestra.run.smithi148.stdout:ttyS1 2024-09-14T09:00:32.031 DEBUG:teuthology.parallel:result is None 2024-09-14T09:00:32.031 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-14T09:00:32.038 INFO:teuthology.task.internal:Creating test directory... 2024-09-14T09:00:32.039 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T09:00:32.041 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T09:00:32.044 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T09:00:32.059 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-14T09:00:32.070 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-14T09:00:32.084 INFO:teuthology.task.internal:Creating archive directory... 2024-09-14T09:00:32.085 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T09:00:32.101 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T09:00:32.103 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T09:00:32.144 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-14T09:00:32.154 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-14T09:00:32.154 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T09:00:32.168 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T09:00:32.180 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T09:00:32.202 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T09:00:32.209 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T09:00:32.211 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T09:00:32.213 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T09:00:32.220 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T09:00:32.221 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T09:00:32.223 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-14T09:00:32.232 INFO:teuthology.task.internal:Configuring sudo... 2024-09-14T09:00:32.232 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T09:00:32.257 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T09:00:32.265 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T09:00:32.291 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-14T09:00:32.300 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-14T09:00:32.300 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T09:00:32.324 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T09:00:32.330 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T09:00:32.346 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T09:00:32.422 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T09:00:32.465 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T09:00:32.549 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T09:00:32.588 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T09:00:32.588 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T09:00:32.653 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T09:00:32.695 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T09:00:32.740 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T09:00:32.823 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T09:00:32.863 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-14T09:00:32.863 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T09:00:32.927 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T09:00:33.005 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T09:00:33.064 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T09:00:33.130 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T09:00:33.197 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T09:00:33.197 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T09:00:33.256 DEBUG:teuthology.orchestra.run.smithi116:> sudo service rsyslog restart 2024-09-14T09:00:33.258 DEBUG:teuthology.orchestra.run.smithi144:> sudo service rsyslog restart 2024-09-14T09:00:33.260 DEBUG:teuthology.orchestra.run.smithi148:> sudo service rsyslog restart 2024-09-14T09:00:33.301 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T09:00:33.302 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T09:00:33.389 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T09:00:33.816 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-14T09:00:33.825 INFO:teuthology.task.internal:Starting timer... 2024-09-14T09:00:33.825 INFO:teuthology.run_tasks:Running task pcp... 2024-09-14T09:00:33.841 INFO:teuthology.run_tasks:Running task selinux... 2024-09-14T09:00:33.855 DEBUG:teuthology.orchestra.run.smithi116:> sudo service auditd rotate 2024-09-14T09:00:33.925 INFO:teuthology.orchestra.run.smithi116.stdout:Rotating logs: 2024-09-14T09:00:33.927 DEBUG:teuthology.orchestra.run.smithi144:> sudo service auditd rotate 2024-09-14T09:00:33.982 INFO:teuthology.orchestra.run.smithi144.stdout:Rotating logs: 2024-09-14T09:00:33.984 DEBUG:teuthology.orchestra.run.smithi148:> sudo service auditd rotate 2024-09-14T09:00:34.138 INFO:teuthology.orchestra.run.smithi148.stdout:Rotating logs: 2024-09-14T09:00:34.141 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-14T09:00:34.141 DEBUG:teuthology.orchestra.run.smithi116:> /usr/sbin/getenforce 2024-09-14T09:00:34.169 INFO:teuthology.orchestra.run.smithi116.stdout:Permissive 2024-09-14T09:00:34.169 DEBUG:teuthology.orchestra.run.smithi144:> /usr/sbin/getenforce 2024-09-14T09:00:34.200 INFO:teuthology.orchestra.run.smithi144.stdout:Permissive 2024-09-14T09:00:34.201 DEBUG:teuthology.orchestra.run.smithi148:> /usr/sbin/getenforce 2024-09-14T09:00:34.254 INFO:teuthology.orchestra.run.smithi148.stdout:Permissive 2024-09-14T09:00:34.254 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi116.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi144.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi148.front.sepia.ceph.com': 'permissive'} 2024-09-14T09:00:34.254 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T09:00:34.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T09:00:34.282 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T09:00:34.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T09:00:34.308 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T09:00:34.333 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T09:00:34.333 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-14T09:00:34.333 DEBUG:teuthology.orchestra.run.smithi116:> sudo /usr/sbin/setenforce permissive 2024-09-14T09:00:34.365 DEBUG:teuthology.orchestra.run.smithi144:> sudo /usr/sbin/setenforce permissive 2024-09-14T09:00:34.400 DEBUG:teuthology.orchestra.run.smithi148:> sudo /usr/sbin/setenforce permissive 2024-09-14T09:00:34.434 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-14T09:00:34.444 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-14T09:00:34.454 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-14T09:00:34.455 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi116.front.sepia.ceph.com,smithi144.front.sepia.ceph.com,smithi148.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-14T09:04:23.236 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi116.front.sepia.ceph.com'), Remote(name='ubuntu@smithi144.front.sepia.ceph.com'), Remote(name='ubuntu@smithi148.front.sepia.ceph.com')] 2024-09-14T09:04:23.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-14T09:04:23.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T09:04:23.314 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-09-14T09:04:23.396 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-14T09:04:23.396 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-14T09:04:23.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T09:04:23.472 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-09-14T09:04:23.557 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-14T09:04:23.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-14T09:04:23.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T09:04:23.638 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-09-14T09:04:23.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-14T09:04:23.732 INFO:teuthology.run_tasks:Running task clock... 2024-09-14T09:04:23.748 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-14T09:04:23.749 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T09:04:23.749 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T09:04:23.752 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T09:04:23.753 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T09:04:23.756 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T09:04:23.757 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T09:04:23.781 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T09:04:23.787 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T09:04:23.796 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T09:04:23.802 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T09:04:23.802 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T09:04:23.817 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T09:04:23.821 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: ntpd: command not found 2024-09-14T09:04:23.827 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: ntpd: command not found 2024-09-14T09:04:23.832 INFO:teuthology.orchestra.run.smithi116.stdout:506 Cannot talk to daemon 2024-09-14T09:04:23.838 INFO:teuthology.orchestra.run.smithi144.stdout:506 Cannot talk to daemon 2024-09-14T09:04:23.843 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: ntpd: command not found 2024-09-14T09:04:23.846 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T09:04:23.853 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T09:04:23.855 INFO:teuthology.orchestra.run.smithi148.stdout:506 Cannot talk to daemon 2024-09-14T09:04:23.860 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T09:04:23.867 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T09:04:23.869 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T09:04:23.884 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T09:04:23.917 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: ntpq: command not found 2024-09-14T09:04:23.921 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T09:04:23.921 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2024-09-14T09:04:23.921 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T09:04:23.921 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T09:04:23.921 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T09:04:23.921 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T09:04:23.924 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2024-09-14T09:04:23.927 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T09:04:23.927 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-09-14T09:04:23.927 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T09:04:23.928 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T09:04:23.928 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T09:04:23.928 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T09:04:23.941 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-09-14T09:04:23.944 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T09:04:23.945 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-09-14T09:04:23.945 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T09:04:23.945 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T09:04:23.945 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T09:04:23.945 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T09:04:23.946 INFO:teuthology.run_tasks:Running task install... 2024-09-14T09:04:23.953 DEBUG:teuthology.task.install:project ceph 2024-09-14T09:04:23.954 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'extra_packages': ['rbd-nbd'], 'flavor': 'default', 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}} 2024-09-14T09:04:23.954 DEBUG:teuthology.task.install:config {'extra_packages': ['rbd-nbd'], 'flavor': 'default', 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'} 2024-09-14T09:04:23.954 INFO:teuthology.task.install:Using flavor: default 2024-09-14T09:04:23.959 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-14T09:04:23.960 INFO:teuthology.task.install:extra packages: ['rbd-nbd'] 2024-09-14T09:04:23.960 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['rbd-nbd'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47', 'tag': None, 'wait_for_package': False} 2024-09-14T09:04:23.960 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T09:04:23.962 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['rbd-nbd'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47', 'tag': None, 'wait_for_package': False} 2024-09-14T09:04:23.962 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T09:04:23.963 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['rbd-nbd'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47', 'tag': None, 'wait_for_package': False} 2024-09-14T09:04:23.963 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T09:04:24.108 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/ 2024-09-14T09:04:24.108 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4775.g7f24e589 2024-09-14T09:04:24.115 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/ 2024-09-14T09:04:24.115 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4775.g7f24e589 2024-09-14T09:04:24.126 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/ 2024-09-14T09:04:24.126 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4775.g7f24e589 2024-09-14T09:04:24.218 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T09:04:24.218 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T09:04:24.218 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T09:04:24.224 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T09:04:24.224 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T09:04:24.224 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T09:04:24.235 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T09:04:24.235 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-14T09:04:24.235 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T09:04:24.244 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, rbd-nbd on remote rpm x86_64 2024-09-14T09:04:24.244 DEBUG:teuthology.orchestra.run.smithi148:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7f24e589328ae9e639c0009d93340e5b235d0a47/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T09:04:24.250 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, rbd-nbd on remote rpm x86_64 2024-09-14T09:04:24.250 DEBUG:teuthology.orchestra.run.smithi116:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7f24e589328ae9e639c0009d93340e5b235d0a47/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T09:04:24.260 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, rbd-nbd on remote rpm x86_64 2024-09-14T09:04:24.261 DEBUG:teuthology.orchestra.run.smithi144:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7f24e589328ae9e639c0009d93340e5b235d0a47/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T09:04:24.309 DEBUG:teuthology.orchestra.run.smithi148:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T09:04:24.316 DEBUG:teuthology.orchestra.run.smithi116:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T09:04:24.326 DEBUG:teuthology.orchestra.run.smithi144:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T09:04:24.385 DEBUG:teuthology.orchestra.run.smithi148:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T09:04:24.390 DEBUG:teuthology.orchestra.run.smithi116:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T09:04:24.400 DEBUG:teuthology.orchestra.run.smithi144:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T09:04:24.449 INFO:teuthology.orchestra.run.smithi148.stdout:check_obsoletes = 1 2024-09-14T09:04:24.450 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum clean all 2024-09-14T09:04:24.455 INFO:teuthology.orchestra.run.smithi116.stdout:check_obsoletes = 1 2024-09-14T09:04:24.458 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum clean all 2024-09-14T09:04:24.464 INFO:teuthology.orchestra.run.smithi144.stdout:check_obsoletes = 1 2024-09-14T09:04:24.466 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum clean all 2024-09-14T09:04:24.676 INFO:teuthology.orchestra.run.smithi148.stdout:45 files removed 2024-09-14T09:04:24.688 INFO:teuthology.orchestra.run.smithi116.stdout:45 files removed 2024-09-14T09:04:24.690 INFO:teuthology.orchestra.run.smithi144.stdout:45 files removed 2024-09-14T09:04:24.703 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-radosgw 2024-09-14T09:04:24.714 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-radosgw 2024-09-14T09:04:24.717 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-radosgw 2024-09-14T09:04:25.249 INFO:teuthology.orchestra.run.smithi148.stdout:ceph packages for x86_64 323 kB/s | 84 kB 00:00 2024-09-14T09:04:25.261 INFO:teuthology.orchestra.run.smithi116.stdout:ceph packages for x86_64 318 kB/s | 84 kB 00:00 2024-09-14T09:04:25.283 INFO:teuthology.orchestra.run.smithi144.stdout:ceph packages for x86_64 299 kB/s | 84 kB 00:00 2024-09-14T09:04:25.535 INFO:teuthology.orchestra.run.smithi148.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-09-14T09:04:25.545 INFO:teuthology.orchestra.run.smithi116.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-09-14T09:04:25.584 INFO:teuthology.orchestra.run.smithi144.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-14T09:04:25.793 INFO:teuthology.orchestra.run.smithi148.stdout:ceph source packages 8.7 kB/s | 1.9 kB 00:00 2024-09-14T09:04:25.804 INFO:teuthology.orchestra.run.smithi116.stdout:ceph source packages 8.7 kB/s | 1.9 kB 00:00 2024-09-14T09:04:25.859 INFO:teuthology.orchestra.run.smithi144.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-14T09:04:26.243 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.2 MB 00:00 2024-09-14T09:04:26.429 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-14T09:04:26.559 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-14T09:04:28.402 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-14T09:04:28.711 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 15 MB/s | 20 MB 00:01 2024-09-14T09:04:30.888 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - AppStream 6.1 MB/s | 20 MB 00:03 2024-09-14T09:04:33.053 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-14T09:04:33.253 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - CRB 6.2 MB/s | 6.5 MB 00:01 2024-09-14T09:04:34.721 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 89 kB/s | 19 kB 00:00 2024-09-14T09:04:35.517 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-14T09:04:35.645 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-14T09:04:36.733 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-14T09:04:37.731 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - CRB 2.1 MB/s | 6.5 MB 00:03 2024-09-14T09:04:39.240 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - Extras packages 103 kB/s | 19 kB 00:00 2024-09-14T09:04:40.319 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-14T09:04:41.008 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-14T09:04:42.222 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-14T09:04:43.410 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:04:43.423 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:04:43.423 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-14T09:04:43.423 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:04:43.423 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-14T09:04:43.424 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 11 M 2024-09-14T09:04:43.424 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrading: 2024-09-14T09:04:43.424 INFO:teuthology.orchestra.run.smithi148.stdout: librados2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.5 M 2024-09-14T09:04:43.424 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.2 M 2024-09-14T09:04:43.424 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-14T09:04:43.424 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T09:04:43.424 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 5.5 M 2024-09-14T09:04:43.424 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 22 M 2024-09-14T09:04:43.424 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 25 k 2024-09-14T09:04:43.424 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T09:04:43.424 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T09:04:43.424 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T09:04:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 755 k 2024-09-14T09:04:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T09:04:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T09:04:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T09:04:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T09:04:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 508 k 2024-09-14T09:04:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T09:04:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 5.5 M 2024-09-14T09:04:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T09:04:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T09:04:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T09:04:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 45 k 2024-09-14T09:04:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 143 k 2024-09-14T09:04:43.425 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 161 k 2024-09-14T09:04:43.426 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T09:04:43.426 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 321 k 2024-09-14T09:04:43.426 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 306 k 2024-09-14T09:04:43.426 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 99 k 2024-09-14T09:04:43.426 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T09:04:43.426 INFO:teuthology.orchestra.run.smithi148.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T09:04:43.426 INFO:teuthology.orchestra.run.smithi148.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T09:04:43.426 INFO:teuthology.orchestra.run.smithi148.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T09:04:43.426 INFO:teuthology.orchestra.run.smithi148.stdout:Installing weak dependencies: 2024-09-14T09:04:43.427 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T09:04:43.427 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:04:43.427 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-14T09:04:43.427 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:04:43.427 INFO:teuthology.orchestra.run.smithi148.stdout:Install 31 Packages 2024-09-14T09:04:43.427 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrade 2 Packages 2024-09-14T09:04:43.427 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:04:43.428 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 62 M 2024-09-14T09:04:43.428 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-14T09:04:44.185 INFO:teuthology.orchestra.run.smithi148.stdout:(1/33): ceph-base-19.3.0-4775.g7f24e589.el9.x86 12 MB/s | 5.5 MB 00:00 2024-09-14T09:04:44.243 INFO:teuthology.orchestra.run.smithi148.stdout:(2/33): ceph-selinux-19.3.0-4775.g7f24e589.el9. 435 kB/s | 25 kB 00:00 2024-09-14T09:04:44.335 INFO:teuthology.orchestra.run.smithi148.stdout:(3/33): libcephfs2-19.3.0-4775.g7f24e589.el9.x8 8.1 MB/s | 755 kB 00:00 2024-09-14T09:04:44.427 INFO:teuthology.orchestra.run.smithi148.stdout:(4/33): libradosstriper1-19.3.0-4775.g7f24e589. 5.4 MB/s | 508 kB 00:00 2024-09-14T09:04:44.605 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:04:44.634 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:04:44.634 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2024-09-14T09:04:44.634 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:04:44.634 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-14T09:04:44.634 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 11 M 2024-09-14T09:04:44.634 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrading: 2024-09-14T09:04:44.634 INFO:teuthology.orchestra.run.smithi144.stdout: librados2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.5 M 2024-09-14T09:04:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.2 M 2024-09-14T09:04:44.635 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2024-09-14T09:04:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T09:04:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 5.5 M 2024-09-14T09:04:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 22 M 2024-09-14T09:04:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 25 k 2024-09-14T09:04:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T09:04:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T09:04:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T09:04:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 755 k 2024-09-14T09:04:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T09:04:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T09:04:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T09:04:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T09:04:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 508 k 2024-09-14T09:04:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T09:04:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 5.5 M 2024-09-14T09:04:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T09:04:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T09:04:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T09:04:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 45 k 2024-09-14T09:04:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 143 k 2024-09-14T09:04:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 161 k 2024-09-14T09:04:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T09:04:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 321 k 2024-09-14T09:04:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 306 k 2024-09-14T09:04:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 99 k 2024-09-14T09:04:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T09:04:44.637 INFO:teuthology.orchestra.run.smithi144.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T09:04:44.637 INFO:teuthology.orchestra.run.smithi144.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T09:04:44.637 INFO:teuthology.orchestra.run.smithi144.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T09:04:44.637 INFO:teuthology.orchestra.run.smithi144.stdout:Installing weak dependencies: 2024-09-14T09:04:44.637 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T09:04:44.637 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:04:44.637 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-14T09:04:44.637 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:04:44.637 INFO:teuthology.orchestra.run.smithi144.stdout:Install 31 Packages 2024-09-14T09:04:44.637 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrade 2 Packages 2024-09-14T09:04:44.637 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:04:44.638 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 62 M 2024-09-14T09:04:44.638 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-14T09:04:44.752 INFO:teuthology.orchestra.run.smithi148.stdout:(5/33): librgw2-19.3.0-4775.g7f24e589.el9.x86_6 17 MB/s | 5.5 MB 00:00 2024-09-14T09:04:44.969 INFO:teuthology.orchestra.run.smithi148.stdout:(6/33): ceph-common-19.3.0-4775.g7f24e589.el9.x 18 MB/s | 22 MB 00:01 2024-09-14T09:04:44.994 INFO:teuthology.orchestra.run.smithi148.stdout:(7/33): python3-ceph-argparse-19.3.0-4775.g7f24 186 kB/s | 45 kB 00:00 2024-09-14T09:04:45.019 INFO:teuthology.orchestra.run.smithi148.stdout:(8/33): python3-ceph-common-19.3.0-4775.g7f24e5 2.8 MB/s | 143 kB 00:00 2024-09-14T09:04:45.137 INFO:teuthology.orchestra.run.smithi148.stdout:(9/33): ceph-radosgw-19.3.0-4775.g7f24e589.el9. 7.8 MB/s | 11 MB 00:01 2024-09-14T09:04:45.170 INFO:teuthology.orchestra.run.smithi148.stdout:(10/33): python3-cephfs-19.3.0-4775.g7f24e589.e 919 kB/s | 161 kB 00:00 2024-09-14T09:04:45.195 INFO:teuthology.orchestra.run.smithi148.stdout:(11/33): python3-rados-19.3.0-4775.g7f24e589.el 1.8 MB/s | 321 kB 00:00 2024-09-14T09:04:45.220 INFO:teuthology.orchestra.run.smithi148.stdout:(12/33): python3-rbd-19.3.0-4775.g7f24e589.el9. 3.6 MB/s | 306 kB 00:00 2024-09-14T09:04:45.246 INFO:teuthology.orchestra.run.smithi148.stdout:(13/33): python3-rgw-19.3.0-4775.g7f24e589.el9. 1.3 MB/s | 99 kB 00:00 2024-09-14T09:04:45.388 INFO:teuthology.orchestra.run.smithi148.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 556 kB/s | 107 kB 00:00 2024-09-14T09:04:45.421 INFO:teuthology.orchestra.run.smithi148.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 851 kB/s | 171 kB 00:00 2024-09-14T09:04:45.446 INFO:teuthology.orchestra.run.smithi148.stdout:(16/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 799 kB/s | 160 kB 00:00 2024-09-14T09:04:45.472 INFO:teuthology.orchestra.run.smithi148.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 540 kB/s | 45 kB 00:00 2024-09-14T09:04:45.523 INFO:teuthology.orchestra.run.smithi148.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 847 kB/s | 42 kB 00:00 2024-09-14T09:04:45.547 INFO:teuthology.orchestra.run.smithi148.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-14T09:04:45.581 INFO:teuthology.orchestra.run.smithi148.stdout:(20/33): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-14T09:04:45.606 INFO:teuthology.orchestra.run.smithi148.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 614 kB/s | 36 kB 00:00 2024-09-14T09:04:45.640 INFO:teuthology.orchestra.run.smithi148.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 812 kB/s | 47 kB 00:00 2024-09-14T09:04:45.665 INFO:teuthology.orchestra.run.smithi148.stdout:(23/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-09-14T09:04:45.700 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-14T09:04:45.716 INFO:teuthology.orchestra.run.smithi148.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-14T09:04:45.741 INFO:teuthology.orchestra.run.smithi148.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-14T09:04:45.767 INFO:teuthology.orchestra.run.smithi148.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 279 kB/s | 26 kB 00:00 2024-09-14T09:04:45.792 INFO:teuthology.orchestra.run.smithi148.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-14T09:04:45.833 INFO:teuthology.orchestra.run.smithi148.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-14T09:04:45.884 INFO:teuthology.orchestra.run.smithi148.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-14T09:04:45.942 INFO:teuthology.orchestra.run.smithi148.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-14T09:04:46.034 INFO:teuthology.orchestra.run.smithi148.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-14T09:04:46.039 INFO:teuthology.orchestra.run.smithi144.stdout:(1/33): ceph-base-19.3.0-4775.g7f24e589.el9.x86 7.0 MB/s | 5.5 MB 00:00 2024-09-14T09:04:46.106 INFO:teuthology.orchestra.run.smithi144.stdout:(2/33): ceph-selinux-19.3.0-4775.g7f24e589.el9. 380 kB/s | 25 kB 00:00 2024-09-14T09:04:46.185 INFO:teuthology.orchestra.run.smithi148.stdout:(32/33): librados2-19.3.0-4775.g7f24e589.el9.x8 12 MB/s | 3.5 MB 00:00 2024-09-14T09:04:46.277 INFO:teuthology.orchestra.run.smithi148.stdout:(33/33): librbd1-19.3.0-4775.g7f24e589.el9.x86_ 9.7 MB/s | 3.2 MB 00:00 2024-09-14T09:04:46.281 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:04:46.281 INFO:teuthology.orchestra.run.smithi148.stdout:Total 22 MB/s | 62 MB 00:02 2024-09-14T09:04:46.357 INFO:teuthology.orchestra.run.smithi144.stdout:(3/33): ceph-radosgw-19.3.0-4775.g7f24e589.el9. 9.9 MB/s | 11 MB 00:01 2024-09-14T09:04:46.391 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-14T09:04:46.427 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-14T09:04:46.427 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-14T09:04:46.565 INFO:teuthology.orchestra.run.smithi144.stdout:(4/33): ceph-common-19.3.0-4775.g7f24e589.el9.x 16 MB/s | 22 MB 00:01 2024-09-14T09:04:46.607 INFO:teuthology.orchestra.run.smithi144.stdout:(5/33): libcephfs2-19.3.0-4775.g7f24e589.el9.x8 1.5 MB/s | 755 kB 00:00 2024-09-14T09:04:46.632 INFO:teuthology.orchestra.run.smithi144.stdout:(6/33): libradosstriper1-19.3.0-4775.g7f24e589. 1.8 MB/s | 508 kB 00:00 2024-09-14T09:04:46.674 INFO:teuthology.orchestra.run.smithi144.stdout:(7/33): python3-ceph-argparse-19.3.0-4775.g7f24 674 kB/s | 45 kB 00:00 2024-09-14T09:04:46.699 INFO:teuthology.orchestra.run.smithi144.stdout:(8/33): python3-ceph-common-19.3.0-4775.g7f24e5 2.1 MB/s | 143 kB 00:00 2024-09-14T09:04:46.733 INFO:teuthology.orchestra.run.smithi144.stdout:(9/33): python3-cephfs-19.3.0-4775.g7f24e589.el 2.7 MB/s | 161 kB 00:00 2024-09-14T09:04:46.817 INFO:teuthology.orchestra.run.smithi144.stdout:(10/33): librgw2-19.3.0-4775.g7f24e589.el9.x86_ 22 MB/s | 5.5 MB 00:00 2024-09-14T09:04:46.842 INFO:teuthology.orchestra.run.smithi144.stdout:(11/33): python3-rados-19.3.0-4775.g7f24e589.el 2.2 MB/s | 321 kB 00:00 2024-09-14T09:04:46.867 INFO:teuthology.orchestra.run.smithi144.stdout:(12/33): python3-rgw-19.3.0-4775.g7f24e589.el9. 1.9 MB/s | 99 kB 00:00 2024-09-14T09:04:46.892 INFO:teuthology.orchestra.run.smithi144.stdout:(13/33): python3-rbd-19.3.0-4775.g7f24e589.el9. 1.9 MB/s | 306 kB 00:00 2024-09-14T09:04:46.951 INFO:teuthology.orchestra.run.smithi144.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 982 kB/s | 107 kB 00:00 2024-09-14T09:04:46.993 INFO:teuthology.orchestra.run.smithi144.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 1.3 MB/s | 171 kB 00:00 2024-09-14T09:04:47.013 INFO:teuthology.orchestra.run.smithi144.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 729 kB/s | 45 kB 00:00 2024-09-14T09:04:47.093 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-14T09:04:47.093 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-14T09:04:47.119 INFO:teuthology.orchestra.run.smithi144.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 709 kB/s | 160 kB 00:00 2024-09-14T09:04:47.144 INFO:teuthology.orchestra.run.smithi144.stdout:(18/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.2 MB/s | 292 kB 00:00 2024-09-14T09:04:47.169 INFO:teuthology.orchestra.run.smithi144.stdout:(19/33): python3-prettytable-0.7.2-27.el9.noarc 843 kB/s | 42 kB 00:00 2024-09-14T09:04:47.194 INFO:teuthology.orchestra.run.smithi144.stdout:(20/33): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-14T09:04:47.219 INFO:teuthology.orchestra.run.smithi144.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 717 kB/s | 36 kB 00:00 2024-09-14T09:04:47.245 INFO:teuthology.orchestra.run.smithi144.stdout:(22/33): librdkafka-1.6.1-102.el9.x86_64.rpm 2.8 MB/s | 662 kB 00:00 2024-09-14T09:04:47.270 INFO:teuthology.orchestra.run.smithi144.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 626 kB/s | 47 kB 00:00 2024-09-14T09:04:47.329 INFO:teuthology.orchestra.run.smithi144.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-14T09:04:47.354 INFO:teuthology.orchestra.run.smithi144.stdout:(25/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 311 kB/s | 26 kB 00:00 2024-09-14T09:04:47.379 INFO:teuthology.orchestra.run.smithi144.stdout:(26/33): liboath-2.6.7-2.el9.x86_64.rpm 971 kB/s | 49 kB 00:00 2024-09-14T09:04:47.405 INFO:teuthology.orchestra.run.smithi144.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-14T09:04:47.438 INFO:teuthology.orchestra.run.smithi144.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-14T09:04:47.472 INFO:teuthology.orchestra.run.smithi144.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-14T09:04:47.581 INFO:teuthology.orchestra.run.smithi144.stdout:(30/33): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-14T09:04:47.622 INFO:teuthology.orchestra.run.smithi144.stdout:(31/33): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-09-14T09:04:47.939 INFO:teuthology.orchestra.run.smithi144.stdout:(32/33): librbd1-19.3.0-4775.g7f24e589.el9.x86_ 9.0 MB/s | 3.2 MB 00:00 2024-09-14T09:04:48.067 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:04:48.081 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:04:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-14T09:04:48.082 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:04:48.082 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T09:04:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 11 M 2024-09-14T09:04:48.082 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrading: 2024-09-14T09:04:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: librados2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.5 M 2024-09-14T09:04:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.2 M 2024-09-14T09:04:48.082 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-14T09:04:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T09:04:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 5.5 M 2024-09-14T09:04:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 22 M 2024-09-14T09:04:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 25 k 2024-09-14T09:04:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T09:04:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T09:04:48.082 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T09:04:48.083 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 755 k 2024-09-14T09:04:48.083 INFO:teuthology.orchestra.run.smithi116.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T09:04:48.083 INFO:teuthology.orchestra.run.smithi116.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T09:04:48.083 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T09:04:48.083 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T09:04:48.083 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 508 k 2024-09-14T09:04:48.083 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T09:04:48.083 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 5.5 M 2024-09-14T09:04:48.083 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T09:04:48.083 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T09:04:48.083 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T09:04:48.083 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 45 k 2024-09-14T09:04:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 143 k 2024-09-14T09:04:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 161 k 2024-09-14T09:04:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T09:04:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 321 k 2024-09-14T09:04:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 306 k 2024-09-14T09:04:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 99 k 2024-09-14T09:04:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T09:04:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T09:04:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T09:04:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T09:04:48.084 INFO:teuthology.orchestra.run.smithi116.stdout:Installing weak dependencies: 2024-09-14T09:04:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T09:04:48.084 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:04:48.084 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T09:04:48.085 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:04:48.085 INFO:teuthology.orchestra.run.smithi116.stdout:Install 31 Packages 2024-09-14T09:04:48.085 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrade 2 Packages 2024-09-14T09:04:48.085 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:04:48.085 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 62 M 2024-09-14T09:04:48.085 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T09:04:48.364 INFO:teuthology.orchestra.run.smithi144.stdout:(33/33): librados2-19.3.0-4775.g7f24e589.el9.x8 3.9 MB/s | 3.5 MB 00:00 2024-09-14T09:04:48.370 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:04:48.370 INFO:teuthology.orchestra.run.smithi144.stdout:Total 17 MB/s | 62 MB 00:03 2024-09-14T09:04:48.484 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-14T09:04:48.520 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-14T09:04:48.520 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-14T09:04:48.597 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-14T09:04:48.684 INFO:teuthology.orchestra.run.smithi116.stdout:(1/33): ceph-base-19.3.0-4775.g7f24e589.el9.x86 11 MB/s | 5.5 MB 00:00 2024-09-14T09:04:48.685 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-14T09:04:48.715 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-14T09:04:48.748 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-14T09:04:48.768 INFO:teuthology.orchestra.run.smithi116.stdout:(2/33): ceph-selinux-19.3.0-4775.g7f24e589.el9. 302 kB/s | 25 kB 00:00 2024-09-14T09:04:48.771 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-14T09:04:48.798 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-14T09:04:48.910 INFO:teuthology.orchestra.run.smithi116.stdout:(3/33): ceph-radosgw-19.3.0-4775.g7f24e589.el9. 15 MB/s | 11 MB 00:00 2024-09-14T09:04:48.943 INFO:teuthology.orchestra.run.smithi116.stdout:(4/33): libcephfs2-19.3.0-4775.g7f24e589.el9.x8 4.2 MB/s | 755 kB 00:00 2024-09-14T09:04:48.977 INFO:teuthology.orchestra.run.smithi116.stdout:(5/33): libradosstriper1-19.3.0-4775.g7f24e589. 7.5 MB/s | 508 kB 00:00 2024-09-14T09:04:48.991 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-14T09:04:49.043 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-14T09:04:49.052 INFO:teuthology.orchestra.run.smithi116.stdout:(6/33): python3-ceph-argparse-19.3.0-4775.g7f24 601 kB/s | 45 kB 00:00 2024-09-14T09:04:49.186 INFO:teuthology.orchestra.run.smithi116.stdout:(7/33): librgw2-19.3.0-4775.g7f24e589.el9.x86_6 23 MB/s | 5.5 MB 00:00 2024-09-14T09:04:49.211 INFO:teuthology.orchestra.run.smithi116.stdout:(8/33): python3-ceph-common-19.3.0-4775.g7f24e5 902 kB/s | 143 kB 00:00 2024-09-14T09:04:49.223 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-14T09:04:49.223 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-14T09:04:49.236 INFO:teuthology.orchestra.run.smithi116.stdout:(9/33): python3-cephfs-19.3.0-4775.g7f24e589.el 3.2 MB/s | 161 kB 00:00 2024-09-14T09:04:49.262 INFO:teuthology.orchestra.run.smithi116.stdout:(10/33): python3-rados-19.3.0-4775.g7f24e589.el 6.2 MB/s | 321 kB 00:00 2024-09-14T09:04:49.287 INFO:teuthology.orchestra.run.smithi116.stdout:(11/33): python3-rbd-19.3.0-4775.g7f24e589.el9. 5.9 MB/s | 306 kB 00:00 2024-09-14T09:04:49.312 INFO:teuthology.orchestra.run.smithi116.stdout:(12/33): python3-rgw-19.3.0-4775.g7f24e589.el9. 1.9 MB/s | 99 kB 00:00 2024-09-14T09:04:49.402 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-14T09:04:49.509 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T09:04:49.554 INFO:teuthology.orchestra.run.smithi116.stdout:(13/33): ceph-common-19.3.0-4775.g7f24e589.el9. 16 MB/s | 22 MB 00:01 2024-09-14T09:04:49.601 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T09:04:49.605 INFO:teuthology.orchestra.run.smithi116.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 337 kB/s | 107 kB 00:00 2024-09-14T09:04:49.638 INFO:teuthology.orchestra.run.smithi116.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 524 kB/s | 171 kB 00:00 2024-09-14T09:04:49.690 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 8/35 2024-09-14T09:04:49.697 INFO:teuthology.orchestra.run.smithi116.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 492 kB/s | 45 kB 00:00 2024-09-14T09:04:49.718 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 9/35 2024-09-14T09:04:49.781 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 9/35 2024-09-14T09:04:49.797 INFO:teuthology.orchestra.run.smithi116.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 661 kB/s | 160 kB 00:00 2024-09-14T09:04:49.818 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-14T09:04:49.831 INFO:teuthology.orchestra.run.smithi116.stdout:(18/33): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-09-14T09:04:49.856 INFO:teuthology.orchestra.run.smithi116.stdout:(19/33): python3-prettytable-0.7.2-27.el9.noarc 721 kB/s | 42 kB 00:00 2024-09-14T09:04:49.870 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9. 11/35 2024-09-14T09:04:49.889 INFO:teuthology.orchestra.run.smithi116.stdout:(20/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.5 MB/s | 292 kB 00:00 2024-09-14T09:04:49.915 INFO:teuthology.orchestra.run.smithi116.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 614 kB/s | 36 kB 00:00 2024-09-14T09:04:49.940 INFO:teuthology.orchestra.run.smithi116.stdout:(22/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-09-14T09:04:49.949 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 12/35 2024-09-14T09:04:49.970 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 13/35 2024-09-14T09:04:49.974 INFO:teuthology.orchestra.run.smithi116.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-09-14T09:04:50.018 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 13/35 2024-09-14T09:04:50.032 INFO:teuthology.orchestra.run.smithi116.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.6 MB/s | 308 kB 00:00 2024-09-14T09:04:50.057 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-14T09:04:50.058 INFO:teuthology.orchestra.run.smithi116.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-14T09:04:50.083 INFO:teuthology.orchestra.run.smithi116.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 277 kB/s | 26 kB 00:00 2024-09-14T09:04:50.108 INFO:teuthology.orchestra.run.smithi116.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-14T09:04:50.142 INFO:teuthology.orchestra.run.smithi116.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-14T09:04:50.170 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-14T09:04:50.204 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-14T09:04:50.225 INFO:teuthology.orchestra.run.smithi116.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 839 kB 00:00 2024-09-14T09:04:50.249 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-14T09:04:50.276 INFO:teuthology.orchestra.run.smithi116.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-14T09:04:50.277 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-14T09:04:50.306 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-14T09:04:50.339 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-14T09:04:50.351 INFO:teuthology.orchestra.run.smithi116.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-14T09:04:50.376 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-14T09:04:50.460 INFO:teuthology.orchestra.run.smithi116.stdout:(32/33): librados2-19.3.0-4775.g7f24e589.el9.x8 15 MB/s | 3.5 MB 00:00 2024-09-14T09:04:50.543 INFO:teuthology.orchestra.run.smithi116.stdout:(33/33): librbd1-19.3.0-4775.g7f24e589.el9.x86_ 12 MB/s | 3.2 MB 00:00 2024-09-14T09:04:50.549 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:04:50.549 INFO:teuthology.orchestra.run.smithi116.stdout:Total 25 MB/s | 62 MB 00:02 2024-09-14T09:04:50.667 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T09:04:50.693 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-14T09:04:50.703 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T09:04:50.704 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T09:04:50.744 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 23/35 2024-09-14T09:04:50.754 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-14T09:04:50.840 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-14T09:04:50.841 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 23/35 2024-09-14T09:04:50.869 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-14T09:04:50.882 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 24/35 2024-09-14T09:04:50.894 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-14T09:04:50.917 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-14T09:04:50.926 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-14T09:04:50.945 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-14T09:04:51.136 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-14T09:04:51.188 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-14T09:04:51.364 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T09:04:51.365 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T09:04:51.429 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-14T09:04:51.455 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 27/35 2024-09-14T09:04:51.510 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 27/35 2024-09-14T09:04:51.571 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-14T09:04:51.588 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 28/35 2024-09-14T09:04:51.624 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x8 29/35 2024-09-14T09:04:51.655 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T09:04:51.731 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T09:04:51.820 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 8/35 2024-09-14T09:04:51.848 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 9/35 2024-09-14T09:04:51.903 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 9/35 2024-09-14T09:04:51.939 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-14T09:04:51.984 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9. 11/35 2024-09-14T09:04:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 12/35 2024-09-14T09:04:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 13/35 2024-09-14T09:04:52.148 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 13/35 2024-09-14T09:04:52.182 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-14T09:04:52.292 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-14T09:04:52.325 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-14T09:04:52.384 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-14T09:04:52.416 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-14T09:04:52.444 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-14T09:04:52.477 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-14T09:04:52.514 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-14T09:04:52.839 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-14T09:04:52.872 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T09:04:52.882 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 23/35 2024-09-14T09:04:52.965 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-14T09:04:52.974 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 23/35 2024-09-14T09:04:52.998 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-14T09:04:53.022 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 24/35 2024-09-14T09:04:53.023 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-14T09:04:53.046 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-14T09:04:53.064 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-14T09:04:53.071 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-14T09:04:53.215 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-14T09:04:53.267 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-14T09:04:53.562 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-14T09:04:53.593 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 27/35 2024-09-14T09:04:53.653 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-14T09:04:53.665 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 27/35 2024-09-14T09:04:53.716 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T09:04:53.742 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 28/35 2024-09-14T09:04:53.770 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x8 29/35 2024-09-14T09:04:53.810 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T09:04:53.922 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 8/35 2024-09-14T09:04:53.951 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 9/35 2024-09-14T09:04:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 9/35 2024-09-14T09:04:54.005 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T09:04:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-14T09:04:54.037 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T09:04:54.069 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9. 11/35 2024-09-14T09:04:54.138 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 12/35 2024-09-14T09:04:54.164 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 13/35 2024-09-14T09:04:54.234 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 13/35 2024-09-14T09:04:54.268 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-14T09:04:54.375 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-14T09:04:54.411 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-14T09:04:54.452 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-14T09:04:54.493 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-14T09:04:54.522 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-14T09:04:54.569 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-14T09:04:54.609 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-14T09:04:54.621 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T09:04:54.666 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 31/35 2024-09-14T09:04:54.765 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 31/35 2024-09-14T09:04:54.765 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T09:04:54.765 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T09:04:54.765 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:04:54.800 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T09:04:54.925 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-14T09:04:54.977 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 23/35 2024-09-14T09:04:55.067 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 23/35 2024-09-14T09:04:55.098 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 24/35 2024-09-14T09:04:55.134 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-14T09:04:55.632 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-14T09:04:55.662 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 27/35 2024-09-14T09:04:55.740 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 27/35 2024-09-14T09:04:55.811 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 28/35 2024-09-14T09:04:55.847 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x8 29/35 2024-09-14T09:04:56.090 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T09:04:56.156 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T09:04:56.734 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T09:04:56.779 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 31/35 2024-09-14T09:04:56.863 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 31/35 2024-09-14T09:04:56.863 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T09:04:56.863 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T09:04:56.863 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:04:56.897 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T09:04:58.140 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T09:04:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T09:04:58.755 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T09:04:58.789 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 31/35 2024-09-14T09:04:58.881 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 31/35 2024-09-14T09:04:58.881 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T09:04:58.881 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T09:04:58.881 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:04:58.924 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T09:05:04.922 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T09:05:04.922 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /sys 2024-09-14T09:05:04.922 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /proc 2024-09-14T09:05:04.922 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /mnt 2024-09-14T09:05:04.922 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /var/tmp 2024-09-14T09:05:04.922 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /home 2024-09-14T09:05:04.923 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /root 2024-09-14T09:05:04.923 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /tmp 2024-09-14T09:05:04.923 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:06.000 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 33/35 2024-09-14T09:05:06.026 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 33/35 2024-09-14T09:05:06.026 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:05:06.026 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T09:05:06.026 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T09:05:06.026 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T09:05:06.026 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:06.028 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-14T09:05:06.111 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-14T09:05:06.111 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T09:05:07.262 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T09:05:07.262 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /sys 2024-09-14T09:05:07.262 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /proc 2024-09-14T09:05:07.263 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /mnt 2024-09-14T09:05:07.263 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /var/tmp 2024-09-14T09:05:07.263 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /home 2024-09-14T09:05:07.263 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /root 2024-09-14T09:05:07.263 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /tmp 2024-09-14T09:05:07.263 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:07.331 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T09:05:07.331 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 1/35 2024-09-14T09:05:07.331 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2/35 2024-09-14T09:05:07.331 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 3/35 2024-09-14T09:05:07.331 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 4/35 2024-09-14T09:05:07.331 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 5/35 2024-09-14T09:05:07.331 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 6/35 2024-09-14T09:05:07.331 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T09:05:07.332 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9. 8/35 2024-09-14T09:05:07.332 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x8 9/35 2024-09-14T09:05:07.332 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 10/35 2024-09-14T09:05:07.332 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 11/35 2024-09-14T09:05:07.332 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 12/35 2024-09-14T09:05:07.332 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 13/35 2024-09-14T09:05:07.332 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-14T09:05:07.332 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-14T09:05:07.332 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-14T09:05:07.332 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-14T09:05:07.332 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-14T09:05:07.332 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-14T09:05:07.332 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-14T09:05:07.332 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-14T09:05:07.333 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-14T09:05:07.333 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-14T09:05:07.333 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-14T09:05:07.333 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-14T09:05:07.333 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-14T09:05:07.333 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-14T09:05:07.334 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-14T09:05:07.334 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-14T09:05:07.334 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-14T09:05:07.334 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-14T09:05:07.334 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T09:05:07.334 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-14T09:05:07.334 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 34/35 2024-09-14T09:05:08.176 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T09:05:08.176 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:08.177 INFO:teuthology.orchestra.run.smithi148.stdout:Upgraded: 2024-09-14T09:05:08.177 INFO:teuthology.orchestra.run.smithi148.stdout: librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:08.177 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:08.177 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-14T09:05:08.177 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T09:05:08.177 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:08.177 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:08.177 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:08.177 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:08.177 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T09:05:08.177 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T09:05:08.177 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T09:05:08.177 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:08.177 INFO:teuthology.orchestra.run.smithi148.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T09:05:08.178 INFO:teuthology.orchestra.run.smithi148.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T09:05:08.178 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T09:05:08.178 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T09:05:08.178 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:08.178 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T09:05:08.178 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:08.178 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T09:05:08.178 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T09:05:08.178 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T09:05:08.178 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:08.178 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:08.178 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:08.178 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T09:05:08.178 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:08.179 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:08.179 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:08.179 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T09:05:08.179 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T09:05:08.179 INFO:teuthology.orchestra.run.smithi148.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T09:05:08.179 INFO:teuthology.orchestra.run.smithi148.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T09:05:08.179 INFO:teuthology.orchestra.run.smithi148.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T09:05:08.179 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:08.179 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:05:08.299 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 33/35 2024-09-14T09:05:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 33/35 2024-09-14T09:05:08.325 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:05:08.325 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T09:05:08.325 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T09:05:08.325 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T09:05:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-14T09:05:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-14T09:05:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T09:05:08.510 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-test 2024-09-14T09:05:09.089 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:00:29 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:05:09.114 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T09:05:09.115 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /sys 2024-09-14T09:05:09.115 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /proc 2024-09-14T09:05:09.115 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /mnt 2024-09-14T09:05:09.115 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /var/tmp 2024-09-14T09:05:09.115 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /home 2024-09-14T09:05:09.115 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /root 2024-09-14T09:05:09.115 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /tmp 2024-09-14T09:05:09.115 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:09.230 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:05:09.231 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:05:09.231 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-14T09:05:09.231 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:05:09.231 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-14T09:05:09.231 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 50 M 2024-09-14T09:05:09.231 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-14T09:05:09.232 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 162 k 2024-09-14T09:05:09.232 INFO:teuthology.orchestra.run.smithi148.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T09:05:09.232 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T09:05:09.232 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:09.232 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-14T09:05:09.232 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:05:09.232 INFO:teuthology.orchestra.run.smithi148.stdout:Install 4 Packages 2024-09-14T09:05:09.232 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:09.233 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 51 M 2024-09-14T09:05:09.233 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 217 M 2024-09-14T09:05:09.233 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-14T09:05:09.408 INFO:teuthology.orchestra.run.smithi148.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.0 MB/s | 304 kB 00:00 2024-09-14T09:05:09.450 INFO:teuthology.orchestra.run.smithi148.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-14T09:05:09.567 INFO:teuthology.orchestra.run.smithi148.stdout:(3/4): libcephsqlite-19.3.0-4775.g7f24e589.el9. 521 kB/s | 162 kB 00:00 2024-09-14T09:05:09.696 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T09:05:09.696 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 1/35 2024-09-14T09:05:09.696 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2/35 2024-09-14T09:05:09.696 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 3/35 2024-09-14T09:05:09.696 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 4/35 2024-09-14T09:05:09.696 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 5/35 2024-09-14T09:05:09.696 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 6/35 2024-09-14T09:05:09.696 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T09:05:09.696 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9. 8/35 2024-09-14T09:05:09.696 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x8 9/35 2024-09-14T09:05:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 10/35 2024-09-14T09:05:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 11/35 2024-09-14T09:05:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 12/35 2024-09-14T09:05:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 13/35 2024-09-14T09:05:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-14T09:05:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-14T09:05:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-14T09:05:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-14T09:05:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-14T09:05:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-14T09:05:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-14T09:05:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-14T09:05:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-14T09:05:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-14T09:05:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-14T09:05:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-14T09:05:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-14T09:05:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-14T09:05:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-14T09:05:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-14T09:05:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-14T09:05:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-14T09:05:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T09:05:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-14T09:05:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 34/35 2024-09-14T09:05:10.124 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 33/35 2024-09-14T09:05:10.149 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 33/35 2024-09-14T09:05:10.149 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:05:10.150 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T09:05:10.150 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T09:05:10.150 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T09:05:10.150 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:10.152 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-14T09:05:10.234 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-14T09:05:10.234 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T09:05:10.758 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T09:05:10.758 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:10.758 INFO:teuthology.orchestra.run.smithi144.stdout:Upgraded: 2024-09-14T09:05:10.758 INFO:teuthology.orchestra.run.smithi144.stdout: librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:10.758 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:10.758 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-14T09:05:10.758 INFO:teuthology.orchestra.run.smithi144.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T09:05:10.758 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:10.758 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:10.758 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:10.759 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:10.759 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T09:05:10.759 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T09:05:10.759 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T09:05:10.759 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:10.759 INFO:teuthology.orchestra.run.smithi144.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T09:05:10.759 INFO:teuthology.orchestra.run.smithi144.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T09:05:10.759 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T09:05:10.759 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T09:05:10.759 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:10.759 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T09:05:10.759 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:10.759 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T09:05:10.759 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T09:05:10.760 INFO:teuthology.orchestra.run.smithi144.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T09:05:10.760 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:10.760 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:10.760 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:10.760 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T09:05:10.760 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:10.760 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:10.760 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:10.760 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T09:05:10.760 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T09:05:10.760 INFO:teuthology.orchestra.run.smithi144.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T09:05:10.760 INFO:teuthology.orchestra.run.smithi144.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T09:05:10.760 INFO:teuthology.orchestra.run.smithi144.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T09:05:10.760 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:10.761 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:05:11.096 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-test 2024-09-14T09:05:11.432 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T09:05:11.432 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 1/35 2024-09-14T09:05:11.432 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2/35 2024-09-14T09:05:11.432 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 3/35 2024-09-14T09:05:11.432 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 4/35 2024-09-14T09:05:11.432 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 5/35 2024-09-14T09:05:11.432 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 6/35 2024-09-14T09:05:11.432 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T09:05:11.432 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9. 8/35 2024-09-14T09:05:11.432 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x8 9/35 2024-09-14T09:05:11.433 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 10/35 2024-09-14T09:05:11.433 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 11/35 2024-09-14T09:05:11.433 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 12/35 2024-09-14T09:05:11.433 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 13/35 2024-09-14T09:05:11.433 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-14T09:05:11.433 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-14T09:05:11.433 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-14T09:05:11.433 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-14T09:05:11.433 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-14T09:05:11.433 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-14T09:05:11.433 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-14T09:05:11.433 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-14T09:05:11.433 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-14T09:05:11.433 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-14T09:05:11.434 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-14T09:05:11.434 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-14T09:05:11.434 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-14T09:05:11.434 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-14T09:05:11.434 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-14T09:05:11.434 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-14T09:05:11.434 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-14T09:05:11.435 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-14T09:05:11.435 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T09:05:11.435 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-14T09:05:11.435 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 34/35 2024-09-14T09:05:11.673 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:00:29 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:05:11.804 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:05:11.805 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:05:11.805 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2024-09-14T09:05:11.805 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:05:11.805 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-14T09:05:11.805 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 50 M 2024-09-14T09:05:11.805 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2024-09-14T09:05:11.805 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 162 k 2024-09-14T09:05:11.805 INFO:teuthology.orchestra.run.smithi144.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T09:05:11.805 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T09:05:11.806 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:11.806 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-14T09:05:11.806 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:05:11.806 INFO:teuthology.orchestra.run.smithi144.stdout:Install 4 Packages 2024-09-14T09:05:11.806 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:11.806 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 51 M 2024-09-14T09:05:11.806 INFO:teuthology.orchestra.run.smithi144.stdout:Installed size: 217 M 2024-09-14T09:05:11.807 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-14T09:05:12.057 INFO:teuthology.orchestra.run.smithi144.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-09-14T09:05:12.107 INFO:teuthology.orchestra.run.smithi144.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-14T09:05:12.267 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T09:05:12.267 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:12.268 INFO:teuthology.orchestra.run.smithi116.stdout:Upgraded: 2024-09-14T09:05:12.268 INFO:teuthology.orchestra.run.smithi116.stdout: librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:12.268 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:12.268 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T09:05:12.268 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T09:05:12.268 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:12.268 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:12.268 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:12.268 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:12.268 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T09:05:12.268 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T09:05:12.268 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T09:05:12.269 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:12.269 INFO:teuthology.orchestra.run.smithi116.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T09:05:12.269 INFO:teuthology.orchestra.run.smithi116.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T09:05:12.269 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T09:05:12.269 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T09:05:12.269 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:12.269 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T09:05:12.269 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:12.269 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T09:05:12.269 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T09:05:12.269 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T09:05:12.269 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:12.269 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:12.269 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:12.270 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T09:05:12.270 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:12.270 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:12.270 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:12.270 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T09:05:12.270 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T09:05:12.270 INFO:teuthology.orchestra.run.smithi116.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T09:05:12.270 INFO:teuthology.orchestra.run.smithi116.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T09:05:12.270 INFO:teuthology.orchestra.run.smithi116.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T09:05:12.270 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:12.270 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:05:12.349 INFO:teuthology.orchestra.run.smithi144.stdout:(3/4): libcephsqlite-19.3.0-4775.g7f24e589.el9. 329 kB/s | 162 kB 00:00 2024-09-14T09:05:12.638 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-test 2024-09-14T09:05:13.213 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:00:28 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:05:13.344 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:05:13.344 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:05:13.344 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-14T09:05:13.345 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:05:13.345 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T09:05:13.345 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 50 M 2024-09-14T09:05:13.345 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-14T09:05:13.345 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 162 k 2024-09-14T09:05:13.345 INFO:teuthology.orchestra.run.smithi116.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T09:05:13.345 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T09:05:13.345 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:13.345 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T09:05:13.345 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:05:13.345 INFO:teuthology.orchestra.run.smithi116.stdout:Install 4 Packages 2024-09-14T09:05:13.345 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:13.346 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 51 M 2024-09-14T09:05:13.346 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 217 M 2024-09-14T09:05:13.346 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T09:05:13.848 INFO:teuthology.orchestra.run.smithi116.stdout:(1/4): libcephsqlite-19.3.0-4775.g7f24e589.el9. 337 kB/s | 162 kB 00:00 2024-09-14T09:05:14.090 INFO:teuthology.orchestra.run.smithi116.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 421 kB/s | 304 kB 00:00 2024-09-14T09:05:14.223 INFO:teuthology.orchestra.run.smithi116.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 170 kB/s | 64 kB 00:00 2024-09-14T09:05:17.317 INFO:teuthology.orchestra.run.smithi148.stdout:(4/4): ceph-test-19.3.0-4775.g7f24e589.el9.x86_ 6.2 MB/s | 50 MB 00:08 2024-09-14T09:05:17.319 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:05:17.319 INFO:teuthology.orchestra.run.smithi148.stdout:Total 6.3 MB/s | 51 MB 00:08 2024-09-14T09:05:17.344 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-14T09:05:17.362 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-14T09:05:17.362 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-14T09:05:17.769 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-14T09:05:17.770 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-14T09:05:17.840 INFO:teuthology.orchestra.run.smithi144.stdout:(4/4): ceph-test-19.3.0-4775.g7f24e589.el9.x86_ 8.4 MB/s | 50 MB 00:05 2024-09-14T09:05:17.841 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:05:17.842 INFO:teuthology.orchestra.run.smithi144.stdout:Total 8.4 MB/s | 51 MB 00:06 2024-09-14T09:05:17.866 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-14T09:05:17.884 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-14T09:05:17.885 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-14T09:05:18.290 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-14T09:05:18.290 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-14T09:05:18.314 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-14T09:05:18.397 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-14T09:05:18.441 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-14T09:05:18.468 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 3/4 2024-09-14T09:05:18.817 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-14T09:05:18.901 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-14T09:05:18.947 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-14T09:05:18.975 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 3/4 2024-09-14T09:05:22.157 INFO:teuthology.orchestra.run.smithi116.stdout:(4/4): ceph-test-19.3.0-4775.g7f24e589.el9.x86_ 5.7 MB/s | 50 MB 00:08 2024-09-14T09:05:22.159 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:05:22.159 INFO:teuthology.orchestra.run.smithi116.stdout:Total 5.8 MB/s | 51 MB 00:08 2024-09-14T09:05:22.187 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T09:05:22.207 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T09:05:22.207 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T09:05:22.603 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T09:05:22.603 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T09:05:23.139 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T09:05:23.231 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 3/4 2024-09-14T09:05:23.264 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-14T09:05:23.307 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-14T09:05:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 4/4 2024-09-14T09:05:23.334 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 3/4 2024-09-14T09:05:23.715 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 3/4 2024-09-14T09:05:23.807 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 4/4 2024-09-14T09:05:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 4/4 2024-09-14T09:05:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 1/4 2024-09-14T09:05:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 2/4 2024-09-14T09:05:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-14T09:05:26.165 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-14T09:05:26.166 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:26.166 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-14T09:05:26.166 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:26.166 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:26.166 INFO:teuthology.orchestra.run.smithi148.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T09:05:26.166 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T09:05:26.166 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:26.166 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:05:26.263 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 4/4 2024-09-14T09:05:26.263 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 1/4 2024-09-14T09:05:26.263 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 2/4 2024-09-14T09:05:26.263 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-14T09:05:26.454 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph 2024-09-14T09:05:26.612 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-14T09:05:26.612 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:26.612 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-14T09:05:26.612 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:26.612 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:26.612 INFO:teuthology.orchestra.run.smithi144.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T09:05:26.612 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T09:05:26.612 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:26.612 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:05:26.890 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph 2024-09-14T09:05:27.025 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:00:47 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:05:27.163 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:05:27.165 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:05:27.165 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-14T09:05:27.166 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:05:27.166 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-14T09:05:27.166 INFO:teuthology.orchestra.run.smithi148.stdout: ceph x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 6.6 k 2024-09-14T09:05:27.166 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-14T09:05:27.166 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 2.4 M 2024-09-14T09:05:27.166 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 1.5 M 2024-09-14T09:05:27.166 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 291 k 2024-09-14T09:05:27.166 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 4.8 M 2024-09-14T09:05:27.166 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 17 M 2024-09-14T09:05:27.166 INFO:teuthology.orchestra.run.smithi148.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T09:05:27.166 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T09:05:27.166 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T09:05:27.166 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T09:05:27.167 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T09:05:27.167 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T09:05:27.167 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T09:05:27.167 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T09:05:27.167 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T09:05:27.167 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T09:05:27.167 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections 2024-09-14T09:05:27.167 INFO:teuthology.orchestra.run.smithi148.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-14T09:05:27.167 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T09:05:27.167 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T09:05:27.167 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T09:05:27.167 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T09:05:27.168 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T09:05:27.168 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T09:05:27.168 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T09:05:27.168 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T09:05:27.168 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T09:05:27.168 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T09:05:27.168 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T09:05:27.168 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T09:05:27.168 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T09:05:27.168 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T09:05:27.168 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T09:05:27.168 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T09:05:27.168 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T09:05:27.168 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T09:05:27.169 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T09:05:27.169 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T09:05:27.169 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:27.169 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-14T09:05:27.169 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:05:27.169 INFO:teuthology.orchestra.run.smithi148.stdout:Install 37 Packages 2024-09-14T09:05:27.169 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:27.169 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 31 M 2024-09-14T09:05:27.170 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 109 M 2024-09-14T09:05:27.170 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-14T09:05:27.462 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:00:45 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:05:27.597 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:05:27.600 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:05:27.600 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2024-09-14T09:05:27.600 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:05:27.600 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-14T09:05:27.600 INFO:teuthology.orchestra.run.smithi144.stdout: ceph x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 6.6 k 2024-09-14T09:05:27.600 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2024-09-14T09:05:27.600 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 2.4 M 2024-09-14T09:05:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 1.5 M 2024-09-14T09:05:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 291 k 2024-09-14T09:05:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 4.8 M 2024-09-14T09:05:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 17 M 2024-09-14T09:05:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T09:05:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T09:05:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T09:05:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T09:05:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T09:05:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T09:05:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T09:05:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T09:05:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T09:05:27.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T09:05:27.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-collections 2024-09-14T09:05:27.602 INFO:teuthology.orchestra.run.smithi144.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-14T09:05:27.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T09:05:27.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T09:05:27.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T09:05:27.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T09:05:27.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T09:05:27.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T09:05:27.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T09:05:27.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T09:05:27.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T09:05:27.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T09:05:27.602 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T09:05:27.603 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T09:05:27.603 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T09:05:27.603 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T09:05:27.603 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T09:05:27.603 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T09:05:27.603 INFO:teuthology.orchestra.run.smithi144.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T09:05:27.603 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T09:05:27.603 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T09:05:27.603 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T09:05:27.603 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:27.603 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-14T09:05:27.603 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:05:27.604 INFO:teuthology.orchestra.run.smithi144.stdout:Install 37 Packages 2024-09-14T09:05:27.604 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:27.604 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 31 M 2024-09-14T09:05:27.604 INFO:teuthology.orchestra.run.smithi144.stdout:Installed size: 109 M 2024-09-14T09:05:27.604 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-14T09:05:27.854 INFO:teuthology.orchestra.run.smithi148.stdout:(1/37): ceph-19.3.0-4775.g7f24e589.el9.x86_64.r 51 kB/s | 6.6 kB 00:00 2024-09-14T09:05:28.055 INFO:teuthology.orchestra.run.smithi148.stdout:(2/37): ceph-mgr-19.3.0-4775.g7f24e589.el9.x86_ 4.6 MB/s | 1.5 MB 00:00 2024-09-14T09:05:28.121 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 3/4 2024-09-14T09:05:28.122 INFO:teuthology.orchestra.run.smithi148.stdout:(3/37): ceph-mds-19.3.0-4775.g7f24e589.el9.x86_ 6.0 MB/s | 2.4 MB 00:00 2024-09-14T09:05:28.180 INFO:teuthology.orchestra.run.smithi148.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4775.g7f24 4.9 MB/s | 291 kB 00:00 2024-09-14T09:05:28.198 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 4/4 2024-09-14T09:05:28.289 INFO:teuthology.orchestra.run.smithi148.stdout:(5/37): ceph-mon-19.3.0-4775.g7f24e589.el9.x86_ 11 MB/s | 4.8 MB 00:00 2024-09-14T09:05:28.691 INFO:teuthology.orchestra.run.smithi144.stdout:(1/37): ceph-19.3.0-4775.g7f24e589.el9.x86_64.r 47 kB/s | 6.6 kB 00:00 2024-09-14T09:05:28.789 INFO:teuthology.orchestra.run.smithi148.stdout:(6/37): ceph-osd-19.3.0-4775.g7f24e589.el9.x86_ 23 MB/s | 17 MB 00:00 2024-09-14T09:05:28.881 INFO:teuthology.orchestra.run.smithi148.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 361 kB/s | 253 kB 00:00 2024-09-14T09:05:28.899 INFO:teuthology.orchestra.run.smithi144.stdout:(2/37): ceph-mgr-19.3.0-4775.g7f24e589.el9.x86_ 4.4 MB/s | 1.5 MB 00:00 2024-09-14T09:05:28.958 INFO:teuthology.orchestra.run.smithi144.stdout:(3/37): ceph-mds-19.3.0-4775.g7f24e589.el9.x86_ 5.8 MB/s | 2.4 MB 00:00 2024-09-14T09:05:28.990 INFO:teuthology.orchestra.run.smithi148.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.2 MB/s | 135 kB 00:00 2024-09-14T09:05:29.016 INFO:teuthology.orchestra.run.smithi144.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4775.g7f24 4.9 MB/s | 291 kB 00:00 2024-09-14T09:05:29.098 INFO:teuthology.orchestra.run.smithi148.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 1.1 MB/s | 125 kB 00:00 2024-09-14T09:05:29.159 INFO:teuthology.orchestra.run.smithi144.stdout:(5/37): ceph-mon-19.3.0-4775.g7f24e589.el9.x86_ 10 MB/s | 4.8 MB 00:00 2024-09-14T09:05:29.199 INFO:teuthology.orchestra.run.smithi148.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 1.3 MB/s | 1.2 MB 00:00 2024-09-14T09:05:29.224 INFO:teuthology.orchestra.run.smithi148.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.7 MB/s | 215 kB 00:00 2024-09-14T09:05:29.249 INFO:teuthology.orchestra.run.smithi148.stdout:(12/37): python3-ply-3.11-14.el9.noarch.rpm 232 kB/s | 106 kB 00:00 2024-09-14T09:05:29.267 INFO:teuthology.orchestra.run.smithi144.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-09-14T09:05:29.316 INFO:teuthology.orchestra.run.smithi148.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-14T09:05:29.317 INFO:teuthology.orchestra.run.smithi144.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-14T09:05:29.341 INFO:teuthology.orchestra.run.smithi148.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 378 kB/s | 35 kB 00:00 2024-09-14T09:05:29.368 INFO:teuthology.orchestra.run.smithi144.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-09-14T09:05:29.375 INFO:teuthology.orchestra.run.smithi148.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.3 MB/s | 77 kB 00:00 2024-09-14T09:05:29.400 INFO:teuthology.orchestra.run.smithi148.stdout:(16/37): python3-mako-1.1.4-6.el9.noarch.rpm 978 kB/s | 172 kB 00:00 2024-09-14T09:05:29.418 INFO:teuthology.orchestra.run.smithi144.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-14T09:05:29.426 INFO:teuthology.orchestra.run.smithi148.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 609 kB/s | 51 kB 00:00 2024-09-14T09:05:29.451 INFO:teuthology.orchestra.run.smithi148.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 551 kB/s | 42 kB 00:00 2024-09-14T09:05:29.501 INFO:teuthology.orchestra.run.smithi148.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-09-14T09:05:29.543 INFO:teuthology.orchestra.run.smithi144.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.7 MB/s | 215 kB 00:00 2024-09-14T09:05:29.577 INFO:teuthology.orchestra.run.smithi144.stdout:(11/37): python3-cryptography-36.0.1-4.el9.x86_ 2.9 MB/s | 1.2 MB 00:00 2024-09-14T09:05:29.610 INFO:teuthology.orchestra.run.smithi148.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 107 kB/s | 22 kB 00:00 2024-09-14T09:05:29.635 INFO:teuthology.orchestra.run.smithi148.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 236 kB/s | 43 kB 00:00 2024-09-14T09:05:29.668 INFO:teuthology.orchestra.run.smithi148.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 413 kB/s | 11 kB 00:00 2024-09-14T09:05:29.694 INFO:teuthology.orchestra.run.smithi148.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 900 kB/s | 172 kB 00:00 2024-09-14T09:05:29.719 INFO:teuthology.orchestra.run.smithi148.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 364 kB/s | 18 kB 00:00 2024-09-14T09:05:29.745 INFO:teuthology.orchestra.run.smithi148.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-14T09:05:29.752 INFO:teuthology.orchestra.run.smithi144.stdout:(12/37): ceph-osd-19.3.0-4775.g7f24e589.el9.x86 20 MB/s | 17 MB 00:00 2024-09-14T09:05:29.770 INFO:teuthology.orchestra.run.smithi148.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-14T09:05:29.803 INFO:teuthology.orchestra.run.smithi148.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 336 kB/s | 20 kB 00:00 2024-09-14T09:05:29.827 INFO:teuthology.orchestra.run.smithi144.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 665 kB/s | 188 kB 00:00 2024-09-14T09:05:29.829 INFO:teuthology.orchestra.run.smithi148.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 791 kB/s | 46 kB 00:00 2024-09-14T09:05:29.853 INFO:teuthology.orchestra.run.smithi144.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 348 kB/s | 35 kB 00:00 2024-09-14T09:05:29.862 INFO:teuthology.orchestra.run.smithi148.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2024-09-14T09:05:29.878 INFO:teuthology.orchestra.run.smithi144.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-14T09:05:29.888 INFO:teuthology.orchestra.run.smithi148.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 660 kB/s | 16 kB 00:00 2024-09-14T09:05:29.903 INFO:teuthology.orchestra.run.smithi144.stdout:(16/37): python3-mako-1.1.4-6.el9.noarch.rpm 528 kB/s | 172 kB 00:00 2024-09-14T09:05:29.913 INFO:teuthology.orchestra.run.smithi148.stdout:(31/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.2 MB/s | 358 kB 00:00 2024-09-14T09:05:29.920 INFO:teuthology.orchestra.run.smithi144.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 761 kB/s | 51 kB 00:00 2024-09-14T09:05:29.937 INFO:teuthology.orchestra.run.smithi144.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 709 kB/s | 42 kB 00:00 2024-09-14T09:05:29.947 INFO:teuthology.orchestra.run.smithi148.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-14T09:05:29.972 INFO:teuthology.orchestra.run.smithi148.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 612 kB/s | 36 kB 00:00 2024-09-14T09:05:29.987 INFO:teuthology.orchestra.run.smithi144.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-14T09:05:29.997 INFO:teuthology.orchestra.run.smithi148.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-09-14T09:05:30.004 INFO:teuthology.orchestra.run.smithi144.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 652 kB/s | 43 kB 00:00 2024-09-14T09:05:30.029 INFO:teuthology.orchestra.run.smithi144.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 4.2 MB/s | 172 kB 00:00 2024-09-14T09:05:30.033 INFO:teuthology.orchestra.run.smithi148.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 567 kB/s | 20 kB 00:00 2024-09-14T09:05:30.046 INFO:teuthology.orchestra.run.smithi144.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 642 kB/s | 11 kB 00:00 2024-09-14T09:05:30.063 INFO:teuthology.orchestra.run.smithi144.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 1.0 MB/s | 18 kB 00:00 2024-09-14T09:05:30.064 INFO:teuthology.orchestra.run.smithi148.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-14T09:05:30.090 INFO:teuthology.orchestra.run.smithi148.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.6 MB/s | 427 kB 00:00 2024-09-14T09:05:30.092 INFO:teuthology.orchestra.run.smithi144.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 820 kB/s | 23 kB 00:00 2024-09-14T09:05:30.094 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:05:30.095 INFO:teuthology.orchestra.run.smithi148.stdout:Total 11 MB/s | 31 MB 00:02 2024-09-14T09:05:30.117 INFO:teuthology.orchestra.run.smithi144.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 779 kB/s | 19 kB 00:00 2024-09-14T09:05:30.143 INFO:teuthology.orchestra.run.smithi144.stdout:(26/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.5 MB/s | 358 kB 00:00 2024-09-14T09:05:30.168 INFO:teuthology.orchestra.run.smithi144.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-14T09:05:30.193 INFO:teuthology.orchestra.run.smithi144.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 921 kB/s | 46 kB 00:00 2024-09-14T09:05:30.210 INFO:teuthology.orchestra.run.smithi144.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2024-09-14T09:05:30.250 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-14T09:05:30.269 INFO:teuthology.orchestra.run.smithi144.stdout:(30/37): lua-devel-5.4.4-4.el9.x86_64.rpm 61 kB/s | 22 kB 00:00 2024-09-14T09:05:30.290 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-14T09:05:30.291 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-14T09:05:30.294 INFO:teuthology.orchestra.run.smithi144.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 197 kB/s | 16 kB 00:00 2024-09-14T09:05:30.328 INFO:teuthology.orchestra.run.smithi144.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.3 MB/s | 36 kB 00:00 2024-09-14T09:05:30.353 INFO:teuthology.orchestra.run.smithi144.stdout:(33/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-14T09:05:30.378 INFO:teuthology.orchestra.run.smithi144.stdout:(34/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 825 kB/s | 90 kB 00:00 2024-09-14T09:05:30.403 INFO:teuthology.orchestra.run.smithi144.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.1 MB/s | 230 kB 00:00 2024-09-14T09:05:30.428 INFO:teuthology.orchestra.run.smithi144.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 398 kB/s | 20 kB 00:00 2024-09-14T09:05:30.454 INFO:teuthology.orchestra.run.smithi144.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-14T09:05:30.459 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:05:30.459 INFO:teuthology.orchestra.run.smithi144.stdout:Total 11 MB/s | 31 MB 00:02 2024-09-14T09:05:30.596 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 4/4 2024-09-14T09:05:30.596 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 1/4 2024-09-14T09:05:30.596 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 2/4 2024-09-14T09:05:30.596 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-14T09:05:30.614 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-14T09:05:30.655 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-14T09:05:30.655 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-14T09:05:30.772 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-14T09:05:30.773 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-14T09:05:30.904 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-14T09:05:30.904 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:30.904 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T09:05:30.904 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:30.904 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:30.904 INFO:teuthology.orchestra.run.smithi116.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T09:05:30.904 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T09:05:30.904 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:30.904 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:05:31.160 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-14T09:05:31.160 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-14T09:05:31.217 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph 2024-09-14T09:05:31.789 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:00:46 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:05:31.925 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:05:31.928 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:05:31.928 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-14T09:05:31.928 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:05:31.928 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T09:05:31.928 INFO:teuthology.orchestra.run.smithi116.stdout: ceph x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 6.6 k 2024-09-14T09:05:31.928 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-14T09:05:31.928 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 2.4 M 2024-09-14T09:05:31.928 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 1.5 M 2024-09-14T09:05:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 291 k 2024-09-14T09:05:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 4.8 M 2024-09-14T09:05:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 17 M 2024-09-14T09:05:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T09:05:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T09:05:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T09:05:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T09:05:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T09:05:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T09:05:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T09:05:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T09:05:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T09:05:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T09:05:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections 2024-09-14T09:05:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-14T09:05:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T09:05:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T09:05:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T09:05:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T09:05:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T09:05:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T09:05:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T09:05:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T09:05:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T09:05:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T09:05:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T09:05:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T09:05:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T09:05:31.931 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T09:05:31.931 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T09:05:31.931 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T09:05:31.931 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T09:05:31.931 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T09:05:31.931 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T09:05:31.931 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T09:05:31.931 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:31.931 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T09:05:31.931 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:05:31.931 INFO:teuthology.orchestra.run.smithi116.stdout:Install 37 Packages 2024-09-14T09:05:31.931 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:31.932 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 31 M 2024-09-14T09:05:31.932 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 109 M 2024-09-14T09:05:31.932 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T09:05:32.166 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-14T09:05:32.234 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-14T09:05:32.275 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-14T09:05:32.303 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-14T09:05:32.376 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-14T09:05:32.427 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-14T09:05:32.461 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-14T09:05:32.507 INFO:teuthology.orchestra.run.smithi116.stdout:(1/37): ceph-19.3.0-4775.g7f24e589.el9.x86_64.r 52 kB/s | 6.6 kB 00:00 2024-09-14T09:05:32.523 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-14T09:05:32.553 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-14T09:05:32.582 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-14T09:05:32.622 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-14T09:05:32.639 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-14T09:05:32.651 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-14T09:05:32.674 INFO:teuthology.orchestra.run.smithi116.stdout:(2/37): ceph-mgr-19.3.0-4775.g7f24e589.el9.x86_ 5.2 MB/s | 1.5 MB 00:00 2024-09-14T09:05:32.680 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-14T09:05:32.714 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-14T09:05:32.721 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-14T09:05:32.745 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-14T09:05:32.750 INFO:teuthology.orchestra.run.smithi116.stdout:(3/37): ceph-mds-19.3.0-4775.g7f24e589.el9.x86_ 6.5 MB/s | 2.4 MB 00:00 2024-09-14T09:05:32.766 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-14T09:05:32.779 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-14T09:05:32.799 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-14T09:05:32.812 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-14T09:05:32.816 INFO:teuthology.orchestra.run.smithi116.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4775.g7f24 4.3 MB/s | 291 kB 00:00 2024-09-14T09:05:32.870 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-14T09:05:32.891 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-14T09:05:32.892 INFO:teuthology.orchestra.run.smithi116.stdout:(5/37): ceph-mon-19.3.0-4775.g7f24e589.el9.x86_ 12 MB/s | 4.8 MB 00:00 2024-09-14T09:05:32.913 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-14T09:05:32.948 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-14T09:05:32.969 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-14T09:05:32.996 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-14T09:05:33.010 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-14T09:05:33.028 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-14T09:05:33.045 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-14T09:05:33.067 INFO:teuthology.orchestra.run.smithi116.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-09-14T09:05:33.075 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-14T09:05:33.101 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-14T09:05:33.110 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-14T09:05:33.126 INFO:teuthology.orchestra.run.smithi116.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-14T09:05:33.143 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-14T09:05:33.201 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-14T09:05:33.235 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-14T09:05:33.240 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-14T09:05:33.270 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-14T09:05:33.301 INFO:teuthology.orchestra.run.smithi116.stdout:(8/37): ceph-osd-19.3.0-4775.g7f24e589.el9.x86_ 27 MB/s | 17 MB 00:00 2024-09-14T09:05:33.309 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-14T09:05:33.326 INFO:teuthology.orchestra.run.smithi116.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 675 kB/s | 135 kB 00:00 2024-09-14T09:05:33.327 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-14T09:05:33.341 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-14T09:05:33.368 INFO:teuthology.orchestra.run.smithi116.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 2.6 MB/s | 1.2 MB 00:00 2024-09-14T09:05:33.389 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-14T09:05:33.402 INFO:teuthology.orchestra.run.smithi116.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.8 MB/s | 215 kB 00:00 2024-09-14T09:05:33.414 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-14T09:05:33.428 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-14T09:05:33.485 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-14T09:05:33.511 INFO:teuthology.orchestra.run.smithi116.stdout:(12/37): python3-requests-2.25.1-8.el9.noarch.r 597 kB/s | 125 kB 00:00 2024-09-14T09:05:33.536 INFO:teuthology.orchestra.run.smithi116.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-09-14T09:05:33.540 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-14T09:05:33.551 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-14T09:05:33.603 INFO:teuthology.orchestra.run.smithi116.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 859 kB/s | 172 kB 00:00 2024-09-14T09:05:33.620 INFO:teuthology.orchestra.run.smithi116.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 319 kB/s | 35 kB 00:00 2024-09-14T09:05:33.636 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-14T09:05:33.645 INFO:teuthology.orchestra.run.smithi116.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-14T09:05:33.689 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-14T09:05:33.695 INFO:teuthology.orchestra.run.smithi116.stdout:(17/37): python3-packaging-20.9-5.el9.noarch.rp 485 kB/s | 77 kB 00:00 2024-09-14T09:05:33.712 INFO:teuthology.orchestra.run.smithi116.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-09-14T09:05:33.727 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-14T09:05:33.729 INFO:teuthology.orchestra.run.smithi116.stdout:(19/37): lua-devel-5.4.4-4.el9.x86_64.rpm 266 kB/s | 22 kB 00:00 2024-09-14T09:05:33.731 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-14T09:05:33.779 INFO:teuthology.orchestra.run.smithi116.stdout:(20/37): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-09-14T09:05:33.781 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-14T09:05:33.784 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-14T09:05:33.796 INFO:teuthology.orchestra.run.smithi116.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 518 kB/s | 43 kB 00:00 2024-09-14T09:05:33.813 INFO:teuthology.orchestra.run.smithi116.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 649 kB/s | 11 kB 00:00 2024-09-14T09:05:33.830 INFO:teuthology.orchestra.run.smithi116.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 1.1 MB/s | 18 kB 00:00 2024-09-14T09:05:33.839 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-14T09:05:33.859 INFO:teuthology.orchestra.run.smithi116.stdout:(24/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-14T09:05:33.860 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-14T09:05:33.884 INFO:teuthology.orchestra.run.smithi116.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 432 kB/s | 23 kB 00:00 2024-09-14T09:05:33.910 INFO:teuthology.orchestra.run.smithi116.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 389 kB/s | 19 kB 00:00 2024-09-14T09:05:33.935 INFO:teuthology.orchestra.run.smithi116.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-14T09:05:33.947 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-14T09:05:33.960 INFO:teuthology.orchestra.run.smithi116.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 923 kB/s | 46 kB 00:00 2024-09-14T09:05:33.985 INFO:teuthology.orchestra.run.smithi116.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.7 MB/s | 358 kB 00:00 2024-09-14T09:05:33.989 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-14T09:05:34.011 INFO:teuthology.orchestra.run.smithi116.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-14T09:05:34.028 INFO:teuthology.orchestra.run.smithi116.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 391 kB/s | 16 kB 00:00 2024-09-14T09:05:34.033 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-14T09:05:34.053 INFO:teuthology.orchestra.run.smithi116.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2024-09-14T09:05:34.083 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-14T09:05:34.095 INFO:teuthology.orchestra.run.smithi116.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 535 kB/s | 36 kB 00:00 2024-09-14T09:05:34.118 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-14T09:05:34.120 INFO:teuthology.orchestra.run.smithi116.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-14T09:05:34.137 INFO:teuthology.orchestra.run.smithi116.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-14T09:05:34.153 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-14T09:05:34.170 INFO:teuthology.orchestra.run.smithi116.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-14T09:05:34.195 INFO:teuthology.orchestra.run.smithi116.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-14T09:05:34.200 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:05:34.200 INFO:teuthology.orchestra.run.smithi116.stdout:Total 14 MB/s | 31 MB 00:02 2024-09-14T09:05:34.248 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-14T09:05:34.282 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-14T09:05:34.293 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9. 32/37 2024-09-14T09:05:34.325 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 33/37 2024-09-14T09:05:34.351 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 33/37 2024-09-14T09:05:34.351 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:05:34.351 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T09:05:34.351 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T09:05:34.352 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T09:05:34.352 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:34.352 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T09:05:34.393 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T09:05:34.394 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T09:05:34.408 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-14T09:05:34.572 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9. 32/37 2024-09-14T09:05:34.601 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 33/37 2024-09-14T09:05:34.627 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 33/37 2024-09-14T09:05:34.627 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:05:34.627 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T09:05:34.627 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T09:05:34.627 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T09:05:34.627 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:34.885 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T09:05:34.885 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T09:05:35.825 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 34/37 2024-09-14T09:05:35.854 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 34/37 2024-09-14T09:05:35.854 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:05:35.854 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T09:05:35.854 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T09:05:35.854 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T09:05:35.854 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:36.085 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 34/37 2024-09-14T09:05:36.113 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 34/37 2024-09-14T09:05:36.113 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:05:36.113 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T09:05:36.113 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T09:05:36.113 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T09:05:36.113 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:36.269 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T09:05:36.301 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 35/37 2024-09-14T09:05:36.325 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 35/37 2024-09-14T09:05:36.325 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:05:36.326 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T09:05:36.326 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T09:05:36.326 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T09:05:36.326 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:36.340 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-14T09:05:36.381 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-14T09:05:36.418 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-14T09:05:36.489 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-14T09:05:36.542 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-14T09:05:36.552 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 36/37 2024-09-14T09:05:36.561 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 35/37 2024-09-14T09:05:36.574 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-14T09:05:36.576 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 36/37 2024-09-14T09:05:36.576 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:05:36.576 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T09:05:36.576 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T09:05:36.576 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T09:05:36.577 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:36.585 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 35/37 2024-09-14T09:05:36.585 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:05:36.585 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T09:05:36.585 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T09:05:36.585 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T09:05:36.585 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:36.640 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 37/37 2024-09-14T09:05:36.665 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-14T09:05:36.744 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-14T09:05:36.785 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-14T09:05:36.811 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 36/37 2024-09-14T09:05:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-14T09:05:36.835 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 36/37 2024-09-14T09:05:36.835 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:05:36.835 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T09:05:36.835 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T09:05:36.835 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T09:05:36.835 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:36.867 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-14T09:05:36.891 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 37/37 2024-09-14T09:05:36.901 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-14T09:05:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-14T09:05:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-14T09:05:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-14T09:05:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-14T09:05:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-14T09:05:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-14T09:05:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-14T09:05:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-14T09:05:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-14T09:05:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-14T09:05:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-14T09:05:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-14T09:05:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-14T09:05:37.832 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-14T09:05:38.008 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-14T09:05:38.107 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-14T09:05:38.195 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-14T09:05:38.237 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-14T09:05:38.364 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-14T09:05:38.438 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 37/37 2024-09-14T09:05:38.438 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 1/37 2024-09-14T09:05:38.438 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 2/37 2024-09-14T09:05:38.438 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 3/37 2024-09-14T09:05:38.438 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 4/37 2024-09-14T09:05:38.439 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 5/37 2024-09-14T09:05:38.439 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9. 6/37 2024-09-14T09:05:38.439 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-14T09:05:38.439 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-14T09:05:38.439 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-14T09:05:38.439 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-14T09:05:38.439 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-14T09:05:38.439 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-14T09:05:38.440 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-14T09:05:38.440 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-14T09:05:38.440 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-14T09:05:38.440 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-14T09:05:38.440 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-14T09:05:38.440 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-14T09:05:38.440 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-14T09:05:38.440 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-14T09:05:38.440 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-14T09:05:38.440 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-14T09:05:38.440 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-14T09:05:38.440 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-14T09:05:38.440 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-14T09:05:38.441 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-14T09:05:38.441 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-14T09:05:38.441 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-14T09:05:38.441 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-14T09:05:38.441 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-14T09:05:38.441 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-14T09:05:38.441 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-14T09:05:38.441 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-14T09:05:38.441 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-14T09:05:38.441 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-14T09:05:38.441 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-14T09:05:38.535 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9. 32/37 2024-09-14T09:05:38.564 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 33/37 2024-09-14T09:05:38.590 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 33/37 2024-09-14T09:05:38.590 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:05:38.590 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T09:05:38.590 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T09:05:38.590 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T09:05:38.590 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 37/37 2024-09-14T09:05:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 1/37 2024-09-14T09:05:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 2/37 2024-09-14T09:05:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 3/37 2024-09-14T09:05:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 4/37 2024-09-14T09:05:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 5/37 2024-09-14T09:05:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9. 6/37 2024-09-14T09:05:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-14T09:05:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-14T09:05:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-14T09:05:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-14T09:05:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-14T09:05:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-14T09:05:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-14T09:05:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-14T09:05:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-14T09:05:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-14T09:05:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-14T09:05:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-14T09:05:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-14T09:05:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-14T09:05:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-14T09:05:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-14T09:05:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-14T09:05:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-14T09:05:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-14T09:05:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-14T09:05:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-14T09:05:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-14T09:05:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-14T09:05:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-14T09:05:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-14T09:05:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-14T09:05:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-14T09:05:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-14T09:05:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-14T09:05:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-14T09:05:39.404 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-14T09:05:39.404 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:39.404 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-14T09:05:39.404 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:39.404 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:39.404 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:39.404 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:05:39.404 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:39.404 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:39.404 INFO:teuthology.orchestra.run.smithi148.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T09:05:39.405 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T09:05:39.405 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T09:05:39.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T09:05:39.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T09:05:39.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T09:05:39.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T09:05:39.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T09:05:39.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T09:05:39.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T09:05:39.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T09:05:39.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T09:05:39.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T09:05:39.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T09:05:39.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T09:05:39.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T09:05:39.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T09:05:39.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T09:05:39.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T09:05:39.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T09:05:39.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T09:05:39.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T09:05:39.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T09:05:39.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T09:05:39.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T09:05:39.407 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T09:05:39.407 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T09:05:39.407 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T09:05:39.407 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T09:05:39.407 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T09:05:39.407 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T09:05:39.407 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:39.407 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:05:39.605 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-14T09:05:39.605 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:39.605 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-14T09:05:39.605 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:39.605 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:39.605 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:39.605 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:05:39.606 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:39.606 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:39.606 INFO:teuthology.orchestra.run.smithi144.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T09:05:39.606 INFO:teuthology.orchestra.run.smithi144.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T09:05:39.606 INFO:teuthology.orchestra.run.smithi144.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T09:05:39.606 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T09:05:39.606 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T09:05:39.606 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T09:05:39.606 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T09:05:39.606 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T09:05:39.606 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T09:05:39.606 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T09:05:39.606 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T09:05:39.607 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T09:05:39.607 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T09:05:39.607 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T09:05:39.607 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T09:05:39.607 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T09:05:39.607 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T09:05:39.607 INFO:teuthology.orchestra.run.smithi144.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T09:05:39.607 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T09:05:39.607 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T09:05:39.607 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T09:05:39.607 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T09:05:39.607 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T09:05:39.608 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T09:05:39.608 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T09:05:39.608 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T09:05:39.608 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T09:05:39.608 INFO:teuthology.orchestra.run.smithi144.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T09:05:39.608 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T09:05:39.608 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T09:05:39.608 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T09:05:39.608 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:39.608 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:05:39.774 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-base 2024-09-14T09:05:40.027 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-base 2024-09-14T09:05:40.048 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 34/37 2024-09-14T09:05:40.076 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 34/37 2024-09-14T09:05:40.076 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:05:40.076 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T09:05:40.076 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T09:05:40.076 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T09:05:40.076 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:40.355 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:00 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:05:40.445 INFO:teuthology.orchestra.run.smithi148.stdout:Package ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:05:40.486 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:05:40.487 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-14T09:05:40.487 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:05:40.524 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 35/37 2024-09-14T09:05:40.548 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install cephadm 2024-09-14T09:05:40.548 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 35/37 2024-09-14T09:05:40.549 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:05:40.549 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T09:05:40.549 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T09:05:40.549 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T09:05:40.549 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:40.595 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:00:58 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:05:40.686 INFO:teuthology.orchestra.run.smithi144.stdout:Package ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:05:40.728 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:05:40.729 INFO:teuthology.orchestra.run.smithi144.stdout:Nothing to do. 2024-09-14T09:05:40.729 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:05:40.774 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 36/37 2024-09-14T09:05:40.794 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install cephadm 2024-09-14T09:05:40.798 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 36/37 2024-09-14T09:05:40.798 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:05:40.798 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T09:05:40.799 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T09:05:40.799 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T09:05:40.799 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:40.866 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 37/37 2024-09-14T09:05:41.107 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:01 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:05:41.240 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:05:41.241 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:05:41.241 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-14T09:05:41.241 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:05:41.241 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-14T09:05:41.241 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 783 k 2024-09-14T09:05:41.242 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:41.242 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-14T09:05:41.242 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:05:41.242 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-14T09:05:41.242 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:41.242 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 783 k 2024-09-14T09:05:41.242 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 789 k 2024-09-14T09:05:41.242 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-14T09:05:41.358 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:00:59 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:05:41.491 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:05:41.492 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:05:41.492 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2024-09-14T09:05:41.492 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:05:41.492 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-14T09:05:41.492 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 783 k 2024-09-14T09:05:41.492 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:41.492 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-14T09:05:41.493 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:05:41.493 INFO:teuthology.orchestra.run.smithi144.stdout:Install 1 Package 2024-09-14T09:05:41.493 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:41.493 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 783 k 2024-09-14T09:05:41.493 INFO:teuthology.orchestra.run.smithi144.stdout:Installed size: 789 k 2024-09-14T09:05:41.493 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-14T09:05:41.517 INFO:teuthology.orchestra.run.smithi148.stdout:cephadm-19.3.0-4775.g7f24e589.el9.noarch.rpm 2.8 MB/s | 783 kB 00:00 2024-09-14T09:05:41.517 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:05:41.518 INFO:teuthology.orchestra.run.smithi148.stdout:Total 2.8 MB/s | 783 kB 00:00 2024-09-14T09:05:41.518 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-14T09:05:41.523 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-14T09:05:41.523 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-14T09:05:41.529 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-14T09:05:41.529 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-14T09:05:41.603 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-14T09:05:41.770 INFO:teuthology.orchestra.run.smithi144.stdout:cephadm-19.3.0-4775.g7f24e589.el9.noarch.rpm 2.8 MB/s | 783 kB 00:00 2024-09-14T09:05:41.770 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:05:41.770 INFO:teuthology.orchestra.run.smithi144.stdout:Total 2.8 MB/s | 783 kB 00:00 2024-09-14T09:05:41.771 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-14T09:05:41.776 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-14T09:05:41.776 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-14T09:05:41.782 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-14T09:05:41.782 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-14T09:05:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-14T09:05:42.008 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T09:05:42.095 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T09:05:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T09:05:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T09:05:42.453 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T09:05:42.565 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 37/37 2024-09-14T09:05:42.565 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 1/37 2024-09-14T09:05:42.565 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 2/37 2024-09-14T09:05:42.565 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 3/37 2024-09-14T09:05:42.565 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 4/37 2024-09-14T09:05:42.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 5/37 2024-09-14T09:05:42.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9. 6/37 2024-09-14T09:05:42.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-14T09:05:42.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-14T09:05:42.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-14T09:05:42.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-14T09:05:42.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-14T09:05:42.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-14T09:05:42.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-14T09:05:42.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-14T09:05:42.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-14T09:05:42.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-14T09:05:42.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-14T09:05:42.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-14T09:05:42.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-14T09:05:42.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-14T09:05:42.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-14T09:05:42.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-14T09:05:42.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-14T09:05:42.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-14T09:05:42.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-14T09:05:42.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-14T09:05:42.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-14T09:05:42.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-14T09:05:42.568 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-14T09:05:42.568 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-14T09:05:42.568 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-14T09:05:42.568 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-14T09:05:42.569 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-14T09:05:42.569 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-14T09:05:42.569 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-14T09:05:42.569 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-14T09:05:42.705 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T09:05:42.705 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:42.705 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-14T09:05:42.705 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:05:42.705 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:42.705 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:05:42.760 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T09:05:42.905 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-immutable-object-cache 2024-09-14T09:05:43.009 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T09:05:43.010 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:43.010 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-14T09:05:43.010 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:05:43.010 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:43.010 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:05:43.202 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-immutable-object-cache 2024-09-14T09:05:43.361 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-14T09:05:43.361 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:43.361 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T09:05:43.361 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:43.361 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:43.361 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:43.361 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:05:43.361 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:43.361 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:43.361 INFO:teuthology.orchestra.run.smithi116.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T09:05:43.361 INFO:teuthology.orchestra.run.smithi116.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T09:05:43.362 INFO:teuthology.orchestra.run.smithi116.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T09:05:43.362 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T09:05:43.362 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T09:05:43.362 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T09:05:43.362 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T09:05:43.362 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T09:05:43.362 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T09:05:43.362 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T09:05:43.362 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T09:05:43.362 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T09:05:43.362 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T09:05:43.362 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T09:05:43.362 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T09:05:43.363 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T09:05:43.363 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T09:05:43.363 INFO:teuthology.orchestra.run.smithi116.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T09:05:43.363 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T09:05:43.363 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T09:05:43.363 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T09:05:43.363 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T09:05:43.363 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T09:05:43.363 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T09:05:43.363 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T09:05:43.363 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T09:05:43.363 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T09:05:43.363 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T09:05:43.364 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T09:05:43.364 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T09:05:43.364 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T09:05:43.364 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:43.364 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:05:43.480 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:03 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:05:43.616 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:05:43.617 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:05:43.617 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repo Size 2024-09-14T09:05:43.617 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:05:43.617 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-14T09:05:43.617 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 145 k 2024-09-14T09:05:43.617 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:43.618 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-14T09:05:43.618 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:05:43.618 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-14T09:05:43.618 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:43.618 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 145 k 2024-09-14T09:05:43.618 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 432 k 2024-09-14T09:05:43.618 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-14T09:05:43.756 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-base 2024-09-14T09:05:43.781 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:01:01 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:05:43.824 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-immutable-object-cache-19.3.0-4775.g7f24e5 703 kB/s | 145 kB 00:00 2024-09-14T09:05:43.825 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:05:43.826 INFO:teuthology.orchestra.run.smithi148.stdout:Total 696 kB/s | 145 kB 00:00 2024-09-14T09:05:43.826 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-14T09:05:43.833 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-14T09:05:43.833 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-14T09:05:43.891 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-14T09:05:43.892 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-14T09:05:43.919 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:05:43.920 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:05:43.921 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repo Size 2024-09-14T09:05:43.921 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:05:43.921 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-14T09:05:43.921 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 145 k 2024-09-14T09:05:43.921 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:43.921 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-14T09:05:43.921 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:05:43.921 INFO:teuthology.orchestra.run.smithi144.stdout:Install 1 Package 2024-09-14T09:05:43.921 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:43.921 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 145 k 2024-09-14T09:05:43.921 INFO:teuthology.orchestra.run.smithi144.stdout:Installed size: 432 k 2024-09-14T09:05:43.922 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-14T09:05:44.058 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-14T09:05:44.126 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-immutable-object-cache-19.3.0-4775.g7f24e5 711 kB/s | 145 kB 00:00 2024-09-14T09:05:44.126 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:05:44.126 INFO:teuthology.orchestra.run.smithi144.stdout:Total 705 kB/s | 145 kB 00:00 2024-09-14T09:05:44.127 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-14T09:05:44.134 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-14T09:05:44.134 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-14T09:05:44.142 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T09:05:44.168 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T09:05:44.168 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:05:44.168 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T09:05:44.168 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:44.191 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-14T09:05:44.192 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-14T09:05:44.329 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:00:59 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:05:44.340 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-14T09:05:44.401 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T09:05:44.419 INFO:teuthology.orchestra.run.smithi116.stdout:Package ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:05:44.427 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T09:05:44.427 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:05:44.427 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T09:05:44.427 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:44.460 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:05:44.461 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-14T09:05:44.461 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:05:44.538 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install cephadm 2024-09-14T09:05:45.091 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T09:05:45.091 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:45.092 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-14T09:05:45.092 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:45.092 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:45.092 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:05:45.100 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:00 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:05:45.232 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:05:45.233 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:05:45.233 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-14T09:05:45.233 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:05:45.233 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T09:05:45.233 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 783 k 2024-09-14T09:05:45.233 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:45.233 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T09:05:45.233 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:05:45.233 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-14T09:05:45.233 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:45.233 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 783 k 2024-09-14T09:05:45.233 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 789 k 2024-09-14T09:05:45.233 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T09:05:45.340 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-mgr 2024-09-14T09:05:45.389 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T09:05:45.389 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:45.389 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-14T09:05:45.389 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:45.390 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:45.390 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:05:45.500 INFO:teuthology.orchestra.run.smithi116.stdout:cephadm-19.3.0-4775.g7f24e589.el9.noarch.rpm 2.9 MB/s | 783 kB 00:00 2024-09-14T09:05:45.500 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:05:45.501 INFO:teuthology.orchestra.run.smithi116.stdout:Total 2.9 MB/s | 783 kB 00:00 2024-09-14T09:05:45.501 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T09:05:45.506 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T09:05:45.506 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T09:05:45.512 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T09:05:45.512 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T09:05:45.585 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T09:05:45.613 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-mgr 2024-09-14T09:05:45.922 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:05 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:05:46.014 INFO:teuthology.orchestra.run.smithi148.stdout:Package ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:05:46.024 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T09:05:46.056 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:05:46.057 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-14T09:05:46.057 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:05:46.111 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T09:05:46.121 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-mgr-dashboard 2024-09-14T09:05:46.185 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:01:04 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:05:46.280 INFO:teuthology.orchestra.run.smithi144.stdout:Package ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:05:46.323 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:05:46.325 INFO:teuthology.orchestra.run.smithi144.stdout:Nothing to do. 2024-09-14T09:05:46.325 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:05:46.391 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-mgr-dashboard 2024-09-14T09:05:46.498 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T09:05:46.682 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:06 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:05:46.752 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T09:05:46.752 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:46.752 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T09:05:46.752 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:05:46.752 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:46.752 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:05:46.814 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:05:46.815 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:05:46.815 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-14T09:05:46.815 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:05:46.815 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-14T09:05:46.815 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 14 M 2024-09-14T09:05:46.815 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-14T09:05:46.815 INFO:teuthology.orchestra.run.smithi148.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T09:05:46.815 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 34 k 2024-09-14T09:05:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 16 k 2024-09-14T09:05:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T09:05:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T09:05:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T09:05:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T09:05:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T09:05:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T09:05:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T09:05:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T09:05:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:46.816 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-14T09:05:46.816 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:05:46.816 INFO:teuthology.orchestra.run.smithi148.stdout:Install 12 Packages 2024-09-14T09:05:46.816 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:46.817 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 19 M 2024-09-14T09:05:46.817 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 159 M 2024-09-14T09:05:46.817 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-14T09:05:46.945 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:01:04 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:05:46.964 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-immutable-object-cache 2024-09-14T09:05:47.076 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:05:47.078 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:05:47.078 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2024-09-14T09:05:47.078 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:05:47.078 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-14T09:05:47.078 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 14 M 2024-09-14T09:05:47.078 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2024-09-14T09:05:47.078 INFO:teuthology.orchestra.run.smithi144.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T09:05:47.078 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 34 k 2024-09-14T09:05:47.078 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 16 k 2024-09-14T09:05:47.078 INFO:teuthology.orchestra.run.smithi144.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T09:05:47.078 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T09:05:47.078 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T09:05:47.079 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T09:05:47.079 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T09:05:47.079 INFO:teuthology.orchestra.run.smithi144.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T09:05:47.079 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T09:05:47.079 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T09:05:47.079 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:47.079 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-14T09:05:47.079 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:05:47.079 INFO:teuthology.orchestra.run.smithi144.stdout:Install 12 Packages 2024-09-14T09:05:47.079 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:47.080 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 19 M 2024-09-14T09:05:47.080 INFO:teuthology.orchestra.run.smithi144.stdout:Installed size: 159 M 2024-09-14T09:05:47.080 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-14T09:05:47.494 INFO:teuthology.orchestra.run.smithi148.stdout:(1/12): ceph-grafana-dashboards-19.3.0-4775.g7f 218 kB/s | 34 kB 00:00 2024-09-14T09:05:47.520 INFO:teuthology.orchestra.run.smithi148.stdout:(2/12): ceph-prometheus-alerts-19.3.0-4775.g7f2 90 kB/s | 16 kB 00:00 2024-09-14T09:05:47.537 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:02 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:05:47.645 INFO:teuthology.orchestra.run.smithi148.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.1 MB/s | 269 kB 00:00 2024-09-14T09:05:47.673 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:05:47.674 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:05:47.674 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-09-14T09:05:47.674 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:05:47.674 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T09:05:47.674 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 145 k 2024-09-14T09:05:47.674 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:47.674 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T09:05:47.674 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:05:47.675 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-14T09:05:47.675 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:47.675 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 145 k 2024-09-14T09:05:47.675 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 432 k 2024-09-14T09:05:47.675 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T09:05:47.679 INFO:teuthology.orchestra.run.smithi144.stdout:(1/12): ceph-grafana-dashboards-19.3.0-4775.g7f 227 kB/s | 34 kB 00:00 2024-09-14T09:05:47.704 INFO:teuthology.orchestra.run.smithi144.stdout:(2/12): ceph-prometheus-alerts-19.3.0-4775.g7f2 93 kB/s | 16 kB 00:00 2024-09-14T09:05:47.712 INFO:teuthology.orchestra.run.smithi148.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.6 MB/s | 1.0 MB 00:00 2024-09-14T09:05:47.762 INFO:teuthology.orchestra.run.smithi148.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-14T09:05:47.787 INFO:teuthology.orchestra.run.smithi148.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-14T09:05:47.821 INFO:teuthology.orchestra.run.smithi148.stdout:(7/12): protobuf-compiler-3.14.0-13.el9.x86_64. 4.8 MB/s | 863 kB 00:00 2024-09-14T09:05:47.830 INFO:teuthology.orchestra.run.smithi144.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.1 MB/s | 269 kB 00:00 2024-09-14T09:05:47.871 INFO:teuthology.orchestra.run.smithi148.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.8 MB/s | 144 kB 00:00 2024-09-14T09:05:47.872 INFO:teuthology.orchestra.run.smithi144.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 5.3 MB/s | 1.0 MB 00:00 2024-09-14T09:05:47.873 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-immutable-object-cache-19.3.0-4775.g7f24e5 734 kB/s | 145 kB 00:00 2024-09-14T09:05:47.873 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:05:47.874 INFO:teuthology.orchestra.run.smithi116.stdout:Total 729 kB/s | 145 kB 00:00 2024-09-14T09:05:47.874 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T09:05:47.881 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T09:05:47.881 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T09:05:47.896 INFO:teuthology.orchestra.run.smithi148.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-14T09:05:47.922 INFO:teuthology.orchestra.run.smithi144.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-14T09:05:47.922 INFO:teuthology.orchestra.run.smithi148.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-14T09:05:47.938 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T09:05:47.938 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T09:05:47.947 INFO:teuthology.orchestra.run.smithi144.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-14T09:05:47.981 INFO:teuthology.orchestra.run.smithi148.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 11 MB/s | 2.0 MB 00:00 2024-09-14T09:05:48.014 INFO:teuthology.orchestra.run.smithi144.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 31 MB/s | 2.0 MB 00:00 2024-09-14T09:05:48.039 INFO:teuthology.orchestra.run.smithi144.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-14T09:05:48.065 INFO:teuthology.orchestra.run.smithi144.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-14T09:05:48.090 INFO:teuthology.orchestra.run.smithi144.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-14T09:05:48.097 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T09:05:48.164 INFO:teuthology.orchestra.run.smithi148.stdout:(12/12): ceph-mgr-dashboard-19.3.0-4775.g7f24e5 17 MB/s | 14 MB 00:00 2024-09-14T09:05:48.169 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:05:48.169 INFO:teuthology.orchestra.run.smithi148.stdout:Total 14 MB/s | 19 MB 00:01 2024-09-14T09:05:48.173 INFO:teuthology.orchestra.run.smithi144.stdout:(11/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.5 MB/s | 863 kB 00:00 2024-09-14T09:05:48.190 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T09:05:48.215 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T09:05:48.215 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:05:48.215 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T09:05:48.215 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:48.221 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-14T09:05:48.241 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-14T09:05:48.241 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-14T09:05:48.526 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-14T09:05:48.527 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-14T09:05:48.774 INFO:teuthology.orchestra.run.smithi144.stdout:(12/12): ceph-mgr-dashboard-19.3.0-4775.g7f24e5 11 MB/s | 14 MB 00:01 2024-09-14T09:05:48.777 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:05:48.777 INFO:teuthology.orchestra.run.smithi144.stdout:Total 11 MB/s | 19 MB 00:01 2024-09-14T09:05:48.825 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-14T09:05:48.843 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-14T09:05:48.843 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-14T09:05:49.106 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-14T09:05:49.106 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-14T09:05:49.141 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-14T09:05:49.167 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T09:05:49.167 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:49.167 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T09:05:49.167 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:05:49.167 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:49.167 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:05:49.231 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-14T09:05:49.274 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-14T09:05:49.321 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-14T09:05:49.352 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-14T09:05:49.409 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr 2024-09-14T09:05:49.459 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-14T09:05:49.586 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-14T09:05:49.679 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-14T09:05:49.698 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-14T09:05:49.723 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-14T09:05:49.760 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-14T09:05:49.782 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-14T09:05:49.792 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9 10/12 2024-09-14T09:05:49.818 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-14T09:05:49.865 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-14T09:05:49.895 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-14T09:05:49.980 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:04 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:05:50.012 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-14T09:05:50.070 INFO:teuthology.orchestra.run.smithi116.stdout:Package ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:05:50.112 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:05:50.113 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-14T09:05:50.114 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:05:50.138 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-14T09:05:50.179 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr-dashboard 2024-09-14T09:05:50.223 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-14T09:05:50.275 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-14T09:05:50.303 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-14T09:05:50.335 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9 10/12 2024-09-14T09:05:50.748 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:05 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:05:50.880 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:05:50.881 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:05:50.881 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-14T09:05:50.881 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:05:50.882 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T09:05:50.882 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 14 M 2024-09-14T09:05:50.882 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-14T09:05:50.882 INFO:teuthology.orchestra.run.smithi116.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T09:05:50.882 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 34 k 2024-09-14T09:05:50.882 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 16 k 2024-09-14T09:05:50.882 INFO:teuthology.orchestra.run.smithi116.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T09:05:50.882 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T09:05:50.882 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T09:05:50.882 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T09:05:50.882 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T09:05:50.882 INFO:teuthology.orchestra.run.smithi116.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T09:05:50.882 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T09:05:50.882 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T09:05:50.883 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:50.883 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T09:05:50.883 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:05:50.883 INFO:teuthology.orchestra.run.smithi116.stdout:Install 12 Packages 2024-09-14T09:05:50.883 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:50.883 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 19 M 2024-09-14T09:05:50.884 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 159 M 2024-09-14T09:05:50.884 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T09:05:51.252 INFO:teuthology.orchestra.run.smithi116.stdout:(1/12): ceph-grafana-dashboards-19.3.0-4775.g7f 234 kB/s | 34 kB 00:00 2024-09-14T09:05:51.277 INFO:teuthology.orchestra.run.smithi116.stdout:(2/12): ceph-prometheus-alerts-19.3.0-4775.g7f2 96 kB/s | 16 kB 00:00 2024-09-14T09:05:51.469 INFO:teuthology.orchestra.run.smithi116.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.4 MB/s | 269 kB 00:00 2024-09-14T09:05:51.636 INFO:teuthology.orchestra.run.smithi116.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 2.6 MB/s | 1.0 MB 00:00 2024-09-14T09:05:51.669 INFO:teuthology.orchestra.run.smithi116.stdout:(5/12): protobuf-compiler-3.14.0-13.el9.x86_64. 4.2 MB/s | 863 kB 00:00 2024-09-14T09:05:51.720 INFO:teuthology.orchestra.run.smithi116.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 389 kB/s | 19 kB 00:00 2024-09-14T09:05:51.862 INFO:teuthology.orchestra.run.smithi116.stdout:(7/12): ceph-mgr-dashboard-19.3.0-4775.g7f24e58 19 MB/s | 14 MB 00:00 2024-09-14T09:05:51.904 INFO:teuthology.orchestra.run.smithi116.stdout:(8/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 2.0 MB/s | 548 kB 00:00 2024-09-14T09:05:51.929 INFO:teuthology.orchestra.run.smithi116.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.3 MB/s | 31 kB 00:00 2024-09-14T09:05:51.954 INFO:teuthology.orchestra.run.smithi116.stdout:(10/12): python3-grpcio-tools-1.46.7-10.el9.x86 1.5 MB/s | 144 kB 00:00 2024-09-14T09:05:51.979 INFO:teuthology.orchestra.run.smithi116.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-14T09:05:52.038 INFO:teuthology.orchestra.run.smithi116.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 6.4 MB/s | 2.0 MB 00:00 2024-09-14T09:05:52.042 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:05:52.042 INFO:teuthology.orchestra.run.smithi116.stdout:Total 17 MB/s | 19 MB 00:01 2024-09-14T09:05:52.090 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T09:05:52.109 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T09:05:52.109 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T09:05:52.373 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T09:05:52.373 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T09:05:52.963 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T09:05:52.966 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el 11/12 2024-09-14T09:05:53.030 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 12/12 2024-09-14T09:05:53.038 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-14T09:05:53.082 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-14T09:05:53.129 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-14T09:05:53.167 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-14T09:05:53.277 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-14T09:05:53.403 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-14T09:05:53.504 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-14T09:05:53.512 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el 11/12 2024-09-14T09:05:53.548 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-14T09:05:53.573 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 12/12 2024-09-14T09:05:53.584 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-14T09:05:53.616 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9 10/12 2024-09-14T09:05:54.911 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 12/12 2024-09-14T09:05:54.911 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el 1/12 2024-09-14T09:05:54.911 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 2/12 2024-09-14T09:05:54.911 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9 3/12 2024-09-14T09:05:54.911 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-14T09:05:54.911 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-14T09:05:54.911 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-14T09:05:54.911 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-14T09:05:54.912 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-14T09:05:54.912 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-14T09:05:54.912 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-14T09:05:54.912 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-14T09:05:55.220 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-14T09:05:55.220 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:55.220 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-14T09:05:55.220 INFO:teuthology.orchestra.run.smithi148.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T09:05:55.220 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:05:55.220 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:05:55.220 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:05:55.220 INFO:teuthology.orchestra.run.smithi148.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T09:05:55.220 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T09:05:55.221 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T09:05:55.221 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T09:05:55.221 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T09:05:55.221 INFO:teuthology.orchestra.run.smithi148.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T09:05:55.221 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T09:05:55.221 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T09:05:55.221 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:55.221 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:05:55.456 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 12/12 2024-09-14T09:05:55.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el 1/12 2024-09-14T09:05:55.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 2/12 2024-09-14T09:05:55.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9 3/12 2024-09-14T09:05:55.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-14T09:05:55.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-14T09:05:55.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-14T09:05:55.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-14T09:05:55.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-14T09:05:55.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-14T09:05:55.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-14T09:05:55.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-14T09:05:55.493 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-14T09:05:55.790 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-14T09:05:55.791 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:55.791 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-14T09:05:55.791 INFO:teuthology.orchestra.run.smithi144.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T09:05:55.791 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:05:55.791 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:05:55.792 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:05:55.792 INFO:teuthology.orchestra.run.smithi144.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T09:05:55.792 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T09:05:55.792 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T09:05:55.792 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T09:05:55.792 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T09:05:55.793 INFO:teuthology.orchestra.run.smithi144.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T09:05:55.793 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T09:05:55.793 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T09:05:55.793 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:55.793 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:05:56.032 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-14T09:05:56.054 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:16 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:05:56.189 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:05:56.190 INFO:teuthology.orchestra.run.smithi148.stdout:======================================================================================= 2024-09-14T09:05:56.190 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-14T09:05:56.190 INFO:teuthology.orchestra.run.smithi148.stdout:======================================================================================= 2024-09-14T09:05:56.190 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-14T09:05:56.190 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 7.4 M 2024-09-14T09:05:56.190 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-14T09:05:56.190 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T09:05:56.190 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T09:05:56.190 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T09:05:56.190 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T09:05:56.190 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T09:05:56.191 INFO:teuthology.orchestra.run.smithi148.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T09:05:56.191 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T09:05:56.191 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T09:05:56.191 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T09:05:56.191 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T09:05:56.191 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T09:05:56.191 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:56.191 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-14T09:05:56.191 INFO:teuthology.orchestra.run.smithi148.stdout:======================================================================================= 2024-09-14T09:05:56.191 INFO:teuthology.orchestra.run.smithi148.stdout:Install 12 Packages 2024-09-14T09:05:56.191 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:05:56.192 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 38 M 2024-09-14T09:05:56.192 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 212 M 2024-09-14T09:05:56.192 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-14T09:05:56.546 INFO:teuthology.orchestra.run.smithi148.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 872 kB/s | 191 kB 00:00 2024-09-14T09:05:56.600 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:01:14 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:05:56.654 INFO:teuthology.orchestra.run.smithi148.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-14T09:05:56.679 INFO:teuthology.orchestra.run.smithi148.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 245 kB/s | 33 kB 00:00 2024-09-14T09:05:56.733 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:05:56.734 INFO:teuthology.orchestra.run.smithi144.stdout:======================================================================================= 2024-09-14T09:05:56.734 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2024-09-14T09:05:56.734 INFO:teuthology.orchestra.run.smithi144.stdout:======================================================================================= 2024-09-14T09:05:56.734 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-14T09:05:56.734 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 7.4 M 2024-09-14T09:05:56.734 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2024-09-14T09:05:56.734 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T09:05:56.734 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T09:05:56.735 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T09:05:56.735 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T09:05:56.735 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T09:05:56.735 INFO:teuthology.orchestra.run.smithi144.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T09:05:56.735 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T09:05:56.735 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T09:05:56.735 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T09:05:56.735 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T09:05:56.735 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T09:05:56.735 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:56.735 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-14T09:05:56.735 INFO:teuthology.orchestra.run.smithi144.stdout:======================================================================================= 2024-09-14T09:05:56.735 INFO:teuthology.orchestra.run.smithi144.stdout:Install 12 Packages 2024-09-14T09:05:56.736 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:05:56.736 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 38 M 2024-09-14T09:05:56.736 INFO:teuthology.orchestra.run.smithi144.stdout:Installed size: 212 M 2024-09-14T09:05:56.736 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-14T09:05:56.805 INFO:teuthology.orchestra.run.smithi148.stdout:(4/12): ceph-mgr-diskprediction-local-19.3.0-47 15 MB/s | 7.4 MB 00:00 2024-09-14T09:05:56.823 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el 11/12 2024-09-14T09:05:56.830 INFO:teuthology.orchestra.run.smithi148.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 121 kB/s | 18 kB 00:00 2024-09-14T09:05:56.879 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 12/12 2024-09-14T09:05:56.914 INFO:teuthology.orchestra.run.smithi148.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 355 kB/s | 38 kB 00:00 2024-09-14T09:05:57.072 INFO:teuthology.orchestra.run.smithi148.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 7.2 MB/s | 3.0 MB 00:00 2024-09-14T09:05:57.097 INFO:teuthology.orchestra.run.smithi148.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.3 MB/s | 245 kB 00:00 2024-09-14T09:05:57.164 INFO:teuthology.orchestra.run.smithi144.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-14T09:05:57.189 INFO:teuthology.orchestra.run.smithi148.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 14 MB/s | 4.9 MB 00:00 2024-09-14T09:05:57.206 INFO:teuthology.orchestra.run.smithi144.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.0 MB/s | 801 kB 00:00 2024-09-14T09:05:57.215 INFO:teuthology.orchestra.run.smithi148.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.1 MB/s | 250 kB 00:00 2024-09-14T09:05:57.290 INFO:teuthology.orchestra.run.smithi144.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-09-14T09:05:57.340 INFO:teuthology.orchestra.run.smithi148.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 5.1 MB 00:00 2024-09-14T09:05:57.340 INFO:teuthology.orchestra.run.smithi144.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 363 kB/s | 18 kB 00:00 2024-09-14T09:05:57.432 INFO:teuthology.orchestra.run.smithi144.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 419 kB/s | 38 kB 00:00 2024-09-14T09:05:57.524 INFO:teuthology.orchestra.run.smithi144.stdout:(6/12): ceph-mgr-diskprediction-local-19.3.0-47 14 MB/s | 7.4 MB 00:00 2024-09-14T09:05:57.715 INFO:teuthology.orchestra.run.smithi148.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-14T09:05:57.716 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:05:57.716 INFO:teuthology.orchestra.run.smithi144.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-09-14T09:05:57.716 INFO:teuthology.orchestra.run.smithi148.stdout:Total 25 MB/s | 38 MB 00:01 2024-09-14T09:05:58.068 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-14T09:05:58.094 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-14T09:05:58.094 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-14T09:05:58.216 INFO:teuthology.orchestra.run.smithi144.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 10 MB/s | 5.1 MB 00:00 2024-09-14T09:05:58.283 INFO:teuthology.orchestra.run.smithi144.stdout:(9/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.8 MB/s | 3.0 MB 00:01 2024-09-14T09:05:58.308 INFO:teuthology.orchestra.run.smithi144.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.7 MB/s | 250 kB 00:00 2024-09-14T09:05:58.375 INFO:teuthology.orchestra.run.smithi144.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 5.2 MB/s | 4.9 MB 00:00 2024-09-14T09:05:58.536 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-14T09:05:58.536 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-14T09:05:58.812 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 12/12 2024-09-14T09:05:58.812 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el 1/12 2024-09-14T09:05:58.812 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 2/12 2024-09-14T09:05:58.812 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9 3/12 2024-09-14T09:05:58.812 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-14T09:05:58.813 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-14T09:05:58.813 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-14T09:05:58.813 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-14T09:05:58.813 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-14T09:05:58.813 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-14T09:05:58.813 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-14T09:05:58.813 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-14T09:05:59.135 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-14T09:05:59.135 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:59.135 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T09:05:59.135 INFO:teuthology.orchestra.run.smithi116.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T09:05:59.135 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:05:59.135 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:05:59.135 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:05:59.136 INFO:teuthology.orchestra.run.smithi116.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T09:05:59.136 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T09:05:59.136 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T09:05:59.136 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T09:05:59.136 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T09:05:59.136 INFO:teuthology.orchestra.run.smithi116.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T09:05:59.136 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T09:05:59.136 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T09:05:59.136 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:05:59.136 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:05:59.333 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-14T09:05:59.407 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-14T09:05:59.413 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-14T09:05:59.455 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-14T09:05:59.555 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-14T09:05:59.598 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-14T09:05:59.784 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-14T09:05:59.822 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-14T09:05:59.899 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-14T09:05:59.968 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:14 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:06:00.101 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:06:00.102 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2024-09-14T09:06:00.102 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-14T09:06:00.103 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2024-09-14T09:06:00.103 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T09:06:00.103 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 7.4 M 2024-09-14T09:06:00.103 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-14T09:06:00.103 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T09:06:00.103 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T09:06:00.103 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T09:06:00.103 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T09:06:00.103 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T09:06:00.103 INFO:teuthology.orchestra.run.smithi116.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T09:06:00.103 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T09:06:00.103 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T09:06:00.103 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T09:06:00.104 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T09:06:00.104 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T09:06:00.104 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:00.104 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T09:06:00.104 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2024-09-14T09:06:00.104 INFO:teuthology.orchestra.run.smithi116.stdout:Install 12 Packages 2024-09-14T09:06:00.104 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:00.104 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 38 M 2024-09-14T09:06:00.105 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 212 M 2024-09-14T09:06:00.105 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T09:06:00.570 INFO:teuthology.orchestra.run.smithi116.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-14T09:06:00.573 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-14T09:06:00.662 INFO:teuthology.orchestra.run.smithi116.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-14T09:06:00.679 INFO:teuthology.orchestra.run.smithi116.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-14T09:06:00.694 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-14T09:06:00.746 INFO:teuthology.orchestra.run.smithi116.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 272 kB/s | 18 kB 00:00 2024-09-14T09:06:00.838 INFO:teuthology.orchestra.run.smithi116.stdout:(5/12): ceph-mgr-diskprediction-local-19.3.0-47 16 MB/s | 7.4 MB 00:00 2024-09-14T09:06:00.855 INFO:teuthology.orchestra.run.smithi116.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 355 kB/s | 38 kB 00:00 2024-09-14T09:06:00.964 INFO:teuthology.orchestra.run.smithi116.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-14T09:06:01.539 INFO:teuthology.orchestra.run.smithi116.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.4 MB/s | 3.0 MB 00:00 2024-09-14T09:06:01.622 INFO:teuthology.orchestra.run.smithi116.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-09-14T09:06:01.954 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-14T09:06:01.964 INFO:teuthology.orchestra.run.smithi116.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.1 MB/s | 5.1 MB 00:01 2024-09-14T09:06:02.115 INFO:teuthology.orchestra.run.smithi116.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 3.9 MB/s | 4.9 MB 00:01 2024-09-14T09:06:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-14T09:06:03.013 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 12/12 2024-09-14T09:06:04.248 INFO:teuthology.orchestra.run.smithi116.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.2 MB/s | 16 MB 00:02 2024-09-14T09:06:04.249 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:04.250 INFO:teuthology.orchestra.run.smithi116.stdout:Total 9.2 MB/s | 38 MB 00:04 2024-09-14T09:06:04.607 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T09:06:04.633 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T09:06:04.633 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T09:06:05.072 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T09:06:05.073 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T09:06:05.538 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 12/12 2024-09-14T09:06:05.538 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 1/12 2024-09-14T09:06:05.538 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-14T09:06:05.538 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-14T09:06:05.538 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-14T09:06:05.539 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-14T09:06:05.539 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-14T09:06:05.539 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-14T09:06:05.539 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-14T09:06:05.539 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-14T09:06:05.539 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-14T09:06:05.539 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-14T09:06:05.616 INFO:teuthology.orchestra.run.smithi144.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.2 MB/s | 16 MB 00:07 2024-09-14T09:06:05.618 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:05.618 INFO:teuthology.orchestra.run.smithi144.stdout:Total 4.3 MB/s | 38 MB 00:08 2024-09-14T09:06:05.841 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T09:06:05.911 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-14T09:06:05.954 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-14T09:06:05.954 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:05.954 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-14T09:06:05.954 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:06:05.954 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T09:06:05.954 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T09:06:05.954 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T09:06:05.954 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T09:06:05.955 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T09:06:05.955 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T09:06:05.955 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T09:06:05.955 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T09:06:05.955 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T09:06:05.955 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T09:06:05.955 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T09:06:05.955 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:05.955 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:06:05.955 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-14T09:06:05.975 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-14T09:06:06.000 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-14T09:06:06.000 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-14T09:06:06.052 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-14T09:06:06.089 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-14T09:06:06.273 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-14T09:06:06.305 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-14T09:06:06.380 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-14T09:06:06.389 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-mgr-rook 2024-09-14T09:06:06.433 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-14T09:06:06.433 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-14T09:06:06.965 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:26 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:06:07.026 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-14T09:06:07.101 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:06:07.102 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:07.102 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-14T09:06:07.102 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:07.103 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-14T09:06:07.103 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 49 k 2024-09-14T09:06:07.103 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-14T09:06:07.103 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T09:06:07.103 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T09:06:07.103 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T09:06:07.103 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T09:06:07.103 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T09:06:07.103 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T09:06:07.103 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T09:06:07.103 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T09:06:07.103 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T09:06:07.104 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T09:06:07.104 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T09:06:07.104 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T09:06:07.104 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:07.104 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-14T09:06:07.104 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:07.104 INFO:teuthology.orchestra.run.smithi148.stdout:Install 13 Packages 2024-09-14T09:06:07.104 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:07.105 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 2.2 M 2024-09-14T09:06:07.105 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 26 M 2024-09-14T09:06:07.105 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-14T09:06:07.133 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-14T09:06:07.197 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-14T09:06:07.272 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-14T09:06:07.315 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-14T09:06:07.413 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-14T09:06:07.457 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-14T09:06:07.641 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-14T09:06:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-14T09:06:07.749 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-14T09:06:07.770 INFO:teuthology.orchestra.run.smithi148.stdout:(1/13): ceph-mgr-rook-19.3.0-4775.g7f24e589.el9 292 kB/s | 49 kB 00:00 2024-09-14T09:06:07.870 INFO:teuthology.orchestra.run.smithi148.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 95 kB/s | 26 kB 00:00 2024-09-14T09:06:07.895 INFO:teuthology.orchestra.run.smithi148.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 65 kB/s | 19 kB 00:00 2024-09-14T09:06:08.296 INFO:teuthology.orchestra.run.smithi148.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 423 kB/s | 222 kB 00:00 2024-09-14T09:06:08.321 INFO:teuthology.orchestra.run.smithi148.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 352 kB/s | 159 kB 00:00 2024-09-14T09:06:08.371 INFO:teuthology.orchestra.run.smithi148.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 647 kB/s | 32 kB 00:00 2024-09-14T09:06:08.393 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-14T09:06:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-14T09:06:08.396 INFO:teuthology.orchestra.run.smithi148.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 563 kB/s | 14 kB 00:00 2024-09-14T09:06:08.422 INFO:teuthology.orchestra.run.smithi148.stdout:(8/13): python3-google-auth-2.34.0-1.el9.noarch 8.6 MB/s | 220 kB 00:00 2024-09-14T09:06:08.447 INFO:teuthology.orchestra.run.smithi148.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 506 kB/s | 279 kB 00:00 2024-09-14T09:06:08.506 INFO:teuthology.orchestra.run.smithi148.stdout:(10/13): python3-kubernetes-26.1.0-2.el9.noarch 12 MB/s | 1.0 MB 00:00 2024-09-14T09:06:08.511 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-14T09:06:08.531 INFO:teuthology.orchestra.run.smithi148.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 707 kB/s | 59 kB 00:00 2024-09-14T09:06:08.557 INFO:teuthology.orchestra.run.smithi148.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-14T09:06:08.665 INFO:teuthology.orchestra.run.smithi148.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 145 kB/s | 54 kB 00:00 2024-09-14T09:06:08.668 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:08.668 INFO:teuthology.orchestra.run.smithi148.stdout:Total 1.4 MB/s | 2.2 MB 00:01 2024-09-14T09:06:08.739 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-14T09:06:08.755 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-14T09:06:08.755 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-14T09:06:08.846 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-14T09:06:08.846 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-14T09:06:09.354 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-14T09:06:09.421 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-14T09:06:09.454 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 12/12 2024-09-14T09:06:09.540 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-14T09:06:09.600 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-14T09:06:09.654 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-14T09:06:09.692 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-14T09:06:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-14T09:06:09.733 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-14T09:06:09.834 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-14T09:06:09.946 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-14T09:06:10.002 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-14T09:06:10.720 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-14T09:06:10.774 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-14T09:06:10.782 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-14T09:06:10.806 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 12/12 2024-09-14T09:06:10.808 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-14T09:06:10.856 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-14T09:06:10.877 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 13/13 2024-09-14T09:06:11.630 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 13/13 2024-09-14T09:06:11.630 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 1/13 2024-09-14T09:06:11.630 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-14T09:06:11.631 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-14T09:06:11.631 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-14T09:06:11.631 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-14T09:06:11.631 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-14T09:06:11.631 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-14T09:06:11.631 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-14T09:06:11.631 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-14T09:06:11.631 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-14T09:06:11.631 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-14T09:06:11.631 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-14T09:06:11.968 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-14T09:06:11.969 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:11.969 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-14T09:06:11.969 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:06:11.969 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T09:06:11.969 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T09:06:11.969 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T09:06:11.969 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T09:06:11.969 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T09:06:11.969 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T09:06:11.969 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T09:06:11.969 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T09:06:11.970 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T09:06:11.970 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T09:06:11.970 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T09:06:11.970 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T09:06:11.970 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:11.970 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:06:12.075 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 12/12 2024-09-14T09:06:12.075 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 1/12 2024-09-14T09:06:12.075 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-14T09:06:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-14T09:06:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-14T09:06:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-14T09:06:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-14T09:06:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-14T09:06:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-14T09:06:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-14T09:06:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-14T09:06:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-14T09:06:12.229 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-mgr-cephadm 2024-09-14T09:06:12.525 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-14T09:06:12.525 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:12.525 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T09:06:12.525 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:06:12.525 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T09:06:12.525 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T09:06:12.525 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T09:06:12.526 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T09:06:12.526 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T09:06:12.526 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T09:06:12.526 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T09:06:12.526 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T09:06:12.526 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T09:06:12.526 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T09:06:12.526 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T09:06:12.526 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:12.526 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:06:12.802 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:32 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:06:12.939 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr-rook 2024-09-14T09:06:12.939 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:06:12.940 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:12.940 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-14T09:06:12.940 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:12.940 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-14T09:06:12.940 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 154 k 2024-09-14T09:06:12.940 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-14T09:06:12.940 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T09:06:12.940 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T09:06:12.940 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T09:06:12.940 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T09:06:12.940 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T09:06:12.940 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:12.940 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-14T09:06:12.941 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:12.941 INFO:teuthology.orchestra.run.smithi148.stdout:Install 6 Packages 2024-09-14T09:06:12.941 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:12.941 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 7.0 M 2024-09-14T09:06:12.942 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 33 M 2024-09-14T09:06:12.942 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-14T09:06:13.377 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 12/12 2024-09-14T09:06:13.377 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 1/12 2024-09-14T09:06:13.377 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-14T09:06:13.377 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-14T09:06:13.377 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-14T09:06:13.377 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-14T09:06:13.377 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-14T09:06:13.377 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-14T09:06:13.377 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-14T09:06:13.378 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-14T09:06:13.378 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-14T09:06:13.378 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-14T09:06:13.520 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:28 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:06:13.655 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:06:13.656 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-14T09:06:13.656 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:13.656 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T09:06:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 49 k 2024-09-14T09:06:13.657 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-14T09:06:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T09:06:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T09:06:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T09:06:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T09:06:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T09:06:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T09:06:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T09:06:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T09:06:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T09:06:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T09:06:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T09:06:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T09:06:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:13.658 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T09:06:13.658 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:13.658 INFO:teuthology.orchestra.run.smithi116.stdout:Install 13 Packages 2024-09-14T09:06:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:13.658 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 2.2 M 2024-09-14T09:06:13.658 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 26 M 2024-09-14T09:06:13.659 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T09:06:13.741 INFO:teuthology.orchestra.run.smithi148.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-09-14T09:06:13.766 INFO:teuthology.orchestra.run.smithi148.stdout:(2/6): ceph-mgr-cephadm-19.3.0-4775.g7f24e589.e 721 kB/s | 154 kB 00:00 2024-09-14T09:06:13.795 INFO:teuthology.orchestra.run.smithi116.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 233 kB/s | 19 kB 00:00 2024-09-14T09:06:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-14T09:06:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:13.808 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-14T09:06:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:06:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T09:06:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T09:06:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T09:06:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T09:06:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T09:06:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T09:06:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T09:06:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T09:06:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T09:06:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T09:06:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T09:06:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:13.809 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:06:13.817 INFO:teuthology.orchestra.run.smithi148.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.1 MB/s | 548 kB 00:00 2024-09-14T09:06:13.820 INFO:teuthology.orchestra.run.smithi116.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 238 kB/s | 26 kB 00:00 2024-09-14T09:06:13.842 INFO:teuthology.orchestra.run.smithi148.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 766 kB/s | 58 kB 00:00 2024-09-14T09:06:13.867 INFO:teuthology.orchestra.run.smithi148.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-14T09:06:13.896 INFO:teuthology.orchestra.run.smithi116.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.2 MB/s | 222 kB 00:00 2024-09-14T09:06:13.921 INFO:teuthology.orchestra.run.smithi116.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-09-14T09:06:13.946 INFO:teuthology.orchestra.run.smithi116.stdout:(5/13): ceph-mgr-rook-19.3.0-4775.g7f24e589.el9 211 kB/s | 49 kB 00:00 2024-09-14T09:06:13.971 INFO:teuthology.orchestra.run.smithi116.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-14T09:06:13.997 INFO:teuthology.orchestra.run.smithi116.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.7 MB/s | 279 kB 00:00 2024-09-14T09:06:14.034 INFO:teuthology.orchestra.run.smithi148.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-14T09:06:14.037 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:14.038 INFO:teuthology.orchestra.run.smithi148.stdout:Total 6.4 MB/s | 7.0 MB 00:01 2024-09-14T09:06:14.047 INFO:teuthology.orchestra.run.smithi116.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-14T09:06:14.072 INFO:teuthology.orchestra.run.smithi116.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2024-09-14T09:06:14.098 INFO:teuthology.orchestra.run.smithi116.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-14T09:06:14.109 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-14T09:06:14.120 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-14T09:06:14.120 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-14T09:06:14.123 INFO:teuthology.orchestra.run.smithi116.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.9 MB/s | 220 kB 00:00 2024-09-14T09:06:14.148 INFO:teuthology.orchestra.run.smithi116.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-14T09:06:14.181 INFO:teuthology.orchestra.run.smithi116.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.7 MB/s | 1.0 MB 00:00 2024-09-14T09:06:14.184 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:14.184 INFO:teuthology.orchestra.run.smithi116.stdout:Total 4.2 MB/s | 2.2 MB 00:00 2024-09-14T09:06:14.195 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-mgr-rook 2024-09-14T09:06:14.221 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-14T09:06:14.222 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-14T09:06:14.247 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T09:06:14.262 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T09:06:14.262 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T09:06:14.350 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T09:06:14.350 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T09:06:14.535 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-14T09:06:14.717 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-14T09:06:14.770 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-14T09:06:14.779 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:01:32 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:06:14.884 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T09:06:14.914 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:06:14.915 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:14.915 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2024-09-14T09:06:14.915 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:14.915 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-14T09:06:14.915 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 49 k 2024-09-14T09:06:14.915 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2024-09-14T09:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T09:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T09:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T09:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T09:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T09:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T09:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T09:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T09:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T09:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T09:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T09:06:14.917 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T09:06:14.917 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:14.917 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-14T09:06:14.917 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:14.917 INFO:teuthology.orchestra.run.smithi144.stdout:Install 13 Packages 2024-09-14T09:06:14.917 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:14.917 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 2.2 M 2024-09-14T09:06:14.918 INFO:teuthology.orchestra.run.smithi144.stdout:Installed size: 26 M 2024-09-14T09:06:14.918 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-14T09:06:15.052 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-14T09:06:15.117 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-14T09:06:15.179 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-14T09:06:15.217 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-14T09:06:15.258 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-14T09:06:15.264 INFO:teuthology.orchestra.run.smithi144.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 288 kB/s | 26 kB 00:00 2024-09-14T09:06:15.289 INFO:teuthology.orchestra.run.smithi144.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 168 kB/s | 19 kB 00:00 2024-09-14T09:06:15.305 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-14T09:06:15.348 INFO:teuthology.orchestra.run.smithi144.stdout:(3/13): ceph-mgr-rook-19.3.0-4775.g7f24e589.el9 285 kB/s | 49 kB 00:00 2024-09-14T09:06:15.360 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-14T09:06:15.373 INFO:teuthology.orchestra.run.smithi144.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-14T09:06:15.397 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-14T09:06:15.398 INFO:teuthology.orchestra.run.smithi144.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-14T09:06:15.440 INFO:teuthology.orchestra.run.smithi144.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 772 kB/s | 32 kB 00:00 2024-09-14T09:06:15.465 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-14T09:06:15.466 INFO:teuthology.orchestra.run.smithi144.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 582 kB/s | 54 kB 00:00 2024-09-14T09:06:15.469 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-14T09:06:15.490 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 6/6 2024-09-14T09:06:15.491 INFO:teuthology.orchestra.run.smithi144.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 281 kB/s | 14 kB 00:00 2024-09-14T09:06:15.524 INFO:teuthology.orchestra.run.smithi144.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.5 MB/s | 279 kB 00:00 2024-09-14T09:06:15.527 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-14T09:06:15.566 INFO:teuthology.orchestra.run.smithi144.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.1 MB/s | 220 kB 00:00 2024-09-14T09:06:15.591 INFO:teuthology.orchestra.run.smithi144.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.8 MB/s | 90 kB 00:00 2024-09-14T09:06:15.617 INFO:teuthology.orchestra.run.smithi144.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 651 kB/s | 59 kB 00:00 2024-09-14T09:06:15.651 INFO:teuthology.orchestra.run.smithi144.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.7 MB/s | 1.0 MB 00:00 2024-09-14T09:06:15.653 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:15.653 INFO:teuthology.orchestra.run.smithi144.stdout:Total 3.0 MB/s | 2.2 MB 00:00 2024-09-14T09:06:15.716 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-14T09:06:15.732 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-14T09:06:15.732 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-14T09:06:15.823 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-14T09:06:15.824 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-14T09:06:16.234 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-14T09:06:16.289 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 6/6 2024-09-14T09:06:16.289 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/6 2024-09-14T09:06:16.289 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-14T09:06:16.289 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-14T09:06:16.289 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-14T09:06:16.289 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-14T09:06:16.291 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-14T09:06:16.324 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-14T09:06:16.332 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-14T09:06:16.372 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-14T09:06:16.395 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 13/13 2024-09-14T09:06:16.516 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-14T09:06:16.567 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-14T09:06:16.568 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:16.568 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-14T09:06:16.568 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:06:16.568 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T09:06:16.568 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T09:06:16.568 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T09:06:16.568 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T09:06:16.568 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T09:06:16.568 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:16.568 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:06:16.569 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-14T09:06:16.623 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-14T09:06:16.661 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-14T09:06:16.702 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-14T09:06:16.804 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-14T09:06:16.839 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-fuse 2024-09-14T09:06:16.905 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-14T09:06:16.954 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-14T09:06:17.146 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 13/13 2024-09-14T09:06:17.147 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 1/13 2024-09-14T09:06:17.147 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-14T09:06:17.147 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-14T09:06:17.147 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-14T09:06:17.147 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-14T09:06:17.147 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-14T09:06:17.147 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-14T09:06:17.147 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-14T09:06:17.147 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-14T09:06:17.147 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-14T09:06:17.147 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-14T09:06:17.147 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-14T09:06:17.409 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:37 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:06:17.483 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-14T09:06:17.483 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:17.483 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T09:06:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:06:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T09:06:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T09:06:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T09:06:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T09:06:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T09:06:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T09:06:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T09:06:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T09:06:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T09:06:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T09:06:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T09:06:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T09:06:17.485 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:17.485 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:06:17.545 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:06:17.545 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:17.546 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-14T09:06:17.546 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:17.546 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-14T09:06:17.546 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 900 k 2024-09-14T09:06:17.546 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-14T09:06:17.546 INFO:teuthology.orchestra.run.smithi148.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T09:06:17.546 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:17.546 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-14T09:06:17.546 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:17.546 INFO:teuthology.orchestra.run.smithi148.stdout:Install 2 Packages 2024-09-14T09:06:17.547 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:17.547 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 979 k 2024-09-14T09:06:17.547 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 2.9 M 2024-09-14T09:06:17.547 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-14T09:06:17.663 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-14T09:06:17.718 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-14T09:06:17.736 INFO:teuthology.orchestra.run.smithi148.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 474 kB/s | 80 kB 00:00 2024-09-14T09:06:17.738 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr-cephadm 2024-09-14T09:06:17.751 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-14T09:06:17.800 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-14T09:06:17.811 INFO:teuthology.orchestra.run.smithi148.stdout:(2/2): ceph-fuse-19.3.0-4775.g7f24e589.el9.x86_ 3.6 MB/s | 900 kB 00:00 2024-09-14T09:06:17.812 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:17.812 INFO:teuthology.orchestra.run.smithi148.stdout:Total 3.6 MB/s | 979 kB 00:00 2024-09-14T09:06:17.824 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-14T09:06:17.829 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 13/13 2024-09-14T09:06:17.847 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-14T09:06:17.847 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-14T09:06:17.928 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-14T09:06:17.928 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-14T09:06:18.120 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-14T09:06:18.255 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-14T09:06:18.302 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:33 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:06:18.328 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2/2 2024-09-14T09:06:18.437 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:06:18.438 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:18.438 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-14T09:06:18.438 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:18.438 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T09:06:18.438 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 154 k 2024-09-14T09:06:18.438 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-14T09:06:18.438 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T09:06:18.439 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T09:06:18.439 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T09:06:18.439 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T09:06:18.439 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T09:06:18.439 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:18.439 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T09:06:18.439 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:18.439 INFO:teuthology.orchestra.run.smithi116.stdout:Install 6 Packages 2024-09-14T09:06:18.439 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:18.440 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 7.0 M 2024-09-14T09:06:18.440 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 33 M 2024-09-14T09:06:18.440 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T09:06:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 13/13 2024-09-14T09:06:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 1/13 2024-09-14T09:06:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-14T09:06:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-14T09:06:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-14T09:06:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-14T09:06:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-14T09:06:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-14T09:06:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-14T09:06:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-14T09:06:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-14T09:06:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-14T09:06:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-14T09:06:18.981 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-14T09:06:18.981 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:18.981 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-14T09:06:18.981 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:06:18.981 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T09:06:18.981 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T09:06:18.981 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T09:06:18.981 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T09:06:18.981 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T09:06:18.981 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T09:06:18.981 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T09:06:18.982 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T09:06:18.982 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T09:06:18.982 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T09:06:18.982 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T09:06:18.982 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T09:06:18.982 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:18.982 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:06:19.009 INFO:teuthology.orchestra.run.smithi116.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-09-14T09:06:19.034 INFO:teuthology.orchestra.run.smithi116.stdout:(2/6): ceph-mgr-cephadm-19.3.0-4775.g7f24e589.e 763 kB/s | 154 kB 00:00 2024-09-14T09:06:19.037 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2/2 2024-09-14T09:06:19.037 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/2 2024-09-14T09:06:19.076 INFO:teuthology.orchestra.run.smithi116.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.4 MB/s | 58 kB 00:00 2024-09-14T09:06:19.101 INFO:teuthology.orchestra.run.smithi116.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 3.1 MB/s | 74 kB 00:00 2024-09-14T09:06:19.135 INFO:teuthology.orchestra.run.smithi116.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.3 MB/s | 548 kB 00:00 2024-09-14T09:06:19.257 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-mgr-cephadm 2024-09-14T09:06:19.318 INFO:teuthology.orchestra.run.smithi116.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-14T09:06:19.321 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:19.321 INFO:teuthology.orchestra.run.smithi116.stdout:Total 8.0 MB/s | 7.0 MB 00:00 2024-09-14T09:06:19.334 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-14T09:06:19.334 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:19.335 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-14T09:06:19.335 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-14T09:06:19.335 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:19.335 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:06:19.391 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T09:06:19.402 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T09:06:19.402 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T09:06:19.501 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T09:06:19.502 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T09:06:19.603 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-volume 2024-09-14T09:06:19.816 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T09:06:19.828 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:01:37 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:06:19.961 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:06:19.962 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:19.962 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2024-09-14T09:06:19.962 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:19.962 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-14T09:06:19.962 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 154 k 2024-09-14T09:06:19.962 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2024-09-14T09:06:19.962 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T09:06:19.962 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T09:06:19.962 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T09:06:19.963 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T09:06:19.963 INFO:teuthology.orchestra.run.smithi144.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T09:06:19.963 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:19.963 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-14T09:06:19.963 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:19.963 INFO:teuthology.orchestra.run.smithi144.stdout:Install 6 Packages 2024-09-14T09:06:19.963 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:19.964 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 7.0 M 2024-09-14T09:06:19.964 INFO:teuthology.orchestra.run.smithi144.stdout:Installed size: 33 M 2024-09-14T09:06:19.964 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-14T09:06:19.982 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-14T09:06:20.045 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-14T09:06:20.192 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:40 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:06:20.328 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:06:20.329 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:20.329 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-14T09:06:20.329 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:20.329 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-14T09:06:20.330 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 285 k 2024-09-14T09:06:20.330 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:20.330 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-14T09:06:20.330 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:20.330 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-14T09:06:20.330 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:20.330 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 285 k 2024-09-14T09:06:20.330 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 1.3 M 2024-09-14T09:06:20.330 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-14T09:06:20.557 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-volume-19.3.0-4775.g7f24e589.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-14T09:06:20.558 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:20.558 INFO:teuthology.orchestra.run.smithi148.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-14T09:06:20.558 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-14T09:06:20.567 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-14T09:06:20.567 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-14T09:06:20.571 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-14T09:06:20.600 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-14T09:06:20.601 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-14T09:06:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-14T09:06:20.686 INFO:teuthology.orchestra.run.smithi144.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.7 MB/s | 248 kB 00:00 2024-09-14T09:06:20.732 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-14T09:06:20.737 INFO:teuthology.orchestra.run.smithi144.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-14T09:06:20.762 INFO:teuthology.orchestra.run.smithi144.stdout:(3/6): ceph-mgr-cephadm-19.3.0-4775.g7f24e589.e 708 kB/s | 154 kB 00:00 2024-09-14T09:06:20.765 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 6/6 2024-09-14T09:06:20.787 INFO:teuthology.orchestra.run.smithi144.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-14T09:06:20.819 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-14T09:06:20.829 INFO:teuthology.orchestra.run.smithi144.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.1 MB/s | 74 kB 00:00 2024-09-14T09:06:20.901 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T09:06:20.904 INFO:teuthology.orchestra.run.smithi144.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-14T09:06:20.907 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:20.907 INFO:teuthology.orchestra.run.smithi144.stdout:Total 7.4 MB/s | 7.0 MB 00:00 2024-09-14T09:06:20.917 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T09:06:20.917 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:06:20.917 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T09:06:20.917 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:20.977 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-14T09:06:20.988 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-14T09:06:20.988 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-14T09:06:21.086 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-14T09:06:21.087 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-14T09:06:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-14T09:06:21.563 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 6/6 2024-09-14T09:06:21.563 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/6 2024-09-14T09:06:21.563 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-14T09:06:21.563 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-14T09:06:21.563 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-14T09:06:21.564 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-14T09:06:21.567 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-14T09:06:21.614 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-14T09:06:21.849 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-14T09:06:21.849 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:21.849 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T09:06:21.849 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:06:21.849 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T09:06:21.849 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T09:06:21.850 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T09:06:21.850 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T09:06:21.850 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T09:06:21.850 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:21.850 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:06:21.951 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T09:06:21.951 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:21.951 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-14T09:06:21.951 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:06:21.951 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:21.951 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:06:22.107 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-fuse 2024-09-14T09:06:22.131 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-14T09:06:22.217 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-14T09:06:22.284 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-14T09:06:22.287 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install librados-devel 2024-09-14T09:06:22.310 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 6/6 2024-09-14T09:06:22.672 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:37 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:06:22.806 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:06:22.807 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:22.807 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-14T09:06:22.807 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:22.807 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T09:06:22.807 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 900 k 2024-09-14T09:06:22.807 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-14T09:06:22.807 INFO:teuthology.orchestra.run.smithi116.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T09:06:22.807 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:22.807 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T09:06:22.807 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:22.807 INFO:teuthology.orchestra.run.smithi116.stdout:Install 2 Packages 2024-09-14T09:06:22.808 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:22.808 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 979 k 2024-09-14T09:06:22.808 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 2.9 M 2024-09-14T09:06:22.808 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T09:06:22.869 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:42 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:06:23.005 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:06:23.006 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:23.006 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repo Size 2024-09-14T09:06:23.006 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:23.007 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-14T09:06:23.007 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 126 k 2024-09-14T09:06:23.007 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:23.007 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-14T09:06:23.007 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:23.007 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-14T09:06:23.007 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:23.007 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 126 k 2024-09-14T09:06:23.007 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 456 k 2024-09-14T09:06:23.007 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-14T09:06:23.070 INFO:teuthology.orchestra.run.smithi116.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 595 kB/s | 80 kB 00:00 2024-09-14T09:06:23.175 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 6/6 2024-09-14T09:06:23.175 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/6 2024-09-14T09:06:23.175 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-14T09:06:23.175 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-14T09:06:23.175 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-14T09:06:23.175 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-14T09:06:23.196 INFO:teuthology.orchestra.run.smithi148.stdout:librados-devel-19.3.0-4775.g7f24e589.el9.x86_64 671 kB/s | 126 kB 00:00 2024-09-14T09:06:23.196 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:23.197 INFO:teuthology.orchestra.run.smithi148.stdout:Total 666 kB/s | 126 kB 00:00 2024-09-14T09:06:23.197 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-14T09:06:23.202 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-14T09:06:23.202 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-14T09:06:23.237 INFO:teuthology.orchestra.run.smithi116.stdout:(2/2): ceph-fuse-19.3.0-4775.g7f24e589.el9.x86_ 2.9 MB/s | 900 kB 00:00 2024-09-14T09:06:23.237 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:23.238 INFO:teuthology.orchestra.run.smithi116.stdout:Total 2.2 MB/s | 979 kB 00:00 2024-09-14T09:06:23.249 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T09:06:23.265 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-14T09:06:23.266 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-14T09:06:23.271 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T09:06:23.271 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T09:06:23.351 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T09:06:23.352 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T09:06:23.417 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-14T09:06:23.461 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-14T09:06:23.461 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:23.461 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-14T09:06:23.461 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:06:23.462 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T09:06:23.462 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T09:06:23.462 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T09:06:23.462 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T09:06:23.462 INFO:teuthology.orchestra.run.smithi144.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T09:06:23.462 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:23.462 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:06:23.527 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:23.535 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T09:06:23.672 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-14T09:06:23.710 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-fuse 2024-09-14T09:06:23.745 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2/2 2024-09-14T09:06:23.979 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:24.209 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:24.209 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:24.209 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-14T09:06:24.210 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:06:24.210 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:24.210 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:06:24.294 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:01:42 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:06:24.440 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:06:24.440 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:24.440 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2024-09-14T09:06:24.440 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:24.440 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-14T09:06:24.440 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 900 k 2024-09-14T09:06:24.441 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2024-09-14T09:06:24.441 INFO:teuthology.orchestra.run.smithi144.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T09:06:24.441 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:24.441 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-14T09:06:24.441 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:24.441 INFO:teuthology.orchestra.run.smithi144.stdout:Install 2 Packages 2024-09-14T09:06:24.441 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:24.442 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 979 k 2024-09-14T09:06:24.442 INFO:teuthology.orchestra.run.smithi144.stdout:Installed size: 2.9 M 2024-09-14T09:06:24.442 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-14T09:06:24.462 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install libcephfs2 2024-09-14T09:06:24.495 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2/2 2024-09-14T09:06:24.496 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/2 2024-09-14T09:06:24.742 INFO:teuthology.orchestra.run.smithi144.stdout:(1/2): ceph-fuse-19.3.0-4775.g7f24e589.el9.x86_ 3.2 MB/s | 900 kB 00:00 2024-09-14T09:06:24.772 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-14T09:06:24.772 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:24.772 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T09:06:24.772 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-14T09:06:24.772 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:24.772 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:06:25.050 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-volume 2024-09-14T09:06:25.065 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:45 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:06:25.090 INFO:teuthology.orchestra.run.smithi144.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 127 kB/s | 80 kB 00:00 2024-09-14T09:06:25.091 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:25.091 INFO:teuthology.orchestra.run.smithi144.stdout:Total 1.5 MB/s | 979 kB 00:00 2024-09-14T09:06:25.103 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-14T09:06:25.125 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-14T09:06:25.125 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-14T09:06:25.156 INFO:teuthology.orchestra.run.smithi148.stdout:Package libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:25.200 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:06:25.201 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-14T09:06:25.201 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:06:25.209 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-14T09:06:25.209 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-14T09:06:25.276 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install libcephfs-devel 2024-09-14T09:06:25.403 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-14T09:06:25.542 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-14T09:06:25.614 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2/2 2024-09-14T09:06:25.628 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:40 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:06:25.769 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:06:25.770 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:25.770 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-14T09:06:25.770 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:25.770 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T09:06:25.770 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 285 k 2024-09-14T09:06:25.770 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:25.770 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T09:06:25.771 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:25.771 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-14T09:06:25.771 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:25.771 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 285 k 2024-09-14T09:06:25.771 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 1.3 M 2024-09-14T09:06:25.771 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T09:06:25.847 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:45 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:06:25.982 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:06:25.983 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:25.983 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repo Size 2024-09-14T09:06:25.983 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:25.983 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-14T09:06:25.983 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 32 k 2024-09-14T09:06:25.984 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:25.984 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-14T09:06:25.984 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:25.984 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-14T09:06:25.984 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:25.984 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 32 k 2024-09-14T09:06:25.984 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 142 k 2024-09-14T09:06:25.984 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-14T09:06:26.009 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-volume-19.3.0-4775.g7f24e589.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-14T09:06:26.009 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:26.010 INFO:teuthology.orchestra.run.smithi116.stdout:Total 1.1 MB/s | 285 kB 00:00 2024-09-14T09:06:26.010 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T09:06:26.019 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T09:06:26.019 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T09:06:26.048 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T09:06:26.048 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T09:06:26.142 INFO:teuthology.orchestra.run.smithi148.stdout:libcephfs-devel-19.3.0-4775.g7f24e589.el9.x86_6 201 kB/s | 32 kB 00:00 2024-09-14T09:06:26.143 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:26.143 INFO:teuthology.orchestra.run.smithi148.stdout:Total 199 kB/s | 32 kB 00:00 2024-09-14T09:06:26.143 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-14T09:06:26.146 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-14T09:06:26.146 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-14T09:06:26.157 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-14T09:06:26.158 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-14T09:06:26.248 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-14T09:06:26.267 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T09:06:26.344 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T09:06:26.347 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2/2 2024-09-14T09:06:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/2 2024-09-14T09:06:26.360 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T09:06:26.360 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:06:26.360 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T09:06:26.360 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:26.646 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-14T09:06:26.646 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:26.646 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-14T09:06:26.647 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-14T09:06:26.647 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:26.647 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:06:26.713 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:26.904 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-volume 2024-09-14T09:06:26.946 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:26.946 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:26.946 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-14T09:06:26.946 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:06:26.946 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:26.947 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:06:27.139 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install librados2 2024-09-14T09:06:27.402 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T09:06:27.402 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:27.402 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T09:06:27.402 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:06:27.402 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:27.402 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:06:27.487 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:01:45 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:06:27.625 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:06:27.626 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:27.626 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2024-09-14T09:06:27.626 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:27.626 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-14T09:06:27.626 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 285 k 2024-09-14T09:06:27.626 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:27.626 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-14T09:06:27.626 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:27.626 INFO:teuthology.orchestra.run.smithi144.stdout:Install 1 Package 2024-09-14T09:06:27.627 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:27.627 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 285 k 2024-09-14T09:06:27.627 INFO:teuthology.orchestra.run.smithi144.stdout:Installed size: 1.3 M 2024-09-14T09:06:27.627 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-14T09:06:27.708 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:47 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:06:27.712 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install librados-devel 2024-09-14T09:06:27.798 INFO:teuthology.orchestra.run.smithi148.stdout:Package librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:27.842 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:06:27.843 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-14T09:06:27.843 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:06:27.853 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-volume-19.3.0-4775.g7f24e589.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-14T09:06:27.854 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:27.854 INFO:teuthology.orchestra.run.smithi144.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-14T09:06:27.854 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-14T09:06:27.863 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-14T09:06:27.863 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-14T09:06:27.898 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-14T09:06:27.898 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-14T09:06:27.910 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install librbd1 2024-09-14T09:06:28.119 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-14T09:06:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T09:06:28.222 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T09:06:28.222 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:06:28.222 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T09:06:28.222 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:28.290 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:43 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:06:28.430 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:06:28.431 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:28.431 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-09-14T09:06:28.431 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:28.431 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T09:06:28.431 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 126 k 2024-09-14T09:06:28.431 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:28.431 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T09:06:28.431 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:28.432 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-14T09:06:28.432 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:28.432 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 126 k 2024-09-14T09:06:28.432 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 456 k 2024-09-14T09:06:28.432 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T09:06:28.477 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:48 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:06:28.568 INFO:teuthology.orchestra.run.smithi148.stdout:Package librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:28.611 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:06:28.612 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-14T09:06:28.612 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:06:28.614 INFO:teuthology.orchestra.run.smithi116.stdout:librados-devel-19.3.0-4775.g7f24e589.el9.x86_64 693 kB/s | 126 kB 00:00 2024-09-14T09:06:28.615 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:28.616 INFO:teuthology.orchestra.run.smithi116.stdout:Total 687 kB/s | 126 kB 00:00 2024-09-14T09:06:28.616 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T09:06:28.624 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T09:06:28.624 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T09:06:28.676 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install python3-rados 2024-09-14T09:06:28.688 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T09:06:28.688 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T09:06:28.846 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T09:06:28.964 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:29.227 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T09:06:29.227 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:29.227 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-14T09:06:29.227 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T09:06:29.227 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:29.227 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:06:29.238 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:49 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:06:29.328 INFO:teuthology.orchestra.run.smithi148.stdout:Package python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:29.371 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:06:29.372 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-14T09:06:29.373 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:06:29.441 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install python3-rgw 2024-09-14T09:06:29.490 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install librados-devel 2024-09-14T09:06:29.536 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:29.786 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:29.786 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:29.786 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T09:06:29.786 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:06:29.786 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:29.786 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:06:30.006 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:50 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:06:30.059 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install libcephfs2 2024-09-14T09:06:30.079 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:01:48 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:06:30.096 INFO:teuthology.orchestra.run.smithi148.stdout:Package python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:30.139 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:06:30.140 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-14T09:06:30.140 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:06:30.201 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install python3-cephfs 2024-09-14T09:06:30.214 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:06:30.214 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:30.214 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repo Size 2024-09-14T09:06:30.215 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:30.215 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-14T09:06:30.215 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 126 k 2024-09-14T09:06:30.215 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:30.215 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-14T09:06:30.215 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:30.215 INFO:teuthology.orchestra.run.smithi144.stdout:Install 1 Package 2024-09-14T09:06:30.215 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:30.216 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 126 k 2024-09-14T09:06:30.216 INFO:teuthology.orchestra.run.smithi144.stdout:Installed size: 456 k 2024-09-14T09:06:30.216 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-14T09:06:30.426 INFO:teuthology.orchestra.run.smithi144.stdout:librados-devel-19.3.0-4775.g7f24e589.el9.x86_64 604 kB/s | 126 kB 00:00 2024-09-14T09:06:30.426 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:30.426 INFO:teuthology.orchestra.run.smithi144.stdout:Total 599 kB/s | 126 kB 00:00 2024-09-14T09:06:30.427 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-14T09:06:30.432 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-14T09:06:30.432 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-14T09:06:30.498 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-14T09:06:30.498 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-14T09:06:30.631 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:45 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:06:30.651 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-14T09:06:30.722 INFO:teuthology.orchestra.run.smithi116.stdout:Package libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:30.765 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:30.767 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:06:30.767 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:50 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:06:30.768 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-14T09:06:30.768 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:06:30.833 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install libcephfs-devel 2024-09-14T09:06:30.858 INFO:teuthology.orchestra.run.smithi148.stdout:Package python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:30.902 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:06:30.903 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-14T09:06:30.903 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:06:30.964 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install python3-rbd 2024-09-14T09:06:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:31.400 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:46 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:06:31.503 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:31.503 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:31.503 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-14T09:06:31.503 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:06:31.503 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:31.503 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:06:31.531 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:51 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:06:31.536 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:06:31.537 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:31.537 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-09-14T09:06:31.537 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:31.537 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T09:06:31.537 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 32 k 2024-09-14T09:06:31.537 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:31.537 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T09:06:31.537 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:31.537 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-14T09:06:31.537 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:31.537 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 32 k 2024-09-14T09:06:31.538 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 142 k 2024-09-14T09:06:31.538 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T09:06:31.621 INFO:teuthology.orchestra.run.smithi148.stdout:Package python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:31.664 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:06:31.665 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-14T09:06:31.665 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:06:31.702 INFO:teuthology.orchestra.run.smithi116.stdout:libcephfs-devel-19.3.0-4775.g7f24e589.el9.x86_6 193 kB/s | 32 kB 00:00 2024-09-14T09:06:31.703 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:31.703 INFO:teuthology.orchestra.run.smithi116.stdout:Total 191 kB/s | 32 kB 00:00 2024-09-14T09:06:31.703 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T09:06:31.707 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T09:06:31.707 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T09:06:31.725 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T09:06:31.726 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T09:06:31.729 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install rbd-fuse 2024-09-14T09:06:31.769 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install libcephfs2 2024-09-14T09:06:31.806 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T09:06:31.917 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:32.291 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:52 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:06:32.339 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:32.346 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:01:50 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:06:32.426 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:06:32.427 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:32.427 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-09-14T09:06:32.427 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:32.427 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-14T09:06:32.428 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 85 k 2024-09-14T09:06:32.428 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:32.428 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-14T09:06:32.428 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:32.428 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-14T09:06:32.428 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:32.428 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 85 k 2024-09-14T09:06:32.428 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 231 k 2024-09-14T09:06:32.428 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-14T09:06:32.438 INFO:teuthology.orchestra.run.smithi144.stdout:Package libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:32.484 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:06:32.485 INFO:teuthology.orchestra.run.smithi144.stdout:Nothing to do. 2024-09-14T09:06:32.485 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:06:32.549 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install libcephfs-devel 2024-09-14T09:06:32.571 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:32.571 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:32.571 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T09:06:32.571 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:06:32.571 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:32.571 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:06:32.611 INFO:teuthology.orchestra.run.smithi148.stdout:rbd-fuse-19.3.0-4775.g7f24e589.el9.x86_64.rpm 463 kB/s | 85 kB 00:00 2024-09-14T09:06:32.612 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:32.612 INFO:teuthology.orchestra.run.smithi148.stdout:Total 460 kB/s | 85 kB 00:00 2024-09-14T09:06:32.612 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-14T09:06:32.619 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-14T09:06:32.619 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-14T09:06:32.683 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-14T09:06:32.683 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-14T09:06:32.777 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install librados2 2024-09-14T09:06:32.826 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-14T09:06:32.926 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:33.121 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:01:51 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:06:33.258 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:06:33.258 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:33.259 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repo Size 2024-09-14T09:06:33.259 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:33.259 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-14T09:06:33.259 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 32 k 2024-09-14T09:06:33.259 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:33.259 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-14T09:06:33.259 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:33.259 INFO:teuthology.orchestra.run.smithi144.stdout:Install 1 Package 2024-09-14T09:06:33.259 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:33.259 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 32 k 2024-09-14T09:06:33.259 INFO:teuthology.orchestra.run.smithi144.stdout:Installed size: 142 k 2024-09-14T09:06:33.259 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-14T09:06:33.317 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:33.344 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:48 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:06:33.404 INFO:teuthology.orchestra.run.smithi144.stdout:libcephfs-devel-19.3.0-4775.g7f24e589.el9.x86_6 219 kB/s | 32 kB 00:00 2024-09-14T09:06:33.405 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:33.405 INFO:teuthology.orchestra.run.smithi144.stdout:Total 217 kB/s | 32 kB 00:00 2024-09-14T09:06:33.405 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-14T09:06:33.409 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-14T09:06:33.409 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-14T09:06:33.420 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-14T09:06:33.420 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-14T09:06:33.431 INFO:teuthology.orchestra.run.smithi116.stdout:Package librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:33.475 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:06:33.477 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-14T09:06:33.477 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:06:33.507 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-14T09:06:33.547 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install librbd1 2024-09-14T09:06:33.580 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:33.580 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:33.580 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-14T09:06:33.580 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:06:33.580 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:33.580 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:06:33.610 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:33.811 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install rbd-mirror 2024-09-14T09:06:33.975 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:34.105 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:49 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:06:34.195 INFO:teuthology.orchestra.run.smithi116.stdout:Package librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:34.208 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:34.209 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:34.209 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-14T09:06:34.209 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:06:34.209 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:34.209 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:06:34.238 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:06:34.239 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-14T09:06:34.240 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:06:34.316 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-rados 2024-09-14T09:06:34.359 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install librados2 2024-09-14T09:06:34.396 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:54 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:06:34.532 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:06:34.533 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:34.533 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repo Size 2024-09-14T09:06:34.533 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:34.533 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-14T09:06:34.533 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.2 M 2024-09-14T09:06:34.533 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:34.533 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-14T09:06:34.534 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:34.534 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-14T09:06:34.534 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:34.534 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 3.2 M 2024-09-14T09:06:34.534 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 14 M 2024-09-14T09:06:34.534 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-14T09:06:34.865 INFO:teuthology.orchestra.run.smithi148.stdout:rbd-mirror-19.3.0-4775.g7f24e589.el9.x86_64.rpm 9.6 MB/s | 3.2 MB 00:00 2024-09-14T09:06:34.865 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:34.866 INFO:teuthology.orchestra.run.smithi148.stdout:Total 9.6 MB/s | 3.2 MB 00:00 2024-09-14T09:06:34.866 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-14T09:06:34.872 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:49 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:06:34.875 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-14T09:06:34.875 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-14T09:06:34.931 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:01:52 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:06:34.961 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-14T09:06:34.961 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-14T09:06:34.962 INFO:teuthology.orchestra.run.smithi116.stdout:Package python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:35.005 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:06:35.006 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-14T09:06:35.006 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:06:35.023 INFO:teuthology.orchestra.run.smithi144.stdout:Package librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:35.067 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:06:35.068 INFO:teuthology.orchestra.run.smithi144.stdout:Nothing to do. 2024-09-14T09:06:35.068 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:06:35.071 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-rgw 2024-09-14T09:06:35.130 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install librbd1 2024-09-14T09:06:35.405 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-14T09:06:35.474 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:35.499 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:35.499 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:06:35.499 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T09:06:35.500 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T09:06:35.500 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T09:06:35.500 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:35.637 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:50 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:06:35.704 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:01:53 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:06:35.726 INFO:teuthology.orchestra.run.smithi116.stdout:Package python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:35.769 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:06:35.770 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-14T09:06:35.771 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:06:35.795 INFO:teuthology.orchestra.run.smithi144.stdout:Package librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:35.839 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:06:35.840 INFO:teuthology.orchestra.run.smithi144.stdout:Nothing to do. 2024-09-14T09:06:35.840 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:06:35.841 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-cephfs 2024-09-14T09:06:35.898 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install python3-rados 2024-09-14T09:06:36.413 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:51 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:06:36.466 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:01:54 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:06:36.502 INFO:teuthology.orchestra.run.smithi116.stdout:Package python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:36.545 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:06:36.546 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-14T09:06:36.546 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:06:36.556 INFO:teuthology.orchestra.run.smithi144.stdout:Package python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:36.604 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:06:36.605 INFO:teuthology.orchestra.run.smithi144.stdout:Nothing to do. 2024-09-14T09:06:36.605 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:06:36.616 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-rbd 2024-09-14T09:06:36.623 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:36.623 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:36.623 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-14T09:06:36.624 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:06:36.624 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:36.624 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:06:36.674 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install python3-rgw 2024-09-14T09:06:36.880 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install rbd-nbd 2024-09-14T09:06:37.178 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:52 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:06:37.245 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:01:55 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:06:37.270 INFO:teuthology.orchestra.run.smithi116.stdout:Package python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:37.313 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:06:37.314 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-14T09:06:37.314 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:06:37.337 INFO:teuthology.orchestra.run.smithi144.stdout:Package python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:37.381 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:06:37.382 INFO:teuthology.orchestra.run.smithi144.stdout:Nothing to do. 2024-09-14T09:06:37.382 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:06:37.388 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install rbd-fuse 2024-09-14T09:06:37.439 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install python3-cephfs 2024-09-14T09:06:37.467 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:57 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:06:37.605 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:06:37.606 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:37.606 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-09-14T09:06:37.606 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:37.606 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-14T09:06:37.606 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 171 k 2024-09-14T09:06:37.606 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:37.606 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-14T09:06:37.606 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-14T09:06:37.606 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-14T09:06:37.606 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:37.607 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 171 k 2024-09-14T09:06:37.607 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 490 k 2024-09-14T09:06:37.607 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-14T09:06:37.835 INFO:teuthology.orchestra.run.smithi148.stdout:rbd-nbd-19.3.0-4775.g7f24e589.el9.x86_64.rpm 749 kB/s | 171 kB 00:00 2024-09-14T09:06:37.836 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:37.836 INFO:teuthology.orchestra.run.smithi148.stdout:Total 744 kB/s | 171 kB 00:00 2024-09-14T09:06:37.836 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-14T09:06:37.844 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-14T09:06:37.844 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-14T09:06:37.908 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-14T09:06:37.908 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-14T09:06:37.941 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:52 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:06:38.010 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:01:56 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:06:38.075 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:06:38.076 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:38.076 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2024-09-14T09:06:38.076 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:38.076 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T09:06:38.076 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 85 k 2024-09-14T09:06:38.076 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:38.076 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T09:06:38.076 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:38.076 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-14T09:06:38.076 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:38.077 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 85 k 2024-09-14T09:06:38.077 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 231 k 2024-09-14T09:06:38.077 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T09:06:38.080 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-14T09:06:38.102 INFO:teuthology.orchestra.run.smithi144.stdout:Package python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:38.145 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:06:38.146 INFO:teuthology.orchestra.run.smithi144.stdout:Nothing to do. 2024-09-14T09:06:38.146 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:06:38.183 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:38.206 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install python3-rbd 2024-09-14T09:06:38.285 INFO:teuthology.orchestra.run.smithi116.stdout:rbd-fuse-19.3.0-4775.g7f24e589.el9.x86_64.rpm 409 kB/s | 85 kB 00:00 2024-09-14T09:06:38.285 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:38.286 INFO:teuthology.orchestra.run.smithi116.stdout:Total 405 kB/s | 85 kB 00:00 2024-09-14T09:06:38.286 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T09:06:38.293 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T09:06:38.293 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T09:06:38.356 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T09:06:38.356 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T09:06:38.499 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T09:06:38.619 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:38.769 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:01:56 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:06:38.861 INFO:teuthology.orchestra.run.smithi144.stdout:Package python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:38.902 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:06:38.903 INFO:teuthology.orchestra.run.smithi144.stdout:Nothing to do. 2024-09-14T09:06:38.903 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:06:38.922 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:38.922 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:38.922 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-14T09:06:38.922 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:06:38.922 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:38.922 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:06:38.963 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install rbd-fuse 2024-09-14T09:06:39.041 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:39.195 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install rbd-nbd 2024-09-14T09:06:39.310 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:39.310 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:39.310 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T09:06:39.310 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:06:39.310 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:39.310 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:06:39.529 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:01:57 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:06:39.614 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install rbd-mirror 2024-09-14T09:06:39.663 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:06:39.664 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:39.664 INFO:teuthology.orchestra.run.smithi144.stdout: Package Architecture Version Repository Size 2024-09-14T09:06:39.664 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:39.665 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-14T09:06:39.665 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 85 k 2024-09-14T09:06:39.665 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:39.665 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-14T09:06:39.665 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:39.665 INFO:teuthology.orchestra.run.smithi144.stdout:Install 1 Package 2024-09-14T09:06:39.665 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:39.665 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 85 k 2024-09-14T09:06:39.665 INFO:teuthology.orchestra.run.smithi144.stdout:Installed size: 231 k 2024-09-14T09:06:39.665 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-14T09:06:39.777 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:59 ago on Sat 14 Sep 2024 09:04:40 AM UTC. 2024-09-14T09:06:39.849 INFO:teuthology.orchestra.run.smithi144.stdout:rbd-fuse-19.3.0-4775.g7f24e589.el9.x86_64.rpm 463 kB/s | 85 kB 00:00 2024-09-14T09:06:39.850 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:39.850 INFO:teuthology.orchestra.run.smithi144.stdout:Total 459 kB/s | 85 kB 00:00 2024-09-14T09:06:39.851 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-14T09:06:39.857 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-14T09:06:39.857 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-14T09:06:39.868 INFO:teuthology.orchestra.run.smithi148.stdout:Package rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:39.913 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-14T09:06:39.914 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-14T09:06:39.914 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-14T09:06:39.920 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-14T09:06:39.921 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-14T09:06:40.016 DEBUG:teuthology.parallel:result is None 2024-09-14T09:06:40.070 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-14T09:06:40.155 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:40.194 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:55 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:06:40.331 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:06:40.332 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:40.332 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-09-14T09:06:40.332 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:40.332 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T09:06:40.332 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.2 M 2024-09-14T09:06:40.332 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:40.333 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T09:06:40.333 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:40.333 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-14T09:06:40.333 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:40.333 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 3.2 M 2024-09-14T09:06:40.333 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 14 M 2024-09-14T09:06:40.333 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T09:06:40.532 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:40.660 INFO:teuthology.orchestra.run.smithi116.stdout:rbd-mirror-19.3.0-4775.g7f24e589.el9.x86_64.rpm 9.7 MB/s | 3.2 MB 00:00 2024-09-14T09:06:40.660 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:40.661 INFO:teuthology.orchestra.run.smithi116.stdout:Total 9.7 MB/s | 3.2 MB 00:00 2024-09-14T09:06:40.661 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T09:06:40.670 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T09:06:40.670 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T09:06:40.752 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T09:06:40.752 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T09:06:40.800 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:40.800 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:40.800 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-14T09:06:40.801 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:06:40.801 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:40.801 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:06:41.037 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install rbd-mirror 2024-09-14T09:06:41.190 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T09:06:41.369 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:41.395 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:41.395 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:06:41.395 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T09:06:41.395 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T09:06:41.395 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T09:06:41.395 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:41.619 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:01:59 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:06:41.760 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:06:41.761 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:41.761 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repo Size 2024-09-14T09:06:41.762 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:41.762 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-14T09:06:41.762 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.2 M 2024-09-14T09:06:41.762 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:41.762 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-14T09:06:41.762 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:41.762 INFO:teuthology.orchestra.run.smithi144.stdout:Install 1 Package 2024-09-14T09:06:41.762 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:41.762 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 3.2 M 2024-09-14T09:06:41.763 INFO:teuthology.orchestra.run.smithi144.stdout:Installed size: 14 M 2024-09-14T09:06:41.763 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-14T09:06:42.111 INFO:teuthology.orchestra.run.smithi144.stdout:rbd-mirror-19.3.0-4775.g7f24e589.el9.x86_64.rpm 9.1 MB/s | 3.2 MB 00:00 2024-09-14T09:06:42.112 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:42.112 INFO:teuthology.orchestra.run.smithi144.stdout:Total 9.1 MB/s | 3.2 MB 00:00 2024-09-14T09:06:42.112 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-14T09:06:42.121 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-14T09:06:42.121 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-14T09:06:42.203 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-14T09:06:42.203 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-14T09:06:42.410 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:42.410 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:42.411 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T09:06:42.411 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:06:42.411 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:42.411 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:06:42.638 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install rbd-nbd 2024-09-14T09:06:42.645 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-14T09:06:42.703 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:42.728 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:42.728 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T09:06:42.728 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T09:06:42.728 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T09:06:42.728 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T09:06:42.729 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:43.220 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:58 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:06:43.354 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:06:43.355 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:43.355 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2024-09-14T09:06:43.355 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:43.355 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T09:06:43.355 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 171 k 2024-09-14T09:06:43.355 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:43.355 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T09:06:43.355 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T09:06:43.355 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-14T09:06:43.356 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:43.356 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 171 k 2024-09-14T09:06:43.356 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 490 k 2024-09-14T09:06:43.356 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T09:06:43.571 INFO:teuthology.orchestra.run.smithi116.stdout:rbd-nbd-19.3.0-4775.g7f24e589.el9.x86_64.rpm 793 kB/s | 171 kB 00:00 2024-09-14T09:06:43.572 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:43.572 INFO:teuthology.orchestra.run.smithi116.stdout:Total 788 kB/s | 171 kB 00:00 2024-09-14T09:06:43.572 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T09:06:43.580 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T09:06:43.580 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T09:06:43.644 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T09:06:43.645 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T09:06:43.816 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:43.816 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:43.816 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-14T09:06:43.816 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:06:43.816 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:43.816 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:06:43.822 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T09:06:43.928 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:44.031 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install rbd-nbd 2024-09-14T09:06:44.403 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:44.612 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:02:02 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:06:44.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:44.646 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:44.646 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T09:06:44.646 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:06:44.646 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:44.647 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:06:44.746 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:06:44.747 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:44.747 INFO:teuthology.orchestra.run.smithi144.stdout: Package Architecture Version Repository Size 2024-09-14T09:06:44.747 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:44.747 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-14T09:06:44.747 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 171 k 2024-09-14T09:06:44.747 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:44.747 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-14T09:06:44.747 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-09-14T09:06:44.748 INFO:teuthology.orchestra.run.smithi144.stdout:Install 1 Package 2024-09-14T09:06:44.748 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:44.748 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 171 k 2024-09-14T09:06:44.748 INFO:teuthology.orchestra.run.smithi144.stdout:Installed size: 490 k 2024-09-14T09:06:44.748 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-14T09:06:44.900 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install rbd-nbd 2024-09-14T09:06:44.956 INFO:teuthology.orchestra.run.smithi144.stdout:rbd-nbd-19.3.0-4775.g7f24e589.el9.x86_64.rpm 821 kB/s | 171 kB 00:00 2024-09-14T09:06:44.957 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-14T09:06:44.957 INFO:teuthology.orchestra.run.smithi144.stdout:Total 814 kB/s | 171 kB 00:00 2024-09-14T09:06:44.957 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-14T09:06:44.965 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-14T09:06:44.965 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-14T09:06:45.029 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-14T09:06:45.029 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-14T09:06:45.192 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-14T09:06:45.303 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:45.477 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:02:00 ago on Sat 14 Sep 2024 09:04:45 AM UTC. 2024-09-14T09:06:45.569 INFO:teuthology.orchestra.run.smithi116.stdout:Package rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:45.613 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T09:06:45.614 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-14T09:06:45.614 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T09:06:45.694 DEBUG:teuthology.parallel:result is None 2024-09-14T09:06:45.699 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:45.983 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T09:06:45.983 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:45.983 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-14T09:06:45.983 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T09:06:45.983 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:45.983 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:06:46.251 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install rbd-nbd 2024-09-14T09:06:46.839 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:02:04 ago on Sat 14 Sep 2024 09:04:42 AM UTC. 2024-09-14T09:06:46.933 INFO:teuthology.orchestra.run.smithi144.stdout:Package rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T09:06:46.978 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-14T09:06:46.979 INFO:teuthology.orchestra.run.smithi144.stdout:Nothing to do. 2024-09-14T09:06:46.979 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-14T09:06:47.039 DEBUG:teuthology.parallel:result is None 2024-09-14T09:06:47.039 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T09:06:47.185 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T09:06:47.210 INFO:teuthology.orchestra.run.smithi116.stdout:19.3.0-4775.g7f24e589.el9 2024-09-14T09:06:47.210 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4775.g7f24e589.el9 2024-09-14T09:06:47.211 INFO:teuthology.task.install:The correct ceph version 19.3.0-4775.g7f24e589 is installed. 2024-09-14T09:06:47.212 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T09:06:47.355 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T09:06:47.377 INFO:teuthology.orchestra.run.smithi144.stdout:19.3.0-4775.g7f24e589.el9 2024-09-14T09:06:47.377 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4775.g7f24e589.el9 2024-09-14T09:06:47.377 INFO:teuthology.task.install:The correct ceph version 19.3.0-4775.g7f24e589 is installed. 2024-09-14T09:06:47.379 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T09:06:47.512 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T09:06:47.537 INFO:teuthology.orchestra.run.smithi148.stdout:19.3.0-4775.g7f24e589.el9 2024-09-14T09:06:47.537 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4775.g7f24e589.el9 2024-09-14T09:06:47.537 INFO:teuthology.task.install:The correct ceph version 19.3.0-4775.g7f24e589 is installed. 2024-09-14T09:06:47.539 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-14T09:06:47.539 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T09:06:47.540 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T09:06:47.570 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-14T09:06:47.570 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T09:06:47.595 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T09:06:47.596 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T09:06:47.625 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-14T09:06:47.625 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T09:06:47.625 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T09:06:47.654 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T09:06:47.723 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-14T09:06:47.724 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T09:06:47.749 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T09:06:47.814 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T09:06:47.814 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T09:06:47.844 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T09:06:47.912 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-14T09:06:47.912 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T09:06:47.912 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T09:06:47.941 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T09:06:48.010 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-14T09:06:48.010 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T09:06:48.035 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T09:06:48.101 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T09:06:48.101 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T09:06:48.131 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T09:06:48.201 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-14T09:06:48.201 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T09:06:48.201 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T09:06:48.231 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T09:06:48.299 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-14T09:06:48.299 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T09:06:48.325 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T09:06:48.392 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T09:06:48.392 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T09:06:48.421 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T09:06:48.491 INFO:teuthology.run_tasks:Running task ceph... 2024-09-14T09:06:48.572 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-14T09:06:48.572 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 777 /var/log/ceph 2024-09-14T09:06:48.575 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 777 /var/log/ceph 2024-09-14T09:06:48.577 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 777 /var/log/ceph 2024-09-14T09:06:48.604 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-14T09:06:48.605 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T09:06:48.645 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T09:06:48.647 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T09:06:48.674 INFO:tasks.ceph:Creating extra log directories... 2024-09-14T09:06:48.674 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T09:06:48.714 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T09:06:48.716 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T09:06:48.750 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-14T09:06:48.751 INFO:tasks.ceph:config {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-14T09:06:48.751 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900520', 'branch': 'main', 'description': 'rbd/device/{base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_nbd}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7900520', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'extra_packages': ['rbd-nbd'], 'flavor': 'default', 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'], ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5'], ['client.0']], 'seed': 5839, 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47', 'sleep_before_teardown': 0, 'subset': '99/128', 'suite': 'rbd', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a', 'targets': {'smithi116.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGd83wt8MkUNsyNzDeavoJNCFhzdBm7QijSnFW3jmUdrEnEK5Zkqmb7JqouGXvev0qIwNtSR57YXx2Z9qJNAAPs=', 'smithi144.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFOBT61YvmuE0Cf9+s/hPknD0hTe0CADoe42XruzXGiFyumthVXW1lW1PAPNqxUqAVwNLHX0v/ALjdVWdWR7lrs=', 'smithi148.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFDQJvHERc8rmaVKqrfefCrdLu3Mr5dDAHC9ZcxZvl/m+I4fL2Ol+G+jr+YHOjx0FmPzgd5hNLppFQD/qvvN2Lg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'rbd_fsx': {'clients': ['client.0'], 'holebdy': 512, 'nbd': True, 'ops': 6000, 'punch_holes': True, 'readbdy': 512, 'truncbdy': 512, 'writebdy': 512}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_20:16:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-14T09:06:48.751 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T09:06:48.782 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T09:06:48.784 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T09:06:48.800 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T09:06:48.839 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T09:06:48.842 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T09:06:48.867 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T09:06:48.867 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T09:06:48.922 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T09:06:48.922 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_1 2024-09-14T09:06:48.979 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T09:06:48.979 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T09:06:48.979 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-14T09:06:48.980 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T09:06:48.980 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T09:06:48.980 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-14 09:06:41.649870088 +0000 2024-09-14T09:06:48.980 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-14 09:03:57.408606912 +0000 2024-09-14T09:06:48.980 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-14 09:03:57.408606912 +0000 2024-09-14T09:06:48.980 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-14 09:03:57.408606912 +0000 2024-09-14T09:06:48.981 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T09:06:49.045 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-14T09:06:49.045 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-14T09:06:49.045 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000340131 s, 1.5 MB/s 2024-09-14T09:06:49.046 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T09:06:49.104 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_2 2024-09-14T09:06:49.161 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T09:06:49.161 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T09:06:49.161 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-14T09:06:49.161 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T09:06:49.161 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T09:06:49.161 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-14 09:06:41.649870088 +0000 2024-09-14T09:06:49.161 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-14 09:03:57.736601575 +0000 2024-09-14T09:06:49.161 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-14 09:03:57.736601575 +0000 2024-09-14T09:06:49.161 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-14 09:03:57.736601575 +0000 2024-09-14T09:06:49.162 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T09:06:49.225 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-14T09:06:49.225 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-14T09:06:49.226 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000202049 s, 2.5 MB/s 2024-09-14T09:06:49.227 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T09:06:49.284 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_3 2024-09-14T09:06:49.340 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T09:06:49.340 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T09:06:49.340 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-14T09:06:49.340 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T09:06:49.340 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T09:06:49.340 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-14 09:06:41.650870071 +0000 2024-09-14T09:06:49.340 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-14 09:03:58.068596173 +0000 2024-09-14T09:06:49.341 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-14 09:03:58.068596173 +0000 2024-09-14T09:06:49.341 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-14 09:03:58.068596173 +0000 2024-09-14T09:06:49.341 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T09:06:49.404 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-14T09:06:49.404 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-14T09:06:49.404 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000181865 s, 2.8 MB/s 2024-09-14T09:06:49.405 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T09:06:49.462 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_4 2024-09-14T09:06:49.518 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T09:06:49.518 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T09:06:49.518 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-14T09:06:49.518 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T09:06:49.518 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T09:06:49.518 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-14 09:06:41.650870071 +0000 2024-09-14T09:06:49.518 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-14 09:03:58.387590982 +0000 2024-09-14T09:06:49.518 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-14 09:03:58.387590982 +0000 2024-09-14T09:06:49.519 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-14 09:03:58.387590982 +0000 2024-09-14T09:06:49.519 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T09:06:49.582 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-14T09:06:49.582 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-14T09:06:49.582 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.00018922 s, 2.7 MB/s 2024-09-14T09:06:49.584 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T09:06:49.640 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-14T09:06:49.641 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-14T09:06:49.641 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T09:06:49.658 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T09:06:49.659 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_1 2024-09-14T09:06:49.716 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T09:06:49.716 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T09:06:49.716 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-14T09:06:49.716 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T09:06:49.716 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T09:06:49.716 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-14 09:06:42.982408461 +0000 2024-09-14T09:06:49.716 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-14 09:04:04.977046674 +0000 2024-09-14T09:06:49.716 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-14 09:04:04.977046674 +0000 2024-09-14T09:06:49.716 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-14 09:04:04.977046674 +0000 2024-09-14T09:06:49.717 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T09:06:49.781 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-14T09:06:49.781 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-14T09:06:49.781 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000344264 s, 1.5 MB/s 2024-09-14T09:06:49.783 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T09:06:49.840 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_2 2024-09-14T09:06:49.898 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T09:06:49.898 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T09:06:49.898 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-14T09:06:49.898 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T09:06:49.899 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T09:06:49.899 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-14 09:06:42.983408445 +0000 2024-09-14T09:06:49.899 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-14 09:04:05.324041287 +0000 2024-09-14T09:06:49.899 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-14 09:04:05.324041287 +0000 2024-09-14T09:06:49.899 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-14 09:04:05.324041287 +0000 2024-09-14T09:06:49.900 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T09:06:49.962 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-14T09:06:49.962 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-14T09:06:49.962 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000200903 s, 2.5 MB/s 2024-09-14T09:06:49.963 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T09:06:50.021 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_3 2024-09-14T09:06:50.076 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T09:06:50.077 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T09:06:50.077 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-14T09:06:50.077 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T09:06:50.077 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T09:06:50.077 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-14 09:06:42.983408445 +0000 2024-09-14T09:06:50.077 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-14 09:04:05.648036256 +0000 2024-09-14T09:06:50.077 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-14 09:04:05.648036256 +0000 2024-09-14T09:06:50.077 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-14 09:04:05.648036256 +0000 2024-09-14T09:06:50.077 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T09:06:50.140 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-14T09:06:50.140 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-14T09:06:50.140 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000208628 s, 2.5 MB/s 2024-09-14T09:06:50.141 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T09:06:50.198 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_4 2024-09-14T09:06:50.253 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T09:06:50.253 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T09:06:50.253 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-14T09:06:50.253 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T09:06:50.253 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T09:06:50.253 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-14 09:06:42.983408445 +0000 2024-09-14T09:06:50.253 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-14 09:04:05.995030869 +0000 2024-09-14T09:06:50.253 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-14 09:04:05.995030869 +0000 2024-09-14T09:06:50.253 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-14 09:04:05.995030869 +0000 2024-09-14T09:06:50.253 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T09:06:50.315 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-14T09:06:50.316 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-14T09:06:50.316 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000166671 s, 3.1 MB/s 2024-09-14T09:06:50.317 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T09:06:50.373 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-14T09:06:50.373 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-09-14T09:06:50.373 INFO:tasks.ceph:Generating config... 2024-09-14T09:06:50.374 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-14T09:06:50.374 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-14T09:06:50.374 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-14T09:06:50.375 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-14T09:06:50.375 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-14T09:06:50.375 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-14T09:06:50.375 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-14T09:06:50.375 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-14T09:06:50.375 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-14T09:06:50.375 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-14T09:06:50.375 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-14T09:06:50.375 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-14T09:06:50.375 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-14T09:06:50.375 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-14T09:06:50.375 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-14T09:06:50.376 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-14T09:06:50.376 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-14T09:06:50.376 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-14T09:06:50.376 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-14T09:06:50.376 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-14T09:06:50.376 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-14T09:06:50.376 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-14T09:06:50.376 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-14T09:06:50.376 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-14T09:06:50.376 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-14T09:06:50.376 INFO:tasks.ceph:Setting up mon.a... 2024-09-14T09:06:50.377 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-14T09:06:50.430 INFO:teuthology.orchestra.run.smithi116.stdout:creating /etc/ceph/ceph.keyring 2024-09-14T09:06:50.433 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-14T09:06:50.479 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T09:06:50.504 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.116'), ('mon.c', '[v2:172.21.15.116:3301,v1:172.21.15.116:6790]'), ('mon.b', '172.21.15.144')] 2024-09-14T09:06:50.508 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.116,[v2:172.21.15.116:3301,v1:172.21.15.116:6790],172.21.15.144', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-14T09:06:50.509 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T09:06:50.509 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T09:06:50.561 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.116 --addv c '[v2:172.21.15.116:3301,v1:172.21.15.116:6790]' --add b 172.21.15.144 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-14T09:06:50.648 INFO:teuthology.orchestra.run.smithi116.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-14T09:06:50.649 INFO:teuthology.orchestra.run.smithi116.stdout:monmaptool: generated fsid c991ac1c-978d-48b3-a540-4d3d4755e125 2024-09-14T09:06:50.649 INFO:teuthology.orchestra.run.smithi116.stdout:setting min_mon_release = quincy 2024-09-14T09:06:50.649 INFO:teuthology.orchestra.run.smithi116.stdout:epoch 0 2024-09-14T09:06:50.649 INFO:teuthology.orchestra.run.smithi116.stdout:fsid c991ac1c-978d-48b3-a540-4d3d4755e125 2024-09-14T09:06:50.649 INFO:teuthology.orchestra.run.smithi116.stdout:last_changed 2024-09-14T09:06:50.651519+0000 2024-09-14T09:06:50.649 INFO:teuthology.orchestra.run.smithi116.stdout:created 2024-09-14T09:06:50.651519+0000 2024-09-14T09:06:50.649 INFO:teuthology.orchestra.run.smithi116.stdout:min_mon_release 17 (quincy) 2024-09-14T09:06:50.649 INFO:teuthology.orchestra.run.smithi116.stdout:election_strategy: 1 2024-09-14T09:06:50.649 INFO:teuthology.orchestra.run.smithi116.stdout:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T09:06:50.649 INFO:teuthology.orchestra.run.smithi116.stdout:1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.b 2024-09-14T09:06:50.649 INFO:teuthology.orchestra.run.smithi116.stdout:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T09:06:50.649 INFO:teuthology.orchestra.run.smithi116.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-14T09:06:50.651 DEBUG:teuthology.orchestra.run.smithi116:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T09:06:50.665 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c991ac1c-978d-48b3-a540-4d3d4755e125... 2024-09-14T09:06:50.666 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T09:06:50.707 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T09:06:50.710 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T09:06:50.747 INFO:teuthology.orchestra.run.smithi116.stdout:[global] 2024-09-14T09:06:50.747 INFO:teuthology.orchestra.run.smithi116.stdout: chdir = "" 2024-09-14T09:06:50.748 INFO:teuthology.orchestra.run.smithi116.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T09:06:50.748 INFO:teuthology.orchestra.run.smithi116.stdout: auth supported = cephx 2024-09-14T09:06:50.748 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.748 INFO:teuthology.orchestra.run.smithi116.stdout: filestore xattr use omap = true 2024-09-14T09:06:50.748 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.748 INFO:teuthology.orchestra.run.smithi116.stdout: mon clock drift allowed = 1.000 2024-09-14T09:06:50.748 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.748 INFO:teuthology.orchestra.run.smithi116.stdout: osd crush chooseleaf type = 0 2024-09-14T09:06:50.748 INFO:teuthology.orchestra.run.smithi116.stdout: auth debug = true 2024-09-14T09:06:50.748 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.748 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on old message = true 2024-09-14T09:06:50.748 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on bug = true 2024-09-14T09:06:50.748 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.748 INFO:teuthology.orchestra.run.smithi116.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T09:06:50.749 INFO:teuthology.orchestra.run.smithi116.stdout: mon pg warn max object skew = 0 2024-09-14T09:06:50.749 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.749 INFO:teuthology.orchestra.run.smithi116.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T09:06:50.749 INFO:teuthology.orchestra.run.smithi116.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T09:06:50.749 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.749 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default size = 2 2024-09-14T09:06:50.749 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.749 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow primary affinity = true 2024-09-14T09:06:50.749 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow pg remap = true 2024-09-14T09:06:50.749 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on legacy crush tunables = false 2024-09-14T09:06:50.749 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on crush straw calc version zero = false 2024-09-14T09:06:50.749 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on no sortbitwise = false 2024-09-14T09:06:50.749 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on osd down out interval zero = false 2024-09-14T09:06:50.749 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on too few osds = false 2024-09-14T09:06:50.750 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T09:06:50.750 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T09:06:50.750 INFO:teuthology.orchestra.run.smithi116.stdout: mon_allow_pool_size_one = true 2024-09-14T09:06:50.750 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.750 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T09:06:50.750 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.750 INFO:teuthology.orchestra.run.smithi116.stdout: osd default data pool replay window = 5 2024-09-14T09:06:50.750 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.750 INFO:teuthology.orchestra.run.smithi116.stdout: mon allow pool delete = true 2024-09-14T09:06:50.750 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.750 INFO:teuthology.orchestra.run.smithi116.stdout: mon cluster log file level = debug 2024-09-14T09:06:50.750 INFO:teuthology.orchestra.run.smithi116.stdout: debug asserts on shutdown = true 2024-09-14T09:06:50.750 INFO:teuthology.orchestra.run.smithi116.stdout: mon health detail to clog = false 2024-09-14T09:06:50.750 INFO:teuthology.orchestra.run.smithi116.stdout: mon host = "172.21.15.116,[v2:172.21.15.116:3301,v1:172.21.15.116:6790],172.21.15.144" 2024-09-14T09:06:50.751 INFO:teuthology.orchestra.run.smithi116.stdout: mon client directed command retry = 5 2024-09-14T09:06:50.751 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on pool no app = False 2024-09-14T09:06:50.751 INFO:teuthology.orchestra.run.smithi116.stdout: ms inject socket failures = 5000 2024-09-14T09:06:50.751 INFO:teuthology.orchestra.run.smithi116.stdout: fsid = c991ac1c-978d-48b3-a540-4d3d4755e125 2024-09-14T09:06:50.751 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.751 INFO:teuthology.orchestra.run.smithi116.stdout:[osd] 2024-09-14T09:06:50.751 INFO:teuthology.orchestra.run.smithi116.stdout: osd journal size = 100 2024-09-14T09:06:50.751 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.751 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub load threshold = 5.0 2024-09-14T09:06:50.751 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub max interval = 600 2024-09-14T09:06:50.751 INFO:teuthology.orchestra.run.smithi116.stdout: osd mclock profile = high_recovery_ops 2024-09-14T09:06:50.751 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.751 INFO:teuthology.orchestra.run.smithi116.stdout: osd recover clone overlap = true 2024-09-14T09:06:50.751 INFO:teuthology.orchestra.run.smithi116.stdout: osd recovery max chunk = 1048576 2024-09-14T09:06:50.751 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.752 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug shutdown = true 2024-09-14T09:06:50.752 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug op order = true 2024-09-14T09:06:50.752 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug verify stray on activate = true 2024-09-14T09:06:50.752 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug trim objects = true 2024-09-14T09:06:50.752 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.752 INFO:teuthology.orchestra.run.smithi116.stdout: osd open classes on start = true 2024-09-14T09:06:50.752 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug pg log writeout = true 2024-09-14T09:06:50.752 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.752 INFO:teuthology.orchestra.run.smithi116.stdout: osd deep scrub update digest min age = 30 2024-09-14T09:06:50.752 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.752 INFO:teuthology.orchestra.run.smithi116.stdout: osd map max advance = 10 2024-09-14T09:06:50.752 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.752 INFO:teuthology.orchestra.run.smithi116.stdout: journal zero on create = true 2024-09-14T09:06:50.752 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.752 INFO:teuthology.orchestra.run.smithi116.stdout: filestore ondisk finisher threads = 3 2024-09-14T09:06:50.753 INFO:teuthology.orchestra.run.smithi116.stdout: filestore apply finisher threads = 3 2024-09-14T09:06:50.753 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.753 INFO:teuthology.orchestra.run.smithi116.stdout: bdev debug aio = true 2024-09-14T09:06:50.753 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug misdirected ops = true 2024-09-14T09:06:50.753 INFO:teuthology.orchestra.run.smithi116.stdout: bdev async discard = True 2024-09-14T09:06:50.753 INFO:teuthology.orchestra.run.smithi116.stdout: bdev enable discard = True 2024-09-14T09:06:50.753 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore allocator = bitmap 2024-09-14T09:06:50.753 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore block size = 96636764160 2024-09-14T09:06:50.753 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore fsck on mount = True 2024-09-14T09:06:50.753 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluefs = 1/20 2024-09-14T09:06:50.754 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluestore = 1/20 2024-09-14T09:06:50.754 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-09-14T09:06:50.754 INFO:teuthology.orchestra.run.smithi116.stdout: debug osd = 20 2024-09-14T09:06:50.754 INFO:teuthology.orchestra.run.smithi116.stdout: debug rocksdb = 4/10 2024-09-14T09:06:50.754 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T09:06:50.754 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd full ratio = 0.9 2024-09-14T09:06:50.754 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd nearfull ratio = 0.8 2024-09-14T09:06:50.754 INFO:teuthology.orchestra.run.smithi116.stdout: osd blocked scrub grace period = 3600 2024-09-14T09:06:50.754 INFO:teuthology.orchestra.run.smithi116.stdout: osd failsafe full ratio = 0.95 2024-09-14T09:06:50.754 INFO:teuthology.orchestra.run.smithi116.stdout: osd max markdown count = 1000 2024-09-14T09:06:50.754 INFO:teuthology.orchestra.run.smithi116.stdout: osd objectstore = bluestore 2024-09-14T09:06:50.754 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.754 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr] 2024-09-14T09:06:50.754 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-09-14T09:06:50.754 INFO:teuthology.orchestra.run.smithi116.stdout: debug mgr = 20 2024-09-14T09:06:50.754 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2024-09-14T09:06:50.755 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2024-09-14T09:06:50.755 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2024-09-14T09:06:50.755 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2024-09-14T09:06:50.755 INFO:teuthology.orchestra.run.smithi116.stdout: mgr/telemetry/nag = false 2024-09-14T09:06:50.755 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.755 INFO:teuthology.orchestra.run.smithi116.stdout:[mon] 2024-09-14T09:06:50.755 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-09-14T09:06:50.755 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2024-09-14T09:06:50.755 INFO:teuthology.orchestra.run.smithi116.stdout: debug paxos = 20 2024-09-14T09:06:50.755 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2024-09-14T09:06:50.755 INFO:teuthology.orchestra.run.smithi116.stdout: mon data avail warn = 5 2024-09-14T09:06:50.755 INFO:teuthology.orchestra.run.smithi116.stdout: mon mgr mkfs grace = 240 2024-09-14T09:06:50.755 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2024-09-14T09:06:50.755 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd reporter subtree level = osd 2024-09-14T09:06:50.756 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd prime pg temp = true 2024-09-14T09:06:50.756 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2024-09-14T09:06:50.756 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.756 INFO:teuthology.orchestra.run.smithi116.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T09:06:50.756 INFO:teuthology.orchestra.run.smithi116.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T09:06:50.756 INFO:teuthology.orchestra.run.smithi116.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T09:06:50.756 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.756 INFO:teuthology.orchestra.run.smithi116.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T09:06:50.756 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T09:06:50.756 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T09:06:50.756 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.756 INFO:teuthology.orchestra.run.smithi116.stdout: # 1m isn't quite enough 2024-09-14T09:06:50.756 INFO:teuthology.orchestra.run.smithi116.stdout: mon_down_mkfs_grace = 2m 2024-09-14T09:06:50.756 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.757 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_filestore_osds = false 2024-09-14T09:06:50.757 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:06:50.757 INFO:teuthology.orchestra.run.smithi116.stdout:[client] 2024-09-14T09:06:50.757 INFO:teuthology.orchestra.run.smithi116.stdout: rgw cache enabled = true 2024-09-14T09:06:50.757 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable ops log = true 2024-09-14T09:06:50.757 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable usage log = true 2024-09-14T09:06:50.757 INFO:teuthology.orchestra.run.smithi116.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T09:06:50.757 INFO:teuthology.orchestra.run.smithi116.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T09:06:50.757 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.a] 2024-09-14T09:06:50.757 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.c] 2024-09-14T09:06:50.757 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.b] 2024-09-14T09:06:50.757 INFO:teuthology.orchestra.run.smithi144.stdout:[global] 2024-09-14T09:06:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: chdir = "" 2024-09-14T09:06:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T09:06:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: auth supported = cephx 2024-09-14T09:06:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: filestore xattr use omap = true 2024-09-14T09:06:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: mon clock drift allowed = 1.000 2024-09-14T09:06:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: osd crush chooseleaf type = 0 2024-09-14T09:06:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: auth debug = true 2024-09-14T09:06:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on old message = true 2024-09-14T09:06:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on bug = true 2024-09-14T09:06:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T09:06:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: mon pg warn max object skew = 0 2024-09-14T09:06:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T09:06:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T09:06:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default size = 2 2024-09-14T09:06:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow primary affinity = true 2024-09-14T09:06:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow pg remap = true 2024-09-14T09:06:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on legacy crush tunables = false 2024-09-14T09:06:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on crush straw calc version zero = false 2024-09-14T09:06:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on no sortbitwise = false 2024-09-14T09:06:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on osd down out interval zero = false 2024-09-14T09:06:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on too few osds = false 2024-09-14T09:06:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T09:06:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T09:06:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: mon_allow_pool_size_one = true 2024-09-14T09:06:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T09:06:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: osd default data pool replay window = 5 2024-09-14T09:06:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: mon allow pool delete = true 2024-09-14T09:06:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: mon cluster log file level = debug 2024-09-14T09:06:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: debug asserts on shutdown = true 2024-09-14T09:06:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: mon health detail to clog = false 2024-09-14T09:06:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: mon host = "172.21.15.116,[v2:172.21.15.116:3301,v1:172.21.15.116:6790],172.21.15.144" 2024-09-14T09:06:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: mon client directed command retry = 5 2024-09-14T09:06:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on pool no app = False 2024-09-14T09:06:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: ms inject socket failures = 5000 2024-09-14T09:06:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: fsid = c991ac1c-978d-48b3-a540-4d3d4755e125 2024-09-14T09:06:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.761 INFO:teuthology.orchestra.run.smithi144.stdout:[osd] 2024-09-14T09:06:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: osd journal size = 100 2024-09-14T09:06:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub load threshold = 5.0 2024-09-14T09:06:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub max interval = 600 2024-09-14T09:06:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: osd mclock profile = high_recovery_ops 2024-09-14T09:06:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: osd recover clone overlap = true 2024-09-14T09:06:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: osd recovery max chunk = 1048576 2024-09-14T09:06:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug shutdown = true 2024-09-14T09:06:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug op order = true 2024-09-14T09:06:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug verify stray on activate = true 2024-09-14T09:06:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug trim objects = true 2024-09-14T09:06:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: osd open classes on start = true 2024-09-14T09:06:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug pg log writeout = true 2024-09-14T09:06:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: osd deep scrub update digest min age = 30 2024-09-14T09:06:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: osd map max advance = 10 2024-09-14T09:06:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: journal zero on create = true 2024-09-14T09:06:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: filestore ondisk finisher threads = 3 2024-09-14T09:06:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: filestore apply finisher threads = 3 2024-09-14T09:06:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: bdev debug aio = true 2024-09-14T09:06:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug misdirected ops = true 2024-09-14T09:06:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: bdev async discard = True 2024-09-14T09:06:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: bdev enable discard = True 2024-09-14T09:06:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore allocator = bitmap 2024-09-14T09:06:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore block size = 96636764160 2024-09-14T09:06:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore fsck on mount = True 2024-09-14T09:06:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluefs = 1/20 2024-09-14T09:06:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluestore = 1/20 2024-09-14T09:06:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-14T09:06:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: debug osd = 20 2024-09-14T09:06:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: debug rocksdb = 4/10 2024-09-14T09:06:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T09:06:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd full ratio = 0.9 2024-09-14T09:06:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd nearfull ratio = 0.8 2024-09-14T09:06:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: osd blocked scrub grace period = 3600 2024-09-14T09:06:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: osd failsafe full ratio = 0.95 2024-09-14T09:06:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: osd max markdown count = 1000 2024-09-14T09:06:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: osd objectstore = bluestore 2024-09-14T09:06:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.764 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr] 2024-09-14T09:06:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-14T09:06:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: debug mgr = 20 2024-09-14T09:06:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2024-09-14T09:06:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2024-09-14T09:06:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2024-09-14T09:06:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2024-09-14T09:06:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: mgr/telemetry/nag = false 2024-09-14T09:06:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.765 INFO:teuthology.orchestra.run.smithi144.stdout:[mon] 2024-09-14T09:06:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-14T09:06:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2024-09-14T09:06:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: debug paxos = 20 2024-09-14T09:06:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2024-09-14T09:06:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: mon data avail warn = 5 2024-09-14T09:06:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: mon mgr mkfs grace = 240 2024-09-14T09:06:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2024-09-14T09:06:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd reporter subtree level = osd 2024-09-14T09:06:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd prime pg temp = true 2024-09-14T09:06:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2024-09-14T09:06:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T09:06:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T09:06:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T09:06:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T09:06:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T09:06:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T09:06:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: # 1m isn't quite enough 2024-09-14T09:06:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: mon_down_mkfs_grace = 2m 2024-09-14T09:06:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_filestore_osds = false 2024-09-14T09:06:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-14T09:06:50.766 INFO:teuthology.orchestra.run.smithi144.stdout:[client] 2024-09-14T09:06:50.767 INFO:teuthology.orchestra.run.smithi144.stdout: rgw cache enabled = true 2024-09-14T09:06:50.767 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable ops log = true 2024-09-14T09:06:50.767 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable usage log = true 2024-09-14T09:06:50.767 INFO:teuthology.orchestra.run.smithi144.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T09:06:50.767 INFO:teuthology.orchestra.run.smithi144.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T09:06:50.767 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.a] 2024-09-14T09:06:50.767 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.c] 2024-09-14T09:06:50.767 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.b] 2024-09-14T09:06:50.768 INFO:teuthology.orchestra.run.smithi148.stdout:[global] 2024-09-14T09:06:50.768 INFO:teuthology.orchestra.run.smithi148.stdout: chdir = "" 2024-09-14T09:06:50.768 INFO:teuthology.orchestra.run.smithi148.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T09:06:50.768 INFO:teuthology.orchestra.run.smithi148.stdout: auth supported = cephx 2024-09-14T09:06:50.768 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.768 INFO:teuthology.orchestra.run.smithi148.stdout: filestore xattr use omap = true 2024-09-14T09:06:50.768 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.768 INFO:teuthology.orchestra.run.smithi148.stdout: mon clock drift allowed = 1.000 2024-09-14T09:06:50.768 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.768 INFO:teuthology.orchestra.run.smithi148.stdout: osd crush chooseleaf type = 0 2024-09-14T09:06:50.768 INFO:teuthology.orchestra.run.smithi148.stdout: auth debug = true 2024-09-14T09:06:50.768 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.769 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on old message = true 2024-09-14T09:06:50.769 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on bug = true 2024-09-14T09:06:50.769 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.769 INFO:teuthology.orchestra.run.smithi148.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T09:06:50.769 INFO:teuthology.orchestra.run.smithi148.stdout: mon pg warn max object skew = 0 2024-09-14T09:06:50.769 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.769 INFO:teuthology.orchestra.run.smithi148.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T09:06:50.769 INFO:teuthology.orchestra.run.smithi148.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T09:06:50.769 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.769 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default size = 2 2024-09-14T09:06:50.769 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.769 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow primary affinity = true 2024-09-14T09:06:50.769 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow pg remap = true 2024-09-14T09:06:50.769 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on legacy crush tunables = false 2024-09-14T09:06:50.770 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on crush straw calc version zero = false 2024-09-14T09:06:50.770 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on no sortbitwise = false 2024-09-14T09:06:50.770 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on osd down out interval zero = false 2024-09-14T09:06:50.770 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on too few osds = false 2024-09-14T09:06:50.770 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T09:06:50.770 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T09:06:50.770 INFO:teuthology.orchestra.run.smithi148.stdout: mon_allow_pool_size_one = true 2024-09-14T09:06:50.770 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.770 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T09:06:50.770 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.770 INFO:teuthology.orchestra.run.smithi148.stdout: osd default data pool replay window = 5 2024-09-14T09:06:50.770 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.770 INFO:teuthology.orchestra.run.smithi148.stdout: mon allow pool delete = true 2024-09-14T09:06:50.770 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.770 INFO:teuthology.orchestra.run.smithi148.stdout: mon cluster log file level = debug 2024-09-14T09:06:50.771 INFO:teuthology.orchestra.run.smithi148.stdout: debug asserts on shutdown = true 2024-09-14T09:06:50.771 INFO:teuthology.orchestra.run.smithi148.stdout: mon health detail to clog = false 2024-09-14T09:06:50.771 INFO:teuthology.orchestra.run.smithi148.stdout: mon host = "172.21.15.116,[v2:172.21.15.116:3301,v1:172.21.15.116:6790],172.21.15.144" 2024-09-14T09:06:50.771 INFO:teuthology.orchestra.run.smithi148.stdout: mon client directed command retry = 5 2024-09-14T09:06:50.771 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on pool no app = False 2024-09-14T09:06:50.771 INFO:teuthology.orchestra.run.smithi148.stdout: ms inject socket failures = 5000 2024-09-14T09:06:50.771 INFO:teuthology.orchestra.run.smithi148.stdout: fsid = c991ac1c-978d-48b3-a540-4d3d4755e125 2024-09-14T09:06:50.771 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.771 INFO:teuthology.orchestra.run.smithi148.stdout:[osd] 2024-09-14T09:06:50.771 INFO:teuthology.orchestra.run.smithi148.stdout: osd journal size = 100 2024-09-14T09:06:50.771 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.771 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub load threshold = 5.0 2024-09-14T09:06:50.771 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub max interval = 600 2024-09-14T09:06:50.771 INFO:teuthology.orchestra.run.smithi148.stdout: osd mclock profile = high_recovery_ops 2024-09-14T09:06:50.772 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.772 INFO:teuthology.orchestra.run.smithi148.stdout: osd recover clone overlap = true 2024-09-14T09:06:50.772 INFO:teuthology.orchestra.run.smithi148.stdout: osd recovery max chunk = 1048576 2024-09-14T09:06:50.772 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.772 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug shutdown = true 2024-09-14T09:06:50.772 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug op order = true 2024-09-14T09:06:50.772 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug verify stray on activate = true 2024-09-14T09:06:50.772 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug trim objects = true 2024-09-14T09:06:50.772 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.772 INFO:teuthology.orchestra.run.smithi148.stdout: osd open classes on start = true 2024-09-14T09:06:50.772 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug pg log writeout = true 2024-09-14T09:06:50.772 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.772 INFO:teuthology.orchestra.run.smithi148.stdout: osd deep scrub update digest min age = 30 2024-09-14T09:06:50.772 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.773 INFO:teuthology.orchestra.run.smithi148.stdout: osd map max advance = 10 2024-09-14T09:06:50.773 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.773 INFO:teuthology.orchestra.run.smithi148.stdout: journal zero on create = true 2024-09-14T09:06:50.773 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.773 INFO:teuthology.orchestra.run.smithi148.stdout: filestore ondisk finisher threads = 3 2024-09-14T09:06:50.773 INFO:teuthology.orchestra.run.smithi148.stdout: filestore apply finisher threads = 3 2024-09-14T09:06:50.773 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.773 INFO:teuthology.orchestra.run.smithi148.stdout: bdev debug aio = true 2024-09-14T09:06:50.773 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug misdirected ops = true 2024-09-14T09:06:50.773 INFO:teuthology.orchestra.run.smithi148.stdout: bdev async discard = True 2024-09-14T09:06:50.773 INFO:teuthology.orchestra.run.smithi148.stdout: bdev enable discard = True 2024-09-14T09:06:50.773 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore allocator = bitmap 2024-09-14T09:06:50.773 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore block size = 96636764160 2024-09-14T09:06:50.773 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore fsck on mount = True 2024-09-14T09:06:50.773 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluefs = 1/20 2024-09-14T09:06:50.774 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluestore = 1/20 2024-09-14T09:06:50.774 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-09-14T09:06:50.774 INFO:teuthology.orchestra.run.smithi148.stdout: debug osd = 20 2024-09-14T09:06:50.774 INFO:teuthology.orchestra.run.smithi148.stdout: debug rocksdb = 4/10 2024-09-14T09:06:50.774 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T09:06:50.774 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd full ratio = 0.9 2024-09-14T09:06:50.774 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd nearfull ratio = 0.8 2024-09-14T09:06:50.774 INFO:teuthology.orchestra.run.smithi148.stdout: osd blocked scrub grace period = 3600 2024-09-14T09:06:50.774 INFO:teuthology.orchestra.run.smithi148.stdout: osd failsafe full ratio = 0.95 2024-09-14T09:06:50.774 INFO:teuthology.orchestra.run.smithi148.stdout: osd max markdown count = 1000 2024-09-14T09:06:50.774 INFO:teuthology.orchestra.run.smithi148.stdout: osd objectstore = bluestore 2024-09-14T09:06:50.774 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.774 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr] 2024-09-14T09:06:50.774 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-09-14T09:06:50.774 INFO:teuthology.orchestra.run.smithi148.stdout: debug mgr = 20 2024-09-14T09:06:50.775 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2024-09-14T09:06:50.775 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2024-09-14T09:06:50.775 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2024-09-14T09:06:50.775 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2024-09-14T09:06:50.775 INFO:teuthology.orchestra.run.smithi148.stdout: mgr/telemetry/nag = false 2024-09-14T09:06:50.775 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.775 INFO:teuthology.orchestra.run.smithi148.stdout:[mon] 2024-09-14T09:06:50.775 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-09-14T09:06:50.775 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2024-09-14T09:06:50.775 INFO:teuthology.orchestra.run.smithi148.stdout: debug paxos = 20 2024-09-14T09:06:50.775 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2024-09-14T09:06:50.775 INFO:teuthology.orchestra.run.smithi148.stdout: mon data avail warn = 5 2024-09-14T09:06:50.775 INFO:teuthology.orchestra.run.smithi148.stdout: mon mgr mkfs grace = 240 2024-09-14T09:06:50.775 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2024-09-14T09:06:50.776 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd reporter subtree level = osd 2024-09-14T09:06:50.776 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd prime pg temp = true 2024-09-14T09:06:50.776 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2024-09-14T09:06:50.776 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.776 INFO:teuthology.orchestra.run.smithi148.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T09:06:50.776 INFO:teuthology.orchestra.run.smithi148.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T09:06:50.776 INFO:teuthology.orchestra.run.smithi148.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T09:06:50.776 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.776 INFO:teuthology.orchestra.run.smithi148.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T09:06:50.776 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T09:06:50.776 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T09:06:50.776 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.776 INFO:teuthology.orchestra.run.smithi148.stdout: # 1m isn't quite enough 2024-09-14T09:06:50.776 INFO:teuthology.orchestra.run.smithi148.stdout: mon_down_mkfs_grace = 2m 2024-09-14T09:06:50.776 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.777 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_filestore_osds = false 2024-09-14T09:06:50.777 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T09:06:50.777 INFO:teuthology.orchestra.run.smithi148.stdout:[client] 2024-09-14T09:06:50.777 INFO:teuthology.orchestra.run.smithi148.stdout: rgw cache enabled = true 2024-09-14T09:06:50.777 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable ops log = true 2024-09-14T09:06:50.777 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable usage log = true 2024-09-14T09:06:50.777 INFO:teuthology.orchestra.run.smithi148.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T09:06:50.777 INFO:teuthology.orchestra.run.smithi148.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T09:06:50.777 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.a] 2024-09-14T09:06:50.777 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.c] 2024-09-14T09:06:50.777 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.b] 2024-09-14T09:06:50.779 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-14T09:06:50.779 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-14T09:06:50.872 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-14T09:06:50.872 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T09:06:50.873 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-14T09:06:50.888 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T09:06:50.888 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-14T09:06:50.943 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T09:06:50.943 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T09:06:50.943 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T09:06:50.943 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T09:06:51.017 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T09:06:51.017 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T09:06:51.073 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi144.front.sepia.ceph.com 2024-09-14T09:06:51.073 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-14T09:06:51.073 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T09:06:51.073 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T09:06:51.108 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-14T09:06:51.108 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T09:06:51.164 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi148.front.sepia.ceph.com 2024-09-14T09:06:51.164 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T09:06:51.165 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T09:06:51.165 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T09:06:51.206 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T09:06:51.206 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T09:06:51.265 INFO:tasks.ceph:Setting up mon nodes... 2024-09-14T09:06:51.265 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-14T09:06:51.265 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T09:06:51.347 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T09:06:51.349 INFO:tasks.ceph:Setting up mds nodes... 2024-09-14T09:06:51.349 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-14T09:06:51.350 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-14T09:06:51.401 INFO:teuthology.orchestra.run.smithi148.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-14T09:06:51.415 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-14T09:06:51.415 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-09-14T09:06:51.415 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-14T09:06:51.440 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-14T09:06:51.441 INFO:tasks.ceph:role: osd.0 2024-09-14T09:06:51.441 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T09:06:51.441 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T09:06:51.513 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T09:06:51.514 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T09:06:51.514 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T09:06:51.514 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T09:06:51.514 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T09:06:51.514 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-09-14T09:06:51.514 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T09:06:51.514 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T09:06:51.514 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T09:06:51.514 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T09:06:52.020 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-09-14T09:06:52.022 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-09-14T09:06:52.022 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-14T09:06:52.171 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-14T09:06:52.206 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-14T09:06:52.274 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-14T09:06:52.274 INFO:tasks.ceph:role: osd.1 2024-09-14T09:06:52.275 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T09:06:52.275 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T09:06:52.348 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T09:06:52.349 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T09:06:52.349 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T09:06:52.349 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T09:06:52.349 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T09:06:52.349 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-09-14T09:06:52.349 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T09:06:52.349 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T09:06:52.350 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T09:06:52.350 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T09:06:52.790 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-09-14T09:06:52.792 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-09-14T09:06:52.792 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-14T09:06:52.888 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-14T09:06:52.917 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-14T09:06:52.982 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-14T09:06:52.982 INFO:tasks.ceph:role: osd.2 2024-09-14T09:06:52.982 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T09:06:52.982 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T09:06:53.054 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T09:06:53.054 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T09:06:53.054 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T09:06:53.054 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T09:06:53.054 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T09:06:53.054 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-09-14T09:06:53.054 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T09:06:53.054 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T09:06:53.054 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T09:06:53.054 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T09:06:53.541 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-09-14T09:06:53.543 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-09-14T09:06:53.543 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-14T09:06:53.691 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-14T09:06:53.721 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T09:06:53.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T09:06:53.821+0000 7f2e88eeb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-14T09:06:53.823 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T09:06:53.825+0000 7f2e88eeb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-14T09:06:53.823 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T09:06:53.825+0000 7f2e88eeb640 -1 bdev(0x55c9d4615800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-14T09:06:53.823 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T09:06:53.825+0000 7f2e88eeb640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-14T09:06:57.250 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-14T09:06:57.280 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T09:06:57.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T09:06:57.374+0000 7ff674820640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-14T09:06:57.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T09:06:57.374+0000 7ff674820640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-14T09:06:57.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T09:06:57.374+0000 7ff674820640 -1 bdev(0x560fa8f87800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-14T09:06:57.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T09:06:57.374+0000 7ff674820640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-14T09:07:00.288 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-14T09:07:00.318 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T09:07:00.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T09:07:00.410+0000 7f3fa6a62640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-14T09:07:00.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T09:07:00.410+0000 7f3fa6a62640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-14T09:07:00.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T09:07:00.410+0000 7f3fa6a62640 -1 bdev(0x5633e0395800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-14T09:07:00.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T09:07:00.410+0000 7f3fa6a62640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-14T09:07:03.323 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-14T09:07:03.352 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-14T09:07:03.383 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-14T09:07:03.383 INFO:tasks.ceph:role: osd.3 2024-09-14T09:07:03.383 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-14T09:07:03.383 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T09:07:03.461 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T09:07:03.461 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T09:07:03.461 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T09:07:03.461 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T09:07:03.461 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T09:07:03.461 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-09-14T09:07:03.461 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T09:07:03.462 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T09:07:03.462 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T09:07:03.462 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T09:07:03.958 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-09-14T09:07:03.960 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-09-14T09:07:03.960 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2024-09-14T09:07:04.083 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-14T09:07:04.116 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-14T09:07:04.180 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-14T09:07:04.181 INFO:tasks.ceph:role: osd.4 2024-09-14T09:07:04.181 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-14T09:07:04.181 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T09:07:04.253 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T09:07:04.253 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T09:07:04.253 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T09:07:04.253 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T09:07:04.253 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T09:07:04.253 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-09-14T09:07:04.253 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T09:07:04.253 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T09:07:04.253 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T09:07:04.253 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T09:07:04.714 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-09-14T09:07:04.716 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-09-14T09:07:04.716 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-09-14T09:07:04.810 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-14T09:07:04.839 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-14T09:07:04.904 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-14T09:07:04.904 INFO:tasks.ceph:role: osd.5 2024-09-14T09:07:04.904 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-14T09:07:04.905 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T09:07:04.977 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T09:07:04.977 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T09:07:04.977 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T09:07:04.977 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T09:07:04.977 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T09:07:04.977 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-09-14T09:07:04.977 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T09:07:04.977 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T09:07:04.977 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T09:07:04.977 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T09:07:05.465 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-09-14T09:07:05.467 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-09-14T09:07:05.467 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2024-09-14T09:07:05.626 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-14T09:07:05.656 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T09:07:05.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-14T09:07:05.754+0000 7f5aab5a8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-14T09:07:05.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-14T09:07:05.758+0000 7f5aab5a8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-14T09:07:05.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-14T09:07:05.758+0000 7f5aab5a8640 -1 bdev(0x55c602f47800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-14T09:07:05.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-14T09:07:05.759+0000 7f5aab5a8640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-14T09:07:08.918 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-14T09:07:08.947 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T09:07:09.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-14T09:07:09.036+0000 7f6a544ef640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-14T09:07:09.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-14T09:07:09.036+0000 7f6a544ef640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-14T09:07:09.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-14T09:07:09.037+0000 7f6a544ef640 -1 bdev(0x55bb9582f800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-14T09:07:09.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-14T09:07:09.037+0000 7f6a544ef640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-14T09:07:11.943 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-14T09:07:11.969 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T09:07:12.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-14T09:07:12.058+0000 7f28065dd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-14T09:07:12.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-14T09:07:12.058+0000 7f28065dd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-14T09:07:12.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-14T09:07:12.058+0000 7f28065dd640 -1 bdev(0x55d6938a1800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-14T09:07:12.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-14T09:07:12.059+0000 7f28065dd640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-14T09:07:15.210 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-14T09:07:15.234 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-14T09:07:15.235 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T09:07:15.235 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-14T09:07:15.265 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T09:07:15.265 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-14T09:07:15.333 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T09:07:15.333 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-14T09:07:15.400 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-14T09:07:15.401 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-14T09:07:15.425 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-14T09:07:15.426 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-14T09:07:15.490 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-14T09:07:15.490 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-14T09:07:15.555 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-14T09:07:15.555 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-14T09:07:15.620 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T09:07:15.620 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-14T09:07:15.639 INFO:tasks.ceph:Adding keys to all mons... 2024-09-14T09:07:15.639 DEBUG:teuthology.orchestra.run.smithi116:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T09:07:15.642 DEBUG:teuthology.orchestra.run.smithi144:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T09:07:15.664 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.0] 2024-09-14T09:07:15.665 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQAtUuVmD4QAMRAAdcqDWkQL1vVHNMQaPMFcjA== 2024-09-14T09:07:15.665 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.1] 2024-09-14T09:07:15.665 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQAxUuVmCFpaFhAAe2/1C36gDNWX85wRouGnvg== 2024-09-14T09:07:15.665 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.2] 2024-09-14T09:07:15.665 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQA0UuVmERKBGBAAwk1IyBA2VyFetqZM6f9PWQ== 2024-09-14T09:07:15.665 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr.x] 2024-09-14T09:07:15.665 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQArUuVmUY7ZFBAAKMmoxKcdf90KkeIztRLSGg== 2024-09-14T09:07:15.665 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.3] 2024-09-14T09:07:15.665 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQA5UuVm3isALRAAgOPd+u9PeKkoMH7jaE/Qlw== 2024-09-14T09:07:15.665 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.4] 2024-09-14T09:07:15.665 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQA9UuVm+U5JAhAADhRxEHjJI1lJNBwNv9L5jg== 2024-09-14T09:07:15.665 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.5] 2024-09-14T09:07:15.665 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBAUuVmv+WYAxAAjVwqKkEiyeCPiWYwEVXHJg== 2024-09-14T09:07:15.665 INFO:teuthology.orchestra.run.smithi116.stdout:[client.0] 2024-09-14T09:07:15.665 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQArUuVmrGIgGBAANowksHBWPEgj5WsUNnMnpA== 2024-09-14T09:07:15.682 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.0] 2024-09-14T09:07:15.682 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAtUuVmD4QAMRAAdcqDWkQL1vVHNMQaPMFcjA== 2024-09-14T09:07:15.683 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.1] 2024-09-14T09:07:15.683 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAxUuVmCFpaFhAAe2/1C36gDNWX85wRouGnvg== 2024-09-14T09:07:15.683 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.2] 2024-09-14T09:07:15.683 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQA0UuVmERKBGBAAwk1IyBA2VyFetqZM6f9PWQ== 2024-09-14T09:07:15.683 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr.x] 2024-09-14T09:07:15.683 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQArUuVmUY7ZFBAAKMmoxKcdf90KkeIztRLSGg== 2024-09-14T09:07:15.683 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.3] 2024-09-14T09:07:15.683 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQA5UuVm3isALRAAgOPd+u9PeKkoMH7jaE/Qlw== 2024-09-14T09:07:15.683 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.4] 2024-09-14T09:07:15.683 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQA9UuVm+U5JAhAADhRxEHjJI1lJNBwNv9L5jg== 2024-09-14T09:07:15.683 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.5] 2024-09-14T09:07:15.683 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBAUuVmv+WYAxAAjVwqKkEiyeCPiWYwEVXHJg== 2024-09-14T09:07:15.683 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-14T09:07:15.684 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQArUuVmrGIgGBAANowksHBWPEgj5WsUNnMnpA== 2024-09-14T09:07:15.684 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T09:07:15.708 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T09:07:15.775 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T09:07:15.778 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T09:07:15.829 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T09:07:15.832 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T09:07:15.885 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T09:07:15.887 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T09:07:15.938 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T09:07:15.940 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T09:07:15.990 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T09:07:15.992 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T09:07:16.043 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T09:07:16.045 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T09:07:16.097 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T09:07:16.099 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T09:07:16.153 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-14T09:07:16.153 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-14T09:07:16.177 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T09:07:16.273 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-14T09:07:16.298 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-14T09:07:16.362 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T09:07:16.458 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-14T09:07:16.483 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-14T09:07:16.509 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T09:07:16.605 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-14T09:07:16.629 DEBUG:teuthology.orchestra.run.smithi116:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T09:07:16.632 DEBUG:teuthology.orchestra.run.smithi144:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T09:07:16.685 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-14T09:07:16.686 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-14T09:07:16.686 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-14T09:07:16.689 INFO:tasks.ceph.mon.a:Started 2024-09-14T09:07:16.689 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-14T09:07:16.689 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-14T09:07:16.691 INFO:tasks.ceph.mon.c:Started 2024-09-14T09:07:16.691 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-14T09:07:16.691 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-14T09:07:16.728 INFO:tasks.ceph.mon.b:Started 2024-09-14T09:07:16.729 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-14T09:07:16.729 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-14T09:07:16.729 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-14T09:07:16.731 INFO:tasks.ceph.mgr.x:Started 2024-09-14T09:07:16.731 DEBUG:tasks.ceph:set 0 configs 2024-09-14T09:07:16.731 INFO:tasks.ceph:Setting crush tunables to default 2024-09-14T09:07:16.731 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd crush tunables default 2024-09-14T09:07:17.065 INFO:teuthology.orchestra.run.smithi116.stderr:adjusted tunables profile to default 2024-09-14T09:07:17.077 INFO:tasks.ceph:check_enable_crimson: False 2024-09-14T09:07:17.077 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-14T09:07:17.077 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T09:07:17.077 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-14T09:07:17.101 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T09:07:17.101 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-14T09:07:17.165 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T09:07:17.166 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-14T09:07:17.231 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-14T09:07:17.231 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-14T09:07:17.256 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-14T09:07:17.256 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-14T09:07:17.320 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-14T09:07:17.321 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-14T09:07:17.385 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new b3c13086-1183-454b-8e62-3aec9b69cdf5 0 2024-09-14T09:07:17.606 INFO:teuthology.orchestra.run.smithi144.stdout:0 2024-09-14T09:07:17.617 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 8ee6a373-9d0d-4cd2-96f4-9673de96f546 1 2024-09-14T09:07:17.800 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-14T09:07:17.811 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 958a9363-d751-49c3-9ec7-7330d377ee53 2 2024-09-14T09:07:17.989 INFO:teuthology.orchestra.run.smithi144.stdout:2 2024-09-14T09:07:18.000 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 7fafd519-b2e9-498c-a409-f55cfe45a51a 3 2024-09-14T09:07:18.178 INFO:teuthology.orchestra.run.smithi144.stdout:3 2024-09-14T09:07:18.189 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 63d99552-5fea-4367-bf86-0addc8cceb98 4 2024-09-14T09:07:18.367 INFO:teuthology.orchestra.run.smithi144.stdout:4 2024-09-14T09:07:18.379 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new e4bcb224-662f-4530-b477-c0dd9c4ddbf4 5 2024-09-14T09:07:18.560 INFO:teuthology.orchestra.run.smithi144.stdout:5 2024-09-14T09:07:18.571 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T09:07:18.571 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T09:07:18.574 INFO:tasks.ceph.osd.0:Started 2024-09-14T09:07:18.574 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-14T09:07:18.574 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-14T09:07:18.576 INFO:tasks.ceph.osd.1:Started 2024-09-14T09:07:18.576 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-14T09:07:18.576 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-14T09:07:18.579 INFO:tasks.ceph.osd.2:Started 2024-09-14T09:07:18.579 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-14T09:07:18.579 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-14T09:07:18.581 INFO:tasks.ceph.osd.3:Started 2024-09-14T09:07:18.581 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-14T09:07:18.581 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-14T09:07:18.583 INFO:tasks.ceph.osd.4:Started 2024-09-14T09:07:18.583 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-14T09:07:18.584 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-14T09:07:18.586 INFO:tasks.ceph.osd.5:Started 2024-09-14T09:07:18.586 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T09:07:18.759 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:07:18.759 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":8,"fsid":"c991ac1c-978d-48b3-a540-4d3d4755e125","created":"2024-09-14T09:07:16.982473+0000","modified":"2024-09-14T09:07:18.560664+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T09:07:18.560664+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b3c13086-1183-454b-8e62-3aec9b69cdf5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8ee6a373-9d0d-4cd2-96f4-9673de96f546","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"958a9363-d751-49c3-9ec7-7330d377ee53","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7fafd519-b2e9-498c-a409-f55cfe45a51a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"63d99552-5fea-4367-bf86-0addc8cceb98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e4bcb224-662f-4530-b477-c0dd9c4ddbf4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T09:07:18.770 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-14T09:07:18.770 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-14T09:07:19.375 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T09:07:19.535 INFO:teuthology.misc.health.smithi116.stdout: 2024-09-14T09:07:19.536 INFO:teuthology.misc.health.smithi116.stdout:{"epoch":8,"fsid":"c991ac1c-978d-48b3-a540-4d3d4755e125","created":"2024-09-14T09:07:16.982473+0000","modified":"2024-09-14T09:07:18.560664+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T09:07:18.560664+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b3c13086-1183-454b-8e62-3aec9b69cdf5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8ee6a373-9d0d-4cd2-96f4-9673de96f546","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"958a9363-d751-49c3-9ec7-7330d377ee53","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7fafd519-b2e9-498c-a409-f55cfe45a51a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"63d99552-5fea-4367-bf86-0addc8cceb98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e4bcb224-662f-4530-b477-c0dd9c4ddbf4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T09:07:19.545 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-09-14T09:07:20.018 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:20.020+0000 7f0dbd3b2640 -1 Falling back to public interface 2024-09-14T09:07:20.020 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:20.022+0000 7fbee7945640 -1 Falling back to public interface 2024-09-14T09:07:20.025 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:20.026+0000 7f1fdd3d4640 -1 Falling back to public interface 2024-09-14T09:07:20.044 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:20.045+0000 7f1ddd016640 -1 Falling back to public interface 2024-09-14T09:07:20.247 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:20.249+0000 7f99ce80c640 -1 Falling back to public interface 2024-09-14T09:07:20.298 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:20.299+0000 7faa50a0d640 -1 Falling back to public interface 2024-09-14T09:07:22.181 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-14T09:07:22.182+0000 7f10a8125640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-14T09:07:22.181 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-09-14T09:07:22.182+0000 7f10a8125640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-14T09:07:23.758 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:23.760+0000 7f99ce80c640 -1 osd.0 0 log_to_monitors true 2024-09-14T09:07:23.851 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:23.852+0000 7f1ddd016640 -1 osd.4 0 log_to_monitors true 2024-09-14T09:07:24.022 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:24.023+0000 7f1fdd3d4640 -1 osd.5 0 log_to_monitors true 2024-09-14T09:07:24.317 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:24.319+0000 7f0dbd3b2640 -1 osd.1 0 log_to_monitors true 2024-09-14T09:07:24.330 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:24.332+0000 7fbee7945640 -1 osd.2 0 log_to_monitors true 2024-09-14T09:07:24.336 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:24.337+0000 7faa50a0d640 -1 osd.3 0 log_to_monitors true 2024-09-14T09:07:26.050 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:26.051+0000 7f99ca0c9640 -1 osd.0 0 waiting for initial osdmap 2024-09-14T09:07:26.064 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:26.066+0000 7f99c1ee8640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T09:07:26.150 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T09:07:26.458 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:26.460+0000 7f1dd90b3640 -1 osd.4 0 waiting for initial osdmap 2024-09-14T09:07:26.472 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:26.474+0000 7f1dd06be640 -1 osd.4 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T09:07:26.473 INFO:teuthology.misc.health.smithi116.stdout: 2024-09-14T09:07:26.473 INFO:teuthology.misc.health.smithi116.stdout:{"epoch":11,"fsid":"c991ac1c-978d-48b3-a540-4d3d4755e125","created":"2024-09-14T09:07:16.982473+0000","modified":"2024-09-14T09:07:26.184188+0000","last_up_change":"2024-09-14T09:07:26.184188+0000","last_in_change":"2024-09-14T09:07:18.560664+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b3c13086-1183-454b-8e62-3aec9b69cdf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6817","nonce":1856142608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6819","nonce":1856142608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6823","nonce":1856142608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6821","nonce":1856142608}]},"public_addr":"172.21.15.116:6817/1856142608","cluster_addr":"172.21.15.116:6819/1856142608","heartbeat_back_addr":"172.21.15.116:6823/1856142608","heartbeat_front_addr":"172.21.15.116:6821/1856142608","state":["exists","up"]},{"osd":1,"uuid":"8ee6a373-9d0d-4cd2-96f4-9673de96f546","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"958a9363-d751-49c3-9ec7-7330d377ee53","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7fafd519-b2e9-498c-a409-f55cfe45a51a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"63d99552-5fea-4367-bf86-0addc8cceb98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e4bcb224-662f-4530-b477-c0dd9c4ddbf4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T09:07:26.487 DEBUG:teuthology.misc:1 of 6 OSDs are up 2024-09-14T09:07:26.565 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:26.567+0000 7f1fd9363640 -1 osd.5 0 waiting for initial osdmap 2024-09-14T09:07:26.586 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:26.588+0000 7f1fd1182640 -1 osd.5 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T09:07:27.111 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:27.112+0000 7faa4cc5f640 -1 osd.3 0 waiting for initial osdmap 2024-09-14T09:07:27.123 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:27.125+0000 7faa4426a640 -1 osd.3 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T09:07:27.452 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:27.453+0000 7f0db9341640 -1 osd.1 0 waiting for initial osdmap 2024-09-14T09:07:27.465 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:27.467+0000 7f0db1160640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T09:07:27.470 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:27.472+0000 7fbee38d4640 -1 osd.2 0 waiting for initial osdmap 2024-09-14T09:07:27.484 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:27.486+0000 7fbedb6f3640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T09:07:33.094 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T09:07:33.384 INFO:teuthology.misc.health.smithi116.stdout: 2024-09-14T09:07:33.384 INFO:teuthology.misc.health.smithi116.stdout:{"epoch":16,"fsid":"c991ac1c-978d-48b3-a540-4d3d4755e125","created":"2024-09-14T09:07:16.982473+0000","modified":"2024-09-14T09:07:31.227873+0000","last_up_change":"2024-09-14T09:07:28.201361+0000","last_in_change":"2024-09-14T09:07:18.560664+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T09:07:29.194849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3c13086-1183-454b-8e62-3aec9b69cdf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6817","nonce":1856142608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6819","nonce":1856142608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6823","nonce":1856142608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6821","nonce":1856142608}]},"public_addr":"172.21.15.116:6817/1856142608","cluster_addr":"172.21.15.116:6819/1856142608","heartbeat_back_addr":"172.21.15.116:6823/1856142608","heartbeat_front_addr":"172.21.15.116:6821/1856142608","state":["exists","up"]},{"osd":1,"uuid":"8ee6a373-9d0d-4cd2-96f4-9673de96f546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6801","nonce":3469105275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6803","nonce":3469105275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6807","nonce":3469105275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6805","nonce":3469105275}]},"public_addr":"172.21.15.116:6801/3469105275","cluster_addr":"172.21.15.116:6803/3469105275","heartbeat_back_addr":"172.21.15.116:6807/3469105275","heartbeat_front_addr":"172.21.15.116:6805/3469105275","state":["exists","up"]},{"osd":2,"uuid":"958a9363-d751-49c3-9ec7-7330d377ee53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2660214336},{"type":"v1","addr":"172.21.15.116:6809","nonce":2660214336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2660214336},{"type":"v1","addr":"172.21.15.116:6811","nonce":2660214336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2660214336},{"type":"v1","addr":"172.21.15.116:6815","nonce":2660214336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2660214336},{"type":"v1","addr":"172.21.15.116:6813","nonce":2660214336}]},"public_addr":"172.21.15.116:6809/2660214336","cluster_addr":"172.21.15.116:6811/2660214336","heartbeat_back_addr":"172.21.15.116:6815/2660214336","heartbeat_front_addr":"172.21.15.116:6813/2660214336","state":["exists","up"]},{"osd":3,"uuid":"7fafd519-b2e9-498c-a409-f55cfe45a51a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6817","nonce":2855061278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6819","nonce":2855061278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6823","nonce":2855061278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6821","nonce":2855061278}]},"public_addr":"172.21.15.144:6817/2855061278","cluster_addr":"172.21.15.144:6819/2855061278","heartbeat_back_addr":"172.21.15.144:6823/2855061278","heartbeat_front_addr":"172.21.15.144:6821/2855061278","state":["exists","up"]},{"osd":4,"uuid":"63d99552-5fea-4367-bf86-0addc8cceb98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6809","nonce":369903047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6811","nonce":369903047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6815","nonce":369903047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6813","nonce":369903047}]},"public_addr":"172.21.15.144:6809/369903047","cluster_addr":"172.21.15.144:6811/369903047","heartbeat_back_addr":"172.21.15.144:6815/369903047","heartbeat_front_addr":"172.21.15.144:6813/369903047","state":["exists","up"]},{"osd":5,"uuid":"e4bcb224-662f-4530-b477-c0dd9c4ddbf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6801","nonce":2878111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6803","nonce":2878111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6807","nonce":2878111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6805","nonce":2878111293}]},"public_addr":"172.21.15.144:6801/2878111293","cluster_addr":"172.21.15.144:6803/2878111293","heartbeat_back_addr":"172.21.15.144:6807/2878111293","heartbeat_front_addr":"172.21.15.144:6805/2878111293","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:24.757990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.277795+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.290172+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.324594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:24.865136+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.020572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T09:07:33.396 DEBUG:teuthology.misc:6 of 6 OSDs are up 2024-09-14T09:07:33.396 INFO:tasks.ceph:Creating RBD pool 2024-09-14T09:07:33.397 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-14T09:07:34.240 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'rbd' created 2024-09-14T09:07:34.254 DEBUG:teuthology.orchestra.run.smithi116:> rbd --cluster ceph pool init rbd 2024-09-14T09:07:37.265 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-14T09:07:37.265 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-14T09:07:37.266 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-14T09:07:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:07:37.571 INFO:teuthology.orchestra.run.smithi116.stdout:[{"version":7,"timestamp":"2024-09-14T09:07:27.473474+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"6528.582504"}]}] 2024-09-14T09:07:37.571 INFO:tasks.ceph_manager:config epoch is 7 2024-09-14T09:07:37.571 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-14T09:07:37.571 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-14T09:07:37.572 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-14T09:07:37.902 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:07:37.913 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3194325721},{"type":"v1","addr":"172.21.15.144:6825","nonce":3194325721}]},"active_addr":"172.21.15.144:6825/3194325721","active_change":"2024-09-14T09:07:21.169429+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":4255635981}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":3119569515}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":2241285011}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":2732622313}]}]} 2024-09-14T09:07:37.916 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-14T09:07:37.916 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T09:07:37.916 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T09:07:38.198 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:07:38.198 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":20,"fsid":"c991ac1c-978d-48b3-a540-4d3d4755e125","created":"2024-09-14T09:07:16.982473+0000","modified":"2024-09-14T09:07:37.249843+0000","last_up_change":"2024-09-14T09:07:28.201361+0000","last_in_change":"2024-09-14T09:07:18.560664+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T09:07:29.194849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T09:07:33.684592+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3c13086-1183-454b-8e62-3aec9b69cdf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6817","nonce":1856142608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6819","nonce":1856142608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6823","nonce":1856142608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6821","nonce":1856142608}]},"public_addr":"172.21.15.116:6817/1856142608","cluster_addr":"172.21.15.116:6819/1856142608","heartbeat_back_addr":"172.21.15.116:6823/1856142608","heartbeat_front_addr":"172.21.15.116:6821/1856142608","state":["exists","up"]},{"osd":1,"uuid":"8ee6a373-9d0d-4cd2-96f4-9673de96f546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6801","nonce":3469105275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6803","nonce":3469105275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6807","nonce":3469105275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6805","nonce":3469105275}]},"public_addr":"172.21.15.116:6801/3469105275","cluster_addr":"172.21.15.116:6803/3469105275","heartbeat_back_addr":"172.21.15.116:6807/3469105275","heartbeat_front_addr":"172.21.15.116:6805/3469105275","state":["exists","up"]},{"osd":2,"uuid":"958a9363-d751-49c3-9ec7-7330d377ee53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2660214336},{"type":"v1","addr":"172.21.15.116:6809","nonce":2660214336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2660214336},{"type":"v1","addr":"172.21.15.116:6811","nonce":2660214336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2660214336},{"type":"v1","addr":"172.21.15.116:6815","nonce":2660214336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2660214336},{"type":"v1","addr":"172.21.15.116:6813","nonce":2660214336}]},"public_addr":"172.21.15.116:6809/2660214336","cluster_addr":"172.21.15.116:6811/2660214336","heartbeat_back_addr":"172.21.15.116:6815/2660214336","heartbeat_front_addr":"172.21.15.116:6813/2660214336","state":["exists","up"]},{"osd":3,"uuid":"7fafd519-b2e9-498c-a409-f55cfe45a51a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6817","nonce":2855061278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6819","nonce":2855061278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6823","nonce":2855061278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6821","nonce":2855061278}]},"public_addr":"172.21.15.144:6817/2855061278","cluster_addr":"172.21.15.144:6819/2855061278","heartbeat_back_addr":"172.21.15.144:6823/2855061278","heartbeat_front_addr":"172.21.15.144:6821/2855061278","state":["exists","up"]},{"osd":4,"uuid":"63d99552-5fea-4367-bf86-0addc8cceb98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6809","nonce":369903047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6811","nonce":369903047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6815","nonce":369903047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6813","nonce":369903047}]},"public_addr":"172.21.15.144:6809/369903047","cluster_addr":"172.21.15.144:6811/369903047","heartbeat_back_addr":"172.21.15.144:6815/369903047","heartbeat_front_addr":"172.21.15.144:6813/369903047","state":["exists","up"]},{"osd":5,"uuid":"e4bcb224-662f-4530-b477-c0dd9c4ddbf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6801","nonce":2878111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6803","nonce":2878111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6807","nonce":2878111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6805","nonce":2878111293}]},"public_addr":"172.21.15.144:6801/2878111293","cluster_addr":"172.21.15.144:6803/2878111293","heartbeat_back_addr":"172.21.15.144:6807/2878111293","heartbeat_front_addr":"172.21.15.144:6805/2878111293","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:24.757990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.277795+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.290172+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.324594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:24.865136+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.020572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T09:07:38.211 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T09:07:38.211 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T09:07:38.493 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:07:38.494 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":20,"fsid":"c991ac1c-978d-48b3-a540-4d3d4755e125","created":"2024-09-14T09:07:16.982473+0000","modified":"2024-09-14T09:07:37.249843+0000","last_up_change":"2024-09-14T09:07:28.201361+0000","last_in_change":"2024-09-14T09:07:18.560664+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T09:07:29.194849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T09:07:33.684592+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3c13086-1183-454b-8e62-3aec9b69cdf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6817","nonce":1856142608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6819","nonce":1856142608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6823","nonce":1856142608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6821","nonce":1856142608}]},"public_addr":"172.21.15.116:6817/1856142608","cluster_addr":"172.21.15.116:6819/1856142608","heartbeat_back_addr":"172.21.15.116:6823/1856142608","heartbeat_front_addr":"172.21.15.116:6821/1856142608","state":["exists","up"]},{"osd":1,"uuid":"8ee6a373-9d0d-4cd2-96f4-9673de96f546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6801","nonce":3469105275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6803","nonce":3469105275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6807","nonce":3469105275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6805","nonce":3469105275}]},"public_addr":"172.21.15.116:6801/3469105275","cluster_addr":"172.21.15.116:6803/3469105275","heartbeat_back_addr":"172.21.15.116:6807/3469105275","heartbeat_front_addr":"172.21.15.116:6805/3469105275","state":["exists","up"]},{"osd":2,"uuid":"958a9363-d751-49c3-9ec7-7330d377ee53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2660214336},{"type":"v1","addr":"172.21.15.116:6809","nonce":2660214336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2660214336},{"type":"v1","addr":"172.21.15.116:6811","nonce":2660214336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2660214336},{"type":"v1","addr":"172.21.15.116:6815","nonce":2660214336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2660214336},{"type":"v1","addr":"172.21.15.116:6813","nonce":2660214336}]},"public_addr":"172.21.15.116:6809/2660214336","cluster_addr":"172.21.15.116:6811/2660214336","heartbeat_back_addr":"172.21.15.116:6815/2660214336","heartbeat_front_addr":"172.21.15.116:6813/2660214336","state":["exists","up"]},{"osd":3,"uuid":"7fafd519-b2e9-498c-a409-f55cfe45a51a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6817","nonce":2855061278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6819","nonce":2855061278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6823","nonce":2855061278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6821","nonce":2855061278}]},"public_addr":"172.21.15.144:6817/2855061278","cluster_addr":"172.21.15.144:6819/2855061278","heartbeat_back_addr":"172.21.15.144:6823/2855061278","heartbeat_front_addr":"172.21.15.144:6821/2855061278","state":["exists","up"]},{"osd":4,"uuid":"63d99552-5fea-4367-bf86-0addc8cceb98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6809","nonce":369903047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6811","nonce":369903047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6815","nonce":369903047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6813","nonce":369903047}]},"public_addr":"172.21.15.144:6809/369903047","cluster_addr":"172.21.15.144:6811/369903047","heartbeat_back_addr":"172.21.15.144:6815/369903047","heartbeat_front_addr":"172.21.15.144:6813/369903047","state":["exists","up"]},{"osd":5,"uuid":"e4bcb224-662f-4530-b477-c0dd9c4ddbf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6801","nonce":2878111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6803","nonce":2878111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6807","nonce":2878111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6805","nonce":2878111293}]},"public_addr":"172.21.15.144:6801/2878111293","cluster_addr":"172.21.15.144:6803/2878111293","heartbeat_back_addr":"172.21.15.144:6807/2878111293","heartbeat_front_addr":"172.21.15.144:6805/2878111293","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:24.757990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.277795+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.290172+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.324594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:24.865136+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.020572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T09:07:38.506 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T09:07:38.507 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T09:07:38.507 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T09:07:38.508 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T09:07:38.508 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T09:07:38.508 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T09:07:38.662 INFO:teuthology.orchestra.run.smithi116.stdout:51539607557 2024-09-14T09:07:38.662 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T09:07:38.663 INFO:teuthology.orchestra.run.smithi116.stdout:51539607559 2024-09-14T09:07:38.663 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T09:07:38.705 INFO:teuthology.orchestra.run.smithi116.stdout:47244640261 2024-09-14T09:07:38.706 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T09:07:38.708 INFO:teuthology.orchestra.run.smithi116.stdout:51539607557 2024-09-14T09:07:38.709 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T09:07:38.712 INFO:teuthology.orchestra.run.smithi116.stdout:55834574853 2024-09-14T09:07:38.712 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T09:07:38.713 INFO:teuthology.orchestra.run.smithi116.stdout:55834574853 2024-09-14T09:07:38.713 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T09:07:39.079 INFO:teuthology.orchestra.run.smithi116.stdout:55834574852 2024-09-14T09:07:39.087 INFO:teuthology.orchestra.run.smithi116.stdout:51539607555 2024-09-14T09:07:39.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-09-14T09:07:39.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607555 for osd.5 2024-09-14T09:07:39.204 INFO:teuthology.orchestra.run.smithi116.stdout:51539607557 2024-09-14T09:07:39.217 INFO:teuthology.orchestra.run.smithi116.stdout:51539607555 2024-09-14T09:07:39.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607559 got 51539607557 for osd.4 2024-09-14T09:07:39.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607555 for osd.3 2024-09-14T09:07:39.241 INFO:teuthology.orchestra.run.smithi116.stdout:47244640259 2024-09-14T09:07:39.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640259 for osd.0 2024-09-14T09:07:39.267 INFO:teuthology.orchestra.run.smithi116.stdout:55834574853 2024-09-14T09:07:39.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-09-14T09:07:39.280 DEBUG:teuthology.parallel:result is None 2024-09-14T09:07:40.095 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T09:07:40.101 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T09:07:40.222 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T09:07:40.231 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T09:07:40.255 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T09:07:40.460 INFO:teuthology.orchestra.run.smithi116.stdout:55834574853 2024-09-14T09:07:40.467 INFO:teuthology.orchestra.run.smithi116.stdout:51539607557 2024-09-14T09:07:40.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2024-09-14T09:07:40.475 DEBUG:teuthology.parallel:result is None 2024-09-14T09:07:40.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607557 for osd.5 2024-09-14T09:07:40.486 DEBUG:teuthology.parallel:result is None 2024-09-14T09:07:40.544 INFO:teuthology.orchestra.run.smithi116.stdout:51539607559 2024-09-14T09:07:40.558 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607559 got 51539607559 for osd.4 2024-09-14T09:07:40.558 DEBUG:teuthology.parallel:result is None 2024-09-14T09:07:40.583 INFO:teuthology.orchestra.run.smithi116.stdout:47244640261 2024-09-14T09:07:40.595 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.0 2024-09-14T09:07:40.595 DEBUG:teuthology.parallel:result is None 2024-09-14T09:07:40.644 INFO:teuthology.orchestra.run.smithi116.stdout:51539607557 2024-09-14T09:07:40.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607557 for osd.3 2024-09-14T09:07:40.656 DEBUG:teuthology.parallel:result is None 2024-09-14T09:07:40.657 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T09:07:40.657 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T09:07:40.936 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:07:40.937 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T09:07:40.949 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-14T09:07:39.180295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":164456,"kb_used_data":2260,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566066584,"statfs":{"total":579820584960,"available":579652182016,"internally_reserved":0,"allocated":2314240,"data_stored":1554460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.937813"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.257097+0000","last_change":"2024-09-14T09:07:37.257097+0000","last_active":"2024-09-14T09:07:37.257097+0000","last_peered":"2024-09-14T09:07:37.257097+0000","last_clean":"2024-09-14T09:07:37.257097+0000","last_became_active":"2024-09-14T09:07:35.253071+0000","last_became_peered":"2024-09-14T09:07:35.253071+0000","last_unstale":"2024-09-14T09:07:37.257097+0000","last_undegraded":"2024-09-14T09:07:37.257097+0000","last_fullsized":"2024-09-14T09:07:37.257097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:27.094847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061552199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.256104+0000","last_change":"2024-09-14T09:07:37.256104+0000","last_active":"2024-09-14T09:07:37.256104+0000","last_peered":"2024-09-14T09:07:37.256104+0000","last_clean":"2024-09-14T09:07:37.256104+0000","last_became_active":"2024-09-14T09:07:35.253725+0000","last_became_peered":"2024-09-14T09:07:35.253725+0000","last_unstale":"2024-09-14T09:07:37.256104+0000","last_undegraded":"2024-09-14T09:07:37.256104+0000","last_fullsized":"2024-09-14T09:07:37.256104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:42.441599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042190199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.257178+0000","last_change":"2024-09-14T09:07:37.257178+0000","last_active":"2024-09-14T09:07:37.257178+0000","last_peered":"2024-09-14T09:07:37.257178+0000","last_clean":"2024-09-14T09:07:37.257178+0000","last_became_active":"2024-09-14T09:07:35.254147+0000","last_became_peered":"2024-09-14T09:07:35.254147+0000","last_unstale":"2024-09-14T09:07:37.257178+0000","last_undegraded":"2024-09-14T09:07:37.257178+0000","last_fullsized":"2024-09-14T09:07:37.257178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:39:27.498363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067899400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.992319+0000","last_change":"2024-09-14T09:07:37.992319+0000","last_active":"2024-09-14T09:07:37.992319+0000","last_peered":"2024-09-14T09:07:37.992319+0000","last_clean":"2024-09-14T09:07:37.992319+0000","last_became_active":"2024-09-14T09:07:35.254014+0000","last_became_peered":"2024-09-14T09:07:35.254014+0000","last_unstale":"2024-09-14T09:07:37.992319+0000","last_undegraded":"2024-09-14T09:07:37.992319+0000","last_fullsized":"2024-09-14T09:07:37.992319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:17:16.263680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047858699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.260986+0000","last_change":"2024-09-14T09:07:37.260986+0000","last_active":"2024-09-14T09:07:37.260986+0000","last_peered":"2024-09-14T09:07:37.260986+0000","last_clean":"2024-09-14T09:07:37.260986+0000","last_became_active":"2024-09-14T09:07:35.254256+0000","last_became_peered":"2024-09-14T09:07:35.254256+0000","last_unstale":"2024-09-14T09:07:37.260986+0000","last_undegraded":"2024-09-14T09:07:37.260986+0000","last_fullsized":"2024-09-14T09:07:37.260986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:07.063058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096898500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:38.337784+0000","last_change":"2024-09-14T09:07:38.337974+0000","last_active":"2024-09-14T09:07:38.337784+0000","last_peered":"2024-09-14T09:07:38.337784+0000","last_clean":"2024-09-14T09:07:38.337784+0000","last_became_active":"2024-09-14T09:07:35.254931+0000","last_became_peered":"2024-09-14T09:07:35.254931+0000","last_unstale":"2024-09-14T09:07:38.337784+0000","last_undegraded":"2024-09-14T09:07:38.337784+0000","last_fullsized":"2024-09-14T09:07:38.337784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:28.082506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038920099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.369655+0000","last_change":"2024-09-14T09:07:37.369655+0000","last_active":"2024-09-14T09:07:37.369655+0000","last_peered":"2024-09-14T09:07:37.369655+0000","last_clean":"2024-09-14T09:07:37.369655+0000","last_became_active":"2024-09-14T09:07:35.254080+0000","last_became_peered":"2024-09-14T09:07:35.254080+0000","last_unstale":"2024-09-14T09:07:37.369655+0000","last_undegraded":"2024-09-14T09:07:37.369655+0000","last_fullsized":"2024-09-14T09:07:37.369655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:06.212888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000375058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.257430+0000","last_change":"2024-09-14T09:07:37.257430+0000","last_active":"2024-09-14T09:07:37.257430+0000","last_peered":"2024-09-14T09:07:37.257430+0000","last_clean":"2024-09-14T09:07:37.257430+0000","last_became_active":"2024-09-14T09:07:35.253253+0000","last_became_peered":"2024-09-14T09:07:35.253253+0000","last_unstale":"2024-09-14T09:07:37.257430+0000","last_undegraded":"2024-09-14T09:07:37.257430+0000","last_fullsized":"2024-09-14T09:07:37.257430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:33.799033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094749299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.256384+0000","last_change":"2024-09-14T09:07:30.953383+0000","last_active":"2024-09-14T09:07:37.256384+0000","last_peered":"2024-09-14T09:07:37.256384+0000","last_clean":"2024-09-14T09:07:37.256384+0000","last_became_active":"2024-09-14T09:07:30.952238+0000","last_became_peered":"2024-09-14T09:07:30.952238+0000","last_unstale":"2024-09-14T09:07:37.256384+0000","last_undegraded":"2024-09-14T09:07:37.256384+0000","last_fullsized":"2024-09-14T09:07:37.256384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_clean_scrub_stamp":"2024-09-14T09:07:29.211432+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:30.453453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":188416,"data_stored":63109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":782336,"data_stored":653477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607557,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":770048,"data_stored":648509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607559,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":192512,"data_stored":63128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607557,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":188416,"data_stored":63109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":192512,"data_stored":63128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T09:07:40.950 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T09:07:41.227 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:07:41.227 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T09:07:41.239 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-14T09:07:41.180850+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":164456,"kb_used_data":2260,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566066584,"statfs":{"total":579820584960,"available":579652182016,"internally_reserved":0,"allocated":2314240,"data_stored":1554460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001586"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.257097+0000","last_change":"2024-09-14T09:07:37.257097+0000","last_active":"2024-09-14T09:07:37.257097+0000","last_peered":"2024-09-14T09:07:37.257097+0000","last_clean":"2024-09-14T09:07:37.257097+0000","last_became_active":"2024-09-14T09:07:35.253071+0000","last_became_peered":"2024-09-14T09:07:35.253071+0000","last_unstale":"2024-09-14T09:07:37.257097+0000","last_undegraded":"2024-09-14T09:07:37.257097+0000","last_fullsized":"2024-09-14T09:07:37.257097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:27.094847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061552199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.256104+0000","last_change":"2024-09-14T09:07:37.256104+0000","last_active":"2024-09-14T09:07:37.256104+0000","last_peered":"2024-09-14T09:07:37.256104+0000","last_clean":"2024-09-14T09:07:37.256104+0000","last_became_active":"2024-09-14T09:07:35.253725+0000","last_became_peered":"2024-09-14T09:07:35.253725+0000","last_unstale":"2024-09-14T09:07:37.256104+0000","last_undegraded":"2024-09-14T09:07:37.256104+0000","last_fullsized":"2024-09-14T09:07:37.256104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:42.441599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042190199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.257178+0000","last_change":"2024-09-14T09:07:37.257178+0000","last_active":"2024-09-14T09:07:37.257178+0000","last_peered":"2024-09-14T09:07:37.257178+0000","last_clean":"2024-09-14T09:07:37.257178+0000","last_became_active":"2024-09-14T09:07:35.254147+0000","last_became_peered":"2024-09-14T09:07:35.254147+0000","last_unstale":"2024-09-14T09:07:37.257178+0000","last_undegraded":"2024-09-14T09:07:37.257178+0000","last_fullsized":"2024-09-14T09:07:37.257178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:39:27.498363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067899400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.992319+0000","last_change":"2024-09-14T09:07:37.992319+0000","last_active":"2024-09-14T09:07:37.992319+0000","last_peered":"2024-09-14T09:07:37.992319+0000","last_clean":"2024-09-14T09:07:37.992319+0000","last_became_active":"2024-09-14T09:07:35.254014+0000","last_became_peered":"2024-09-14T09:07:35.254014+0000","last_unstale":"2024-09-14T09:07:37.992319+0000","last_undegraded":"2024-09-14T09:07:37.992319+0000","last_fullsized":"2024-09-14T09:07:37.992319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:17:16.263680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047858699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.260986+0000","last_change":"2024-09-14T09:07:37.260986+0000","last_active":"2024-09-14T09:07:37.260986+0000","last_peered":"2024-09-14T09:07:37.260986+0000","last_clean":"2024-09-14T09:07:37.260986+0000","last_became_active":"2024-09-14T09:07:35.254256+0000","last_became_peered":"2024-09-14T09:07:35.254256+0000","last_unstale":"2024-09-14T09:07:37.260986+0000","last_undegraded":"2024-09-14T09:07:37.260986+0000","last_fullsized":"2024-09-14T09:07:37.260986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:07.063058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096898500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:38.337784+0000","last_change":"2024-09-14T09:07:38.337974+0000","last_active":"2024-09-14T09:07:38.337784+0000","last_peered":"2024-09-14T09:07:38.337784+0000","last_clean":"2024-09-14T09:07:38.337784+0000","last_became_active":"2024-09-14T09:07:35.254931+0000","last_became_peered":"2024-09-14T09:07:35.254931+0000","last_unstale":"2024-09-14T09:07:38.337784+0000","last_undegraded":"2024-09-14T09:07:38.337784+0000","last_fullsized":"2024-09-14T09:07:38.337784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:28.082506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038920099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.369655+0000","last_change":"2024-09-14T09:07:37.369655+0000","last_active":"2024-09-14T09:07:37.369655+0000","last_peered":"2024-09-14T09:07:37.369655+0000","last_clean":"2024-09-14T09:07:37.369655+0000","last_became_active":"2024-09-14T09:07:35.254080+0000","last_became_peered":"2024-09-14T09:07:35.254080+0000","last_unstale":"2024-09-14T09:07:37.369655+0000","last_undegraded":"2024-09-14T09:07:37.369655+0000","last_fullsized":"2024-09-14T09:07:37.369655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:06.212888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000375058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.257430+0000","last_change":"2024-09-14T09:07:37.257430+0000","last_active":"2024-09-14T09:07:37.257430+0000","last_peered":"2024-09-14T09:07:37.257430+0000","last_clean":"2024-09-14T09:07:37.257430+0000","last_became_active":"2024-09-14T09:07:35.253253+0000","last_became_peered":"2024-09-14T09:07:35.253253+0000","last_unstale":"2024-09-14T09:07:37.257430+0000","last_undegraded":"2024-09-14T09:07:37.257430+0000","last_fullsized":"2024-09-14T09:07:37.257430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:33.799033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094749299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.256384+0000","last_change":"2024-09-14T09:07:30.953383+0000","last_active":"2024-09-14T09:07:37.256384+0000","last_peered":"2024-09-14T09:07:37.256384+0000","last_clean":"2024-09-14T09:07:37.256384+0000","last_became_active":"2024-09-14T09:07:30.952238+0000","last_became_peered":"2024-09-14T09:07:30.952238+0000","last_unstale":"2024-09-14T09:07:37.256384+0000","last_undegraded":"2024-09-14T09:07:37.256384+0000","last_fullsized":"2024-09-14T09:07:37.256384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_clean_scrub_stamp":"2024-09-14T09:07:29.211432+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:30.453453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":188416,"data_stored":63109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":782336,"data_stored":653477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607557,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":770048,"data_stored":648509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607559,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":192512,"data_stored":63128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607557,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":188416,"data_stored":63109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":192512,"data_stored":63128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T09:07:41.240 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T09:07:41.240 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-14T09:07:41.240 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-14T09:07:41.241 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-14T09:07:41.555 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:07:41.555 INFO:teuthology.orchestra.run.smithi116.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-14T09:07:41.568 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-14T09:07:41.568 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-14T09:07:41.579 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-14T09:07:41.579 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'extra_packages': ['rbd-nbd'], 'flavor': 'default', 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}} 2024-09-14T09:07:41.579 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-14T09:07:41.580 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-14T09:07:41.885 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-14T09:07:41.885 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T09:07:41.885 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T09:07:42.163 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:07:42.164 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T09:07:42.175 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-14T09:07:41.776158+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":164456,"kb_used_data":2260,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566066584,"statfs":{"total":579820584960,"available":579652182016,"internally_reserved":0,"allocated":2314240,"data_stored":1554460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.529912"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.257097+0000","last_change":"2024-09-14T09:07:37.257097+0000","last_active":"2024-09-14T09:07:37.257097+0000","last_peered":"2024-09-14T09:07:37.257097+0000","last_clean":"2024-09-14T09:07:37.257097+0000","last_became_active":"2024-09-14T09:07:35.253071+0000","last_became_peered":"2024-09-14T09:07:35.253071+0000","last_unstale":"2024-09-14T09:07:37.257097+0000","last_undegraded":"2024-09-14T09:07:37.257097+0000","last_fullsized":"2024-09-14T09:07:37.257097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:27.094847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061552199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.256104+0000","last_change":"2024-09-14T09:07:37.256104+0000","last_active":"2024-09-14T09:07:37.256104+0000","last_peered":"2024-09-14T09:07:37.256104+0000","last_clean":"2024-09-14T09:07:37.256104+0000","last_became_active":"2024-09-14T09:07:35.253725+0000","last_became_peered":"2024-09-14T09:07:35.253725+0000","last_unstale":"2024-09-14T09:07:37.256104+0000","last_undegraded":"2024-09-14T09:07:37.256104+0000","last_fullsized":"2024-09-14T09:07:37.256104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:42.441599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042190199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.257178+0000","last_change":"2024-09-14T09:07:37.257178+0000","last_active":"2024-09-14T09:07:37.257178+0000","last_peered":"2024-09-14T09:07:37.257178+0000","last_clean":"2024-09-14T09:07:37.257178+0000","last_became_active":"2024-09-14T09:07:35.254147+0000","last_became_peered":"2024-09-14T09:07:35.254147+0000","last_unstale":"2024-09-14T09:07:37.257178+0000","last_undegraded":"2024-09-14T09:07:37.257178+0000","last_fullsized":"2024-09-14T09:07:37.257178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:39:27.498363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067899400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.992319+0000","last_change":"2024-09-14T09:07:37.992319+0000","last_active":"2024-09-14T09:07:37.992319+0000","last_peered":"2024-09-14T09:07:37.992319+0000","last_clean":"2024-09-14T09:07:37.992319+0000","last_became_active":"2024-09-14T09:07:35.254014+0000","last_became_peered":"2024-09-14T09:07:35.254014+0000","last_unstale":"2024-09-14T09:07:37.992319+0000","last_undegraded":"2024-09-14T09:07:37.992319+0000","last_fullsized":"2024-09-14T09:07:37.992319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:17:16.263680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047858699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.260986+0000","last_change":"2024-09-14T09:07:37.260986+0000","last_active":"2024-09-14T09:07:37.260986+0000","last_peered":"2024-09-14T09:07:37.260986+0000","last_clean":"2024-09-14T09:07:37.260986+0000","last_became_active":"2024-09-14T09:07:35.254256+0000","last_became_peered":"2024-09-14T09:07:35.254256+0000","last_unstale":"2024-09-14T09:07:37.260986+0000","last_undegraded":"2024-09-14T09:07:37.260986+0000","last_fullsized":"2024-09-14T09:07:37.260986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:07.063058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096898500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:38.337784+0000","last_change":"2024-09-14T09:07:38.337974+0000","last_active":"2024-09-14T09:07:38.337784+0000","last_peered":"2024-09-14T09:07:38.337784+0000","last_clean":"2024-09-14T09:07:38.337784+0000","last_became_active":"2024-09-14T09:07:35.254931+0000","last_became_peered":"2024-09-14T09:07:35.254931+0000","last_unstale":"2024-09-14T09:07:38.337784+0000","last_undegraded":"2024-09-14T09:07:38.337784+0000","last_fullsized":"2024-09-14T09:07:38.337784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:28.082506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038920099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.369655+0000","last_change":"2024-09-14T09:07:37.369655+0000","last_active":"2024-09-14T09:07:37.369655+0000","last_peered":"2024-09-14T09:07:37.369655+0000","last_clean":"2024-09-14T09:07:37.369655+0000","last_became_active":"2024-09-14T09:07:35.254080+0000","last_became_peered":"2024-09-14T09:07:35.254080+0000","last_unstale":"2024-09-14T09:07:37.369655+0000","last_undegraded":"2024-09-14T09:07:37.369655+0000","last_fullsized":"2024-09-14T09:07:37.369655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:06.212888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000375058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.257430+0000","last_change":"2024-09-14T09:07:37.257430+0000","last_active":"2024-09-14T09:07:37.257430+0000","last_peered":"2024-09-14T09:07:37.257430+0000","last_clean":"2024-09-14T09:07:37.257430+0000","last_became_active":"2024-09-14T09:07:35.253253+0000","last_became_peered":"2024-09-14T09:07:35.253253+0000","last_unstale":"2024-09-14T09:07:37.257430+0000","last_undegraded":"2024-09-14T09:07:37.257430+0000","last_fullsized":"2024-09-14T09:07:37.257430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:33.799033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094749299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.256384+0000","last_change":"2024-09-14T09:07:30.953383+0000","last_active":"2024-09-14T09:07:37.256384+0000","last_peered":"2024-09-14T09:07:37.256384+0000","last_clean":"2024-09-14T09:07:37.256384+0000","last_became_active":"2024-09-14T09:07:30.952238+0000","last_became_peered":"2024-09-14T09:07:30.952238+0000","last_unstale":"2024-09-14T09:07:37.256384+0000","last_undegraded":"2024-09-14T09:07:37.256384+0000","last_fullsized":"2024-09-14T09:07:37.256384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_clean_scrub_stamp":"2024-09-14T09:07:29.211432+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:30.453453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":188416,"data_stored":63109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":782336,"data_stored":653477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607557,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":770048,"data_stored":648509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607559,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":192512,"data_stored":63128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607557,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":188416,"data_stored":63109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":192512,"data_stored":63128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T09:07:42.176 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T09:07:42.460 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:07:42.460 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T09:07:42.472 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-14T09:07:41.776158+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":164456,"kb_used_data":2260,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566066584,"statfs":{"total":579820584960,"available":579652182016,"internally_reserved":0,"allocated":2314240,"data_stored":1554460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.529912"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.257097+0000","last_change":"2024-09-14T09:07:37.257097+0000","last_active":"2024-09-14T09:07:37.257097+0000","last_peered":"2024-09-14T09:07:37.257097+0000","last_clean":"2024-09-14T09:07:37.257097+0000","last_became_active":"2024-09-14T09:07:35.253071+0000","last_became_peered":"2024-09-14T09:07:35.253071+0000","last_unstale":"2024-09-14T09:07:37.257097+0000","last_undegraded":"2024-09-14T09:07:37.257097+0000","last_fullsized":"2024-09-14T09:07:37.257097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:27.094847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061552199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.256104+0000","last_change":"2024-09-14T09:07:37.256104+0000","last_active":"2024-09-14T09:07:37.256104+0000","last_peered":"2024-09-14T09:07:37.256104+0000","last_clean":"2024-09-14T09:07:37.256104+0000","last_became_active":"2024-09-14T09:07:35.253725+0000","last_became_peered":"2024-09-14T09:07:35.253725+0000","last_unstale":"2024-09-14T09:07:37.256104+0000","last_undegraded":"2024-09-14T09:07:37.256104+0000","last_fullsized":"2024-09-14T09:07:37.256104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:42.441599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042190199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.257178+0000","last_change":"2024-09-14T09:07:37.257178+0000","last_active":"2024-09-14T09:07:37.257178+0000","last_peered":"2024-09-14T09:07:37.257178+0000","last_clean":"2024-09-14T09:07:37.257178+0000","last_became_active":"2024-09-14T09:07:35.254147+0000","last_became_peered":"2024-09-14T09:07:35.254147+0000","last_unstale":"2024-09-14T09:07:37.257178+0000","last_undegraded":"2024-09-14T09:07:37.257178+0000","last_fullsized":"2024-09-14T09:07:37.257178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:39:27.498363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067899400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.992319+0000","last_change":"2024-09-14T09:07:37.992319+0000","last_active":"2024-09-14T09:07:37.992319+0000","last_peered":"2024-09-14T09:07:37.992319+0000","last_clean":"2024-09-14T09:07:37.992319+0000","last_became_active":"2024-09-14T09:07:35.254014+0000","last_became_peered":"2024-09-14T09:07:35.254014+0000","last_unstale":"2024-09-14T09:07:37.992319+0000","last_undegraded":"2024-09-14T09:07:37.992319+0000","last_fullsized":"2024-09-14T09:07:37.992319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:17:16.263680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047858699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.260986+0000","last_change":"2024-09-14T09:07:37.260986+0000","last_active":"2024-09-14T09:07:37.260986+0000","last_peered":"2024-09-14T09:07:37.260986+0000","last_clean":"2024-09-14T09:07:37.260986+0000","last_became_active":"2024-09-14T09:07:35.254256+0000","last_became_peered":"2024-09-14T09:07:35.254256+0000","last_unstale":"2024-09-14T09:07:37.260986+0000","last_undegraded":"2024-09-14T09:07:37.260986+0000","last_fullsized":"2024-09-14T09:07:37.260986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:07.063058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096898500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:38.337784+0000","last_change":"2024-09-14T09:07:38.337974+0000","last_active":"2024-09-14T09:07:38.337784+0000","last_peered":"2024-09-14T09:07:38.337784+0000","last_clean":"2024-09-14T09:07:38.337784+0000","last_became_active":"2024-09-14T09:07:35.254931+0000","last_became_peered":"2024-09-14T09:07:35.254931+0000","last_unstale":"2024-09-14T09:07:38.337784+0000","last_undegraded":"2024-09-14T09:07:38.337784+0000","last_fullsized":"2024-09-14T09:07:38.337784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:28.082506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038920099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.369655+0000","last_change":"2024-09-14T09:07:37.369655+0000","last_active":"2024-09-14T09:07:37.369655+0000","last_peered":"2024-09-14T09:07:37.369655+0000","last_clean":"2024-09-14T09:07:37.369655+0000","last_became_active":"2024-09-14T09:07:35.254080+0000","last_became_peered":"2024-09-14T09:07:35.254080+0000","last_unstale":"2024-09-14T09:07:37.369655+0000","last_undegraded":"2024-09-14T09:07:37.369655+0000","last_fullsized":"2024-09-14T09:07:37.369655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:06.212888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000375058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.257430+0000","last_change":"2024-09-14T09:07:37.257430+0000","last_active":"2024-09-14T09:07:37.257430+0000","last_peered":"2024-09-14T09:07:37.257430+0000","last_clean":"2024-09-14T09:07:37.257430+0000","last_became_active":"2024-09-14T09:07:35.253253+0000","last_became_peered":"2024-09-14T09:07:35.253253+0000","last_unstale":"2024-09-14T09:07:37.257430+0000","last_undegraded":"2024-09-14T09:07:37.257430+0000","last_fullsized":"2024-09-14T09:07:37.257430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:33.799033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094749299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T09:07:37.256384+0000","last_change":"2024-09-14T09:07:30.953383+0000","last_active":"2024-09-14T09:07:37.256384+0000","last_peered":"2024-09-14T09:07:37.256384+0000","last_clean":"2024-09-14T09:07:37.256384+0000","last_became_active":"2024-09-14T09:07:30.952238+0000","last_became_peered":"2024-09-14T09:07:30.952238+0000","last_unstale":"2024-09-14T09:07:37.256384+0000","last_undegraded":"2024-09-14T09:07:37.256384+0000","last_fullsized":"2024-09-14T09:07:37.256384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_clean_scrub_stamp":"2024-09-14T09:07:29.211432+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:30.453453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":188416,"data_stored":63109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":782336,"data_stored":653477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607557,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":770048,"data_stored":648509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607559,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":192512,"data_stored":63128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607557,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":188416,"data_stored":63109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":192512,"data_stored":63128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T09:07:42.473 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T09:07:42.473 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-14T09:07:42.753 INFO:teuthology.orchestra.run.smithi116.stdout:epoch 21 2024-09-14T09:07:42.753 INFO:teuthology.orchestra.run.smithi116.stdout:fsid c991ac1c-978d-48b3-a540-4d3d4755e125 2024-09-14T09:07:42.753 INFO:teuthology.orchestra.run.smithi116.stdout:created 2024-09-14T09:07:16.982473+0000 2024-09-14T09:07:42.753 INFO:teuthology.orchestra.run.smithi116.stdout:modified 2024-09-14T09:07:41.772828+0000 2024-09-14T09:07:42.753 INFO:teuthology.orchestra.run.smithi116.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-14T09:07:42.753 INFO:teuthology.orchestra.run.smithi116.stdout:crush_version 5 2024-09-14T09:07:42.753 INFO:teuthology.orchestra.run.smithi116.stdout:full_ratio 0.95 2024-09-14T09:07:42.753 INFO:teuthology.orchestra.run.smithi116.stdout:backfillfull_ratio 0.9 2024-09-14T09:07:42.753 INFO:teuthology.orchestra.run.smithi116.stdout:nearfull_ratio 0.85 2024-09-14T09:07:42.753 INFO:teuthology.orchestra.run.smithi116.stdout:require_min_compat_client luminous 2024-09-14T09:07:42.754 INFO:teuthology.orchestra.run.smithi116.stdout:min_compat_client jewel 2024-09-14T09:07:42.754 INFO:teuthology.orchestra.run.smithi116.stdout:require_osd_release squid 2024-09-14T09:07:42.754 INFO:teuthology.orchestra.run.smithi116.stdout:stretch_mode_enabled false 2024-09-14T09:07:42.754 INFO:teuthology.orchestra.run.smithi116.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 6.06 2024-09-14T09:07:42.754 INFO:teuthology.orchestra.run.smithi116.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 20 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 2.25 2024-09-14T09:07:42.754 INFO:teuthology.orchestra.run.smithi116.stdout:max_osd 6 2024-09-14T09:07:42.754 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0 up in weight 1 up_from 11 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6816/1856142608,v1:172.21.15.116:6817/1856142608] [v2:172.21.15.116:6818/1856142608,v1:172.21.15.116:6819/1856142608] exists,up b3c13086-1183-454b-8e62-3aec9b69cdf5 2024-09-14T09:07:42.754 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6800/3469105275,v1:172.21.15.116:6801/3469105275] [v2:172.21.15.116:6802/3469105275,v1:172.21.15.116:6803/3469105275] exists,up 8ee6a373-9d0d-4cd2-96f4-9673de96f546 2024-09-14T09:07:42.754 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6808/2660214336,v1:172.21.15.116:6809/2660214336] [v2:172.21.15.116:6810/2660214336,v1:172.21.15.116:6811/2660214336] exists,up 958a9363-d751-49c3-9ec7-7330d377ee53 2024-09-14T09:07:42.754 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3 up in weight 1 up_from 12 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6816/2855061278,v1:172.21.15.144:6817/2855061278] [v2:172.21.15.144:6818/2855061278,v1:172.21.15.144:6819/2855061278] exists,up 7fafd519-b2e9-498c-a409-f55cfe45a51a 2024-09-14T09:07:42.754 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4 up in weight 1 up_from 12 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6808/369903047,v1:172.21.15.144:6809/369903047] [v2:172.21.15.144:6810/369903047,v1:172.21.15.144:6811/369903047] exists,up 63d99552-5fea-4367-bf86-0addc8cceb98 2024-09-14T09:07:42.754 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5 up in weight 1 up_from 12 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6800/2878111293,v1:172.21.15.144:6801/2878111293] [v2:172.21.15.144:6802/2878111293,v1:172.21.15.144:6803/2878111293] exists,up e4bcb224-662f-4530-b477-c0dd9c4ddbf4 2024-09-14T09:07:42.765 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 11 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6816/1856142608,v1:172.21.15.116:6817/1856142608] [v2:172.21.15.116:6818/1856142608,v1:172.21.15.116:6819/1856142608] exists,up b3c13086-1183-454b-8e62-3aec9b69cdf5', 'osd.1 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6800/3469105275,v1:172.21.15.116:6801/3469105275] [v2:172.21.15.116:6802/3469105275,v1:172.21.15.116:6803/3469105275] exists,up 8ee6a373-9d0d-4cd2-96f4-9673de96f546', 'osd.2 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6808/2660214336,v1:172.21.15.116:6809/2660214336] [v2:172.21.15.116:6810/2660214336,v1:172.21.15.116:6811/2660214336] exists,up 958a9363-d751-49c3-9ec7-7330d377ee53', 'osd.3 up in weight 1 up_from 12 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6816/2855061278,v1:172.21.15.144:6817/2855061278] [v2:172.21.15.144:6818/2855061278,v1:172.21.15.144:6819/2855061278] exists,up 7fafd519-b2e9-498c-a409-f55cfe45a51a', 'osd.4 up in weight 1 up_from 12 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6808/369903047,v1:172.21.15.144:6809/369903047] [v2:172.21.15.144:6810/369903047,v1:172.21.15.144:6811/369903047] exists,up 63d99552-5fea-4367-bf86-0addc8cceb98', 'osd.5 up in weight 1 up_from 12 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6800/2878111293,v1:172.21.15.144:6801/2878111293] [v2:172.21.15.144:6802/2878111293,v1:172.21.15.144:6803/2878111293] exists,up e4bcb224-662f-4530-b477-c0dd9c4ddbf4'] 2024-09-14T09:07:42.766 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-14T09:07:42.864 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:42.864 INFO:teuthology.orchestra.run.smithi116.stdout: "name": "mon.a", 2024-09-14T09:07:42.864 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster": "ceph", 2024-09-14T09:07:42.864 INFO:teuthology.orchestra.run.smithi116.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-14T09:07:42.864 INFO:teuthology.orchestra.run.smithi116.stdout: "admin_socket_mode": "", 2024-09-14T09:07:42.864 INFO:teuthology.orchestra.run.smithi116.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-14T09:07:42.864 INFO:teuthology.orchestra.run.smithi116.stdout: "auth_client_required": "cephx, none", 2024-09-14T09:07:42.864 INFO:teuthology.orchestra.run.smithi116.stdout: "auth_cluster_required": "cephx", 2024-09-14T09:07:42.864 INFO:teuthology.orchestra.run.smithi116.stdout: "auth_debug": "true", 2024-09-14T09:07:42.865 INFO:teuthology.orchestra.run.smithi116.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-14T09:07:42.865 INFO:teuthology.orchestra.run.smithi116.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-14T09:07:42.865 INFO:teuthology.orchestra.run.smithi116.stdout: "auth_service_required": "cephx", 2024-09-14T09:07:42.865 INFO:teuthology.orchestra.run.smithi116.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-14T09:07:42.865 INFO:teuthology.orchestra.run.smithi116.stdout: "auth_supported": "cephx", 2024-09-14T09:07:42.865 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_aio": "true", 2024-09-14T09:07:42.865 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-14T09:07:42.865 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_aio_poll_ms": "250", 2024-09-14T09:07:42.865 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_aio_reap_max": "16", 2024-09-14T09:07:42.865 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_async_discard_threads": "0", 2024-09-14T09:07:42.865 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_block_size": "4096", 2024-09-14T09:07:42.865 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_debug_aio": "false", 2024-09-14T09:07:42.865 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-14T09:07:42.866 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-14T09:07:42.866 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_debug_inflight_ios": "false", 2024-09-14T09:07:42.866 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_enable_discard": "false", 2024-09-14T09:07:42.866 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_flock_retry": "3", 2024-09-14T09:07:42.866 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-14T09:07:42.866 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_inject_crash": "0", 2024-09-14T09:07:42.866 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-14T09:07:42.866 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_ioring": "false", 2024-09-14T09:07:42.866 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_ioring_hipri": "false", 2024-09-14T09:07:42.866 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-14T09:07:42.866 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-14T09:07:42.866 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-14T09:07:42.866 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-14T09:07:42.866 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-14T09:07:42.867 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-14T09:07:42.867 INFO:teuthology.orchestra.run.smithi116.stdout: "bdev_type": "", 2024-09-14T09:07:42.867 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_alloc_size": "1048576", 2024-09-14T09:07:42.867 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_allocator": "hybrid", 2024-09-14T09:07:42.867 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_buffered_io": "true", 2024-09-14T09:07:42.867 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_check_for_zeros": "false", 2024-09-14T09:07:42.867 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-14T09:07:42.867 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-14T09:07:42.867 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_compact_log_sync": "false", 2024-09-14T09:07:42.867 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-14T09:07:42.867 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-14T09:07:42.867 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-14T09:07:42.867 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-14T09:07:42.867 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_max_log_runway": "4194304", 2024-09-14T09:07:42.868 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_max_prefetch": "1048576", 2024-09-14T09:07:42.868 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_min_flush_size": "524288", 2024-09-14T09:07:42.868 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_min_log_runway": "1048576", 2024-09-14T09:07:42.868 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_replay_recovery": "false", 2024-09-14T09:07:42.868 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-14T09:07:42.868 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-14T09:07:42.868 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_sync_write": "false", 2024-09-14T09:07:42.868 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-14T09:07:42.868 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-14T09:07:42.868 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-14T09:07:42.868 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_allocation_from_file": "true", 2024-09-14T09:07:42.868 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_allocator": "hybrid", 2024-09-14T09:07:42.869 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_async_db_compaction": "true", 2024-09-14T09:07:42.869 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-14T09:07:42.869 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-14T09:07:42.869 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-14T09:07:42.869 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-14T09:07:42.869 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_bdev_label_multi": "true", 2024-09-14T09:07:42.869 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-14T09:07:42.869 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-14T09:07:42.869 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-14T09:07:42.869 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-14T09:07:42.869 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-14T09:07:42.869 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_block_create": "true", 2024-09-14T09:07:42.869 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_block_db_create": "false", 2024-09-14T09:07:42.869 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_block_db_path": "", 2024-09-14T09:07:42.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_block_db_size": "0", 2024-09-14T09:07:42.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_block_path": "", 2024-09-14T09:07:42.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_block_preallocate_file": "false", 2024-09-14T09:07:42.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_block_size": "107374182400", 2024-09-14T09:07:42.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_block_wal_create": "false", 2024-09-14T09:07:42.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_block_wal_path": "", 2024-09-14T09:07:42.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_block_wal_size": "100663296", 2024-09-14T09:07:42.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_bluefs": "true", 2024-09-14T09:07:42.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-14T09:07:42.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-14T09:07:42.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-14T09:07:42.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-14T09:07:42.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-14T09:07:42.870 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-14T09:07:42.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-14T09:07:42.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-14T09:07:42.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-14T09:07:42.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_autotune": "true", 2024-09-14T09:07:42.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-14T09:07:42.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-14T09:07:42.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-14T09:07:42.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-14T09:07:42.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_size": "0", 2024-09-14T09:07:42.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-14T09:07:42.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-14T09:07:42.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-14T09:07:42.871 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-14T09:07:42.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_type": "2q", 2024-09-14T09:07:42.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-14T09:07:42.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_clone_cow": "true", 2024-09-14T09:07:42.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-14T09:07:42.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-14T09:07:42.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-14T09:07:42.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-14T09:07:42.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-14T09:07:42.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-14T09:07:42.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-14T09:07:42.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_compression_mode": "none", 2024-09-14T09:07:42.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-14T09:07:42.872 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_csum_type": "crc32c", 2024-09-14T09:07:42.873 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-14T09:07:42.873 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-14T09:07:42.873 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_debug_freelist": "false", 2024-09-14T09:07:42.873 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-14T09:07:42.873 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-14T09:07:42.873 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-14T09:07:42.873 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-14T09:07:42.873 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-14T09:07:42.873 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-14T09:07:42.873 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-14T09:07:42.873 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-14T09:07:42.873 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-14T09:07:42.873 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-14T09:07:42.874 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-14T09:07:42.874 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-14T09:07:42.874 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_debug_small_allocations": "0", 2024-09-14T09:07:42.874 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-14T09:07:42.874 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_default_buffered_read": "true", 2024-09-14T09:07:42.874 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_default_buffered_write": "false", 2024-09-14T09:07:42.874 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-14T09:07:42.874 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-14T09:07:42.874 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-14T09:07:42.874 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-14T09:07:42.874 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-14T09:07:42.874 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-14T09:07:42.874 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-14T09:07:42.874 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-14T09:07:42.875 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-14T09:07:42.875 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fail_eio": "false", 2024-09-14T09:07:42.875 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-14T09:07:42.875 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-14T09:07:42.875 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-14T09:07:42.875 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-14T09:07:42.875 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-14T09:07:42.875 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-14T09:07:42.875 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_on_mount": "false", 2024-09-14T09:07:42.875 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-14T09:07:42.875 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_on_umount": "false", 2024-09-14T09:07:42.875 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-14T09:07:42.875 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-14T09:07:42.875 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-14T09:07:42.876 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-14T09:07:42.876 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-14T09:07:42.876 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-14T09:07:42.876 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-14T09:07:42.876 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-14T09:07:42.876 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_ignore_data_csum": "false", 2024-09-14T09:07:42.876 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-14T09:07:42.876 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-14T09:07:42.876 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-14T09:07:42.876 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-14T09:07:42.876 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_log_op_age": "5.000000", 2024-09-14T09:07:42.876 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_max_alloc_size": "0", 2024-09-14T09:07:42.876 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_max_blob_size": "0", 2024-09-14T09:07:42.877 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-14T09:07:42.877 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-14T09:07:42.877 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-14T09:07:42.877 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_max_deferred_txc": "32", 2024-09-14T09:07:42.877 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_min_alloc_size": "0", 2024-09-14T09:07:42.877 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-14T09:07:42.877 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-14T09:07:42.877 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_nid_prealloc": "1024", 2024-09-14T09:07:42.877 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-14T09:07:42.877 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-14T09:07:42.877 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-14T09:07:42.877 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-14T09:07:42.877 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_retry_disk_reads": "3", 2024-09-14T09:07:42.877 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_rocksdb_cf": "true", 2024-09-14T09:07:42.878 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-14T09:07:42.878 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-14T09:07:42.878 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-14T09:07:42.878 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-14T09:07:42.878 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-14T09:07:42.878 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-14T09:07:42.878 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-14T09:07:42.878 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-14T09:07:42.878 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_spdk_mem": "512", 2024-09-14T09:07:42.878 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-14T09:07:42.878 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-14T09:07:42.878 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-14T09:07:42.878 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-14T09:07:42.879 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-14T09:07:42.879 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-14T09:07:42.879 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-14T09:07:42.879 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_tracing": "false", 2024-09-14T09:07:42.879 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-14T09:07:42.879 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-14T09:07:42.879 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-14T09:07:42.879 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-14T09:07:42.879 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-14T09:07:42.879 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-14T09:07:42.879 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-14T09:07:42.879 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-14T09:07:42.879 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-14T09:07:42.879 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_write_v2": "false", 2024-09-14T09:07:42.880 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_write_v2_random": "false", 2024-09-14T09:07:42.880 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_zero_block_detection": "false", 2024-09-14T09:07:42.880 INFO:teuthology.orchestra.run.smithi116.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-14T09:07:42.880 INFO:teuthology.orchestra.run.smithi116.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-14T09:07:42.880 INFO:teuthology.orchestra.run.smithi116.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-14T09:07:42.880 INFO:teuthology.orchestra.run.smithi116.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-14T09:07:42.880 INFO:teuthology.orchestra.run.smithi116.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-14T09:07:42.880 INFO:teuthology.orchestra.run.smithi116.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-14T09:07:42.880 INFO:teuthology.orchestra.run.smithi116.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-14T09:07:42.880 INFO:teuthology.orchestra.run.smithi116.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-14T09:07:42.880 INFO:teuthology.orchestra.run.smithi116.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-14T09:07:42.880 INFO:teuthology.orchestra.run.smithi116.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-14T09:07:42.881 INFO:teuthology.orchestra.run.smithi116.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-14T09:07:42.881 INFO:teuthology.orchestra.run.smithi116.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-14T09:07:42.881 INFO:teuthology.orchestra.run.smithi116.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-14T09:07:42.881 INFO:teuthology.orchestra.run.smithi116.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-14T09:07:42.881 INFO:teuthology.orchestra.run.smithi116.stdout: "cephx_cluster_require_signatures": "false", 2024-09-14T09:07:42.881 INFO:teuthology.orchestra.run.smithi116.stdout: "cephx_cluster_require_version": "2", 2024-09-14T09:07:42.881 INFO:teuthology.orchestra.run.smithi116.stdout: "cephx_require_signatures": "false", 2024-09-14T09:07:42.881 INFO:teuthology.orchestra.run.smithi116.stdout: "cephx_require_version": "2", 2024-09-14T09:07:42.881 INFO:teuthology.orchestra.run.smithi116.stdout: "cephx_service_require_signatures": "false", 2024-09-14T09:07:42.881 INFO:teuthology.orchestra.run.smithi116.stdout: "cephx_service_require_version": "2", 2024-09-14T09:07:42.881 INFO:teuthology.orchestra.run.smithi116.stdout: "cephx_sign_messages": "true", 2024-09-14T09:07:42.881 INFO:teuthology.orchestra.run.smithi116.stdout: "chdir": "", 2024-09-14T09:07:42.881 INFO:teuthology.orchestra.run.smithi116.stdout: "client_acl_type": "", 2024-09-14T09:07:42.882 INFO:teuthology.orchestra.run.smithi116.stdout: "client_asio_thread_count": "2", 2024-09-14T09:07:42.882 INFO:teuthology.orchestra.run.smithi116.stdout: "client_cache_mid": "0.750000", 2024-09-14T09:07:42.882 INFO:teuthology.orchestra.run.smithi116.stdout: "client_cache_size": "16384", 2024-09-14T09:07:42.882 INFO:teuthology.orchestra.run.smithi116.stdout: "client_caps_release_delay": "5", 2024-09-14T09:07:42.882 INFO:teuthology.orchestra.run.smithi116.stdout: "client_check_pool_perm": "true", 2024-09-14T09:07:42.882 INFO:teuthology.orchestra.run.smithi116.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-14T09:07:42.882 INFO:teuthology.orchestra.run.smithi116.stdout: "client_debug_force_sync_read": "false", 2024-09-14T09:07:42.882 INFO:teuthology.orchestra.run.smithi116.stdout: "client_debug_getattr_caps": "false", 2024-09-14T09:07:42.882 INFO:teuthology.orchestra.run.smithi116.stdout: "client_debug_inject_features": "", 2024-09-14T09:07:42.882 INFO:teuthology.orchestra.run.smithi116.stdout: "client_debug_inject_tick_delay": "0", 2024-09-14T09:07:42.882 INFO:teuthology.orchestra.run.smithi116.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-14T09:07:42.882 INFO:teuthology.orchestra.run.smithi116.stdout: "client_die_on_failed_remount": "false", 2024-09-14T09:07:42.882 INFO:teuthology.orchestra.run.smithi116.stdout: "client_dirsize_rbytes": "true", 2024-09-14T09:07:42.882 INFO:teuthology.orchestra.run.smithi116.stdout: "client_force_lazyio": "false", 2024-09-14T09:07:42.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client_fs": "", 2024-09-14T09:07:42.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-14T09:07:42.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client_inject_release_failure": "false", 2024-09-14T09:07:42.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client_max_inline_size": "4096", 2024-09-14T09:07:42.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-14T09:07:42.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client_mds_namespace": "", 2024-09-14T09:07:42.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client_metadata": "", 2024-09-14T09:07:42.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client_mount_gid": "-1", 2024-09-14T09:07:42.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client_mount_timeout": "300", 2024-09-14T09:07:42.884 INFO:teuthology.orchestra.run.smithi116.stdout: "client_mount_uid": "-1", 2024-09-14T09:07:42.884 INFO:teuthology.orchestra.run.smithi116.stdout: "client_mountpoint": "/", 2024-09-14T09:07:42.884 INFO:teuthology.orchestra.run.smithi116.stdout: "client_notify_timeout": "10", 2024-09-14T09:07:42.884 INFO:teuthology.orchestra.run.smithi116.stdout: "client_oc": "true", 2024-09-14T09:07:42.884 INFO:teuthology.orchestra.run.smithi116.stdout: "client_oc_max_dirty": "104857600", 2024-09-14T09:07:42.884 INFO:teuthology.orchestra.run.smithi116.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-14T09:07:42.884 INFO:teuthology.orchestra.run.smithi116.stdout: "client_oc_max_objects": "1000", 2024-09-14T09:07:42.884 INFO:teuthology.orchestra.run.smithi116.stdout: "client_oc_size": "209715200", 2024-09-14T09:07:42.884 INFO:teuthology.orchestra.run.smithi116.stdout: "client_oc_target_dirty": "8388608", 2024-09-14T09:07:42.884 INFO:teuthology.orchestra.run.smithi116.stdout: "client_permissions": "true", 2024-09-14T09:07:42.884 INFO:teuthology.orchestra.run.smithi116.stdout: "client_quota": "true", 2024-09-14T09:07:42.884 INFO:teuthology.orchestra.run.smithi116.stdout: "client_quota_df": "true", 2024-09-14T09:07:42.884 INFO:teuthology.orchestra.run.smithi116.stdout: "client_readahead_max_bytes": "0", 2024-09-14T09:07:42.885 INFO:teuthology.orchestra.run.smithi116.stdout: "client_readahead_max_periods": "4", 2024-09-14T09:07:42.885 INFO:teuthology.orchestra.run.smithi116.stdout: "client_readahead_min": "131072", 2024-09-14T09:07:42.885 INFO:teuthology.orchestra.run.smithi116.stdout: "client_reconnect_stale": "false", 2024-09-14T09:07:42.885 INFO:teuthology.orchestra.run.smithi116.stdout: "client_shutdown_timeout": "30", 2024-09-14T09:07:42.885 INFO:teuthology.orchestra.run.smithi116.stdout: "client_snapdir": ".snap", 2024-09-14T09:07:42.885 INFO:teuthology.orchestra.run.smithi116.stdout: "client_tick_interval": "1", 2024-09-14T09:07:42.885 INFO:teuthology.orchestra.run.smithi116.stdout: "client_trace": "", 2024-09-14T09:07:42.885 INFO:teuthology.orchestra.run.smithi116.stdout: "client_try_dentry_invalidate": "false", 2024-09-14T09:07:42.885 INFO:teuthology.orchestra.run.smithi116.stdout: "client_use_faked_inos": "false", 2024-09-14T09:07:42.885 INFO:teuthology.orchestra.run.smithi116.stdout: "client_use_random_mds": "false", 2024-09-14T09:07:42.885 INFO:teuthology.orchestra.run.smithi116.stdout: "clog_to_graylog": "false", 2024-09-14T09:07:42.885 INFO:teuthology.orchestra.run.smithi116.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-14T09:07:42.885 INFO:teuthology.orchestra.run.smithi116.stdout: "clog_to_graylog_port": "12201", 2024-09-14T09:07:42.885 INFO:teuthology.orchestra.run.smithi116.stdout: "clog_to_monitors": "default=true", 2024-09-14T09:07:42.886 INFO:teuthology.orchestra.run.smithi116.stdout: "clog_to_syslog": "false", 2024-09-14T09:07:42.886 INFO:teuthology.orchestra.run.smithi116.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-14T09:07:42.886 INFO:teuthology.orchestra.run.smithi116.stdout: "clog_to_syslog_level": "info", 2024-09-14T09:07:42.886 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "-", 2024-09-14T09:07:42.886 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_network": "", 2024-09-14T09:07:42.886 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_network_interface": "", 2024-09-14T09:07:42.886 INFO:teuthology.orchestra.run.smithi116.stdout: "compressor_zlib_isal": "false", 2024-09-14T09:07:42.886 INFO:teuthology.orchestra.run.smithi116.stdout: "compressor_zlib_level": "5", 2024-09-14T09:07:42.886 INFO:teuthology.orchestra.run.smithi116.stdout: "compressor_zlib_winsize": "-15", 2024-09-14T09:07:42.886 INFO:teuthology.orchestra.run.smithi116.stdout: "compressor_zstd_level": "1", 2024-09-14T09:07:42.887 INFO:teuthology.orchestra.run.smithi116.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-14T09:07:42.887 INFO:teuthology.orchestra.run.smithi116.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-14T09:07:42.887 INFO:teuthology.orchestra.run.smithi116.stdout: "crimson_alien_op_num_threads": "6", 2024-09-14T09:07:42.887 INFO:teuthology.orchestra.run.smithi116.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-14T09:07:42.887 INFO:teuthology.orchestra.run.smithi116.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-14T09:07:42.887 INFO:teuthology.orchestra.run.smithi116.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-14T09:07:42.887 INFO:teuthology.orchestra.run.smithi116.stdout: "crimson_osd_stat_interval": "0", 2024-09-14T09:07:42.887 INFO:teuthology.orchestra.run.smithi116.stdout: "crimson_seastar_cpu_cores": "", 2024-09-14T09:07:42.887 INFO:teuthology.orchestra.run.smithi116.stdout: "crimson_seastar_num_threads": "0", 2024-09-14T09:07:42.887 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_location": "", 2024-09-14T09:07:42.887 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_location_hook": "", 2024-09-14T09:07:42.887 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_location_hook_timeout": "10", 2024-09-14T09:07:42.887 INFO:teuthology.orchestra.run.smithi116.stdout: "daemonize": "false", 2024-09-14T09:07:42.888 INFO:teuthology.orchestra.run.smithi116.stdout: "daos_pool": "tank", 2024-09-14T09:07:42.888 INFO:teuthology.orchestra.run.smithi116.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-14T09:07:42.888 INFO:teuthology.orchestra.run.smithi116.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-14T09:07:42.888 INFO:teuthology.orchestra.run.smithi116.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-14T09:07:42.888 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_alienstore": "0/5", 2024-09-14T09:07:42.888 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_allow_any_pool_priority": "false", 2024-09-14T09:07:42.888 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_asok": "1/5", 2024-09-14T09:07:42.888 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_asok_assert_abort": "false", 2024-09-14T09:07:42.888 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_asserts_on_shutdown": "true", 2024-09-14T09:07:42.888 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_auth": "20/20", 2024-09-14T09:07:42.888 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_bdev": "1/3", 2024-09-14T09:07:42.888 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_bluefs": "1/5", 2024-09-14T09:07:42.888 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_bluestore": "1/5", 2024-09-14T09:07:42.889 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_buffer": "0/1", 2024-09-14T09:07:42.889 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_ceph_dedup": "0/5", 2024-09-14T09:07:42.889 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_ceph_exporter": "1/5", 2024-09-14T09:07:42.889 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_cephfs_mirror": "0/5", 2024-09-14T09:07:42.889 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_cephsqlite": "0/5", 2024-09-14T09:07:42.889 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_client": "0/5", 2024-09-14T09:07:42.889 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_compressor": "1/5", 2024-09-14T09:07:42.889 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_context": "0/1", 2024-09-14T09:07:42.889 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_crimson_interrupt": "0/5", 2024-09-14T09:07:42.889 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_crush": "1/1", 2024-09-14T09:07:42.889 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_crypto": "1/5", 2024-09-14T09:07:42.889 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_cyanstore": "0/5", 2024-09-14T09:07:42.889 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_deliberately_leak_memory": "false", 2024-09-14T09:07:42.890 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_disable_randomized_ping": "false", 2024-09-14T09:07:42.890 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_dpdk": "1/5", 2024-09-14T09:07:42.890 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_eventtrace": "1/5", 2024-09-14T09:07:42.890 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_filer": "0/1", 2024-09-14T09:07:42.890 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_filestore": "1/3", 2024-09-14T09:07:42.890 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_finisher": "1/1", 2024-09-14T09:07:42.890 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_fuse": "1/5", 2024-09-14T09:07:42.890 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_heartbeat_testing_span": "0", 2024-09-14T09:07:42.890 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_heartbeatmap": "1/5", 2024-09-14T09:07:42.890 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-14T09:07:42.890 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_javaclient": "1/5", 2024-09-14T09:07:42.890 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_journal": "1/3", 2024-09-14T09:07:42.890 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_journaler": "0/5", 2024-09-14T09:07:42.891 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_kstore": "1/5", 2024-09-14T09:07:42.891 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_lockdep": "0/1", 2024-09-14T09:07:42.891 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_mclock": "1/5", 2024-09-14T09:07:42.891 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_mds": "1/5", 2024-09-14T09:07:42.891 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_mds_balancer": "1/5", 2024-09-14T09:07:42.891 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_mds_locker": "1/5", 2024-09-14T09:07:42.891 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_mds_log": "1/5", 2024-09-14T09:07:42.891 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_mds_log_expire": "1/5", 2024-09-14T09:07:42.891 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_mds_migrator": "1/5", 2024-09-14T09:07:42.891 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_mds_quiesce": "3/5", 2024-09-14T09:07:42.891 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_memstore": "1/5", 2024-09-14T09:07:42.891 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_mgr": "2/5", 2024-09-14T09:07:42.891 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_mgrc": "1/5", 2024-09-14T09:07:42.891 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_mon": "20/20", 2024-09-14T09:07:42.891 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_monc": "0/10", 2024-09-14T09:07:42.892 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_ms": "1/1", 2024-09-14T09:07:42.892 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_none": "0/5", 2024-09-14T09:07:42.892 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_objclass": "0/5", 2024-09-14T09:07:42.892 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_objectcacher": "0/5", 2024-09-14T09:07:42.892 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_objecter": "0/1", 2024-09-14T09:07:42.892 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_optracker": "0/5", 2024-09-14T09:07:42.892 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_osd": "1/5", 2024-09-14T09:07:42.892 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_paxos": "20/20", 2024-09-14T09:07:42.892 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_perfcounter": "1/5", 2024-09-14T09:07:42.892 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_prioritycache": "1/5", 2024-09-14T09:07:42.892 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_rados": "0/5", 2024-09-14T09:07:42.892 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_rbd": "0/5", 2024-09-14T09:07:42.892 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_rbd_mirror": "0/5", 2024-09-14T09:07:42.892 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_rbd_pwl": "0/5", 2024-09-14T09:07:42.893 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_rbd_replay": "0/5", 2024-09-14T09:07:42.893 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_refs": "0/0", 2024-09-14T09:07:42.893 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_reserver": "1/1", 2024-09-14T09:07:42.893 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_rgw": "1/5", 2024-09-14T09:07:42.893 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_rgw_access": "1/5", 2024-09-14T09:07:42.893 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_rgw_datacache": "1/5", 2024-09-14T09:07:42.893 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_rgw_dbstore": "1/5", 2024-09-14T09:07:42.893 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_rgw_flight": "1/5", 2024-09-14T09:07:42.893 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-14T09:07:42.893 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_rgw_notification": "1/5", 2024-09-14T09:07:42.893 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_rgw_sync": "1/5", 2024-09-14T09:07:42.893 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_rocksdb": "4/5", 2024-09-14T09:07:42.893 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_seastore": "0/5", 2024-09-14T09:07:42.894 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_seastore_backref": "0/5", 2024-09-14T09:07:42.894 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_seastore_cache": "0/5", 2024-09-14T09:07:42.894 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_seastore_cleaner": "0/5", 2024-09-14T09:07:42.894 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_seastore_device": "0/5", 2024-09-14T09:07:42.894 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_seastore_epm": "0/5", 2024-09-14T09:07:42.894 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-14T09:07:42.894 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_seastore_journal": "0/5", 2024-09-14T09:07:42.894 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_seastore_lba": "0/5", 2024-09-14T09:07:42.894 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_seastore_odata": "0/5", 2024-09-14T09:07:42.894 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_seastore_omap": "0/5", 2024-09-14T09:07:42.894 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_seastore_onode": "0/5", 2024-09-14T09:07:42.894 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_seastore_t": "0/5", 2024-09-14T09:07:42.894 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_seastore_tm": "0/5", 2024-09-14T09:07:42.894 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_striper": "0/1", 2024-09-14T09:07:42.894 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_test": "0/5", 2024-09-14T09:07:42.895 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_throttle": "1/1", 2024-09-14T09:07:42.895 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_timer": "0/1", 2024-09-14T09:07:42.895 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_tp": "0/5", 2024-09-14T09:07:42.895 INFO:teuthology.orchestra.run.smithi116.stdout: "debug_trace": "1/5", 2024-09-14T09:07:42.895 INFO:teuthology.orchestra.run.smithi116.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-14T09:07:42.895 INFO:teuthology.orchestra.run.smithi116.stdout: "device_failure_prediction_mode": "none", 2024-09-14T09:07:42.895 INFO:teuthology.orchestra.run.smithi116.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-14T09:07:42.895 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-14T09:07:42.895 INFO:teuthology.orchestra.run.smithi116.stdout: "err_to_graylog": "false", 2024-09-14T09:07:42.895 INFO:teuthology.orchestra.run.smithi116.stdout: "err_to_journald": "false", 2024-09-14T09:07:42.895 INFO:teuthology.orchestra.run.smithi116.stdout: "err_to_stderr": "true", 2024-09-14T09:07:42.895 INFO:teuthology.orchestra.run.smithi116.stdout: "err_to_syslog": "false", 2024-09-14T09:07:42.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event_tracing": "false", 2024-09-14T09:07:42.895 INFO:teuthology.orchestra.run.smithi116.stdout: "exporter_addr": "0.0.0.0", 2024-09-14T09:07:42.895 INFO:teuthology.orchestra.run.smithi116.stdout: "exporter_cert_file": "", 2024-09-14T09:07:42.896 INFO:teuthology.orchestra.run.smithi116.stdout: "exporter_http_port": "9926", 2024-09-14T09:07:42.896 INFO:teuthology.orchestra.run.smithi116.stdout: "exporter_key_file": "", 2024-09-14T09:07:42.896 INFO:teuthology.orchestra.run.smithi116.stdout: "exporter_prio_limit": "5", 2024-09-14T09:07:42.896 INFO:teuthology.orchestra.run.smithi116.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-14T09:07:42.896 INFO:teuthology.orchestra.run.smithi116.stdout: "exporter_sort_metrics": "true", 2024-09-14T09:07:42.896 INFO:teuthology.orchestra.run.smithi116.stdout: "exporter_stats_period": "5", 2024-09-14T09:07:42.896 INFO:teuthology.orchestra.run.smithi116.stdout: "fake_statfs_for_testing": "0", 2024-09-14T09:07:42.896 INFO:teuthology.orchestra.run.smithi116.stdout: "fatal_signal_handlers": "true", 2024-09-14T09:07:42.896 INFO:teuthology.orchestra.run.smithi116.stdout: "filer_max_purge_ops": "10", 2024-09-14T09:07:42.896 INFO:teuthology.orchestra.run.smithi116.stdout: "filer_max_truncate_ops": "128", 2024-09-14T09:07:42.896 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_apply_finisher_threads": "1", 2024-09-14T09:07:42.896 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_blackhole": "false", 2024-09-14T09:07:42.896 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_btrfs_clone_range": "true", 2024-09-14T09:07:42.896 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_btrfs_snap": "true", 2024-09-14T09:07:42.897 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_caller_concurrency": "10", 2024-09-14T09:07:42.897 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_collect_device_partition_information": "true", 2024-09-14T09:07:42.897 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_commit_timeout": "600.000000", 2024-09-14T09:07:42.897 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_debug_inject_read_err": "false", 2024-09-14T09:07:42.897 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_debug_omap_check": "false", 2024-09-14T09:07:42.897 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_debug_verify_split": "false", 2024-09-14T09:07:42.897 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_dump_file": "", 2024-09-14T09:07:42.897 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-14T09:07:42.897 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-14T09:07:42.897 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_fadvise": "true", 2024-09-14T09:07:42.897 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_fail_eio": "true", 2024-09-14T09:07:42.897 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_fd_cache_shards": "16", 2024-09-14T09:07:42.897 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_fd_cache_size": "128", 2024-09-14T09:07:42.897 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_fiemap": "false", 2024-09-14T09:07:42.898 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_fiemap_threshold": "4096", 2024-09-14T09:07:42.898 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-14T09:07:42.898 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-14T09:07:42.898 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_inject_stall": "0", 2024-09-14T09:07:42.898 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_journal_parallel": "false", 2024-09-14T09:07:42.898 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_journal_trailing": "false", 2024-09-14T09:07:42.898 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_journal_writeahead": "false", 2024-09-14T09:07:42.898 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_kill_at": "0", 2024-09-14T09:07:42.898 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-14T09:07:42.898 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-14T09:07:42.898 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-14T09:07:42.898 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-14T09:07:42.898 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-14T09:07:42.898 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_max_inline_xattrs": "0", 2024-09-14T09:07:42.899 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-14T09:07:42.899 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-14T09:07:42.899 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-14T09:07:42.899 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-14T09:07:42.899 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_max_xattr_value_size": "0", 2024-09-14T09:07:42.899 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-14T09:07:42.899 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-14T09:07:42.899 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-14T09:07:42.899 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_merge_threshold": "-10", 2024-09-14T09:07:42.899 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-14T09:07:42.899 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_odsync_write": "false", 2024-09-14T09:07:42.899 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_omap_backend": "rocksdb", 2024-09-14T09:07:42.899 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_omap_backend_path": "", 2024-09-14T09:07:42.899 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-14T09:07:42.899 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-14T09:07:42.900 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-14T09:07:42.900 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_op_thread_timeout": "60", 2024-09-14T09:07:42.900 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_op_threads": "2", 2024-09-14T09:07:42.900 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_punch_hole": "false", 2024-09-14T09:07:42.900 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-14T09:07:42.900 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-14T09:07:42.900 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-14T09:07:42.900 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-14T09:07:42.900 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-14T09:07:42.900 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-14T09:07:42.900 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-14T09:07:42.900 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-14T09:07:42.900 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-14T09:07:42.900 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_queue_max_ops": "50", 2024-09-14T09:07:42.900 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-14T09:07:42.901 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_seek_data_hole": "false", 2024-09-14T09:07:42.901 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_sloppy_crc": "false", 2024-09-14T09:07:42.901 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-14T09:07:42.901 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_splice": "false", 2024-09-14T09:07:42.901 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_split_multiple": "2", 2024-09-14T09:07:42.901 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_split_rand_factor": "20", 2024-09-14T09:07:42.901 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_update_to": "1000", 2024-09-14T09:07:42.901 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-14T09:07:42.901 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-14T09:07:42.901 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-14T09:07:42.901 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-14T09:07:42.901 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-14T09:07:42.901 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-14T09:07:42.902 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_wbthrottle_enable": "true", 2024-09-14T09:07:42.902 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-14T09:07:42.902 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-14T09:07:42.902 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-14T09:07:42.902 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-14T09:07:42.902 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-14T09:07:42.902 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-14T09:07:42.902 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_xfs_extsize": "false", 2024-09-14T09:07:42.902 INFO:teuthology.orchestra.run.smithi116.stdout: "filestore_zfs_snap": "false", 2024-09-14T09:07:42.902 INFO:teuthology.orchestra.run.smithi116.stdout: "fio_dir": "/tmp/fio", 2024-09-14T09:07:42.902 INFO:teuthology.orchestra.run.smithi116.stdout: "fsid": "c991ac1c-978d-48b3-a540-4d3d4755e125", 2024-09-14T09:07:42.902 INFO:teuthology.orchestra.run.smithi116.stdout: "fuse_allow_other": "true", 2024-09-14T09:07:42.902 INFO:teuthology.orchestra.run.smithi116.stdout: "fuse_atomic_o_trunc": "true", 2024-09-14T09:07:42.902 INFO:teuthology.orchestra.run.smithi116.stdout: "fuse_big_writes": "true", 2024-09-14T09:07:42.903 INFO:teuthology.orchestra.run.smithi116.stdout: "fuse_debug": "false", 2024-09-14T09:07:42.903 INFO:teuthology.orchestra.run.smithi116.stdout: "fuse_default_permissions": "false", 2024-09-14T09:07:42.903 INFO:teuthology.orchestra.run.smithi116.stdout: "fuse_disable_pagecache": "false", 2024-09-14T09:07:42.903 INFO:teuthology.orchestra.run.smithi116.stdout: "fuse_max_write": "0", 2024-09-14T09:07:42.903 INFO:teuthology.orchestra.run.smithi116.stdout: "fuse_multithreaded": "true", 2024-09-14T09:07:42.903 INFO:teuthology.orchestra.run.smithi116.stdout: "fuse_require_active_mds": "true", 2024-09-14T09:07:42.903 INFO:teuthology.orchestra.run.smithi116.stdout: "fuse_set_user_groups": "true", 2024-09-14T09:07:42.903 INFO:teuthology.orchestra.run.smithi116.stdout: "fuse_splice_move": "true", 2024-09-14T09:07:42.903 INFO:teuthology.orchestra.run.smithi116.stdout: "fuse_splice_read": "true", 2024-09-14T09:07:42.903 INFO:teuthology.orchestra.run.smithi116.stdout: "fuse_splice_write": "true", 2024-09-14T09:07:42.903 INFO:teuthology.orchestra.run.smithi116.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-14T09:07:42.903 INFO:teuthology.orchestra.run.smithi116.stdout: "fuse_use_invalidate_cb": "true", 2024-09-14T09:07:42.903 INFO:teuthology.orchestra.run.smithi116.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-14T09:07:42.903 INFO:teuthology.orchestra.run.smithi116.stdout: "gss_target_name": "ceph", 2024-09-14T09:07:42.904 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_file": "", 2024-09-14T09:07:42.904 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_inject_failure": "0", 2024-09-14T09:07:42.904 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_interval": "5", 2024-09-14T09:07:42.904 INFO:teuthology.orchestra.run.smithi116.stdout: "host": "smithi116", 2024-09-14T09:07:42.904 INFO:teuthology.orchestra.run.smithi116.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-14T09:07:42.904 INFO:teuthology.orchestra.run.smithi116.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-14T09:07:42.904 INFO:teuthology.orchestra.run.smithi116.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-14T09:07:42.904 INFO:teuthology.orchestra.run.smithi116.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-14T09:07:42.904 INFO:teuthology.orchestra.run.smithi116.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-14T09:07:42.904 INFO:teuthology.orchestra.run.smithi116.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-14T09:07:42.904 INFO:teuthology.orchestra.run.smithi116.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-14T09:07:42.905 INFO:teuthology.orchestra.run.smithi116.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-14T09:07:42.905 INFO:teuthology.orchestra.run.smithi116.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-14T09:07:42.905 INFO:teuthology.orchestra.run.smithi116.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-14T09:07:42.905 INFO:teuthology.orchestra.run.smithi116.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-14T09:07:42.905 INFO:teuthology.orchestra.run.smithi116.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-14T09:07:42.905 INFO:teuthology.orchestra.run.smithi116.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-14T09:07:42.905 INFO:teuthology.orchestra.run.smithi116.stdout: "inject_early_sigterm": "false", 2024-09-14T09:07:42.905 INFO:teuthology.orchestra.run.smithi116.stdout: "jaeger_agent_port": "6799", 2024-09-14T09:07:42.905 INFO:teuthology.orchestra.run.smithi116.stdout: "jaeger_tracing_enable": "false", 2024-09-14T09:07:42.905 INFO:teuthology.orchestra.run.smithi116.stdout: "journal_aio": "true", 2024-09-14T09:07:42.905 INFO:teuthology.orchestra.run.smithi116.stdout: "journal_align_min_size": "65536", 2024-09-14T09:07:42.905 INFO:teuthology.orchestra.run.smithi116.stdout: "journal_block_align": "true", 2024-09-14T09:07:42.905 INFO:teuthology.orchestra.run.smithi116.stdout: "journal_block_size": "4096", 2024-09-14T09:07:42.905 INFO:teuthology.orchestra.run.smithi116.stdout: "journal_dio": "true", 2024-09-14T09:07:42.906 INFO:teuthology.orchestra.run.smithi116.stdout: "journal_discard": "false", 2024-09-14T09:07:42.906 INFO:teuthology.orchestra.run.smithi116.stdout: "journal_force_aio": "false", 2024-09-14T09:07:42.906 INFO:teuthology.orchestra.run.smithi116.stdout: "journal_ignore_corruption": "false", 2024-09-14T09:07:42.906 INFO:teuthology.orchestra.run.smithi116.stdout: "journal_max_write_bytes": "10485760", 2024-09-14T09:07:42.906 INFO:teuthology.orchestra.run.smithi116.stdout: "journal_max_write_entries": "100", 2024-09-14T09:07:42.906 INFO:teuthology.orchestra.run.smithi116.stdout: "journal_replay_from": "0", 2024-09-14T09:07:42.906 INFO:teuthology.orchestra.run.smithi116.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-14T09:07:42.906 INFO:teuthology.orchestra.run.smithi116.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-14T09:07:42.906 INFO:teuthology.orchestra.run.smithi116.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-14T09:07:42.906 INFO:teuthology.orchestra.run.smithi116.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-14T09:07:42.906 INFO:teuthology.orchestra.run.smithi116.stdout: "journal_write_header_frequency": "0", 2024-09-14T09:07:42.906 INFO:teuthology.orchestra.run.smithi116.stdout: "journal_zero_on_create": "false", 2024-09-14T09:07:42.906 INFO:teuthology.orchestra.run.smithi116.stdout: "journaler_prefetch_periods": "10", 2024-09-14T09:07:42.906 INFO:teuthology.orchestra.run.smithi116.stdout: "journaler_prezero_periods": "5", 2024-09-14T09:07:42.906 INFO:teuthology.orchestra.run.smithi116.stdout: "journaler_write_head_interval": "15", 2024-09-14T09:07:42.907 INFO:teuthology.orchestra.run.smithi116.stdout: "key": "", 2024-09-14T09:07:42.907 INFO:teuthology.orchestra.run.smithi116.stdout: "keyfile": "", 2024-09-14T09:07:42.907 INFO:teuthology.orchestra.run.smithi116.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-14T09:07:42.907 INFO:teuthology.orchestra.run.smithi116.stdout: "kstore_backend": "rocksdb", 2024-09-14T09:07:42.907 INFO:teuthology.orchestra.run.smithi116.stdout: "kstore_default_stripe_size": "65536", 2024-09-14T09:07:42.907 INFO:teuthology.orchestra.run.smithi116.stdout: "kstore_fsck_on_mount": "false", 2024-09-14T09:07:42.907 INFO:teuthology.orchestra.run.smithi116.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-14T09:07:42.907 INFO:teuthology.orchestra.run.smithi116.stdout: "kstore_max_bytes": "67108864", 2024-09-14T09:07:42.907 INFO:teuthology.orchestra.run.smithi116.stdout: "kstore_max_ops": "512", 2024-09-14T09:07:42.907 INFO:teuthology.orchestra.run.smithi116.stdout: "kstore_nid_prealloc": "1024", 2024-09-14T09:07:42.907 INFO:teuthology.orchestra.run.smithi116.stdout: "kstore_onode_map_size": "1024", 2024-09-14T09:07:42.907 INFO:teuthology.orchestra.run.smithi116.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-14T09:07:42.907 INFO:teuthology.orchestra.run.smithi116.stdout: "kstore_sync_submit_transaction": "false", 2024-09-14T09:07:42.908 INFO:teuthology.orchestra.run.smithi116.stdout: "kstore_sync_transaction": "false", 2024-09-14T09:07:42.908 INFO:teuthology.orchestra.run.smithi116.stdout: "librados_thread_count": "2", 2024-09-14T09:07:42.908 INFO:teuthology.orchestra.run.smithi116.stdout: "lockdep": "false", 2024-09-14T09:07:42.908 INFO:teuthology.orchestra.run.smithi116.stdout: "lockdep_force_backtrace": "false", 2024-09-14T09:07:42.908 INFO:teuthology.orchestra.run.smithi116.stdout: "log_coarse_timestamps": "true", 2024-09-14T09:07:42.908 INFO:teuthology.orchestra.run.smithi116.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-14T09:07:42.908 INFO:teuthology.orchestra.run.smithi116.stdout: "log_flush_on_exit": "false", 2024-09-14T09:07:42.908 INFO:teuthology.orchestra.run.smithi116.stdout: "log_graylog_host": "127.0.0.1", 2024-09-14T09:07:42.908 INFO:teuthology.orchestra.run.smithi116.stdout: "log_graylog_port": "12201", 2024-09-14T09:07:42.908 INFO:teuthology.orchestra.run.smithi116.stdout: "log_max_new": "1000", 2024-09-14T09:07:42.908 INFO:teuthology.orchestra.run.smithi116.stdout: "log_max_recent": "10000", 2024-09-14T09:07:42.908 INFO:teuthology.orchestra.run.smithi116.stdout: "log_stderr_prefix": "", 2024-09-14T09:07:42.908 INFO:teuthology.orchestra.run.smithi116.stdout: "log_stop_at_utilization": "0.970000", 2024-09-14T09:07:42.908 INFO:teuthology.orchestra.run.smithi116.stdout: "log_to_file": "true", 2024-09-14T09:07:42.909 INFO:teuthology.orchestra.run.smithi116.stdout: "log_to_graylog": "false", 2024-09-14T09:07:42.909 INFO:teuthology.orchestra.run.smithi116.stdout: "log_to_journald": "false", 2024-09-14T09:07:42.909 INFO:teuthology.orchestra.run.smithi116.stdout: "log_to_stderr": "false", 2024-09-14T09:07:42.909 INFO:teuthology.orchestra.run.smithi116.stdout: "log_to_syslog": "false", 2024-09-14T09:07:42.909 INFO:teuthology.orchestra.run.smithi116.stdout: "max_rotating_auth_attempts": "10", 2024-09-14T09:07:42.909 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-14T09:07:42.909 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_action_on_write_error": "1", 2024-09-14T09:07:42.909 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_alternate_name_max": "8192", 2024-09-14T09:07:42.909 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_asio_thread_count": "2", 2024-09-14T09:07:42.909 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_export_pin": "true", 2024-09-14T09:07:42.909 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_fragment_dirs": "true", 2024-09-14T09:07:42.909 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-14T09:07:42.909 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_fragment_interval": "5", 2024-09-14T09:07:42.909 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-14T09:07:42.910 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-14T09:07:42.910 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_interval": "10", 2024-09-14T09:07:42.910 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_max": "-1", 2024-09-14T09:07:42.910 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_max_until": "-1", 2024-09-14T09:07:42.910 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_merge_size": "50", 2024-09-14T09:07:42.910 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_midchunk": "0.300000", 2024-09-14T09:07:42.910 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-14T09:07:42.910 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_min_start": "0.200000", 2024-09-14T09:07:42.910 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_minchunk": "0.001000", 2024-09-14T09:07:42.910 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_mode": "0", 2024-09-14T09:07:42.910 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_need_max": "1.200000", 2024-09-14T09:07:42.910 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_need_min": "0.800000", 2024-09-14T09:07:42.910 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_overload_epochs": "2", 2024-09-14T09:07:42.911 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-14T09:07:42.911 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-14T09:07:42.911 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_split_bits": "3", 2024-09-14T09:07:42.911 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-14T09:07:42.911 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_split_size": "10000", 2024-09-14T09:07:42.911 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-14T09:07:42.911 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_target_decay": "10.000000", 2024-09-14T09:07:42.911 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-14T09:07:42.911 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_beacon_grace": "15.000000", 2024-09-14T09:07:42.911 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_beacon_interval": "4.000000", 2024-09-14T09:07:42.911 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-14T09:07:42.911 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-14T09:07:42.911 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache_mid": "0.700000", 2024-09-14T09:07:42.911 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-14T09:07:42.912 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache_quiesce_delay": "0", 2024-09-14T09:07:42.912 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-14T09:07:42.912 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-14T09:07:42.912 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-14T09:07:42.912 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache_release_free_interval": "10", 2024-09-14T09:07:42.912 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache_reservation": "0.050000", 2024-09-14T09:07:42.912 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-14T09:07:42.912 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache_trim_interval": "1", 2024-09-14T09:07:42.912 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache_trim_threshold": "262144", 2024-09-14T09:07:42.912 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-14T09:07:42.912 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-14T09:07:42.912 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-14T09:07:42.913 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_client_prealloc_inos": "1000", 2024-09-14T09:07:42.913 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-14T09:07:42.913 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_connect_bootstrapping": "false", 2024-09-14T09:07:42.913 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_damage_table_max_entries": "10000", 2024-09-14T09:07:42.913 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-14T09:07:42.913 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_debug_auth_pins": "false", 2024-09-14T09:07:42.913 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_debug_frag": "false", 2024-09-14T09:07:42.913 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_debug_scatterstat": "false", 2024-09-14T09:07:42.913 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_debug_subtrees": "false", 2024-09-14T09:07:42.913 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_decay_halflife": "5.000000", 2024-09-14T09:07:42.913 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_default_dir_hash": "2", 2024-09-14T09:07:42.913 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_defer_session_stale": "true", 2024-09-14T09:07:42.913 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_deny_all_reconnect": "false", 2024-09-14T09:07:42.913 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_dir_keys_per_op": "16384", 2024-09-14T09:07:42.913 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_dir_max_commit_size": "10", 2024-09-14T09:07:42.914 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_dir_max_entries": "0", 2024-09-14T09:07:42.914 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_dir_prefetch": "true", 2024-09-14T09:07:42.914 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-14T09:07:42.914 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-14T09:07:42.914 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_dump_cache_on_map": "false", 2024-09-14T09:07:42.914 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-14T09:07:42.914 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-14T09:07:42.914 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_early_reply": "true", 2024-09-14T09:07:42.914 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_enable_op_tracker": "true", 2024-09-14T09:07:42.914 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_enforce_unique_name": "true", 2024-09-14T09:07:42.914 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-14T09:07:42.914 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-14T09:07:42.914 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_export_ephemeral_random": "true", 2024-09-14T09:07:42.914 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-14T09:07:42.915 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-14T09:07:42.915 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-14T09:07:42.915 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-14T09:07:42.915 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-14T09:07:42.915 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-14T09:07:42.915 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-14T09:07:42.915 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-14T09:07:42.915 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_health_summarize_threshold": "10", 2024-09-14T09:07:42.915 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-14T09:07:42.915 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-14T09:07:42.915 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_inject_health_dummy": "false", 2024-09-14T09:07:42.915 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-14T09:07:42.915 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_inject_migrator_session_race": "false", 2024-09-14T09:07:42.915 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-14T09:07:42.916 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-14T09:07:42.916 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-14T09:07:42.916 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_join_fs": "", 2024-09-14T09:07:42.916 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_journal_format": "1", 2024-09-14T09:07:42.916 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-14T09:07:42.916 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_kill_create_at": "0", 2024-09-14T09:07:42.916 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_kill_dirfrag_at": "0", 2024-09-14T09:07:42.916 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_kill_export_at": "0", 2024-09-14T09:07:42.916 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_kill_import_at": "0", 2024-09-14T09:07:42.916 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_kill_journal_at": "0", 2024-09-14T09:07:42.916 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_kill_journal_expire_at": "0", 2024-09-14T09:07:42.916 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_kill_journal_replay_at": "0", 2024-09-14T09:07:42.916 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_kill_link_at": "0", 2024-09-14T09:07:42.916 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_kill_mdstable_at": "0", 2024-09-14T09:07:42.917 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_kill_openc_at": "0", 2024-09-14T09:07:42.917 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_kill_rename_at": "0", 2024-09-14T09:07:42.917 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_kill_shutdown_at": "0", 2024-09-14T09:07:42.917 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log_event_large_threshold": "524288", 2024-09-14T09:07:42.917 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log_events_per_segment": "1024", 2024-09-14T09:07:42.917 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-14T09:07:42.917 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log_max_events": "-1", 2024-09-14T09:07:42.917 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log_max_segments": "128", 2024-09-14T09:07:42.917 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log_pause": "false", 2024-09-14T09:07:42.917 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log_segment_size": "0", 2024-09-14T09:07:42.917 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-14T09:07:42.917 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-14T09:07:42.918 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-14T09:07:42.918 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log_trim_threshold": "128", 2024-09-14T09:07:42.918 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-14T09:07:42.918 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log_warn_factor": "2.000000", 2024-09-14T09:07:42.918 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_max_caps_per_client": "1048576", 2024-09-14T09:07:42.918 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_max_completed_flushes": "100000", 2024-09-14T09:07:42.918 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_max_completed_requests": "100000", 2024-09-14T09:07:42.918 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_max_export_size": "20971520", 2024-09-14T09:07:42.918 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_max_file_recover": "32", 2024-09-14T09:07:42.918 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_max_purge_files": "64", 2024-09-14T09:07:42.918 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_max_purge_ops": "8192", 2024-09-14T09:07:42.918 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-14T09:07:42.918 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-14T09:07:42.918 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_max_snaps_per_dir": "100", 2024-09-14T09:07:42.919 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_metrics_update_interval": "2", 2024-09-14T09:07:42.919 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_min_caps_per_client": "100", 2024-09-14T09:07:42.919 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_min_caps_working_set": "10000", 2024-09-14T09:07:42.919 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-14T09:07:42.919 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_numa_node": "-1", 2024-09-14T09:07:42.919 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-14T09:07:42.919 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_op_complaint_time": "30.000000", 2024-09-14T09:07:42.919 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_op_history_duration": "600", 2024-09-14T09:07:42.919 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_op_history_size": "20", 2024-09-14T09:07:42.919 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_op_history_slow_op_size": "20", 2024-09-14T09:07:42.919 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-14T09:07:42.919 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_op_log_threshold": "5", 2024-09-14T09:07:42.919 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_ping_grace": "15", 2024-09-14T09:07:42.919 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_ping_interval": "5", 2024-09-14T09:07:42.919 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-14T09:07:42.920 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-14T09:07:42.920 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_recall_max_caps": "30000", 2024-09-14T09:07:42.920 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-14T09:07:42.920 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-14T09:07:42.920 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-14T09:07:42.920 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_recall_warning_threshold": "262144", 2024-09-14T09:07:42.920 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-14T09:07:42.920 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_replay_interval": "1.000000", 2024-09-14T09:07:42.920 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-14T09:07:42.920 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-14T09:07:42.920 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_root_ino_gid": "0", 2024-09-14T09:07:42.920 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_root_ino_uid": "0", 2024-09-14T09:07:42.920 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-14T09:07:42.920 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_scrub_stats_review_period": "1", 2024-09-14T09:07:42.921 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-14T09:07:42.921 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-14T09:07:42.921 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-14T09:07:42.921 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-14T09:07:42.921 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-14T09:07:42.921 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-14T09:07:42.921 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-14T09:07:42.921 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-14T09:07:42.921 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-14T09:07:42.921 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-14T09:07:42.921 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-14T09:07:42.921 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_shutdown_check": "0", 2024-09-14T09:07:42.921 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_skip_ino": "0", 2024-09-14T09:07:42.922 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-14T09:07:42.922 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_snap_max_uid": "4294967294", 2024-09-14T09:07:42.922 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_snap_min_uid": "0", 2024-09-14T09:07:42.922 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_snap_rstat": "false", 2024-09-14T09:07:42.922 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_standby_replay_damaged": "false", 2024-09-14T09:07:42.922 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_symlink_recovery": "true", 2024-09-14T09:07:42.922 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-14T09:07:42.922 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_thrash_exports": "0", 2024-09-14T09:07:42.922 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_thrash_fragments": "0", 2024-09-14T09:07:42.922 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_tick_interval": "5.000000", 2024-09-14T09:07:42.922 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_valgrind_exit": "false", 2024-09-14T09:07:42.922 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_verify_backtrace": "1", 2024-09-14T09:07:42.922 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_verify_scatter": "false", 2024-09-14T09:07:42.922 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-14T09:07:42.923 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_wipe_sessions": "false", 2024-09-14T09:07:42.923 INFO:teuthology.orchestra.run.smithi116.stdout: "mempool_debug": "false", 2024-09-14T09:07:42.923 INFO:teuthology.orchestra.run.smithi116.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-14T09:07:42.923 INFO:teuthology.orchestra.run.smithi116.stdout: "memstore_device_bytes": "1073741824", 2024-09-14T09:07:42.923 INFO:teuthology.orchestra.run.smithi116.stdout: "memstore_page_set": "false", 2024-09-14T09:07:42.923 INFO:teuthology.orchestra.run.smithi116.stdout: "memstore_page_size": "65536", 2024-09-14T09:07:42.923 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_client_bytes": "134217728", 2024-09-14T09:07:42.923 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_client_messages": "512", 2024-09-14T09:07:42.923 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-14T09:07:42.923 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-14T09:07:42.923 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-14T09:07:42.923 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-14T09:07:42.923 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_disabled_modules": "", 2024-09-14T09:07:42.923 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_enable_op_tracker": "true", 2024-09-14T09:07:42.924 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-14T09:07:42.924 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_max_pg_creating": "1024", 2024-09-14T09:07:42.924 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_max_pg_num_change": "128", 2024-09-14T09:07:42.924 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_mds_bytes": "134217728", 2024-09-14T09:07:42.924 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_mds_messages": "128", 2024-09-14T09:07:42.924 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-14T09:07:42.924 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_mon_bytes": "134217728", 2024-09-14T09:07:42.924 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_mon_messages": "128", 2024-09-14T09:07:42.924 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-14T09:07:42.924 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-14T09:07:42.924 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_op_history_duration": "600", 2024-09-14T09:07:42.924 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_op_history_size": "20", 2024-09-14T09:07:42.924 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-14T09:07:42.925 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-14T09:07:42.925 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_op_log_threshold": "5", 2024-09-14T09:07:42.925 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_osd_bytes": "536870912", 2024-09-14T09:07:42.925 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_osd_messages": "8192", 2024-09-14T09:07:42.925 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_pool": "true", 2024-09-14T09:07:42.925 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-14T09:07:42.925 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_standby_modules": "true", 2024-09-14T09:07:42.925 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_stats_period": "5", 2024-09-14T09:07:42.925 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_stats_threshold": "5", 2024-09-14T09:07:42.925 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_tick_period": "2", 2024-09-14T09:07:42.925 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-14T09:07:42.925 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-14T09:07:42.925 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_allow_pool_delete": "true", 2024-09-14T09:07:42.926 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_allow_pool_size_one": "true", 2024-09-14T09:07:42.926 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_auth_validate_all_caps": "true", 2024-09-14T09:07:42.926 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-14T09:07:42.926 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-14T09:07:42.926 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_client_bytes": "104857600", 2024-09-14T09:07:42.926 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_client_directed_command_retry": "5", 2024-09-14T09:07:42.926 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-14T09:07:42.926 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-14T09:07:42.926 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-14T09:07:42.926 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-14T09:07:42.926 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_client_hunt_parallel": "3", 2024-09-14T09:07:42.926 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_client_log_interval": "1.000000", 2024-09-14T09:07:42.926 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-14T09:07:42.926 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_client_ping_interval": "10.000000", 2024-09-14T09:07:42.927 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-14T09:07:42.927 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_client_target_rank": "-1", 2024-09-14T09:07:42.927 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-14T09:07:42.927 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-14T09:07:42.927 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-14T09:07:42.927 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_cluster_log_level": "debug", 2024-09-14T09:07:42.927 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_cluster_log_to_file": "true", 2024-09-14T09:07:42.927 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-14T09:07:42.927 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-14T09:07:42.927 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-14T09:07:42.927 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_cluster_log_to_journald": "false", 2024-09-14T09:07:42.927 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-14T09:07:42.927 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-14T09:07:42.927 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-14T09:07:42.928 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_compact_on_bootstrap": "false", 2024-09-14T09:07:42.928 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_compact_on_start": "false", 2024-09-14T09:07:42.928 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_compact_on_trim": "true", 2024-09-14T09:07:42.928 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-14T09:07:42.928 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-14T09:07:42.928 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-14T09:07:42.928 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_cpu_threads": "4", 2024-09-14T09:07:42.928 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_crush_min_required_version": "hammer", 2024-09-14T09:07:42.928 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_daemon_bytes": "419430400", 2024-09-14T09:07:42.928 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-14T09:07:42.928 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_data_avail_crit": "5", 2024-09-14T09:07:42.928 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_data_avail_warn": "5", 2024-09-14T09:07:42.928 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_data_size_warn": "16106127360", 2024-09-14T09:07:42.928 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-14T09:07:42.929 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-14T09:07:42.929 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_debug_dump_json": "false", 2024-09-14T09:07:42.929 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-14T09:07:42.929 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_debug_dump_transactions": "false", 2024-09-14T09:07:42.929 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_debug_extra_checks": "false", 2024-09-14T09:07:42.929 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-14T09:07:42.929 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-14T09:07:42.929 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_debug_no_require_reef": "false", 2024-09-14T09:07:42.929 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_debug_no_require_squid": "false", 2024-09-14T09:07:42.929 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-14T09:07:42.929 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-14T09:07:42.929 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-14T09:07:42.929 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_down_mkfs_grace": "120", 2024-09-14T09:07:42.930 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_down_uptime_grace": "60", 2024-09-14T09:07:42.930 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_election_default_strategy": "1", 2024-09-14T09:07:42.930 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_election_timeout": "5.000000", 2024-09-14T09:07:42.930 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-14T09:07:42.930 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_elector_ping_divisor": "2", 2024-09-14T09:07:42.930 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-14T09:07:42.930 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_enable_op_tracker": "true", 2024-09-14T09:07:42.930 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_fake_pool_delete": "false", 2024-09-14T09:07:42.930 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_force_quorum_join": "false", 2024-09-14T09:07:42.930 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-14T09:07:42.930 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_globalid_prealloc": "10000", 2024-09-14T09:07:42.930 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_health_detail_to_clog": "false", 2024-09-14T09:07:42.930 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_health_log_update_period": "5", 2024-09-14T09:07:42.930 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_health_max_detail": "50", 2024-09-14T09:07:42.931 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_health_to_clog": "true", 2024-09-14T09:07:42.931 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_health_to_clog_interval": "600", 2024-09-14T09:07:42.931 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-14T09:07:42.931 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_host": "172.21.15.116,[v2:172.21.15.116:3301,v1:172.21.15.116:6790],172.21.15.144", 2024-09-14T09:07:42.931 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_host_override": "", 2024-09-14T09:07:42.931 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_initial_members": "", 2024-09-14T09:07:42.931 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-14T09:07:42.931 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-14T09:07:42.931 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-14T09:07:42.931 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-14T09:07:42.931 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-14T09:07:42.931 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_lease": "5.000000", 2024-09-14T09:07:42.931 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-14T09:07:42.932 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-14T09:07:42.932 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_log_full_interval": "50", 2024-09-14T09:07:42.932 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_log_max": "10000", 2024-09-14T09:07:42.932 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_log_max_summary": "50", 2024-09-14T09:07:42.932 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-14T09:07:42.932 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_max_log_epochs": "500", 2024-09-14T09:07:42.932 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-14T09:07:42.932 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-14T09:07:42.932 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-14T09:07:42.932 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_max_osd": "10000", 2024-09-14T09:07:42.932 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_max_pg_per_osd": "10000", 2024-09-14T09:07:42.932 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_max_pool_pg_num": "65536", 2024-09-14T09:07:42.932 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-14T09:07:42.932 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-14T09:07:42.933 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_mds_force_trim_to": "0", 2024-09-14T09:07:42.933 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_mds_skip_sanity": "false", 2024-09-14T09:07:42.933 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_memory_autotune": "true", 2024-09-14T09:07:42.933 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_memory_target": "2147483648", 2024-09-14T09:07:42.933 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_mgr_beacon_grace": "30", 2024-09-14T09:07:42.933 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-14T09:07:42.933 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_mgr_digest_period": "5", 2024-09-14T09:07:42.933 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_mgr_inactive_grace": "60", 2024-09-14T09:07:42.933 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-14T09:07:42.933 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-14T09:07:42.933 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_min_osdmap_epochs": "500", 2024-09-14T09:07:42.933 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-14T09:07:42.933 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-14T09:07:42.933 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_op_complaint_time": "30", 2024-09-14T09:07:42.934 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_op_history_duration": "600", 2024-09-14T09:07:42.934 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_op_history_size": "20", 2024-09-14T09:07:42.934 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_op_history_slow_op_size": "20", 2024-09-14T09:07:42.934 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-14T09:07:42.934 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_op_log_threshold": "5", 2024-09-14T09:07:42.934 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-14T09:07:42.934 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-14T09:07:42.934 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-14T09:07:42.934 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_auto_mark_in": "false", 2024-09-14T09:07:42.934 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-14T09:07:42.934 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-14T09:07:42.934 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-14T09:07:42.934 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_cache_size": "500", 2024-09-14T09:07:42.934 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-14T09:07:42.935 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-14T09:07:42.935 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-14T09:07:42.935 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_down_out_interval": "600", 2024-09-14T09:07:42.935 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-14T09:07:42.935 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-14T09:07:42.935 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_force_trim_to": "0", 2024-09-14T09:07:42.935 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-14T09:07:42.935 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-14T09:07:42.935 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-14T09:07:42.935 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-14T09:07:42.935 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-14T09:07:42.935 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-14T09:07:42.935 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-14T09:07:42.935 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_min_down_reporters": "2", 2024-09-14T09:07:42.936 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-14T09:07:42.936 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-14T09:07:42.936 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-14T09:07:42.936 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-14T09:07:42.936 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-14T09:07:42.936 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-14T09:07:42.936 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_report_timeout": "900", 2024-09-14T09:07:42.936 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-14T09:07:42.936 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-14T09:07:42.936 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-14T09:07:42.936 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-14T09:07:42.936 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-14T09:07:42.936 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-14T09:07:42.936 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-14T09:07:42.937 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-14T09:07:42.937 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-14T09:07:42.937 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_pg_stuck_threshold": "60", 2024-09-14T09:07:42.937 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-14T09:07:42.937 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-14T09:07:42.937 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-14T09:07:42.937 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-14T09:07:42.937 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-14T09:07:42.937 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-14T09:07:42.937 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_probe_timeout": "2.000000", 2024-09-14T09:07:42.937 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_reweight_max_change": "0.050000", 2024-09-14T09:07:42.937 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_reweight_max_osds": "4", 2024-09-14T09:07:42.937 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-14T09:07:42.937 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-14T09:07:42.938 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-14T09:07:42.938 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-14T09:07:42.938 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-14T09:07:42.938 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_scrub_interval": "86400", 2024-09-14T09:07:42.938 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_scrub_max_keys": "100", 2024-09-14T09:07:42.938 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_scrub_timeout": "300", 2024-09-14T09:07:42.938 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_session_timeout": "300", 2024-09-14T09:07:42.938 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_smart_report_timeout": "5", 2024-09-14T09:07:42.938 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_stat_smooth_intervals": "6", 2024-09-14T09:07:42.938 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-14T09:07:42.938 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_stretch_pool_min_size": "2", 2024-09-14T09:07:42.938 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_stretch_pool_size": "4", 2024-09-14T09:07:42.938 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-14T09:07:42.938 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-14T09:07:42.939 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_sync_debug": "false", 2024-09-14T09:07:42.939 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-14T09:07:42.939 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-14T09:07:42.939 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_sync_provider_kill_at": "0", 2024-09-14T09:07:42.939 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_sync_requester_kill_at": "0", 2024-09-14T09:07:42.939 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_sync_timeout": "60.000000", 2024-09-14T09:07:42.939 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_target_pg_per_osd": "100", 2024-09-14T09:07:42.939 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_tick_interval": "5", 2024-09-14T09:07:42.939 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_timecheck_interval": "300.000000", 2024-09-14T09:07:42.939 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-14T09:07:42.939 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_use_min_delay_socket": "false", 2024-09-14T09:07:42.939 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_warn_older_version_delay": "604800", 2024-09-14T09:07:42.939 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-14T09:07:42.939 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-14T09:07:42.939 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-14T09:07:42.940 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-14T09:07:42.940 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-14T09:07:42.940 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-14T09:07:42.940 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-14T09:07:42.940 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_warn_on_misplaced": "false", 2024-09-14T09:07:42.940 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-14T09:07:42.940 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_warn_on_older_version": "true", 2024-09-14T09:07:42.940 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-14T09:07:42.940 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-14T09:07:42.940 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-14T09:07:42.940 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-14T09:07:42.940 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-14T09:07:42.940 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-14T09:07:42.940 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-14T09:07:42.941 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-14T09:07:42.941 INFO:teuthology.orchestra.run.smithi116.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-14T09:07:42.941 INFO:teuthology.orchestra.run.smithi116.stdout: "monmap": "", 2024-09-14T09:07:42.941 INFO:teuthology.orchestra.run.smithi116.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-14T09:07:42.941 INFO:teuthology.orchestra.run.smithi116.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-14T09:07:42.941 INFO:teuthology.orchestra.run.smithi116.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-14T09:07:42.941 INFO:teuthology.orchestra.run.smithi116.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-14T09:07:42.941 INFO:teuthology.orchestra.run.smithi116.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-14T09:07:42.941 INFO:teuthology.orchestra.run.smithi116.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-14T09:07:42.941 INFO:teuthology.orchestra.run.smithi116.stdout: "motr_tracing_enabled": "false", 2024-09-14T09:07:42.941 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_async_op_threads": "3", 2024-09-14T09:07:42.941 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-14T09:07:42.941 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_async_rdma_cm": "false", 2024-09-14T09:07:42.942 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_async_rdma_device_name": "", 2024-09-14T09:07:42.942 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_async_rdma_dscp": "96", 2024-09-14T09:07:42.942 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-14T09:07:42.942 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-14T09:07:42.942 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_async_rdma_local_gid": "", 2024-09-14T09:07:42.942 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-14T09:07:42.942 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_async_rdma_port_num": "1", 2024-09-14T09:07:42.942 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-14T09:07:42.942 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-14T09:07:42.942 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-14T09:07:42.942 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-14T09:07:42.942 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_async_rdma_sl": "3", 2024-09-14T09:07:42.942 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_async_rdma_support_srq": "true", 2024-09-14T09:07:42.942 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_async_rdma_type": "ib", 2024-09-14T09:07:42.942 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_async_reap_threshold": "5", 2024-09-14T09:07:42.943 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_bind_before_connect": "false", 2024-09-14T09:07:42.943 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_bind_ipv4": "true", 2024-09-14T09:07:42.943 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_bind_ipv6": "false", 2024-09-14T09:07:42.943 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_bind_msgr1": "true", 2024-09-14T09:07:42.943 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_bind_msgr2": "true", 2024-09-14T09:07:42.943 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_bind_port_max": "7568", 2024-09-14T09:07:42.943 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_bind_port_min": "6800", 2024-09-14T09:07:42.943 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-14T09:07:42.943 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_bind_retry_count": "3", 2024-09-14T09:07:42.943 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_bind_retry_delay": "5", 2024-09-14T09:07:42.943 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_blackhole_client": "false", 2024-09-14T09:07:42.943 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_blackhole_mds": "false", 2024-09-14T09:07:42.943 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_blackhole_mgr": "false", 2024-09-14T09:07:42.944 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_blackhole_mon": "false", 2024-09-14T09:07:42.944 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_blackhole_osd": "false", 2024-09-14T09:07:42.944 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_client_mode": "crc secure", 2024-09-14T09:07:42.944 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-14T09:07:42.944 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_cluster_mode": "crc secure", 2024-09-14T09:07:42.944 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_cluster_type": "", 2024-09-14T09:07:42.944 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_compress_secure": "false", 2024-09-14T09:07:42.944 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_connection_idle_timeout": "900", 2024-09-14T09:07:42.944 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_connection_ready_timeout": "10", 2024-09-14T09:07:42.944 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_crc_data": "true", 2024-09-14T09:07:42.944 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_crc_header": "true", 2024-09-14T09:07:42.944 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_die_on_bad_msg": "false", 2024-09-14T09:07:42.944 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_die_on_bug": "true", 2024-09-14T09:07:42.944 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_die_on_old_message": "true", 2024-09-14T09:07:42.944 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_die_on_skipped_message": "false", 2024-09-14T09:07:42.945 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-14T09:07:42.945 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-14T09:07:42.945 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_dpdk_coremask": "0xF", 2024-09-14T09:07:42.945 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-14T09:07:42.945 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-14T09:07:42.945 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_dpdk_enable_tso": "true", 2024-09-14T09:07:42.945 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-14T09:07:42.945 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-14T09:07:42.945 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_dpdk_hugepages": "", 2024-09-14T09:07:42.945 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-14T09:07:42.945 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-14T09:07:42.945 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_dpdk_lro": "true", 2024-09-14T09:07:42.945 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_dpdk_memory_channel": "4", 2024-09-14T09:07:42.945 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-14T09:07:42.945 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_dpdk_pmd": "", 2024-09-14T09:07:42.946 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_dpdk_port_id": "0", 2024-09-14T09:07:42.946 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-14T09:07:42.946 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-14T09:07:42.946 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_dump_on_send": "false", 2024-09-14T09:07:42.946 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_initial_backoff": "0.200000", 2024-09-14T09:07:42.946 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_inject_delay_max": "1.000000", 2024-09-14T09:07:42.946 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-14T09:07:42.946 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_inject_delay_type": "", 2024-09-14T09:07:42.946 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-14T09:07:42.946 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_inject_network_congestion": "0", 2024-09-14T09:07:42.946 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_inject_socket_failures": "5000", 2024-09-14T09:07:42.946 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_learn_addr_from_peer": "true", 2024-09-14T09:07:42.946 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_max_accept_failures": "4", 2024-09-14T09:07:42.946 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_max_backoff": "15.000000", 2024-09-14T09:07:42.946 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_mon_client_mode": "secure crc", 2024-09-14T09:07:42.947 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-14T09:07:42.947 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_mon_service_mode": "secure crc", 2024-09-14T09:07:42.947 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_osd_compress_min_size": "1024", 2024-09-14T09:07:42.947 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_osd_compress_mode": "none", 2024-09-14T09:07:42.947 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-14T09:07:42.947 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-14T09:07:42.947 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_pq_min_cost": "65536", 2024-09-14T09:07:42.947 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_public_type": "", 2024-09-14T09:07:42.947 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_service_mode": "crc secure", 2024-09-14T09:07:42.947 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_tcp_listen_backlog": "512", 2024-09-14T09:07:42.947 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_tcp_nodelay": "true", 2024-09-14T09:07:42.947 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-14T09:07:42.947 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_tcp_rcvbuf": "0", 2024-09-14T09:07:42.947 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-14T09:07:42.947 INFO:teuthology.orchestra.run.smithi116.stdout: "ms_type": "async+posix", 2024-09-14T09:07:42.948 INFO:teuthology.orchestra.run.smithi116.stdout: "no_config_file": "false", 2024-09-14T09:07:42.948 INFO:teuthology.orchestra.run.smithi116.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-14T09:07:42.948 INFO:teuthology.orchestra.run.smithi116.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-14T09:07:42.948 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter_completion_locks_per_session": "32", 2024-09-14T09:07:42.948 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-14T09:07:42.948 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-14T09:07:42.948 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter_inflight_ops": "1024", 2024-09-14T09:07:42.948 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-14T09:07:42.948 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-14T09:07:42.948 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter_tick_interval": "5.000000", 2024-09-14T09:07:42.948 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter_timeout": "10.000000", 2024-09-14T09:07:42.948 INFO:teuthology.orchestra.run.smithi116.stdout: "objectstore_blackhole": "false", 2024-09-14T09:07:42.948 INFO:teuthology.orchestra.run.smithi116.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-14T09:07:42.949 INFO:teuthology.orchestra.run.smithi116.stdout: "openssl_engine_opts": "", 2024-09-14T09:07:42.949 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_agent_delay_time": "5.000000", 2024-09-14T09:07:42.949 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_agent_hist_halflife": "1000", 2024-09-14T09:07:42.949 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_agent_max_low_ops": "2", 2024-09-14T09:07:42.949 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_agent_max_ops": "4", 2024-09-14T09:07:42.949 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-14T09:07:42.949 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-14T09:07:42.949 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_agent_slop": "0.020000", 2024-09-14T09:07:42.949 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-14T09:07:42.949 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-14T09:07:42.949 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_asio_thread_count": "2", 2024-09-14T09:07:42.949 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_async_recovery_min_cost": "100", 2024-09-14T09:07:42.949 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-14T09:07:42.949 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-14T09:07:42.949 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_backfill_scan_max": "512", 2024-09-14T09:07:42.950 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_backfill_scan_min": "64", 2024-09-14T09:07:42.950 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_backoff_on_degraded": "false", 2024-09-14T09:07:42.950 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_backoff_on_peering": "false", 2024-09-14T09:07:42.950 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_backoff_on_unfound": "true", 2024-09-14T09:07:42.950 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_beacon_report_interval": "300", 2024-09-14T09:07:42.950 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bench_duration": "30", 2024-09-14T09:07:42.950 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-14T09:07:42.950 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bench_max_block_size": "67108864", 2024-09-14T09:07:42.950 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-14T09:07:42.950 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_blkin_trace_all": "false", 2024-09-14T09:07:42.950 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-14T09:07:42.950 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-14T09:07:42.950 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-14T09:07:42.950 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-14T09:07:42.950 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_check_for_log_corruption": "false", 2024-09-14T09:07:42.951 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-14T09:07:42.951 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-14T09:07:42.951 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-14T09:07:42.951 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-14T09:07:42.951 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_class_update_on_start": "true", 2024-09-14T09:07:42.951 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_client_message_cap": "256", 2024-09-14T09:07:42.951 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_client_message_size_cap": "524288000", 2024-09-14T09:07:42.951 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_client_op_priority": "63", 2024-09-14T09:07:42.951 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_client_watch_timeout": "30", 2024-09-14T09:07:42.951 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_command_max_records": "256", 2024-09-14T09:07:42.951 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_compact_on_start": "false", 2024-09-14T09:07:42.951 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-14T09:07:42.951 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-14T09:07:42.952 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-14T09:07:42.952 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_crush_update_on_start": "true", 2024-09-14T09:07:42.952 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_crush_update_weight_set": "true", 2024-09-14T09:07:42.952 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-14T09:07:42.952 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-14T09:07:42.952 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-14T09:07:42.952 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-14T09:07:42.952 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-14T09:07:42.952 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_feed_pullee": "-1", 2024-09-14T09:07:42.952 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-14T09:07:42.952 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-14T09:07:42.952 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-14T09:07:42.952 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_misdirected_ops": "false", 2024-09-14T09:07:42.953 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_no_acting_change": "false", 2024-09-14T09:07:42.953 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_no_purge_strays": "false", 2024-09-14T09:07:42.953 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_op_order": "false", 2024-09-14T09:07:42.953 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-14T09:07:42.953 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-14T09:07:42.953 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-14T09:07:42.953 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-14T09:07:42.953 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_shutdown": "false", 2024-09-14T09:07:42.953 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-14T09:07:42.953 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-14T09:07:42.953 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_trim_objects": "false", 2024-09-14T09:07:42.953 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-14T09:07:42.953 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-14T09:07:42.953 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_verify_snaps": "false", 2024-09-14T09:07:42.954 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-14T09:07:42.954 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-14T09:07:42.954 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_deep_scrub_keys": "1024", 2024-09-14T09:07:42.954 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-14T09:07:42.954 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-14T09:07:42.954 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-14T09:07:42.954 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_deep_scrub_stride": "524288", 2024-09-14T09:07:42.954 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-14T09:07:42.954 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-14T09:07:42.954 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_default_notify_timeout": "30", 2024-09-14T09:07:42.954 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_delete_sleep": "0.000000", 2024-09-14T09:07:42.954 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-14T09:07:42.954 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-14T09:07:42.954 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-14T09:07:42.954 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_discard_disconnected_ops": "true", 2024-09-14T09:07:42.955 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_ec_partial_reads": "true", 2024-09-14T09:07:42.955 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_enable_op_tracker": "true", 2024-09-14T09:07:42.955 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-14T09:07:42.955 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-14T09:07:42.955 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-14T09:07:42.955 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-14T09:07:42.955 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_fast_info": "true", 2024-09-14T09:07:42.955 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_fast_shutdown": "true", 2024-09-14T09:07:42.955 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-14T09:07:42.955 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-14T09:07:42.955 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-14T09:07:42.955 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-14T09:07:42.955 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-14T09:07:42.955 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_function_tracing": "false", 2024-09-14T09:07:42.956 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_heartbeat_grace": "20", 2024-09-14T09:07:42.956 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_heartbeat_interval": "6", 2024-09-14T09:07:42.956 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-14T09:07:42.956 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_heartbeat_min_peers": "10", 2024-09-14T09:07:42.956 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_heartbeat_min_size": "2000", 2024-09-14T09:07:42.956 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_heartbeat_stale": "600", 2024-09-14T09:07:42.956 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-14T09:07:42.956 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_hit_set_max_size": "100000", 2024-09-14T09:07:42.956 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_hit_set_min_size": "1000", 2024-09-14T09:07:42.956 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-14T09:07:42.956 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-14T09:07:42.956 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-14T09:07:42.956 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-14T09:07:42.956 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-14T09:07:42.956 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-14T09:07:42.957 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_journal_size": "5120", 2024-09-14T09:07:42.957 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_kill_backfill_at": "0", 2024-09-14T09:07:42.957 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-14T09:07:42.957 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_map_cache_size": "50", 2024-09-14T09:07:42.957 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_map_dedup": "true", 2024-09-14T09:07:42.957 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_map_message_max": "40", 2024-09-14T09:07:42.957 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-14T09:07:42.957 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_map_share_max_epochs": "40", 2024-09-14T09:07:42.957 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_max_attr_name_len": "100", 2024-09-14T09:07:42.957 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_max_attr_size": "0", 2024-09-14T09:07:42.957 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_max_backfills": "1", 2024-09-14T09:07:42.957 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_max_markdown_count": "5", 2024-09-14T09:07:42.957 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_max_markdown_period": "600", 2024-09-14T09:07:42.957 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_max_object_name_len": "2048", 2024-09-14T09:07:42.958 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_max_object_namespace_len": "256", 2024-09-14T09:07:42.958 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_max_object_size": "134217728", 2024-09-14T09:07:42.958 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-14T09:07:42.958 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-14T09:07:42.958 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_max_pg_blocked_by": "16", 2024-09-14T09:07:42.958 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_max_pg_log_entries": "10000", 2024-09-14T09:07:42.958 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-14T09:07:42.958 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_max_pgls": "1024", 2024-09-14T09:07:42.958 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_max_push_cost": "8388608", 2024-09-14T09:07:42.958 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_max_push_objects": "10", 2024-09-14T09:07:42.958 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_max_scrubs": "3", 2024-09-14T09:07:42.958 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-14T09:07:42.958 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_max_trimming_pgs": "2", 2024-09-14T09:07:42.958 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_max_write_op_reply_len": "64", 2024-09-14T09:07:42.958 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_max_write_size": "90", 2024-09-14T09:07:42.959 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-14T09:07:42.959 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-14T09:07:42.959 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-14T09:07:42.959 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-14T09:07:42.959 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-14T09:07:42.959 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-14T09:07:42.959 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-14T09:07:42.959 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-14T09:07:42.959 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mclock_profile": "balanced", 2024-09-14T09:07:42.959 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-14T09:07:42.959 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-14T09:07:42.959 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-14T09:07:42.959 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-14T09:07:42.960 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-14T09:07:42.960 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-14T09:07:42.960 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-14T09:07:42.960 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-14T09:07:42.960 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-14T09:07:42.960 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-14T09:07:42.960 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-14T09:07:42.960 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_memory_base": "805306368", 2024-09-14T09:07:42.960 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_memory_cache_min": "134217728", 2024-09-14T09:07:42.960 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-14T09:07:42.960 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-14T09:07:42.960 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_memory_target": "4294967296", 2024-09-14T09:07:42.960 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_memory_target_autotune": "false", 2024-09-14T09:07:42.961 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-14T09:07:42.961 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_min_pg_log_entries": "250", 2024-09-14T09:07:42.961 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_min_recovery_priority": "0", 2024-09-14T09:07:42.961 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-14T09:07:42.961 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-14T09:07:42.961 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mon_report_interval": "5", 2024-09-14T09:07:42.961 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-14T09:07:42.961 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-14T09:07:42.961 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_num_cache_shards": "32", 2024-09-14T09:07:42.961 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_num_op_tracker_shard": "32", 2024-09-14T09:07:42.961 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_numa_auto_affinity": "true", 2024-09-14T09:07:42.961 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_numa_node": "-1", 2024-09-14T09:07:42.961 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_numa_prefer_iface": "true", 2024-09-14T09:07:42.961 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-14T09:07:42.962 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_objecter_finishers": "1", 2024-09-14T09:07:42.962 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_objectstore": "bluestore", 2024-09-14T09:07:42.962 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_objectstore_fuse": "false", 2024-09-14T09:07:42.962 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-14T09:07:42.962 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_objectstore_tracing": "false", 2024-09-14T09:07:42.962 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_op_complaint_time": "30.000000", 2024-09-14T09:07:42.962 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_op_history_duration": "600", 2024-09-14T09:07:42.962 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_op_history_size": "20", 2024-09-14T09:07:42.962 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_op_history_slow_op_size": "20", 2024-09-14T09:07:42.962 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-14T09:07:42.962 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_op_log_threshold": "5", 2024-09-14T09:07:42.962 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_op_num_shards": "0", 2024-09-14T09:07:42.962 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_op_num_shards_hdd": "5", 2024-09-14T09:07:42.962 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_op_num_shards_ssd": "8", 2024-09-14T09:07:42.963 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-14T09:07:42.963 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-14T09:07:42.963 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-14T09:07:42.963 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-14T09:07:42.963 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_op_pq_min_cost": "65536", 2024-09-14T09:07:42.963 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-14T09:07:42.963 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_op_queue_cut_off": "high", 2024-09-14T09:07:42.963 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-14T09:07:42.963 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_op_thread_timeout": "15", 2024-09-14T09:07:42.963 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_open_classes_on_start": "true", 2024-09-14T09:07:42.963 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_os_flags": "0", 2024-09-14T09:07:42.963 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_peering_op_priority": "255", 2024-09-14T09:07:42.963 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pg_delete_cost": "1048576", 2024-09-14T09:07:42.963 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pg_delete_priority": "5", 2024-09-14T09:07:42.964 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-14T09:07:42.964 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-14T09:07:42.964 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-14T09:07:42.964 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pg_log_trim_max": "10000", 2024-09-14T09:07:42.964 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pg_log_trim_min": "100", 2024-09-14T09:07:42.964 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-14T09:07:42.964 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-14T09:07:42.964 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-14T09:07:42.964 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-14T09:07:42.964 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-14T09:07:42.964 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-14T09:07:42.964 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-14T09:07:42.964 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-14T09:07:42.965 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-14T09:07:42.965 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-14T09:07:42.965 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_crimson": "false", 2024-09-14T09:07:42.965 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-14T09:07:42.965 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-14T09:07:42.965 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-14T09:07:42.965 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-14T09:07:42.965 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-14T09:07:42.965 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-14T09:07:42.965 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-14T09:07:42.965 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-14T09:07:42.965 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_flags": "0", 2024-09-14T09:07:42.965 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-14T09:07:42.965 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_min_size": "0", 2024-09-14T09:07:42.966 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-14T09:07:42.966 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_pg_num": "32", 2024-09-14T09:07:42.966 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_pgp_num": "0", 2024-09-14T09:07:42.966 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-14T09:07:42.966 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_read_ratio": "70", 2024-09-14T09:07:42.966 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_size": "2", 2024-09-14T09:07:42.966 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_default_type": "replicated", 2024-09-14T09:07:42.966 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-14T09:07:42.966 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-14T09:07:42.966 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_push_per_object_cost": "1000", 2024-09-14T09:07:42.966 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-14T09:07:42.966 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_recover_clone_overlap": "true", 2024-09-14T09:07:42.966 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-14T09:07:42.967 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_recovery_cost": "20971520", 2024-09-14T09:07:42.967 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-14T09:07:42.967 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_recovery_max_active": "0", 2024-09-14T09:07:42.967 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-14T09:07:42.967 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-14T09:07:42.967 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-14T09:07:42.967 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-14T09:07:42.967 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_recovery_max_single_start": "1", 2024-09-14T09:07:42.967 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_recovery_op_priority": "3", 2024-09-14T09:07:42.967 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-14T09:07:42.967 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_recovery_priority": "5", 2024-09-14T09:07:42.967 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-14T09:07:42.967 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_recovery_sleep": "0.000000", 2024-09-14T09:07:42.967 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-14T09:07:42.968 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-14T09:07:42.968 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-14T09:07:42.968 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_repair_during_recovery": "false", 2024-09-14T09:07:42.968 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_requested_scrub_priority": "120", 2024-09-14T09:07:42.968 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-14T09:07:42.968 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-14T09:07:42.968 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_scrub_auto_repair": "false", 2024-09-14T09:07:42.968 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-14T09:07:42.968 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-14T09:07:42.968 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_scrub_begin_hour": "0", 2024-09-14T09:07:42.968 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_scrub_begin_week_day": "0", 2024-09-14T09:07:42.968 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_scrub_chunk_max": "25", 2024-09-14T09:07:42.968 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_scrub_chunk_min": "5", 2024-09-14T09:07:42.969 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_scrub_cost": "52428800", 2024-09-14T09:07:42.969 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-14T09:07:42.969 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_scrub_during_recovery": "false", 2024-09-14T09:07:42.969 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_scrub_end_hour": "0", 2024-09-14T09:07:42.969 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_scrub_end_week_day": "0", 2024-09-14T09:07:42.969 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_scrub_event_cost": "4096", 2024-09-14T09:07:42.969 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-14T09:07:42.969 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-14T09:07:42.969 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_scrub_invalid_stats": "true", 2024-09-14T09:07:42.969 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-14T09:07:42.969 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-14T09:07:42.969 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_scrub_max_preemptions": "5", 2024-09-14T09:07:42.969 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-14T09:07:42.969 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_scrub_priority": "5", 2024-09-14T09:07:42.970 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_scrub_sleep": "0.000000", 2024-09-14T09:07:42.970 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-14T09:07:42.970 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-14T09:07:42.970 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-14T09:07:42.970 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-14T09:07:42.970 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_skip_data_digest": "false", 2024-09-14T09:07:42.970 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_smart_report_timeout": "5", 2024-09-14T09:07:42.970 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_snap_trim_cost": "1048576", 2024-09-14T09:07:42.970 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_snap_trim_priority": "5", 2024-09-14T09:07:42.970 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-14T09:07:42.970 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-14T09:07:42.970 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-14T09:07:42.970 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-14T09:07:42.970 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-14T09:07:42.971 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-14T09:07:42.971 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-14T09:07:42.971 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_target_transaction_size": "30", 2024-09-14T09:07:42.971 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-14T09:07:42.971 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-14T09:07:42.971 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-14T09:07:42.971 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-14T09:07:42.971 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-14T09:07:42.971 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-14T09:07:42.971 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-14T09:07:42.971 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-14T09:07:42.971 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-14T09:07:42.971 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-14T09:07:42.972 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_tracing": "false", 2024-09-14T09:07:42.972 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_use_stale_snap": "false", 2024-09-14T09:07:42.972 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-14T09:07:42.972 INFO:teuthology.orchestra.run.smithi116.stdout: "osdc_blkin_trace_all": "false", 2024-09-14T09:07:42.972 INFO:teuthology.orchestra.run.smithi116.stdout: "paxos_kill_at": "0", 2024-09-14T09:07:42.972 INFO:teuthology.orchestra.run.smithi116.stdout: "paxos_max_join_drift": "10", 2024-09-14T09:07:42.972 INFO:teuthology.orchestra.run.smithi116.stdout: "paxos_min": "500", 2024-09-14T09:07:42.972 INFO:teuthology.orchestra.run.smithi116.stdout: "paxos_min_wait": "0.050000", 2024-09-14T09:07:42.972 INFO:teuthology.orchestra.run.smithi116.stdout: "paxos_propose_interval": "1.000000", 2024-09-14T09:07:42.972 INFO:teuthology.orchestra.run.smithi116.stdout: "paxos_service_trim_max": "500", 2024-09-14T09:07:42.972 INFO:teuthology.orchestra.run.smithi116.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-14T09:07:42.972 INFO:teuthology.orchestra.run.smithi116.stdout: "paxos_service_trim_min": "250", 2024-09-14T09:07:42.972 INFO:teuthology.orchestra.run.smithi116.stdout: "paxos_stash_full_interval": "25", 2024-09-14T09:07:42.972 INFO:teuthology.orchestra.run.smithi116.stdout: "paxos_trim_max": "500", 2024-09-14T09:07:42.973 INFO:teuthology.orchestra.run.smithi116.stdout: "paxos_trim_min": "250", 2024-09-14T09:07:42.973 INFO:teuthology.orchestra.run.smithi116.stdout: "perf": "true", 2024-09-14T09:07:42.973 INFO:teuthology.orchestra.run.smithi116.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-14T09:07:42.973 INFO:teuthology.orchestra.run.smithi116.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-14T09:07:42.973 INFO:teuthology.orchestra.run.smithi116.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-14T09:07:42.973 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "-", 2024-09-14T09:07:42.973 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrv": "", 2024-09-14T09:07:42.973 INFO:teuthology.orchestra.run.smithi116.stdout: "public_bind_addr": "-", 2024-09-14T09:07:42.973 INFO:teuthology.orchestra.run.smithi116.stdout: "public_network": "", 2024-09-14T09:07:42.973 INFO:teuthology.orchestra.run.smithi116.stdout: "public_network_interface": "", 2024-09-14T09:07:42.973 INFO:teuthology.orchestra.run.smithi116.stdout: "qat_compressor_busy_polling": "false", 2024-09-14T09:07:42.973 INFO:teuthology.orchestra.run.smithi116.stdout: "qat_compressor_enabled": "false", 2024-09-14T09:07:42.973 INFO:teuthology.orchestra.run.smithi116.stdout: "qat_compressor_session_max_number": "256", 2024-09-14T09:07:42.974 INFO:teuthology.orchestra.run.smithi116.stdout: "rados_mon_op_timeout": "0", 2024-09-14T09:07:42.974 INFO:teuthology.orchestra.run.smithi116.stdout: "rados_osd_op_timeout": "0", 2024-09-14T09:07:42.974 INFO:teuthology.orchestra.run.smithi116.stdout: "rados_tracing": "false", 2024-09-14T09:07:42.974 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_atime_update_interval": "60", 2024-09-14T09:07:42.974 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-14T09:07:42.974 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_balance_parent_reads": "false", 2024-09-14T09:07:42.974 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_balance_snap_reads": "false", 2024-09-14T09:07:42.974 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_blkin_trace_all": "false", 2024-09-14T09:07:42.974 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-14T09:07:42.974 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-14T09:07:42.974 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_cache": "true", 2024-09-14T09:07:42.974 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-14T09:07:42.974 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-14T09:07:42.974 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-14T09:07:42.975 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-14T09:07:42.975 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_cache_policy": "writearound", 2024-09-14T09:07:42.975 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_cache_size": "33554432", 2024-09-14T09:07:42.975 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-14T09:07:42.975 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-14T09:07:42.975 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_clone_copy_on_read": "false", 2024-09-14T09:07:42.975 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_compression_hint": "none", 2024-09-14T09:07:42.975 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_concurrent_management_ops": "10", 2024-09-14T09:07:42.975 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-14T09:07:42.975 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_default_clone_format": "auto", 2024-09-14T09:07:42.975 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_default_data_pool": "", 2024-09-14T09:07:42.975 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_default_features": "61", 2024-09-14T09:07:42.975 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_default_format": "2", 2024-09-14T09:07:42.975 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_default_map_options": "", 2024-09-14T09:07:42.975 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_default_order": "22", 2024-09-14T09:07:42.976 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_default_pool": "rbd", 2024-09-14T09:07:42.976 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-14T09:07:42.976 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_default_stripe_count": "0", 2024-09-14T09:07:42.976 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_default_stripe_unit": "0", 2024-09-14T09:07:42.976 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-14T09:07:42.976 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-14T09:07:42.976 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-14T09:07:42.976 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_enable_alloc_hint": "true", 2024-09-14T09:07:42.976 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-14T09:07:42.976 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_io_scheduler": "simple", 2024-09-14T09:07:42.976 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-14T09:07:42.976 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-14T09:07:42.976 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-14T09:07:42.977 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-14T09:07:42.977 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-14T09:07:42.977 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-14T09:07:42.977 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-14T09:07:42.977 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-14T09:07:42.977 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-14T09:07:42.977 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_journal_order": "24", 2024-09-14T09:07:42.977 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_journal_pool": "", 2024-09-14T09:07:42.977 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_journal_splay_width": "4", 2024-09-14T09:07:42.977 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_localize_parent_reads": "false", 2024-09-14T09:07:42.977 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_localize_snap_reads": "false", 2024-09-14T09:07:42.977 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-14T09:07:42.977 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-14T09:07:42.977 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-14T09:07:42.978 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-14T09:07:42.978 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-14T09:07:42.978 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-14T09:07:42.978 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-14T09:07:42.978 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-14T09:07:42.978 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-14T09:07:42.978 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-14T09:07:42.978 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-14T09:07:42.978 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-14T09:07:42.978 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-14T09:07:42.978 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-14T09:07:42.978 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-14T09:07:42.978 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-14T09:07:42.979 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-14T09:07:42.979 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-14T09:07:42.979 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-14T09:07:42.979 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-14T09:07:42.979 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-14T09:07:42.979 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-14T09:07:42.979 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-14T09:07:42.979 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-14T09:07:42.979 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-14T09:07:42.979 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-14T09:07:42.979 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-14T09:07:42.979 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-14T09:07:42.979 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-14T09:07:42.979 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-14T09:07:42.980 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-14T09:07:42.980 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_mtime_update_interval": "60", 2024-09-14T09:07:42.980 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_non_blocking_aio": "true", 2024-09-14T09:07:42.980 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_op_thread_timeout": "60", 2024-09-14T09:07:42.980 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_op_threads": "1", 2024-09-14T09:07:42.980 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_parent_cache_enabled": "false", 2024-09-14T09:07:42.980 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-14T09:07:42.980 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-14T09:07:42.980 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-14T09:07:42.980 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_plugins": "", 2024-09-14T09:07:42.980 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_qos_bps_burst": "0", 2024-09-14T09:07:42.980 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-14T09:07:42.980 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_qos_bps_limit": "0", 2024-09-14T09:07:42.981 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_qos_exclude_ops": "0", 2024-09-14T09:07:42.981 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_qos_iops_burst": "0", 2024-09-14T09:07:42.981 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-14T09:07:42.981 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_qos_iops_limit": "0", 2024-09-14T09:07:42.981 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-14T09:07:42.981 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-14T09:07:42.981 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-14T09:07:42.981 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-14T09:07:42.981 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-14T09:07:42.981 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-14T09:07:42.981 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-14T09:07:42.981 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-14T09:07:42.981 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-14T09:07:42.981 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-14T09:07:42.982 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-14T09:07:42.982 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-14T09:07:42.982 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-14T09:07:42.982 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-14T09:07:42.982 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_read_from_replica_policy": "default", 2024-09-14T09:07:42.982 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-14T09:07:42.982 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-14T09:07:42.982 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-14T09:07:42.982 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-14T09:07:42.982 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_skip_partial_discard": "true", 2024-09-14T09:07:42.982 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-14T09:07:42.982 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_tracing": "false", 2024-09-14T09:07:42.982 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_validate_names": "true", 2024-09-14T09:07:42.982 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd_validate_pool": "true", 2024-09-14T09:07:42.983 INFO:teuthology.orchestra.run.smithi116.stdout: "restapi_base_url": "", 2024-09-14T09:07:42.983 INFO:teuthology.orchestra.run.smithi116.stdout: "restapi_log_level": "", 2024-09-14T09:07:42.983 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-14T09:07:42.983 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-14T09:07:42.983 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_acl_grants_max_num": "100", 2024-09-14T09:07:42.983 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_admin_entry": "admin", 2024-09-14T09:07:42.983 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-14T09:07:42.983 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_asio_assert_yielding": "false", 2024-09-14T09:07:42.983 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_backend_store": "rados", 2024-09-14T09:07:42.984 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_barbican_url": "", 2024-09-14T09:07:42.984 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_beast_enable_async": "true", 2024-09-14T09:07:42.984 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_bucket_counters_cache": "false", 2024-09-14T09:07:42.984 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-14T09:07:42.984 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-14T09:07:42.984 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-14T09:07:42.984 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-14T09:07:42.984 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-14T09:07:42.984 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-14T09:07:42.984 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-14T09:07:42.984 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-14T09:07:42.984 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_cache_enabled": "true", 2024-09-14T09:07:42.984 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_cache_expiry_interval": "900", 2024-09-14T09:07:42.984 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_cache_lru_size": "25000", 2024-09-14T09:07:42.985 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_config_store": "rados", 2024-09-14T09:07:42.985 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_content_length_compat": "false", 2024-09-14T09:07:42.985 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_copy_obj_progress": "true", 2024-09-14T09:07:42.985 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-14T09:07:42.985 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_cors_rules_max_num": "100", 2024-09-14T09:07:42.985 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_cross_domain_policy": "", 2024-09-14T09:07:42.985 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-14T09:07:42.985 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_kmip_addr": "", 2024-09-14T09:07:42.985 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-14T09:07:42.985 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-14T09:07:42.985 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-14T09:07:42.985 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-14T09:07:42.985 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_kmip_password": "", 2024-09-14T09:07:42.986 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-14T09:07:42.986 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_kmip_username": "", 2024-09-14T09:07:42.986 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_require_ssl": "true", 2024-09-14T09:07:42.986 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-14T09:07:42.986 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-14T09:07:42.986 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-14T09:07:42.986 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-14T09:07:42.986 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-14T09:07:42.986 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-14T09:07:42.986 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-14T09:07:42.986 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-14T09:07:42.986 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-14T09:07:42.986 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-14T09:07:42.987 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-14T09:07:42.987 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-14T09:07:42.987 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-14T09:07:42.987 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-14T09:07:42.987 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-14T09:07:42.987 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_vault_addr": "", 2024-09-14T09:07:42.987 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_vault_auth": "token", 2024-09-14T09:07:42.987 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_vault_namespace": "", 2024-09-14T09:07:42.987 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_vault_prefix": "", 2024-09-14T09:07:42.987 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-14T09:07:42.987 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-14T09:07:42.987 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-14T09:07:42.987 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-14T09:07:42.987 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_vault_token_file": "", 2024-09-14T09:07:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-14T09:07:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_curl_buffersize": "524288", 2024-09-14T09:07:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-14T09:07:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_curl_low_speed_time": "300", 2024-09-14T09:07:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-14T09:07:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-14T09:07:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-14T09:07:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-14T09:07:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-14T09:07:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-14T09:07:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-14T09:07:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-14T09:07:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-14T09:07:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-14T09:07:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-14T09:07:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-14T09:07:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-14T09:07:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-14T09:07:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-14T09:07:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-14T09:07:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-14T09:07:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-14T09:07:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-14T09:07:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_data_log_changes_size": "1000", 2024-09-14T09:07:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_data_log_num_shards": "128", 2024-09-14T09:07:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-14T09:07:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_data_log_window": "30", 2024-09-14T09:07:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-14T09:07:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-14T09:07:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-14T09:07:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-14T09:07:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-14T09:07:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-14T09:07:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-14T09:07:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-14T09:07:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-14T09:07:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-14T09:07:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-14T09:07:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-14T09:07:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-14T09:07:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_disable_s3select": "false", 2024-09-14T09:07:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-14T09:07:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-14T09:07:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-14T09:07:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-14T09:07:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-14T09:07:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-14T09:07:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-14T09:07:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-14T09:07:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-14T09:07:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-14T09:07:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-14T09:07:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-14T09:07:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_dns_name": "", 2024-09-14T09:07:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_dns_s3website_name": "", 2024-09-14T09:07:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_dynamic_resharding": "true", 2024-09-14T09:07:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-14T09:07:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-14T09:07:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-14T09:07:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_enable_gc_threads": "true", 2024-09-14T09:07:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_enable_lc_threads": "true", 2024-09-14T09:07:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_enable_mdsearch": "true", 2024-09-14T09:07:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_enable_ops_log": "false", 2024-09-14T09:07:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_enable_quota_threads": "true", 2024-09-14T09:07:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_enable_static_website": "false", 2024-09-14T09:07:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_enable_usage_log": "false", 2024-09-14T09:07:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_enforce_swift_acls": "true", 2024-09-14T09:07:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_exit_timeout_secs": "120", 2024-09-14T09:07:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_expose_bucket": "false", 2024-09-14T09:07:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_extended_http_attrs": "", 2024-09-14T09:07:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_filter": "none", 2024-09-14T09:07:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-14T09:07:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_frontends": "beast port=7480", 2024-09-14T09:07:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-14T09:07:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_gc_max_deferred": "50", 2024-09-14T09:07:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-14T09:07:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_gc_max_objs": "32", 2024-09-14T09:07:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-14T09:07:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-14T09:07:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-14T09:07:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-14T09:07:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_gc_processor_period": "3600", 2024-09-14T09:07:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-14T09:07:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-14T09:07:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-14T09:07:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-14T09:07:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_init_timeout": "300", 2024-09-14T09:07:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-14T09:07:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-14T09:07:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_kafka_connection_idle": "300", 2024-09-14T09:07:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-14T09:07:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-14T09:07:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-14T09:07:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-14T09:07:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-14T09:07:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_admin_domain": "", 2024-09-14T09:07:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_admin_password": "", 2024-09-14T09:07:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_admin_password_path": "", 2024-09-14T09:07:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_admin_project": "", 2024-09-14T09:07:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_admin_tenant": "", 2024-09-14T09:07:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_admin_token": "", 2024-09-14T09:07:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_admin_token_path": "", 2024-09-14T09:07:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_admin_user": "", 2024-09-14T09:07:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_barbican_domain": "", 2024-09-14T09:07:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_barbican_password": "", 2024-09-14T09:07:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_barbican_project": "", 2024-09-14T09:07:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-14T09:07:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_barbican_user": "", 2024-09-14T09:07:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-14T09:07:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-14T09:07:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-14T09:07:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-14T09:07:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-14T09:07:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_url": "", 2024-09-14T09:07:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-14T09:07:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_lc_debug_interval": "-1", 2024-09-14T09:07:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_lc_lock_max_time": "90", 2024-09-14T09:07:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_lc_max_objs": "32", 2024-09-14T09:07:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_lc_max_rules": "1000", 2024-09-14T09:07:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_lc_max_worker": "3", 2024-09-14T09:07:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-14T09:07:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_lc_thread_delay": "0", 2024-09-14T09:07:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-14T09:07:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_ldap_dnattr": "uid", 2024-09-14T09:07:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-14T09:07:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_ldap_searchfilter": "", 2024-09-14T09:07:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-14T09:07:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_ldap_uri": "", 2024-09-14T09:07:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-14T09:07:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-14T09:07:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-14T09:07:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-14T09:07:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_log_http_headers": "", 2024-09-14T09:07:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-14T09:07:42.998 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-14T09:07:42.998 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_log_object_name_utc": "false", 2024-09-14T09:07:42.998 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-14T09:07:42.998 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-14T09:07:42.998 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_max_attr_name_len": "0", 2024-09-14T09:07:42.998 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_max_attr_size": "0", 2024-09-14T09:07:42.998 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-14T09:07:42.998 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_max_chunk_size": "4194304", 2024-09-14T09:07:42.998 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-14T09:07:42.998 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-14T09:07:42.998 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-14T09:07:42.998 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_max_listing_results": "1000", 2024-09-14T09:07:42.998 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_max_notify_retries": "10", 2024-09-14T09:07:42.998 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-14T09:07:42.998 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_max_put_param_size": "1048576", 2024-09-14T09:07:42.999 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_max_put_size": "5368709120", 2024-09-14T09:07:42.999 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_max_slo_entries": "1000", 2024-09-14T09:07:42.999 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_md_log_max_shards": "64", 2024-09-14T09:07:42.999 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-14T09:07:42.999 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-14T09:07:42.999 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-14T09:07:42.999 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-14T09:07:42.999 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_mp_lock_max_time": "600", 2024-09-14T09:07:42.999 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-14T09:07:42.999 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-14T09:07:42.999 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-14T09:07:42.999 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-14T09:07:42.999 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-14T09:07:42.999 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-14T09:07:42.999 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-14T09:07:43.000 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-14T09:07:43.000 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_nfs_max_gc": "300", 2024-09-14T09:07:43.000 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-14T09:07:43.000 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-14T09:07:43.000 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-14T09:07:43.000 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-14T09:07:43.000 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-14T09:07:43.000 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-14T09:07:43.000 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-14T09:07:43.000 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_num_async_rados_threads": "32", 2024-09-14T09:07:43.000 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_num_control_oids": "8", 2024-09-14T09:07:43.000 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_numa_node": "-1", 2024-09-14T09:07:43.000 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-14T09:07:43.000 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-14T09:07:43.000 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_objexp_chunk_size": "100", 2024-09-14T09:07:43.001 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_objexp_gc_interval": "600", 2024-09-14T09:07:43.001 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-14T09:07:43.001 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-14T09:07:43.001 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-14T09:07:43.001 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_op_thread_timeout": "600", 2024-09-14T09:07:43.001 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_op_tracing": "false", 2024-09-14T09:07:43.001 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_opa_token": "", 2024-09-14T09:07:43.001 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_opa_url": "", 2024-09-14T09:07:43.001 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_opa_verify_ssl": "true", 2024-09-14T09:07:43.001 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-14T09:07:43.001 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-14T09:07:43.001 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_ops_log_rados": "false", 2024-09-14T09:07:43.001 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_ops_log_socket_path": "", 2024-09-14T09:07:43.002 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-14T09:07:43.002 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-14T09:07:43.002 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-14T09:07:43.002 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_period_push_interval": "2.000000", 2024-09-14T09:07:43.002 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-14T09:07:43.002 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-14T09:07:43.002 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-14T09:07:43.002 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-14T09:07:43.002 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_posix_cache_lanes": "3", 2024-09-14T09:07:43.002 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-14T09:07:43.002 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-14T09:07:43.002 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_posix_cache_partitions": "3", 2024-09-14T09:07:43.002 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-14T09:07:43.002 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_print_continue": "true", 2024-09-14T09:07:43.003 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-14T09:07:43.003 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-14T09:07:43.003 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-14T09:07:43.003 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-14T09:07:43.003 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-14T09:07:43.003 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_rados_tracing": "false", 2024-09-14T09:07:43.003 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_realm": "", 2024-09-14T09:07:43.003 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_realm_id": "", 2024-09-14T09:07:43.003 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-14T09:07:43.003 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_region": "", 2024-09-14T09:07:43.003 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-14T09:07:43.003 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-14T09:07:43.003 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-14T09:07:43.003 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-14T09:07:43.003 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_request_uri": "", 2024-09-14T09:07:43.004 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_reshard_batch_size": "64", 2024-09-14T09:07:43.004 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-14T09:07:43.004 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-14T09:07:43.004 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_reshard_max_aio": "128", 2024-09-14T09:07:43.004 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_reshard_num_logs": "16", 2024-09-14T09:07:43.004 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-14T09:07:43.004 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-14T09:07:43.004 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_reshard_thread_interval": "600", 2024-09-14T09:07:43.004 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-14T09:07:43.004 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_resolve_cname": "false", 2024-09-14T09:07:43.004 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-14T09:07:43.004 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_run_sync_thread": "true", 2024-09-14T09:07:43.004 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-14T09:07:43.004 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-14T09:07:43.005 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-14T09:07:43.005 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-14T09:07:43.005 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-14T09:07:43.005 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-14T09:07:43.005 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-14T09:07:43.005 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-14T09:07:43.005 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-14T09:07:43.005 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_scheduler_type": "throttler", 2024-09-14T09:07:43.005 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_script_uri": "", 2024-09-14T09:07:43.005 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_service_provider_name": "", 2024-09-14T09:07:43.005 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-14T09:07:43.005 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_sts_client_id": "", 2024-09-14T09:07:43.005 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_sts_client_secret": "", 2024-09-14T09:07:43.005 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_sts_entry": "sts", 2024-09-14T09:07:43.006 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_sts_key": "sts", 2024-09-14T09:07:43.006 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-14T09:07:43.006 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_sts_min_session_duration": "900", 2024-09-14T09:07:43.006 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_sts_token_introspection_url": "", 2024-09-14T09:07:43.006 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_swift_account_in_url": "false", 2024-09-14T09:07:43.006 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_swift_auth_entry": "auth", 2024-09-14T09:07:43.006 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_swift_auth_url": "", 2024-09-14T09:07:43.006 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_swift_custom_header": "", 2024-09-14T09:07:43.006 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-14T09:07:43.006 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_swift_need_stats": "true", 2024-09-14T09:07:43.006 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_swift_tenant_name": "", 2024-09-14T09:07:43.006 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_swift_token_expiration": "86400", 2024-09-14T09:07:43.006 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_swift_url": "", 2024-09-14T09:07:43.006 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_swift_url_prefix": "swift", 2024-09-14T09:07:43.007 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-14T09:07:43.007 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-14T09:07:43.007 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-14T09:07:43.007 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_sync_lease_period": "120", 2024-09-14T09:07:43.007 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-14T09:07:43.007 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-14T09:07:43.007 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-14T09:07:43.007 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-14T09:07:43.007 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-14T09:07:43.007 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-14T09:07:43.007 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-14T09:07:43.007 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-14T09:07:43.007 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-14T09:07:43.008 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_thread_pool_size": "512", 2024-09-14T09:07:43.008 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-14T09:07:43.008 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-14T09:07:43.008 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-14T09:07:43.008 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-14T09:07:43.008 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_torrent_comment": "", 2024-09-14T09:07:43.008 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_torrent_createby": "", 2024-09-14T09:07:43.008 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_torrent_encoding": "", 2024-09-14T09:07:43.008 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_torrent_flag": "false", 2024-09-14T09:07:43.008 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-14T09:07:43.008 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_torrent_origin": "", 2024-09-14T09:07:43.008 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-14T09:07:43.008 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_torrent_tracker": "", 2024-09-14T09:07:43.009 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_trust_forwarded_https": "false", 2024-09-14T09:07:43.009 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-14T09:07:43.009 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-14T09:07:43.009 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_usage_max_shards": "32", 2024-09-14T09:07:43.009 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_usage_max_user_shards": "1", 2024-09-14T09:07:43.009 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_use_opa_authz": "false", 2024-09-14T09:07:43.009 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_user_counters_cache": "false", 2024-09-14T09:07:43.009 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-14T09:07:43.009 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-14T09:07:43.009 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-14T09:07:43.009 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_user_max_buckets": "1000", 2024-09-14T09:07:43.009 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_user_policies_max_num": "100", 2024-09-14T09:07:43.009 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-14T09:07:43.010 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-14T09:07:43.010 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-14T09:07:43.010 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-14T09:07:43.010 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_user_unique_email": "true", 2024-09-14T09:07:43.010 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_verify_ssl": "true", 2024-09-14T09:07:43.010 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-14T09:07:43.010 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_zone": "", 2024-09-14T09:07:43.010 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_zone_id": "", 2024-09-14T09:07:43.010 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-14T09:07:43.010 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_zonegroup": "", 2024-09-14T09:07:43.010 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_zonegroup_id": "", 2024-09-14T09:07:43.010 INFO:teuthology.orchestra.run.smithi116.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-14T09:07:43.010 INFO:teuthology.orchestra.run.smithi116.stdout: "rgwlc_auto_session_clear": "true", 2024-09-14T09:07:43.010 INFO:teuthology.orchestra.run.smithi116.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-14T09:07:43.011 INFO:teuthology.orchestra.run.smithi116.stdout: "rocksdb_block_size": "4096", 2024-09-14T09:07:43.011 INFO:teuthology.orchestra.run.smithi116.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-14T09:07:43.011 INFO:teuthology.orchestra.run.smithi116.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-14T09:07:43.011 INFO:teuthology.orchestra.run.smithi116.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-14T09:07:43.011 INFO:teuthology.orchestra.run.smithi116.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-14T09:07:43.011 INFO:teuthology.orchestra.run.smithi116.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-14T09:07:43.011 INFO:teuthology.orchestra.run.smithi116.stdout: "rocksdb_cache_size": "536870912", 2024-09-14T09:07:43.011 INFO:teuthology.orchestra.run.smithi116.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-14T09:07:43.011 INFO:teuthology.orchestra.run.smithi116.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-14T09:07:43.011 INFO:teuthology.orchestra.run.smithi116.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-14T09:07:43.011 INFO:teuthology.orchestra.run.smithi116.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-14T09:07:43.011 INFO:teuthology.orchestra.run.smithi116.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-14T09:07:43.011 INFO:teuthology.orchestra.run.smithi116.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-14T09:07:43.011 INFO:teuthology.orchestra.run.smithi116.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-14T09:07:43.012 INFO:teuthology.orchestra.run.smithi116.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-14T09:07:43.012 INFO:teuthology.orchestra.run.smithi116.stdout: "rocksdb_index_type": "binary_search", 2024-09-14T09:07:43.012 INFO:teuthology.orchestra.run.smithi116.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-14T09:07:43.012 INFO:teuthology.orchestra.run.smithi116.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-14T09:07:43.012 INFO:teuthology.orchestra.run.smithi116.stdout: "rocksdb_partition_filters": "false", 2024-09-14T09:07:43.012 INFO:teuthology.orchestra.run.smithi116.stdout: "rocksdb_perf": "false", 2024-09-14T09:07:43.012 INFO:teuthology.orchestra.run.smithi116.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-14T09:07:43.012 INFO:teuthology.orchestra.run.smithi116.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-14T09:07:43.012 INFO:teuthology.orchestra.run.smithi116.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-14T09:07:43.012 INFO:teuthology.orchestra.run.smithi116.stdout: "run_dir": "/var/run/ceph", 2024-09-14T09:07:43.012 INFO:teuthology.orchestra.run.smithi116.stdout: "seastore_block_create": "true", 2024-09-14T09:07:43.012 INFO:teuthology.orchestra.run.smithi116.stdout: "seastore_cache_lru_size": "67108864", 2024-09-14T09:07:43.012 INFO:teuthology.orchestra.run.smithi116.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-14T09:07:43.013 INFO:teuthology.orchestra.run.smithi116.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-14T09:07:43.013 INFO:teuthology.orchestra.run.smithi116.stdout: "seastore_default_max_object_size": "16777216", 2024-09-14T09:07:43.013 INFO:teuthology.orchestra.run.smithi116.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-14T09:07:43.013 INFO:teuthology.orchestra.run.smithi116.stdout: "seastore_device_size": "53687091200", 2024-09-14T09:07:43.013 INFO:teuthology.orchestra.run.smithi116.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-14T09:07:43.013 INFO:teuthology.orchestra.run.smithi116.stdout: "seastore_full_integrity_check": "false", 2024-09-14T09:07:43.013 INFO:teuthology.orchestra.run.smithi116.stdout: "seastore_journal_batch_capacity": "16", 2024-09-14T09:07:43.013 INFO:teuthology.orchestra.run.smithi116.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-14T09:07:43.013 INFO:teuthology.orchestra.run.smithi116.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-14T09:07:43.013 INFO:teuthology.orchestra.run.smithi116.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-14T09:07:43.013 INFO:teuthology.orchestra.run.smithi116.stdout: "seastore_main_device_type": "SSD", 2024-09-14T09:07:43.013 INFO:teuthology.orchestra.run.smithi116.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-14T09:07:43.013 INFO:teuthology.orchestra.run.smithi116.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-14T09:07:43.013 INFO:teuthology.orchestra.run.smithi116.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-14T09:07:43.014 INFO:teuthology.orchestra.run.smithi116.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-14T09:07:43.014 INFO:teuthology.orchestra.run.smithi116.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-14T09:07:43.014 INFO:teuthology.orchestra.run.smithi116.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-14T09:07:43.014 INFO:teuthology.orchestra.run.smithi116.stdout: "seastore_segment_size": "67108864", 2024-09-14T09:07:43.014 INFO:teuthology.orchestra.run.smithi116.stdout: "set_keepcaps": "false", 2024-09-14T09:07:43.014 INFO:teuthology.orchestra.run.smithi116.stdout: "setgroup": "", 2024-09-14T09:07:43.014 INFO:teuthology.orchestra.run.smithi116.stdout: "setuser": "", 2024-09-14T09:07:43.014 INFO:teuthology.orchestra.run.smithi116.stdout: "setuser_match_path": "", 2024-09-14T09:07:43.014 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-14T09:07:43.014 INFO:teuthology.orchestra.run.smithi116.stdout: "thp": "false", 2024-09-14T09:07:43.014 INFO:teuthology.orchestra.run.smithi116.stdout: "threadpool_default_timeout": "60", 2024-09-14T09:07:43.014 INFO:teuthology.orchestra.run.smithi116.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-14T09:07:43.014 INFO:teuthology.orchestra.run.smithi116.stdout: "throttler_perf_counter": "true", 2024-09-14T09:07:43.014 INFO:teuthology.orchestra.run.smithi116.stdout: "tmp_dir": "/tmp", 2024-09-14T09:07:43.015 INFO:teuthology.orchestra.run.smithi116.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-14T09:07:43.015 INFO:teuthology.orchestra.run.smithi116.stdout: "uadk_compressor_enabled": "false", 2024-09-14T09:07:43.015 INFO:teuthology.orchestra.run.smithi116.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-14T09:07:43.015 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:43.017 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-14T09:07:43.127 INFO:teuthology.orchestra.run.smithi116.stdout:mon.a: {} 2024-09-14T09:07:43.127 INFO:teuthology.orchestra.run.smithi116.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T09:07:43.136 INFO:teuthology.orchestra.run.smithi116.stdout:mon.b: {} 2024-09-14T09:07:43.137 INFO:teuthology.orchestra.run.smithi116.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T09:07:43.145 INFO:teuthology.orchestra.run.smithi116.stdout:mon.c: {} 2024-09-14T09:07:43.145 INFO:teuthology.orchestra.run.smithi116.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T09:07:43.155 DEBUG:teuthology.orchestra.run.smithi144:> type ceph-objectstore-tool 2024-09-14T09:07:43.174 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-14T09:07:43.174 DEBUG:teuthology.orchestra.run.smithi116:> type ceph-objectstore-tool 2024-09-14T09:07:43.189 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-14T09:07:43.189 INFO:teuthology.run_tasks:Running task rbd_fsx... 2024-09-14T09:07:43.200 INFO:tasks.rbd_fsx:starting rbd_fsx... 2024-09-14T09:07:43.200 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-14T09:07:43.201 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T09:07:43.201 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:07:43.201 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-14T09:07:43.201 INFO:tasks.thrashosds.thrasher:Setting osd 3 primary_affinity to 0.243583 2024-09-14T09:07:43.201 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 0.24358337377097727 2024-09-14T09:07:43.202 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-14T09:07:43.202 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-14T09:07:43.202 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:07:43.202 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-14T09:07:43.203 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:07:43.203 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-14T09:07:43.203 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T09:07:43.203 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 6000 -M pool_client.0 image_client.0 2024-09-14T09:07:43.231 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:43.232+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:43.304 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:43.306+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:07:43.340 INFO:teuthology.orchestra.run.smithi148.stdout:mapped writes DISABLED 2024-09-14T09:07:43.340 INFO:teuthology.orchestra.run.smithi148.stdout:mapped reads DISABLED 2024-09-14T09:07:43.340 INFO:teuthology.orchestra.run.smithi148.stdout:Seed set to 2923 2024-09-14T09:07:43.340 INFO:teuthology.orchestra.run.smithi148.stdout:rbd-nbd mode enabled 2024-09-14T09:07:43.350 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:43.350 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:07:43.350 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:07:43.350 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:43.365 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:07:43.369 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:07:43.370 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:07:43.388 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:07:43.389 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:07:43.405 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:43.407+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:07:43.408 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:07:43.408 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:07:43.426 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:07:43.426 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:07:43.443 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:07:43.444 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:07:43.461 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:07:43.461 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:07:43.478 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:43.478 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:43.487 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:07:43.528 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:43.530+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:07:43.607 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:43.608+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:07:43.629 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:43.629 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:43.638 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:07:43.708 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:43.710+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:43.780 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:43.781 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:43.789 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:07:43.833 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:43.835+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:43.892 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:43.893 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:43.901 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:07:43.910 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:43.912+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:44.011 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:44.013+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:07:44.045 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:44.045 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:44.054 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:07:44.112 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:44.114+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:44.198 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:44.198 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:44.206 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:07:44.250 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:44.252+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:07:44.273 INFO:teuthology.orchestra.run.smithi116.stderr:set osd.3 primary-affinity to 0.243583 (8159632) 2024-09-14T09:07:44.277 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is set 2024-09-14T09:07:44.314 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:44.316+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:44.316 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:44.316 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:44.325 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:07:44.415 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:44.417+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:44.468 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:44.468 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:44.476 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:07:44.516 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:44.518+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:07:44.593 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:44.593 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:44.602 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:07:44.646 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:44.648+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:44.706 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:44.706 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:44.714 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:07:44.717 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:44.719+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:07:44.818 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:44.820+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:44.857 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:44.858 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:44.866 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:07:44.920 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:44.921+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:45.008 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:45.009 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:45.017 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:07:45.020 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:45.022+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:07:45.118 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:45.118 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:45.121 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:45.123+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:07:45.126 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:07:45.222 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:45.224+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:45.229 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:45.230 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:45.238 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:07:45.324 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:45.326+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:07:45.385 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:45.385 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:45.393 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:07:45.425 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:45.427+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:07:45.474 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:07:45.496 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:45.496 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:45.504 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:07:45.548 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:45.550+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:45.605 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:07:45.605 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:07:45.607 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:45.607 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:45.616 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:07:45.622 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:07:45.622 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:07:45.627 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:45.629+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:07:45.638 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:07:45.638 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:07:45.655 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:07:45.656 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:07:45.672 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:07:45.673 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:07:45.689 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:07:45.690 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:07:45.722 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:45.722 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:07:45.722 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:07:45.723 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:45.728 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:45.730+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:45.731 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:07:45.828 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:45.830+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:07:45.875 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:45.875 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:07:45.875 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:07:45.875 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:07:45.875 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:45.883 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:07:45.929 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:45.931+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:46.027 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:46.028 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:07:46.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:07:46.028 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:07:46.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.028 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4217.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T09:07:46.028 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:35.260927+0000", 2024-09-14T09:07:46.028 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.769027211999999, 2024-09-14T09:07:46.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018797799999999999, 2024-09-14T09:07:46.028 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.028 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.028 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:07:46.028 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.028 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4217", 2024-09-14T09:07:46.029 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.116:0/2127928146", 2024-09-14T09:07:46.029 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2 2024-09-14T09:07:46.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.029 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.260927+0000", 2024-09-14T09:07:46.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.260927+0000", 2024-09-14T09:07:46.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.260931+0000", 2024-09-14T09:07:46.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6789999999999998e-06 2024-09-14T09:07:46.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.260935+0000", 2024-09-14T09:07:46.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4719999999999997e-06 2024-09-14T09:07:46.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.260944+0000", 2024-09-14T09:07:46.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2649999999999996e-06 2024-09-14T09:07:46.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.260952+0000", 2024-09-14T09:07:46.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0190000000000006e-06 2024-09-14T09:07:46.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.261020+0000", 2024-09-14T09:07:46.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7973999999999997e-05 2024-09-14T09:07:46.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.261115+0000", 2024-09-14T09:07:46.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5569000000000006e-05 2024-09-14T09:07:46.032 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.032 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.032 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.032 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4217.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T09:07:46.032 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:35.261232+0000", 2024-09-14T09:07:46.032 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.768723011000001, 2024-09-14T09:07:46.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013903200000000001, 2024-09-14T09:07:46.033 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.033 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.033 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:07:46.033 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.033 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4217", 2024-09-14T09:07:46.033 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.116:0/2127928146", 2024-09-14T09:07:46.033 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3 2024-09-14T09:07:46.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.033 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.261232+0000", 2024-09-14T09:07:46.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.261232+0000", 2024-09-14T09:07:46.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.261232+0000", 2024-09-14T09:07:46.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0200000000000002e-07 2024-09-14T09:07:46.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.261236+0000", 2024-09-14T09:07:46.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0380000000000001e-06 2024-09-14T09:07:46.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.261245+0000", 2024-09-14T09:07:46.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0939999999999997e-06 2024-09-14T09:07:46.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.261252+0000", 2024-09-14T09:07:46.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6420000000000001e-06 2024-09-14T09:07:46.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.261295+0000", 2024-09-14T09:07:46.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3129e-05 2024-09-14T09:07:46.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.261371+0000", 2024-09-14T09:07:46.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5526999999999997e-05 2024-09-14T09:07:46.036 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.036 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.036 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.036 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4217.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-14T09:07:46.037 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:36.251612+0000", 2024-09-14T09:07:46.037 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.7783420729999992, 2024-09-14T09:07:46.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0032752599999999999, 2024-09-14T09:07:46.037 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.037 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.037 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:46.037 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.037 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4217", 2024-09-14T09:07:46.037 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.116:0/2127928146", 2024-09-14T09:07:46.037 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 5 2024-09-14T09:07:46.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.038 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.251612+0000", 2024-09-14T09:07:46.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.251612+0000", 2024-09-14T09:07:46.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.251615+0000", 2024-09-14T09:07:46.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5069999999999999e-06 2024-09-14T09:07:46.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.251631+0000", 2024-09-14T09:07:46.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6201e-05 2024-09-14T09:07:46.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.251651+0000", 2024-09-14T09:07:46.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0081e-05 2024-09-14T09:07:46.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.251661+0000", 2024-09-14T09:07:46.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006999999999999e-05 2024-09-14T09:07:46.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.251733+0000", 2024-09-14T09:07:46.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1443e-05 2024-09-14T09:07:46.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:07:46.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.251737+0000", 2024-09-14T09:07:46.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6469999999999997e-06 2024-09-14T09:07:46.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.253352+0000", 2024-09-14T09:07:46.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001614367 2024-09-14T09:07:46.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.253473+0000", 2024-09-14T09:07:46.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000121507 2024-09-14T09:07:46.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 4", 2024-09-14T09:07:46.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.253610+0000", 2024-09-14T09:07:46.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136663 2024-09-14T09:07:46.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:46.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.254294+0000", 2024-09-14T09:07:46.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00068391000000000003 2024-09-14T09:07:46.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:46.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.254821+0000", 2024-09-14T09:07:46.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00052734699999999995 2024-09-14T09:07:46.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:46.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.254858+0000", 2024-09-14T09:07:46.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6395e-05 2024-09-14T09:07:46.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.254888+0000", 2024-09-14T09:07:46.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0185e-05 2024-09-14T09:07:46.043 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.043 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.043 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.044 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop_reply(client.4217.0:5 2.2 e18/17 ondisk, result = 0)", 2024-09-14T09:07:46.044 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:36.254749+0000", 2024-09-14T09:07:46.044 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.7752052280000008, 2024-09-14T09:07:46.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000144225, 2024-09-14T09:07:46.044 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.044 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.044 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:46.044 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.254749+0000", 2024-09-14T09:07:46.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.254749+0000", 2024-09-14T09:07:46.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.254750+0000", 2024-09-14T09:07:46.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.032e-06 2024-09-14T09:07:46.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.254755+0000", 2024-09-14T09:07:46.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.267e-06 2024-09-14T09:07:46.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.254764+0000", 2024-09-14T09:07:46.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7589999999999992e-06 2024-09-14T09:07:46.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.254772+0000", 2024-09-14T09:07:46.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7090000000000002e-06 2024-09-14T09:07:46.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.254812+0000", 2024-09-14T09:07:46.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0132000000000001e-05 2024-09-14T09:07:46.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.254818+0000", 2024-09-14T09:07:46.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.609e-06 2024-09-14T09:07:46.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.254894+0000", 2024-09-14T09:07:46.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5716999999999994e-05 2024-09-14T09:07:46.047 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.047 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.047 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.048 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4217.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-14T09:07:46.048 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:37.257826+0000", 2024-09-14T09:07:46.048 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.7721280420000003, 2024-09-14T09:07:46.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046214849999999998, 2024-09-14T09:07:46.048 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.048 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.048 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:46.048 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.048 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4217", 2024-09-14T09:07:46.048 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.116:0/2127928146", 2024-09-14T09:07:46.048 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7 2024-09-14T09:07:46.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.048 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.257826+0000", 2024-09-14T09:07:46.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.257826+0000", 2024-09-14T09:07:46.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.257828+0000", 2024-09-14T09:07:46.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6190000000000001e-06 2024-09-14T09:07:46.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.257845+0000", 2024-09-14T09:07:46.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6532999999999999e-05 2024-09-14T09:07:46.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.257864+0000", 2024-09-14T09:07:46.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8921000000000001e-05 2024-09-14T09:07:46.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.257874+0000", 2024-09-14T09:07:46.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.01e-05 2024-09-14T09:07:46.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.257936+0000", 2024-09-14T09:07:46.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2420000000000002e-05 2024-09-14T09:07:46.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:07:46.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.257942+0000", 2024-09-14T09:07:46.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3090000000000001e-06 2024-09-14T09:07:46.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.260275+0000", 2024-09-14T09:07:46.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023323850000000002 2024-09-14T09:07:46.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.260357+0000", 2024-09-14T09:07:46.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2305000000000006e-05 2024-09-14T09:07:46.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 4", 2024-09-14T09:07:46.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.260461+0000", 2024-09-14T09:07:46.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000104263 2024-09-14T09:07:46.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:46.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.261166+0000", 2024-09-14T09:07:46.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00070491499999999997 2024-09-14T09:07:46.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:46.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.262380+0000", 2024-09-14T09:07:46.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0012133020000000001 2024-09-14T09:07:46.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:46.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.262417+0000", 2024-09-14T09:07:46.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7848000000000001e-05 2024-09-14T09:07:46.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.262448+0000", 2024-09-14T09:07:46.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0565000000000003e-05 2024-09-14T09:07:46.053 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.053 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.054 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.054 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop_reply(client.4217.0:7 2.2 e20/17 ondisk, result = 0)", 2024-09-14T09:07:46.054 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:37.262291+0000", 2024-09-14T09:07:46.054 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.7676630339999999, 2024-09-14T09:07:46.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016278399999999999, 2024-09-14T09:07:46.054 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.054 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.054 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:46.054 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.262291+0000", 2024-09-14T09:07:46.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.262291+0000", 2024-09-14T09:07:46.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.262292+0000", 2024-09-14T09:07:46.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.85e-07 2024-09-14T09:07:46.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.262298+0000", 2024-09-14T09:07:46.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.31e-06 2024-09-14T09:07:46.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.262311+0000", 2024-09-14T09:07:46.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3124e-05 2024-09-14T09:07:46.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.262317+0000", 2024-09-14T09:07:46.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.494e-06 2024-09-14T09:07:46.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.262367+0000", 2024-09-14T09:07:46.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9904999999999997e-05 2024-09-14T09:07:46.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.262376+0000", 2024-09-14T09:07:46.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4200000000000007e-06 2024-09-14T09:07:46.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.262454+0000", 2024-09-14T09:07:46.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8646000000000006e-05 2024-09-14T09:07:46.058 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.058 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.058 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.058 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.058 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.058 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:46.059 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:07:46.060 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:46.061+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:46.160 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:46.162+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:46.162 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:46.162 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:07:46.163 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:07:46.163 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:46.171 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:07:46.261 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:46.263+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:07:46.300 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T09:07:46.317 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:46.317 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:07:46.318 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:07:46.318 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:07:46.318 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:46.326 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:07:46.363 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:46.365+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:46.463 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:46.465+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:07:46.472 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:46.472 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:07:46.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:07:46.472 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:07:46.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.473 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:46.473 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:07:46.473 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.240114893000001, 2024-09-14T09:07:46.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72111598600000004, 2024-09-14T09:07:46.473 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.473 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.473 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:46.473 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.473 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:46.473 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:46.473 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1 2024-09-14T09:07:46.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.474 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:07:46.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:07:46.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233065+0000", 2024-09-14T09:07:46.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1909999999999999e-06 2024-09-14T09:07:46.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233071+0000", 2024-09-14T09:07:46.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5300000000000002e-06 2024-09-14T09:07:46.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233081+0000", 2024-09-14T09:07:46.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0339e-05 2024-09-14T09:07:46.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233093+0000", 2024-09-14T09:07:46.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1252e-05 2024-09-14T09:07:46.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233162+0000", 2024-09-14T09:07:46.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9678999999999995e-05 2024-09-14T09:07:46.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:07:46.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233171+0000", 2024-09-14T09:07:46.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.132e-06 2024-09-14T09:07:46.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952480+0000", 2024-09-14T09:07:46.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.71930839899999999 2024-09-14T09:07:46.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952655+0000", 2024-09-14T09:07:46.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017552 2024-09-14T09:07:46.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:46.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952835+0000", 2024-09-14T09:07:46.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001797 2024-09-14T09:07:46.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:46.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.953648+0000", 2024-09-14T09:07:46.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00081291700000000002 2024-09-14T09:07:46.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:46.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954108+0000", 2024-09-14T09:07:46.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045992800000000002 2024-09-14T09:07:46.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:46.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954149+0000", 2024-09-14T09:07:46.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1214999999999998e-05 2024-09-14T09:07:46.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954178+0000", 2024-09-14T09:07:46.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9184e-05 2024-09-14T09:07:46.479 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.479 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.479 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.480 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:46.480 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153119+0000", 2024-09-14T09:07:46.480 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 15.320058620999999, 2024-09-14T09:07:46.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011276675999999999, 2024-09-14T09:07:46.480 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.480 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.480 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:46.480 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.480 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:46.480 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:46.480 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 41 2024-09-14T09:07:46.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.480 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153119+0000", 2024-09-14T09:07:46.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153119+0000", 2024-09-14T09:07:46.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153119+0000", 2024-09-14T09:07:46.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8800000000000002e-07 2024-09-14T09:07:46.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153170+0000", 2024-09-14T09:07:46.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1020000000000003e-05 2024-09-14T09:07:46.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153176+0000", 2024-09-14T09:07:46.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1739999999999997e-06 2024-09-14T09:07:46.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153182+0000", 2024-09-14T09:07:46.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4430000000000002e-06 2024-09-14T09:07:46.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.154147+0000", 2024-09-14T09:07:46.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00096519900000000003 2024-09-14T09:07:46.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.154220+0000", 2024-09-14T09:07:46.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3339999999999999e-05 2024-09-14T09:07:46.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:46.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.154305+0000", 2024-09-14T09:07:46.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4266999999999998e-05 2024-09-14T09:07:46.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:46.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157785+0000", 2024-09-14T09:07:46.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034801369999999999 2024-09-14T09:07:46.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:46.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164340+0000", 2024-09-14T09:07:46.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0065547349999999999 2024-09-14T09:07:46.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:46.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164370+0000", 2024-09-14T09:07:46.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0944000000000001e-05 2024-09-14T09:07:46.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164395+0000", 2024-09-14T09:07:46.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4828999999999999e-05 2024-09-14T09:07:46.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.485 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.486 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.486 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:46.486 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153190+0000", 2024-09-14T09:07:46.486 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 15.319987188000001, 2024-09-14T09:07:46.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011298134, 2024-09-14T09:07:46.486 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.486 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.486 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:46.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:46.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:46.486 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 42 2024-09-14T09:07:46.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.487 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153190+0000", 2024-09-14T09:07:46.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153190+0000", 2024-09-14T09:07:46.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153191+0000", 2024-09-14T09:07:46.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4099999999999999e-07 2024-09-14T09:07:46.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153193+0000", 2024-09-14T09:07:46.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1900000000000002e-06 2024-09-14T09:07:46.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153197+0000", 2024-09-14T09:07:46.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3479999999999997e-06 2024-09-14T09:07:46.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153200+0000", 2024-09-14T09:07:46.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8669999999999998e-06 2024-09-14T09:07:46.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.154763+0000", 2024-09-14T09:07:46.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0015633719999999999 2024-09-14T09:07:46.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.154811+0000", 2024-09-14T09:07:46.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7797000000000003e-05 2024-09-14T09:07:46.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:46.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.154889+0000", 2024-09-14T09:07:46.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7742000000000002e-05 2024-09-14T09:07:46.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:46.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157790+0000", 2024-09-14T09:07:46.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0029008710000000002 2024-09-14T09:07:46.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:46.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164429+0000", 2024-09-14T09:07:46.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066394710000000001 2024-09-14T09:07:46.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:46.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164462+0000", 2024-09-14T09:07:46.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2827000000000003e-05 2024-09-14T09:07:46.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164488+0000", 2024-09-14T09:07:46.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6208e-05 2024-09-14T09:07:46.491 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.491 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.491 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.491 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:46.492 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153280+0000", 2024-09-14T09:07:46.492 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 15.319897287, 2024-09-14T09:07:46.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011598466999999999, 2024-09-14T09:07:46.492 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.492 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.492 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:46.492 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.492 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:46.492 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:46.492 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 43 2024-09-14T09:07:46.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.492 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153280+0000", 2024-09-14T09:07:46.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153280+0000", 2024-09-14T09:07:46.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153281+0000", 2024-09-14T09:07:46.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2200000000000004e-07 2024-09-14T09:07:46.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153284+0000", 2024-09-14T09:07:46.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9779999999999999e-06 2024-09-14T09:07:46.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153290+0000", 2024-09-14T09:07:46.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9569999999999999e-06 2024-09-14T09:07:46.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153294+0000", 2024-09-14T09:07:46.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3060000000000002e-06 2024-09-14T09:07:46.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.155173+0000", 2024-09-14T09:07:46.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00187929 2024-09-14T09:07:46.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.155222+0000", 2024-09-14T09:07:46.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9249000000000002e-05 2024-09-14T09:07:46.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:46.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.155299+0000", 2024-09-14T09:07:46.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6755999999999995e-05 2024-09-14T09:07:46.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:46.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157795+0000", 2024-09-14T09:07:46.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024964359999999999 2024-09-14T09:07:46.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:46.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164785+0000", 2024-09-14T09:07:46.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069898729999999997 2024-09-14T09:07:46.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:46.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164837+0000", 2024-09-14T09:07:46.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2061999999999997e-05 2024-09-14T09:07:46.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164878+0000", 2024-09-14T09:07:46.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1038000000000002e-05 2024-09-14T09:07:46.497 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.497 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.497 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.497 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:46.497 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153342+0000", 2024-09-14T09:07:46.498 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 15.319835411, 2024-09-14T09:07:46.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011654108, 2024-09-14T09:07:46.498 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.498 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.498 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:46.498 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.498 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:46.498 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:46.498 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 44 2024-09-14T09:07:46.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.498 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153342+0000", 2024-09-14T09:07:46.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153342+0000", 2024-09-14T09:07:46.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153342+0000", 2024-09-14T09:07:46.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.53e-07 2024-09-14T09:07:46.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153414+0000", 2024-09-14T09:07:46.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1952000000000005e-05 2024-09-14T09:07:46.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153420+0000", 2024-09-14T09:07:46.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8390000000000003e-06 2024-09-14T09:07:46.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153425+0000", 2024-09-14T09:07:46.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7509999999999999e-06 2024-09-14T09:07:46.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.155556+0000", 2024-09-14T09:07:46.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0021313389999999999 2024-09-14T09:07:46.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.155607+0000", 2024-09-14T09:07:46.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0756e-05 2024-09-14T09:07:46.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:46.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.155686+0000", 2024-09-14T09:07:46.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9008e-05 2024-09-14T09:07:46.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:46.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157800+0000", 2024-09-14T09:07:46.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0021143030000000001 2024-09-14T09:07:46.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:46.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164927+0000", 2024-09-14T09:07:46.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071267029999999999 2024-09-14T09:07:46.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:46.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164959+0000", 2024-09-14T09:07:46.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2289999999999997e-05 2024-09-14T09:07:46.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164996+0000", 2024-09-14T09:07:46.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6813999999999997e-05 2024-09-14T09:07:46.503 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.503 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.504 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.504 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:46.504 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153439+0000", 2024-09-14T09:07:46.504 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 15.319738703000001, 2024-09-14T09:07:46.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011648581999999999, 2024-09-14T09:07:46.504 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.504 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.504 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:46.504 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.504 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:46.504 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:46.505 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 45 2024-09-14T09:07:46.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.505 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153439+0000", 2024-09-14T09:07:46.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153439+0000", 2024-09-14T09:07:46.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153439+0000", 2024-09-14T09:07:46.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0499999999999999e-07 2024-09-14T09:07:46.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153442+0000", 2024-09-14T09:07:46.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0070000000000002e-06 2024-09-14T09:07:46.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153448+0000", 2024-09-14T09:07:46.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7540000000000003e-06 2024-09-14T09:07:46.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153452+0000", 2024-09-14T09:07:46.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0559999999999998e-06 2024-09-14T09:07:46.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.156116+0000", 2024-09-14T09:07:46.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026643560000000001 2024-09-14T09:07:46.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.156165+0000", 2024-09-14T09:07:46.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8362000000000002e-05 2024-09-14T09:07:46.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:46.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.156261+0000", 2024-09-14T09:07:46.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6164999999999998e-05 2024-09-14T09:07:46.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:46.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159642+0000", 2024-09-14T09:07:46.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033813599999999999 2024-09-14T09:07:46.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:46.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165035+0000", 2024-09-14T09:07:46.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0053929889999999999 2024-09-14T09:07:46.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:46.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165064+0000", 2024-09-14T09:07:46.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9229000000000001e-05 2024-09-14T09:07:46.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165087+0000", 2024-09-14T09:07:46.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2898999999999999e-05 2024-09-14T09:07:46.509 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.509 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.509 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.510 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:46.510 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153458+0000", 2024-09-14T09:07:46.510 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 15.31971967, 2024-09-14T09:07:46.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011717188999999999, 2024-09-14T09:07:46.510 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.510 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.510 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:46.510 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.510 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:46.510 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:46.510 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 46 2024-09-14T09:07:46.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.511 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153458+0000", 2024-09-14T09:07:46.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153458+0000", 2024-09-14T09:07:46.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153458+0000", 2024-09-14T09:07:46.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3200000000000001e-07 2024-09-14T09:07:46.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153462+0000", 2024-09-14T09:07:46.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0969999999999999e-06 2024-09-14T09:07:46.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153465+0000", 2024-09-14T09:07:46.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.455e-06 2024-09-14T09:07:46.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153468+0000", 2024-09-14T09:07:46.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6460000000000002e-06 2024-09-14T09:07:46.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.156541+0000", 2024-09-14T09:07:46.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030729059999999998 2024-09-14T09:07:46.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.156597+0000", 2024-09-14T09:07:46.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6496999999999998e-05 2024-09-14T09:07:46.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:46.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.156674+0000", 2024-09-14T09:07:46.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6483000000000006e-05 2024-09-14T09:07:46.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:46.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159649+0000", 2024-09-14T09:07:46.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0029750750000000002 2024-09-14T09:07:46.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:46.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165122+0000", 2024-09-14T09:07:46.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054732100000000001 2024-09-14T09:07:46.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:46.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165151+0000", 2024-09-14T09:07:46.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8535999999999999e-05 2024-09-14T09:07:46.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165175+0000", 2024-09-14T09:07:46.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4051999999999999e-05 2024-09-14T09:07:46.515 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.515 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.515 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.516 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:46.516 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153481+0000", 2024-09-14T09:07:46.516 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 15.319696757999999, 2024-09-14T09:07:46.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011772726000000001, 2024-09-14T09:07:46.516 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.516 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.516 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:46.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:46.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:46.516 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 47 2024-09-14T09:07:46.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.516 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153481+0000", 2024-09-14T09:07:46.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153481+0000", 2024-09-14T09:07:46.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153481+0000", 2024-09-14T09:07:46.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3099999999999999e-07 2024-09-14T09:07:46.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153532+0000", 2024-09-14T09:07:46.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1536999999999998e-05 2024-09-14T09:07:46.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153540+0000", 2024-09-14T09:07:46.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4000000000000003e-06 2024-09-14T09:07:46.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153545+0000", 2024-09-14T09:07:46.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7069999999999997e-06 2024-09-14T09:07:46.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.156923+0000", 2024-09-14T09:07:46.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003377082 2024-09-14T09:07:46.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157005+0000", 2024-09-14T09:07:46.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2547999999999996e-05 2024-09-14T09:07:46.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:46.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157082+0000", 2024-09-14T09:07:46.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6829000000000006e-05 2024-09-14T09:07:46.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:46.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159653+0000", 2024-09-14T09:07:46.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025711549999999999 2024-09-14T09:07:46.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:46.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165208+0000", 2024-09-14T09:07:46.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055549429999999997 2024-09-14T09:07:46.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:46.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165234+0000", 2024-09-14T09:07:46.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6274999999999998e-05 2024-09-14T09:07:46.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165253+0000", 2024-09-14T09:07:46.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8919e-05 2024-09-14T09:07:46.521 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.521 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.521 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.522 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:46.522 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153559+0000", 2024-09-14T09:07:46.522 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 15.319618393000001, 2024-09-14T09:07:46.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011777464, 2024-09-14T09:07:46.522 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.522 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.522 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:46.522 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.522 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:46.522 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:46.522 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 48 2024-09-14T09:07:46.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.522 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153559+0000", 2024-09-14T09:07:46.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153559+0000", 2024-09-14T09:07:46.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153559+0000", 2024-09-14T09:07:46.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0399999999999996e-07 2024-09-14T09:07:46.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153563+0000", 2024-09-14T09:07:46.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9049999999999999e-06 2024-09-14T09:07:46.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153572+0000", 2024-09-14T09:07:46.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0219999999999993e-06 2024-09-14T09:07:46.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153578+0000", 2024-09-14T09:07:46.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5369999999999997e-06 2024-09-14T09:07:46.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157446+0000", 2024-09-14T09:07:46.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0038676159999999999 2024-09-14T09:07:46.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157493+0000", 2024-09-14T09:07:46.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7661999999999999e-05 2024-09-14T09:07:46.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:46.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157568+0000", 2024-09-14T09:07:46.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4548999999999994e-05 2024-09-14T09:07:46.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:46.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159656+0000", 2024-09-14T09:07:46.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002088389 2024-09-14T09:07:46.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:46.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165286+0000", 2024-09-14T09:07:46.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056303350000000002 2024-09-14T09:07:46.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:46.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165313+0000", 2024-09-14T09:07:46.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6050999999999998e-05 2024-09-14T09:07:46.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165336+0000", 2024-09-14T09:07:46.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3794e-05 2024-09-14T09:07:46.527 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.527 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.527 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.527 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:46.527 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153590+0000", 2024-09-14T09:07:46.528 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 15.319587008999999, 2024-09-14T09:07:46.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011822174, 2024-09-14T09:07:46.528 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.528 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.528 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:46.528 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.528 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:46.528 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:46.528 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 49 2024-09-14T09:07:46.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.528 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153590+0000", 2024-09-14T09:07:46.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153590+0000", 2024-09-14T09:07:46.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153591+0000", 2024-09-14T09:07:46.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.37e-07 2024-09-14T09:07:46.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153595+0000", 2024-09-14T09:07:46.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1609999999999996e-06 2024-09-14T09:07:46.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153602+0000", 2024-09-14T09:07:46.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1099999999999997e-06 2024-09-14T09:07:46.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153609+0000", 2024-09-14T09:07:46.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8369999999999999e-06 2024-09-14T09:07:46.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157833+0000", 2024-09-14T09:07:46.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.004223699 2024-09-14T09:07:46.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157882+0000", 2024-09-14T09:07:46.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9592999999999998e-05 2024-09-14T09:07:46.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:46.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157956+0000", 2024-09-14T09:07:46.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4196999999999995e-05 2024-09-14T09:07:46.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:46.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159658+0000", 2024-09-14T09:07:46.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0017020749999999999 2024-09-14T09:07:46.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:46.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165369+0000", 2024-09-14T09:07:46.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057103309999999999 2024-09-14T09:07:46.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:46.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165394+0000", 2024-09-14T09:07:46.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5205999999999999e-05 2024-09-14T09:07:46.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165412+0000", 2024-09-14T09:07:46.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8428e-05 2024-09-14T09:07:46.533 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.533 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.533 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.533 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:46.533 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153631+0000", 2024-09-14T09:07:46.533 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 15.319546452999999, 2024-09-14T09:07:46.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011869523999999999, 2024-09-14T09:07:46.533 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.534 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.534 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:46.534 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.534 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:46.534 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:46.534 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 50 2024-09-14T09:07:46.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.534 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153631+0000", 2024-09-14T09:07:46.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153631+0000", 2024-09-14T09:07:46.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153631+0000", 2024-09-14T09:07:46.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999998e-07 2024-09-14T09:07:46.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153681+0000", 2024-09-14T09:07:46.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9688000000000003e-05 2024-09-14T09:07:46.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153689+0000", 2024-09-14T09:07:46.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:07:46.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153696+0000", 2024-09-14T09:07:46.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4159999999999998e-06 2024-09-14T09:07:46.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.158221+0000", 2024-09-14T09:07:46.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045246430000000001 2024-09-14T09:07:46.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.158275+0000", 2024-09-14T09:07:46.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3517999999999998e-05 2024-09-14T09:07:46.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:46.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.158354+0000", 2024-09-14T09:07:46.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9426999999999997e-05 2024-09-14T09:07:46.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:46.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159661+0000", 2024-09-14T09:07:46.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013065310000000001 2024-09-14T09:07:46.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:46.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165449+0000", 2024-09-14T09:07:46.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057885610000000002 2024-09-14T09:07:46.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:46.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165476+0000", 2024-09-14T09:07:46.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6959999999999999e-05 2024-09-14T09:07:46.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165500+0000", 2024-09-14T09:07:46.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4261e-05 2024-09-14T09:07:46.539 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.539 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.539 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.539 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:46.539 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153710+0000", 2024-09-14T09:07:46.539 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 15.319467224, 2024-09-14T09:07:46.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011866623999999999, 2024-09-14T09:07:46.539 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.539 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.540 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:46.540 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.540 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:46.540 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:46.540 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 51 2024-09-14T09:07:46.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.540 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153710+0000", 2024-09-14T09:07:46.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153710+0000", 2024-09-14T09:07:46.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153711+0000", 2024-09-14T09:07:46.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6000000000000003e-07 2024-09-14T09:07:46.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153715+0000", 2024-09-14T09:07:46.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8990000000000003e-06 2024-09-14T09:07:46.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153723+0000", 2024-09-14T09:07:46.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9899999999999997e-06 2024-09-14T09:07:46.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153739+0000", 2024-09-14T09:07:46.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6524999999999998e-05 2024-09-14T09:07:46.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.158746+0000", 2024-09-14T09:07:46.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00500717 2024-09-14T09:07:46.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.158796+0000", 2024-09-14T09:07:46.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9327999999999999e-05 2024-09-14T09:07:46.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:46.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.158897+0000", 2024-09-14T09:07:46.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010135400000000001 2024-09-14T09:07:46.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:46.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.162214+0000", 2024-09-14T09:07:46.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033173500000000002 2024-09-14T09:07:46.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:46.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165533+0000", 2024-09-14T09:07:46.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033186309999999998 2024-09-14T09:07:46.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:46.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165558+0000", 2024-09-14T09:07:46.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5007999999999998e-05 2024-09-14T09:07:46.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165577+0000", 2024-09-14T09:07:46.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8709e-05 2024-09-14T09:07:46.545 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.545 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.545 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.545 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:46.545 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153750+0000", 2024-09-14T09:07:46.545 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 15.319426773, 2024-09-14T09:07:46.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011903145, 2024-09-14T09:07:46.545 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.546 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.546 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:46.546 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.546 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:46.546 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:46.546 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 52 2024-09-14T09:07:46.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.546 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153750+0000", 2024-09-14T09:07:46.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153750+0000", 2024-09-14T09:07:46.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153751+0000", 2024-09-14T09:07:46.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0699999999999997e-07 2024-09-14T09:07:46.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153755+0000", 2024-09-14T09:07:46.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.053e-06 2024-09-14T09:07:46.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153762+0000", 2024-09-14T09:07:46.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8210000000000004e-06 2024-09-14T09:07:46.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153768+0000", 2024-09-14T09:07:46.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9190000000000004e-06 2024-09-14T09:07:46.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159302+0000", 2024-09-14T09:07:46.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055338100000000001 2024-09-14T09:07:46.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159356+0000", 2024-09-14T09:07:46.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4203999999999998e-05 2024-09-14T09:07:46.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:46.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159437+0000", 2024-09-14T09:07:46.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0883999999999993e-05 2024-09-14T09:07:46.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:46.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.162440+0000", 2024-09-14T09:07:46.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003003136 2024-09-14T09:07:46.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:46.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165604+0000", 2024-09-14T09:07:46.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031642760000000002 2024-09-14T09:07:46.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:46.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165632+0000", 2024-09-14T09:07:46.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7883999999999999e-05 2024-09-14T09:07:46.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165654+0000", 2024-09-14T09:07:46.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1651e-05 2024-09-14T09:07:46.551 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.551 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.551 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.551 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:66 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-14T09:07:46.551 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.429086+0000", 2024-09-14T09:07:46.551 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 15.044091105, 2024-09-14T09:07:46.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0081960750000000006, 2024-09-14T09:07:46.551 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.551 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.551 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:46.552 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.552 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:46.552 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:46.552 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 66 2024-09-14T09:07:46.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.552 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429086+0000", 2024-09-14T09:07:46.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429086+0000", 2024-09-14T09:07:46.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429087+0000", 2024-09-14T09:07:46.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.75e-07 2024-09-14T09:07:46.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429222+0000", 2024-09-14T09:07:46.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013551599999999999 2024-09-14T09:07:46.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429229+0000", 2024-09-14T09:07:46.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6420000000000001e-06 2024-09-14T09:07:46.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429235+0000", 2024-09-14T09:07:46.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7270000000000004e-06 2024-09-14T09:07:46.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429806+0000", 2024-09-14T09:07:46.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000571434 2024-09-14T09:07:46.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429855+0000", 2024-09-14T09:07:46.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9075e-05 2024-09-14T09:07:46.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:46.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429925+0000", 2024-09-14T09:07:46.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0191000000000006e-05 2024-09-14T09:07:46.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:46.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434654+0000", 2024-09-14T09:07:46.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0047287639999999999 2024-09-14T09:07:46.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:46.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.437230+0000", 2024-09-14T09:07:46.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025758349999999998 2024-09-14T09:07:46.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:46.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.437260+0000", 2024-09-14T09:07:46.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0431000000000001e-05 2024-09-14T09:07:46.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.437282+0000", 2024-09-14T09:07:46.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1985e-05 2024-09-14T09:07:46.557 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.557 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.557 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.557 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-14T09:07:46.557 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.429665+0000", 2024-09-14T09:07:46.557 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 15.043512759, 2024-09-14T09:07:46.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095381779999999996, 2024-09-14T09:07:46.557 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.557 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.557 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:46.557 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.557 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:46.557 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:46.557 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 72 2024-09-14T09:07:46.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.558 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429665+0000", 2024-09-14T09:07:46.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429665+0000", 2024-09-14T09:07:46.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429665+0000", 2024-09-14T09:07:46.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.35e-07 2024-09-14T09:07:46.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429773+0000", 2024-09-14T09:07:46.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000107864 2024-09-14T09:07:46.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429778+0000", 2024-09-14T09:07:46.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9459999999999997e-06 2024-09-14T09:07:46.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429781+0000", 2024-09-14T09:07:46.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2629999999999999e-06 2024-09-14T09:07:46.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.432292+0000", 2024-09-14T09:07:46.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025115150000000002 2024-09-14T09:07:46.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.432349+0000", 2024-09-14T09:07:46.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6866000000000001e-05 2024-09-14T09:07:46.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:46.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.432419+0000", 2024-09-14T09:07:46.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9407999999999997e-05 2024-09-14T09:07:46.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:46.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434667+0000", 2024-09-14T09:07:46.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022485199999999999 2024-09-14T09:07:46.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:46.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439157+0000", 2024-09-14T09:07:46.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044895890000000004 2024-09-14T09:07:46.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:46.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439183+0000", 2024-09-14T09:07:46.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6659999999999999e-05 2024-09-14T09:07:46.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439203+0000", 2024-09-14T09:07:46.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9312000000000001e-05 2024-09-14T09:07:46.562 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.562 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.562 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.562 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-14T09:07:46.562 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.429802+0000", 2024-09-14T09:07:46.563 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 15.043375186, 2024-09-14T09:07:46.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099135869999999997, 2024-09-14T09:07:46.563 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.563 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.563 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:46.563 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.563 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:46.563 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:46.563 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73 2024-09-14T09:07:46.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.563 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429802+0000", 2024-09-14T09:07:46.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429802+0000", 2024-09-14T09:07:46.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429802+0000", 2024-09-14T09:07:46.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3999999999999997e-07 2024-09-14T09:07:46.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429805+0000", 2024-09-14T09:07:46.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2330000000000001e-06 2024-09-14T09:07:46.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429808+0000", 2024-09-14T09:07:46.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.681e-06 2024-09-14T09:07:46.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429811+0000", 2024-09-14T09:07:46.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7879999999999998e-06 2024-09-14T09:07:46.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.432914+0000", 2024-09-14T09:07:46.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031032640000000001 2024-09-14T09:07:46.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.432957+0000", 2024-09-14T09:07:46.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3006999999999997e-05 2024-09-14T09:07:46.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:46.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.433035+0000", 2024-09-14T09:07:46.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7952000000000002e-05 2024-09-14T09:07:46.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:46.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434669+0000", 2024-09-14T09:07:46.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001633736 2024-09-14T09:07:46.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:46.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439664+0000", 2024-09-14T09:07:46.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.004995396 2024-09-14T09:07:46.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:46.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439694+0000", 2024-09-14T09:07:46.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9428999999999999e-05 2024-09-14T09:07:46.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439716+0000", 2024-09-14T09:07:46.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1761000000000001e-05 2024-09-14T09:07:46.568 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.568 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.568 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.568 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-14T09:07:46.568 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.429827+0000", 2024-09-14T09:07:46.568 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 15.043349964000001, 2024-09-14T09:07:46.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099733119999999998, 2024-09-14T09:07:46.568 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.568 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.569 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:46.569 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.569 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:46.569 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:46.569 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 74 2024-09-14T09:07:46.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.569 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429827+0000", 2024-09-14T09:07:46.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429827+0000", 2024-09-14T09:07:46.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429828+0000", 2024-09-14T09:07:46.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4900000000000001e-07 2024-09-14T09:07:46.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429831+0000", 2024-09-14T09:07:46.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.619e-06 2024-09-14T09:07:46.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429835+0000", 2024-09-14T09:07:46.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-06 2024-09-14T09:07:46.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429843+0000", 2024-09-14T09:07:46.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8350000000000004e-06 2024-09-14T09:07:46.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.433290+0000", 2024-09-14T09:07:46.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003446827 2024-09-14T09:07:46.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.433335+0000", 2024-09-14T09:07:46.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5195999999999999e-05 2024-09-14T09:07:46.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:46.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.433403+0000", 2024-09-14T09:07:46.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8124e-05 2024-09-14T09:07:46.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:46.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434673+0000", 2024-09-14T09:07:46.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0012694519999999999 2024-09-14T09:07:46.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:46.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439754+0000", 2024-09-14T09:07:46.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050815319999999997 2024-09-14T09:07:46.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:46.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439780+0000", 2024-09-14T09:07:46.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6171999999999999e-05 2024-09-14T09:07:46.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439801+0000", 2024-09-14T09:07:46.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0356e-05 2024-09-14T09:07:46.573 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.573 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.574 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.574 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-14T09:07:46.574 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.429864+0000", 2024-09-14T09:07:46.574 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 15.043313505, 2024-09-14T09:07:46.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010013004000000001, 2024-09-14T09:07:46.574 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.574 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.574 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:46.574 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.574 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:46.574 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:46.574 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 75 2024-09-14T09:07:46.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.575 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429864+0000", 2024-09-14T09:07:46.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429864+0000", 2024-09-14T09:07:46.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429864+0000", 2024-09-14T09:07:46.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.34e-07 2024-09-14T09:07:46.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430015+0000", 2024-09-14T09:07:46.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000150579 2024-09-14T09:07:46.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430026+0000", 2024-09-14T09:07:46.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0883999999999999e-05 2024-09-14T09:07:46.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430032+0000", 2024-09-14T09:07:46.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6699999999999997e-06 2024-09-14T09:07:46.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.433709+0000", 2024-09-14T09:07:46.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0036764050000000002 2024-09-14T09:07:46.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.433753+0000", 2024-09-14T09:07:46.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4345000000000003e-05 2024-09-14T09:07:46.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:46.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.433817+0000", 2024-09-14T09:07:46.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3909000000000001e-05 2024-09-14T09:07:46.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:46.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434675+0000", 2024-09-14T09:07:46.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00085810499999999996 2024-09-14T09:07:46.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:46.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439833+0000", 2024-09-14T09:07:46.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0051584350000000003 2024-09-14T09:07:46.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:46.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439859+0000", 2024-09-14T09:07:46.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5573999999999999e-05 2024-09-14T09:07:46.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439877+0000", 2024-09-14T09:07:46.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7764000000000001e-05 2024-09-14T09:07:46.579 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.579 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.579 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.579 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-14T09:07:46.580 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.430045+0000", 2024-09-14T09:07:46.580 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 15.043132097000001, 2024-09-14T09:07:46.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098923150000000005, 2024-09-14T09:07:46.580 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.580 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.580 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:46.580 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.580 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:46.580 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:46.580 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 76 2024-09-14T09:07:46.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.580 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430045+0000", 2024-09-14T09:07:46.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430045+0000", 2024-09-14T09:07:46.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430046+0000", 2024-09-14T09:07:46.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1099999999999995e-07 2024-09-14T09:07:46.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430051+0000", 2024-09-14T09:07:46.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5659999999999997e-06 2024-09-14T09:07:46.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430059+0000", 2024-09-14T09:07:46.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3699999999999997e-06 2024-09-14T09:07:46.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430063+0000", 2024-09-14T09:07:46.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6999999999999999e-06 2024-09-14T09:07:46.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434330+0000", 2024-09-14T09:07:46.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042661929999999997 2024-09-14T09:07:46.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434372+0000", 2024-09-14T09:07:46.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1950000000000003e-05 2024-09-14T09:07:46.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:46.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434444+0000", 2024-09-14T09:07:46.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2775999999999996e-05 2024-09-14T09:07:46.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:46.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434913+0000", 2024-09-14T09:07:46.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046910499999999999 2024-09-14T09:07:46.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:46.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439898+0000", 2024-09-14T09:07:46.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.004984128 2024-09-14T09:07:46.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:46.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439921+0000", 2024-09-14T09:07:46.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3564999999999999e-05 2024-09-14T09:07:46.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439937+0000", 2024-09-14T09:07:46.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6351e-05 2024-09-14T09:07:46.585 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.585 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.585 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.585 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4217.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-14T09:07:46.585 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:35.248793+0000", 2024-09-14T09:07:46.585 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 11.224384761, 2024-09-14T09:07:46.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00936297, 2024-09-14T09:07:46.585 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:46.585 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:46.585 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:46.586 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:46.586 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4217", 2024-09-14T09:07:46.586 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.116:0/2127928146", 2024-09-14T09:07:46.586 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1 2024-09-14T09:07:46.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.586 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:46.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:46.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248793+0000", 2024-09-14T09:07:46.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:46.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248793+0000", 2024-09-14T09:07:46.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:46.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:46.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248794+0000", 2024-09-14T09:07:46.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.192e-06 2024-09-14T09:07:46.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:46.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248798+0000", 2024-09-14T09:07:46.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4580000000000003e-06 2024-09-14T09:07:46.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:46.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248808+0000", 2024-09-14T09:07:46.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5859999999999994e-06 2024-09-14T09:07:46.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:46.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248815+0000", 2024-09-14T09:07:46.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5499999999999997e-06 2024-09-14T09:07:46.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248874+0000", 2024-09-14T09:07:46.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.91e-05 2024-09-14T09:07:46.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:07:46.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248884+0000", 2024-09-14T09:07:46.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6830000000000003e-06 2024-09-14T09:07:46.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:46.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.253902+0000", 2024-09-14T09:07:46.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050176420000000001 2024-09-14T09:07:46.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:46.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254042+0000", 2024-09-14T09:07:46.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000139806 2024-09-14T09:07:46.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-09-14T09:07:46.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254160+0000", 2024-09-14T09:07:46.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000118373 2024-09-14T09:07:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.257976+0000", 2024-09-14T09:07:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0038157299999999998 2024-09-14T09:07:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.258103+0000", 2024-09-14T09:07:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000127494 2024-09-14T09:07:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.258132+0000", 2024-09-14T09:07:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8809000000000001e-05 2024-09-14T09:07:46.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:46.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:46.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:46.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.258155+0000", 2024-09-14T09:07:46.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3547e-05 2024-09-14T09:07:46.591 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.591 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.591 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.591 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:46.591 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:46.591 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:46.593 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:07:46.593 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:46.594+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:46.693 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:46.695+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:46.737 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:46.737 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:07:46.737 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:07:46.737 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:46.745 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:07:46.793 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:46.795+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:46.848 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:46.848 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:07:46.848 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:07:46.848 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:07:46.848 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:46.857 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:07:46.895 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:46.897+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:46.996 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:46.998+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:47.000 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:47.000 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:07:47.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:07:47.000 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:07:47.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:47.001 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4217.0:1 2.3 e18/17 2:c4c92e5a:::rbd_trash:head v 18'1, mlcod=0'0)", 2024-09-14T09:07:47.001 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:35.254531+0000", 2024-09-14T09:07:47.001 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 11.748564951000001, 2024-09-14T09:07:47.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034687910000000001, 2024-09-14T09:07:47.001 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:47.001 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:47.001 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:47.001 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254531+0000", 2024-09-14T09:07:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254531+0000", 2024-09-14T09:07:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:47.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254531+0000", 2024-09-14T09:07:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3300000000000001e-07 2024-09-14T09:07:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254536+0000", 2024-09-14T09:07:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3069999999999996e-06 2024-09-14T09:07:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:47.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254546+0000", 2024-09-14T09:07:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8309999999999996e-06 2024-09-14T09:07:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254558+0000", 2024-09-14T09:07:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2162e-05 2024-09-14T09:07:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254611+0000", 2024-09-14T09:07:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3409000000000003e-05 2024-09-14T09:07:47.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:47.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:47.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:47.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254635+0000", 2024-09-14T09:07:47.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4297000000000001e-05 2024-09-14T09:07:47.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:47.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:47.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:47.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.257943+0000", 2024-09-14T09:07:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033075190000000001 2024-09-14T09:07:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.258000+0000", 2024-09-14T09:07:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7033000000000001e-05 2024-09-14T09:07:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:47.009 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:47.009 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:47.011 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:07:47.097 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:47.099+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:47.126 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:47.127 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:07:47.127 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:07:47.127 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:47.135 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:07:47.198 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:47.199+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:47.280 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:47.280 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:07:47.280 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:07:47.280 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:07:47.280 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:47.288 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:07:47.290 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is set 2024-09-14T09:07:47.298 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:47.300+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:47.393 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:47.393 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:07:47.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:07:47.394 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [] 2024-09-14T09:07:47.394 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:47.400 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:47.402+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:47.402 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:07:47.501 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:47.503+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:47.547 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:47.547 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:07:47.547 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:07:47.548 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:47.555 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:07:47.641 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:47.643+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:47.699 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:47.699 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:07:47.699 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:07:47.700 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:07:47.700 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:47.702 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:07:47.703 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:47.705+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:47.707 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:07:47.804 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:47.806+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:07:47.820 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:07:47.820 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:07:47.836 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:07:47.837 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:07:47.852 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:47.852 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:07:47.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:07:47.852 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:07:47.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:47.852 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4217.0:5 2.2 e19/17 2:5cea7035:::rbd_info:head v 19'1, mlcod=0'0)", 2024-09-14T09:07:47.852 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:36.253847+0000", 2024-09-14T09:07:47.852 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 11.600860665999999, 2024-09-14T09:07:47.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00088235799999999997, 2024-09-14T09:07:47.852 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:47.853 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:47.853 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:47.853 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:47.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:47.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:47.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253847+0000", 2024-09-14T09:07:47.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:47.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:47.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:47.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:47.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253847+0000", 2024-09-14T09:07:47.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:47.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:47.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:47.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:47.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253847+0000", 2024-09-14T09:07:47.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.41e-07 2024-09-14T09:07:47.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:47.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:47.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:47.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253853+0000", 2024-09-14T09:07:47.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6949999999999997e-06 2024-09-14T09:07:47.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:47.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:47.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:47.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253869+0000", 2024-09-14T09:07:47.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5888000000000001e-05 2024-09-14T09:07:47.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:47.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:47.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:47.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253879+0000", 2024-09-14T09:07:47.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.995e-06 2024-09-14T09:07:47.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:47.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:47.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:47.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253940+0000", 2024-09-14T09:07:47.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1283000000000003e-05 2024-09-14T09:07:47.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:47.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:47.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:47.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253958+0000", 2024-09-14T09:07:47.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8286000000000001e-05 2024-09-14T09:07:47.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:47.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:47.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:47.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.254681+0000", 2024-09-14T09:07:47.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00072306900000000001 2024-09-14T09:07:47.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:47.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:47.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:47.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.254729+0000", 2024-09-14T09:07:47.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7901000000000001e-05 2024-09-14T09:07:47.856 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:47.857 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:47.857 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:47.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:47.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:47.857 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4217.0:7 2.2 e20/17 2:5cea7035:::rbd_info:head v 20'2, mlcod=0'0)", 2024-09-14T09:07:47.857 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:37.260704+0000", 2024-09-14T09:07:47.857 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.594003502, 2024-09-14T09:07:47.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001519589, 2024-09-14T09:07:47.857 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:47.857 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:47.857 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:47.857 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:47.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:47.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:47.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260704+0000", 2024-09-14T09:07:47.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:47.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:47.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:47.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:47.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260704+0000", 2024-09-14T09:07:47.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:47.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:47.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:47.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:47.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260704+0000", 2024-09-14T09:07:47.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8299999999999998e-07 2024-09-14T09:07:47.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:47.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:47.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:47.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260711+0000", 2024-09-14T09:07:47.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0160000000000003e-06 2024-09-14T09:07:47.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:47.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:47.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:47.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260725+0000", 2024-09-14T09:07:47.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3740000000000001e-05 2024-09-14T09:07:47.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:47.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:47.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:47.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260744+0000", 2024-09-14T09:07:47.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9023999999999999e-05 2024-09-14T09:07:47.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:47.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:47.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:47.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260800+0000", 2024-09-14T09:07:47.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5739000000000003e-05 2024-09-14T09:07:47.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:47.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:47.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:47.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260819+0000", 2024-09-14T09:07:47.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9236999999999999e-05 2024-09-14T09:07:47.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:47.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:47.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:47.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.262184+0000", 2024-09-14T09:07:47.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001364873 2024-09-14T09:07:47.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:47.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:47.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:47.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.262224+0000", 2024-09-14T09:07:47.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9677e-05 2024-09-14T09:07:47.861 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:47.861 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:47.861 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:47.861 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:47.861 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:47.862 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:47.862 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:07:47.863 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:07:47.863 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:07:47.869 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:07:47.869 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:07:47.886 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:07:47.886 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:07:47.902 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:07:47.902 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:07:47.904 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:47.906+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:07:47.966 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:47.966 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:47.975 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:07:48.006 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:48.008+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:48.077 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:48.077 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:48.086 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:07:48.130 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:48.132+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:48.188 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:48.188 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:48.197 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:07:48.241 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:48.243+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:48.302 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:48.303 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:48.308 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:48.310+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:48.311 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:07:48.409 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:48.411+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:07:48.454 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:48.454 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:48.462 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:07:48.510 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:48.512+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:48.605 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:48.605 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:48.611 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:48.612+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:48.614 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:07:48.712 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:48.714+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:48.756 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:48.757 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:48.765 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:07:48.813 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:48.815+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:48.867 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:48.867 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:48.876 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:07:48.913 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:48.916+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:48.978 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:48.978 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:48.986 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:07:49.030 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:49.032+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:07:49.089 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:49.089 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:49.097 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:07:49.116 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:49.118+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:49.217 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:49.219+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:49.222 INFO:teuthology.orchestra.run.smithi148.stdout:2 write 0x774e800 thru 0x775945c (0xac5d bytes) 2024-09-14T09:07:49.222 INFO:teuthology.orchestra.run.smithi148.stdout:6 write 0x3997e00 thru 0x399df25 (0x6126 bytes) 2024-09-14T09:07:49.222 INFO:teuthology.orchestra.run.smithi148.stdout:7 write 0x6ee000 thru 0x6f7ce2 (0x9ce3 bytes) 2024-09-14T09:07:49.249 INFO:teuthology.orchestra.run.smithi148.stdout:9 write 0xc69b000 thru 0xc6a03ff (0x5400 bytes) 2024-09-14T09:07:49.249 INFO:teuthology.orchestra.run.smithi148.stdout:11 read 0x3985a00 thru 0x398f257 (0x9858 bytes) 2024-09-14T09:07:49.250 INFO:teuthology.orchestra.run.smithi148.stdout:12 write 0x519fe00 thru 0x51a1406 (0x1607 bytes) 2024-09-14T09:07:49.250 INFO:teuthology.orchestra.run.smithi148.stdout:13 punch from 0x1e79e00 to 0x1e80600, (0x6800 bytes) 2024-09-14T09:07:49.250 INFO:teuthology.orchestra.run.smithi148.stdout:15 punch from 0xa6eba00 to 0xa6f8c00, (0xd200 bytes) 2024-09-14T09:07:49.250 INFO:teuthology.orchestra.run.smithi148.stdout:16 clone 1 order 24 su 524288 sc 6 2024-09-14T09:07:49.252 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:49.252 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:49.262 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:07:49.299 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T09:07:49.299 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:07:49.299 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-14T09:07:49.299 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T09:07:49.299 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T09:07:49.299 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-14T09:07:49.307 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T09:07:49.344 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:49.346+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:49.377 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:49.377 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:49.385 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:07:49.414 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:49.415 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-14T09:07:49.415 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:49.418 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:49.420+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:07:49.491 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:49.492 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:49.501 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:07:49.546 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:49.548+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:49.597 INFO:teuthology.orchestra.run.smithi148.stdout:18 write 0x162ea00 thru 0x1637240 (0x8841 bytes) 2024-09-14T09:07:49.598 INFO:teuthology.orchestra.run.smithi148.stdout:21 write 0x92d6800 thru 0x92e3f48 (0xd749 bytes) 2024-09-14T09:07:49.599 INFO:teuthology.orchestra.run.smithi148.stdout:22 read 0x2f06400 thru 0x2f0a79c (0x439d bytes) 2024-09-14T09:07:49.599 INFO:teuthology.orchestra.run.smithi148.stdout:23 read 0xc3df600 thru 0xc3ed977 (0xe378 bytes) 2024-09-14T09:07:49.599 INFO:teuthology.orchestra.run.smithi148.stdout:26 punch from 0x433ae00 to 0x433c200, (0x1400 bytes) 2024-09-14T09:07:49.605 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:49.606 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:49.610 INFO:teuthology.orchestra.run.smithi148.stdout:27 punch from 0x6bd8400 to 0x6bda600, (0x2200 bytes) 2024-09-14T09:07:49.612 INFO:teuthology.orchestra.run.smithi148.stdout:29 write 0x5e4ca00 thru 0x5e5288e (0x5e8f bytes) 2024-09-14T09:07:49.613 INFO:teuthology.orchestra.run.smithi148.stdout:32 read 0x119000 thru 0x1203e6 (0x73e7 bytes) 2024-09-14T09:07:49.613 INFO:teuthology.orchestra.run.smithi148.stdout:34 write 0x2905a00 thru 0x29129a9 (0xcfaa bytes) 2024-09-14T09:07:49.613 INFO:teuthology.orchestra.run.smithi148.stdout:38 punch from 0x936be00 to 0x937ac00, (0xee00 bytes) 2024-09-14T09:07:49.615 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:07:49.622 INFO:teuthology.orchestra.run.smithi148.stdout:39 write 0x3c60e00 thru 0x3c70824 (0xfa25 bytes) 2024-09-14T09:07:49.622 INFO:teuthology.orchestra.run.smithi148.stdout:41 read 0x55e9e00 thru 0x55edabf (0x3cc0 bytes) 2024-09-14T09:07:49.622 INFO:teuthology.orchestra.run.smithi148.stdout:42 punch from 0x1188c00 to 0x1190000, (0x7400 bytes) 2024-09-14T09:07:49.629 INFO:teuthology.orchestra.run.smithi148.stdout:43 write 0x8782200 thru 0x8785e22 (0x3c23 bytes) 2024-09-14T09:07:49.629 INFO:teuthology.orchestra.run.smithi148.stdout:44 write 0x7875a00 thru 0x7880e1f (0xb420 bytes) 2024-09-14T09:07:49.630 INFO:teuthology.orchestra.run.smithi148.stdout:47 read 0x3ca8400 thru 0x3ca9916 (0x1517 bytes) 2024-09-14T09:07:49.630 INFO:teuthology.orchestra.run.smithi148.stdout:52 write 0x2f1d600 thru 0x2f2101c (0x3a1d bytes) 2024-09-14T09:07:49.631 INFO:teuthology.orchestra.run.smithi148.stdout:55 punch from 0x5a77400 to 0x5a7f200, (0x7e00 bytes) 2024-09-14T09:07:49.636 INFO:teuthology.orchestra.run.smithi148.stdout:57 read 0x3802000 thru 0x3802897 (0x898 bytes) 2024-09-14T09:07:49.637 INFO:teuthology.orchestra.run.smithi148.stdout:58 read 0x88dd800 thru 0x88ebaf9 (0xe2fa bytes) 2024-09-14T09:07:49.637 INFO:teuthology.orchestra.run.smithi148.stdout:61 read 0x95ee800 thru 0x95f9e55 (0xb656 bytes) 2024-09-14T09:07:49.637 INFO:teuthology.orchestra.run.smithi148.stdout:62 write 0x98e4600 thru 0x98e6a95 (0x2496 bytes) 2024-09-14T09:07:49.638 INFO:teuthology.orchestra.run.smithi148.stdout:64 write 0x56ca200 thru 0x56d9b12 (0xf913 bytes) 2024-09-14T09:07:49.638 INFO:teuthology.orchestra.run.smithi148.stdout:68 punch from 0x2f00400 to 0x2f0b400, (0xb000 bytes) 2024-09-14T09:07:49.641 INFO:teuthology.orchestra.run.smithi148.stdout:truncating to largest ever: 0xe0d5a00 2024-09-14T09:07:49.643 INFO:teuthology.orchestra.run.smithi148.stdout:69 trunc from 0xc6a0400 to 0xe0d5a00 2024-09-14T09:07:49.652 INFO:teuthology.orchestra.run.smithi148.stdout:70 write 0xafe8400 thru 0xaff5026 (0xcc27 bytes) 2024-09-14T09:07:49.653 INFO:teuthology.orchestra.run.smithi148.stdout:76 write 0xd28e600 thru 0xd29e45b (0xfe5c bytes) 2024-09-14T09:07:49.653 INFO:teuthology.orchestra.run.smithi148.stdout:80 read 0x4ce4000 thru 0x4ceec69 (0xac6a bytes) 2024-09-14T09:07:49.656 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:49.658+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:49.657 INFO:teuthology.orchestra.run.smithi148.stdout:81 trunc from 0xe0d5a00 to 0xa9e8600 2024-09-14T09:07:49.683 INFO:teuthology.orchestra.run.smithi148.stdout:82 read 0xa473600 thru 0xa473ca5 (0x6a6 bytes) 2024-09-14T09:07:49.685 INFO:teuthology.orchestra.run.smithi148.stdout:84 read 0x6c1a00 thru 0x6c8d3c (0x733d bytes) 2024-09-14T09:07:49.685 INFO:teuthology.orchestra.run.smithi148.stdout:85 read 0x7963000 thru 0x7972bba (0xfbbb bytes) 2024-09-14T09:07:49.686 INFO:teuthology.orchestra.run.smithi148.stdout:86 read 0x4e16400 thru 0x4e1f1f5 (0x8df6 bytes) 2024-09-14T09:07:49.698 INFO:teuthology.orchestra.run.smithi148.stdout:88 write 0xdc2e200 thru 0xdc391da (0xafdb bytes) 2024-09-14T09:07:49.699 INFO:teuthology.orchestra.run.smithi148.stdout:89 write 0x655a200 thru 0x655d6b3 (0x34b4 bytes) 2024-09-14T09:07:49.699 INFO:teuthology.orchestra.run.smithi148.stdout:91 punch from 0x53a3000 to 0x53a3400, (0x400 bytes) 2024-09-14T09:07:49.700 INFO:teuthology.orchestra.run.smithi148.stdout:93 write 0xd9ff000 thru 0xda0b0ec (0xc0ed bytes) 2024-09-14T09:07:49.700 INFO:teuthology.orchestra.run.smithi148.stdout:95 read 0x1c8b000 thru 0x1c9af8e (0xff8f bytes) 2024-09-14T09:07:49.713 INFO:teuthology.orchestra.run.smithi148.stdout:96 trunc from 0xdc39200 to 0x2e8de00 2024-09-14T09:07:49.720 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:49.722+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:49.752 INFO:teuthology.orchestra.run.smithi148.stdout:100 read 0x126000 thru 0x135be9 (0xfbea bytes) 2024-09-14T09:07:49.753 INFO:teuthology.orchestra.run.smithi148.stdout:101 write 0x246ce00 thru 0x24744f4 (0x76f5 bytes) 2024-09-14T09:07:49.754 INFO:teuthology.orchestra.run.smithi148.stdout:103 punch from 0x174a800 to 0x1750000, (0x5800 bytes) 2024-09-14T09:07:49.754 INFO:teuthology.orchestra.run.smithi148.stdout:104 write 0xd68400 thru 0xd7263a (0xa23b bytes) 2024-09-14T09:07:49.754 INFO:teuthology.orchestra.run.smithi148.stdout:105 punch from 0x2442000 to 0x2450400, (0xe400 bytes) 2024-09-14T09:07:49.755 INFO:teuthology.orchestra.run.smithi148.stdout:106 punch from 0x2786800 to 0x278f600, (0x8e00 bytes) 2024-09-14T09:07:49.755 INFO:teuthology.orchestra.run.smithi148.stdout:111 punch from 0x22f4200 to 0x22fde00, (0x9c00 bytes) 2024-09-14T09:07:49.755 INFO:teuthology.orchestra.run.smithi148.stdout:113 punch from 0x1879800 to 0x1880800, (0x7000 bytes) 2024-09-14T09:07:49.765 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:49.765 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:49.774 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:07:49.778 INFO:teuthology.orchestra.run.smithi148.stdout:115 write 0xa75f600 thru 0xa76328a (0x3c8b bytes) 2024-09-14T09:07:49.778 INFO:teuthology.orchestra.run.smithi148.stdout:116 read 0x4ac3a00 thru 0x4ac5e9a (0x249b bytes) 2024-09-14T09:07:49.778 INFO:teuthology.orchestra.run.smithi148.stdout:119 clone 2 order 22 su 2097152 sc 7 2024-09-14T09:07:49.821 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:49.823+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:49.877 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:49.877 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:49.885 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:07:49.913 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:07:49.927 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:49.929+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:50.023 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:50.025+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:50.029 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:50.029 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:50.032 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:07:50.032 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:07:50.038 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:07:50.048 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:07:50.048 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:07:50.063 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:07:50.063 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:07:50.080 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:07:50.080 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:07:50.096 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:07:50.096 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:07:50.113 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:07:50.114 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:07:50.124 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:50.126+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:50.142 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:50.142 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:07:50.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:07:50.142 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:07:50.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.142 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4217.0:5 2.2 e19/17 2:5cea7035:::rbd_info:head v 19'1, mlcod=0'0)", 2024-09-14T09:07:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:36.253847+0000", 2024-09-14T09:07:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.891196729000001, 2024-09-14T09:07:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00088235799999999997, 2024-09-14T09:07:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253847+0000", 2024-09-14T09:07:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253847+0000", 2024-09-14T09:07:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253847+0000", 2024-09-14T09:07:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.41e-07 2024-09-14T09:07:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253853+0000", 2024-09-14T09:07:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6949999999999997e-06 2024-09-14T09:07:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253869+0000", 2024-09-14T09:07:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5888000000000001e-05 2024-09-14T09:07:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253879+0000", 2024-09-14T09:07:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.995e-06 2024-09-14T09:07:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253940+0000", 2024-09-14T09:07:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1283000000000003e-05 2024-09-14T09:07:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253958+0000", 2024-09-14T09:07:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8286000000000001e-05 2024-09-14T09:07:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.254681+0000", 2024-09-14T09:07:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00072306900000000001 2024-09-14T09:07:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.254729+0000", 2024-09-14T09:07:50.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7901000000000001e-05 2024-09-14T09:07:50.147 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.147 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.147 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.147 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4217.0:7 2.2 e20/17 2:5cea7035:::rbd_info:head v 20'2, mlcod=0'0)", 2024-09-14T09:07:50.147 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:37.260704+0000", 2024-09-14T09:07:50.147 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.884339564999999, 2024-09-14T09:07:50.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001519589, 2024-09-14T09:07:50.147 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:50.147 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:50.147 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.147 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:50.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:50.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260704+0000", 2024-09-14T09:07:50.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:50.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260704+0000", 2024-09-14T09:07:50.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:50.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260704+0000", 2024-09-14T09:07:50.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8299999999999998e-07 2024-09-14T09:07:50.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:50.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260711+0000", 2024-09-14T09:07:50.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0160000000000003e-06 2024-09-14T09:07:50.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:50.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260725+0000", 2024-09-14T09:07:50.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3740000000000001e-05 2024-09-14T09:07:50.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260744+0000", 2024-09-14T09:07:50.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9023999999999999e-05 2024-09-14T09:07:50.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:50.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260800+0000", 2024-09-14T09:07:50.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5739000000000003e-05 2024-09-14T09:07:50.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:50.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260819+0000", 2024-09-14T09:07:50.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9236999999999999e-05 2024-09-14T09:07:50.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:50.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.262184+0000", 2024-09-14T09:07:50.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001364873 2024-09-14T09:07:50.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:50.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.262224+0000", 2024-09-14T09:07:50.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9677e-05 2024-09-14T09:07:50.151 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.151 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.151 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.151 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.151 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.151 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:50.152 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:07:50.225 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:50.227+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:07:50.255 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:50.256 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:07:50.256 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:07:50.256 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:50.264 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:07:50.301 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is unset 2024-09-14T09:07:50.326 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:50.329+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:50.370 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:50.370 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:07:50.370 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:07:50.370 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:07:50.370 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:50.378 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:07:50.463 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:50.465+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:50.524 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:50.524 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:07:50.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:07:50.524 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:07:50.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.524 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:39 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'21, mlcod=15'19)", 2024-09-14T09:07:50.524 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.153416+0000", 2024-09-14T09:07:50.525 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.371817716999999, 2024-09-14T09:07:50.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0064237909999999999, 2024-09-14T09:07:50.525 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:50.525 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:50.525 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.525 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:50.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:50.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.153416+0000", 2024-09-14T09:07:50.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:50.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.153416+0000", 2024-09-14T09:07:50.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:50.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.153417+0000", 2024-09-14T09:07:50.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9800000000000002e-07 2024-09-14T09:07:50.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:50.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.153425+0000", 2024-09-14T09:07:50.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7770000000000002e-06 2024-09-14T09:07:50.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:50.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.153439+0000", 2024-09-14T09:07:50.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4372000000000001e-05 2024-09-14T09:07:50.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.153448+0000", 2024-09-14T09:07:50.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6070000000000008e-06 2024-09-14T09:07:50.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:50.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.153501+0000", 2024-09-14T09:07:50.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3034000000000001e-05 2024-09-14T09:07:50.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:50.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.153521+0000", 2024-09-14T09:07:50.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9777999999999999e-05 2024-09-14T09:07:50.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:50.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159809+0000", 2024-09-14T09:07:50.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062885959999999996 2024-09-14T09:07:50.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:50.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159840+0000", 2024-09-14T09:07:50.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0629000000000001e-05 2024-09-14T09:07:50.529 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.529 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.529 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.529 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:40 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'22, mlcod=15'19)", 2024-09-14T09:07:50.529 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.153966+0000", 2024-09-14T09:07:50.529 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.371267803999999, 2024-09-14T09:07:50.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005895501, 2024-09-14T09:07:50.529 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:50.529 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:50.529 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.529 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:50.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:50.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.153966+0000", 2024-09-14T09:07:50.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:50.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.153966+0000", 2024-09-14T09:07:50.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:50.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.153967+0000", 2024-09-14T09:07:50.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-07 2024-09-14T09:07:50.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:50.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.153983+0000", 2024-09-14T09:07:50.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6039e-05 2024-09-14T09:07:50.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:50.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.153993+0000", 2024-09-14T09:07:50.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.91e-06 2024-09-14T09:07:50.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.153997+0000", 2024-09-14T09:07:50.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7539999999999997e-06 2024-09-14T09:07:50.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:50.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154042+0000", 2024-09-14T09:07:50.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4759000000000003e-05 2024-09-14T09:07:50.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:50.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154059+0000", 2024-09-14T09:07:50.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7090000000000001e-05 2024-09-14T09:07:50.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:50.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159843+0000", 2024-09-14T09:07:50.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0057834200000000001 2024-09-14T09:07:50.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:50.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159862+0000", 2024-09-14T09:07:50.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8932000000000001e-05 2024-09-14T09:07:50.533 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.533 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.533 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.533 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:41 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'19)", 2024-09-14T09:07:50.533 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.154530+0000", 2024-09-14T09:07:50.533 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.370703906999999, 2024-09-14T09:07:50.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097193060000000005, 2024-09-14T09:07:50.534 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:50.534 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:50.534 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.534 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:50.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:50.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154530+0000", 2024-09-14T09:07:50.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:50.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154530+0000", 2024-09-14T09:07:50.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:50.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154531+0000", 2024-09-14T09:07:50.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6199999999999997e-07 2024-09-14T09:07:50.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:50.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154567+0000", 2024-09-14T09:07:50.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5988000000000002e-05 2024-09-14T09:07:50.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:50.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154577+0000", 2024-09-14T09:07:50.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0366999999999999e-05 2024-09-14T09:07:50.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154583+0000", 2024-09-14T09:07:50.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3929999999999996e-06 2024-09-14T09:07:50.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:50.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154630+0000", 2024-09-14T09:07:50.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6980000000000001e-05 2024-09-14T09:07:50.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:50.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154650+0000", 2024-09-14T09:07:50.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9817999999999999e-05 2024-09-14T09:07:50.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:50.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164200+0000", 2024-09-14T09:07:50.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0095500770000000006 2024-09-14T09:07:50.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:50.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164249+0000", 2024-09-14T09:07:50.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9020999999999997e-05 2024-09-14T09:07:50.537 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.537 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.537 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.538 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:42 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'24, mlcod=15'19)", 2024-09-14T09:07:50.538 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:07:50.538 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.370128483999999, 2024-09-14T09:07:50.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0091673220000000003, 2024-09-14T09:07:50.538 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:50.538 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:50.538 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.538 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:50.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:50.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:07:50.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:50.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:07:50.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:50.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:07:50.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5000000000000001e-07 2024-09-14T09:07:50.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:50.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155113+0000", 2024-09-14T09:07:50.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8719999999999996e-06 2024-09-14T09:07:50.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:50.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155126+0000", 2024-09-14T09:07:50.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2951e-05 2024-09-14T09:07:50.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155132+0000", 2024-09-14T09:07:50.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9270000000000002e-06 2024-09-14T09:07:50.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:50.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158468+0000", 2024-09-14T09:07:50.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033357980000000001 2024-09-14T09:07:50.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:50.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158510+0000", 2024-09-14T09:07:50.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2138999999999998e-05 2024-09-14T09:07:50.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:50.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164251+0000", 2024-09-14T09:07:50.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0057413209999999998 2024-09-14T09:07:50.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:50.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164273+0000", 2024-09-14T09:07:50.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1364000000000001e-05 2024-09-14T09:07:50.542 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.542 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.542 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.542 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:43 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'25, mlcod=15'19)", 2024-09-14T09:07:50.542 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.155476+0000", 2024-09-14T09:07:50.542 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.369757796000002, 2024-09-14T09:07:50.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0092500399999999993, 2024-09-14T09:07:50.542 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:50.542 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:50.543 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.543 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:50.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:50.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155476+0000", 2024-09-14T09:07:50.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:50.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155476+0000", 2024-09-14T09:07:50.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:50.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155477+0000", 2024-09-14T09:07:50.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5300000000000002e-07 2024-09-14T09:07:50.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:50.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155486+0000", 2024-09-14T09:07:50.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2024-09-14T09:07:50.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:50.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155498+0000", 2024-09-14T09:07:50.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2911999999999999e-05 2024-09-14T09:07:50.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155506+0000", 2024-09-14T09:07:50.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3390000000000004e-06 2024-09-14T09:07:50.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:50.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158814+0000", 2024-09-14T09:07:50.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033078309999999998 2024-09-14T09:07:50.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:50.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158849+0000", 2024-09-14T09:07:50.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5330000000000002e-05 2024-09-14T09:07:50.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:50.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164691+0000", 2024-09-14T09:07:50.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005842346 2024-09-14T09:07:50.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:50.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164726+0000", 2024-09-14T09:07:50.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4978999999999998e-05 2024-09-14T09:07:50.546 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.546 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.546 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.547 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:44 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'26, mlcod=15'19)", 2024-09-14T09:07:50.547 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.155917+0000", 2024-09-14T09:07:50.547 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.369317279000001, 2024-09-14T09:07:50.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0088430230000000002, 2024-09-14T09:07:50.547 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:50.547 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:50.547 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.547 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:50.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:50.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155917+0000", 2024-09-14T09:07:50.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:50.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155917+0000", 2024-09-14T09:07:50.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:50.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155918+0000", 2024-09-14T09:07:50.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0359999999999999e-06 2024-09-14T09:07:50.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:50.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155951+0000", 2024-09-14T09:07:50.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3256999999999997e-05 2024-09-14T09:07:50.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:50.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155965+0000", 2024-09-14T09:07:50.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3692e-05 2024-09-14T09:07:50.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155971+0000", 2024-09-14T09:07:50.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0510000000000002e-06 2024-09-14T09:07:50.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:50.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159107+0000", 2024-09-14T09:07:50.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031363430000000002 2024-09-14T09:07:50.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:50.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159127+0000", 2024-09-14T09:07:50.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0268999999999999e-05 2024-09-14T09:07:50.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:50.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164728+0000", 2024-09-14T09:07:50.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056003629999999997 2024-09-14T09:07:50.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:50.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164760+0000", 2024-09-14T09:07:50.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2011999999999998e-05 2024-09-14T09:07:50.551 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.551 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.551 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.551 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:45 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'27, mlcod=15'19)", 2024-09-14T09:07:50.551 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.156503+0000", 2024-09-14T09:07:50.551 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.368730590999998, 2024-09-14T09:07:50.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082756970000000003, 2024-09-14T09:07:50.551 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:50.551 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:50.551 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.552 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:50.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:50.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156503+0000", 2024-09-14T09:07:50.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:50.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156503+0000", 2024-09-14T09:07:50.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:50.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156505+0000", 2024-09-14T09:07:50.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8139999999999999e-06 2024-09-14T09:07:50.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:50.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156516+0000", 2024-09-14T09:07:50.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1019000000000001e-05 2024-09-14T09:07:50.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:50.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156543+0000", 2024-09-14T09:07:50.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.692e-05 2024-09-14T09:07:50.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156556+0000", 2024-09-14T09:07:50.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3063e-05 2024-09-14T09:07:50.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:50.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159573+0000", 2024-09-14T09:07:50.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003016712 2024-09-14T09:07:50.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:50.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159589+0000", 2024-09-14T09:07:50.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6494000000000002e-05 2024-09-14T09:07:50.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:50.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164762+0000", 2024-09-14T09:07:50.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051722519999999996 2024-09-14T09:07:50.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:50.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164779+0000", 2024-09-14T09:07:50.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7422999999999999e-05 2024-09-14T09:07:50.555 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.555 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.555 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.555 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:46 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'28, mlcod=15'19)", 2024-09-14T09:07:50.556 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.156804+0000", 2024-09-14T09:07:50.556 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.368429502000001, 2024-09-14T09:07:50.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079926879999999995, 2024-09-14T09:07:50.556 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:50.556 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:50.556 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.556 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:50.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:50.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156804+0000", 2024-09-14T09:07:50.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:50.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156804+0000", 2024-09-14T09:07:50.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:50.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156805+0000", 2024-09-14T09:07:50.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3099999999999998e-07 2024-09-14T09:07:50.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:50.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156809+0000", 2024-09-14T09:07:50.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8299999999999998e-06 2024-09-14T09:07:50.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:50.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156817+0000", 2024-09-14T09:07:50.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7579999999999992e-06 2024-09-14T09:07:50.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156831+0000", 2024-09-14T09:07:50.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4256999999999999e-05 2024-09-14T09:07:50.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:50.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159903+0000", 2024-09-14T09:07:50.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030721590000000001 2024-09-14T09:07:50.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:50.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159922+0000", 2024-09-14T09:07:50.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8994000000000001e-05 2024-09-14T09:07:50.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:50.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164780+0000", 2024-09-14T09:07:50.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048582879999999997 2024-09-14T09:07:50.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:50.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164797+0000", 2024-09-14T09:07:50.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6971000000000001e-05 2024-09-14T09:07:50.560 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.560 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.560 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.560 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:47 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'29, mlcod=15'19)", 2024-09-14T09:07:50.560 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.157344+0000", 2024-09-14T09:07:50.560 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.367890293999999, 2024-09-14T09:07:50.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074729030000000004, 2024-09-14T09:07:50.560 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:50.560 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:50.561 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.561 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:50.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:50.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157344+0000", 2024-09-14T09:07:50.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:50.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157344+0000", 2024-09-14T09:07:50.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:50.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157346+0000", 2024-09-14T09:07:50.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.81e-06 2024-09-14T09:07:50.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:50.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157406+0000", 2024-09-14T09:07:50.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0523000000000003e-05 2024-09-14T09:07:50.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:50.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157434+0000", 2024-09-14T09:07:50.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8059999999999999e-05 2024-09-14T09:07:50.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157447+0000", 2024-09-14T09:07:50.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2666e-05 2024-09-14T09:07:50.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:50.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160183+0000", 2024-09-14T09:07:50.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002736413 2024-09-14T09:07:50.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:50.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160203+0000", 2024-09-14T09:07:50.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9545e-05 2024-09-14T09:07:50.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:50.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164798+0000", 2024-09-14T09:07:50.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045953890000000001 2024-09-14T09:07:50.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:50.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164817+0000", 2024-09-14T09:07:50.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8496999999999999e-05 2024-09-14T09:07:50.564 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.564 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.564 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.564 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:48 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'30, mlcod=15'19)", 2024-09-14T09:07:50.565 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.157693+0000", 2024-09-14T09:07:50.565 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.367541029000002, 2024-09-14T09:07:50.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0071445789999999999, 2024-09-14T09:07:50.565 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:50.565 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:50.565 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.565 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:50.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:50.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157693+0000", 2024-09-14T09:07:50.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:50.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157693+0000", 2024-09-14T09:07:50.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:50.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157694+0000", 2024-09-14T09:07:50.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2024-09-14T09:07:50.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:50.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157701+0000", 2024-09-14T09:07:50.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0230000000000004e-06 2024-09-14T09:07:50.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:50.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157709+0000", 2024-09-14T09:07:50.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7819999999999999e-06 2024-09-14T09:07:50.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157714+0000", 2024-09-14T09:07:50.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2440000000000004e-06 2024-09-14T09:07:50.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:50.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160598+0000", 2024-09-14T09:07:50.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028844280000000001 2024-09-14T09:07:50.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:50.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160618+0000", 2024-09-14T09:07:50.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0435e-05 2024-09-14T09:07:50.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:50.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164818+0000", 2024-09-14T09:07:50.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042000329999999997 2024-09-14T09:07:50.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:50.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164838+0000", 2024-09-14T09:07:50.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9054000000000001e-05 2024-09-14T09:07:50.569 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.569 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.569 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.569 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:49 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'31, mlcod=15'19)", 2024-09-14T09:07:50.569 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.158173+0000", 2024-09-14T09:07:50.569 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.367061366000001, 2024-09-14T09:07:50.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0066833700000000001, 2024-09-14T09:07:50.569 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:50.569 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:50.569 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.569 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:50.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:50.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158173+0000", 2024-09-14T09:07:50.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:50.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158173+0000", 2024-09-14T09:07:50.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:50.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158175+0000", 2024-09-14T09:07:50.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8840000000000001e-06 2024-09-14T09:07:50.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:50.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158188+0000", 2024-09-14T09:07:50.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3842999999999999e-05 2024-09-14T09:07:50.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:50.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158225+0000", 2024-09-14T09:07:50.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7039000000000002e-05 2024-09-14T09:07:50.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158243+0000", 2024-09-14T09:07:50.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7932999999999999e-05 2024-09-14T09:07:50.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:50.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160875+0000", 2024-09-14T09:07:50.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002632045 2024-09-14T09:07:50.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:50.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160887+0000", 2024-09-14T09:07:50.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2084e-05 2024-09-14T09:07:50.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:50.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164839+0000", 2024-09-14T09:07:50.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039511390000000002 2024-09-14T09:07:50.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:50.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164856+0000", 2024-09-14T09:07:50.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7402999999999999e-05 2024-09-14T09:07:50.573 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.573 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.573 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.573 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:50 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'19)", 2024-09-14T09:07:50.573 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.158531+0000", 2024-09-14T09:07:50.573 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.366703218000001, 2024-09-14T09:07:50.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063435460000000003, 2024-09-14T09:07:50.574 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:50.574 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:50.574 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.574 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:50.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:50.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158531+0000", 2024-09-14T09:07:50.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:50.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158531+0000", 2024-09-14T09:07:50.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:50.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158532+0000", 2024-09-14T09:07:50.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2600000000000001e-07 2024-09-14T09:07:50.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:50.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158584+0000", 2024-09-14T09:07:50.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2419000000000001e-05 2024-09-14T09:07:50.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:50.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158594+0000", 2024-09-14T09:07:50.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0056e-05 2024-09-14T09:07:50.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158602+0000", 2024-09-14T09:07:50.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4950000000000002e-06 2024-09-14T09:07:50.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:50.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.161122+0000", 2024-09-14T09:07:50.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025202940000000002 2024-09-14T09:07:50.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:50.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.161141+0000", 2024-09-14T09:07:50.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.946e-05 2024-09-14T09:07:50.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:50.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164857+0000", 2024-09-14T09:07:50.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037154829999999999 2024-09-14T09:07:50.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:50.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164874+0000", 2024-09-14T09:07:50.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7413000000000001e-05 2024-09-14T09:07:50.577 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.577 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.578 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.578 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:56 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'38, mlcod=15'33)", 2024-09-14T09:07:50.578 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.167691+0000", 2024-09-14T09:07:50.578 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.357543417999999, 2024-09-14T09:07:50.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063426649999999999, 2024-09-14T09:07:50.578 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:50.578 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:50.578 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.578 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:50.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:50.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.167691+0000", 2024-09-14T09:07:50.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:50.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.167691+0000", 2024-09-14T09:07:50.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:50.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.167691+0000", 2024-09-14T09:07:50.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8999999999999997e-07 2024-09-14T09:07:50.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:50.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.167778+0000", 2024-09-14T09:07:50.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6996000000000005e-05 2024-09-14T09:07:50.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:50.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.167786+0000", 2024-09-14T09:07:50.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4300000000000006e-06 2024-09-14T09:07:50.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.167791+0000", 2024-09-14T09:07:50.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1690000000000002e-06 2024-09-14T09:07:50.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:50.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.167828+0000", 2024-09-14T09:07:50.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6844000000000002e-05 2024-09-14T09:07:50.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:50.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.167842+0000", 2024-09-14T09:07:50.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4569999999999999e-05 2024-09-14T09:07:50.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:50.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.173998+0000", 2024-09-14T09:07:50.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061557729999999998 2024-09-14T09:07:50.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:50.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.174033+0000", 2024-09-14T09:07:50.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5392999999999998e-05 2024-09-14T09:07:50.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.582 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.582 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:66 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'44, mlcod=15'40)", 2024-09-14T09:07:50.582 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.430075+0000", 2024-09-14T09:07:50.582 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.09515918, 2024-09-14T09:07:50.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070127770000000004, 2024-09-14T09:07:50.582 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:50.583 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:50.583 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.583 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:50.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:50.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430075+0000", 2024-09-14T09:07:50.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:50.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430075+0000", 2024-09-14T09:07:50.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:50.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430076+0000", 2024-09-14T09:07:50.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4200000000000005e-07 2024-09-14T09:07:50.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:50.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430131+0000", 2024-09-14T09:07:50.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099000000000002e-05 2024-09-14T09:07:50.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:50.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430141+0000", 2024-09-14T09:07:50.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.978e-06 2024-09-14T09:07:50.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430145+0000", 2024-09-14T09:07:50.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4519999999999999e-06 2024-09-14T09:07:50.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:50.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430189+0000", 2024-09-14T09:07:50.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3924000000000002e-05 2024-09-14T09:07:50.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:50.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430202+0000", 2024-09-14T09:07:50.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3319000000000001e-05 2024-09-14T09:07:50.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:50.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437052+0000", 2024-09-14T09:07:50.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0068491389999999997 2024-09-14T09:07:50.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:50.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437088+0000", 2024-09-14T09:07:50.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6023999999999999e-05 2024-09-14T09:07:50.586 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.586 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.586 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.587 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:67 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'45, mlcod=15'40)", 2024-09-14T09:07:50.587 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.430561+0000", 2024-09-14T09:07:50.587 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.094672652, 2024-09-14T09:07:50.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065458490000000003, 2024-09-14T09:07:50.587 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:50.587 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:50.587 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.587 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:50.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:50.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430561+0000", 2024-09-14T09:07:50.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:50.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430561+0000", 2024-09-14T09:07:50.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:50.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430562+0000", 2024-09-14T09:07:50.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1500000000000005e-07 2024-09-14T09:07:50.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:50.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430566+0000", 2024-09-14T09:07:50.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8589999999999998e-06 2024-09-14T09:07:50.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:50.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430572+0000", 2024-09-14T09:07:50.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5390000000000004e-06 2024-09-14T09:07:50.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430576+0000", 2024-09-14T09:07:50.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4879999999999999e-06 2024-09-14T09:07:50.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:50.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430724+0000", 2024-09-14T09:07:50.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000148107 2024-09-14T09:07:50.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:50.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430775+0000", 2024-09-14T09:07:50.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1010000000000001e-05 2024-09-14T09:07:50.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:50.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437090+0000", 2024-09-14T09:07:50.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063148129999999998 2024-09-14T09:07:50.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:50.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437107+0000", 2024-09-14T09:07:50.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7518000000000001e-05 2024-09-14T09:07:50.591 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.591 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.591 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.591 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:68 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'46, mlcod=15'40)", 2024-09-14T09:07:50.591 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.430910+0000", 2024-09-14T09:07:50.591 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.094323907, 2024-09-14T09:07:50.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062144690000000002, 2024-09-14T09:07:50.591 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:50.591 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:50.591 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.592 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:50.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:50.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430910+0000", 2024-09-14T09:07:50.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:50.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430910+0000", 2024-09-14T09:07:50.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:50.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430911+0000", 2024-09-14T09:07:50.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8400000000000003e-07 2024-09-14T09:07:50.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:50.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430916+0000", 2024-09-14T09:07:50.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.259e-06 2024-09-14T09:07:50.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:50.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430928+0000", 2024-09-14T09:07:50.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1931e-05 2024-09-14T09:07:50.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430933+0000", 2024-09-14T09:07:50.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2310000000000004e-06 2024-09-14T09:07:50.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:50.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430988+0000", 2024-09-14T09:07:50.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5050999999999999e-05 2024-09-14T09:07:50.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:50.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.431002+0000", 2024-09-14T09:07:50.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3134e-05 2024-09-14T09:07:50.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:50.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437109+0000", 2024-09-14T09:07:50.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006106981 2024-09-14T09:07:50.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:50.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437125+0000", 2024-09-14T09:07:50.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5998000000000002e-05 2024-09-14T09:07:50.595 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.595 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.595 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.595 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:72 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'50, mlcod=15'41)", 2024-09-14T09:07:50.595 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.432562+0000", 2024-09-14T09:07:50.596 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.092672129, 2024-09-14T09:07:50.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065129940000000002, 2024-09-14T09:07:50.596 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:50.596 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:50.596 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.596 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:50.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:50.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.432562+0000", 2024-09-14T09:07:50.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:50.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.432562+0000", 2024-09-14T09:07:50.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:50.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.432562+0000", 2024-09-14T09:07:50.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:07:50.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:50.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.432632+0000", 2024-09-14T09:07:50.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9482999999999999e-05 2024-09-14T09:07:50.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:50.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.432641+0000", 2024-09-14T09:07:50.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6950000000000006e-06 2024-09-14T09:07:50.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.432644+0000", 2024-09-14T09:07:50.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3000000000000002e-06 2024-09-14T09:07:50.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:50.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.434040+0000", 2024-09-14T09:07:50.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001395683 2024-09-14T09:07:50.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:50.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.434053+0000", 2024-09-14T09:07:50.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3013000000000001e-05 2024-09-14T09:07:50.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:50.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.439046+0000", 2024-09-14T09:07:50.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049934749999999998 2024-09-14T09:07:50.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:50.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.439075+0000", 2024-09-14T09:07:50.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8846000000000001e-05 2024-09-14T09:07:50.599 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.600 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.600 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.600 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:73 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'51, mlcod=15'41)", 2024-09-14T09:07:50.600 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.433184+0000", 2024-09-14T09:07:50.600 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.092050413999999, 2024-09-14T09:07:50.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063181870000000003, 2024-09-14T09:07:50.600 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:50.600 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:50.600 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.600 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:50.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:50.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433184+0000", 2024-09-14T09:07:50.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:50.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433184+0000", 2024-09-14T09:07:50.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:50.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433185+0000", 2024-09-14T09:07:50.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6700000000000002e-07 2024-09-14T09:07:50.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:50.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433193+0000", 2024-09-14T09:07:50.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3329999999999997e-06 2024-09-14T09:07:50.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:50.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433284+0000", 2024-09-14T09:07:50.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1602999999999997e-05 2024-09-14T09:07:50.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433298+0000", 2024-09-14T09:07:50.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.311e-05 2024-09-14T09:07:50.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:50.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.436150+0000", 2024-09-14T09:07:50.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002852659 2024-09-14T09:07:50.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:50.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.436165+0000", 2024-09-14T09:07:50.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4722999999999999e-05 2024-09-14T09:07:50.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:50.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.439476+0000", 2024-09-14T09:07:50.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033114059999999998 2024-09-14T09:07:50.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:50.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.439502+0000", 2024-09-14T09:07:50.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5386000000000001e-05 2024-09-14T09:07:50.604 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.604 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.604 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.604 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:74 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'52, mlcod=15'41)", 2024-09-14T09:07:50.604 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.433529+0000", 2024-09-14T09:07:50.605 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.091704792000002, 2024-09-14T09:07:50.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059868580000000003, 2024-09-14T09:07:50.605 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:50.605 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:50.605 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.605 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:50.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:50.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433529+0000", 2024-09-14T09:07:50.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:50.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433529+0000", 2024-09-14T09:07:50.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:50.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433530+0000", 2024-09-14T09:07:50.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9100000000000004e-07 2024-09-14T09:07:50.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:50.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433534+0000", 2024-09-14T09:07:50.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2470000000000002e-06 2024-09-14T09:07:50.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:50.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433542+0000", 2024-09-14T09:07:50.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6229999999999997e-06 2024-09-14T09:07:50.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433545+0000", 2024-09-14T09:07:50.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3749999999999999e-06 2024-09-14T09:07:50.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:50.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.436419+0000", 2024-09-14T09:07:50.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028736199999999999 2024-09-14T09:07:50.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:50.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.436432+0000", 2024-09-14T09:07:50.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3899e-05 2024-09-14T09:07:50.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:50.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.439503+0000", 2024-09-14T09:07:50.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030706890000000001 2024-09-14T09:07:50.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:50.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.439516+0000", 2024-09-14T09:07:50.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2914e-05 2024-09-14T09:07:50.609 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.609 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.609 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.609 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:89 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'63, mlcod=16'60)", 2024-09-14T09:07:50.609 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.666744+0000", 2024-09-14T09:07:50.609 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.858490193000002, 2024-09-14T09:07:50.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061730250000000004, 2024-09-14T09:07:50.609 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:50.609 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:50.609 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.609 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:50.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:50.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.666744+0000", 2024-09-14T09:07:50.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:50.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.666744+0000", 2024-09-14T09:07:50.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:50.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:50.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.666744+0000", 2024-09-14T09:07:50.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6000000000000004e-07 2024-09-14T09:07:50.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:50.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.666749+0000", 2024-09-14T09:07:50.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0359999999999997e-06 2024-09-14T09:07:50.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:50.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.666754+0000", 2024-09-14T09:07:50.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0420000000000002e-06 2024-09-14T09:07:50.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.666758+0000", 2024-09-14T09:07:50.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2179999999999999e-06 2024-09-14T09:07:50.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:50.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.666895+0000", 2024-09-14T09:07:50.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000137241 2024-09-14T09:07:50.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:50.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.666908+0000", 2024-09-14T09:07:50.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2964e-05 2024-09-14T09:07:50.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:50.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.672887+0000", 2024-09-14T09:07:50.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005978845 2024-09-14T09:07:50.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:50.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:50.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:50.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.672917+0000", 2024-09-14T09:07:50.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0119000000000001e-05 2024-09-14T09:07:50.613 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.613 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.613 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.613 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:50.613 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:50.613 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:50.614 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone1 from 0xa763400 (overlap 0x2e8de00) to 0x0 2024-09-14T09:07:50.615 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:50.617+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:50.615 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:07:50.716 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:50.718+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:50.723 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:50.723 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:07:50.723 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:07:50.723 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:50.733 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:07:50.817 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:50.820+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:50.825 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #0, image image_client.0 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent1 2024-09-14T09:07:50.839 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:50.839 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:07:50.839 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:07:50.839 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:07:50.839 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:50.848 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:07:50.918 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:50.921+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:50.962 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:50.962 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:07:50.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:07:50.962 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:07:50.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.963 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4217.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-14T09:07:50.963 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:36.251612+0000", 2024-09-14T09:07:50.963 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.711650220999999, 2024-09-14T09:07:50.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0032752599999999999, 2024-09-14T09:07:50.963 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:50.963 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:50.963 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.963 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:50.963 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4217", 2024-09-14T09:07:50.964 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.116:0/2127928146", 2024-09-14T09:07:50.964 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 5 2024-09-14T09:07:50.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.964 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:50.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:50.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.251612+0000", 2024-09-14T09:07:50.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:50.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:50.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.251612+0000", 2024-09-14T09:07:50.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:50.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:50.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.251615+0000", 2024-09-14T09:07:50.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5069999999999999e-06 2024-09-14T09:07:50.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:50.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.251631+0000", 2024-09-14T09:07:50.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6201e-05 2024-09-14T09:07:50.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:50.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.251651+0000", 2024-09-14T09:07:50.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0081e-05 2024-09-14T09:07:50.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.251661+0000", 2024-09-14T09:07:50.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006999999999999e-05 2024-09-14T09:07:50.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:50.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.251733+0000", 2024-09-14T09:07:50.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1443e-05 2024-09-14T09:07:50.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:07:50.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.251737+0000", 2024-09-14T09:07:50.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6469999999999997e-06 2024-09-14T09:07:50.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:50.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.253352+0000", 2024-09-14T09:07:50.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001614367 2024-09-14T09:07:50.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:50.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.253473+0000", 2024-09-14T09:07:50.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000121507 2024-09-14T09:07:50.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 4", 2024-09-14T09:07:50.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.253610+0000", 2024-09-14T09:07:50.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136663 2024-09-14T09:07:50.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:50.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.254294+0000", 2024-09-14T09:07:50.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00068391000000000003 2024-09-14T09:07:50.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:50.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.254821+0000", 2024-09-14T09:07:50.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00052734699999999995 2024-09-14T09:07:50.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:50.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.254858+0000", 2024-09-14T09:07:50.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6395e-05 2024-09-14T09:07:50.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:50.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:36.254888+0000", 2024-09-14T09:07:50.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0185e-05 2024-09-14T09:07:50.972 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:50.973 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:50.973 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:50.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.973 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4217.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-14T09:07:50.973 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:37.257826+0000", 2024-09-14T09:07:50.973 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.70543619, 2024-09-14T09:07:50.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046214849999999998, 2024-09-14T09:07:50.973 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:50.973 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:50.973 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.974 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:50.974 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4217", 2024-09-14T09:07:50.974 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.116:0/2127928146", 2024-09-14T09:07:50.974 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7 2024-09-14T09:07:50.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.974 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:50.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:50.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.257826+0000", 2024-09-14T09:07:50.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:50.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:50.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.257826+0000", 2024-09-14T09:07:50.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:50.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:50.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.257828+0000", 2024-09-14T09:07:50.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6190000000000001e-06 2024-09-14T09:07:50.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:50.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.257845+0000", 2024-09-14T09:07:50.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6532999999999999e-05 2024-09-14T09:07:50.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:50.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.257864+0000", 2024-09-14T09:07:50.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8921000000000001e-05 2024-09-14T09:07:50.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.257874+0000", 2024-09-14T09:07:50.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.01e-05 2024-09-14T09:07:50.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:50.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.257936+0000", 2024-09-14T09:07:50.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2420000000000002e-05 2024-09-14T09:07:50.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:07:50.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.257942+0000", 2024-09-14T09:07:50.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3090000000000001e-06 2024-09-14T09:07:50.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:50.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.260275+0000", 2024-09-14T09:07:50.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023323850000000002 2024-09-14T09:07:50.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:50.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.260357+0000", 2024-09-14T09:07:50.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2305000000000006e-05 2024-09-14T09:07:50.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 4", 2024-09-14T09:07:50.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.260461+0000", 2024-09-14T09:07:50.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000104263 2024-09-14T09:07:50.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:50.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.261166+0000", 2024-09-14T09:07:50.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00070491499999999997 2024-09-14T09:07:50.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:50.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.262380+0000", 2024-09-14T09:07:50.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0012133020000000001 2024-09-14T09:07:50.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:50.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.262417+0000", 2024-09-14T09:07:50.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7848000000000001e-05 2024-09-14T09:07:50.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:50.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:37.262448+0000", 2024-09-14T09:07:50.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0565000000000003e-05 2024-09-14T09:07:50.981 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:50.981 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:50.981 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:50.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.981 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4370.0:10 3.1c e25/22 3:3831950c:::rbd_directory:head v 25'1, mlcod=0'0)", 2024-09-14T09:07:50.981 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:47.311332+0000", 2024-09-14T09:07:50.982 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.6519310809999999, 2024-09-14T09:07:50.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00072563100000000002, 2024-09-14T09:07:50.982 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:50.982 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:50.982 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.982 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:50.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:50.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.311332+0000", 2024-09-14T09:07:50.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:50.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:50.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.311332+0000", 2024-09-14T09:07:50.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:50.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:50.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.311332+0000", 2024-09-14T09:07:50.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7100000000000001e-07 2024-09-14T09:07:50.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:50.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.311336+0000", 2024-09-14T09:07:50.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0659999999999997e-06 2024-09-14T09:07:50.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:50.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.311348+0000", 2024-09-14T09:07:50.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2602000000000001e-05 2024-09-14T09:07:50.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.311357+0000", 2024-09-14T09:07:50.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2779999999999993e-06 2024-09-14T09:07:50.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:50.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.311415+0000", 2024-09-14T09:07:50.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8619000000000002e-05 2024-09-14T09:07:50.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:50.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.311435+0000", 2024-09-14T09:07:50.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9901000000000001e-05 2024-09-14T09:07:50.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:50.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.312026+0000", 2024-09-14T09:07:50.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0005911 2024-09-14T09:07:50.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:50.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.312057+0000", 2024-09-14T09:07:50.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0893999999999999e-05 2024-09-14T09:07:50.987 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:50.987 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:50.987 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:50.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.987 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4370.0:12 3.13 e25/22 3:cae4aeb8:::rbd_header.11128b09dac5:head v 25'1, mlcod=0'0)", 2024-09-14T09:07:50.987 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:47.314821+0000", 2024-09-14T09:07:50.987 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.6484421550000001, 2024-09-14T09:07:50.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034357150000000002, 2024-09-14T09:07:50.987 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:50.987 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:50.987 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.987 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:50.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:50.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.314821+0000", 2024-09-14T09:07:50.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:50.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:50.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.314821+0000", 2024-09-14T09:07:50.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:50.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:50.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.314821+0000", 2024-09-14T09:07:50.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1100000000000005e-07 2024-09-14T09:07:50.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:50.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.314837+0000", 2024-09-14T09:07:50.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5897999999999999e-05 2024-09-14T09:07:50.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:50.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.314849+0000", 2024-09-14T09:07:50.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1943000000000001e-05 2024-09-14T09:07:50.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.314857+0000", 2024-09-14T09:07:50.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3710000000000002e-06 2024-09-14T09:07:50.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:50.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.314903+0000", 2024-09-14T09:07:50.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6671000000000001e-05 2024-09-14T09:07:50.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:50.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.314916+0000", 2024-09-14T09:07:50.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2464e-05 2024-09-14T09:07:50.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:50.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.318215+0000", 2024-09-14T09:07:50.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003299607 2024-09-14T09:07:50.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:50.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.318256+0000", 2024-09-14T09:07:50.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0949999999999999e-05 2024-09-14T09:07:50.992 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:50.992 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:50.993 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:50.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.993 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:13 3.b 3:d558f91e:::rbd_object_map.11128b09dac5:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T09:07:50.993 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:47.318813+0000", 2024-09-14T09:07:50.993 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.6444499110000002, 2024-09-14T09:07:50.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002062211, 2024-09-14T09:07:50.994 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:50.994 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:50.994 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:50.994 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:50.994 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:07:50.994 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:50.994 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 13 2024-09-14T09:07:50.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.995 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:50.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:50.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.318813+0000", 2024-09-14T09:07:50.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:50.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:50.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.318813+0000", 2024-09-14T09:07:50.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:50.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:50.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.318814+0000", 2024-09-14T09:07:50.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.438e-06 2024-09-14T09:07:50.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:50.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.318818+0000", 2024-09-14T09:07:50.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.25e-06 2024-09-14T09:07:50.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:50.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.318829+0000", 2024-09-14T09:07:50.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0465999999999999e-05 2024-09-14T09:07:50.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:50.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.318834+0000", 2024-09-14T09:07:50.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3580000000000002e-06 2024-09-14T09:07:50.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:50.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.318879+0000", 2024-09-14T09:07:50.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4687000000000001e-05 2024-09-14T09:07:50.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:50.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:50.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.318954+0000", 2024-09-14T09:07:50.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5450000000000004e-05 2024-09-14T09:07:50.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:50.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 3", 2024-09-14T09:07:51.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.319065+0000", 2024-09-14T09:07:51.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110612 2024-09-14T09:07:51.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.320026+0000", 2024-09-14T09:07:51.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00096110200000000003 2024-09-14T09:07:51.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.320821+0000", 2024-09-14T09:07:51.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00079447000000000003 2024-09-14T09:07:51.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.320852+0000", 2024-09-14T09:07:51.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1118999999999998e-05 2024-09-14T09:07:51.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.320875+0000", 2024-09-14T09:07:51.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3258999999999999e-05 2024-09-14T09:07:51.003 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.003 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.003 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.003 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4388.0:12 3.13 e25/22 3:cae4aeb8:::rbd_header.11128b09dac5:head v 25'3, mlcod=25'1)", 2024-09-14T09:07:51.003 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:47.501203+0000", 2024-09-14T09:07:51.003 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.4620592750000001, 2024-09-14T09:07:51.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00052932299999999995, 2024-09-14T09:07:51.003 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.003 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.004 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.004 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.501203+0000", 2024-09-14T09:07:51.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.501203+0000", 2024-09-14T09:07:51.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.501204+0000", 2024-09-14T09:07:51.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2900000000000002e-07 2024-09-14T09:07:51.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.501212+0000", 2024-09-14T09:07:51.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8390000000000007e-06 2024-09-14T09:07:51.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.501224+0000", 2024-09-14T09:07:51.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2014999999999999e-05 2024-09-14T09:07:51.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.501232+0000", 2024-09-14T09:07:51.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4970000000000004e-06 2024-09-14T09:07:51.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.501279+0000", 2024-09-14T09:07:51.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6915000000000001e-05 2024-09-14T09:07:51.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.501292+0000", 2024-09-14T09:07:51.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3602e-05 2024-09-14T09:07:51.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.501705+0000", 2024-09-14T09:07:51.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00041255600000000001 2024-09-14T09:07:51.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.501733+0000", 2024-09-14T09:07:51.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7970000000000002e-05 2024-09-14T09:07:51.008 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.008 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.008 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.008 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4471.0:487 3.17 e27/22 3:ef21ce5b:::rbd_object_map.1112b98aa287:head v 27'36, mlcod=26'34)", 2024-09-14T09:07:51.009 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.316403+0000", 2024-09-14T09:07:51.009 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64686000200000005, 2024-09-14T09:07:51.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00064431099999999995, 2024-09-14T09:07:51.009 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.009 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.009 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.009 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.316403+0000", 2024-09-14T09:07:51.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.316403+0000", 2024-09-14T09:07:51.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.316403+0000", 2024-09-14T09:07:51.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.68e-07 2024-09-14T09:07:51.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.316407+0000", 2024-09-14T09:07:51.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1010000000000002e-06 2024-09-14T09:07:51.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.316419+0000", 2024-09-14T09:07:51.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2112e-05 2024-09-14T09:07:51.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.316428+0000", 2024-09-14T09:07:51.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5760000000000006e-06 2024-09-14T09:07:51.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.316478+0000", 2024-09-14T09:07:51.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0773999999999999e-05 2024-09-14T09:07:51.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.316495+0000", 2024-09-14T09:07:51.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6220999999999999e-05 2024-09-14T09:07:51.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.317022+0000", 2024-09-14T09:07:51.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00052703799999999996 2024-09-14T09:07:51.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.317047+0000", 2024-09-14T09:07:51.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5321e-05 2024-09-14T09:07:51.013 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.013 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.013 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.013 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:312 3.b 3:d3cceaf5:::rbd_object_map.111213dcc65d:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:51.013 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.556274+0000", 2024-09-14T09:07:51.013 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.40698832200000001, 2024-09-14T09:07:51.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0015286640000000001, 2024-09-14T09:07:51.014 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.014 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.014 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.014 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.014 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:07:51.014 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:51.014 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 312 2024-09-14T09:07:51.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.014 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.556274+0000", 2024-09-14T09:07:51.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.556274+0000", 2024-09-14T09:07:51.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.556276+0000", 2024-09-14T09:07:51.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.438e-06 2024-09-14T09:07:51.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.556280+0000", 2024-09-14T09:07:51.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4429999999999996e-06 2024-09-14T09:07:51.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.556291+0000", 2024-09-14T09:07:51.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0618999999999999e-05 2024-09-14T09:07:51.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.556296+0000", 2024-09-14T09:07:51.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2240000000000003e-06 2024-09-14T09:07:51.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.556343+0000", 2024-09-14T09:07:51.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6762999999999999e-05 2024-09-14T09:07:51.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.556424+0000", 2024-09-14T09:07:51.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0907000000000003e-05 2024-09-14T09:07:51.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 3", 2024-09-14T09:07:51.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.556540+0000", 2024-09-14T09:07:51.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000115858 2024-09-14T09:07:51.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.557154+0000", 2024-09-14T09:07:51.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00061472999999999996 2024-09-14T09:07:51.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.557745+0000", 2024-09-14T09:07:51.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00059022600000000001 2024-09-14T09:07:51.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.557774+0000", 2024-09-14T09:07:51.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9859e-05 2024-09-14T09:07:51.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.557803+0000", 2024-09-14T09:07:51.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8597000000000001e-05 2024-09-14T09:07:51.019 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.019 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.019 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.020 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:327 3.a 3:535385f0:::rbd_children:head [call rbd.add_child in=12b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:51.020 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.569229+0000", 2024-09-14T09:07:51.020 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.394033313, 2024-09-14T09:07:51.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0011329199999999999, 2024-09-14T09:07:51.020 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.021 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.021 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.021 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.021 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:07:51.021 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:51.021 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 327 2024-09-14T09:07:51.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.021 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.569229+0000", 2024-09-14T09:07:51.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.569229+0000", 2024-09-14T09:07:51.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.569230+0000", 2024-09-14T09:07:51.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7700000000000004e-07 2024-09-14T09:07:51.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.569235+0000", 2024-09-14T09:07:51.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4519999999999999e-06 2024-09-14T09:07:51.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.569245+0000", 2024-09-14T09:07:51.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0253e-05 2024-09-14T09:07:51.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.569250+0000", 2024-09-14T09:07:51.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5559999999999998e-06 2024-09-14T09:07:51.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.569293+0000", 2024-09-14T09:07:51.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2339000000000002e-05 2024-09-14T09:07:51.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.569345+0000", 2024-09-14T09:07:51.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2005000000000001e-05 2024-09-14T09:07:51.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:07:51.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.569469+0000", 2024-09-14T09:07:51.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000123981 2024-09-14T09:07:51.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.569867+0000", 2024-09-14T09:07:51.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00039818999999999998 2024-09-14T09:07:51.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.570308+0000", 2024-09-14T09:07:51.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00044076299999999999 2024-09-14T09:07:51.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.570335+0000", 2024-09-14T09:07:51.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7339e-05 2024-09-14T09:07:51.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.570362+0000", 2024-09-14T09:07:51.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7265000000000001e-05 2024-09-14T09:07:51.027 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.027 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.027 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.027 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4471.0:514 3.17 e27/22 3:ef21ce5b:::rbd_object_map.1112b98aa287:head v 27'37, mlcod=26'35)", 2024-09-14T09:07:51.027 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.582742+0000", 2024-09-14T09:07:51.027 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.38052048900000002, 2024-09-14T09:07:51.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00069662100000000002, 2024-09-14T09:07:51.027 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.028 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.028 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.028 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.582742+0000", 2024-09-14T09:07:51.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.582742+0000", 2024-09-14T09:07:51.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.582743+0000", 2024-09-14T09:07:51.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3900000000000004e-07 2024-09-14T09:07:51.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.582748+0000", 2024-09-14T09:07:51.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4430000000000002e-06 2024-09-14T09:07:51.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.582758+0000", 2024-09-14T09:07:51.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1679999999999993e-06 2024-09-14T09:07:51.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.582762+0000", 2024-09-14T09:07:51.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6600000000000003e-06 2024-09-14T09:07:51.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.582806+0000", 2024-09-14T09:07:51.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3575999999999997e-05 2024-09-14T09:07:51.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.582819+0000", 2024-09-14T09:07:51.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3720000000000001e-05 2024-09-14T09:07:51.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.583400+0000", 2024-09-14T09:07:51.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058017400000000003 2024-09-14T09:07:51.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.583439+0000", 2024-09-14T09:07:51.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9140999999999997e-05 2024-09-14T09:07:51.033 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.033 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.033 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.034 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4471.0:518 3.d e27/22 3:b6c9e19b:::rbd_data.1112b98aa287.0000000000000001:head v 27'7, mlcod=26'4)", 2024-09-14T09:07:51.034 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.586027+0000", 2024-09-14T09:07:51.034 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.37723599800000002, 2024-09-14T09:07:51.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001006509, 2024-09-14T09:07:51.034 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.034 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.034 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.034 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.586027+0000", 2024-09-14T09:07:51.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.586027+0000", 2024-09-14T09:07:51.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.586027+0000", 2024-09-14T09:07:51.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4899999999999995e-07 2024-09-14T09:07:51.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.586033+0000", 2024-09-14T09:07:51.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0800000000000002e-06 2024-09-14T09:07:51.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.586045+0000", 2024-09-14T09:07:51.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1353e-05 2024-09-14T09:07:51.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.586052+0000", 2024-09-14T09:07:51.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9410000000000001e-06 2024-09-14T09:07:51.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.586102+0000", 2024-09-14T09:07:51.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9987000000000001e-05 2024-09-14T09:07:51.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.586124+0000", 2024-09-14T09:07:51.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2002e-05 2024-09-14T09:07:51.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.587001+0000", 2024-09-14T09:07:51.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00087694100000000001 2024-09-14T09:07:51.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.587033+0000", 2024-09-14T09:07:51.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2555999999999998e-05 2024-09-14T09:07:51.039 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.039 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.040 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.040 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4471.0:521 3.c 3:35a5bd89:::rbd_data.1112b98aa287.0000000000000004:head [stat,delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:51.040 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.590824+0000", 2024-09-14T09:07:51.040 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.37243878899999999, 2024-09-14T09:07:51.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001667724, 2024-09-14T09:07:51.040 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.040 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.040 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.040 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.040 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4471", 2024-09-14T09:07:51.040 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2207718190", 2024-09-14T09:07:51.041 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 521 2024-09-14T09:07:51.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.041 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.590824+0000", 2024-09-14T09:07:51.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.590824+0000", 2024-09-14T09:07:51.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.590825+0000", 2024-09-14T09:07:51.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4300000000000002e-07 2024-09-14T09:07:51.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.590829+0000", 2024-09-14T09:07:51.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0679999999999998e-06 2024-09-14T09:07:51.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.590839+0000", 2024-09-14T09:07:51.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0550999999999999e-05 2024-09-14T09:07:51.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.590852+0000", 2024-09-14T09:07:51.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.275e-05 2024-09-14T09:07:51.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.590905+0000", 2024-09-14T09:07:51.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3196999999999999e-05 2024-09-14T09:07:51.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.590957+0000", 2024-09-14T09:07:51.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1202999999999997e-05 2024-09-14T09:07:51.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 3", 2024-09-14T09:07:51.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.591074+0000", 2024-09-14T09:07:51.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000117557 2024-09-14T09:07:51.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.591824+0000", 2024-09-14T09:07:51.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00074949800000000003 2024-09-14T09:07:51.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.592434+0000", 2024-09-14T09:07:51.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00061029200000000002 2024-09-14T09:07:51.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.592464+0000", 2024-09-14T09:07:51.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0465999999999999e-05 2024-09-14T09:07:51.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.592492+0000", 2024-09-14T09:07:51.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7299000000000001e-05 2024-09-14T09:07:51.045 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.046 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.046 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.046 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4471.0:523 3.1b e27/22 3:de381ce0:::rbd_data.1112b98aa287.000000000000000a:head v 27'8, mlcod=26'5)", 2024-09-14T09:07:51.046 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.593110+0000", 2024-09-14T09:07:51.046 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.37015294100000001, 2024-09-14T09:07:51.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001176847, 2024-09-14T09:07:51.046 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.046 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.046 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.046 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.593110+0000", 2024-09-14T09:07:51.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.593110+0000", 2024-09-14T09:07:51.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.593112+0000", 2024-09-14T09:07:51.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6309999999999999e-06 2024-09-14T09:07:51.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.593117+0000", 2024-09-14T09:07:51.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6029999999999998e-06 2024-09-14T09:07:51.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.593128+0000", 2024-09-14T09:07:51.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0597999999999999e-05 2024-09-14T09:07:51.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.593135+0000", 2024-09-14T09:07:51.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5950000000000001e-06 2024-09-14T09:07:51.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.593199+0000", 2024-09-14T09:07:51.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3625000000000002e-05 2024-09-14T09:07:51.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.593219+0000", 2024-09-14T09:07:51.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0146999999999999e-05 2024-09-14T09:07:51.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.594263+0000", 2024-09-14T09:07:51.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001043972 2024-09-14T09:07:51.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.594287+0000", 2024-09-14T09:07:51.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3676000000000002e-05 2024-09-14T09:07:51.051 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.051 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.051 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.052 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4471.0:522 3.12 e27/22 3:4912857b:::rbd_data.1112b98aa287.0000000000000005:head v 27'6, mlcod=26'3)", 2024-09-14T09:07:51.052 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.593116+0000", 2024-09-14T09:07:51.052 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.37014685899999999, 2024-09-14T09:07:51.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00092070800000000001, 2024-09-14T09:07:51.052 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.052 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.052 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.052 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.593116+0000", 2024-09-14T09:07:51.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.593116+0000", 2024-09-14T09:07:51.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.593117+0000", 2024-09-14T09:07:51.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.92e-07 2024-09-14T09:07:51.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.593123+0000", 2024-09-14T09:07:51.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5629999999999997e-06 2024-09-14T09:07:51.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.593135+0000", 2024-09-14T09:07:51.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1384e-05 2024-09-14T09:07:51.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.593141+0000", 2024-09-14T09:07:51.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.776e-06 2024-09-14T09:07:51.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.593207+0000", 2024-09-14T09:07:51.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.546e-05 2024-09-14T09:07:51.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.593220+0000", 2024-09-14T09:07:51.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2789000000000001e-05 2024-09-14T09:07:51.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.594000+0000", 2024-09-14T09:07:51.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00078023999999999997 2024-09-14T09:07:51.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.594037+0000", 2024-09-14T09:07:51.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6704e-05 2024-09-14T09:07:51.059 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.059 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.059 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.059 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4471.0:528 3.17 e27/22 3:ef21ce5b:::rbd_object_map.1112b98aa287:head v 27'38, mlcod=27'36)", 2024-09-14T09:07:51.060 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.594895+0000", 2024-09-14T09:07:51.060 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.36836817399999999, 2024-09-14T09:07:51.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058832000000000003, 2024-09-14T09:07:51.060 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.060 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.060 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.060 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.594895+0000", 2024-09-14T09:07:51.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.594895+0000", 2024-09-14T09:07:51.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.594895+0000", 2024-09-14T09:07:51.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.75e-07 2024-09-14T09:07:51.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.594902+0000", 2024-09-14T09:07:51.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7819999999999996e-06 2024-09-14T09:07:51.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.594909+0000", 2024-09-14T09:07:51.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5270000000000001e-06 2024-09-14T09:07:51.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.594914+0000", 2024-09-14T09:07:51.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5650000000000003e-06 2024-09-14T09:07:51.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.594948+0000", 2024-09-14T09:07:51.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4338000000000002e-05 2024-09-14T09:07:51.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.594966+0000", 2024-09-14T09:07:51.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7411e-05 2024-09-14T09:07:51.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.595454+0000", 2024-09-14T09:07:51.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000488851 2024-09-14T09:07:51.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.595483+0000", 2024-09-14T09:07:51.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8371e-05 2024-09-14T09:07:51.066 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.066 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.066 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.066 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4471.0:530 3.17 e27/22 3:ef21ce5b:::rbd_object_map.1112b98aa287:head v 27'39, mlcod=27'37)", 2024-09-14T09:07:51.066 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.600392+0000", 2024-09-14T09:07:51.067 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.36287044000000002, 2024-09-14T09:07:51.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00055046399999999997, 2024-09-14T09:07:51.067 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.067 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.067 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.067 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.600392+0000", 2024-09-14T09:07:51.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.600392+0000", 2024-09-14T09:07:51.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.600393+0000", 2024-09-14T09:07:51.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2399999999999998e-07 2024-09-14T09:07:51.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.600397+0000", 2024-09-14T09:07:51.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5410000000000002e-06 2024-09-14T09:07:51.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.600407+0000", 2024-09-14T09:07:51.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5610000000000004e-06 2024-09-14T09:07:51.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.600411+0000", 2024-09-14T09:07:51.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4669999999999998e-06 2024-09-14T09:07:51.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.600447+0000", 2024-09-14T09:07:51.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5568000000000002e-05 2024-09-14T09:07:51.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.600460+0000", 2024-09-14T09:07:51.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2972999999999999e-05 2024-09-14T09:07:51.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.600915+0000", 2024-09-14T09:07:51.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045543500000000002 2024-09-14T09:07:51.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.600943+0000", 2024-09-14T09:07:51.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7294999999999999e-05 2024-09-14T09:07:51.071 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.071 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.071 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.071 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4471.0:547 3.17 e27/22 3:ef21ce5b:::rbd_object_map.1112b98aa287:head v 27'40, mlcod=27'38)", 2024-09-14T09:07:51.072 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.637027+0000", 2024-09-14T09:07:51.072 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.326235893, 2024-09-14T09:07:51.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00073664900000000003, 2024-09-14T09:07:51.072 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.072 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.072 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.072 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.637027+0000", 2024-09-14T09:07:51.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.637027+0000", 2024-09-14T09:07:51.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.637028+0000", 2024-09-14T09:07:51.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.294e-06 2024-09-14T09:07:51.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.637041+0000", 2024-09-14T09:07:51.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2721000000000001e-05 2024-09-14T09:07:51.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.637055+0000", 2024-09-14T09:07:51.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4559000000000001e-05 2024-09-14T09:07:51.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.637065+0000", 2024-09-14T09:07:51.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3649999999999993e-06 2024-09-14T09:07:51.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.637139+0000", 2024-09-14T09:07:51.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4023000000000006e-05 2024-09-14T09:07:51.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.637157+0000", 2024-09-14T09:07:51.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8008000000000001e-05 2024-09-14T09:07:51.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.637733+0000", 2024-09-14T09:07:51.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057669100000000005 2024-09-14T09:07:51.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.637763+0000", 2024-09-14T09:07:51.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9988000000000002e-05 2024-09-14T09:07:51.076 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.076 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.076 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.076 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4370.0:411 3.13 e27/22 3:cae4aeb8:::rbd_header.11128b09dac5:head v 27'25, mlcod=26'23)", 2024-09-14T09:07:51.076 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.756262+0000", 2024-09-14T09:07:51.076 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.20700094899999999, 2024-09-14T09:07:51.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060361699999999998, 2024-09-14T09:07:51.077 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.077 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.077 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.077 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.756262+0000", 2024-09-14T09:07:51.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.756262+0000", 2024-09-14T09:07:51.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.756263+0000", 2024-09-14T09:07:51.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.314e-06 2024-09-14T09:07:51.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.756271+0000", 2024-09-14T09:07:51.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0970000000000006e-06 2024-09-14T09:07:51.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.756285+0000", 2024-09-14T09:07:51.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3991e-05 2024-09-14T09:07:51.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.756293+0000", 2024-09-14T09:07:51.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7389999999999999e-06 2024-09-14T09:07:51.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.756350+0000", 2024-09-14T09:07:51.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7082e-05 2024-09-14T09:07:51.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.756368+0000", 2024-09-14T09:07:51.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7856e-05 2024-09-14T09:07:51.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.756819+0000", 2024-09-14T09:07:51.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045098700000000002 2024-09-14T09:07:51.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.756865+0000", 2024-09-14T09:07:51.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6551000000000002e-05 2024-09-14T09:07:51.082 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.082 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.082 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.082 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4495.0:13 3.13 e27/22 3:cae4aeb8:::rbd_header.11128b09dac5:head v 27'26, mlcod=26'24)", 2024-09-14T09:07:51.082 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.808122+0000", 2024-09-14T09:07:51.082 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.15514094, 2024-09-14T09:07:51.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00059360800000000003, 2024-09-14T09:07:51.083 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.083 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.083 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.083 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.808122+0000", 2024-09-14T09:07:51.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.808122+0000", 2024-09-14T09:07:51.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.808123+0000", 2024-09-14T09:07:51.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3400000000000001e-06 2024-09-14T09:07:51.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.808133+0000", 2024-09-14T09:07:51.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6579999999999997e-06 2024-09-14T09:07:51.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.808151+0000", 2024-09-14T09:07:51.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8649000000000001e-05 2024-09-14T09:07:51.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.808161+0000", 2024-09-14T09:07:51.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.91e-06 2024-09-14T09:07:51.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.808219+0000", 2024-09-14T09:07:51.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7494000000000002e-05 2024-09-14T09:07:51.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.808245+0000", 2024-09-14T09:07:51.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6534999999999999e-05 2024-09-14T09:07:51.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.808684+0000", 2024-09-14T09:07:51.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043877100000000002 2024-09-14T09:07:51.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.808715+0000", 2024-09-14T09:07:51.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1251000000000003e-05 2024-09-14T09:07:51.088 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.088 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.088 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.089 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "pg_update_log_missing(3.13 epoch 27/22 rep_tid 144 entries 27'27 (0'0) error 3:cae4aeb8:::rbd_header.11128b09dac5:head by client.4495.0:15 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 27'25)", 2024-09-14T09:07:51.089 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.809988+0000", 2024-09-14T09:07:51.089 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.15327500899999999, 2024-09-14T09:07:51.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025308840000000002, 2024-09-14T09:07:51.089 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.089 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.089 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:07:51.089 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.809988+0000", 2024-09-14T09:07:51.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.809988+0000", 2024-09-14T09:07:51.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.809988+0000", 2024-09-14T09:07:51.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3200000000000004e-07 2024-09-14T09:07:51.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.809997+0000", 2024-09-14T09:07:51.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0380000000000005e-06 2024-09-14T09:07:51.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.810018+0000", 2024-09-14T09:07:51.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0392000000000001e-05 2024-09-14T09:07:51.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.810031+0000", 2024-09-14T09:07:51.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.293e-05 2024-09-14T09:07:51.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.810111+0000", 2024-09-14T09:07:51.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0644999999999998e-05 2024-09-14T09:07:51.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.812519+0000", 2024-09-14T09:07:51.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024071470000000001 2024-09-14T09:07:51.097 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.097 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.097 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.097 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.097 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.098 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:51.099 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:07:51.100 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:51.101+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:51.200 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:51.202+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:51.206 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:51.206 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:07:51.206 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:07:51.206 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:51.215 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:07:51.304 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:51.303+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:07:51.313 INFO:teuthology.orchestra.run.smithi148.stdout:122 trunc from 0xa763400 to 0xc304000 2024-09-14T09:07:51.322 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:07:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:07:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:07:51.322 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:51.326 INFO:teuthology.orchestra.run.smithi148.stdout:123 clone 3 order 23 su 65536 sc 10 2024-09-14T09:07:51.332 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:07:51.402 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:51.404+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:51.477 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:51.477 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:07:51.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:07:51.477 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:07:51.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.477 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:51.477 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:07:51.477 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.244904633000001, 2024-09-14T09:07:51.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72111598600000004, 2024-09-14T09:07:51.478 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.478 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.478 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.478 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.478 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:51.478 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:51.478 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1 2024-09-14T09:07:51.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.479 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:07:51.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:07:51.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233065+0000", 2024-09-14T09:07:51.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1909999999999999e-06 2024-09-14T09:07:51.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233071+0000", 2024-09-14T09:07:51.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5300000000000002e-06 2024-09-14T09:07:51.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233081+0000", 2024-09-14T09:07:51.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0339e-05 2024-09-14T09:07:51.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233093+0000", 2024-09-14T09:07:51.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1252e-05 2024-09-14T09:07:51.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233162+0000", 2024-09-14T09:07:51.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9678999999999995e-05 2024-09-14T09:07:51.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:07:51.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233171+0000", 2024-09-14T09:07:51.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.132e-06 2024-09-14T09:07:51.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952480+0000", 2024-09-14T09:07:51.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.71930839899999999 2024-09-14T09:07:51.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952655+0000", 2024-09-14T09:07:51.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017552 2024-09-14T09:07:51.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:51.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952835+0000", 2024-09-14T09:07:51.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001797 2024-09-14T09:07:51.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.953648+0000", 2024-09-14T09:07:51.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00081291700000000002 2024-09-14T09:07:51.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954108+0000", 2024-09-14T09:07:51.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045992800000000002 2024-09-14T09:07:51.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954149+0000", 2024-09-14T09:07:51.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1214999999999998e-05 2024-09-14T09:07:51.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954178+0000", 2024-09-14T09:07:51.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9184e-05 2024-09-14T09:07:51.484 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.484 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.484 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.484 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:51.484 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153119+0000", 2024-09-14T09:07:51.484 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.324848361000001, 2024-09-14T09:07:51.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011276675999999999, 2024-09-14T09:07:51.484 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.484 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.485 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.485 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.485 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:51.485 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:51.485 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 41 2024-09-14T09:07:51.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.485 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153119+0000", 2024-09-14T09:07:51.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153119+0000", 2024-09-14T09:07:51.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153119+0000", 2024-09-14T09:07:51.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8800000000000002e-07 2024-09-14T09:07:51.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153170+0000", 2024-09-14T09:07:51.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1020000000000003e-05 2024-09-14T09:07:51.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153176+0000", 2024-09-14T09:07:51.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1739999999999997e-06 2024-09-14T09:07:51.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153182+0000", 2024-09-14T09:07:51.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4430000000000002e-06 2024-09-14T09:07:51.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.154147+0000", 2024-09-14T09:07:51.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00096519900000000003 2024-09-14T09:07:51.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.154220+0000", 2024-09-14T09:07:51.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3339999999999999e-05 2024-09-14T09:07:51.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:51.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.154305+0000", 2024-09-14T09:07:51.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4266999999999998e-05 2024-09-14T09:07:51.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157785+0000", 2024-09-14T09:07:51.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034801369999999999 2024-09-14T09:07:51.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164340+0000", 2024-09-14T09:07:51.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0065547349999999999 2024-09-14T09:07:51.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164370+0000", 2024-09-14T09:07:51.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0944000000000001e-05 2024-09-14T09:07:51.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164395+0000", 2024-09-14T09:07:51.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4828999999999999e-05 2024-09-14T09:07:51.491 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.491 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.491 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.491 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:51.491 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153190+0000", 2024-09-14T09:07:51.491 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.324776927999999, 2024-09-14T09:07:51.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011298134, 2024-09-14T09:07:51.491 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.491 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.492 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.492 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.492 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:51.492 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:51.492 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 42 2024-09-14T09:07:51.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.492 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153190+0000", 2024-09-14T09:07:51.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153190+0000", 2024-09-14T09:07:51.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153191+0000", 2024-09-14T09:07:51.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4099999999999999e-07 2024-09-14T09:07:51.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153193+0000", 2024-09-14T09:07:51.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1900000000000002e-06 2024-09-14T09:07:51.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153197+0000", 2024-09-14T09:07:51.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3479999999999997e-06 2024-09-14T09:07:51.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153200+0000", 2024-09-14T09:07:51.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8669999999999998e-06 2024-09-14T09:07:51.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.154763+0000", 2024-09-14T09:07:51.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0015633719999999999 2024-09-14T09:07:51.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.154811+0000", 2024-09-14T09:07:51.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7797000000000003e-05 2024-09-14T09:07:51.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:51.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.154889+0000", 2024-09-14T09:07:51.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7742000000000002e-05 2024-09-14T09:07:51.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157790+0000", 2024-09-14T09:07:51.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0029008710000000002 2024-09-14T09:07:51.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164429+0000", 2024-09-14T09:07:51.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066394710000000001 2024-09-14T09:07:51.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164462+0000", 2024-09-14T09:07:51.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2827000000000003e-05 2024-09-14T09:07:51.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164488+0000", 2024-09-14T09:07:51.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6208e-05 2024-09-14T09:07:51.497 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.497 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.497 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.497 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:51.497 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153280+0000", 2024-09-14T09:07:51.497 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.324687027, 2024-09-14T09:07:51.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011598466999999999, 2024-09-14T09:07:51.497 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.497 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.497 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.498 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.498 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:51.498 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:51.498 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 43 2024-09-14T09:07:51.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.498 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153280+0000", 2024-09-14T09:07:51.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153280+0000", 2024-09-14T09:07:51.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153281+0000", 2024-09-14T09:07:51.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2200000000000004e-07 2024-09-14T09:07:51.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153284+0000", 2024-09-14T09:07:51.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9779999999999999e-06 2024-09-14T09:07:51.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153290+0000", 2024-09-14T09:07:51.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9569999999999999e-06 2024-09-14T09:07:51.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153294+0000", 2024-09-14T09:07:51.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3060000000000002e-06 2024-09-14T09:07:51.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.155173+0000", 2024-09-14T09:07:51.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00187929 2024-09-14T09:07:51.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.155222+0000", 2024-09-14T09:07:51.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9249000000000002e-05 2024-09-14T09:07:51.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:51.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.155299+0000", 2024-09-14T09:07:51.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6755999999999995e-05 2024-09-14T09:07:51.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157795+0000", 2024-09-14T09:07:51.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024964359999999999 2024-09-14T09:07:51.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164785+0000", 2024-09-14T09:07:51.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069898729999999997 2024-09-14T09:07:51.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164837+0000", 2024-09-14T09:07:51.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2061999999999997e-05 2024-09-14T09:07:51.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164878+0000", 2024-09-14T09:07:51.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1038000000000002e-05 2024-09-14T09:07:51.503 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.503 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.503 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.503 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:51.503 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153342+0000", 2024-09-14T09:07:51.504 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.324625150999999, 2024-09-14T09:07:51.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011654108, 2024-09-14T09:07:51.504 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.504 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.504 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.504 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.504 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:51.504 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:51.504 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 44 2024-09-14T09:07:51.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.504 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153342+0000", 2024-09-14T09:07:51.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153342+0000", 2024-09-14T09:07:51.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153342+0000", 2024-09-14T09:07:51.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.53e-07 2024-09-14T09:07:51.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153414+0000", 2024-09-14T09:07:51.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1952000000000005e-05 2024-09-14T09:07:51.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153420+0000", 2024-09-14T09:07:51.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8390000000000003e-06 2024-09-14T09:07:51.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153425+0000", 2024-09-14T09:07:51.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7509999999999999e-06 2024-09-14T09:07:51.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.155556+0000", 2024-09-14T09:07:51.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0021313389999999999 2024-09-14T09:07:51.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.155607+0000", 2024-09-14T09:07:51.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0756e-05 2024-09-14T09:07:51.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:51.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.155686+0000", 2024-09-14T09:07:51.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9008e-05 2024-09-14T09:07:51.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157800+0000", 2024-09-14T09:07:51.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0021143030000000001 2024-09-14T09:07:51.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164927+0000", 2024-09-14T09:07:51.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071267029999999999 2024-09-14T09:07:51.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164959+0000", 2024-09-14T09:07:51.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2289999999999997e-05 2024-09-14T09:07:51.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164996+0000", 2024-09-14T09:07:51.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6813999999999997e-05 2024-09-14T09:07:51.513 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.513 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.513 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.513 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:51.513 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153439+0000", 2024-09-14T09:07:51.513 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.324528442999998, 2024-09-14T09:07:51.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011648581999999999, 2024-09-14T09:07:51.513 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.513 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.514 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.514 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.514 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:51.514 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:51.514 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 45 2024-09-14T09:07:51.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.514 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153439+0000", 2024-09-14T09:07:51.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153439+0000", 2024-09-14T09:07:51.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153439+0000", 2024-09-14T09:07:51.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0499999999999999e-07 2024-09-14T09:07:51.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153442+0000", 2024-09-14T09:07:51.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0070000000000002e-06 2024-09-14T09:07:51.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153448+0000", 2024-09-14T09:07:51.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7540000000000003e-06 2024-09-14T09:07:51.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153452+0000", 2024-09-14T09:07:51.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0559999999999998e-06 2024-09-14T09:07:51.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.156116+0000", 2024-09-14T09:07:51.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026643560000000001 2024-09-14T09:07:51.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.156165+0000", 2024-09-14T09:07:51.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8362000000000002e-05 2024-09-14T09:07:51.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:51.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.156261+0000", 2024-09-14T09:07:51.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6164999999999998e-05 2024-09-14T09:07:51.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159642+0000", 2024-09-14T09:07:51.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033813599999999999 2024-09-14T09:07:51.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165035+0000", 2024-09-14T09:07:51.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0053929889999999999 2024-09-14T09:07:51.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165064+0000", 2024-09-14T09:07:51.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9229000000000001e-05 2024-09-14T09:07:51.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165087+0000", 2024-09-14T09:07:51.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2898999999999999e-05 2024-09-14T09:07:51.520 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.520 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.520 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.520 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:51.520 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153458+0000", 2024-09-14T09:07:51.520 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.324509410000001, 2024-09-14T09:07:51.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011717188999999999, 2024-09-14T09:07:51.520 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.520 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.520 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.520 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:51.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:51.521 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 46 2024-09-14T09:07:51.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.521 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153458+0000", 2024-09-14T09:07:51.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153458+0000", 2024-09-14T09:07:51.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153458+0000", 2024-09-14T09:07:51.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3200000000000001e-07 2024-09-14T09:07:51.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153462+0000", 2024-09-14T09:07:51.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0969999999999999e-06 2024-09-14T09:07:51.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153465+0000", 2024-09-14T09:07:51.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.455e-06 2024-09-14T09:07:51.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153468+0000", 2024-09-14T09:07:51.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6460000000000002e-06 2024-09-14T09:07:51.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.156541+0000", 2024-09-14T09:07:51.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030729059999999998 2024-09-14T09:07:51.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.156597+0000", 2024-09-14T09:07:51.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6496999999999998e-05 2024-09-14T09:07:51.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:51.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.156674+0000", 2024-09-14T09:07:51.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6483000000000006e-05 2024-09-14T09:07:51.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159649+0000", 2024-09-14T09:07:51.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0029750750000000002 2024-09-14T09:07:51.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165122+0000", 2024-09-14T09:07:51.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054732100000000001 2024-09-14T09:07:51.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165151+0000", 2024-09-14T09:07:51.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8535999999999999e-05 2024-09-14T09:07:51.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165175+0000", 2024-09-14T09:07:51.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4051999999999999e-05 2024-09-14T09:07:51.526 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.526 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.526 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.526 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:51.526 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153481+0000", 2024-09-14T09:07:51.526 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.324486497999999, 2024-09-14T09:07:51.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011772726000000001, 2024-09-14T09:07:51.527 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.527 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.527 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.527 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.527 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:51.527 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:51.527 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 47 2024-09-14T09:07:51.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.527 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153481+0000", 2024-09-14T09:07:51.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153481+0000", 2024-09-14T09:07:51.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153481+0000", 2024-09-14T09:07:51.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3099999999999999e-07 2024-09-14T09:07:51.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153532+0000", 2024-09-14T09:07:51.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1536999999999998e-05 2024-09-14T09:07:51.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153540+0000", 2024-09-14T09:07:51.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4000000000000003e-06 2024-09-14T09:07:51.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153545+0000", 2024-09-14T09:07:51.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7069999999999997e-06 2024-09-14T09:07:51.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.156923+0000", 2024-09-14T09:07:51.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003377082 2024-09-14T09:07:51.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157005+0000", 2024-09-14T09:07:51.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2547999999999996e-05 2024-09-14T09:07:51.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:51.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157082+0000", 2024-09-14T09:07:51.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6829000000000006e-05 2024-09-14T09:07:51.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159653+0000", 2024-09-14T09:07:51.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025711549999999999 2024-09-14T09:07:51.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165208+0000", 2024-09-14T09:07:51.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055549429999999997 2024-09-14T09:07:51.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165234+0000", 2024-09-14T09:07:51.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6274999999999998e-05 2024-09-14T09:07:51.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165253+0000", 2024-09-14T09:07:51.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8919e-05 2024-09-14T09:07:51.532 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.532 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.532 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.532 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:51.532 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153559+0000", 2024-09-14T09:07:51.532 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.324408132999999, 2024-09-14T09:07:51.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011777464, 2024-09-14T09:07:51.532 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.532 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.533 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.533 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.533 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:51.533 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:51.533 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 48 2024-09-14T09:07:51.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.533 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153559+0000", 2024-09-14T09:07:51.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153559+0000", 2024-09-14T09:07:51.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153559+0000", 2024-09-14T09:07:51.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0399999999999996e-07 2024-09-14T09:07:51.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153563+0000", 2024-09-14T09:07:51.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9049999999999999e-06 2024-09-14T09:07:51.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153572+0000", 2024-09-14T09:07:51.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0219999999999993e-06 2024-09-14T09:07:51.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153578+0000", 2024-09-14T09:07:51.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5369999999999997e-06 2024-09-14T09:07:51.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157446+0000", 2024-09-14T09:07:51.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0038676159999999999 2024-09-14T09:07:51.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157493+0000", 2024-09-14T09:07:51.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7661999999999999e-05 2024-09-14T09:07:51.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:51.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157568+0000", 2024-09-14T09:07:51.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4548999999999994e-05 2024-09-14T09:07:51.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159656+0000", 2024-09-14T09:07:51.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002088389 2024-09-14T09:07:51.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165286+0000", 2024-09-14T09:07:51.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056303350000000002 2024-09-14T09:07:51.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165313+0000", 2024-09-14T09:07:51.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6050999999999998e-05 2024-09-14T09:07:51.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165336+0000", 2024-09-14T09:07:51.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3794e-05 2024-09-14T09:07:51.538 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.538 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.538 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.538 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:51.539 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153590+0000", 2024-09-14T09:07:51.539 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.324376748999999, 2024-09-14T09:07:51.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011822174, 2024-09-14T09:07:51.539 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.539 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.539 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.539 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.539 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:51.539 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:51.539 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 49 2024-09-14T09:07:51.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.539 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153590+0000", 2024-09-14T09:07:51.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153590+0000", 2024-09-14T09:07:51.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153591+0000", 2024-09-14T09:07:51.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.37e-07 2024-09-14T09:07:51.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153595+0000", 2024-09-14T09:07:51.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1609999999999996e-06 2024-09-14T09:07:51.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153602+0000", 2024-09-14T09:07:51.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1099999999999997e-06 2024-09-14T09:07:51.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153609+0000", 2024-09-14T09:07:51.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8369999999999999e-06 2024-09-14T09:07:51.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157833+0000", 2024-09-14T09:07:51.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.004223699 2024-09-14T09:07:51.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157882+0000", 2024-09-14T09:07:51.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9592999999999998e-05 2024-09-14T09:07:51.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:51.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157956+0000", 2024-09-14T09:07:51.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4196999999999995e-05 2024-09-14T09:07:51.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159658+0000", 2024-09-14T09:07:51.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0017020749999999999 2024-09-14T09:07:51.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165369+0000", 2024-09-14T09:07:51.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057103309999999999 2024-09-14T09:07:51.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165394+0000", 2024-09-14T09:07:51.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5205999999999999e-05 2024-09-14T09:07:51.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165412+0000", 2024-09-14T09:07:51.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8428e-05 2024-09-14T09:07:51.544 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.544 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.544 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.544 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:51.544 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153631+0000", 2024-09-14T09:07:51.545 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.324336193000001, 2024-09-14T09:07:51.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011869523999999999, 2024-09-14T09:07:51.545 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.545 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.545 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.545 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.545 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:51.545 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:51.545 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 50 2024-09-14T09:07:51.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.545 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153631+0000", 2024-09-14T09:07:51.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153631+0000", 2024-09-14T09:07:51.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153631+0000", 2024-09-14T09:07:51.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999998e-07 2024-09-14T09:07:51.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153681+0000", 2024-09-14T09:07:51.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9688000000000003e-05 2024-09-14T09:07:51.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153689+0000", 2024-09-14T09:07:51.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:07:51.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153696+0000", 2024-09-14T09:07:51.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4159999999999998e-06 2024-09-14T09:07:51.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.158221+0000", 2024-09-14T09:07:51.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045246430000000001 2024-09-14T09:07:51.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.158275+0000", 2024-09-14T09:07:51.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3517999999999998e-05 2024-09-14T09:07:51.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:51.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.158354+0000", 2024-09-14T09:07:51.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9426999999999997e-05 2024-09-14T09:07:51.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159661+0000", 2024-09-14T09:07:51.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013065310000000001 2024-09-14T09:07:51.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165449+0000", 2024-09-14T09:07:51.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057885610000000002 2024-09-14T09:07:51.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165476+0000", 2024-09-14T09:07:51.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6959999999999999e-05 2024-09-14T09:07:51.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165500+0000", 2024-09-14T09:07:51.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4261e-05 2024-09-14T09:07:51.550 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.550 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.550 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.550 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:51.551 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153710+0000", 2024-09-14T09:07:51.551 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.324256964, 2024-09-14T09:07:51.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011866623999999999, 2024-09-14T09:07:51.551 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.551 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.551 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.551 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.551 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:51.551 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:51.551 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 51 2024-09-14T09:07:51.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.551 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153710+0000", 2024-09-14T09:07:51.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153710+0000", 2024-09-14T09:07:51.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153711+0000", 2024-09-14T09:07:51.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6000000000000003e-07 2024-09-14T09:07:51.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153715+0000", 2024-09-14T09:07:51.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8990000000000003e-06 2024-09-14T09:07:51.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153723+0000", 2024-09-14T09:07:51.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9899999999999997e-06 2024-09-14T09:07:51.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153739+0000", 2024-09-14T09:07:51.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6524999999999998e-05 2024-09-14T09:07:51.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.158746+0000", 2024-09-14T09:07:51.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00500717 2024-09-14T09:07:51.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.158796+0000", 2024-09-14T09:07:51.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9327999999999999e-05 2024-09-14T09:07:51.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:51.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.158897+0000", 2024-09-14T09:07:51.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010135400000000001 2024-09-14T09:07:51.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.162214+0000", 2024-09-14T09:07:51.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033173500000000002 2024-09-14T09:07:51.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165533+0000", 2024-09-14T09:07:51.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033186309999999998 2024-09-14T09:07:51.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165558+0000", 2024-09-14T09:07:51.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5007999999999998e-05 2024-09-14T09:07:51.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165577+0000", 2024-09-14T09:07:51.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8709e-05 2024-09-14T09:07:51.556 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.556 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.556 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.556 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:51.556 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153750+0000", 2024-09-14T09:07:51.556 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.324216513, 2024-09-14T09:07:51.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011903145, 2024-09-14T09:07:51.557 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.557 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.557 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.557 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.557 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:51.557 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:51.557 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 52 2024-09-14T09:07:51.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.557 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153750+0000", 2024-09-14T09:07:51.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153750+0000", 2024-09-14T09:07:51.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153751+0000", 2024-09-14T09:07:51.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0699999999999997e-07 2024-09-14T09:07:51.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153755+0000", 2024-09-14T09:07:51.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.053e-06 2024-09-14T09:07:51.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153762+0000", 2024-09-14T09:07:51.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8210000000000004e-06 2024-09-14T09:07:51.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153768+0000", 2024-09-14T09:07:51.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9190000000000004e-06 2024-09-14T09:07:51.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159302+0000", 2024-09-14T09:07:51.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055338100000000001 2024-09-14T09:07:51.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159356+0000", 2024-09-14T09:07:51.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4203999999999998e-05 2024-09-14T09:07:51.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:51.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159437+0000", 2024-09-14T09:07:51.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0883999999999993e-05 2024-09-14T09:07:51.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.162440+0000", 2024-09-14T09:07:51.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003003136 2024-09-14T09:07:51.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165604+0000", 2024-09-14T09:07:51.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031642760000000002 2024-09-14T09:07:51.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165632+0000", 2024-09-14T09:07:51.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7883999999999999e-05 2024-09-14T09:07:51.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165654+0000", 2024-09-14T09:07:51.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1651e-05 2024-09-14T09:07:51.562 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.562 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.562 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.562 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-14T09:07:51.562 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.429665+0000", 2024-09-14T09:07:51.562 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.048302498999998, 2024-09-14T09:07:51.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095381779999999996, 2024-09-14T09:07:51.562 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.562 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.563 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.563 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.563 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:51.563 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:51.563 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 72 2024-09-14T09:07:51.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.563 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429665+0000", 2024-09-14T09:07:51.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429665+0000", 2024-09-14T09:07:51.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429665+0000", 2024-09-14T09:07:51.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.35e-07 2024-09-14T09:07:51.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429773+0000", 2024-09-14T09:07:51.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000107864 2024-09-14T09:07:51.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429778+0000", 2024-09-14T09:07:51.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9459999999999997e-06 2024-09-14T09:07:51.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429781+0000", 2024-09-14T09:07:51.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2629999999999999e-06 2024-09-14T09:07:51.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.432292+0000", 2024-09-14T09:07:51.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025115150000000002 2024-09-14T09:07:51.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.432349+0000", 2024-09-14T09:07:51.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6866000000000001e-05 2024-09-14T09:07:51.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:51.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.432419+0000", 2024-09-14T09:07:51.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9407999999999997e-05 2024-09-14T09:07:51.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434667+0000", 2024-09-14T09:07:51.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022485199999999999 2024-09-14T09:07:51.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439157+0000", 2024-09-14T09:07:51.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044895890000000004 2024-09-14T09:07:51.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439183+0000", 2024-09-14T09:07:51.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6659999999999999e-05 2024-09-14T09:07:51.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439203+0000", 2024-09-14T09:07:51.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9312000000000001e-05 2024-09-14T09:07:51.568 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.568 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.568 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.568 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-14T09:07:51.568 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.429802+0000", 2024-09-14T09:07:51.568 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.048164925999998, 2024-09-14T09:07:51.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099135869999999997, 2024-09-14T09:07:51.568 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.568 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.568 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.569 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.569 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:51.569 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:51.569 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73 2024-09-14T09:07:51.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.569 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429802+0000", 2024-09-14T09:07:51.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429802+0000", 2024-09-14T09:07:51.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429802+0000", 2024-09-14T09:07:51.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3999999999999997e-07 2024-09-14T09:07:51.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429805+0000", 2024-09-14T09:07:51.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2330000000000001e-06 2024-09-14T09:07:51.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429808+0000", 2024-09-14T09:07:51.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.681e-06 2024-09-14T09:07:51.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429811+0000", 2024-09-14T09:07:51.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7879999999999998e-06 2024-09-14T09:07:51.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.432914+0000", 2024-09-14T09:07:51.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031032640000000001 2024-09-14T09:07:51.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.432957+0000", 2024-09-14T09:07:51.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3006999999999997e-05 2024-09-14T09:07:51.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:51.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.433035+0000", 2024-09-14T09:07:51.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7952000000000002e-05 2024-09-14T09:07:51.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434669+0000", 2024-09-14T09:07:51.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001633736 2024-09-14T09:07:51.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439664+0000", 2024-09-14T09:07:51.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.004995396 2024-09-14T09:07:51.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439694+0000", 2024-09-14T09:07:51.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9428999999999999e-05 2024-09-14T09:07:51.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439716+0000", 2024-09-14T09:07:51.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1761000000000001e-05 2024-09-14T09:07:51.574 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.574 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.574 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.574 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-14T09:07:51.574 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.429827+0000", 2024-09-14T09:07:51.574 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.048139704, 2024-09-14T09:07:51.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099733119999999998, 2024-09-14T09:07:51.574 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.574 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.574 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.574 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.574 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:51.575 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:51.575 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 74 2024-09-14T09:07:51.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.575 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429827+0000", 2024-09-14T09:07:51.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429827+0000", 2024-09-14T09:07:51.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429828+0000", 2024-09-14T09:07:51.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4900000000000001e-07 2024-09-14T09:07:51.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429831+0000", 2024-09-14T09:07:51.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.619e-06 2024-09-14T09:07:51.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429835+0000", 2024-09-14T09:07:51.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-06 2024-09-14T09:07:51.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429843+0000", 2024-09-14T09:07:51.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8350000000000004e-06 2024-09-14T09:07:51.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.433290+0000", 2024-09-14T09:07:51.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003446827 2024-09-14T09:07:51.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.433335+0000", 2024-09-14T09:07:51.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5195999999999999e-05 2024-09-14T09:07:51.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:51.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.433403+0000", 2024-09-14T09:07:51.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8124e-05 2024-09-14T09:07:51.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434673+0000", 2024-09-14T09:07:51.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0012694519999999999 2024-09-14T09:07:51.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439754+0000", 2024-09-14T09:07:51.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050815319999999997 2024-09-14T09:07:51.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439780+0000", 2024-09-14T09:07:51.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6171999999999999e-05 2024-09-14T09:07:51.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439801+0000", 2024-09-14T09:07:51.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0356e-05 2024-09-14T09:07:51.579 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.579 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.579 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.580 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-14T09:07:51.580 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.429864+0000", 2024-09-14T09:07:51.580 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.048103245, 2024-09-14T09:07:51.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010013004000000001, 2024-09-14T09:07:51.580 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.580 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.580 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.580 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.580 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:51.580 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:51.580 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 75 2024-09-14T09:07:51.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.581 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429864+0000", 2024-09-14T09:07:51.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429864+0000", 2024-09-14T09:07:51.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429864+0000", 2024-09-14T09:07:51.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.34e-07 2024-09-14T09:07:51.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430015+0000", 2024-09-14T09:07:51.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000150579 2024-09-14T09:07:51.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430026+0000", 2024-09-14T09:07:51.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0883999999999999e-05 2024-09-14T09:07:51.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430032+0000", 2024-09-14T09:07:51.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6699999999999997e-06 2024-09-14T09:07:51.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.433709+0000", 2024-09-14T09:07:51.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0036764050000000002 2024-09-14T09:07:51.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.433753+0000", 2024-09-14T09:07:51.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4345000000000003e-05 2024-09-14T09:07:51.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:51.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.433817+0000", 2024-09-14T09:07:51.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3909000000000001e-05 2024-09-14T09:07:51.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434675+0000", 2024-09-14T09:07:51.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00085810499999999996 2024-09-14T09:07:51.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439833+0000", 2024-09-14T09:07:51.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0051584350000000003 2024-09-14T09:07:51.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439859+0000", 2024-09-14T09:07:51.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5573999999999999e-05 2024-09-14T09:07:51.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439877+0000", 2024-09-14T09:07:51.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7764000000000001e-05 2024-09-14T09:07:51.585 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.585 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.585 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.585 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-14T09:07:51.586 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.430045+0000", 2024-09-14T09:07:51.586 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.047921837000001, 2024-09-14T09:07:51.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098923150000000005, 2024-09-14T09:07:51.586 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.586 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.586 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.586 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.586 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:51.586 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:51.586 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 76 2024-09-14T09:07:51.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.586 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430045+0000", 2024-09-14T09:07:51.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430045+0000", 2024-09-14T09:07:51.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430046+0000", 2024-09-14T09:07:51.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1099999999999995e-07 2024-09-14T09:07:51.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430051+0000", 2024-09-14T09:07:51.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5659999999999997e-06 2024-09-14T09:07:51.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430059+0000", 2024-09-14T09:07:51.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3699999999999997e-06 2024-09-14T09:07:51.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430063+0000", 2024-09-14T09:07:51.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6999999999999999e-06 2024-09-14T09:07:51.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434330+0000", 2024-09-14T09:07:51.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042661929999999997 2024-09-14T09:07:51.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434372+0000", 2024-09-14T09:07:51.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1950000000000003e-05 2024-09-14T09:07:51.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:51.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434444+0000", 2024-09-14T09:07:51.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2775999999999996e-05 2024-09-14T09:07:51.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434913+0000", 2024-09-14T09:07:51.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046910499999999999 2024-09-14T09:07:51.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439898+0000", 2024-09-14T09:07:51.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.004984128 2024-09-14T09:07:51.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439921+0000", 2024-09-14T09:07:51.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3564999999999999e-05 2024-09-14T09:07:51.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439937+0000", 2024-09-14T09:07:51.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6351e-05 2024-09-14T09:07:51.591 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.591 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.591 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.591 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4217.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-14T09:07:51.592 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:35.248793+0000", 2024-09-14T09:07:51.592 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.229174500999999, 2024-09-14T09:07:51.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00936297, 2024-09-14T09:07:51.592 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.592 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.592 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.592 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.592 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4217", 2024-09-14T09:07:51.592 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.116:0/2127928146", 2024-09-14T09:07:51.592 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1 2024-09-14T09:07:51.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.592 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248793+0000", 2024-09-14T09:07:51.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248793+0000", 2024-09-14T09:07:51.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248794+0000", 2024-09-14T09:07:51.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.192e-06 2024-09-14T09:07:51.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248798+0000", 2024-09-14T09:07:51.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4580000000000003e-06 2024-09-14T09:07:51.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248808+0000", 2024-09-14T09:07:51.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5859999999999994e-06 2024-09-14T09:07:51.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248815+0000", 2024-09-14T09:07:51.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5499999999999997e-06 2024-09-14T09:07:51.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248874+0000", 2024-09-14T09:07:51.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.91e-05 2024-09-14T09:07:51.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:07:51.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248884+0000", 2024-09-14T09:07:51.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6830000000000003e-06 2024-09-14T09:07:51.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.253902+0000", 2024-09-14T09:07:51.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050176420000000001 2024-09-14T09:07:51.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254042+0000", 2024-09-14T09:07:51.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000139806 2024-09-14T09:07:51.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-09-14T09:07:51.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254160+0000", 2024-09-14T09:07:51.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000118373 2024-09-14T09:07:51.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.257976+0000", 2024-09-14T09:07:51.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0038157299999999998 2024-09-14T09:07:51.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.258103+0000", 2024-09-14T09:07:51.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000127494 2024-09-14T09:07:51.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.258132+0000", 2024-09-14T09:07:51.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8809000000000001e-05 2024-09-14T09:07:51.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.258155+0000", 2024-09-14T09:07:51.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3547e-05 2024-09-14T09:07:51.598 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.598 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.598 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.598 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:9 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T09:07:51.598 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:47.299228+0000", 2024-09-14T09:07:51.598 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.1787392739999998, 2024-09-14T09:07:51.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011322218, 2024-09-14T09:07:51.598 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.598 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.599 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.599 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.599 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:07:51.599 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:51.599 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9 2024-09-14T09:07:51.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.599 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.299228+0000", 2024-09-14T09:07:51.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.299228+0000", 2024-09-14T09:07:51.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.299229+0000", 2024-09-14T09:07:51.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.637e-06 2024-09-14T09:07:51.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.299238+0000", 2024-09-14T09:07:51.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.439e-06 2024-09-14T09:07:51.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.299252+0000", 2024-09-14T09:07:51.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4062e-05 2024-09-14T09:07:51.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.299260+0000", 2024-09-14T09:07:51.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3529999999999995e-06 2024-09-14T09:07:51.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.299316+0000", 2024-09-14T09:07:51.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6010000000000001e-05 2024-09-14T09:07:51.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:07:51.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.299321+0000", 2024-09-14T09:07:51.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4390000000000002e-06 2024-09-14T09:07:51.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.301057+0000", 2024-09-14T09:07:51.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001735919 2024-09-14T09:07:51.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.301163+0000", 2024-09-14T09:07:51.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106419 2024-09-14T09:07:51.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:51.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.301299+0000", 2024-09-14T09:07:51.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136122 2024-09-14T09:07:51.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.302353+0000", 2024-09-14T09:07:51.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001054176 2024-09-14T09:07:51.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.310463+0000", 2024-09-14T09:07:51.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0081098469999999999 2024-09-14T09:07:51.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.310510+0000", 2024-09-14T09:07:51.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6563999999999997e-05 2024-09-14T09:07:51.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.310550+0000", 2024-09-14T09:07:51.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0231000000000002e-05 2024-09-14T09:07:51.604 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.604 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.605 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.605 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.605 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.605 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:51.606 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:07:51.607 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:51.608+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:51.708 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:51.710+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:51.708 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:51.708 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:07:51.708 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:07:51.708 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:51.717 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:07:51.809 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:51.811+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:51.819 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:51.819 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:07:51.819 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:07:51.819 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:07:51.819 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:51.828 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:07:51.910 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:51.912+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:07:51.932 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:51.932 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:07:51.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:07:51.932 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:07:51.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.932 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4217.0:1 2.3 e18/17 2:c4c92e5a:::rbd_trash:head v 18'1, mlcod=0'0)", 2024-09-14T09:07:51.932 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:35.254531+0000", 2024-09-14T09:07:51.932 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.678638757000002, 2024-09-14T09:07:51.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034687910000000001, 2024-09-14T09:07:51.933 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.933 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.933 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.933 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254531+0000", 2024-09-14T09:07:51.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254531+0000", 2024-09-14T09:07:51.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254531+0000", 2024-09-14T09:07:51.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3300000000000001e-07 2024-09-14T09:07:51.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254536+0000", 2024-09-14T09:07:51.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3069999999999996e-06 2024-09-14T09:07:51.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254546+0000", 2024-09-14T09:07:51.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8309999999999996e-06 2024-09-14T09:07:51.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254558+0000", 2024-09-14T09:07:51.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2162e-05 2024-09-14T09:07:51.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254611+0000", 2024-09-14T09:07:51.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3409000000000003e-05 2024-09-14T09:07:51.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254635+0000", 2024-09-14T09:07:51.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4297000000000001e-05 2024-09-14T09:07:51.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.257943+0000", 2024-09-14T09:07:51.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033075190000000001 2024-09-14T09:07:51.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.258000+0000", 2024-09-14T09:07:51.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7033000000000001e-05 2024-09-14T09:07:51.936 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.936 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.937 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.937 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4471.0:484 3.14 e27/22 3:2ea9bd49:::rbd_header.1112b98aa287:head v 27'27, mlcod=26'25)", 2024-09-14T09:07:51.937 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.311065+0000", 2024-09-14T09:07:51.937 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.622105015, 2024-09-14T09:07:51.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00075233799999999997, 2024-09-14T09:07:51.937 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.937 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.937 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.937 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.311065+0000", 2024-09-14T09:07:51.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.311065+0000", 2024-09-14T09:07:51.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.311065+0000", 2024-09-14T09:07:51.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:07:51.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.311069+0000", 2024-09-14T09:07:51.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1960000000000001e-06 2024-09-14T09:07:51.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.311084+0000", 2024-09-14T09:07:51.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4577e-05 2024-09-14T09:07:51.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.311094+0000", 2024-09-14T09:07:51.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008e-05 2024-09-14T09:07:51.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.311165+0000", 2024-09-14T09:07:51.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1524000000000002e-05 2024-09-14T09:07:51.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.311190+0000", 2024-09-14T09:07:51.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4488e-05 2024-09-14T09:07:51.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.311782+0000", 2024-09-14T09:07:51.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00059250800000000005 2024-09-14T09:07:51.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.311817+0000", 2024-09-14T09:07:51.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4827999999999999e-05 2024-09-14T09:07:51.941 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.941 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.941 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.941 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:310 3.11 3:8fc2352d:::rbd_header.111213dcc65d:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:51.941 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.553523+0000", 2024-09-14T09:07:51.941 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.379646803, 2024-09-14T09:07:51.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0011277240000000001, 2024-09-14T09:07:51.941 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.941 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.942 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.942 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.942 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:07:51.942 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:51.942 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 310 2024-09-14T09:07:51.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.942 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.553523+0000", 2024-09-14T09:07:51.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.553523+0000", 2024-09-14T09:07:51.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.553524+0000", 2024-09-14T09:07:51.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0800000000000004e-07 2024-09-14T09:07:51.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.553529+0000", 2024-09-14T09:07:51.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0089999999999998e-06 2024-09-14T09:07:51.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.553540+0000", 2024-09-14T09:07:51.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1182999999999999e-05 2024-09-14T09:07:51.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.553546+0000", 2024-09-14T09:07:51.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3680000000000001e-06 2024-09-14T09:07:51.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.553589+0000", 2024-09-14T09:07:51.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3618999999999997e-05 2024-09-14T09:07:51.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.553679+0000", 2024-09-14T09:07:51.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9438999999999995e-05 2024-09-14T09:07:51.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:07:51.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.553811+0000", 2024-09-14T09:07:51.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000132096 2024-09-14T09:07:51.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.554371+0000", 2024-09-14T09:07:51.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00056052499999999998 2024-09-14T09:07:51.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.554595+0000", 2024-09-14T09:07:51.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022341 2024-09-14T09:07:51.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.554626+0000", 2024-09-14T09:07:51.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0997999999999997e-05 2024-09-14T09:07:51.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.554651+0000", 2024-09-14T09:07:51.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5269000000000002e-05 2024-09-14T09:07:51.946 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.947 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.947 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.947 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:311 3.11 3:8fc2352d:::rbd_header.111213dcc65d:head [call rbd.set_stripe_unit_count in=24b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:51.947 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.555002+0000", 2024-09-14T09:07:51.947 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.3781682470000001, 2024-09-14T09:07:51.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0010705790000000001, 2024-09-14T09:07:51.947 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.947 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.947 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.947 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.947 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:07:51.947 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:51.947 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 311 2024-09-14T09:07:51.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.948 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.555002+0000", 2024-09-14T09:07:51.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.555002+0000", 2024-09-14T09:07:51.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.555002+0000", 2024-09-14T09:07:51.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2399999999999997e-07 2024-09-14T09:07:51.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.555006+0000", 2024-09-14T09:07:51.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5769999999999998e-06 2024-09-14T09:07:51.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.555015+0000", 2024-09-14T09:07:51.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1589999999999999e-06 2024-09-14T09:07:51.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.555020+0000", 2024-09-14T09:07:51.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8709999999999996e-06 2024-09-14T09:07:51.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.555061+0000", 2024-09-14T09:07:51.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0692999999999998e-05 2024-09-14T09:07:51.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.555109+0000", 2024-09-14T09:07:51.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8726000000000001e-05 2024-09-14T09:07:51.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:07:51.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.555256+0000", 2024-09-14T09:07:51.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014630099999999999 2024-09-14T09:07:51.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.555667+0000", 2024-09-14T09:07:51.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00041115999999999999 2024-09-14T09:07:51.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.555990+0000", 2024-09-14T09:07:51.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032286800000000003 2024-09-14T09:07:51.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.556020+0000", 2024-09-14T09:07:51.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0298999999999999e-05 2024-09-14T09:07:51.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.556072+0000", 2024-09-14T09:07:51.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2200999999999997e-05 2024-09-14T09:07:51.952 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.952 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.952 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.953 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:325 3.11 3:8fc2352d:::rbd_header.111213dcc65d:head [watch watch cookie 140027946848592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:51.953 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.566681+0000", 2024-09-14T09:07:51.953 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.3664885149999999, 2024-09-14T09:07:51.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00095963799999999996, 2024-09-14T09:07:51.953 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.953 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.953 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.953 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.953 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:07:51.953 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:51.953 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 325 2024-09-14T09:07:51.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.953 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.566681+0000", 2024-09-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.566681+0000", 2024-09-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.566682+0000", 2024-09-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3300000000000002e-07 2024-09-14T09:07:51.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.566685+0000", 2024-09-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7980000000000001e-06 2024-09-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.566694+0000", 2024-09-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8929999999999994e-06 2024-09-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.566698+0000", 2024-09-14T09:07:51.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3950000000000003e-06 2024-09-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.566751+0000", 2024-09-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3022999999999997e-05 2024-09-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.566794+0000", 2024-09-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2617999999999998e-05 2024-09-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.566882+0000", 2024-09-14T09:07:51.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8369999999999996e-05 2024-09-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.567334+0000", 2024-09-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000452294 2024-09-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.567538+0000", 2024-09-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000203346 2024-09-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.567567+0000", 2024-09-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9689999999999999e-05 2024-09-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.567641+0000", 2024-09-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3677999999999995e-05 2024-09-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:326 3.11 3:8fc2352d:::rbd_header.111213dcc65d:head [call rbd.parent_attach in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.567959+0000", 2024-09-14T09:07:51.958 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.3652113639999999, 2024-09-14T09:07:51.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0010166280000000001, 2024-09-14T09:07:51.959 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.959 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.959 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.959 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.959 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:07:51.959 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:51.959 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 326 2024-09-14T09:07:51.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.959 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.567959+0000", 2024-09-14T09:07:51.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.567959+0000", 2024-09-14T09:07:51.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.567959+0000", 2024-09-14T09:07:51.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6300000000000005e-07 2024-09-14T09:07:51.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.567969+0000", 2024-09-14T09:07:51.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4369999999999996e-06 2024-09-14T09:07:51.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.567977+0000", 2024-09-14T09:07:51.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3469999999999999e-06 2024-09-14T09:07:51.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.567982+0000", 2024-09-14T09:07:51.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4160000000000003e-06 2024-09-14T09:07:51.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.568018+0000", 2024-09-14T09:07:51.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5524000000000001e-05 2024-09-14T09:07:51.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.568070+0000", 2024-09-14T09:07:51.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2204999999999999e-05 2024-09-14T09:07:51.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:07:51.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.568224+0000", 2024-09-14T09:07:51.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015339100000000001 2024-09-14T09:07:51.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.568722+0000", 2024-09-14T09:07:51.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00049864500000000003 2024-09-14T09:07:51.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.568898+0000", 2024-09-14T09:07:51.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017573999999999999 2024-09-14T09:07:51.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.568928+0000", 2024-09-14T09:07:51.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0158000000000002e-05 2024-09-14T09:07:51.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.568975+0000", 2024-09-14T09:07:51.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7101999999999997e-05 2024-09-14T09:07:51.964 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.964 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.964 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.964 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:335 3.11 3:8fc2352d:::rbd_header.111213dcc65d:head [watch unwatch cookie 140027946848592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:51.964 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.575027+0000", 2024-09-14T09:07:51.964 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.3581429090000001, 2024-09-14T09:07:51.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00088517000000000001, 2024-09-14T09:07:51.964 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.964 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.964 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.965 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.965 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:07:51.965 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:51.965 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 335 2024-09-14T09:07:51.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.965 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575027+0000", 2024-09-14T09:07:51.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575027+0000", 2024-09-14T09:07:51.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575028+0000", 2024-09-14T09:07:51.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5199999999999996e-07 2024-09-14T09:07:51.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575031+0000", 2024-09-14T09:07:51.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.49e-06 2024-09-14T09:07:51.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575042+0000", 2024-09-14T09:07:51.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0747999999999999e-05 2024-09-14T09:07:51.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575047+0000", 2024-09-14T09:07:51.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1259999999999997e-06 2024-09-14T09:07:51.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575087+0000", 2024-09-14T09:07:51.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9895999999999999e-05 2024-09-14T09:07:51.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575132+0000", 2024-09-14T09:07:51.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4746999999999997e-05 2024-09-14T09:07:51.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:07:51.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575212+0000", 2024-09-14T09:07:51.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0220000000000001e-05 2024-09-14T09:07:51.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575627+0000", 2024-09-14T09:07:51.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000415361 2024-09-14T09:07:51.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575815+0000", 2024-09-14T09:07:51.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018783299999999999 2024-09-14T09:07:51.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575844+0000", 2024-09-14T09:07:51.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8755000000000002e-05 2024-09-14T09:07:51.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575912+0000", 2024-09-14T09:07:51.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8242000000000002e-05 2024-09-14T09:07:51.973 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.973 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.973 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.973 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4471.0:515 3.5 3:a19fd784:::rbd_data.1112b98aa287.0000000000000000:head [stat,delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:51.974 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.584013+0000", 2024-09-14T09:07:51.974 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.3491571499999999, 2024-09-14T09:07:51.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014758550000000001, 2024-09-14T09:07:51.974 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.974 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.974 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.974 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.974 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4471", 2024-09-14T09:07:51.974 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2207718190", 2024-09-14T09:07:51.974 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 515 2024-09-14T09:07:51.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.974 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.584013+0000", 2024-09-14T09:07:51.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.584013+0000", 2024-09-14T09:07:51.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.584014+0000", 2024-09-14T09:07:51.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1200000000000002e-07 2024-09-14T09:07:51.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.584018+0000", 2024-09-14T09:07:51.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.963e-06 2024-09-14T09:07:51.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.584028+0000", 2024-09-14T09:07:51.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0266e-05 2024-09-14T09:07:51.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.584034+0000", 2024-09-14T09:07:51.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1820000000000003e-06 2024-09-14T09:07:51.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.584078+0000", 2024-09-14T09:07:51.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4119000000000002e-05 2024-09-14T09:07:51.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.584129+0000", 2024-09-14T09:07:51.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0331999999999999e-05 2024-09-14T09:07:51.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 3", 2024-09-14T09:07:51.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.584241+0000", 2024-09-14T09:07:51.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000112145 2024-09-14T09:07:51.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.585296+0000", 2024-09-14T09:07:51.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001055828 2024-09-14T09:07:51.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.585419+0000", 2024-09-14T09:07:51.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000122738 2024-09-14T09:07:51.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.585450+0000", 2024-09-14T09:07:51.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0987e-05 2024-09-14T09:07:51.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.585489+0000", 2024-09-14T09:07:51.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8482999999999997e-05 2024-09-14T09:07:51.979 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.979 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.979 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.979 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4471.0:519 3.0 e27/22 3:0315249f:::rbd_data.1112b98aa287.0000000000000002:head v 27'8, mlcod=26'5)", 2024-09-14T09:07:51.979 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.587743+0000", 2024-09-14T09:07:51.979 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.3454268810000001, 2024-09-14T09:07:51.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00086833899999999998, 2024-09-14T09:07:51.980 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.980 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.980 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.980 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.587743+0000", 2024-09-14T09:07:51.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.587743+0000", 2024-09-14T09:07:51.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.587744+0000", 2024-09-14T09:07:51.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6700000000000003e-07 2024-09-14T09:07:51.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.587750+0000", 2024-09-14T09:07:51.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7660000000000004e-06 2024-09-14T09:07:51.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.587759+0000", 2024-09-14T09:07:51.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0690000000000008e-06 2024-09-14T09:07:51.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.587764+0000", 2024-09-14T09:07:51.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0270000000000003e-06 2024-09-14T09:07:51.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.587803+0000", 2024-09-14T09:07:51.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8810000000000003e-05 2024-09-14T09:07:51.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.587817+0000", 2024-09-14T09:07:51.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4207e-05 2024-09-14T09:07:51.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.588583+0000", 2024-09-14T09:07:51.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00076607300000000004 2024-09-14T09:07:51.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.588611+0000", 2024-09-14T09:07:51.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.862e-05 2024-09-14T09:07:51.983 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.983 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.983 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.984 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4471.0:520 3.1 e27/22 3:83bc1d50:::rbd_data.1112b98aa287.0000000000000003:head v 27'11, mlcod=26'8)", 2024-09-14T09:07:51.984 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.589509+0000", 2024-09-14T09:07:51.984 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.343660925, 2024-09-14T09:07:51.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00078836399999999995, 2024-09-14T09:07:51.984 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.984 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.984 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.984 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.589509+0000", 2024-09-14T09:07:51.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.589509+0000", 2024-09-14T09:07:51.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.589510+0000", 2024-09-14T09:07:51.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.99e-07 2024-09-14T09:07:51.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.589514+0000", 2024-09-14T09:07:51.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.707e-06 2024-09-14T09:07:51.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.589524+0000", 2024-09-14T09:07:51.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6539999999999994e-06 2024-09-14T09:07:51.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.589529+0000", 2024-09-14T09:07:51.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5480000000000003e-06 2024-09-14T09:07:51.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.589577+0000", 2024-09-14T09:07:51.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8251999999999998e-05 2024-09-14T09:07:51.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.589590+0000", 2024-09-14T09:07:51.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2995e-05 2024-09-14T09:07:51.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.590271+0000", 2024-09-14T09:07:51.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00068099299999999996 2024-09-14T09:07:51.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.590297+0000", 2024-09-14T09:07:51.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6516000000000002e-05 2024-09-14T09:07:51.988 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.988 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.988 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.988 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:398 3.11 3:8fc2352d:::rbd_header.111213dcc65d:head [watch watch cookie 140027947117712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:51.988 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.669192+0000", 2024-09-14T09:07:51.988 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.2639775659999999, 2024-09-14T09:07:51.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0010400100000000001, 2024-09-14T09:07:51.988 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.988 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.988 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.989 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.989 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:07:51.989 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:51.989 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 398 2024-09-14T09:07:51.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.989 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.669192+0000", 2024-09-14T09:07:51.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.669192+0000", 2024-09-14T09:07:51.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.669193+0000", 2024-09-14T09:07:51.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5600000000000005e-07 2024-09-14T09:07:51.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.669197+0000", 2024-09-14T09:07:51.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5049999999999999e-06 2024-09-14T09:07:51.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.669207+0000", 2024-09-14T09:07:51.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0530000000000001e-05 2024-09-14T09:07:51.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.669212+0000", 2024-09-14T09:07:51.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2349999999999999e-06 2024-09-14T09:07:51.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.669255+0000", 2024-09-14T09:07:51.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2132999999999998e-05 2024-09-14T09:07:51.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.669296+0000", 2024-09-14T09:07:51.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1527999999999999e-05 2024-09-14T09:07:51.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:07:51.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.669396+0000", 2024-09-14T09:07:51.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010016199999999999 2024-09-14T09:07:51.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.669927+0000", 2024-09-14T09:07:51.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000530242 2024-09-14T09:07:51.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.670162+0000", 2024-09-14T09:07:51.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023523700000000001 2024-09-14T09:07:51.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.670191+0000", 2024-09-14T09:07:51.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9573e-05 2024-09-14T09:07:51.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.670232+0000", 2024-09-14T09:07:51.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1109000000000002e-05 2024-09-14T09:07:51.993 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.994 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.994 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.994 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4421.0:38 3.11 3:8fc2352d:::rbd_header.111213dcc65d:head [watch watch cookie 140696283930128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:51.994 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.735675+0000", 2024-09-14T09:07:51.994 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.1974948240000001, 2024-09-14T09:07:51.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001234144, 2024-09-14T09:07:51.994 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:51.994 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:51.994 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:51.994 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:51.994 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4421", 2024-09-14T09:07:51.994 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:51.995 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 38 2024-09-14T09:07:51.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.995 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:51.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:51.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.735675+0000", 2024-09-14T09:07:51.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:51.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.735675+0000", 2024-09-14T09:07:51.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:51.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:51.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.735676+0000", 2024-09-14T09:07:51.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5600000000000005e-07 2024-09-14T09:07:51.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:51.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.735679+0000", 2024-09-14T09:07:51.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7750000000000001e-06 2024-09-14T09:07:51.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:51.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.735686+0000", 2024-09-14T09:07:51.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6669999999999996e-06 2024-09-14T09:07:51.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:51.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.735691+0000", 2024-09-14T09:07:51.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3510000000000004e-06 2024-09-14T09:07:51.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:51.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.735744+0000", 2024-09-14T09:07:51.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2991999999999997e-05 2024-09-14T09:07:51.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:51.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.735823+0000", 2024-09-14T09:07:51.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9618999999999998e-05 2024-09-14T09:07:51.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:07:51.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.735997+0000", 2024-09-14T09:07:51.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017378599999999999 2024-09-14T09:07:51.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:51.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.736581+0000", 2024-09-14T09:07:51.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058447800000000004 2024-09-14T09:07:51.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:51.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.736786+0000", 2024-09-14T09:07:51.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000204231 2024-09-14T09:07:51.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:51.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.736840+0000", 2024-09-14T09:07:51.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4057000000000001e-05 2024-09-14T09:07:51.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:51.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:51.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:51.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.736909+0000", 2024-09-14T09:07:51.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9531999999999998e-05 2024-09-14T09:07:51.999 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.999 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:51.999 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:51.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.000 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4495.0:1746 3.1d 3:be749ce4:::rbd_data.11128b09dac5.0000000000000031:head [read 2269184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:52.000 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:51.151826+0000", 2024-09-14T09:07:52.000 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.781344237, 2024-09-14T09:07:52.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00076418500000000002, 2024-09-14T09:07:52.000 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:52.000 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:52.000 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:52.000 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:52.000 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4495", 2024-09-14T09:07:52.000 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1400929400", 2024-09-14T09:07:52.000 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1746 2024-09-14T09:07:52.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.001 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:52.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:52.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151826+0000", 2024-09-14T09:07:52.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:52.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:52.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151826+0000", 2024-09-14T09:07:52.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:52.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:52.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151826+0000", 2024-09-14T09:07:52.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6300000000000001e-07 2024-09-14T09:07:52.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:52.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151828+0000", 2024-09-14T09:07:52.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4079999999999999e-06 2024-09-14T09:07:52.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:52.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151833+0000", 2024-09-14T09:07:52.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0810000000000001e-06 2024-09-14T09:07:52.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:52.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151836+0000", 2024-09-14T09:07:52.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1439999999999999e-06 2024-09-14T09:07:52.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:52.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.152393+0000", 2024-09-14T09:07:52.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00055680599999999997 2024-09-14T09:07:52.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:52.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.152468+0000", 2024-09-14T09:07:52.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5284999999999995e-05 2024-09-14T09:07:52.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:52.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.152590+0000", 2024-09-14T09:07:52.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012209800000000001 2024-09-14T09:07:52.004 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:52.004 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:52.004 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:52.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.004 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4495.0:1747 3.1d 3:be749ce4:::rbd_data.11128b09dac5.0000000000000031:head [sparse-read 2289664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:52.004 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:51.151842+0000", 2024-09-14T09:07:52.004 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.78132768100000005, 2024-09-14T09:07:52.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00093362499999999999, 2024-09-14T09:07:52.004 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:52.004 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:52.004 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:52.004 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:52.005 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4495", 2024-09-14T09:07:52.005 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1400929400", 2024-09-14T09:07:52.005 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1747 2024-09-14T09:07:52.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.005 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:52.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:52.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151842+0000", 2024-09-14T09:07:52.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:52.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:52.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151842+0000", 2024-09-14T09:07:52.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:52.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:52.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151843+0000", 2024-09-14T09:07:52.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8000000000000002e-07 2024-09-14T09:07:52.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:52.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151844+0000", 2024-09-14T09:07:52.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.06e-06 2024-09-14T09:07:52.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:52.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151847+0000", 2024-09-14T09:07:52.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1580000000000001e-06 2024-09-14T09:07:52.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:52.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151850+0000", 2024-09-14T09:07:52.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6989999999999999e-06 2024-09-14T09:07:52.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:52.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.152616+0000", 2024-09-14T09:07:52.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00076697099999999997 2024-09-14T09:07:52.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:52.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.152685+0000", 2024-09-14T09:07:52.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8449999999999997e-05 2024-09-14T09:07:52.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:52.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.152776+0000", 2024-09-14T09:07:52.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1007000000000005e-05 2024-09-14T09:07:52.008 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:52.008 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:52.008 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:52.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.008 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4495.0:1751 3.1d 3:be749ce4:::rbd_data.11128b09dac5.0000000000000031:head [read 2453504~36864] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:52.008 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:51.153015+0000", 2024-09-14T09:07:52.009 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.78015478400000005, 2024-09-14T09:07:52.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084288899999999999, 2024-09-14T09:07:52.009 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:52.009 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:52.009 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:52.009 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:52.009 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4495", 2024-09-14T09:07:52.009 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1400929400", 2024-09-14T09:07:52.009 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1751 2024-09-14T09:07:52.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.009 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:52.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:52.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.153015+0000", 2024-09-14T09:07:52.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:52.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:52.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.153015+0000", 2024-09-14T09:07:52.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:52.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:52.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.153016+0000", 2024-09-14T09:07:52.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.22e-07 2024-09-14T09:07:52.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:52.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.153017+0000", 2024-09-14T09:07:52.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.127e-06 2024-09-14T09:07:52.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:52.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.153020+0000", 2024-09-14T09:07:52.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.343e-06 2024-09-14T09:07:52.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:52.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.153023+0000", 2024-09-14T09:07:52.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5440000000000001e-06 2024-09-14T09:07:52.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:52.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.153651+0000", 2024-09-14T09:07:52.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000628394 2024-09-14T09:07:52.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:52.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.153728+0000", 2024-09-14T09:07:52.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6688999999999997e-05 2024-09-14T09:07:52.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:52.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.153858+0000", 2024-09-14T09:07:52.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013046999999999999 2024-09-14T09:07:52.012 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:52.013 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:52.013 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:52.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.013 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4421.0:135 3.11 3:8fc2352d:::rbd_header.111213dcc65d:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:52.013 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:51.317500+0000", 2024-09-14T09:07:52.013 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.61566997700000003, 2024-09-14T09:07:52.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00117657, 2024-09-14T09:07:52.013 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:52.013 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:52.013 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:52.013 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:52.013 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4421", 2024-09-14T09:07:52.013 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:52.013 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 135 2024-09-14T09:07:52.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.014 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:52.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:52.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.317500+0000", 2024-09-14T09:07:52.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:52.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:52.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.317500+0000", 2024-09-14T09:07:52.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:52.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:52.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.317501+0000", 2024-09-14T09:07:52.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9299999999999998e-07 2024-09-14T09:07:52.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:52.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.317504+0000", 2024-09-14T09:07:52.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.286e-06 2024-09-14T09:07:52.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:52.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.317512+0000", 2024-09-14T09:07:52.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8909999999999995e-06 2024-09-14T09:07:52.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:52.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.317516+0000", 2024-09-14T09:07:52.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.493e-06 2024-09-14T09:07:52.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:52.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.317558+0000", 2024-09-14T09:07:52.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1257000000000002e-05 2024-09-14T09:07:52.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:52.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.317631+0000", 2024-09-14T09:07:52.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3125000000000002e-05 2024-09-14T09:07:52.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:07:52.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.317834+0000", 2024-09-14T09:07:52.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000203439 2024-09-14T09:07:52.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:52.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.318464+0000", 2024-09-14T09:07:52.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062964100000000001 2024-09-14T09:07:52.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:52.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.318589+0000", 2024-09-14T09:07:52.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000124819 2024-09-14T09:07:52.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:52.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.318639+0000", 2024-09-14T09:07:52.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0090999999999999e-05 2024-09-14T09:07:52.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:52.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.318677+0000", 2024-09-14T09:07:52.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7935000000000002e-05 2024-09-14T09:07:52.018 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:52.018 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:52.018 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:52.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.019 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:415 3.11 3:8fc2352d:::rbd_header.111213dcc65d:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:52.019 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:51.321759+0000", 2024-09-14T09:07:52.019 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.611410499, 2024-09-14T09:07:52.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00090808100000000004, 2024-09-14T09:07:52.019 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:52.019 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:52.019 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:52.019 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:52.019 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:07:52.019 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:52.019 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 415 2024-09-14T09:07:52.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.019 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:52.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:52.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.321759+0000", 2024-09-14T09:07:52.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:52.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:52.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.321759+0000", 2024-09-14T09:07:52.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:52.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:52.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.321760+0000", 2024-09-14T09:07:52.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7199999999999999e-07 2024-09-14T09:07:52.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:52.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.321762+0000", 2024-09-14T09:07:52.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.379e-06 2024-09-14T09:07:52.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:52.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.321768+0000", 2024-09-14T09:07:52.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3299999999999998e-06 2024-09-14T09:07:52.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:52.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.321771+0000", 2024-09-14T09:07:52.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5920000000000001e-06 2024-09-14T09:07:52.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:52.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.321871+0000", 2024-09-14T09:07:52.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9786999999999999e-05 2024-09-14T09:07:52.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:52.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.321911+0000", 2024-09-14T09:07:52.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9956999999999997e-05 2024-09-14T09:07:52.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:52.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.322668+0000", 2024-09-14T09:07:52.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00075656400000000004 2024-09-14T09:07:52.023 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:52.023 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:52.023 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:52.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.023 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4421.0:142 3.11 3:8fc2352d:::rbd_header.111213dcc65d:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:52.023 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:51.325040+0000", 2024-09-14T09:07:52.023 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.60812999899999998, 2024-09-14T09:07:52.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001050598, 2024-09-14T09:07:52.023 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:52.023 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:52.023 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:52.023 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:52.024 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4421", 2024-09-14T09:07:52.024 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:52.024 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 142 2024-09-14T09:07:52.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.024 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:52.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:52.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.325040+0000", 2024-09-14T09:07:52.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:52.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:52.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.325040+0000", 2024-09-14T09:07:52.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:52.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:52.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.325041+0000", 2024-09-14T09:07:52.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0999999999999997e-07 2024-09-14T09:07:52.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:52.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.325045+0000", 2024-09-14T09:07:52.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259999999999997e-06 2024-09-14T09:07:52.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:52.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.325055+0000", 2024-09-14T09:07:52.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8479999999999996e-06 2024-09-14T09:07:52.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:52.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.325062+0000", 2024-09-14T09:07:52.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5220000000000004e-06 2024-09-14T09:07:52.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:52.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.325102+0000", 2024-09-14T09:07:52.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0466999999999997e-05 2024-09-14T09:07:52.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:52.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.325152+0000", 2024-09-14T09:07:52.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0331000000000003e-05 2024-09-14T09:07:52.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:07:52.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.325267+0000", 2024-09-14T09:07:52.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000114147 2024-09-14T09:07:52.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:52.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.325693+0000", 2024-09-14T09:07:52.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00042634200000000002 2024-09-14T09:07:52.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:52.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.326033+0000", 2024-09-14T09:07:52.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00033962700000000001 2024-09-14T09:07:52.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:52.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.326064+0000", 2024-09-14T09:07:52.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1486999999999999e-05 2024-09-14T09:07:52.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:52.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.326091+0000", 2024-09-14T09:07:52.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6591e-05 2024-09-14T09:07:52.028 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:52.029 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:52.029 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:52.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.029 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4421.0:160 3.5 3:a19fd784:::rbd_data.1112b98aa287.0000000000000000:4 [read 3072~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:52.029 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:51.330707+0000", 2024-09-14T09:07:52.029 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.60246258900000005, 2024-09-14T09:07:52.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00082680899999999996, 2024-09-14T09:07:52.029 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:52.029 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:52.029 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:52.029 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:52.029 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4421", 2024-09-14T09:07:52.029 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:52.029 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 160 2024-09-14T09:07:52.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.030 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:52.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:52.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.330707+0000", 2024-09-14T09:07:52.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:52.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:52.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.330707+0000", 2024-09-14T09:07:52.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:52.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:52.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.330708+0000", 2024-09-14T09:07:52.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9999999999999999e-07 2024-09-14T09:07:52.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:52.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.330709+0000", 2024-09-14T09:07:52.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3909999999999999e-06 2024-09-14T09:07:52.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:52.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.330712+0000", 2024-09-14T09:07:52.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3069999999999998e-06 2024-09-14T09:07:52.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:52.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.330715+0000", 2024-09-14T09:07:52.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:07:52.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:52.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.331362+0000", 2024-09-14T09:07:52.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00064719799999999998 2024-09-14T09:07:52.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:52.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.331441+0000", 2024-09-14T09:07:52.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8938999999999998e-05 2024-09-14T09:07:52.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:52.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.331534+0000", 2024-09-14T09:07:52.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3127999999999993e-05 2024-09-14T09:07:52.033 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:52.033 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:52.033 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:52.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.033 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:427 3.11 3:8fc2352d:::rbd_header.111213dcc65d:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:52.033 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:51.331983+0000", 2024-09-14T09:07:52.033 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.60118662499999997, 2024-09-14T09:07:52.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00091587500000000002, 2024-09-14T09:07:52.034 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:52.034 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:52.034 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:52.034 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:52.034 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:07:52.034 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:52.034 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 427 2024-09-14T09:07:52.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.034 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:52.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:52.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.331983+0000", 2024-09-14T09:07:52.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:52.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:52.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.331983+0000", 2024-09-14T09:07:52.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:52.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:52.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.331984+0000", 2024-09-14T09:07:52.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.99e-07 2024-09-14T09:07:52.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:52.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.331988+0000", 2024-09-14T09:07:52.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5199999999999999e-06 2024-09-14T09:07:52.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:52.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.331996+0000", 2024-09-14T09:07:52.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8879999999999997e-06 2024-09-14T09:07:52.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:52.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.332003+0000", 2024-09-14T09:07:52.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1999999999999999e-06 2024-09-14T09:07:52.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:52.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.332040+0000", 2024-09-14T09:07:52.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7870000000000002e-05 2024-09-14T09:07:52.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:52.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.332090+0000", 2024-09-14T09:07:52.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9489e-05 2024-09-14T09:07:52.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:52.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:52.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:52.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.332899+0000", 2024-09-14T09:07:52.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00080930900000000003 2024-09-14T09:07:52.037 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:52.037 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:52.037 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:52.037 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:52.038 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:52.038 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:52.039 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:07:52.040 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:52.041+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:52.124 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:07:52.155 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:52.155 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:07:52.155 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:07:52.155 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:52.164 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:07:52.168 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:52.170+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:07:52.240 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:52.242+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:07:52.242 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:07:52.242 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:07:52.259 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:07:52.259 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:07:52.268 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:52.268 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:07:52.268 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:07:52.268 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:07:52.268 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:52.275 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:07:52.275 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:07:52.276 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:07:52.292 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:07:52.292 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:07:52.310 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:07:52.310 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:07:52.318 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T09:07:52.330 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:07:52.331 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:07:52.341 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:52.343+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:52.384 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:52.384 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:52.387 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone2 from 0xc304000 (overlap 0xa763400) to 0x10bd200 2024-09-14T09:07:52.393 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:07:52.443 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:52.444+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:52.506 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:52.506 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:52.515 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:07:52.556 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:52.558+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:52.644 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:52.646+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:52.658 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:52.658 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:52.667 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:07:52.722 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #1, image image_client.0-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent2 2024-09-14T09:07:52.752 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:52.754+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:52.766 INFO:teuthology.orchestra.run.smithi148.stdout:125 read 0x717f800 thru 0x7185bbc (0x63bd bytes) 2024-09-14T09:07:52.769 INFO:teuthology.orchestra.run.smithi148.stdout:127 read 0x3de4c00 thru 0x3df33ee (0xe7ef bytes) 2024-09-14T09:07:52.773 INFO:teuthology.orchestra.run.smithi148.stdout:128 read 0x67ba600 thru 0x67bbad2 (0x14d3 bytes) 2024-09-14T09:07:52.866 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:52.866 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:52.866 INFO:teuthology.orchestra.run.smithi148.stdout:133 read 0x2aaa800 thru 0x2aad4c7 (0x2cc8 bytes) 2024-09-14T09:07:52.866 INFO:teuthology.orchestra.run.smithi148.stdout:135 trunc from 0xc304000 to 0x205b400 2024-09-14T09:07:52.866 INFO:teuthology.orchestra.run.smithi148.stdout:137 punch from 0x1765800 to 0x1775200, (0xfa00 bytes) 2024-09-14T09:07:52.867 INFO:teuthology.orchestra.run.smithi148.stdout:139 punch from 0x1e44800 to 0x1e4c400, (0x7c00 bytes) 2024-09-14T09:07:52.867 INFO:teuthology.orchestra.run.smithi148.stdout:141 read 0x17e3600 thru 0x17f3593 (0xff94 bytes) 2024-09-14T09:07:52.867 INFO:teuthology.orchestra.run.smithi148.stdout:142 read 0x1242000 thru 0x124e5fb (0xc5fc bytes) 2024-09-14T09:07:52.867 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:07:52.868 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:52.869+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:52.874 INFO:teuthology.orchestra.run.smithi148.stdout:143 write 0x2ec0000 thru 0x2ec0c78 (0xc79 bytes) 2024-09-14T09:07:52.880 INFO:teuthology.orchestra.run.smithi148.stdout:144 read 0x838400 thru 0x83915f (0xd60 bytes) 2024-09-14T09:07:52.880 INFO:teuthology.orchestra.run.smithi148.stdout:146 read 0x141400 thru 0x144391 (0x2f92 bytes) 2024-09-14T09:07:52.881 INFO:teuthology.orchestra.run.smithi148.stdout:149 read 0x2090c00 thru 0x209367c (0x2a7d bytes) 2024-09-14T09:07:52.881 INFO:teuthology.orchestra.run.smithi148.stdout:150 read 0xcdcc00 thru 0xce66a8 (0x9aa9 bytes) 2024-09-14T09:07:52.895 INFO:teuthology.orchestra.run.smithi148.stdout:151 write 0x58c1600 thru 0x58d0569 (0xef6a bytes) 2024-09-14T09:07:52.915 INFO:teuthology.orchestra.run.smithi148.stdout:154 write 0xaecae00 thru 0xaed770b (0xc90c bytes) 2024-09-14T09:07:52.932 INFO:teuthology.orchestra.run.smithi148.stdout:158 write 0xe4da400 thru 0xe4e2d47 (0x8948 bytes) 2024-09-14T09:07:52.936 INFO:teuthology.orchestra.run.smithi148.stdout:160 trunc from 0xe4e2e00 to 0xcde0c00 2024-09-14T09:07:52.950 INFO:teuthology.orchestra.run.smithi148.stdout:161 write 0x44ca000 thru 0x44d373b (0x973c bytes) 2024-09-14T09:07:52.950 INFO:teuthology.orchestra.run.smithi148.stdout:163 read 0x837d800 thru 0x8386e89 (0x968a bytes) 2024-09-14T09:07:52.951 INFO:teuthology.orchestra.run.smithi148.stdout:165 trunc from 0xcde0c00 to 0xd5b4c00 2024-09-14T09:07:52.966 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:52.968+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:52.969 INFO:teuthology.orchestra.run.smithi148.stdout:166 read 0x5868a00 thru 0x587029f (0x78a0 bytes) 2024-09-14T09:07:52.969 INFO:teuthology.orchestra.run.smithi148.stdout:167 punch from 0xb2e9800 to 0xb2eba00, (0x2200 bytes) 2024-09-14T09:07:52.969 INFO:teuthology.orchestra.run.smithi148.stdout:168 punch from 0x822b800 to 0x8233e00, (0x8600 bytes) 2024-09-14T09:07:52.969 INFO:teuthology.orchestra.run.smithi148.stdout:170 write 0xccc9c00 thru 0xccd0db8 (0x71b9 bytes) 2024-09-14T09:07:52.969 INFO:teuthology.orchestra.run.smithi148.stdout:172 punch from 0x7168400 to 0x7168800, (0x400 bytes) 2024-09-14T09:07:52.970 INFO:teuthology.orchestra.run.smithi148.stdout:173 read 0x6b94200 thru 0x6ba1e71 (0xdc72 bytes) 2024-09-14T09:07:52.970 INFO:teuthology.orchestra.run.smithi148.stdout:175 punch from 0x9239e00 to 0x923b800, (0x1a00 bytes) 2024-09-14T09:07:52.970 INFO:teuthology.orchestra.run.smithi148.stdout:183 read 0x984ae00 thru 0x9856511 (0xb712 bytes) 2024-09-14T09:07:52.980 INFO:teuthology.orchestra.run.smithi148.stdout:187 trunc from 0xd5b4c00 to 0x550f600 2024-09-14T09:07:52.999 INFO:teuthology.orchestra.run.smithi148.stdout:188 read 0x376aa00 thru 0x3775b7f (0xb180 bytes) 2024-09-14T09:07:53.000 INFO:teuthology.orchestra.run.smithi148.stdout:189 read 0x3e11000 thru 0x3e1883b (0x783c bytes) 2024-09-14T09:07:53.000 INFO:teuthology.orchestra.run.smithi148.stdout:191 write 0x1f69800 thru 0x1f6d1f2 (0x39f3 bytes) 2024-09-14T09:07:53.001 INFO:teuthology.orchestra.run.smithi148.stdout:192 punch from 0x858e00 to 0x85ac00, (0x1e00 bytes) 2024-09-14T09:07:53.004 INFO:teuthology.orchestra.run.smithi148.stdout:197 punch from 0x493a000 to 0x4945a00, (0xba00 bytes) 2024-09-14T09:07:53.004 INFO:teuthology.orchestra.run.smithi148.stdout:201 flatten 2024-09-14T09:07:53.028 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:53.028 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:53.035 INFO:teuthology.orchestra.run.smithi148.stdout:204 write 0xec08c00 thru 0xec11556 (0x8957 bytes) 2024-09-14T09:07:53.037 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:07:53.038 INFO:teuthology.orchestra.run.smithi148.stdout:206 punch from 0xcbd6c00 to 0xcbe5400, (0xe800 bytes) 2024-09-14T09:07:53.038 INFO:teuthology.orchestra.run.smithi148.stdout:208 read 0xd864600 thru 0xd871d3a (0xd73b bytes) 2024-09-14T09:07:53.047 INFO:teuthology.orchestra.run.smithi148.stdout:209 trunc from 0xec11600 to 0x622b800 2024-09-14T09:07:53.068 INFO:teuthology.orchestra.run.smithi148.stdout:211 write 0x3eda000 thru 0x3ee1af2 (0x7af3 bytes) 2024-09-14T09:07:53.068 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:53.069+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:07:53.069 INFO:teuthology.orchestra.run.smithi148.stdout:212 read 0x5e87a00 thru 0x5e89f94 (0x2595 bytes) 2024-09-14T09:07:53.069 INFO:teuthology.orchestra.run.smithi148.stdout:214 read 0x1a8ce00 thru 0x1a9941c (0xc61d bytes) 2024-09-14T09:07:53.072 INFO:teuthology.orchestra.run.smithi148.stdout:215 read 0x21e1400 thru 0x21e8b86 (0x7787 bytes) 2024-09-14T09:07:53.073 INFO:teuthology.orchestra.run.smithi148.stdout:216 punch from 0x4e07600 to 0x4e0d400, (0x5e00 bytes) 2024-09-14T09:07:53.073 INFO:teuthology.orchestra.run.smithi148.stdout:218 punch from 0x3de1800 to 0x3def200, (0xda00 bytes) 2024-09-14T09:07:53.073 INFO:teuthology.orchestra.run.smithi148.stdout:220 read 0x27a3000 thru 0x27a79e2 (0x49e3 bytes) 2024-09-14T09:07:53.074 INFO:teuthology.orchestra.run.smithi148.stdout:222 punch from 0x465000 to 0x470600, (0xb600 bytes) 2024-09-14T09:07:53.074 INFO:teuthology.orchestra.run.smithi148.stdout:223 read 0x43ef200 thru 0x43ef6fd (0x4fe bytes) 2024-09-14T09:07:53.088 INFO:teuthology.orchestra.run.smithi148.stdout:224 write 0xabb0800 thru 0xabbbdcd (0xb5ce bytes) 2024-09-14T09:07:53.099 INFO:teuthology.orchestra.run.smithi148.stdout:226 trunc from 0xabbbe00 to 0x2d14000 2024-09-14T09:07:53.129 INFO:teuthology.orchestra.run.smithi148.stdout:228 write 0x93ca00 thru 0x941c3a (0x523b bytes) 2024-09-14T09:07:53.130 INFO:teuthology.orchestra.run.smithi148.stdout:229 read 0x12e0200 thru 0x12e83a7 (0x81a8 bytes) 2024-09-14T09:07:53.130 INFO:teuthology.orchestra.run.smithi148.stdout:230 read 0x1d8c00 thru 0x1dc93f (0x3d40 bytes) 2024-09-14T09:07:53.131 INFO:teuthology.orchestra.run.smithi148.stdout:231 read 0xdbb400 thru 0xdbd3f4 (0x1ff5 bytes) 2024-09-14T09:07:53.131 INFO:teuthology.orchestra.run.smithi148.stdout:234 punch from 0x67dc00 to 0x68ca00, (0xee00 bytes) 2024-09-14T09:07:53.145 INFO:teuthology.orchestra.run.smithi148.stdout:235 trunc from 0x2d14000 to 0xdd0c000 2024-09-14T09:07:53.147 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:53.147 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:53.153 INFO:teuthology.orchestra.run.smithi148.stdout:236 write 0x7649400 thru 0x76574c7 (0xe0c8 bytes) 2024-09-14T09:07:53.157 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:07:53.168 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:53.170+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:53.171 INFO:teuthology.orchestra.run.smithi148.stdout:237 write 0xe4ad600 thru 0xe4b8249 (0xac4a bytes) 2024-09-14T09:07:53.179 INFO:teuthology.orchestra.run.smithi148.stdout:238 punch from 0xc275600 to 0xc278000, (0x2a00 bytes) 2024-09-14T09:07:53.179 INFO:teuthology.orchestra.run.smithi148.stdout:240 read 0x4e75e00 thru 0x4e7a3a8 (0x45a9 bytes) 2024-09-14T09:07:53.180 INFO:teuthology.orchestra.run.smithi148.stdout:241 trunc from 0xe4b8400 to 0xd685c00 2024-09-14T09:07:53.201 INFO:teuthology.orchestra.run.smithi148.stdout:244 punch from 0x4de9600 to 0x4de9c00, (0x600 bytes) 2024-09-14T09:07:53.206 INFO:teuthology.orchestra.run.smithi148.stdout:246 read 0x1c87200 thru 0x1c951dc (0xdfdd bytes) 2024-09-14T09:07:53.208 INFO:teuthology.orchestra.run.smithi148.stdout:247 read 0x3593200 thru 0x35a1b9a (0xe99b bytes) 2024-09-14T09:07:53.208 INFO:teuthology.orchestra.run.smithi148.stdout:248 write 0x3963400 thru 0x3970e2c (0xda2d bytes) 2024-09-14T09:07:53.209 INFO:teuthology.orchestra.run.smithi148.stdout:249 read 0x4dc6200 thru 0x4dd377c (0xd57d bytes) 2024-09-14T09:07:53.209 INFO:teuthology.orchestra.run.smithi148.stdout:250 read 0x91600 thru 0x9707b (0x5a7c bytes) 2024-09-14T09:07:53.210 INFO:teuthology.orchestra.run.smithi148.stdout:251 write 0xd391800 thru 0xd3a08d0 (0xf0d1 bytes) 2024-09-14T09:07:53.210 INFO:teuthology.orchestra.run.smithi148.stdout:252 read 0x40eae00 thru 0x40f5424 (0xa625 bytes) 2024-09-14T09:07:53.210 INFO:teuthology.orchestra.run.smithi148.stdout:254 read 0x666f000 thru 0x6674038 (0x5039 bytes) 2024-09-14T09:07:53.210 INFO:teuthology.orchestra.run.smithi148.stdout:256 write 0x6da0200 thru 0x6da507f (0x4e80 bytes) 2024-09-14T09:07:53.211 INFO:teuthology.orchestra.run.smithi148.stdout:257 punch from 0x8ab0000 to 0x8ab4c00, (0x4c00 bytes) 2024-09-14T09:07:53.211 INFO:teuthology.orchestra.run.smithi148.stdout:258 punch from 0x45ad600 to 0x45b1c00, (0x4600 bytes) 2024-09-14T09:07:53.214 INFO:teuthology.orchestra.run.smithi148.stdout:259 trunc from 0xd685c00 to 0xaf00800 2024-09-14T09:07:53.232 INFO:teuthology.orchestra.run.smithi148.stdout:261 punch from 0x7724200 to 0x7730600, (0xc400 bytes) 2024-09-14T09:07:53.237 INFO:teuthology.orchestra.run.smithi148.stdout:262 read 0x9ffaa00 thru 0xa0050ae (0xa6af bytes) 2024-09-14T09:07:53.241 INFO:teuthology.orchestra.run.smithi148.stdout:263 trunc from 0xaf00800 to 0x8342200 2024-09-14T09:07:53.268 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:53.268 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:53.269 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:53.271+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:53.275 INFO:teuthology.orchestra.run.smithi148.stdout:264 read 0x58bce00 thru 0x58cbf72 (0xf173 bytes) 2024-09-14T09:07:53.276 INFO:teuthology.orchestra.run.smithi148.stdout:265 write 0xa74000 thru 0xa749fd (0x9fe bytes) 2024-09-14T09:07:53.276 INFO:teuthology.orchestra.run.smithi148.stdout:267 write 0x7369e00 thru 0x73701c7 (0x63c8 bytes) 2024-09-14T09:07:53.277 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:07:53.295 INFO:teuthology.orchestra.run.smithi148.stdout:268 write 0x8b73c00 thru 0x8b8211d (0xe51e bytes) 2024-09-14T09:07:53.296 INFO:teuthology.orchestra.run.smithi148.stdout:271 punch from 0x7a41600 to 0x7a42800, (0x1200 bytes) 2024-09-14T09:07:53.297 INFO:teuthology.orchestra.run.smithi148.stdout:273 trunc from 0x8b82200 to 0x796ce00 2024-09-14T09:07:53.320 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is unset 2024-09-14T09:07:53.324 INFO:teuthology.orchestra.run.smithi148.stdout:274 write 0x3620200 thru 0x362cda0 (0xcba1 bytes) 2024-09-14T09:07:53.328 INFO:teuthology.orchestra.run.smithi148.stdout:277 read 0x61fb400 thru 0x62075b4 (0xc1b5 bytes) 2024-09-14T09:07:53.329 INFO:teuthology.orchestra.run.smithi148.stdout:281 punch from 0x6770200 to 0x6777800, (0x7600 bytes) 2024-09-14T09:07:53.330 INFO:teuthology.orchestra.run.smithi148.stdout:282 write 0x1fefc00 thru 0x1ff77da (0x7bdb bytes) 2024-09-14T09:07:53.354 INFO:teuthology.orchestra.run.smithi148.stdout:288 write 0xa729c00 thru 0xa7397f0 (0xfbf1 bytes) 2024-09-14T09:07:53.363 INFO:teuthology.orchestra.run.smithi148.stdout:290 trunc from 0xa739800 to 0x29dca00 2024-09-14T09:07:53.377 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:53.379+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:53.393 INFO:teuthology.orchestra.run.smithi148.stdout:skipping zero length punch hole 2024-09-14T09:07:53.397 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:53.397 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:53.405 INFO:teuthology.orchestra.run.smithi148.stdout:294 trunc from 0x29dca00 to 0xd1f1a00 2024-09-14T09:07:53.407 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:07:53.431 INFO:teuthology.orchestra.run.smithi148.stdout:295 write 0xe79d000 thru 0xe7a6828 (0x9829 bytes) 2024-09-14T09:07:53.431 INFO:teuthology.orchestra.run.smithi148.stdout:296 write 0x444ae00 thru 0x444ccd4 (0x1ed5 bytes) 2024-09-14T09:07:53.432 INFO:teuthology.orchestra.run.smithi148.stdout:299 read 0xc486600 thru 0xc492985 (0xc386 bytes) 2024-09-14T09:07:53.433 INFO:teuthology.orchestra.run.smithi148.stdout:302 write 0x8ab9800 thru 0x8ac6e60 (0xd661 bytes) 2024-09-14T09:07:53.433 INFO:teuthology.orchestra.run.smithi148.stdout:303 read 0xbeecc00 thru 0xbeeddcf (0x11d0 bytes) 2024-09-14T09:07:53.442 INFO:teuthology.orchestra.run.smithi148.stdout:304 trunc from 0xe7a6a00 to 0x6fc3800 2024-09-14T09:07:53.469 INFO:teuthology.orchestra.run.smithi148.stdout:305 punch from 0xb76c00 to 0xb7f800, (0x8c00 bytes) 2024-09-14T09:07:53.469 INFO:teuthology.orchestra.run.smithi148.stdout:306 punch from 0x32c200 to 0x32e000, (0x1e00 bytes) 2024-09-14T09:07:53.469 INFO:teuthology.orchestra.run.smithi148.stdout:308 read 0x61e0c00 thru 0x61e625e (0x565f bytes) 2024-09-14T09:07:53.469 INFO:teuthology.orchestra.run.smithi148.stdout:312 read 0x570aa00 thru 0x5712c95 (0x8296 bytes) 2024-09-14T09:07:53.469 INFO:teuthology.orchestra.run.smithi148.stdout:313 read 0x4c0ac00 thru 0x4c14215 (0x9616 bytes) 2024-09-14T09:07:53.469 INFO:teuthology.orchestra.run.smithi148.stdout:315 write 0x1ea4800 thru 0x1ea5f31 (0x1732 bytes) 2024-09-14T09:07:53.470 INFO:teuthology.orchestra.run.smithi148.stdout:320 read 0x33a0a00 thru 0x33a8f62 (0x8563 bytes) 2024-09-14T09:07:53.471 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:53.473+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:53.471 INFO:teuthology.orchestra.run.smithi148.stdout:322 read 0x174de00 thru 0x1755bd4 (0x7dd5 bytes) 2024-09-14T09:07:53.475 INFO:teuthology.orchestra.run.smithi148.stdout:323 trunc from 0x6fc3800 to 0x39b0000 2024-09-14T09:07:53.499 INFO:teuthology.orchestra.run.smithi148.stdout:324 read 0x955a00 thru 0x95c937 (0x6f38 bytes) 2024-09-14T09:07:53.520 INFO:teuthology.orchestra.run.smithi148.stdout:325 write 0xbe34400 thru 0xbe3f3d8 (0xafd9 bytes) 2024-09-14T09:07:53.521 INFO:teuthology.orchestra.run.smithi148.stdout:326 write 0xa2f9e00 thru 0xa2fcb41 (0x2d42 bytes) 2024-09-14T09:07:53.521 INFO:teuthology.orchestra.run.smithi148.stdout:327 read 0x9473400 thru 0x947c3a0 (0x8fa1 bytes) 2024-09-14T09:07:53.525 INFO:teuthology.orchestra.run.smithi148.stdout:328 punch from 0xc1d600 to 0xc28c00, (0xb600 bytes) 2024-09-14T09:07:53.525 INFO:teuthology.orchestra.run.smithi148.stdout:329 read 0x3be7600 thru 0x3bf3fd5 (0xc9d6 bytes) 2024-09-14T09:07:53.543 INFO:teuthology.orchestra.run.smithi148.stdout:334 write 0xed73600 thru 0xed835ff (0x10000 bytes) 2024-09-14T09:07:53.548 INFO:teuthology.orchestra.run.smithi148.stdout:337 trunc from 0xed83600 to 0xb585200 2024-09-14T09:07:53.566 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:53.566 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:53.571 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:53.574+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:53.574 INFO:teuthology.orchestra.run.smithi148.stdout:338 trunc from 0xb585200 to 0xc753600 2024-09-14T09:07:53.575 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:07:53.584 INFO:teuthology.orchestra.run.smithi148.stdout:340 read 0x671ce00 thru 0x672754b (0xa74c bytes) 2024-09-14T09:07:53.585 INFO:teuthology.orchestra.run.smithi148.stdout:341 read 0x985e200 thru 0x986167d (0x347e bytes) 2024-09-14T09:07:53.585 INFO:teuthology.orchestra.run.smithi148.stdout:342 write 0x7e91200 thru 0x7e9e8c4 (0xd6c5 bytes) 2024-09-14T09:07:53.585 INFO:teuthology.orchestra.run.smithi148.stdout:347 punch from 0x961200 to 0x961400, (0x200 bytes) 2024-09-14T09:07:53.589 INFO:teuthology.orchestra.run.smithi148.stdout:348 punch from 0x524d600 to 0x5255000, (0x7a00 bytes) 2024-09-14T09:07:53.589 INFO:teuthology.orchestra.run.smithi148.stdout:truncating to largest ever: 0xe8b5400 2024-09-14T09:07:53.592 INFO:teuthology.orchestra.run.smithi148.stdout:349 trunc from 0xc753600 to 0xe8b5400 2024-09-14T09:07:53.601 INFO:teuthology.orchestra.run.smithi148.stdout:352 write 0x2d2b600 thru 0x2d2e1df (0x2be0 bytes) 2024-09-14T09:07:53.609 INFO:teuthology.orchestra.run.smithi148.stdout:353 read 0xa9c7a00 thru 0xa9cac57 (0x3258 bytes) 2024-09-14T09:07:53.609 INFO:teuthology.orchestra.run.smithi148.stdout:354 read 0x3b35600 thru 0x3b3ccc0 (0x76c1 bytes) 2024-09-14T09:07:53.610 INFO:teuthology.orchestra.run.smithi148.stdout:355 write 0x6547000 thru 0x6555c3c (0xec3d bytes) 2024-09-14T09:07:53.610 INFO:teuthology.orchestra.run.smithi148.stdout:360 read 0x5fd1c00 thru 0x5fd7027 (0x5428 bytes) 2024-09-14T09:07:53.610 INFO:teuthology.orchestra.run.smithi148.stdout:364 punch from 0xbeec200 to 0xbef0c00, (0x4a00 bytes) 2024-09-14T09:07:53.610 INFO:teuthology.orchestra.run.smithi148.stdout:367 read 0x4e77a00 thru 0x4e7f9f3 (0x7ff4 bytes) 2024-09-14T09:07:53.610 INFO:teuthology.orchestra.run.smithi148.stdout:368 read 0x9366a00 thru 0x936dcc4 (0x72c5 bytes) 2024-09-14T09:07:53.610 INFO:teuthology.orchestra.run.smithi148.stdout:369 read 0x5de7200 thru 0x5de9ded (0x2bee bytes) 2024-09-14T09:07:53.611 INFO:teuthology.orchestra.run.smithi148.stdout:371 read 0xd85400 thru 0xd947f5 (0xf3f6 bytes) 2024-09-14T09:07:53.611 INFO:teuthology.orchestra.run.smithi148.stdout:372 write 0x36b6400 thru 0x36bcc88 (0x6889 bytes) 2024-09-14T09:07:53.611 INFO:teuthology.orchestra.run.smithi148.stdout:374 punch from 0x8387400 to 0x8393400, (0xc000 bytes) 2024-09-14T09:07:53.612 INFO:teuthology.orchestra.run.smithi148.stdout:376 write 0x453e600 thru 0x454844e (0x9e4f bytes) 2024-09-14T09:07:53.612 INFO:teuthology.orchestra.run.smithi148.stdout:377 write 0x540ca00 thru 0x5418b1a (0xc11b bytes) 2024-09-14T09:07:53.629 INFO:teuthology.orchestra.run.smithi148.stdout:380 trunc from 0xe8b5400 to 0x1b67400 2024-09-14T09:07:53.671 INFO:teuthology.orchestra.run.smithi148.stdout:385 punch from 0x65c800 to 0x65fc00, (0x3400 bytes) 2024-09-14T09:07:53.672 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:53.674+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:53.692 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:53.692 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:53.701 INFO:teuthology.orchestra.run.smithi148.stdout:386 write 0xe6e4600 thru 0xe6e531a (0xd1b bytes) 2024-09-14T09:07:53.702 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:07:53.702 INFO:teuthology.orchestra.run.smithi148.stdout:388 trunc from 0xe6e5400 to 0xd8cfe00 2024-09-14T09:07:53.719 INFO:teuthology.orchestra.run.smithi148.stdout:390 write 0x871b400 thru 0x871d54f (0x2150 bytes) 2024-09-14T09:07:53.736 INFO:teuthology.orchestra.run.smithi148.stdout:392 write 0xdfe5200 thru 0xdfe5a81 (0x882 bytes) 2024-09-14T09:07:53.736 INFO:teuthology.orchestra.run.smithi148.stdout:393 write 0xc752c00 thru 0xc75c8de (0x9cdf bytes) 2024-09-14T09:07:53.737 INFO:teuthology.orchestra.run.smithi148.stdout:395 read 0x2fd5200 thru 0x2fe3280 (0xe081 bytes) 2024-09-14T09:07:53.737 INFO:teuthology.orchestra.run.smithi148.stdout:401 read 0xb336600 thru 0xb344f74 (0xe975 bytes) 2024-09-14T09:07:53.737 INFO:teuthology.orchestra.run.smithi148.stdout:402 read 0x2691e00 thru 0x269b0d5 (0x92d6 bytes) 2024-09-14T09:07:53.737 INFO:teuthology.orchestra.run.smithi148.stdout:405 punch from 0xd820a00 to 0xd82a400, (0x9a00 bytes) 2024-09-14T09:07:53.737 INFO:teuthology.orchestra.run.smithi148.stdout:408 write 0xd65200 thru 0xd6db8b (0x898c bytes) 2024-09-14T09:07:53.738 INFO:teuthology.orchestra.run.smithi148.stdout:410 write 0x9e58800 thru 0x9e61367 (0x8b68 bytes) 2024-09-14T09:07:53.738 INFO:teuthology.orchestra.run.smithi148.stdout:411 write 0x9897c00 thru 0x98a6f81 (0xf382 bytes) 2024-09-14T09:07:53.739 INFO:teuthology.orchestra.run.smithi148.stdout:412 write 0x2b10a00 thru 0x2b15bf6 (0x51f7 bytes) 2024-09-14T09:07:53.739 INFO:teuthology.orchestra.run.smithi148.stdout:414 read 0xc8cb400 thru 0xc8d7f26 (0xcb27 bytes) 2024-09-14T09:07:53.739 INFO:teuthology.orchestra.run.smithi148.stdout:416 read 0x2e46200 thru 0x2e4a0aa (0x3eab bytes) 2024-09-14T09:07:53.740 INFO:teuthology.orchestra.run.smithi148.stdout:417 write 0x30b4e00 thru 0x30ba6e6 (0x58e7 bytes) 2024-09-14T09:07:53.740 INFO:teuthology.orchestra.run.smithi148.stdout:418 write 0x864f000 thru 0x865985d (0xa85e bytes) 2024-09-14T09:07:53.749 INFO:teuthology.orchestra.run.smithi148.stdout:419 trunc from 0xdfe5c00 to 0x6c7aa00 2024-09-14T09:07:53.773 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:53.775+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:53.799 INFO:teuthology.orchestra.run.smithi148.stdout:422 write 0xa99ea00 thru 0xa9a1ddf (0x33e0 bytes) 2024-09-14T09:07:53.827 INFO:teuthology.orchestra.run.smithi148.stdout:424 write 0xced4600 thru 0xced46a5 (0xa6 bytes) 2024-09-14T09:07:53.827 INFO:teuthology.orchestra.run.smithi148.stdout:425 punch from 0x6a19e00 to 0x6a22800, (0x8a00 bytes) 2024-09-14T09:07:53.828 INFO:teuthology.orchestra.run.smithi148.stdout:427 punch from 0x33c3200 to 0x33cfe00, (0xcc00 bytes) 2024-09-14T09:07:53.828 INFO:teuthology.orchestra.run.smithi148.stdout:429 punch from 0x4044c00 to 0x404ce00, (0x8200 bytes) 2024-09-14T09:07:53.828 INFO:teuthology.orchestra.run.smithi148.stdout:430 write 0x4828000 thru 0x482b5b9 (0x35ba bytes) 2024-09-14T09:07:53.829 INFO:teuthology.orchestra.run.smithi148.stdout:431 read 0x68aee00 thru 0x68b1cf8 (0x2ef9 bytes) 2024-09-14T09:07:53.832 INFO:teuthology.orchestra.run.smithi148.stdout:432 read 0x9804000 thru 0x9804f4c (0xf4d bytes) 2024-09-14T09:07:53.832 INFO:teuthology.orchestra.run.smithi148.stdout:433 read 0x692a200 thru 0x6930316 (0x6117 bytes) 2024-09-14T09:07:53.833 INFO:teuthology.orchestra.run.smithi148.stdout:434 write 0x4344800 thru 0x434aa44 (0x6245 bytes) 2024-09-14T09:07:53.833 INFO:teuthology.orchestra.run.smithi148.stdout:437 write 0xc78c800 thru 0xc790da1 (0x45a2 bytes) 2024-09-14T09:07:53.833 INFO:teuthology.orchestra.run.smithi148.stdout:438 write 0x9c1a800 thru 0x9c20b2a (0x632b bytes) 2024-09-14T09:07:53.836 INFO:teuthology.orchestra.run.smithi148.stdout:439 write 0x1271e00 thru 0x12746d1 (0x28d2 bytes) 2024-09-14T09:07:53.837 INFO:teuthology.orchestra.run.smithi148.stdout:440 write 0x68e9600 thru 0x68eeb9f (0x55a0 bytes) 2024-09-14T09:07:53.838 INFO:teuthology.orchestra.run.smithi148.stdout:442 write 0xa8d6800 thru 0xa8dd94d (0x714e bytes) 2024-09-14T09:07:53.838 INFO:teuthology.orchestra.run.smithi148.stdout:444 read 0xbfe1200 thru 0xbfef5f0 (0xe3f1 bytes) 2024-09-14T09:07:53.838 INFO:teuthology.orchestra.run.smithi148.stdout:445 read 0x968d200 thru 0x9695f9e (0x8d9f bytes) 2024-09-14T09:07:53.838 INFO:teuthology.orchestra.run.smithi148.stdout:446 read 0x404a00 thru 0x41176d (0xcd6e bytes) 2024-09-14T09:07:53.839 INFO:teuthology.orchestra.run.smithi148.stdout:447 read 0x8c5f800 thru 0x8c6038e (0xb8f bytes) 2024-09-14T09:07:53.846 INFO:teuthology.orchestra.run.smithi148.stdout:449 trunc from 0xced4800 to 0x6c5dc00 2024-09-14T09:07:53.859 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:53.859 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:53.869 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:07:53.874 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:53.876+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:53.880 INFO:teuthology.orchestra.run.smithi148.stdout:451 punch from 0x6689000 to 0x668a400, (0x1400 bytes) 2024-09-14T09:07:53.881 INFO:teuthology.orchestra.run.smithi148.stdout:453 write 0xcdf400 thru 0xcec175 (0xcd76 bytes) 2024-09-14T09:07:53.885 INFO:teuthology.orchestra.run.smithi148.stdout:454 punch from 0x100b000 to 0x101a200, (0xf200 bytes) 2024-09-14T09:07:53.891 INFO:teuthology.orchestra.run.smithi148.stdout:455 trunc from 0x6c5dc00 to 0x1cdc200 2024-09-14T09:07:53.927 INFO:teuthology.orchestra.run.smithi148.stdout:456 trunc from 0x1cdc200 to 0x48c9c00 2024-09-14T09:07:53.950 INFO:teuthology.orchestra.run.smithi148.stdout:457 write 0x7a9ea00 thru 0x7aa9487 (0xaa88 bytes) 2024-09-14T09:07:53.950 INFO:teuthology.orchestra.run.smithi148.stdout:462 read 0x7957800 thru 0x7957fb9 (0x7ba bytes) 2024-09-14T09:07:53.950 INFO:teuthology.orchestra.run.smithi148.stdout:463 write 0x2226600 thru 0x2233265 (0xcc66 bytes) 2024-09-14T09:07:53.951 INFO:teuthology.orchestra.run.smithi148.stdout:464 write 0x776b000 thru 0x776ccdd (0x1cde bytes) 2024-09-14T09:07:53.957 INFO:teuthology.orchestra.run.smithi148.stdout:465 trunc from 0x7aa9600 to 0xc5aa000 2024-09-14T09:07:53.975 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:53.977+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:07:53.976 INFO:teuthology.orchestra.run.smithi148.stdout:467 punch from 0x2a53c00 to 0x2a62400, (0xe800 bytes) 2024-09-14T09:07:53.976 INFO:teuthology.orchestra.run.smithi148.stdout:469 read 0x5345000 thru 0x534b49c (0x649d bytes) 2024-09-14T09:07:53.985 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:53.985 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:53.990 INFO:teuthology.orchestra.run.smithi148.stdout:470 trunc from 0xc5aa000 to 0x17f3000 2024-09-14T09:07:53.994 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:07:54.022 INFO:teuthology.orchestra.run.smithi148.stdout:473 write 0x1dd1000 thru 0x1dd5d19 (0x4d1a bytes) 2024-09-14T09:07:54.022 INFO:teuthology.orchestra.run.smithi148.stdout:474 read 0x96cc00 thru 0x970f6e (0x436f bytes) 2024-09-14T09:07:54.038 INFO:teuthology.orchestra.run.smithi148.stdout:475 trunc from 0x1dd5e00 to 0xe751000 2024-09-14T09:07:54.049 INFO:teuthology.orchestra.run.smithi148.stdout:480 punch from 0x8a29600 to 0x8a34000, (0xaa00 bytes) 2024-09-14T09:07:54.056 INFO:teuthology.orchestra.run.smithi148.stdout:481 write 0x354d200 thru 0x355a8dc (0xd6dd bytes) 2024-09-14T09:07:54.057 INFO:teuthology.orchestra.run.smithi148.stdout:483 write 0x7215600 thru 0x72244b7 (0xeeb8 bytes) 2024-09-14T09:07:54.057 INFO:teuthology.orchestra.run.smithi148.stdout:486 punch from 0x8b1e000 to 0x8b2a400, (0xc400 bytes) 2024-09-14T09:07:54.074 INFO:teuthology.orchestra.run.smithi148.stdout:487 trunc from 0xe751000 to 0x23a200 2024-09-14T09:07:54.078 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:54.080+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:07:54.128 INFO:teuthology.orchestra.run.smithi148.stdout:491 write 0x5d40800 thru 0x5d439c7 (0x31c8 bytes) 2024-09-14T09:07:54.129 INFO:teuthology.orchestra.run.smithi148.stdout:492 punch from 0x1ee3e00 to 0x1eefa00, (0xbc00 bytes) 2024-09-14T09:07:54.135 INFO:teuthology.orchestra.run.smithi148.stdout:495 trunc from 0x5d43a00 to 0xa48600 2024-09-14T09:07:54.148 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:54.148 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:54.158 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:07:54.169 INFO:teuthology.orchestra.run.smithi148.stdout:496 read 0x999c00 thru 0x99b686 (0x1a87 bytes) 2024-09-14T09:07:54.177 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:54.179+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:54.191 INFO:teuthology.orchestra.run.smithi148.stdout:498 write 0xc079e00 thru 0xc088e39 (0xf03a bytes) 2024-09-14T09:07:54.193 INFO:teuthology.orchestra.run.smithi148.stdout:500 read 0x9ac6a00 thru 0x9acf632 (0x8c33 bytes) 2024-09-14T09:07:54.193 INFO:teuthology.orchestra.run.smithi148.stdout:501 read 0x7f67000 thru 0x7f6d9e2 (0x69e3 bytes) 2024-09-14T09:07:54.193 INFO:teuthology.orchestra.run.smithi148.stdout:503 write 0x6902e00 thru 0x690f5d5 (0xc7d6 bytes) 2024-09-14T09:07:54.193 INFO:teuthology.orchestra.run.smithi148.stdout:504 write 0xa83ba00 thru 0xa8479cb (0xbfcc bytes) 2024-09-14T09:07:54.193 INFO:teuthology.orchestra.run.smithi148.stdout:505 read 0x91ec800 thru 0x91fb3e7 (0xebe8 bytes) 2024-09-14T09:07:54.193 INFO:teuthology.orchestra.run.smithi148.stdout:509 read 0x5190200 thru 0x5195a9f (0x58a0 bytes) 2024-09-14T09:07:54.211 INFO:teuthology.orchestra.run.smithi148.stdout:510 write 0xc2f1200 thru 0xc2fb1eb (0x9fec bytes) 2024-09-14T09:07:54.212 INFO:teuthology.orchestra.run.smithi148.stdout:511 write 0x8dfbc00 thru 0x8e042cb (0x86cc bytes) 2024-09-14T09:07:54.212 INFO:teuthology.orchestra.run.smithi148.stdout:515 write 0x1f4c400 thru 0x1f597f7 (0xd3f8 bytes) 2024-09-14T09:07:54.226 INFO:teuthology.orchestra.run.smithi148.stdout:516 write 0xc670800 thru 0xc67bbc4 (0xb3c5 bytes) 2024-09-14T09:07:54.228 INFO:teuthology.orchestra.run.smithi148.stdout:517 read 0xa560000 thru 0xa56495c (0x495d bytes) 2024-09-14T09:07:54.228 INFO:teuthology.orchestra.run.smithi148.stdout:518 write 0x6efaa00 thru 0x6f077bf (0xcdc0 bytes) 2024-09-14T09:07:54.228 INFO:teuthology.orchestra.run.smithi148.stdout:520 read 0xa202800 thru 0xa203a8b (0x128c bytes) 2024-09-14T09:07:54.228 INFO:teuthology.orchestra.run.smithi148.stdout:522 read 0x2fd6a00 thru 0x2fd849e (0x1a9f bytes) 2024-09-14T09:07:54.231 INFO:teuthology.orchestra.run.smithi148.stdout:523 trunc from 0xc67bc00 to 0xe831a00 2024-09-14T09:07:54.253 INFO:teuthology.orchestra.run.smithi148.stdout:524 read 0x3cbf200 thru 0x3cc296f (0x3770 bytes) 2024-09-14T09:07:54.254 INFO:teuthology.orchestra.run.smithi148.stdout:525 punch from 0x3b54600 to 0x3b54a00, (0x400 bytes) 2024-09-14T09:07:54.254 INFO:teuthology.orchestra.run.smithi148.stdout:526 punch from 0x945b600 to 0x9465a00, (0xa400 bytes) 2024-09-14T09:07:54.254 INFO:teuthology.orchestra.run.smithi148.stdout:527 write 0xc934000 thru 0xc93e546 (0xa547 bytes) 2024-09-14T09:07:54.254 INFO:teuthology.orchestra.run.smithi148.stdout:530 read 0xb20ce00 thru 0xb21c5c5 (0xf7c6 bytes) 2024-09-14T09:07:54.255 INFO:teuthology.orchestra.run.smithi148.stdout:531 write 0xd7db600 thru 0xd7e0156 (0x4b57 bytes) 2024-09-14T09:07:54.255 INFO:teuthology.orchestra.run.smithi148.stdout:533 read 0xa612e00 thru 0xa61acc2 (0x7ec3 bytes) 2024-09-14T09:07:54.255 INFO:teuthology.orchestra.run.smithi148.stdout:534 read 0xcda5e00 thru 0xcdaeb3f (0x8d40 bytes) 2024-09-14T09:07:54.255 INFO:teuthology.orchestra.run.smithi148.stdout:535 punch from 0x281a600 to 0x2828a00, (0xe400 bytes) 2024-09-14T09:07:54.256 INFO:teuthology.orchestra.run.smithi148.stdout:537 punch from 0x2ed6400 to 0x2ee2c00, (0xc800 bytes) 2024-09-14T09:07:54.256 INFO:teuthology.orchestra.run.smithi148.stdout:538 write 0xadcfc00 thru 0xadd36f4 (0x3af5 bytes) 2024-09-14T09:07:54.256 INFO:teuthology.orchestra.run.smithi148.stdout:539 read 0xabdb800 thru 0xabea894 (0xf095 bytes) 2024-09-14T09:07:54.257 INFO:teuthology.orchestra.run.smithi148.stdout:540 read 0x5a93000 thru 0x5a9d455 (0xa456 bytes) 2024-09-14T09:07:54.273 INFO:teuthology.orchestra.run.smithi148.stdout:541 trunc from 0xe831a00 to 0x1756400 2024-09-14T09:07:54.278 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:54.280+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:54.308 INFO:teuthology.orchestra.run.smithi148.stdout:545 read 0xc1c200 thru 0xc1da3d (0x183e bytes) 2024-09-14T09:07:54.312 INFO:teuthology.orchestra.run.smithi148.stdout:546 trunc from 0x1756400 to 0x52c5800 2024-09-14T09:07:54.321 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:54.321 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:54.331 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:07:54.343 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:07:54.346 INFO:teuthology.orchestra.run.smithi148.stdout:547 write 0xbc89800 thru 0xbc90434 (0x6c35 bytes) 2024-09-14T09:07:54.348 INFO:teuthology.orchestra.run.smithi148.stdout:548 punch from 0xa4a6800 to 0xa4af800, (0x9000 bytes) 2024-09-14T09:07:54.349 INFO:teuthology.orchestra.run.smithi148.stdout:549 trunc from 0xbc90600 to 0xc0d8400 2024-09-14T09:07:54.364 INFO:teuthology.orchestra.run.smithi148.stdout:551 trunc from 0xc0d8400 to 0xb5ec400 2024-09-14T09:07:54.377 INFO:teuthology.orchestra.run.smithi148.stdout:552 read 0x4ca8c00 thru 0x4caf517 (0x6918 bytes) 2024-09-14T09:07:54.379 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:54.381+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:54.381 INFO:teuthology.orchestra.run.smithi148.stdout:553 punch from 0x4d71c00 to 0x4d7de00, (0xc200 bytes) 2024-09-14T09:07:54.383 INFO:teuthology.orchestra.run.smithi148.stdout:554 trunc from 0xb5ec400 to 0x9b29a00 2024-09-14T09:07:54.399 INFO:teuthology.orchestra.run.smithi148.stdout:556 read 0x1f63c00 thru 0x1f6ae5f (0x7260 bytes) 2024-09-14T09:07:54.400 INFO:teuthology.orchestra.run.smithi148.stdout:557 write 0x6fdee00 thru 0x6fedec0 (0xf0c1 bytes) 2024-09-14T09:07:54.400 INFO:teuthology.orchestra.run.smithi148.stdout:559 write 0x3481400 thru 0x348c693 (0xb294 bytes) 2024-09-14T09:07:54.401 INFO:teuthology.orchestra.run.smithi148.stdout:561 write 0x10fb200 thru 0x1100c1b (0x5a1c bytes) 2024-09-14T09:07:54.402 INFO:teuthology.orchestra.run.smithi148.stdout:562 punch from 0x28e600 to 0x29a000, (0xba00 bytes) 2024-09-14T09:07:54.405 INFO:teuthology.orchestra.run.smithi148.stdout:563 trunc from 0x9b29a00 to 0xc464a00 2024-09-14T09:07:54.416 INFO:teuthology.orchestra.run.smithi148.stdout:564 read 0x29e6e00 thru 0x29f54d1 (0xe6d2 bytes) 2024-09-14T09:07:54.417 INFO:teuthology.orchestra.run.smithi148.stdout:565 punch from 0x1eba00 to 0x1f0400, (0x4a00 bytes) 2024-09-14T09:07:54.417 INFO:teuthology.orchestra.run.smithi148.stdout:566 read 0x2df0200 thru 0x2df0d7d (0xb7e bytes) 2024-09-14T09:07:54.417 INFO:teuthology.orchestra.run.smithi148.stdout:568 read 0x1a41000 thru 0x1a4756a (0x656b bytes) 2024-09-14T09:07:54.425 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T09:07:54.425 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:07:54.425 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-09-14T09:07:54.425 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T09:07:54.425 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T09:07:54.426 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2024-09-14T09:07:54.427 INFO:teuthology.orchestra.run.smithi148.stdout:570 trunc from 0xc464a00 to 0x596e600 2024-09-14T09:07:54.441 INFO:teuthology.orchestra.run.smithi148.stdout:571 trunc from 0x596e600 to 0x6736600 2024-09-14T09:07:54.451 INFO:teuthology.orchestra.run.smithi148.stdout:573 read 0x58ace00 thru 0x58ba81e (0xda1f bytes) 2024-09-14T09:07:54.452 INFO:teuthology.orchestra.run.smithi148.stdout:574 read 0x45bca00 thru 0x45bd157 (0x758 bytes) 2024-09-14T09:07:54.453 INFO:teuthology.orchestra.run.smithi148.stdout:576 read 0x3dd6600 thru 0x3ddfe2b (0x982c bytes) 2024-09-14T09:07:54.468 INFO:teuthology.orchestra.run.smithi148.stdout:577 write 0x8dca600 thru 0x8dd54ab (0xaeac bytes) 2024-09-14T09:07:54.469 INFO:teuthology.orchestra.run.smithi148.stdout:578 punch from 0x429da00 to 0x42abe00, (0xe400 bytes) 2024-09-14T09:07:54.469 INFO:teuthology.orchestra.run.smithi148.stdout:579 punch from 0x13cc600 to 0x13ce000, (0x1a00 bytes) 2024-09-14T09:07:54.469 INFO:teuthology.orchestra.run.smithi148.stdout:580 clone 4 order 22 su 1048576 sc 14 2024-09-14T09:07:54.480 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:54.482+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:54.493 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:54.493 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:54.502 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:07:54.509 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:07:54.509 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:07:54.526 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:07:54.526 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:07:54.531 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-14T09:07:54.531 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:54.542 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:07:54.543 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:07:54.559 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:07:54.559 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:07:54.576 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:07:54.576 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:07:54.581 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:54.583+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:54.593 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:07:54.593 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:07:54.608 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:54.608 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:07:54.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:07:54.609 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:07:54.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.609 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4217.0:1 2.3 e18/17 2:c4c92e5a:::rbd_trash:head v 18'1, mlcod=0'0)", 2024-09-14T09:07:54.609 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:35.254531+0000", 2024-09-14T09:07:54.609 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 19.355087126000001, 2024-09-14T09:07:54.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034687910000000001, 2024-09-14T09:07:54.609 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:54.609 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:54.609 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:54.610 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:54.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:54.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254531+0000", 2024-09-14T09:07:54.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:54.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254531+0000", 2024-09-14T09:07:54.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:54.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254531+0000", 2024-09-14T09:07:54.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3300000000000001e-07 2024-09-14T09:07:54.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:54.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254536+0000", 2024-09-14T09:07:54.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3069999999999996e-06 2024-09-14T09:07:54.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:54.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254546+0000", 2024-09-14T09:07:54.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8309999999999996e-06 2024-09-14T09:07:54.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:54.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254558+0000", 2024-09-14T09:07:54.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2162e-05 2024-09-14T09:07:54.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:54.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254611+0000", 2024-09-14T09:07:54.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3409000000000003e-05 2024-09-14T09:07:54.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:54.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254635+0000", 2024-09-14T09:07:54.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4297000000000001e-05 2024-09-14T09:07:54.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:54.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.257943+0000", 2024-09-14T09:07:54.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033075190000000001 2024-09-14T09:07:54.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:54.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.258000+0000", 2024-09-14T09:07:54.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7033000000000001e-05 2024-09-14T09:07:54.613 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.614 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:54.614 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.614 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4471.0:484 3.14 e27/22 3:2ea9bd49:::rbd_header.1112b98aa287:head v 27'27, mlcod=26'25)", 2024-09-14T09:07:54.614 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.311065+0000", 2024-09-14T09:07:54.614 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.2985533839999999, 2024-09-14T09:07:54.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00075233799999999997, 2024-09-14T09:07:54.614 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:54.614 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:54.614 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:54.614 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:54.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:54.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.311065+0000", 2024-09-14T09:07:54.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:54.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.311065+0000", 2024-09-14T09:07:54.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:54.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.311065+0000", 2024-09-14T09:07:54.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:07:54.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:54.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.311069+0000", 2024-09-14T09:07:54.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1960000000000001e-06 2024-09-14T09:07:54.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:54.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.311084+0000", 2024-09-14T09:07:54.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4577e-05 2024-09-14T09:07:54.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:54.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.311094+0000", 2024-09-14T09:07:54.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008e-05 2024-09-14T09:07:54.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:54.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.311165+0000", 2024-09-14T09:07:54.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1524000000000002e-05 2024-09-14T09:07:54.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:54.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.311190+0000", 2024-09-14T09:07:54.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4488e-05 2024-09-14T09:07:54.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:54.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.311782+0000", 2024-09-14T09:07:54.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00059250800000000005 2024-09-14T09:07:54.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:54.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.311817+0000", 2024-09-14T09:07:54.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4827999999999999e-05 2024-09-14T09:07:54.618 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.618 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:54.618 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.618 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:310 3.11 3:8fc2352d:::rbd_header.111213dcc65d:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:54.618 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.553523+0000", 2024-09-14T09:07:54.618 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.056095172, 2024-09-14T09:07:54.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0011277240000000001, 2024-09-14T09:07:54.619 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:54.619 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:54.619 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:54.619 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:54.619 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:07:54.619 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:54.619 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 310 2024-09-14T09:07:54.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.619 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:54.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:54.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.553523+0000", 2024-09-14T09:07:54.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:54.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.553523+0000", 2024-09-14T09:07:54.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:54.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.553524+0000", 2024-09-14T09:07:54.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0800000000000004e-07 2024-09-14T09:07:54.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:54.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.553529+0000", 2024-09-14T09:07:54.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0089999999999998e-06 2024-09-14T09:07:54.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:54.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.553540+0000", 2024-09-14T09:07:54.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1182999999999999e-05 2024-09-14T09:07:54.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:54.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.553546+0000", 2024-09-14T09:07:54.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3680000000000001e-06 2024-09-14T09:07:54.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:54.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.553589+0000", 2024-09-14T09:07:54.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3618999999999997e-05 2024-09-14T09:07:54.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:54.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.553679+0000", 2024-09-14T09:07:54.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9438999999999995e-05 2024-09-14T09:07:54.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:07:54.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.553811+0000", 2024-09-14T09:07:54.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000132096 2024-09-14T09:07:54.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:54.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.554371+0000", 2024-09-14T09:07:54.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00056052499999999998 2024-09-14T09:07:54.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:54.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.554595+0000", 2024-09-14T09:07:54.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022341 2024-09-14T09:07:54.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:54.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.554626+0000", 2024-09-14T09:07:54.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0997999999999997e-05 2024-09-14T09:07:54.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:54.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.554651+0000", 2024-09-14T09:07:54.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5269000000000002e-05 2024-09-14T09:07:54.624 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.624 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:54.624 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.624 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:311 3.11 3:8fc2352d:::rbd_header.111213dcc65d:head [call rbd.set_stripe_unit_count in=24b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:54.624 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.555002+0000", 2024-09-14T09:07:54.624 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.0546166159999997, 2024-09-14T09:07:54.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0010705790000000001, 2024-09-14T09:07:54.624 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:54.624 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:54.625 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:54.625 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:54.625 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:07:54.625 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:54.625 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 311 2024-09-14T09:07:54.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.625 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:54.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:54.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.555002+0000", 2024-09-14T09:07:54.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:54.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.555002+0000", 2024-09-14T09:07:54.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:54.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.555002+0000", 2024-09-14T09:07:54.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2399999999999997e-07 2024-09-14T09:07:54.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:54.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.555006+0000", 2024-09-14T09:07:54.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5769999999999998e-06 2024-09-14T09:07:54.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:54.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.555015+0000", 2024-09-14T09:07:54.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1589999999999999e-06 2024-09-14T09:07:54.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:54.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.555020+0000", 2024-09-14T09:07:54.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8709999999999996e-06 2024-09-14T09:07:54.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:54.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.555061+0000", 2024-09-14T09:07:54.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0692999999999998e-05 2024-09-14T09:07:54.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:54.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.555109+0000", 2024-09-14T09:07:54.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8726000000000001e-05 2024-09-14T09:07:54.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:07:54.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.555256+0000", 2024-09-14T09:07:54.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014630099999999999 2024-09-14T09:07:54.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:54.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.555667+0000", 2024-09-14T09:07:54.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00041115999999999999 2024-09-14T09:07:54.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:54.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.555990+0000", 2024-09-14T09:07:54.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032286800000000003 2024-09-14T09:07:54.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:54.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.556020+0000", 2024-09-14T09:07:54.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0298999999999999e-05 2024-09-14T09:07:54.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:54.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.556072+0000", 2024-09-14T09:07:54.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2200999999999997e-05 2024-09-14T09:07:54.629 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.630 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:54.630 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.630 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:325 3.11 3:8fc2352d:::rbd_header.111213dcc65d:head [watch watch cookie 140027946848592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:54.630 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.566681+0000", 2024-09-14T09:07:54.630 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.0429368840000004, 2024-09-14T09:07:54.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00095963799999999996, 2024-09-14T09:07:54.630 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:54.630 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:54.630 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:54.630 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:54.630 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:07:54.630 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:54.631 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 325 2024-09-14T09:07:54.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.631 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:54.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:54.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.566681+0000", 2024-09-14T09:07:54.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:54.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.566681+0000", 2024-09-14T09:07:54.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:54.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.566682+0000", 2024-09-14T09:07:54.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3300000000000002e-07 2024-09-14T09:07:54.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:54.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.566685+0000", 2024-09-14T09:07:54.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7980000000000001e-06 2024-09-14T09:07:54.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:54.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.566694+0000", 2024-09-14T09:07:54.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8929999999999994e-06 2024-09-14T09:07:54.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:54.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.566698+0000", 2024-09-14T09:07:54.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3950000000000003e-06 2024-09-14T09:07:54.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:54.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.566751+0000", 2024-09-14T09:07:54.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3022999999999997e-05 2024-09-14T09:07:54.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:54.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.566794+0000", 2024-09-14T09:07:54.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2617999999999998e-05 2024-09-14T09:07:54.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:07:54.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.566882+0000", 2024-09-14T09:07:54.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8369999999999996e-05 2024-09-14T09:07:54.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:54.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.567334+0000", 2024-09-14T09:07:54.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000452294 2024-09-14T09:07:54.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:54.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.567538+0000", 2024-09-14T09:07:54.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000203346 2024-09-14T09:07:54.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:54.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.567567+0000", 2024-09-14T09:07:54.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9689999999999999e-05 2024-09-14T09:07:54.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:54.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.567641+0000", 2024-09-14T09:07:54.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3677999999999995e-05 2024-09-14T09:07:54.636 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.636 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:54.636 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.637 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:326 3.11 3:8fc2352d:::rbd_header.111213dcc65d:head [call rbd.parent_attach in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:54.637 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.567959+0000", 2024-09-14T09:07:54.637 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.0416597330000004, 2024-09-14T09:07:54.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0010166280000000001, 2024-09-14T09:07:54.637 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:54.637 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:54.637 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:54.637 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:54.637 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:07:54.637 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:54.637 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 326 2024-09-14T09:07:54.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.637 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:54.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:54.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.567959+0000", 2024-09-14T09:07:54.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:54.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.567959+0000", 2024-09-14T09:07:54.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:54.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.567959+0000", 2024-09-14T09:07:54.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6300000000000005e-07 2024-09-14T09:07:54.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:54.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.567969+0000", 2024-09-14T09:07:54.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4369999999999996e-06 2024-09-14T09:07:54.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:54.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.567977+0000", 2024-09-14T09:07:54.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3469999999999999e-06 2024-09-14T09:07:54.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:54.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.567982+0000", 2024-09-14T09:07:54.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4160000000000003e-06 2024-09-14T09:07:54.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:54.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.568018+0000", 2024-09-14T09:07:54.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5524000000000001e-05 2024-09-14T09:07:54.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:54.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.568070+0000", 2024-09-14T09:07:54.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2204999999999999e-05 2024-09-14T09:07:54.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:07:54.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.568224+0000", 2024-09-14T09:07:54.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015339100000000001 2024-09-14T09:07:54.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:54.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.568722+0000", 2024-09-14T09:07:54.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00049864500000000003 2024-09-14T09:07:54.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:54.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.568898+0000", 2024-09-14T09:07:54.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017573999999999999 2024-09-14T09:07:54.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:54.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.568928+0000", 2024-09-14T09:07:54.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0158000000000002e-05 2024-09-14T09:07:54.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:54.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.568975+0000", 2024-09-14T09:07:54.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7101999999999997e-05 2024-09-14T09:07:54.643 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.643 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:54.643 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.643 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:335 3.11 3:8fc2352d:::rbd_header.111213dcc65d:head [watch unwatch cookie 140027946848592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:54.643 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.575027+0000", 2024-09-14T09:07:54.643 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.0345912779999997, 2024-09-14T09:07:54.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00088517000000000001, 2024-09-14T09:07:54.643 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:54.643 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:54.643 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:54.644 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:54.644 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:07:54.644 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:54.644 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 335 2024-09-14T09:07:54.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.644 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:54.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:54.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575027+0000", 2024-09-14T09:07:54.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:54.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575027+0000", 2024-09-14T09:07:54.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:54.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575028+0000", 2024-09-14T09:07:54.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5199999999999996e-07 2024-09-14T09:07:54.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:54.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575031+0000", 2024-09-14T09:07:54.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.49e-06 2024-09-14T09:07:54.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:54.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575042+0000", 2024-09-14T09:07:54.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0747999999999999e-05 2024-09-14T09:07:54.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:54.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575047+0000", 2024-09-14T09:07:54.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1259999999999997e-06 2024-09-14T09:07:54.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:54.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575087+0000", 2024-09-14T09:07:54.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9895999999999999e-05 2024-09-14T09:07:54.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:54.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575132+0000", 2024-09-14T09:07:54.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4746999999999997e-05 2024-09-14T09:07:54.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:07:54.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575212+0000", 2024-09-14T09:07:54.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0220000000000001e-05 2024-09-14T09:07:54.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:54.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575627+0000", 2024-09-14T09:07:54.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000415361 2024-09-14T09:07:54.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:54.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575815+0000", 2024-09-14T09:07:54.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018783299999999999 2024-09-14T09:07:54.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:54.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575844+0000", 2024-09-14T09:07:54.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8755000000000002e-05 2024-09-14T09:07:54.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:54.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.575912+0000", 2024-09-14T09:07:54.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8242000000000002e-05 2024-09-14T09:07:54.649 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.649 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:54.649 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.649 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4471.0:515 3.5 3:a19fd784:::rbd_data.1112b98aa287.0000000000000000:head [stat,delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:54.649 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.584013+0000", 2024-09-14T09:07:54.649 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.025605519, 2024-09-14T09:07:54.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014758550000000001, 2024-09-14T09:07:54.649 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:54.649 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:54.649 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:54.649 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:54.649 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4471", 2024-09-14T09:07:54.650 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2207718190", 2024-09-14T09:07:54.650 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 515 2024-09-14T09:07:54.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.650 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:54.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:54.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.584013+0000", 2024-09-14T09:07:54.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:54.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.584013+0000", 2024-09-14T09:07:54.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:54.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.584014+0000", 2024-09-14T09:07:54.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1200000000000002e-07 2024-09-14T09:07:54.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:54.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.584018+0000", 2024-09-14T09:07:54.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.963e-06 2024-09-14T09:07:54.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:54.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.584028+0000", 2024-09-14T09:07:54.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0266e-05 2024-09-14T09:07:54.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:54.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.584034+0000", 2024-09-14T09:07:54.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1820000000000003e-06 2024-09-14T09:07:54.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:54.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.584078+0000", 2024-09-14T09:07:54.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4119000000000002e-05 2024-09-14T09:07:54.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:54.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.584129+0000", 2024-09-14T09:07:54.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0331999999999999e-05 2024-09-14T09:07:54.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 3", 2024-09-14T09:07:54.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.584241+0000", 2024-09-14T09:07:54.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000112145 2024-09-14T09:07:54.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:54.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.585296+0000", 2024-09-14T09:07:54.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001055828 2024-09-14T09:07:54.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:54.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.585419+0000", 2024-09-14T09:07:54.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000122738 2024-09-14T09:07:54.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:54.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.585450+0000", 2024-09-14T09:07:54.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0987e-05 2024-09-14T09:07:54.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:54.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.585489+0000", 2024-09-14T09:07:54.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8482999999999997e-05 2024-09-14T09:07:54.654 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.654 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:54.655 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.655 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4471.0:519 3.0 e27/22 3:0315249f:::rbd_data.1112b98aa287.0000000000000002:head v 27'8, mlcod=26'5)", 2024-09-14T09:07:54.655 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.587743+0000", 2024-09-14T09:07:54.655 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.0218752499999999, 2024-09-14T09:07:54.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00086833899999999998, 2024-09-14T09:07:54.655 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:54.655 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:54.655 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:54.655 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:54.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:54.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.587743+0000", 2024-09-14T09:07:54.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:54.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.587743+0000", 2024-09-14T09:07:54.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:54.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.587744+0000", 2024-09-14T09:07:54.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6700000000000003e-07 2024-09-14T09:07:54.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:54.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.587750+0000", 2024-09-14T09:07:54.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7660000000000004e-06 2024-09-14T09:07:54.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:54.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.587759+0000", 2024-09-14T09:07:54.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0690000000000008e-06 2024-09-14T09:07:54.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:54.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.587764+0000", 2024-09-14T09:07:54.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0270000000000003e-06 2024-09-14T09:07:54.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:54.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.587803+0000", 2024-09-14T09:07:54.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8810000000000003e-05 2024-09-14T09:07:54.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:54.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.587817+0000", 2024-09-14T09:07:54.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4207e-05 2024-09-14T09:07:54.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:54.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.588583+0000", 2024-09-14T09:07:54.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00076607300000000004 2024-09-14T09:07:54.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:54.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.588611+0000", 2024-09-14T09:07:54.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.862e-05 2024-09-14T09:07:54.659 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.659 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:54.659 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.660 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4471.0:520 3.1 e27/22 3:83bc1d50:::rbd_data.1112b98aa287.0000000000000003:head v 27'11, mlcod=26'8)", 2024-09-14T09:07:54.660 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.589509+0000", 2024-09-14T09:07:54.660 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.0201092940000001, 2024-09-14T09:07:54.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00078836399999999995, 2024-09-14T09:07:54.660 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:54.660 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:54.660 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:54.660 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:54.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:54.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.589509+0000", 2024-09-14T09:07:54.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:54.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.589509+0000", 2024-09-14T09:07:54.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:54.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.589510+0000", 2024-09-14T09:07:54.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.99e-07 2024-09-14T09:07:54.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:54.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.589514+0000", 2024-09-14T09:07:54.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.707e-06 2024-09-14T09:07:54.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:54.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.589524+0000", 2024-09-14T09:07:54.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6539999999999994e-06 2024-09-14T09:07:54.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:54.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.589529+0000", 2024-09-14T09:07:54.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5480000000000003e-06 2024-09-14T09:07:54.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:54.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.589577+0000", 2024-09-14T09:07:54.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8251999999999998e-05 2024-09-14T09:07:54.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:54.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.589590+0000", 2024-09-14T09:07:54.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2995e-05 2024-09-14T09:07:54.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:54.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.590271+0000", 2024-09-14T09:07:54.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00068099299999999996 2024-09-14T09:07:54.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:54.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.590297+0000", 2024-09-14T09:07:54.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6516000000000002e-05 2024-09-14T09:07:54.664 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.664 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:54.664 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.665 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:398 3.11 3:8fc2352d:::rbd_header.111213dcc65d:head [watch watch cookie 140027947117712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:54.665 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.669192+0000", 2024-09-14T09:07:54.665 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.9404259349999999, 2024-09-14T09:07:54.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0010400100000000001, 2024-09-14T09:07:54.665 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:54.665 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:54.665 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:54.665 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:54.665 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:07:54.665 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:54.665 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 398 2024-09-14T09:07:54.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.665 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:54.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:54.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.669192+0000", 2024-09-14T09:07:54.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:54.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.669192+0000", 2024-09-14T09:07:54.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:54.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.669193+0000", 2024-09-14T09:07:54.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5600000000000005e-07 2024-09-14T09:07:54.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:54.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.669197+0000", 2024-09-14T09:07:54.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5049999999999999e-06 2024-09-14T09:07:54.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:54.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.669207+0000", 2024-09-14T09:07:54.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0530000000000001e-05 2024-09-14T09:07:54.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:54.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.669212+0000", 2024-09-14T09:07:54.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2349999999999999e-06 2024-09-14T09:07:54.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:54.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.669255+0000", 2024-09-14T09:07:54.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2132999999999998e-05 2024-09-14T09:07:54.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:54.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.669296+0000", 2024-09-14T09:07:54.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1527999999999999e-05 2024-09-14T09:07:54.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:07:54.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.669396+0000", 2024-09-14T09:07:54.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010016199999999999 2024-09-14T09:07:54.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:54.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.669927+0000", 2024-09-14T09:07:54.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000530242 2024-09-14T09:07:54.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:54.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.670162+0000", 2024-09-14T09:07:54.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023523700000000001 2024-09-14T09:07:54.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:54.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.670191+0000", 2024-09-14T09:07:54.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9573e-05 2024-09-14T09:07:54.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:54.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.670232+0000", 2024-09-14T09:07:54.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1109000000000002e-05 2024-09-14T09:07:54.670 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.670 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:54.670 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.671 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4421.0:38 3.11 3:8fc2352d:::rbd_header.111213dcc65d:head [watch watch cookie 140696283930128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:54.671 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:50.735675+0000", 2024-09-14T09:07:54.671 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.8739431930000001, 2024-09-14T09:07:54.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001234144, 2024-09-14T09:07:54.671 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:54.671 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:54.671 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:54.671 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:54.671 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4421", 2024-09-14T09:07:54.671 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:54.671 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 38 2024-09-14T09:07:54.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.671 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:54.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:54.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.735675+0000", 2024-09-14T09:07:54.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:54.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.735675+0000", 2024-09-14T09:07:54.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:54.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.735676+0000", 2024-09-14T09:07:54.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5600000000000005e-07 2024-09-14T09:07:54.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:54.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.735679+0000", 2024-09-14T09:07:54.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7750000000000001e-06 2024-09-14T09:07:54.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:54.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.735686+0000", 2024-09-14T09:07:54.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6669999999999996e-06 2024-09-14T09:07:54.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:54.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.735691+0000", 2024-09-14T09:07:54.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3510000000000004e-06 2024-09-14T09:07:54.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:54.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.735744+0000", 2024-09-14T09:07:54.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2991999999999997e-05 2024-09-14T09:07:54.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:54.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.735823+0000", 2024-09-14T09:07:54.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9618999999999998e-05 2024-09-14T09:07:54.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:07:54.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.735997+0000", 2024-09-14T09:07:54.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017378599999999999 2024-09-14T09:07:54.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:54.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.736581+0000", 2024-09-14T09:07:54.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058447800000000004 2024-09-14T09:07:54.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:54.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.736786+0000", 2024-09-14T09:07:54.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000204231 2024-09-14T09:07:54.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:54.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.736840+0000", 2024-09-14T09:07:54.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4057000000000001e-05 2024-09-14T09:07:54.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:54.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:50.736909+0000", 2024-09-14T09:07:54.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9531999999999998e-05 2024-09-14T09:07:54.676 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.676 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:54.676 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.677 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4495.0:1746 3.1d 3:be749ce4:::rbd_data.11128b09dac5.0000000000000031:head [read 2269184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:54.677 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:51.151826+0000", 2024-09-14T09:07:54.677 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.4577926059999999, 2024-09-14T09:07:54.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00076418500000000002, 2024-09-14T09:07:54.677 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:54.677 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:54.677 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:54.677 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:54.677 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4495", 2024-09-14T09:07:54.678 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1400929400", 2024-09-14T09:07:54.678 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1746 2024-09-14T09:07:54.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.678 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:54.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:54.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151826+0000", 2024-09-14T09:07:54.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:54.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151826+0000", 2024-09-14T09:07:54.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:54.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151826+0000", 2024-09-14T09:07:54.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6300000000000001e-07 2024-09-14T09:07:54.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:54.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151828+0000", 2024-09-14T09:07:54.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4079999999999999e-06 2024-09-14T09:07:54.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:54.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151833+0000", 2024-09-14T09:07:54.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0810000000000001e-06 2024-09-14T09:07:54.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:54.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151836+0000", 2024-09-14T09:07:54.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1439999999999999e-06 2024-09-14T09:07:54.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:54.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.152393+0000", 2024-09-14T09:07:54.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00055680599999999997 2024-09-14T09:07:54.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:54.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.152468+0000", 2024-09-14T09:07:54.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5284999999999995e-05 2024-09-14T09:07:54.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:54.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.152590+0000", 2024-09-14T09:07:54.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012209800000000001 2024-09-14T09:07:54.681 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.682 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:54.682 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.682 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4495.0:1747 3.1d 3:be749ce4:::rbd_data.11128b09dac5.0000000000000031:head [sparse-read 2289664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:54.682 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:51.151842+0000", 2024-09-14T09:07:54.682 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.4577760500000001, 2024-09-14T09:07:54.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00093362499999999999, 2024-09-14T09:07:54.682 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:54.682 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:54.682 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:54.682 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:54.682 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4495", 2024-09-14T09:07:54.682 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1400929400", 2024-09-14T09:07:54.683 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1747 2024-09-14T09:07:54.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.683 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:54.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:54.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151842+0000", 2024-09-14T09:07:54.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:54.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151842+0000", 2024-09-14T09:07:54.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:54.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151843+0000", 2024-09-14T09:07:54.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8000000000000002e-07 2024-09-14T09:07:54.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:54.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151844+0000", 2024-09-14T09:07:54.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.06e-06 2024-09-14T09:07:54.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:54.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151847+0000", 2024-09-14T09:07:54.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1580000000000001e-06 2024-09-14T09:07:54.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:54.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.151850+0000", 2024-09-14T09:07:54.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6989999999999999e-06 2024-09-14T09:07:54.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:54.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.152616+0000", 2024-09-14T09:07:54.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00076697099999999997 2024-09-14T09:07:54.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:54.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.152685+0000", 2024-09-14T09:07:54.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8449999999999997e-05 2024-09-14T09:07:54.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:54.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.152776+0000", 2024-09-14T09:07:54.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1007000000000005e-05 2024-09-14T09:07:54.687 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.687 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:54.687 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.688 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4495.0:1751 3.1d 3:be749ce4:::rbd_data.11128b09dac5.0000000000000031:head [read 2453504~36864] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:54.688 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:51.153015+0000", 2024-09-14T09:07:54.688 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.4566031530000001, 2024-09-14T09:07:54.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084288899999999999, 2024-09-14T09:07:54.688 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:54.688 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:54.688 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:54.688 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:54.688 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4495", 2024-09-14T09:07:54.688 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1400929400", 2024-09-14T09:07:54.688 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1751 2024-09-14T09:07:54.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.689 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:54.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:54.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.153015+0000", 2024-09-14T09:07:54.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:54.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.153015+0000", 2024-09-14T09:07:54.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:54.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.153016+0000", 2024-09-14T09:07:54.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.22e-07 2024-09-14T09:07:54.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:54.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.153017+0000", 2024-09-14T09:07:54.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.127e-06 2024-09-14T09:07:54.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:54.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.153020+0000", 2024-09-14T09:07:54.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.343e-06 2024-09-14T09:07:54.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:54.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.153023+0000", 2024-09-14T09:07:54.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5440000000000001e-06 2024-09-14T09:07:54.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:54.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.153651+0000", 2024-09-14T09:07:54.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000628394 2024-09-14T09:07:54.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:54.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.153728+0000", 2024-09-14T09:07:54.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6688999999999997e-05 2024-09-14T09:07:54.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:54.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.153858+0000", 2024-09-14T09:07:54.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013046999999999999 2024-09-14T09:07:54.692 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.692 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:54.693 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.693 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4421.0:135 3.11 3:8fc2352d:::rbd_header.111213dcc65d:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:54.693 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:51.317500+0000", 2024-09-14T09:07:54.693 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.2921183460000001, 2024-09-14T09:07:54.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00117657, 2024-09-14T09:07:54.693 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:54.693 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:54.693 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:54.693 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:54.693 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4421", 2024-09-14T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 135 2024-09-14T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.317500+0000", 2024-09-14T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.317500+0000", 2024-09-14T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:54.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.317501+0000", 2024-09-14T09:07:54.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9299999999999998e-07 2024-09-14T09:07:54.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:54.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.317504+0000", 2024-09-14T09:07:54.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.286e-06 2024-09-14T09:07:54.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:54.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.317512+0000", 2024-09-14T09:07:54.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8909999999999995e-06 2024-09-14T09:07:54.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:54.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.317516+0000", 2024-09-14T09:07:54.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.493e-06 2024-09-14T09:07:54.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:54.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.317558+0000", 2024-09-14T09:07:54.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1257000000000002e-05 2024-09-14T09:07:54.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:54.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.317631+0000", 2024-09-14T09:07:54.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3125000000000002e-05 2024-09-14T09:07:54.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:07:54.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.317834+0000", 2024-09-14T09:07:54.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000203439 2024-09-14T09:07:54.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:54.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.318464+0000", 2024-09-14T09:07:54.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062964100000000001 2024-09-14T09:07:54.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:54.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.318589+0000", 2024-09-14T09:07:54.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000124819 2024-09-14T09:07:54.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:54.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.318639+0000", 2024-09-14T09:07:54.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0090999999999999e-05 2024-09-14T09:07:54.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:54.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.318677+0000", 2024-09-14T09:07:54.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7935000000000002e-05 2024-09-14T09:07:54.699 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.699 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:54.699 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.699 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:415 3.11 3:8fc2352d:::rbd_header.111213dcc65d:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:54.699 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:51.321759+0000", 2024-09-14T09:07:54.699 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.2878588679999998, 2024-09-14T09:07:54.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00090808100000000004, 2024-09-14T09:07:54.699 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:54.699 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:54.699 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:54.700 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:54.700 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:07:54.700 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:54.700 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 415 2024-09-14T09:07:54.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.700 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:54.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:54.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.321759+0000", 2024-09-14T09:07:54.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:54.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.321759+0000", 2024-09-14T09:07:54.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:54.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.321760+0000", 2024-09-14T09:07:54.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7199999999999999e-07 2024-09-14T09:07:54.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:54.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.321762+0000", 2024-09-14T09:07:54.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.379e-06 2024-09-14T09:07:54.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:54.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.321768+0000", 2024-09-14T09:07:54.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3299999999999998e-06 2024-09-14T09:07:54.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:54.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.321771+0000", 2024-09-14T09:07:54.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5920000000000001e-06 2024-09-14T09:07:54.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:54.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.321871+0000", 2024-09-14T09:07:54.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9786999999999999e-05 2024-09-14T09:07:54.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:54.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.321911+0000", 2024-09-14T09:07:54.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9956999999999997e-05 2024-09-14T09:07:54.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:54.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.322668+0000", 2024-09-14T09:07:54.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00075656400000000004 2024-09-14T09:07:54.703 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.703 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:54.703 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.703 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4421.0:142 3.11 3:8fc2352d:::rbd_header.111213dcc65d:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:54.704 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:51.325040+0000", 2024-09-14T09:07:54.704 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.284578368, 2024-09-14T09:07:54.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001050598, 2024-09-14T09:07:54.704 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:54.704 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:54.704 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:54.704 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:54.704 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4421", 2024-09-14T09:07:54.704 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:54.704 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 142 2024-09-14T09:07:54.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.704 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:54.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:54.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.325040+0000", 2024-09-14T09:07:54.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:54.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.325040+0000", 2024-09-14T09:07:54.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:54.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.325041+0000", 2024-09-14T09:07:54.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0999999999999997e-07 2024-09-14T09:07:54.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:54.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.325045+0000", 2024-09-14T09:07:54.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3259999999999997e-06 2024-09-14T09:07:54.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:54.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.325055+0000", 2024-09-14T09:07:54.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8479999999999996e-06 2024-09-14T09:07:54.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:54.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.325062+0000", 2024-09-14T09:07:54.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5220000000000004e-06 2024-09-14T09:07:54.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:54.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.325102+0000", 2024-09-14T09:07:54.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0466999999999997e-05 2024-09-14T09:07:54.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:54.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.325152+0000", 2024-09-14T09:07:54.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0331000000000003e-05 2024-09-14T09:07:54.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:07:54.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.325267+0000", 2024-09-14T09:07:54.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000114147 2024-09-14T09:07:54.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:54.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.325693+0000", 2024-09-14T09:07:54.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00042634200000000002 2024-09-14T09:07:54.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:54.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.326033+0000", 2024-09-14T09:07:54.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00033962700000000001 2024-09-14T09:07:54.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:54.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.326064+0000", 2024-09-14T09:07:54.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1486999999999999e-05 2024-09-14T09:07:54.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:54.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.326091+0000", 2024-09-14T09:07:54.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6591e-05 2024-09-14T09:07:54.709 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.709 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:54.709 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.709 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4421.0:160 3.5 3:a19fd784:::rbd_data.1112b98aa287.0000000000000000:4 [read 3072~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:54.709 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:51.330707+0000", 2024-09-14T09:07:54.709 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.278910958, 2024-09-14T09:07:54.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00082680899999999996, 2024-09-14T09:07:54.710 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:54.710 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:54.710 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:54.710 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:54.710 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4421", 2024-09-14T09:07:54.710 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:54.710 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 160 2024-09-14T09:07:54.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.710 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:54.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:54.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.330707+0000", 2024-09-14T09:07:54.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:54.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.330707+0000", 2024-09-14T09:07:54.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:54.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.330708+0000", 2024-09-14T09:07:54.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9999999999999999e-07 2024-09-14T09:07:54.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:54.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.330709+0000", 2024-09-14T09:07:54.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3909999999999999e-06 2024-09-14T09:07:54.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:54.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.330712+0000", 2024-09-14T09:07:54.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3069999999999998e-06 2024-09-14T09:07:54.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:54.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.330715+0000", 2024-09-14T09:07:54.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:07:54.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:54.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.331362+0000", 2024-09-14T09:07:54.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00064719799999999998 2024-09-14T09:07:54.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:54.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.331441+0000", 2024-09-14T09:07:54.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8938999999999998e-05 2024-09-14T09:07:54.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:54.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.331534+0000", 2024-09-14T09:07:54.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3127999999999993e-05 2024-09-14T09:07:54.713 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.714 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:54.714 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.714 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:427 3.11 3:8fc2352d:::rbd_header.111213dcc65d:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:54.714 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:51.331983+0000", 2024-09-14T09:07:54.714 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.277634994, 2024-09-14T09:07:54.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00091587500000000002, 2024-09-14T09:07:54.714 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:54.714 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:54.714 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:54.714 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:54.714 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:07:54.715 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:54.715 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 427 2024-09-14T09:07:54.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.715 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:54.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:54.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.331983+0000", 2024-09-14T09:07:54.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:54.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.331983+0000", 2024-09-14T09:07:54.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:54.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:54.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.331984+0000", 2024-09-14T09:07:54.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.99e-07 2024-09-14T09:07:54.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:54.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.331988+0000", 2024-09-14T09:07:54.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5199999999999999e-06 2024-09-14T09:07:54.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:54.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.331996+0000", 2024-09-14T09:07:54.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8879999999999997e-06 2024-09-14T09:07:54.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:54.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.332003+0000", 2024-09-14T09:07:54.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1999999999999999e-06 2024-09-14T09:07:54.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:54.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.332040+0000", 2024-09-14T09:07:54.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7870000000000002e-05 2024-09-14T09:07:54.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:54.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.332090+0000", 2024-09-14T09:07:54.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9489e-05 2024-09-14T09:07:54.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:54.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:54.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:54.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:51.332899+0000", 2024-09-14T09:07:54.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00080930900000000003 2024-09-14T09:07:54.718 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.718 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:54.718 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.718 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:54.718 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:54.718 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:54.720 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:07:54.720 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:54.721+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:54.821 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:54.823+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:54.823 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:54.823 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:07:54.824 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:07:54.824 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:54.832 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:07:54.921 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:54.924+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:54.975 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:54.975 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:07:54.976 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:07:54.976 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:07:54.976 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:54.984 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:07:55.026 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:55.028+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:55.123 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:55.125+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:55.130 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:07:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:07:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:07:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4370.0:13 3.b e25/22 3:d558f91e:::rbd_object_map.11128b09dac5:head v 25'1, mlcod=0'0)", 2024-09-14T09:07:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:47.319251+0000", 2024-09-14T09:07:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.8120684310000001, 2024-09-14T09:07:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000695339, 2024-09-14T09:07:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:47.319251+0000", 2024-09-14T09:07:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:47.319251+0000", 2024-09-14T09:07:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:47.319251+0000", 2024-09-14T09:07:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9500000000000001e-07 2024-09-14T09:07:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:47.319254+0000", 2024-09-14T09:07:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3799999999999998e-06 2024-09-14T09:07:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:47.319266+0000", 2024-09-14T09:07:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1392e-05 2024-09-14T09:07:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:47.319275+0000", 2024-09-14T09:07:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8409999999999995e-06 2024-09-14T09:07:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:47.319321+0000", 2024-09-14T09:07:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5126000000000001e-05 2024-09-14T09:07:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:47.319340+0000", 2024-09-14T09:07:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9432999999999998e-05 2024-09-14T09:07:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:47.319916+0000", 2024-09-14T09:07:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00057561400000000001 2024-09-14T09:07:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:47.319946+0000", 2024-09-14T09:07:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0358e-05 2024-09-14T09:07:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4370.0:312 3.b e27/22 3:d3cceaf5:::rbd_object_map.111213dcc65d:head v 27'16, mlcod=26'14)", 2024-09-14T09:07:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.556808+0000", 2024-09-14T09:07:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.574510955, 2024-09-14T09:07:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00088407799999999995, 2024-09-14T09:07:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.556808+0000", 2024-09-14T09:07:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.556808+0000", 2024-09-14T09:07:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.556808+0000", 2024-09-14T09:07:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7499999999999999e-07 2024-09-14T09:07:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.556812+0000", 2024-09-14T09:07:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1060000000000002e-06 2024-09-14T09:07:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.556824+0000", 2024-09-14T09:07:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.164e-05 2024-09-14T09:07:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.556832+0000", 2024-09-14T09:07:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0479999999999999e-06 2024-09-14T09:07:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.556887+0000", 2024-09-14T09:07:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4747999999999998e-05 2024-09-14T09:07:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.556911+0000", 2024-09-14T09:07:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4094e-05 2024-09-14T09:07:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.557654+0000", 2024-09-14T09:07:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000742762 2024-09-14T09:07:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.557692+0000", 2024-09-14T09:07:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8504999999999998e-05 2024-09-14T09:07:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4471.0:515 3.5 e27/22 3:a19fd784:::rbd_data.1112b98aa287.0000000000000000:head v 27'9, mlcod=26'6)", 2024-09-14T09:07:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.584437+0000", 2024-09-14T09:07:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5468816319999998, 2024-09-14T09:07:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00096452500000000004, 2024-09-14T09:07:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.584437+0000", 2024-09-14T09:07:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.584437+0000", 2024-09-14T09:07:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.584438+0000", 2024-09-14T09:07:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4299999999999999e-07 2024-09-14T09:07:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.584442+0000", 2024-09-14T09:07:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2760000000000002e-06 2024-09-14T09:07:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.584455+0000", 2024-09-14T09:07:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.252e-05 2024-09-14T09:07:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.584463+0000", 2024-09-14T09:07:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0229999999999992e-06 2024-09-14T09:07:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.584529+0000", 2024-09-14T09:07:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6804000000000006e-05 2024-09-14T09:07:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.584543+0000", 2024-09-14T09:07:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3251000000000001e-05 2024-09-14T09:07:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.585370+0000", 2024-09-14T09:07:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00082721499999999996 2024-09-14T09:07:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.585402+0000", 2024-09-14T09:07:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2193000000000002e-05 2024-09-14T09:07:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4471.0:521 3.c e27/22 3:35a5bd89:::rbd_data.1112b98aa287.0000000000000004:head v 27'7, mlcod=26'4)", 2024-09-14T09:07:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.591279+0000", 2024-09-14T09:07:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5400401869999998, 2024-09-14T09:07:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001127292, 2024-09-14T09:07:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591279+0000", 2024-09-14T09:07:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591279+0000", 2024-09-14T09:07:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591281+0000", 2024-09-14T09:07:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5799999999999999e-06 2024-09-14T09:07:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591293+0000", 2024-09-14T09:07:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2052000000000001e-05 2024-09-14T09:07:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591317+0000", 2024-09-14T09:07:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4406999999999999e-05 2024-09-14T09:07:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591329+0000", 2024-09-14T09:07:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2303000000000001e-05 2024-09-14T09:07:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591466+0000", 2024-09-14T09:07:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013648100000000001 2024-09-14T09:07:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591504+0000", 2024-09-14T09:07:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8306000000000002e-05 2024-09-14T09:07:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592379+0000", 2024-09-14T09:07:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000874806 2024-09-14T09:07:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592406+0000", 2024-09-14T09:07:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7356999999999999e-05 2024-09-14T09:07:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4471.0:523 3.1b 3:de381ce0:::rbd_data.1112b98aa287.000000000000000a:head [delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.592885+0000", 2024-09-14T09:07:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5384338060000005, 2024-09-14T09:07:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016302420000000001, 2024-09-14T09:07:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4471", 2024-09-14T09:07:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2207718190", 2024-09-14T09:07:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 523 2024-09-14T09:07:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592885+0000", 2024-09-14T09:07:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592885+0000", 2024-09-14T09:07:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592887+0000", 2024-09-14T09:07:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.364e-06 2024-09-14T09:07:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592891+0000", 2024-09-14T09:07:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5900000000000001e-06 2024-09-14T09:07:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592904+0000", 2024-09-14T09:07:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2481e-05 2024-09-14T09:07:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592911+0000", 2024-09-14T09:07:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.644e-06 2024-09-14T09:07:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592957+0000", 2024-09-14T09:07:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5979999999999997e-05 2024-09-14T09:07:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.593007+0000", 2024-09-14T09:07:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9568999999999999e-05 2024-09-14T09:07:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:07:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.593104+0000", 2024-09-14T09:07:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6877000000000001e-05 2024-09-14T09:07:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:07:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.593837+0000", 2024-09-14T09:07:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073326499999999998 2024-09-14T09:07:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.594459+0000", 2024-09-14T09:07:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00062228800000000003 2024-09-14T09:07:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.594490+0000", 2024-09-14T09:07:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0178000000000001e-05 2024-09-14T09:07:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.594516+0000", 2024-09-14T09:07:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6006000000000001e-05 2024-09-14T09:07:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4421.0:52 3.1b 3:de381ce0:::rbd_data.1112b98aa287.000000000000000a:4 [read 12455936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.750990+0000", 2024-09-14T09:07:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3803294399999997, 2024-09-14T09:07:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00028022099999999999, 2024-09-14T09:07:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:07:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4421", 2024-09-14T09:07:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 52 2024-09-14T09:07:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.750990+0000", 2024-09-14T09:07:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.750990+0000", 2024-09-14T09:07:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.750990+0000", 2024-09-14T09:07:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8199999999999999e-07 2024-09-14T09:07:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.750996+0000", 2024-09-14T09:07:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3979999999999998e-06 2024-09-14T09:07:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.751006+0000", 2024-09-14T09:07:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0414000000000001e-05 2024-09-14T09:07:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.751013+0000", 2024-09-14T09:07:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7410000000000003e-06 2024-09-14T09:07:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.751053+0000", 2024-09-14T09:07:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0194999999999997e-05 2024-09-14T09:07:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.751112+0000", 2024-09-14T09:07:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8412000000000002e-05 2024-09-14T09:07:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.751270+0000", 2024-09-14T09:07:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015827899999999999 2024-09-14T09:07:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4421.0:56 3.1b 3:de381ce0:::rbd_data.1112b98aa287.000000000000000a:4 [read 12464128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.752536+0000", 2024-09-14T09:07:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3787829729999999, 2024-09-14T09:07:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00059566399999999998, 2024-09-14T09:07:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:07:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4421", 2024-09-14T09:07:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 56 2024-09-14T09:07:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.752536+0000", 2024-09-14T09:07:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.752536+0000", 2024-09-14T09:07:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.752538+0000", 2024-09-14T09:07:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.916e-06 2024-09-14T09:07:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.752547+0000", 2024-09-14T09:07:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2269999999999999e-06 2024-09-14T09:07:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.752575+0000", 2024-09-14T09:07:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7572999999999998e-05 2024-09-14T09:07:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.752588+0000", 2024-09-14T09:07:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3366999999999999e-05 2024-09-14T09:07:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.752680+0000", 2024-09-14T09:07:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2145000000000006e-05 2024-09-14T09:07:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.752826+0000", 2024-09-14T09:07:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014604400000000001 2024-09-14T09:07:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.753132+0000", 2024-09-14T09:07:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030539199999999998 2024-09-14T09:07:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4421.0:58 3.1b 3:de381ce0:::rbd_data.1112b98aa287.000000000000000a:4 [read 12333056~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.753525+0000", 2024-09-14T09:07:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3777939559999997, 2024-09-14T09:07:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00026285600000000001, 2024-09-14T09:07:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:07:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4421", 2024-09-14T09:07:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 58 2024-09-14T09:07:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.753525+0000", 2024-09-14T09:07:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.753525+0000", 2024-09-14T09:07:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.753526+0000", 2024-09-14T09:07:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5799999999999998e-07 2024-09-14T09:07:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.753529+0000", 2024-09-14T09:07:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3720000000000001e-06 2024-09-14T09:07:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.753540+0000", 2024-09-14T09:07:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0661e-05 2024-09-14T09:07:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.753546+0000", 2024-09-14T09:07:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0789999999999997e-06 2024-09-14T09:07:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.753594+0000", 2024-09-14T09:07:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7868999999999999e-05 2024-09-14T09:07:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.753683+0000", 2024-09-14T09:07:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9423000000000001e-05 2024-09-14T09:07:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.753788+0000", 2024-09-14T09:07:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000104694 2024-09-14T09:07:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4421.0:60 3.1b 3:de381ce0:::rbd_data.1112b98aa287.000000000000000a:4 [read 12431360~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.754173+0000", 2024-09-14T09:07:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3771463879999999, 2024-09-14T09:07:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023291300000000001, 2024-09-14T09:07:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:07:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4421", 2024-09-14T09:07:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 60 2024-09-14T09:07:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.754173+0000", 2024-09-14T09:07:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.754173+0000", 2024-09-14T09:07:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.754174+0000", 2024-09-14T09:07:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7700000000000004e-07 2024-09-14T09:07:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.754177+0000", 2024-09-14T09:07:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4079999999999998e-06 2024-09-14T09:07:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.754188+0000", 2024-09-14T09:07:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0611000000000001e-05 2024-09-14T09:07:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.754193+0000", 2024-09-14T09:07:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1370000000000001e-06 2024-09-14T09:07:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.754234+0000", 2024-09-14T09:07:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1019999999999997e-05 2024-09-14T09:07:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.754312+0000", 2024-09-14T09:07:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8536999999999997e-05 2024-09-14T09:07:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.754406+0000", 2024-09-14T09:07:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3423000000000003e-05 2024-09-14T09:07:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4421.0:64 3.1b 3:de381ce0:::rbd_data.1112b98aa287.000000000000000a:4 [read 12161024~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.755532+0000", 2024-09-14T09:07:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3757867069999996, 2024-09-14T09:07:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000229831, 2024-09-14T09:07:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:07:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4421", 2024-09-14T09:07:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64 2024-09-14T09:07:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.755532+0000", 2024-09-14T09:07:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.755532+0000", 2024-09-14T09:07:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.755533+0000", 2024-09-14T09:07:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9999999999999996e-07 2024-09-14T09:07:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.755537+0000", 2024-09-14T09:07:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7230000000000002e-06 2024-09-14T09:07:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.755548+0000", 2024-09-14T09:07:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0623e-05 2024-09-14T09:07:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.755553+0000", 2024-09-14T09:07:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9930000000000003e-06 2024-09-14T09:07:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.755592+0000", 2024-09-14T09:07:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9682999999999999e-05 2024-09-14T09:07:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.755668+0000", 2024-09-14T09:07:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5425000000000004e-05 2024-09-14T09:07:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.755762+0000", 2024-09-14T09:07:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4584000000000001e-05 2024-09-14T09:07:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4421.0:66 3.1b 3:de381ce0:::rbd_data.1112b98aa287.000000000000000a:4 [read 12115968~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.756242+0000", 2024-09-14T09:07:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3750774019999996, 2024-09-14T09:07:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022815199999999999, 2024-09-14T09:07:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:07:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4421", 2024-09-14T09:07:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 66 2024-09-14T09:07:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.756242+0000", 2024-09-14T09:07:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.756242+0000", 2024-09-14T09:07:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.756243+0000", 2024-09-14T09:07:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0400000000000005e-07 2024-09-14T09:07:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.756247+0000", 2024-09-14T09:07:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8029999999999996e-06 2024-09-14T09:07:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.756258+0000", 2024-09-14T09:07:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.084e-05 2024-09-14T09:07:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.756263+0000", 2024-09-14T09:07:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-09-14T09:07:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.756302+0000", 2024-09-14T09:07:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8504999999999998e-05 2024-09-14T09:07:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.756383+0000", 2024-09-14T09:07:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0802000000000003e-05 2024-09-14T09:07:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.756470+0000", 2024-09-14T09:07:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7295999999999999e-05 2024-09-14T09:07:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4421.0:75 3.1b 3:de381ce0:::rbd_data.1112b98aa287.000000000000000a:4 [read 12460032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.759240+0000", 2024-09-14T09:07:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3720795030000001, 2024-09-14T09:07:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00041810799999999999, 2024-09-14T09:07:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:07:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4421", 2024-09-14T09:07:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 75 2024-09-14T09:07:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.759240+0000", 2024-09-14T09:07:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.759240+0000", 2024-09-14T09:07:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.759240+0000", 2024-09-14T09:07:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7899999999999997e-07 2024-09-14T09:07:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.759245+0000", 2024-09-14T09:07:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.566e-06 2024-09-14T09:07:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.759256+0000", 2024-09-14T09:07:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0771000000000001e-05 2024-09-14T09:07:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.759261+0000", 2024-09-14T09:07:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4999999999999999e-06 2024-09-14T09:07:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.759330+0000", 2024-09-14T09:07:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8459000000000003e-05 2024-09-14T09:07:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.759415+0000", 2024-09-14T09:07:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5563999999999996e-05 2024-09-14T09:07:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.759658+0000", 2024-09-14T09:07:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024246900000000001 2024-09-14T09:07:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4421.0:126 3.1b 3:de381ce0:::rbd_data.1112b98aa287.000000000000000a:4 [read 12091392~24576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.774367+0000", 2024-09-14T09:07:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3569521379999996, 2024-09-14T09:07:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023530900000000001, 2024-09-14T09:07:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:07:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4421", 2024-09-14T09:07:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 126 2024-09-14T09:07:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774367+0000", 2024-09-14T09:07:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774367+0000", 2024-09-14T09:07:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774368+0000", 2024-09-14T09:07:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1900000000000002e-07 2024-09-14T09:07:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774371+0000", 2024-09-14T09:07:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.794e-06 2024-09-14T09:07:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774399+0000", 2024-09-14T09:07:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7983e-05 2024-09-14T09:07:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774404+0000", 2024-09-14T09:07:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9590000000000003e-06 2024-09-14T09:07:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774453+0000", 2024-09-14T09:07:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8406999999999999e-05 2024-09-14T09:07:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774526+0000", 2024-09-14T09:07:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3509000000000004e-05 2024-09-14T09:07:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774602+0000", 2024-09-14T09:07:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5938000000000004e-05 2024-09-14T09:07:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4421.0:127 3.1b 3:de381ce0:::rbd_data.1112b98aa287.000000000000000a:4 [read 12058624~28672] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.774433+0000", 2024-09-14T09:07:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3568863560000004, 2024-09-14T09:07:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00042432599999999999, 2024-09-14T09:07:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:07:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4421", 2024-09-14T09:07:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 127 2024-09-14T09:07:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774433+0000", 2024-09-14T09:07:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774433+0000", 2024-09-14T09:07:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774433+0000", 2024-09-14T09:07:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2024-09-14T09:07:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774436+0000", 2024-09-14T09:07:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7089999999999998e-06 2024-09-14T09:07:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774443+0000", 2024-09-14T09:07:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5540000000000003e-06 2024-09-14T09:07:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774448+0000", 2024-09-14T09:07:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0470000000000001e-06 2024-09-14T09:07:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774643+0000", 2024-09-14T09:07:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019556700000000001 2024-09-14T09:07:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774758+0000", 2024-09-14T09:07:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011482800000000001 2024-09-14T09:07:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774857+0000", 2024-09-14T09:07:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9041000000000003e-05 2024-09-14T09:07:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4421.0:128 3.1b 3:de381ce0:::rbd_data.1112b98aa287.000000000000000a:4 [read 12120064~40960] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.774482+0000", 2024-09-14T09:07:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3568369929999999, 2024-09-14T09:07:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00051338100000000004, 2024-09-14T09:07:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:07:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4421", 2024-09-14T09:07:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 128 2024-09-14T09:07:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774482+0000", 2024-09-14T09:07:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774482+0000", 2024-09-14T09:07:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774483+0000", 2024-09-14T09:07:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8999999999999997e-07 2024-09-14T09:07:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774486+0000", 2024-09-14T09:07:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5839999999999999e-06 2024-09-14T09:07:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774493+0000", 2024-09-14T09:07:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7710000000000001e-06 2024-09-14T09:07:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774498+0000", 2024-09-14T09:07:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4430000000000002e-06 2024-09-14T09:07:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774889+0000", 2024-09-14T09:07:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00039018599999999999 2024-09-14T09:07:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774935+0000", 2024-09-14T09:07:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5957000000000001e-05 2024-09-14T09:07:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774996+0000", 2024-09-14T09:07:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0949999999999998e-05 2024-09-14T09:07:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4421.0:129 3.1b 3:de381ce0:::rbd_data.1112b98aa287.000000000000000a:4 [read 12165120~24576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.774592+0000", 2024-09-14T09:07:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3567266650000001, 2024-09-14T09:07:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00063488699999999999, 2024-09-14T09:07:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:07:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4421", 2024-09-14T09:07:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 129 2024-09-14T09:07:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774592+0000", 2024-09-14T09:07:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774592+0000", 2024-09-14T09:07:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774593+0000", 2024-09-14T09:07:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1800000000000005e-07 2024-09-14T09:07:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774596+0000", 2024-09-14T09:07:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1e-06 2024-09-14T09:07:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774603+0000", 2024-09-14T09:07:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7089999999999996e-06 2024-09-14T09:07:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.774608+0000", 2024-09-14T09:07:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:07:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.775020+0000", 2024-09-14T09:07:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00041172099999999998 2024-09-14T09:07:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.775133+0000", 2024-09-14T09:07:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000113285 2024-09-14T09:07:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.775227+0000", 2024-09-14T09:07:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3913999999999996e-05 2024-09-14T09:07:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4421.0:132 3.1b 3:de381ce0:::rbd_data.1112b98aa287.000000000000000a:4 [sparse-read 12189696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.775662+0000", 2024-09-14T09:07:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3556575659999996, 2024-09-14T09:07:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00028851799999999998, 2024-09-14T09:07:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:07:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4421", 2024-09-14T09:07:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 132 2024-09-14T09:07:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.775662+0000", 2024-09-14T09:07:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.775662+0000", 2024-09-14T09:07:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.775662+0000", 2024-09-14T09:07:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7599999999999996e-07 2024-09-14T09:07:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.775666+0000", 2024-09-14T09:07:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6049999999999998e-06 2024-09-14T09:07:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.775677+0000", 2024-09-14T09:07:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0789e-05 2024-09-14T09:07:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.775682+0000", 2024-09-14T09:07:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0640000000000001e-06 2024-09-14T09:07:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.775725+0000", 2024-09-14T09:07:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3587000000000001e-05 2024-09-14T09:07:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.775855+0000", 2024-09-14T09:07:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012956099999999999 2024-09-14T09:07:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.775950+0000", 2024-09-14T09:07:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5136000000000005e-05 2024-09-14T09:07:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4421.0:133 3.1b 3:de381ce0:::rbd_data.1112b98aa287.000000000000000a:4 [read 12263424~57344] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.775761+0000", 2024-09-14T09:07:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3555581429999997, 2024-09-14T09:07:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00036058599999999998, 2024-09-14T09:07:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:07:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4421", 2024-09-14T09:07:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 133 2024-09-14T09:07:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.775761+0000", 2024-09-14T09:07:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.775761+0000", 2024-09-14T09:07:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.775761+0000", 2024-09-14T09:07:55.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9499999999999998e-07 2024-09-14T09:07:55.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.775763+0000", 2024-09-14T09:07:55.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9719999999999999e-06 2024-09-14T09:07:55.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.775785+0000", 2024-09-14T09:07:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2048e-05 2024-09-14T09:07:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.775789+0000", 2024-09-14T09:07:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2100000000000002e-06 2024-09-14T09:07:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.775976+0000", 2024-09-14T09:07:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000187873 2024-09-14T09:07:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.776029+0000", 2024-09-14T09:07:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2049000000000003e-05 2024-09-14T09:07:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.776122+0000", 2024-09-14T09:07:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3039000000000001e-05 2024-09-14T09:07:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4421.0:136 3.b e27/22 3:d3cceaf5:::rbd_object_map.111213dcc65d:head v 27'17, mlcod=26'15)", 2024-09-14T09:07:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:51.319486+0000", 2024-09-14T09:07:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.8118327779999999, 2024-09-14T09:07:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00068004800000000005, 2024-09-14T09:07:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:51.319486+0000", 2024-09-14T09:07:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:51.319486+0000", 2024-09-14T09:07:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:51.319487+0000", 2024-09-14T09:07:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7700000000000004e-07 2024-09-14T09:07:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:51.319493+0000", 2024-09-14T09:07:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6520000000000003e-06 2024-09-14T09:07:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:51.319503+0000", 2024-09-14T09:07:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0464e-05 2024-09-14T09:07:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:51.319511+0000", 2024-09-14T09:07:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.379e-06 2024-09-14T09:07:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:51.319577+0000", 2024-09-14T09:07:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6354999999999997e-05 2024-09-14T09:07:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:51.319602+0000", 2024-09-14T09:07:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4732e-05 2024-09-14T09:07:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:51.320123+0000", 2024-09-14T09:07:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00052119299999999998 2024-09-14T09:07:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:51.320166+0000", 2024-09-14T09:07:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3495999999999998e-05 2024-09-14T09:07:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.219 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4421.0:141 3.b e27/22 3:d3cceaf5:::rbd_object_map.111213dcc65d:head v 27'18, mlcod=27'16)", 2024-09-14T09:07:55.219 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:51.324185+0000", 2024-09-14T09:07:55.219 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.8071337129999998, 2024-09-14T09:07:55.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00060694700000000004, 2024-09-14T09:07:55.219 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.219 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.219 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:55.219 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:51.324185+0000", 2024-09-14T09:07:55.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:51.324185+0000", 2024-09-14T09:07:55.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:51.324186+0000", 2024-09-14T09:07:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000004e-07 2024-09-14T09:07:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:51.324191+0000", 2024-09-14T09:07:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6210000000000003e-06 2024-09-14T09:07:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:51.324201+0000", 2024-09-14T09:07:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8560000000000002e-06 2024-09-14T09:07:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:51.324205+0000", 2024-09-14T09:07:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7149999999999997e-06 2024-09-14T09:07:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:51.324249+0000", 2024-09-14T09:07:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3466e-05 2024-09-14T09:07:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:51.324261+0000", 2024-09-14T09:07:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1973e-05 2024-09-14T09:07:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:51.324753+0000", 2024-09-14T09:07:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000492638 2024-09-14T09:07:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:51.324792+0000", 2024-09-14T09:07:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9025e-05 2024-09-14T09:07:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.224 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.224 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:55.225 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:07:55.226 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:55.227+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:07:55.325 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:55.327+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:07:55.337 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T09:07:55.372 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:55.372 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:07:55.372 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:07:55.372 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:55.381 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:07:55.427 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:55.429+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:55.484 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:55.484 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:07:55.484 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:07:55.484 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:07:55.484 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:55.492 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:07:55.533 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:55.535+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:55.628 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:55.631+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:55.637 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:55.637 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:07:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:07:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:07:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4217.0:5 2.2 e19/17 2:5cea7035:::rbd_info:head v 19'1, mlcod=0'0)", 2024-09-14T09:07:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:36.253847+0000", 2024-09-14T09:07:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.38494201, 2024-09-14T09:07:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00088235799999999997, 2024-09-14T09:07:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253847+0000", 2024-09-14T09:07:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253847+0000", 2024-09-14T09:07:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253847+0000", 2024-09-14T09:07:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.41e-07 2024-09-14T09:07:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253853+0000", 2024-09-14T09:07:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6949999999999997e-06 2024-09-14T09:07:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253869+0000", 2024-09-14T09:07:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5888000000000001e-05 2024-09-14T09:07:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253879+0000", 2024-09-14T09:07:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.995e-06 2024-09-14T09:07:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253940+0000", 2024-09-14T09:07:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1283000000000003e-05 2024-09-14T09:07:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.253958+0000", 2024-09-14T09:07:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8286000000000001e-05 2024-09-14T09:07:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.254681+0000", 2024-09-14T09:07:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00072306900000000001 2024-09-14T09:07:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:36.254729+0000", 2024-09-14T09:07:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7901000000000001e-05 2024-09-14T09:07:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4217.0:7 2.2 e20/17 2:5cea7035:::rbd_info:head v 20'2, mlcod=0'0)", 2024-09-14T09:07:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:37.260704+0000", 2024-09-14T09:07:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.378084846, 2024-09-14T09:07:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001519589, 2024-09-14T09:07:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260704+0000", 2024-09-14T09:07:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260704+0000", 2024-09-14T09:07:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260704+0000", 2024-09-14T09:07:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8299999999999998e-07 2024-09-14T09:07:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260711+0000", 2024-09-14T09:07:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0160000000000003e-06 2024-09-14T09:07:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260725+0000", 2024-09-14T09:07:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3740000000000001e-05 2024-09-14T09:07:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260744+0000", 2024-09-14T09:07:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9023999999999999e-05 2024-09-14T09:07:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260800+0000", 2024-09-14T09:07:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5739000000000003e-05 2024-09-14T09:07:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.260819+0000", 2024-09-14T09:07:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9236999999999999e-05 2024-09-14T09:07:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.262184+0000", 2024-09-14T09:07:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001364873 2024-09-14T09:07:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:37.262224+0000", 2024-09-14T09:07:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9677e-05 2024-09-14T09:07:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4471.0:486 3.8 3:11a84d98:::rbd_object_map.1112b98aa287.0000000000000004:head [writefull 0~37] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.314563+0000", 2024-09-14T09:07:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.3242263679999997, 2024-09-14T09:07:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00128762, 2024-09-14T09:07:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4471", 2024-09-14T09:07:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2207718190", 2024-09-14T09:07:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 486 2024-09-14T09:07:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.314563+0000", 2024-09-14T09:07:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.314563+0000", 2024-09-14T09:07:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.314564+0000", 2024-09-14T09:07:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.606e-06 2024-09-14T09:07:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.314573+0000", 2024-09-14T09:07:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5010000000000004e-06 2024-09-14T09:07:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.314587+0000", 2024-09-14T09:07:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4549000000000001e-05 2024-09-14T09:07:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.314597+0000", 2024-09-14T09:07:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.011e-05 2024-09-14T09:07:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.314657+0000", 2024-09-14T09:07:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9499000000000001e-05 2024-09-14T09:07:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.314752+0000", 2024-09-14T09:07:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4848999999999999e-05 2024-09-14T09:07:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:07:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.314840+0000", 2024-09-14T09:07:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7848000000000003e-05 2024-09-14T09:07:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:07:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.315428+0000", 2024-09-14T09:07:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00058855500000000005 2024-09-14T09:07:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.315792+0000", 2024-09-14T09:07:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00036351299999999999 2024-09-14T09:07:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.315824+0000", 2024-09-14T09:07:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2048000000000002e-05 2024-09-14T09:07:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.315850+0000", 2024-09-14T09:07:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6542000000000001e-05 2024-09-14T09:07:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4370.0:292 3.8 3:11a84d98:::rbd_object_map.1112b98aa287.0000000000000004:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.535806+0000", 2024-09-14T09:07:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.1029828049999999, 2024-09-14T09:07:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032007009999999998, 2024-09-14T09:07:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:07:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4370", 2024-09-14T09:07:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 292 2024-09-14T09:07:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.535806+0000", 2024-09-14T09:07:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.535806+0000", 2024-09-14T09:07:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.535808+0000", 2024-09-14T09:07:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6440000000000001e-06 2024-09-14T09:07:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.535815+0000", 2024-09-14T09:07:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2459999999999997e-06 2024-09-14T09:07:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.535825+0000", 2024-09-14T09:07:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0088000000000001e-05 2024-09-14T09:07:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.535833+0000", 2024-09-14T09:07:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3299999999999999e-06 2024-09-14T09:07:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.535897+0000", 2024-09-14T09:07:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3600000000000001e-05 2024-09-14T09:07:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.535965+0000", 2024-09-14T09:07:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7733999999999999e-05 2024-09-14T09:07:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.539007+0000", 2024-09-14T09:07:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030420590000000002 2024-09-14T09:07:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4471.0:520 3.1 3:83bc1d50:::rbd_data.1112b98aa287.0000000000000003:head [stat,delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.589116+0000", 2024-09-14T09:07:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.0496726540000001, 2024-09-14T09:07:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001457919, 2024-09-14T09:07:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4471", 2024-09-14T09:07:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2207718190", 2024-09-14T09:07:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 520 2024-09-14T09:07:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.589116+0000", 2024-09-14T09:07:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.589116+0000", 2024-09-14T09:07:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.589117+0000", 2024-09-14T09:07:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8700000000000004e-07 2024-09-14T09:07:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.589122+0000", 2024-09-14T09:07:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2809999999999999e-06 2024-09-14T09:07:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.589133+0000", 2024-09-14T09:07:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1044e-05 2024-09-14T09:07:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.589139+0000", 2024-09-14T09:07:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2989999999999996e-06 2024-09-14T09:07:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.589193+0000", 2024-09-14T09:07:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4027000000000003e-05 2024-09-14T09:07:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.589277+0000", 2024-09-14T09:07:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4439999999999998e-05 2024-09-14T09:07:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:07:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.589456+0000", 2024-09-14T09:07:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017833500000000001 2024-09-14T09:07:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:07:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.590311+0000", 2024-09-14T09:07:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00085559399999999999 2024-09-14T09:07:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.590484+0000", 2024-09-14T09:07:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000172339 2024-09-14T09:07:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.590534+0000", 2024-09-14T09:07:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0149999999999999e-05 2024-09-14T09:07:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.590574+0000", 2024-09-14T09:07:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0522999999999998e-05 2024-09-14T09:07:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4370.0:397 3.8 3:11a84d98:::rbd_object_map.1112b98aa287.0000000000000004:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.668609+0000", 2024-09-14T09:07:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.9701803529999999, 2024-09-14T09:07:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00041725900000000001, 2024-09-14T09:07:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:07:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4370", 2024-09-14T09:07:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 397 2024-09-14T09:07:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.668609+0000", 2024-09-14T09:07:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.668609+0000", 2024-09-14T09:07:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.668611+0000", 2024-09-14T09:07:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2239999999999998e-06 2024-09-14T09:07:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.668623+0000", 2024-09-14T09:07:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2306e-05 2024-09-14T09:07:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.668651+0000", 2024-09-14T09:07:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7495999999999999e-05 2024-09-14T09:07:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.668664+0000", 2024-09-14T09:07:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3823e-05 2024-09-14T09:07:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.668849+0000", 2024-09-14T09:07:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018412600000000001 2024-09-14T09:07:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.668899+0000", 2024-09-14T09:07:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0157000000000001e-05 2024-09-14T09:07:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.669026+0000", 2024-09-14T09:07:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012712699999999999 2024-09-14T09:07:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4421.0:44 3.4 3:278b0f69:::rbd_data.111213dcc65d.0000000000000000:head [read 3072~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.744512+0000", 2024-09-14T09:07:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8942770419999997, 2024-09-14T09:07:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00032385500000000001, 2024-09-14T09:07:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:07:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4421", 2024-09-14T09:07:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 44 2024-09-14T09:07:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.744512+0000", 2024-09-14T09:07:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.744512+0000", 2024-09-14T09:07:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.744512+0000", 2024-09-14T09:07:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1900000000000003e-07 2024-09-14T09:07:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.744514+0000", 2024-09-14T09:07:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.046e-06 2024-09-14T09:07:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.744520+0000", 2024-09-14T09:07:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6520000000000003e-06 2024-09-14T09:07:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.744525+0000", 2024-09-14T09:07:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6630000000000001e-06 2024-09-14T09:07:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.744786+0000", 2024-09-14T09:07:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00026078800000000002 2024-09-14T09:07:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.744836+0000", 2024-09-14T09:07:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0186999999999999e-05 2024-09-14T09:07:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4421.0:82 3.4 3:278b0f69:::rbd_data.111213dcc65d.0000000000000000:head [read 131072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.762396+0000", 2024-09-14T09:07:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8763933120000003, 2024-09-14T09:07:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00032611700000000001, 2024-09-14T09:07:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:07:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4421", 2024-09-14T09:07:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 82 2024-09-14T09:07:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.762396+0000", 2024-09-14T09:07:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.762396+0000", 2024-09-14T09:07:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.762397+0000", 2024-09-14T09:07:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4559999999999999e-06 2024-09-14T09:07:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.762404+0000", 2024-09-14T09:07:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8970000000000002e-06 2024-09-14T09:07:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.762423+0000", 2024-09-14T09:07:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8972999999999999e-05 2024-09-14T09:07:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.762439+0000", 2024-09-14T09:07:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5685999999999999e-05 2024-09-14T09:07:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.762554+0000", 2024-09-14T09:07:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114925 2024-09-14T09:07:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.762722+0000", 2024-09-14T09:07:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016818000000000001 2024-09-14T09:07:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4421.0:101 3.4 3:278b0f69:::rbd_data.111213dcc65d.0000000000000000:head [read 36864~24576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.769155+0000", 2024-09-14T09:07:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8696341859999999, 2024-09-14T09:07:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033566800000000001, 2024-09-14T09:07:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:07:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4421", 2024-09-14T09:07:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 101 2024-09-14T09:07:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769155+0000", 2024-09-14T09:07:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769155+0000", 2024-09-14T09:07:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769156+0000", 2024-09-14T09:07:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.42e-06 2024-09-14T09:07:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769163+0000", 2024-09-14T09:07:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5729999999999996e-06 2024-09-14T09:07:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769182+0000", 2024-09-14T09:07:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9483e-05 2024-09-14T09:07:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769198+0000", 2024-09-14T09:07:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5747e-05 2024-09-14T09:07:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769339+0000", 2024-09-14T09:07:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014103400000000001 2024-09-14T09:07:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769490+0000", 2024-09-14T09:07:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000151411 2024-09-14T09:07:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4421.0:102 3.4 3:278b0f69:::rbd_data.111213dcc65d.0000000000000000:head [read 20480~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.769222+0000", 2024-09-14T09:07:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8695666969999998, 2024-09-14T09:07:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00034874899999999998, 2024-09-14T09:07:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:07:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4421", 2024-09-14T09:07:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 102 2024-09-14T09:07:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769222+0000", 2024-09-14T09:07:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769222+0000", 2024-09-14T09:07:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769224+0000", 2024-09-14T09:07:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2729999999999999e-06 2024-09-14T09:07:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769229+0000", 2024-09-14T09:07:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.48e-06 2024-09-14T09:07:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769247+0000", 2024-09-14T09:07:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7520000000000002e-05 2024-09-14T09:07:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769260+0000", 2024-09-14T09:07:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3560000000000001e-05 2024-09-14T09:07:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769527+0000", 2024-09-14T09:07:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00026658200000000002 2024-09-14T09:07:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769571+0000", 2024-09-14T09:07:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4333999999999999e-05 2024-09-14T09:07:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4421.0:103 3.4 3:278b0f69:::rbd_data.111213dcc65d.0000000000000000:head [read 69632~61440] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.769278+0000", 2024-09-14T09:07:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8695109409999997, 2024-09-14T09:07:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00035915600000000002, 2024-09-14T09:07:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:07:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4421", 2024-09-14T09:07:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 103 2024-09-14T09:07:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769278+0000", 2024-09-14T09:07:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769278+0000", 2024-09-14T09:07:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769279+0000", 2024-09-14T09:07:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7300000000000004e-07 2024-09-14T09:07:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769301+0000", 2024-09-14T09:07:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2379999999999999e-05 2024-09-14T09:07:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769319+0000", 2024-09-14T09:07:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8128999999999999e-05 2024-09-14T09:07:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769333+0000", 2024-09-14T09:07:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3874e-05 2024-09-14T09:07:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769590+0000", 2024-09-14T09:07:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00025704100000000001 2024-09-14T09:07:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769637+0000", 2024-09-14T09:07:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6758999999999997e-05 2024-09-14T09:07:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4421.0:104 3.4 3:278b0f69:::rbd_data.111213dcc65d.0000000000000000:head [read 135168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.769352+0000", 2024-09-14T09:07:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8694367849999995, 2024-09-14T09:07:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033945999999999998, 2024-09-14T09:07:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:07:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4421", 2024-09-14T09:07:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 104 2024-09-14T09:07:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769352+0000", 2024-09-14T09:07:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769352+0000", 2024-09-14T09:07:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769353+0000", 2024-09-14T09:07:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.26e-06 2024-09-14T09:07:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769371+0000", 2024-09-14T09:07:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7339000000000001e-05 2024-09-14T09:07:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769388+0000", 2024-09-14T09:07:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.73e-05 2024-09-14T09:07:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769413+0000", 2024-09-14T09:07:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5213000000000001e-05 2024-09-14T09:07:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769649+0000", 2024-09-14T09:07:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000235517 2024-09-14T09:07:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.769692+0000", 2024-09-14T09:07:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2830999999999997e-05 2024-09-14T09:07:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4421.0:112 3.4 3:278b0f69:::rbd_data.111213dcc65d.0000000000000000:head [sparse-read 266240~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.771284+0000", 2024-09-14T09:07:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8675049340000003, 2024-09-14T09:07:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00036952699999999997, 2024-09-14T09:07:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:07:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4421", 2024-09-14T09:07:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2934633500", 2024-09-14T09:07:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112 2024-09-14T09:07:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.771284+0000", 2024-09-14T09:07:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.771284+0000", 2024-09-14T09:07:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.771286+0000", 2024-09-14T09:07:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9300000000000002e-06 2024-09-14T09:07:55.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.771295+0000", 2024-09-14T09:07:55.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2799999999999992e-06 2024-09-14T09:07:55.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.771323+0000", 2024-09-14T09:07:55.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7895999999999999e-05 2024-09-14T09:07:55.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.771344+0000", 2024-09-14T09:07:55.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0679e-05 2024-09-14T09:07:55.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.771491+0000", 2024-09-14T09:07:55.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014746799999999999 2024-09-14T09:07:55.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.771654+0000", 2024-09-14T09:07:55.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016227400000000001 2024-09-14T09:07:55.698 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.698 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.698 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.698 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4495.0:745 3.1 3:84db2e10:::rbd_data.11128b09dac5.0000000000000014:head [sparse-read 2625536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.698 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.984431+0000", 2024-09-14T09:07:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.6543581400000003, 2024-09-14T09:07:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00038000099999999998, 2024-09-14T09:07:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:07:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4495", 2024-09-14T09:07:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1400929400", 2024-09-14T09:07:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 745 2024-09-14T09:07:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.984431+0000", 2024-09-14T09:07:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.984431+0000", 2024-09-14T09:07:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.984431+0000", 2024-09-14T09:07:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.22e-07 2024-09-14T09:07:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.984433+0000", 2024-09-14T09:07:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.528e-06 2024-09-14T09:07:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.984438+0000", 2024-09-14T09:07:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3229999999999997e-06 2024-09-14T09:07:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.984441+0000", 2024-09-14T09:07:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8870000000000001e-06 2024-09-14T09:07:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.984692+0000", 2024-09-14T09:07:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00025085199999999998 2024-09-14T09:07:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.984745+0000", 2024-09-14T09:07:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3609999999999997e-05 2024-09-14T09:07:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.984811+0000", 2024-09-14T09:07:55.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5479000000000001e-05 2024-09-14T09:07:55.703 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.703 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.703 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.703 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4495.0:747 3.1 3:84db2e10:::rbd_data.11128b09dac5.0000000000000014:head [sparse-read 3018752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:07:55.703 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.985070+0000", 2024-09-14T09:07:55.703 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.6537189489999999, 2024-09-14T09:07:55.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00031983100000000002, 2024-09-14T09:07:55.703 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.703 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.703 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:07:55.703 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.704 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4495", 2024-09-14T09:07:55.704 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1400929400", 2024-09-14T09:07:55.704 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 747 2024-09-14T09:07:55.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.704 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.985070+0000", 2024-09-14T09:07:55.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.985070+0000", 2024-09-14T09:07:55.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.985070+0000", 2024-09-14T09:07:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4999999999999998e-07 2024-09-14T09:07:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.985072+0000", 2024-09-14T09:07:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5960000000000001e-06 2024-09-14T09:07:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.985078+0000", 2024-09-14T09:07:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6579999999999999e-06 2024-09-14T09:07:55.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.985080+0000", 2024-09-14T09:07:55.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8760000000000001e-06 2024-09-14T09:07:55.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.985292+0000", 2024-09-14T09:07:55.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00021198699999999999 2024-09-14T09:07:55.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.985333+0000", 2024-09-14T09:07:55.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0229999999999999e-05 2024-09-14T09:07:55.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.985390+0000", 2024-09-14T09:07:55.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7133999999999999e-05 2024-09-14T09:07:55.707 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.707 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.707 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.707 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4519.0:5259 3.7 3:e2a08aae:::rbd_object_map.11122fa6a16d:head [call lock.assert_locked in=17b,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:55.707 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.345981+0000", 2024-09-14T09:07:55.707 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29280751900000002, 2024-09-14T09:07:55.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016403329999999999, 2024-09-14T09:07:55.707 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.708 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.708 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:55.708 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.708 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4519", 2024-09-14T09:07:55.708 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/4113002635", 2024-09-14T09:07:55.708 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5259 2024-09-14T09:07:55.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.708 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.345981+0000", 2024-09-14T09:07:55.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.345981+0000", 2024-09-14T09:07:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.345983+0000", 2024-09-14T09:07:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.201e-06 2024-09-14T09:07:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.345989+0000", 2024-09-14T09:07:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4280000000000001e-06 2024-09-14T09:07:55.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.346005+0000", 2024-09-14T09:07:55.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6410999999999999e-05 2024-09-14T09:07:55.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.346015+0000", 2024-09-14T09:07:55.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.166e-06 2024-09-14T09:07:55.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.346071+0000", 2024-09-14T09:07:55.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6792000000000001e-05 2024-09-14T09:07:55.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.346263+0000", 2024-09-14T09:07:55.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019164599999999999 2024-09-14T09:07:55.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 3", 2024-09-14T09:07:55.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.346524+0000", 2024-09-14T09:07:55.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00026127700000000003 2024-09-14T09:07:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:07:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.347274+0000", 2024-09-14T09:07:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00075000999999999996 2024-09-14T09:07:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.347525+0000", 2024-09-14T09:07:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00025023500000000002 2024-09-14T09:07:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.347577+0000", 2024-09-14T09:07:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2692000000000003e-05 2024-09-14T09:07:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.347622+0000", 2024-09-14T09:07:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4474999999999997e-05 2024-09-14T09:07:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4370.0:1491 3.8 3:17e81ee6:::rbd_id.image_client.0-clone4:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.376220+0000", 2024-09-14T09:07:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.262569002, 2024-09-14T09:07:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0012858360000000001, 2024-09-14T09:07:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4370", 2024-09-14T09:07:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1491 2024-09-14T09:07:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.376220+0000", 2024-09-14T09:07:55.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.376220+0000", 2024-09-14T09:07:55.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.376221+0000", 2024-09-14T09:07:55.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8100000000000001e-07 2024-09-14T09:07:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.376234+0000", 2024-09-14T09:07:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.345e-05 2024-09-14T09:07:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.376246+0000", 2024-09-14T09:07:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1823e-05 2024-09-14T09:07:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.376252+0000", 2024-09-14T09:07:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0059999999999998e-06 2024-09-14T09:07:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.376302+0000", 2024-09-14T09:07:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9991000000000003e-05 2024-09-14T09:07:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.376393+0000", 2024-09-14T09:07:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0929999999999998e-05 2024-09-14T09:07:55.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:07:55.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.376520+0000", 2024-09-14T09:07:55.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000126935 2024-09-14T09:07:55.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:07:55.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.377126+0000", 2024-09-14T09:07:55.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00060591499999999995 2024-09-14T09:07:55.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.377441+0000", 2024-09-14T09:07:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000314982 2024-09-14T09:07:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.377474+0000", 2024-09-14T09:07:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3074000000000002e-05 2024-09-14T09:07:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.377506+0000", 2024-09-14T09:07:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1748999999999997e-05 2024-09-14T09:07:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4370.0:1496 3.8 3:17e81ee6:::rbd_id.image_client.0-clone4:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.387152+0000", 2024-09-14T09:07:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.25163672399999998, 2024-09-14T09:07:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00036800899999999998, 2024-09-14T09:07:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:07:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4370", 2024-09-14T09:07:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1496 2024-09-14T09:07:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.387152+0000", 2024-09-14T09:07:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.387152+0000", 2024-09-14T09:07:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.387153+0000", 2024-09-14T09:07:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5400000000000001e-07 2024-09-14T09:07:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.387156+0000", 2024-09-14T09:07:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1559999999999999e-06 2024-09-14T09:07:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.387163+0000", 2024-09-14T09:07:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2350000000000002e-06 2024-09-14T09:07:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.387175+0000", 2024-09-14T09:07:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.219e-05 2024-09-14T09:07:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.387215+0000", 2024-09-14T09:07:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9304999999999997e-05 2024-09-14T09:07:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.387268+0000", 2024-09-14T09:07:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3010999999999998e-05 2024-09-14T09:07:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.387520+0000", 2024-09-14T09:07:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000252558 2024-09-14T09:07:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4519.0:5313 3.18 3:1ac19143:::rbd_data.11122fa6a16d.0000000000000003:head [sparse-read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.492441+0000", 2024-09-14T09:07:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.14634771999999999, 2024-09-14T09:07:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00031334700000000001, 2024-09-14T09:07:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:07:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4519", 2024-09-14T09:07:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/4113002635", 2024-09-14T09:07:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5313 2024-09-14T09:07:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.492441+0000", 2024-09-14T09:07:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.492441+0000", 2024-09-14T09:07:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.492444+0000", 2024-09-14T09:07:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8600000000000001e-06 2024-09-14T09:07:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.492453+0000", 2024-09-14T09:07:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4190000000000008e-06 2024-09-14T09:07:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.492473+0000", 2024-09-14T09:07:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9398e-05 2024-09-14T09:07:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.492500+0000", 2024-09-14T09:07:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7263999999999998e-05 2024-09-14T09:07:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.492596+0000", 2024-09-14T09:07:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5951000000000003e-05 2024-09-14T09:07:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.492661+0000", 2024-09-14T09:07:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4598999999999996e-05 2024-09-14T09:07:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.492755+0000", 2024-09-14T09:07:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3856000000000004e-05 2024-09-14T09:07:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4519.0:5320 3.7 3:e2a08aae:::rbd_object_map.11122fa6a16d:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.514287+0000", 2024-09-14T09:07:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.124501482, 2024-09-14T09:07:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0012296259999999999, 2024-09-14T09:07:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4519", 2024-09-14T09:07:55.730 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/4113002635", 2024-09-14T09:07:55.730 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5320 2024-09-14T09:07:55.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.730 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:55.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:55.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.514287+0000", 2024-09-14T09:07:55.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:55.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.514287+0000", 2024-09-14T09:07:55.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:55.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.514289+0000", 2024-09-14T09:07:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9700000000000002e-06 2024-09-14T09:07:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.514299+0000", 2024-09-14T09:07:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0033e-05 2024-09-14T09:07:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.514327+0000", 2024-09-14T09:07:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.775e-05 2024-09-14T09:07:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.514341+0000", 2024-09-14T09:07:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3336000000000001e-05 2024-09-14T09:07:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.514453+0000", 2024-09-14T09:07:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011257899999999999 2024-09-14T09:07:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.514563+0000", 2024-09-14T09:07:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000110114 2024-09-14T09:07:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 3", 2024-09-14T09:07:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.514680+0000", 2024-09-14T09:07:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116972 2024-09-14T09:07:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:07:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.515429+0000", 2024-09-14T09:07:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00074853099999999998 2024-09-14T09:07:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.515460+0000", 2024-09-14T09:07:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1238999999999997e-05 2024-09-14T09:07:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.515492+0000", 2024-09-14T09:07:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2221999999999997e-05 2024-09-14T09:07:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.515517+0000", 2024-09-14T09:07:55.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4879999999999999e-05 2024-09-14T09:07:55.735 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.735 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.735 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.735 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:55.735 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:55.735 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:55.736 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #2, image image_client.0-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent3 2024-09-14T09:07:55.737 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:07:55.737 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:55.738+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:55.821 INFO:teuthology.orchestra.run.smithi148.stdout:581 punch from 0x7aecc00 to 0x7af0a00, (0x3e00 bytes) 2024-09-14T09:07:55.829 INFO:teuthology.orchestra.run.smithi148.stdout:583 read 0x5a2dc00 thru 0x5a35bdc (0x7fdd bytes) 2024-09-14T09:07:55.830 INFO:teuthology.orchestra.run.smithi148.stdout:584 read 0x2868800 thru 0x286ddc6 (0x55c7 bytes) 2024-09-14T09:07:55.830 INFO:teuthology.orchestra.run.smithi148.stdout:588 read 0x67d3000 thru 0x67d9b58 (0x6b59 bytes) 2024-09-14T09:07:55.831 INFO:teuthology.orchestra.run.smithi148.stdout:591 trunc from 0x8dd5600 to 0x973bc00 2024-09-14T09:07:55.837 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:55.839+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:55.847 INFO:teuthology.orchestra.run.smithi148.stdout:594 trunc from 0x973bc00 to 0x2535000 2024-09-14T09:07:55.891 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:55.891 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:07:55.891 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:07:55.891 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:55.900 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:07:55.906 INFO:teuthology.orchestra.run.smithi148.stdout:596 write 0x78c2c00 thru 0x78cb366 (0x8767 bytes) 2024-09-14T09:07:55.910 INFO:teuthology.orchestra.run.smithi148.stdout:598 trunc from 0x78cb400 to 0x537a200 2024-09-14T09:07:55.936 INFO:teuthology.orchestra.run.smithi148.stdout:600 trunc from 0x537a200 to 0x87e5600 2024-09-14T09:07:55.937 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:55.939+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:55.943 INFO:teuthology.orchestra.run.smithi148.stdout:601 write 0x53c3a00 thru 0x53cc711 (0x8d12 bytes) 2024-09-14T09:07:55.944 INFO:teuthology.orchestra.run.smithi148.stdout:602 punch from 0x870ee00 to 0x8714600, (0x5800 bytes) 2024-09-14T09:07:55.962 INFO:teuthology.orchestra.run.smithi148.stdout:603 write 0xbb8d800 thru 0xbb96925 (0x9126 bytes) 2024-09-14T09:07:55.963 INFO:teuthology.orchestra.run.smithi148.stdout:606 write 0x606dc00 thru 0x6077a6f (0x9e70 bytes) 2024-09-14T09:07:55.963 INFO:teuthology.orchestra.run.smithi148.stdout:608 punch from 0x167d000 to 0x1687400, (0xa400 bytes) 2024-09-14T09:07:55.964 INFO:teuthology.orchestra.run.smithi148.stdout:612 read 0xba17400 thru 0xba19765 (0x2366 bytes) 2024-09-14T09:07:55.964 INFO:teuthology.orchestra.run.smithi148.stdout:614 write 0x757e00 thru 0x7642c8 (0xc4c9 bytes) 2024-09-14T09:07:55.966 INFO:teuthology.orchestra.run.smithi148.stdout:616 trunc from 0xbb96a00 to 0xc822e00 2024-09-14T09:07:55.986 INFO:teuthology.orchestra.run.smithi148.stdout:619 trunc from 0xc822e00 to 0x8f47200 2024-09-14T09:07:56.004 INFO:teuthology.orchestra.run.smithi148.stdout:620 read 0x24e4000 thru 0x24e7bb4 (0x3bb5 bytes) 2024-09-14T09:07:56.004 INFO:teuthology.orchestra.run.smithi148.stdout:622 read 0xc26e00 thru 0xc2ea05 (0x7c06 bytes) 2024-09-14T09:07:56.005 INFO:teuthology.orchestra.run.smithi148.stdout:625 punch from 0xd03e00 to 0xd06000, (0x2200 bytes) 2024-09-14T09:07:56.005 INFO:teuthology.orchestra.run.smithi148.stdout:627 write 0x7fc4800 thru 0x7fc7f3b (0x373c bytes) 2024-09-14T09:07:56.005 INFO:teuthology.orchestra.run.smithi148.stdout:628 clone 5 order 24 su 131072 sc 8 2024-09-14T09:07:56.008 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:56.008 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:07:56.008 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:07:56.008 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:07:56.009 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:56.017 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:07:56.063 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:56.065+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:56.123 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:07:56.123 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:07:56.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:07:56.123 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:07:56.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.124 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:39 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'21, mlcod=15'19)", 2024-09-14T09:07:56.124 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.153416+0000", 2024-09-14T09:07:56.124 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.969523200000001, 2024-09-14T09:07:56.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0064237909999999999, 2024-09-14T09:07:56.124 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:56.124 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:56.125 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:56.125 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:56.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:56.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.153416+0000", 2024-09-14T09:07:56.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:56.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.153416+0000", 2024-09-14T09:07:56.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:56.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.153417+0000", 2024-09-14T09:07:56.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9800000000000002e-07 2024-09-14T09:07:56.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:56.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.153425+0000", 2024-09-14T09:07:56.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7770000000000002e-06 2024-09-14T09:07:56.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:56.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.153439+0000", 2024-09-14T09:07:56.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4372000000000001e-05 2024-09-14T09:07:56.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.153448+0000", 2024-09-14T09:07:56.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6070000000000008e-06 2024-09-14T09:07:56.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:56.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.153501+0000", 2024-09-14T09:07:56.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3034000000000001e-05 2024-09-14T09:07:56.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:56.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.153521+0000", 2024-09-14T09:07:56.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9777999999999999e-05 2024-09-14T09:07:56.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:56.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159809+0000", 2024-09-14T09:07:56.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062885959999999996 2024-09-14T09:07:56.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:56.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159840+0000", 2024-09-14T09:07:56.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0629000000000001e-05 2024-09-14T09:07:56.133 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.133 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:56.133 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.134 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:41 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'19)", 2024-09-14T09:07:56.134 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.154530+0000", 2024-09-14T09:07:56.134 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.968409390000001, 2024-09-14T09:07:56.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097193060000000005, 2024-09-14T09:07:56.135 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:56.135 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:56.135 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:56.135 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:56.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:56.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154530+0000", 2024-09-14T09:07:56.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:56.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154530+0000", 2024-09-14T09:07:56.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:56.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154531+0000", 2024-09-14T09:07:56.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6199999999999997e-07 2024-09-14T09:07:56.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:56.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154567+0000", 2024-09-14T09:07:56.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5988000000000002e-05 2024-09-14T09:07:56.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:56.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154577+0000", 2024-09-14T09:07:56.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0366999999999999e-05 2024-09-14T09:07:56.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154583+0000", 2024-09-14T09:07:56.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3929999999999996e-06 2024-09-14T09:07:56.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:56.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154630+0000", 2024-09-14T09:07:56.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6980000000000001e-05 2024-09-14T09:07:56.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:56.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154650+0000", 2024-09-14T09:07:56.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9817999999999999e-05 2024-09-14T09:07:56.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:56.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164200+0000", 2024-09-14T09:07:56.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0095500770000000006 2024-09-14T09:07:56.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:56.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164249+0000", 2024-09-14T09:07:56.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9020999999999997e-05 2024-09-14T09:07:56.144 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.144 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:56.144 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.144 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:42 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'24, mlcod=15'19)", 2024-09-14T09:07:56.145 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:07:56.145 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.967833967000001, 2024-09-14T09:07:56.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0091673220000000003, 2024-09-14T09:07:56.145 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:56.145 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:56.145 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:56.146 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:56.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:56.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:07:56.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:56.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:07:56.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:56.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:07:56.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5000000000000001e-07 2024-09-14T09:07:56.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:56.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155113+0000", 2024-09-14T09:07:56.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8719999999999996e-06 2024-09-14T09:07:56.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:56.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155126+0000", 2024-09-14T09:07:56.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2951e-05 2024-09-14T09:07:56.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155132+0000", 2024-09-14T09:07:56.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9270000000000002e-06 2024-09-14T09:07:56.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:56.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158468+0000", 2024-09-14T09:07:56.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033357980000000001 2024-09-14T09:07:56.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:56.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158510+0000", 2024-09-14T09:07:56.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2138999999999998e-05 2024-09-14T09:07:56.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:56.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164251+0000", 2024-09-14T09:07:56.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0057413209999999998 2024-09-14T09:07:56.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:56.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164273+0000", 2024-09-14T09:07:56.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1364000000000001e-05 2024-09-14T09:07:56.153 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.153 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:56.154 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.154 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:43 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'25, mlcod=15'19)", 2024-09-14T09:07:56.154 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.155476+0000", 2024-09-14T09:07:56.154 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.967463279, 2024-09-14T09:07:56.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0092500399999999993, 2024-09-14T09:07:56.155 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:56.155 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:56.155 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:56.155 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:56.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:56.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155476+0000", 2024-09-14T09:07:56.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:56.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155476+0000", 2024-09-14T09:07:56.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:56.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155477+0000", 2024-09-14T09:07:56.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5300000000000002e-07 2024-09-14T09:07:56.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:56.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155486+0000", 2024-09-14T09:07:56.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2024-09-14T09:07:56.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:56.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155498+0000", 2024-09-14T09:07:56.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2911999999999999e-05 2024-09-14T09:07:56.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155506+0000", 2024-09-14T09:07:56.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3390000000000004e-06 2024-09-14T09:07:56.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:56.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158814+0000", 2024-09-14T09:07:56.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033078309999999998 2024-09-14T09:07:56.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:56.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158849+0000", 2024-09-14T09:07:56.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5330000000000002e-05 2024-09-14T09:07:56.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:56.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164691+0000", 2024-09-14T09:07:56.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005842346 2024-09-14T09:07:56.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:56.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164726+0000", 2024-09-14T09:07:56.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4978999999999998e-05 2024-09-14T09:07:56.166 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.166 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:56.166 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.167 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:44 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'26, mlcod=15'19)", 2024-09-14T09:07:56.167 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.155917+0000", 2024-09-14T09:07:56.167 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.967022761999999, 2024-09-14T09:07:56.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0088430230000000002, 2024-09-14T09:07:56.167 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:56.168 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:56.168 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:56.168 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:56.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:56.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155917+0000", 2024-09-14T09:07:56.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:56.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155917+0000", 2024-09-14T09:07:56.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:56.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155918+0000", 2024-09-14T09:07:56.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0359999999999999e-06 2024-09-14T09:07:56.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:56.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155951+0000", 2024-09-14T09:07:56.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3256999999999997e-05 2024-09-14T09:07:56.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:56.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155965+0000", 2024-09-14T09:07:56.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3692e-05 2024-09-14T09:07:56.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155971+0000", 2024-09-14T09:07:56.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0510000000000002e-06 2024-09-14T09:07:56.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:56.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159107+0000", 2024-09-14T09:07:56.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031363430000000002 2024-09-14T09:07:56.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:56.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159127+0000", 2024-09-14T09:07:56.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0268999999999999e-05 2024-09-14T09:07:56.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:56.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164728+0000", 2024-09-14T09:07:56.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056003629999999997 2024-09-14T09:07:56.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:56.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164760+0000", 2024-09-14T09:07:56.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2011999999999998e-05 2024-09-14T09:07:56.179 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.179 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:56.179 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.180 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:45 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'27, mlcod=15'19)", 2024-09-14T09:07:56.180 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.156503+0000", 2024-09-14T09:07:56.180 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.966436074000001, 2024-09-14T09:07:56.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082756970000000003, 2024-09-14T09:07:56.180 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:56.180 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:56.180 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:56.181 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:56.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:56.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156503+0000", 2024-09-14T09:07:56.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:56.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156503+0000", 2024-09-14T09:07:56.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:56.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156505+0000", 2024-09-14T09:07:56.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8139999999999999e-06 2024-09-14T09:07:56.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:56.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156516+0000", 2024-09-14T09:07:56.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1019000000000001e-05 2024-09-14T09:07:56.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:56.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156543+0000", 2024-09-14T09:07:56.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.692e-05 2024-09-14T09:07:56.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156556+0000", 2024-09-14T09:07:56.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3063e-05 2024-09-14T09:07:56.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:56.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159573+0000", 2024-09-14T09:07:56.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003016712 2024-09-14T09:07:56.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:56.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159589+0000", 2024-09-14T09:07:56.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6494000000000002e-05 2024-09-14T09:07:56.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:56.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164762+0000", 2024-09-14T09:07:56.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051722519999999996 2024-09-14T09:07:56.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:56.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164779+0000", 2024-09-14T09:07:56.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7422999999999999e-05 2024-09-14T09:07:56.188 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.188 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:46 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'28, mlcod=15'19)", 2024-09-14T09:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.156804+0000", 2024-09-14T09:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.966134985, 2024-09-14T09:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079926879999999995, 2024-09-14T09:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156804+0000", 2024-09-14T09:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156804+0000", 2024-09-14T09:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156805+0000", 2024-09-14T09:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3099999999999998e-07 2024-09-14T09:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156809+0000", 2024-09-14T09:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8299999999999998e-06 2024-09-14T09:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156817+0000", 2024-09-14T09:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7579999999999992e-06 2024-09-14T09:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156831+0000", 2024-09-14T09:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4256999999999999e-05 2024-09-14T09:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159903+0000", 2024-09-14T09:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030721590000000001 2024-09-14T09:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159922+0000", 2024-09-14T09:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8994000000000001e-05 2024-09-14T09:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164780+0000", 2024-09-14T09:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048582879999999997 2024-09-14T09:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164797+0000", 2024-09-14T09:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6971000000000001e-05 2024-09-14T09:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:47 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'29, mlcod=15'19)", 2024-09-14T09:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.157344+0000", 2024-09-14T09:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.965595777000001, 2024-09-14T09:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074729030000000004, 2024-09-14T09:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157344+0000", 2024-09-14T09:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157344+0000", 2024-09-14T09:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157346+0000", 2024-09-14T09:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.81e-06 2024-09-14T09:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157406+0000", 2024-09-14T09:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0523000000000003e-05 2024-09-14T09:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157434+0000", 2024-09-14T09:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8059999999999999e-05 2024-09-14T09:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157447+0000", 2024-09-14T09:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2666e-05 2024-09-14T09:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160183+0000", 2024-09-14T09:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002736413 2024-09-14T09:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160203+0000", 2024-09-14T09:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9545e-05 2024-09-14T09:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164798+0000", 2024-09-14T09:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045953890000000001 2024-09-14T09:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164817+0000", 2024-09-14T09:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8496999999999999e-05 2024-09-14T09:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:48 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'30, mlcod=15'19)", 2024-09-14T09:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.157693+0000", 2024-09-14T09:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.965246512, 2024-09-14T09:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0071445789999999999, 2024-09-14T09:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157693+0000", 2024-09-14T09:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157693+0000", 2024-09-14T09:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157694+0000", 2024-09-14T09:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2024-09-14T09:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157701+0000", 2024-09-14T09:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0230000000000004e-06 2024-09-14T09:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157709+0000", 2024-09-14T09:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7819999999999999e-06 2024-09-14T09:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157714+0000", 2024-09-14T09:07:56.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2440000000000004e-06 2024-09-14T09:07:56.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:56.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160598+0000", 2024-09-14T09:07:56.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028844280000000001 2024-09-14T09:07:56.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:56.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160618+0000", 2024-09-14T09:07:56.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0435e-05 2024-09-14T09:07:56.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164818+0000", 2024-09-14T09:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042000329999999997 2024-09-14T09:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164838+0000", 2024-09-14T09:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9054000000000001e-05 2024-09-14T09:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:49 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'31, mlcod=15'19)", 2024-09-14T09:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.158173+0000", 2024-09-14T09:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.964766849, 2024-09-14T09:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0066833700000000001, 2024-09-14T09:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158173+0000", 2024-09-14T09:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158173+0000", 2024-09-14T09:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158175+0000", 2024-09-14T09:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8840000000000001e-06 2024-09-14T09:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158188+0000", 2024-09-14T09:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3842999999999999e-05 2024-09-14T09:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158225+0000", 2024-09-14T09:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7039000000000002e-05 2024-09-14T09:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158243+0000", 2024-09-14T09:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7932999999999999e-05 2024-09-14T09:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160875+0000", 2024-09-14T09:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002632045 2024-09-14T09:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160887+0000", 2024-09-14T09:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2084e-05 2024-09-14T09:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164839+0000", 2024-09-14T09:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039511390000000002 2024-09-14T09:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164856+0000", 2024-09-14T09:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7402999999999999e-05 2024-09-14T09:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:50 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'19)", 2024-09-14T09:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.158531+0000", 2024-09-14T09:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.964408701, 2024-09-14T09:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063435460000000003, 2024-09-14T09:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158531+0000", 2024-09-14T09:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158531+0000", 2024-09-14T09:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158532+0000", 2024-09-14T09:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2600000000000001e-07 2024-09-14T09:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158584+0000", 2024-09-14T09:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2419000000000001e-05 2024-09-14T09:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158594+0000", 2024-09-14T09:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0056e-05 2024-09-14T09:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158602+0000", 2024-09-14T09:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4950000000000002e-06 2024-09-14T09:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.161122+0000", 2024-09-14T09:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025202940000000002 2024-09-14T09:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.161141+0000", 2024-09-14T09:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.946e-05 2024-09-14T09:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164857+0000", 2024-09-14T09:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037154829999999999 2024-09-14T09:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164874+0000", 2024-09-14T09:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7413000000000001e-05 2024-09-14T09:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:56 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'38, mlcod=15'33)", 2024-09-14T09:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.167691+0000", 2024-09-14T09:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.955248901000001, 2024-09-14T09:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063426649999999999, 2024-09-14T09:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.167691+0000", 2024-09-14T09:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.167691+0000", 2024-09-14T09:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.167691+0000", 2024-09-14T09:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8999999999999997e-07 2024-09-14T09:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.167778+0000", 2024-09-14T09:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6996000000000005e-05 2024-09-14T09:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.167786+0000", 2024-09-14T09:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4300000000000006e-06 2024-09-14T09:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.167791+0000", 2024-09-14T09:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1690000000000002e-06 2024-09-14T09:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.167828+0000", 2024-09-14T09:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6844000000000002e-05 2024-09-14T09:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.167842+0000", 2024-09-14T09:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4569999999999999e-05 2024-09-14T09:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.173998+0000", 2024-09-14T09:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061557729999999998 2024-09-14T09:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.174033+0000", 2024-09-14T09:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5392999999999998e-05 2024-09-14T09:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:66 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'44, mlcod=15'40)", 2024-09-14T09:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.430075+0000", 2024-09-14T09:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.692864663000002, 2024-09-14T09:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070127770000000004, 2024-09-14T09:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430075+0000", 2024-09-14T09:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430075+0000", 2024-09-14T09:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430076+0000", 2024-09-14T09:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4200000000000005e-07 2024-09-14T09:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430131+0000", 2024-09-14T09:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099000000000002e-05 2024-09-14T09:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430141+0000", 2024-09-14T09:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.978e-06 2024-09-14T09:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430145+0000", 2024-09-14T09:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4519999999999999e-06 2024-09-14T09:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430189+0000", 2024-09-14T09:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3924000000000002e-05 2024-09-14T09:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430202+0000", 2024-09-14T09:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3319000000000001e-05 2024-09-14T09:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437052+0000", 2024-09-14T09:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0068491389999999997 2024-09-14T09:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437088+0000", 2024-09-14T09:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6023999999999999e-05 2024-09-14T09:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:67 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'45, mlcod=15'40)", 2024-09-14T09:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.430561+0000", 2024-09-14T09:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.692378134999998, 2024-09-14T09:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065458490000000003, 2024-09-14T09:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430561+0000", 2024-09-14T09:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430561+0000", 2024-09-14T09:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430562+0000", 2024-09-14T09:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1500000000000005e-07 2024-09-14T09:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430566+0000", 2024-09-14T09:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8589999999999998e-06 2024-09-14T09:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430572+0000", 2024-09-14T09:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5390000000000004e-06 2024-09-14T09:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430576+0000", 2024-09-14T09:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4879999999999999e-06 2024-09-14T09:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430724+0000", 2024-09-14T09:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000148107 2024-09-14T09:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430775+0000", 2024-09-14T09:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1010000000000001e-05 2024-09-14T09:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437090+0000", 2024-09-14T09:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063148129999999998 2024-09-14T09:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437107+0000", 2024-09-14T09:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7518000000000001e-05 2024-09-14T09:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:68 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'46, mlcod=15'40)", 2024-09-14T09:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.430910+0000", 2024-09-14T09:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.692029389999998, 2024-09-14T09:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062144690000000002, 2024-09-14T09:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430910+0000", 2024-09-14T09:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430910+0000", 2024-09-14T09:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430911+0000", 2024-09-14T09:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8400000000000003e-07 2024-09-14T09:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430916+0000", 2024-09-14T09:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.259e-06 2024-09-14T09:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430928+0000", 2024-09-14T09:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1931e-05 2024-09-14T09:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430933+0000", 2024-09-14T09:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2310000000000004e-06 2024-09-14T09:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430988+0000", 2024-09-14T09:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5050999999999999e-05 2024-09-14T09:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.431002+0000", 2024-09-14T09:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3134e-05 2024-09-14T09:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437109+0000", 2024-09-14T09:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006106981 2024-09-14T09:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437125+0000", 2024-09-14T09:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5998000000000002e-05 2024-09-14T09:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:72 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'50, mlcod=15'41)", 2024-09-14T09:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.432562+0000", 2024-09-14T09:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.690377611999999, 2024-09-14T09:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065129940000000002, 2024-09-14T09:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.432562+0000", 2024-09-14T09:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.432562+0000", 2024-09-14T09:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.432562+0000", 2024-09-14T09:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.432632+0000", 2024-09-14T09:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9482999999999999e-05 2024-09-14T09:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.432641+0000", 2024-09-14T09:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6950000000000006e-06 2024-09-14T09:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.432644+0000", 2024-09-14T09:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3000000000000002e-06 2024-09-14T09:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.434040+0000", 2024-09-14T09:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001395683 2024-09-14T09:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.434053+0000", 2024-09-14T09:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3013000000000001e-05 2024-09-14T09:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.439046+0000", 2024-09-14T09:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049934749999999998 2024-09-14T09:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.439075+0000", 2024-09-14T09:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8846000000000001e-05 2024-09-14T09:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:73 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'51, mlcod=15'41)", 2024-09-14T09:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.433184+0000", 2024-09-14T09:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.689755897000001, 2024-09-14T09:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063181870000000003, 2024-09-14T09:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433184+0000", 2024-09-14T09:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433184+0000", 2024-09-14T09:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433185+0000", 2024-09-14T09:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6700000000000002e-07 2024-09-14T09:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433193+0000", 2024-09-14T09:07:56.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3329999999999997e-06 2024-09-14T09:07:56.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:56.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433284+0000", 2024-09-14T09:07:56.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1602999999999997e-05 2024-09-14T09:07:56.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433298+0000", 2024-09-14T09:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.311e-05 2024-09-14T09:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.436150+0000", 2024-09-14T09:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002852659 2024-09-14T09:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.436165+0000", 2024-09-14T09:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4722999999999999e-05 2024-09-14T09:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.439476+0000", 2024-09-14T09:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033114059999999998 2024-09-14T09:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.439502+0000", 2024-09-14T09:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5386000000000001e-05 2024-09-14T09:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:74 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'52, mlcod=15'41)", 2024-09-14T09:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.433529+0000", 2024-09-14T09:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.689410275, 2024-09-14T09:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059868580000000003, 2024-09-14T09:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433529+0000", 2024-09-14T09:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433529+0000", 2024-09-14T09:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433530+0000", 2024-09-14T09:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9100000000000004e-07 2024-09-14T09:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433534+0000", 2024-09-14T09:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2470000000000002e-06 2024-09-14T09:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433542+0000", 2024-09-14T09:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6229999999999997e-06 2024-09-14T09:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.433545+0000", 2024-09-14T09:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3749999999999999e-06 2024-09-14T09:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.436419+0000", 2024-09-14T09:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028736199999999999 2024-09-14T09:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.436432+0000", 2024-09-14T09:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3899e-05 2024-09-14T09:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.439503+0000", 2024-09-14T09:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030706890000000001 2024-09-14T09:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.439516+0000", 2024-09-14T09:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2914e-05 2024-09-14T09:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:89 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'63, mlcod=16'60)", 2024-09-14T09:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.666744+0000", 2024-09-14T09:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.456195676, 2024-09-14T09:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061730250000000004, 2024-09-14T09:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.666744+0000", 2024-09-14T09:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.666744+0000", 2024-09-14T09:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.666744+0000", 2024-09-14T09:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6000000000000004e-07 2024-09-14T09:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.666749+0000", 2024-09-14T09:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0359999999999997e-06 2024-09-14T09:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.666754+0000", 2024-09-14T09:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0420000000000002e-06 2024-09-14T09:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.666758+0000", 2024-09-14T09:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2179999999999999e-06 2024-09-14T09:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.666895+0000", 2024-09-14T09:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000137241 2024-09-14T09:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.666908+0000", 2024-09-14T09:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2964e-05 2024-09-14T09:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.672887+0000", 2024-09-14T09:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005978845 2024-09-14T09:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.672917+0000", 2024-09-14T09:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0119000000000001e-05 2024-09-14T09:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1024 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.966579+0000", 2024-09-14T09:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.156360097, 2024-09-14T09:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069169419999999997, 2024-09-14T09:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1024 2024-09-14T09:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966579+0000", 2024-09-14T09:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966579+0000", 2024-09-14T09:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966580+0000", 2024-09-14T09:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000002e-07 2024-09-14T09:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966582+0000", 2024-09-14T09:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0040000000000002e-06 2024-09-14T09:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966588+0000", 2024-09-14T09:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6959999999999999e-06 2024-09-14T09:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966592+0000", 2024-09-14T09:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2370000000000001e-06 2024-09-14T09:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.967468+0000", 2024-09-14T09:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00087601900000000002 2024-09-14T09:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.967562+0000", 2024-09-14T09:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4543000000000006e-05 2024-09-14T09:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.967905+0000", 2024-09-14T09:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00034289100000000001 2024-09-14T09:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.968973+0000", 2024-09-14T09:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010677530000000001 2024-09-14T09:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.973420+0000", 2024-09-14T09:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044470810000000003 2024-09-14T09:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.973455+0000", 2024-09-14T09:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5018000000000003e-05 2024-09-14T09:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:07:56.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:07:56.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.973496+0000", 2024-09-14T09:07:56.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1303000000000001e-05 2024-09-14T09:07:56.253 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.253 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:56.253 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.253 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:07:56.253 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:07:56.253 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:07:56.255 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:56.257+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:56.255 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:07:56.332 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is set 2024-09-14T09:07:56.355 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:56.357+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:56.363 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:56.364 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:07:56.364 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:07:56.364 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:56.372 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:07:56.406 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone4 from 0x8f47200 (overlap 0x2535000) to 0x1a0b800 2024-09-14T09:07:56.456 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:56.458+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:56.522 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:56.522 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:07:56.522 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:07:56.522 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:07:56.523 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:56.531 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:07:56.575 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:56.577+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:07:56.604 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:07:56.644 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:56.644 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:07:56.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:07:56.645 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:07:56.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.645 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:654 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 1179648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:56.645 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862916+0000", 2024-09-14T09:07:56.645 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.78271517199999996, 2024-09-14T09:07:56.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012658305, 2024-09-14T09:07:56.645 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:56.645 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:56.645 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:56.645 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:56.645 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:56.645 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:56.645 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 654 2024-09-14T09:07:56.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.646 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:56.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:56.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862916+0000", 2024-09-14T09:07:56.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:56.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862916+0000", 2024-09-14T09:07:56.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:56.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862916+0000", 2024-09-14T09:07:56.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:07:56.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:56.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862918+0000", 2024-09-14T09:07:56.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.018e-06 2024-09-14T09:07:56.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:56.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862924+0000", 2024-09-14T09:07:56.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7799999999999997e-06 2024-09-14T09:07:56.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862929+0000", 2024-09-14T09:07:56.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6160000000000004e-06 2024-09-14T09:07:56.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:56.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875412+0000", 2024-09-14T09:07:56.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012482804 2024-09-14T09:07:56.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:56.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875479+0000", 2024-09-14T09:07:56.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7661000000000002e-05 2024-09-14T09:07:56.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:56.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875574+0000", 2024-09-14T09:07:56.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5050999999999995e-05 2024-09-14T09:07:56.649 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.649 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:56.649 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.649 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:655 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 2621440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:56.649 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862936+0000", 2024-09-14T09:07:56.649 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.78269535499999998, 2024-09-14T09:07:56.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012886771999999999, 2024-09-14T09:07:56.649 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:56.649 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:56.649 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:56.650 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:56.650 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:56.650 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:56.650 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 655 2024-09-14T09:07:56.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.650 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:56.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:56.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862936+0000", 2024-09-14T09:07:56.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:56.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862936+0000", 2024-09-14T09:07:56.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:56.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862936+0000", 2024-09-14T09:07:56.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.41e-07 2024-09-14T09:07:56.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:56.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862938+0000", 2024-09-14T09:07:56.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0480000000000001e-06 2024-09-14T09:07:56.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:56.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862944+0000", 2024-09-14T09:07:56.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9710000000000001e-06 2024-09-14T09:07:56.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862957+0000", 2024-09-14T09:07:56.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2438e-05 2024-09-14T09:07:56.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:56.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875625+0000", 2024-09-14T09:07:56.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012668789 2024-09-14T09:07:56.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:56.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875710+0000", 2024-09-14T09:07:56.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4753999999999995e-05 2024-09-14T09:07:56.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:56.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875823+0000", 2024-09-14T09:07:56.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011243099999999999 2024-09-14T09:07:56.653 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.653 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:56.653 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.653 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:656 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:56.653 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862975+0000", 2024-09-14T09:07:56.653 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.78265673700000005, 2024-09-14T09:07:56.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013016366999999999, 2024-09-14T09:07:56.654 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:56.654 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:56.654 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:56.654 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:56.654 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:56.654 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:56.654 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 656 2024-09-14T09:07:56.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.654 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:56.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:56.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862975+0000", 2024-09-14T09:07:56.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:56.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862975+0000", 2024-09-14T09:07:56.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:56.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862975+0000", 2024-09-14T09:07:56.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5099999999999999e-07 2024-09-14T09:07:56.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:56.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862977+0000", 2024-09-14T09:07:56.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2819999999999999e-06 2024-09-14T09:07:56.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:56.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862984+0000", 2024-09-14T09:07:56.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4489999999999996e-06 2024-09-14T09:07:56.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862995+0000", 2024-09-14T09:07:56.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0655999999999999e-05 2024-09-14T09:07:56.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:56.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875873+0000", 2024-09-14T09:07:56.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012878466999999999 2024-09-14T09:07:56.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:56.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875922+0000", 2024-09-14T09:07:56.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9038e-05 2024-09-14T09:07:56.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:56.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875991+0000", 2024-09-14T09:07:56.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8824000000000004e-05 2024-09-14T09:07:56.657 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.658 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:56.658 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.658 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:657 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:56.658 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863002+0000", 2024-09-14T09:07:56.658 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.78262929699999995, 2024-09-14T09:07:56.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013236974, 2024-09-14T09:07:56.658 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:56.658 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:56.658 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:56.658 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:56.658 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:56.659 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:56.659 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 657 2024-09-14T09:07:56.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.659 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:56.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:56.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863002+0000", 2024-09-14T09:07:56.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:56.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863002+0000", 2024-09-14T09:07:56.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:56.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863002+0000", 2024-09-14T09:07:56.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3000000000000001e-07 2024-09-14T09:07:56.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:56.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863005+0000", 2024-09-14T09:07:56.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0329999999999998e-06 2024-09-14T09:07:56.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:56.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863010+0000", 2024-09-14T09:07:56.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7799999999999997e-06 2024-09-14T09:07:56.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863015+0000", 2024-09-14T09:07:56.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6070000000000001e-06 2024-09-14T09:07:56.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:56.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876045+0000", 2024-09-14T09:07:56.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013029987999999999 2024-09-14T09:07:56.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:56.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876130+0000", 2024-09-14T09:07:56.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5347999999999997e-05 2024-09-14T09:07:56.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:56.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876239+0000", 2024-09-14T09:07:56.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000108688 2024-09-14T09:07:56.662 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.662 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:56.662 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.662 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:690 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:56.662 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863199+0000", 2024-09-14T09:07:56.662 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.78243218800000003, 2024-09-14T09:07:56.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013255059, 2024-09-14T09:07:56.663 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:56.663 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:56.663 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:56.663 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:56.663 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:56.663 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:56.663 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 690 2024-09-14T09:07:56.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.663 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:56.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:56.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863199+0000", 2024-09-14T09:07:56.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:56.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863199+0000", 2024-09-14T09:07:56.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:56.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863200+0000", 2024-09-14T09:07:56.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9800000000000004e-07 2024-09-14T09:07:56.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:56.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863201+0000", 2024-09-14T09:07:56.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8080000000000001e-06 2024-09-14T09:07:56.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:56.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863207+0000", 2024-09-14T09:07:56.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7790000000000001e-06 2024-09-14T09:07:56.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863212+0000", 2024-09-14T09:07:56.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2789999999999998e-06 2024-09-14T09:07:56.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:56.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876282+0000", 2024-09-14T09:07:56.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013069414999999999 2024-09-14T09:07:56.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:56.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876363+0000", 2024-09-14T09:07:56.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1055000000000002e-05 2024-09-14T09:07:56.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:56.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876454+0000", 2024-09-14T09:07:56.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1224999999999995e-05 2024-09-14T09:07:56.666 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.666 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:56.666 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.667 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:691 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 2752512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:56.667 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863219+0000", 2024-09-14T09:07:56.667 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.78241224200000004, 2024-09-14T09:07:56.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013427955, 2024-09-14T09:07:56.667 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:56.667 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:56.667 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:56.667 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:56.667 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:56.667 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:56.667 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 691 2024-09-14T09:07:56.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.668 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:56.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:56.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863219+0000", 2024-09-14T09:07:56.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:56.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863219+0000", 2024-09-14T09:07:56.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:56.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863219+0000", 2024-09-14T09:07:56.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.39e-07 2024-09-14T09:07:56.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:56.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863221+0000", 2024-09-14T09:07:56.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.753e-06 2024-09-14T09:07:56.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:56.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863227+0000", 2024-09-14T09:07:56.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.896e-06 2024-09-14T09:07:56.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863232+0000", 2024-09-14T09:07:56.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5310000000000003e-06 2024-09-14T09:07:56.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:56.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876501+0000", 2024-09-14T09:07:56.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013269197999999999 2024-09-14T09:07:56.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:56.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876580+0000", 2024-09-14T09:07:56.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9487999999999995e-05 2024-09-14T09:07:56.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:56.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876647+0000", 2024-09-14T09:07:56.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6749999999999996e-05 2024-09-14T09:07:56.671 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.671 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:56.671 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.671 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:692 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:56.671 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863238+0000", 2024-09-14T09:07:56.671 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.78239346200000004, 2024-09-14T09:07:56.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013610064, 2024-09-14T09:07:56.672 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:56.672 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:56.672 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:56.672 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:56.672 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:56.672 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:56.672 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 692 2024-09-14T09:07:56.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.672 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:56.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:56.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863238+0000", 2024-09-14T09:07:56.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:56.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863238+0000", 2024-09-14T09:07:56.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:56.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863238+0000", 2024-09-14T09:07:56.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.39e-07 2024-09-14T09:07:56.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:56.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863240+0000", 2024-09-14T09:07:56.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.649e-06 2024-09-14T09:07:56.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:56.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863246+0000", 2024-09-14T09:07:56.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7869999999999998e-06 2024-09-14T09:07:56.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863250+0000", 2024-09-14T09:07:56.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5850000000000001e-06 2024-09-14T09:07:56.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:56.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876683+0000", 2024-09-14T09:07:56.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013432372999999999 2024-09-14T09:07:56.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:56.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876763+0000", 2024-09-14T09:07:56.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9951999999999996e-05 2024-09-14T09:07:56.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:56.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876848+0000", 2024-09-14T09:07:56.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5278999999999994e-05 2024-09-14T09:07:56.675 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.676 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:56.676 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.676 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:693 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 5701632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:56.676 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863257+0000", 2024-09-14T09:07:56.676 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.78237437399999998, 2024-09-14T09:07:56.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013728496999999999, 2024-09-14T09:07:56.676 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:56.676 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:56.676 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:56.676 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:56.676 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:56.676 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:56.677 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 693 2024-09-14T09:07:56.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.677 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:56.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:56.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863257+0000", 2024-09-14T09:07:56.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:56.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863257+0000", 2024-09-14T09:07:56.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:56.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863257+0000", 2024-09-14T09:07:56.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5600000000000001e-07 2024-09-14T09:07:56.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:56.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863259+0000", 2024-09-14T09:07:56.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.736e-06 2024-09-14T09:07:56.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:56.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863265+0000", 2024-09-14T09:07:56.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9150000000000001e-06 2024-09-14T09:07:56.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863269+0000", 2024-09-14T09:07:56.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5390000000000001e-06 2024-09-14T09:07:56.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:56.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876880+0000", 2024-09-14T09:07:56.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013610587 2024-09-14T09:07:56.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:56.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876925+0000", 2024-09-14T09:07:56.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4820000000000001e-05 2024-09-14T09:07:56.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:56.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876985+0000", 2024-09-14T09:07:56.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0544000000000002e-05 2024-09-14T09:07:56.680 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.680 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:56.680 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.680 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:694 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:56.680 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863275+0000", 2024-09-14T09:07:56.680 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.782356104, 2024-09-14T09:07:56.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013905130999999999, 2024-09-14T09:07:56.680 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:56.680 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:56.681 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:56.681 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:56.681 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:56.681 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:56.681 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 694 2024-09-14T09:07:56.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.681 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:56.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:56.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863275+0000", 2024-09-14T09:07:56.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:56.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863275+0000", 2024-09-14T09:07:56.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:56.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863275+0000", 2024-09-14T09:07:56.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3200000000000001e-07 2024-09-14T09:07:56.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:56.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863277+0000", 2024-09-14T09:07:56.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7799999999999999e-06 2024-09-14T09:07:56.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:56.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863283+0000", 2024-09-14T09:07:56.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6529999999999999e-06 2024-09-14T09:07:56.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863287+0000", 2024-09-14T09:07:56.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.374e-06 2024-09-14T09:07:56.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:56.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877018+0000", 2024-09-14T09:07:56.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01373095 2024-09-14T09:07:56.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:56.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877088+0000", 2024-09-14T09:07:56.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9986000000000004e-05 2024-09-14T09:07:56.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:56.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877180+0000", 2024-09-14T09:07:56.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2056000000000001e-05 2024-09-14T09:07:56.684 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.684 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:56.684 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.685 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:695 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 2752512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:56.685 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863293+0000", 2024-09-14T09:07:56.685 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.78233806900000002, 2024-09-14T09:07:56.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014059326, 2024-09-14T09:07:56.685 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:56.685 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:56.685 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:56.685 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:56.685 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:56.685 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:56.685 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 695 2024-09-14T09:07:56.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.685 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:56.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:56.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863293+0000", 2024-09-14T09:07:56.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:56.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863293+0000", 2024-09-14T09:07:56.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:56.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863294+0000", 2024-09-14T09:07:56.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2800000000000003e-07 2024-09-14T09:07:56.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:56.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863308+0000", 2024-09-14T09:07:56.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.453e-05 2024-09-14T09:07:56.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:56.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863316+0000", 2024-09-14T09:07:56.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4730000000000003e-06 2024-09-14T09:07:56.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863321+0000", 2024-09-14T09:07:56.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1159999999999998e-06 2024-09-14T09:07:56.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:56.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877217+0000", 2024-09-14T09:07:56.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013896116 2024-09-14T09:07:56.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:56.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877271+0000", 2024-09-14T09:07:56.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4450000000000002e-05 2024-09-14T09:07:56.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:56.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877353+0000", 2024-09-14T09:07:56.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1312999999999999e-05 2024-09-14T09:07:56.689 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.689 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:56.689 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.689 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:696 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:56.689 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863341+0000", 2024-09-14T09:07:56.689 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.78229037300000004, 2024-09-14T09:07:56.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01426848, 2024-09-14T09:07:56.689 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:56.689 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:56.689 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:56.689 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:56.690 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:56.690 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:56.690 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 696 2024-09-14T09:07:56.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.690 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:56.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:56.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863341+0000", 2024-09-14T09:07:56.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:56.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863341+0000", 2024-09-14T09:07:56.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:56.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863342+0000", 2024-09-14T09:07:56.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.44e-07 2024-09-14T09:07:56.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:56.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863344+0000", 2024-09-14T09:07:56.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2400000000000002e-06 2024-09-14T09:07:56.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:56.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863350+0000", 2024-09-14T09:07:56.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.579e-06 2024-09-14T09:07:56.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863355+0000", 2024-09-14T09:07:56.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.549e-06 2024-09-14T09:07:56.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:56.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877400+0000", 2024-09-14T09:07:56.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014044911 2024-09-14T09:07:56.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:56.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877496+0000", 2024-09-14T09:07:56.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6105000000000002e-05 2024-09-14T09:07:56.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:56.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877609+0000", 2024-09-14T09:07:56.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000113452 2024-09-14T09:07:56.693 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.693 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:56.693 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.693 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:697 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 5701632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:56.693 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863362+0000", 2024-09-14T09:07:56.693 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.78226973200000005, 2024-09-14T09:07:56.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014418841999999999, 2024-09-14T09:07:56.694 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:56.694 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:56.694 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:56.694 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:56.694 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:56.694 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:56.694 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 697 2024-09-14T09:07:56.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.694 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:56.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:56.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863362+0000", 2024-09-14T09:07:56.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:56.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863362+0000", 2024-09-14T09:07:56.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:56.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863362+0000", 2024-09-14T09:07:56.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.46e-07 2024-09-14T09:07:56.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:56.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863364+0000", 2024-09-14T09:07:56.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.624e-06 2024-09-14T09:07:56.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:56.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863369+0000", 2024-09-14T09:07:56.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7400000000000001e-06 2024-09-14T09:07:56.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863383+0000", 2024-09-14T09:07:56.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3582e-05 2024-09-14T09:07:56.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:56.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877652+0000", 2024-09-14T09:07:56.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014269298999999999 2024-09-14T09:07:56.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:56.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877721+0000", 2024-09-14T09:07:56.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8881999999999995e-05 2024-09-14T09:07:56.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:56.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877780+0000", 2024-09-14T09:07:56.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9268999999999998e-05 2024-09-14T09:07:56.697 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.697 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:56.697 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.698 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:730 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 1376256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:56.698 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863562+0000", 2024-09-14T09:07:56.698 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.78206920800000002, 2024-09-14T09:07:56.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014435170000000001, 2024-09-14T09:07:56.698 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:56.698 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:56.698 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:56.698 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:56.698 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:56.698 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:56.698 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 730 2024-09-14T09:07:56.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.698 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:56.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:56.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863562+0000", 2024-09-14T09:07:56.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:56.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863562+0000", 2024-09-14T09:07:56.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:56.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863562+0000", 2024-09-14T09:07:56.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.65e-07 2024-09-14T09:07:56.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:56.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863570+0000", 2024-09-14T09:07:56.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8189999999999992e-06 2024-09-14T09:07:56.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:56.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863576+0000", 2024-09-14T09:07:56.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7420000000000003e-06 2024-09-14T09:07:56.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863585+0000", 2024-09-14T09:07:56.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3000000000000007e-06 2024-09-14T09:07:56.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:56.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877818+0000", 2024-09-14T09:07:56.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014232463000000001 2024-09-14T09:07:56.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:56.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877898+0000", 2024-09-14T09:07:56.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0012999999999994e-05 2024-09-14T09:07:56.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:56.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877997+0000", 2024-09-14T09:07:56.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9468000000000004e-05 2024-09-14T09:07:56.702 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.702 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:56.702 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.702 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:731 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:56.702 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863593+0000", 2024-09-14T09:07:56.702 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.78203836599999998, 2024-09-14T09:07:56.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014635227000000001, 2024-09-14T09:07:56.702 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:56.702 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:56.702 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:56.702 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:56.703 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:56.703 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:56.703 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 731 2024-09-14T09:07:56.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.703 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:56.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:56.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863593+0000", 2024-09-14T09:07:56.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:56.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863593+0000", 2024-09-14T09:07:56.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:56.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863593+0000", 2024-09-14T09:07:56.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.08e-07 2024-09-14T09:07:56.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:56.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863600+0000", 2024-09-14T09:07:56.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6250000000000001e-06 2024-09-14T09:07:56.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:56.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863606+0000", 2024-09-14T09:07:56.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0270000000000001e-06 2024-09-14T09:07:56.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863611+0000", 2024-09-14T09:07:56.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1420000000000001e-06 2024-09-14T09:07:56.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:56.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878041+0000", 2024-09-14T09:07:56.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014430121000000001 2024-09-14T09:07:56.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:56.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878128+0000", 2024-09-14T09:07:56.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6562000000000002e-05 2024-09-14T09:07:56.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:56.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878228+0000", 2024-09-14T09:07:56.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000100342 2024-09-14T09:07:56.706 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.706 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:56.706 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.707 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:732 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 4325376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:56.707 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863618+0000", 2024-09-14T09:07:56.707 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.78201368699999996, 2024-09-14T09:07:56.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014825102999999999, 2024-09-14T09:07:56.707 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:56.707 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:56.707 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:56.707 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:56.707 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:56.707 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:56.707 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 732 2024-09-14T09:07:56.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.707 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:56.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:56.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863618+0000", 2024-09-14T09:07:56.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:56.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863618+0000", 2024-09-14T09:07:56.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:56.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863618+0000", 2024-09-14T09:07:56.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6399999999999998e-07 2024-09-14T09:07:56.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:56.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863620+0000", 2024-09-14T09:07:56.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6559999999999999e-06 2024-09-14T09:07:56.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:56.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863626+0000", 2024-09-14T09:07:56.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5799999999999997e-06 2024-09-14T09:07:56.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863631+0000", 2024-09-14T09:07:56.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2830000000000001e-06 2024-09-14T09:07:56.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:56.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878274+0000", 2024-09-14T09:07:56.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014642426 2024-09-14T09:07:56.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:56.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878348+0000", 2024-09-14T09:07:56.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4209999999999996e-05 2024-09-14T09:07:56.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:56.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878443+0000", 2024-09-14T09:07:56.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4584000000000001e-05 2024-09-14T09:07:56.710 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.711 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:56.711 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.711 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:733 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:56.711 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863638+0000", 2024-09-14T09:07:56.711 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.78199362500000003, 2024-09-14T09:07:56.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01497658, 2024-09-14T09:07:56.711 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:56.711 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:56.711 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:56.711 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:56.711 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:56.711 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:56.711 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 733 2024-09-14T09:07:56.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.712 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:56.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:56.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863638+0000", 2024-09-14T09:07:56.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:56.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863638+0000", 2024-09-14T09:07:56.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:56.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863638+0000", 2024-09-14T09:07:56.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7e-07 2024-09-14T09:07:56.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:56.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863640+0000", 2024-09-14T09:07:56.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.765e-06 2024-09-14T09:07:56.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:56.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863646+0000", 2024-09-14T09:07:56.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9109999999999998e-06 2024-09-14T09:07:56.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863650+0000", 2024-09-14T09:07:56.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7099999999999998e-06 2024-09-14T09:07:56.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:56.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878476+0000", 2024-09-14T09:07:56.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014825408 2024-09-14T09:07:56.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:56.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878522+0000", 2024-09-14T09:07:56.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5731e-05 2024-09-14T09:07:56.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:56.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878614+0000", 2024-09-14T09:07:56.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2684999999999998e-05 2024-09-14T09:07:56.715 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.715 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:56.715 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.715 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:734 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 1376256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:56.715 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863656+0000", 2024-09-14T09:07:56.715 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.781975266, 2024-09-14T09:07:56.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015170861000000001, 2024-09-14T09:07:56.715 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:56.715 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:56.715 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:56.716 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:56.716 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:56.716 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:56.716 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 734 2024-09-14T09:07:56.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.716 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:56.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:56.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863656+0000", 2024-09-14T09:07:56.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:56.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863656+0000", 2024-09-14T09:07:56.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:56.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863656+0000", 2024-09-14T09:07:56.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4200000000000002e-07 2024-09-14T09:07:56.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:56.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863658+0000", 2024-09-14T09:07:56.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.685e-06 2024-09-14T09:07:56.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:56.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863665+0000", 2024-09-14T09:07:56.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5610000000000004e-06 2024-09-14T09:07:56.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863669+0000", 2024-09-14T09:07:56.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7899999999999999e-06 2024-09-14T09:07:56.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:56.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878654+0000", 2024-09-14T09:07:56.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014984877000000001 2024-09-14T09:07:56.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:56.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878731+0000", 2024-09-14T09:07:56.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6627999999999999e-05 2024-09-14T09:07:56.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:56.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878827+0000", 2024-09-14T09:07:56.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5977999999999995e-05 2024-09-14T09:07:56.719 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.719 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:56.719 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.719 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:735 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 2818048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:56.720 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863676+0000", 2024-09-14T09:07:56.720 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.78195571399999997, 2024-09-14T09:07:56.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015314884000000001, 2024-09-14T09:07:56.720 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:56.720 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:56.720 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:56.720 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:56.720 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:56.720 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:56.720 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 735 2024-09-14T09:07:56.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.720 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:56.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:56.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863676+0000", 2024-09-14T09:07:56.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:56.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863676+0000", 2024-09-14T09:07:56.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:56.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863676+0000", 2024-09-14T09:07:56.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9699999999999996e-07 2024-09-14T09:07:56.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:56.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863678+0000", 2024-09-14T09:07:56.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.73e-06 2024-09-14T09:07:56.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:56.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863683+0000", 2024-09-14T09:07:56.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7089999999999999e-06 2024-09-14T09:07:56.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863688+0000", 2024-09-14T09:07:56.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4209999999999997e-06 2024-09-14T09:07:56.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:56.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878858+0000", 2024-09-14T09:07:56.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015170243 2024-09-14T09:07:56.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:56.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878898+0000", 2024-09-14T09:07:56.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9471999999999997e-05 2024-09-14T09:07:56.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:56.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878990+0000", 2024-09-14T09:07:56.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2812000000000005e-05 2024-09-14T09:07:56.724 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.724 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:56.724 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.724 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:736 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 4325376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:56.724 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863711+0000", 2024-09-14T09:07:56.724 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.78192072000000001, 2024-09-14T09:07:56.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015489134, 2024-09-14T09:07:56.724 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:56.724 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:56.724 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:56.724 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:56.724 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:56.725 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:56.725 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 736 2024-09-14T09:07:56.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.725 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:56.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:56.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863711+0000", 2024-09-14T09:07:56.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:56.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863711+0000", 2024-09-14T09:07:56.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:56.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863711+0000", 2024-09-14T09:07:56.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7599999999999997e-07 2024-09-14T09:07:56.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:56.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863713+0000", 2024-09-14T09:07:56.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.04e-06 2024-09-14T09:07:56.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:56.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863720+0000", 2024-09-14T09:07:56.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4570000000000002e-06 2024-09-14T09:07:56.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863724+0000", 2024-09-14T09:07:56.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4490000000000001e-06 2024-09-14T09:07:56.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:56.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.879030+0000", 2024-09-14T09:07:56.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01530606 2024-09-14T09:07:56.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:56.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.879104+0000", 2024-09-14T09:07:56.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4023000000000006e-05 2024-09-14T09:07:56.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:56.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.879200+0000", 2024-09-14T09:07:56.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5529e-05 2024-09-14T09:07:56.728 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.728 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:56.728 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.728 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:737 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:56.728 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863731+0000", 2024-09-14T09:07:56.728 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.78190057800000001, 2024-09-14T09:07:56.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015612793999999999, 2024-09-14T09:07:56.729 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:56.729 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:56.729 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:56.729 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:56.729 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:56.729 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:56.729 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 737 2024-09-14T09:07:56.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.729 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:56.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:56.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863731+0000", 2024-09-14T09:07:56.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:56.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863731+0000", 2024-09-14T09:07:56.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:56.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:56.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863731+0000", 2024-09-14T09:07:56.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3000000000000001e-07 2024-09-14T09:07:56.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:56.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863733+0000", 2024-09-14T09:07:56.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.821e-06 2024-09-14T09:07:56.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:56.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863739+0000", 2024-09-14T09:07:56.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-09-14T09:07:56.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:56.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863744+0000", 2024-09-14T09:07:56.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1699999999999996e-06 2024-09-14T09:07:56.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:56.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.879230+0000", 2024-09-14T09:07:56.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015485478 2024-09-14T09:07:56.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:56.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.879276+0000", 2024-09-14T09:07:56.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6489999999999997e-05 2024-09-14T09:07:56.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:56.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:56.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:56.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.879343+0000", 2024-09-14T09:07:56.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7047999999999999e-05 2024-09-14T09:07:56.733 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.733 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:56.733 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.733 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:56.733 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:56.733 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:56.734 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #3, image image_client.0-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent4 2024-09-14T09:07:56.735 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:07:56.735 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:56.736+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:07:56.736 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:07:56.736 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:07:56.767 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:07:56.767 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:07:56.790 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:07:56.790 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:07:56.813 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:07:56.813 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:07:56.836 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:56.837+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:56.836 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:07:56.836 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:07:56.861 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:07:56.861 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:07:56.880 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:56.880 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:56.891 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:07:56.936 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:56.939+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:57.037 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:57.040+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:57.045 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:57.045 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:57.054 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:07:57.138 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:57.140+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:57.156 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:57.156 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:57.164 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:07:57.165 INFO:teuthology.orchestra.run.smithi148.stdout:629 write 0x4277400 thru 0x4280d67 (0x9968 bytes) 2024-09-14T09:07:57.166 INFO:teuthology.orchestra.run.smithi148.stdout:632 write 0x45a4600 thru 0x45aeb18 (0xa519 bytes) 2024-09-14T09:07:57.167 INFO:teuthology.orchestra.run.smithi148.stdout:634 read 0x4083600 thru 0x4089dff (0x6800 bytes) 2024-09-14T09:07:57.168 INFO:teuthology.orchestra.run.smithi148.stdout:636 punch from 0x7b96600 to 0x7b9e000, (0x7a00 bytes) 2024-09-14T09:07:57.185 INFO:teuthology.orchestra.run.smithi148.stdout:637 punch from 0x33d4000 to 0x33d6600, (0x2600 bytes) 2024-09-14T09:07:57.191 INFO:teuthology.orchestra.run.smithi148.stdout:638 write 0x5d59e00 thru 0x5d61f15 (0x8116 bytes) 2024-09-14T09:07:57.191 INFO:teuthology.orchestra.run.smithi148.stdout:639 punch from 0xdb6000 to 0xdb6e00, (0xe00 bytes) 2024-09-14T09:07:57.198 INFO:teuthology.orchestra.run.smithi148.stdout:640 write 0x7fc9e00 thru 0x7fcb5fd (0x17fe bytes) 2024-09-14T09:07:57.198 INFO:teuthology.orchestra.run.smithi148.stdout:641 read 0x67d1c00 thru 0x67dd637 (0xba38 bytes) 2024-09-14T09:07:57.199 INFO:teuthology.orchestra.run.smithi148.stdout:644 read 0x4c35200 thru 0x4c39997 (0x4798 bytes) 2024-09-14T09:07:57.214 INFO:teuthology.orchestra.run.smithi148.stdout:645 write 0xce7ce00 thru 0xce8312e (0x632f bytes) 2024-09-14T09:07:57.221 INFO:teuthology.orchestra.run.smithi148.stdout:652 read 0x5f92800 thru 0x5f9757d (0x4d7e bytes) 2024-09-14T09:07:57.222 INFO:teuthology.orchestra.run.smithi148.stdout:653 write 0xa47aa00 thru 0xa4828ee (0x7eef bytes) 2024-09-14T09:07:57.222 INFO:teuthology.orchestra.run.smithi148.stdout:656 write 0x43b3800 thru 0x43bb953 (0x8154 bytes) 2024-09-14T09:07:57.222 INFO:teuthology.orchestra.run.smithi148.stdout:657 punch from 0x8fea600 to 0x8fecc00, (0x2600 bytes) 2024-09-14T09:07:57.223 INFO:teuthology.orchestra.run.smithi148.stdout:658 read 0x8785400 thru 0x878b45f (0x6060 bytes) 2024-09-14T09:07:57.224 INFO:teuthology.orchestra.run.smithi148.stdout:660 read 0xcd0bc00 thru 0xcd17bca (0xbfcb bytes) 2024-09-14T09:07:57.226 INFO:teuthology.orchestra.run.smithi148.stdout:664 trunc from 0xce83200 to 0xb589600 2024-09-14T09:07:57.245 INFO:teuthology.orchestra.run.smithi148.stdout:667 write 0x7dcd800 thru 0x7dce21b (0xa1c bytes) 2024-09-14T09:07:57.246 INFO:teuthology.orchestra.run.smithi148.stdout:668 read 0x6a8b800 thru 0x6a9b197 (0xf998 bytes) 2024-09-14T09:07:57.249 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:57.251+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:07:57.256 INFO:teuthology.orchestra.run.smithi148.stdout:669 trunc from 0xb589600 to 0x33cc000 2024-09-14T09:07:57.310 INFO:teuthology.orchestra.run.smithi148.stdout:670 write 0x57dd000 thru 0x57dfd4d (0x2d4e bytes) 2024-09-14T09:07:57.310 INFO:teuthology.orchestra.run.smithi148.stdout:671 write 0x229fc00 thru 0x22ab1a7 (0xb5a8 bytes) 2024-09-14T09:07:57.310 INFO:teuthology.orchestra.run.smithi148.stdout:673 read 0xa75e00 thru 0xa7df44 (0x8145 bytes) 2024-09-14T09:07:57.311 INFO:teuthology.orchestra.run.smithi148.stdout:674 read 0x27a2600 thru 0x27a543c (0x2e3d bytes) 2024-09-14T09:07:57.311 INFO:teuthology.orchestra.run.smithi148.stdout:677 read 0xfa7200 thru 0xfadd62 (0x6b63 bytes) 2024-09-14T09:07:57.323 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:57.323 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:57.332 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:07:57.333 INFO:teuthology.orchestra.run.smithi148.stdout:678 write 0xd8cb600 thru 0xd8d09ab (0x53ac bytes) 2024-09-14T09:07:57.334 INFO:teuthology.orchestra.run.smithi148.stdout:679 read 0x6347c00 thru 0x63488b9 (0xcba bytes) 2024-09-14T09:07:57.335 INFO:teuthology.orchestra.run.smithi148.stdout:681 write 0x960f200 thru 0x960f97c (0x77d bytes) 2024-09-14T09:07:57.335 INFO:teuthology.orchestra.run.smithi148.stdout:682 write 0x8325400 thru 0x832e0b1 (0x8cb2 bytes) 2024-09-14T09:07:57.335 INFO:teuthology.orchestra.run.smithi148.stdout:685 punch from 0xac74400 to 0xac7a200, (0x5e00 bytes) 2024-09-14T09:07:57.339 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:57.341+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:57.347 INFO:teuthology.orchestra.run.smithi148.stdout:686 trunc from 0xd8d0a00 to 0x65b2600 2024-09-14T09:07:57.363 INFO:teuthology.orchestra.run.smithi148.stdout:687 read 0x5812200 thru 0x581e3cd (0xc1ce bytes) 2024-09-14T09:07:57.365 INFO:teuthology.orchestra.run.smithi148.stdout:truncating to largest ever: 0xeba3200 2024-09-14T09:07:57.375 INFO:teuthology.orchestra.run.smithi148.stdout:688 trunc from 0x65b2600 to 0xeba3200 2024-09-14T09:07:57.385 INFO:teuthology.orchestra.run.smithi148.stdout:690 read 0x5fcc400 thru 0x5fd45f9 (0x81fa bytes) 2024-09-14T09:07:57.391 INFO:teuthology.orchestra.run.smithi148.stdout:692 punch from 0x3457c00 to 0x345a600, (0x2a00 bytes) 2024-09-14T09:07:57.394 INFO:teuthology.orchestra.run.smithi148.stdout:693 trunc from 0xeba3200 to 0xc7d0600 2024-09-14T09:07:57.414 INFO:teuthology.orchestra.run.smithi148.stdout:694 write 0xcf2c200 thru 0xcf316a8 (0x54a9 bytes) 2024-09-14T09:07:57.422 INFO:teuthology.orchestra.run.smithi148.stdout:695 trunc from 0xcf31800 to 0x6dbcc00 2024-09-14T09:07:57.441 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:57.442+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:57.465 INFO:teuthology.orchestra.run.smithi148.stdout:696 write 0xe8f8a00 thru 0xe905318 (0xc919 bytes) 2024-09-14T09:07:57.476 INFO:teuthology.orchestra.run.smithi148.stdout:697 trunc from 0xe905400 to 0x5255e00 2024-09-14T09:07:57.481 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:57.481 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:57.492 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:07:57.507 INFO:teuthology.orchestra.run.smithi148.stdout:698 trunc from 0x5255e00 to 0xd3a1000 2024-09-14T09:07:57.524 INFO:teuthology.orchestra.run.smithi148.stdout:699 write 0xe15f000 thru 0xe16065a (0x165b bytes) 2024-09-14T09:07:57.525 INFO:teuthology.orchestra.run.smithi148.stdout:700 read 0xe084800 thru 0xe093bc1 (0xf3c2 bytes) 2024-09-14T09:07:57.526 INFO:teuthology.orchestra.run.smithi148.stdout:707 write 0x934de00 thru 0x935a164 (0xc365 bytes) 2024-09-14T09:07:57.526 INFO:teuthology.orchestra.run.smithi148.stdout:708 write 0xc67ac00 thru 0xc67ef6f (0x4370 bytes) 2024-09-14T09:07:57.526 INFO:teuthology.orchestra.run.smithi148.stdout:709 read 0x8bffc00 thru 0x8c06947 (0x6d48 bytes) 2024-09-14T09:07:57.526 INFO:teuthology.orchestra.run.smithi148.stdout:710 write 0x950e00 thru 0x951868 (0xa69 bytes) 2024-09-14T09:07:57.527 INFO:teuthology.orchestra.run.smithi148.stdout:711 punch from 0x67ac200 to 0x67b8c00, (0xca00 bytes) 2024-09-14T09:07:57.527 INFO:teuthology.orchestra.run.smithi148.stdout:712 write 0xc653e00 thru 0xc654757 (0x958 bytes) 2024-09-14T09:07:57.527 INFO:teuthology.orchestra.run.smithi148.stdout:713 punch from 0x6f56a00 to 0x6f63200, (0xc800 bytes) 2024-09-14T09:07:57.527 INFO:teuthology.orchestra.run.smithi148.stdout:716 punch from 0x81eda00 to 0x81fa200, (0xc800 bytes) 2024-09-14T09:07:57.527 INFO:teuthology.orchestra.run.smithi148.stdout:717 read 0xb548800 thru 0xb54d17b (0x497c bytes) 2024-09-14T09:07:57.533 INFO:teuthology.orchestra.run.smithi148.stdout:718 trunc from 0xe160800 to 0x88e5200 2024-09-14T09:07:57.544 INFO:teuthology.orchestra.run.smithi148.stdout:720 write 0x4b6bc00 thru 0x4b7b0fa (0xf4fb bytes) 2024-09-14T09:07:57.545 INFO:teuthology.orchestra.run.smithi148.stdout:721 punch from 0x2fd0a00 to 0x2fd4a00, (0x4000 bytes) 2024-09-14T09:07:57.551 INFO:teuthology.orchestra.run.smithi148.stdout:723 trunc from 0x88e5200 to 0x6bba800 2024-09-14T09:07:57.575 INFO:teuthology.orchestra.run.smithi148.stdout:724 read 0x33c6a00 thru 0x33cec4a (0x824b bytes) 2024-09-14T09:07:57.575 INFO:teuthology.orchestra.run.smithi148.stdout:725 read 0x1d1a200 thru 0x1d27355 (0xd156 bytes) 2024-09-14T09:07:57.576 INFO:teuthology.orchestra.run.smithi148.stdout:730 punch from 0x1446800 to 0x1450800, (0xa000 bytes) 2024-09-14T09:07:57.577 INFO:teuthology.orchestra.run.smithi148.stdout:731 punch from 0x5cd4400 to 0x5cdf200, (0xae00 bytes) 2024-09-14T09:07:57.577 INFO:teuthology.orchestra.run.smithi148.stdout:736 read 0x5069800 thru 0x50748f2 (0xb0f3 bytes) 2024-09-14T09:07:57.578 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:57.580+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:57.581 INFO:teuthology.orchestra.run.smithi148.stdout:737 trunc from 0x6bba800 to 0x3046c00 2024-09-14T09:07:57.600 INFO:teuthology.orchestra.run.smithi148.stdout:740 write 0x2191e00 thru 0x219411e (0x231f bytes) 2024-09-14T09:07:57.602 INFO:teuthology.orchestra.run.smithi148.stdout:742 trunc from 0x3046c00 to 0x2931c00 2024-09-14T09:07:57.617 INFO:teuthology.orchestra.run.smithi148.stdout:743 punch from 0x1f8fe00 to 0x1f96000, (0x6200 bytes) 2024-09-14T09:07:57.618 INFO:teuthology.orchestra.run.smithi148.stdout:744 read 0x738600 thru 0x746a6f (0xe470 bytes) 2024-09-14T09:07:57.618 INFO:teuthology.orchestra.run.smithi148.stdout:750 read 0xceca00 thru 0xcf4036 (0x7637 bytes) 2024-09-14T09:07:57.619 INFO:teuthology.orchestra.run.smithi148.stdout:751 write 0xb3ce00 thru 0xb3e7ef (0x19f0 bytes) 2024-09-14T09:07:57.619 INFO:teuthology.orchestra.run.smithi148.stdout:752 punch from 0x1c49a00 to 0x1c51e00, (0x8400 bytes) 2024-09-14T09:07:57.619 INFO:teuthology.orchestra.run.smithi148.stdout:753 punch from 0xfeea00 to 0xff0000, (0x1600 bytes) 2024-09-14T09:07:57.635 INFO:teuthology.orchestra.run.smithi148.stdout:754 write 0x8c8da00 thru 0x8c99183 (0xb784 bytes) 2024-09-14T09:07:57.642 INFO:teuthology.orchestra.run.smithi148.stdout:756 write 0x2cfa00 thru 0x2cfe2c (0x42d bytes) 2024-09-14T09:07:57.642 INFO:teuthology.orchestra.run.smithi148.stdout:757 write 0x2040800 thru 0x204084d (0x4e bytes) 2024-09-14T09:07:57.642 INFO:teuthology.orchestra.run.smithi148.stdout:758 write 0x7b88800 thru 0x7b8f0fc (0x68fd bytes) 2024-09-14T09:07:57.643 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:57.644+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:57.648 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:57.648 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:57.651 INFO:teuthology.orchestra.run.smithi148.stdout:759 trunc from 0x8c99200 to 0x1ca7000 2024-09-14T09:07:57.656 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:07:57.684 INFO:teuthology.orchestra.run.smithi148.stdout:761 read 0xe64a00 thru 0xe6d03b (0x863c bytes) 2024-09-14T09:07:57.684 INFO:teuthology.orchestra.run.smithi148.stdout:762 read 0x19d6e00 thru 0x19e54e7 (0xe6e8 bytes) 2024-09-14T09:07:57.700 INFO:teuthology.orchestra.run.smithi148.stdout:766 write 0x8801a00 thru 0x880c614 (0xac15 bytes) 2024-09-14T09:07:57.701 INFO:teuthology.orchestra.run.smithi148.stdout:768 write 0x787dc00 thru 0x788b228 (0xd629 bytes) 2024-09-14T09:07:57.702 INFO:teuthology.orchestra.run.smithi148.stdout:772 punch from 0x22b6800 to 0x22b9a00, (0x3200 bytes) 2024-09-14T09:07:57.703 INFO:teuthology.orchestra.run.smithi148.stdout:775 punch from 0x20b7a00 to 0x20c1e00, (0xa400 bytes) 2024-09-14T09:07:57.703 INFO:teuthology.orchestra.run.smithi148.stdout:776 write 0x1f5200 thru 0x1f5ce2 (0xae3 bytes) 2024-09-14T09:07:57.704 INFO:teuthology.orchestra.run.smithi148.stdout:779 punch from 0x2624000 to 0x2625000, (0x1000 bytes) 2024-09-14T09:07:57.715 INFO:teuthology.orchestra.run.smithi148.stdout:780 write 0xa69c600 thru 0xa6a2f78 (0x6979 bytes) 2024-09-14T09:07:57.730 INFO:teuthology.orchestra.run.smithi148.stdout:781 write 0xb525c00 thru 0xb52bff8 (0x63f9 bytes) 2024-09-14T09:07:57.733 INFO:teuthology.orchestra.run.smithi148.stdout:783 trunc from 0xb52c000 to 0x981f600 2024-09-14T09:07:57.743 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:57.745+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:57.746 INFO:teuthology.orchestra.run.smithi148.stdout:784 write 0x4685e00 thru 0x4686edb (0x10dc bytes) 2024-09-14T09:07:57.762 INFO:teuthology.orchestra.run.smithi148.stdout:786 write 0xdba9200 thru 0xdbb5dc7 (0xcbc8 bytes) 2024-09-14T09:07:57.764 INFO:teuthology.orchestra.run.smithi148.stdout:789 write 0x11d1600 thru 0x11de80d (0xd20e bytes) 2024-09-14T09:07:57.764 INFO:teuthology.orchestra.run.smithi148.stdout:790 trunc from 0xdbb5e00 to 0xd8f8c00 2024-09-14T09:07:57.767 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:57.767 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:57.777 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:07:57.778 INFO:teuthology.orchestra.run.smithi148.stdout:791 punch from 0x2361200 to 0x2367800, (0x6600 bytes) 2024-09-14T09:07:57.785 INFO:teuthology.orchestra.run.smithi148.stdout:792 write 0x22a6a00 thru 0x22b0b28 (0xa129 bytes) 2024-09-14T09:07:57.786 INFO:teuthology.orchestra.run.smithi148.stdout:793 read 0x9349600 thru 0x9350bb7 (0x75b8 bytes) 2024-09-14T09:07:57.787 INFO:teuthology.orchestra.run.smithi148.stdout:798 trunc from 0xd8f8c00 to 0xe9d6e00 2024-09-14T09:07:57.797 INFO:teuthology.orchestra.run.smithi148.stdout:799 read 0x2381600 thru 0x2386500 (0x4f01 bytes) 2024-09-14T09:07:57.802 INFO:teuthology.orchestra.run.smithi148.stdout:800 read 0xcff0c00 thru 0xcff37fd (0x2bfe bytes) 2024-09-14T09:07:57.803 INFO:teuthology.orchestra.run.smithi148.stdout:801 punch from 0x2b02800 to 0x2b08a00, (0x6200 bytes) 2024-09-14T09:07:57.803 INFO:teuthology.orchestra.run.smithi148.stdout:804 punch from 0x534e600 to 0x5352400, (0x3e00 bytes) 2024-09-14T09:07:57.803 INFO:teuthology.orchestra.run.smithi148.stdout:805 read 0xd4f7400 thru 0xd502fa4 (0xbba5 bytes) 2024-09-14T09:07:57.803 INFO:teuthology.orchestra.run.smithi148.stdout:807 punch from 0x69e3000 to 0x69e7c00, (0x4c00 bytes) 2024-09-14T09:07:57.804 INFO:teuthology.orchestra.run.smithi148.stdout:809 write 0xbdc200 thru 0xbe24cd (0x62ce bytes) 2024-09-14T09:07:57.804 INFO:teuthology.orchestra.run.smithi148.stdout:810 write 0x367f600 thru 0x368cb8c (0xd58d bytes) 2024-09-14T09:07:57.805 INFO:teuthology.orchestra.run.smithi148.stdout:811 punch from 0x1fb7800 to 0x1fbde00, (0x6600 bytes) 2024-09-14T09:07:57.805 INFO:teuthology.orchestra.run.smithi148.stdout:813 read 0x4d24800 thru 0x4d333cd (0xebce bytes) 2024-09-14T09:07:57.806 INFO:teuthology.orchestra.run.smithi148.stdout:814 punch from 0xb868400 to 0xb875a00, (0xd600 bytes) 2024-09-14T09:07:57.815 INFO:teuthology.orchestra.run.smithi148.stdout:819 trunc from 0xe9d6e00 to 0x6cdb000 2024-09-14T09:07:57.843 INFO:teuthology.orchestra.run.smithi148.stdout:820 trunc from 0x6cdb000 to 0x1a6ea00 2024-09-14T09:07:57.844 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:57.846+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:57.863 INFO:teuthology.orchestra.run.smithi148.stdout:823 read 0x4cdc00 thru 0x4d19dc (0x3ddd bytes) 2024-09-14T09:07:57.886 INFO:teuthology.orchestra.run.smithi148.stdout:826 write 0x8c1d800 thru 0x8c25d04 (0x8505 bytes) 2024-09-14T09:07:57.886 INFO:teuthology.orchestra.run.smithi148.stdout:827 punch from 0x43a9e00 to 0x43afe00, (0x6000 bytes) 2024-09-14T09:07:57.890 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:57.891 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:57.901 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:07:57.904 INFO:teuthology.orchestra.run.smithi148.stdout:828 write 0xbbe7600 thru 0xbbea59f (0x2fa0 bytes) 2024-09-14T09:07:57.904 INFO:teuthology.orchestra.run.smithi148.stdout:830 read 0x5b02000 thru 0x5b08e6d (0x6e6e bytes) 2024-09-14T09:07:57.904 INFO:teuthology.orchestra.run.smithi148.stdout:832 write 0xb01a600 thru 0xb01f208 (0x4c09 bytes) 2024-09-14T09:07:57.904 INFO:teuthology.orchestra.run.smithi148.stdout:833 write 0x90aba00 thru 0x90b487e (0x8e7f bytes) 2024-09-14T09:07:57.905 INFO:teuthology.orchestra.run.smithi148.stdout:834 write 0x9c02000 thru 0x9c0eaa6 (0xcaa7 bytes) 2024-09-14T09:07:57.905 INFO:teuthology.orchestra.run.smithi148.stdout:836 punch from 0x849d000 to 0x849ec00, (0x1c00 bytes) 2024-09-14T09:07:57.905 INFO:teuthology.orchestra.run.smithi148.stdout:838 read 0x7842c00 thru 0x784d64f (0xaa50 bytes) 2024-09-14T09:07:57.921 INFO:teuthology.orchestra.run.smithi148.stdout:839 write 0xd647800 thru 0xd64dc89 (0x648a bytes) 2024-09-14T09:07:57.922 INFO:teuthology.orchestra.run.smithi148.stdout:840 punch from 0x434e400 to 0x435d600, (0xf200 bytes) 2024-09-14T09:07:57.926 INFO:teuthology.orchestra.run.smithi148.stdout:846 read 0x691f600 thru 0x692db71 (0xe572 bytes) 2024-09-14T09:07:57.938 INFO:teuthology.orchestra.run.smithi148.stdout:848 trunc from 0xd64de00 to 0x148b400 2024-09-14T09:07:57.945 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:57.946+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:07:57.961 INFO:teuthology.orchestra.run.smithi148.stdout:849 read 0xbd5400 thru 0xbdbbbe (0x67bf bytes) 2024-09-14T09:07:57.986 INFO:teuthology.orchestra.run.smithi148.stdout:850 write 0xd9b6200 thru 0xd9bec32 (0x8a33 bytes) 2024-09-14T09:07:57.991 INFO:teuthology.orchestra.run.smithi148.stdout:851 write 0xf0f800 thru 0xf1999d (0xa19e bytes) 2024-09-14T09:07:57.991 INFO:teuthology.orchestra.run.smithi148.stdout:853 read 0x9809a00 thru 0x9809a8a (0x8b bytes) 2024-09-14T09:07:57.991 INFO:teuthology.orchestra.run.smithi148.stdout:855 read 0x6717000 thru 0x67170f8 (0xf9 bytes) 2024-09-14T09:07:58.002 INFO:teuthology.orchestra.run.smithi148.stdout:857 write 0xdb97200 thru 0xdb9d2d7 (0x60d8 bytes) 2024-09-14T09:07:58.005 INFO:teuthology.orchestra.run.smithi148.stdout:858 read 0x7e00 thru 0x1681c (0xea1d bytes) 2024-09-14T09:07:58.005 INFO:teuthology.orchestra.run.smithi148.stdout:859 read 0x43e5600 thru 0x43ebc7c (0x667d bytes) 2024-09-14T09:07:58.008 INFO:teuthology.orchestra.run.smithi148.stdout:860 write 0x5ff2c00 thru 0x5ff2fbc (0x3bd bytes) 2024-09-14T09:07:58.008 INFO:teuthology.orchestra.run.smithi148.stdout:861 read 0x60cde00 thru 0x60d6b38 (0x8d39 bytes) 2024-09-14T09:07:58.008 INFO:teuthology.orchestra.run.smithi148.stdout:862 read 0x28f4000 thru 0x29025d1 (0xe5d2 bytes) 2024-09-14T09:07:58.008 INFO:teuthology.orchestra.run.smithi148.stdout:863 read 0x34e8200 thru 0x34eed72 (0x6b73 bytes) 2024-09-14T09:07:58.008 INFO:teuthology.orchestra.run.smithi148.stdout:864 read 0xb542400 thru 0xb54f0cd (0xccce bytes) 2024-09-14T09:07:58.008 INFO:teuthology.orchestra.run.smithi148.stdout:865 write 0xb256200 thru 0xb2576fe (0x14ff bytes) 2024-09-14T09:07:58.008 INFO:teuthology.orchestra.run.smithi148.stdout:867 read 0xa7dfa00 thru 0xa7e307c (0x367d bytes) 2024-09-14T09:07:58.021 INFO:teuthology.orchestra.run.smithi148.stdout:868 trunc from 0xdb9d400 to 0x1e93a00 2024-09-14T09:07:58.045 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:58.047+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:58.049 INFO:teuthology.orchestra.run.smithi148.stdout:873 read 0xa34600 thru 0xa411b6 (0xcbb7 bytes) 2024-09-14T09:07:58.050 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:58.051 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:58.060 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:07:58.069 INFO:teuthology.orchestra.run.smithi148.stdout:875 write 0x7185200 thru 0x7186004 (0xe05 bytes) 2024-09-14T09:07:58.073 INFO:teuthology.orchestra.run.smithi148.stdout:876 trunc from 0x7186200 to 0x544de00 2024-09-14T09:07:58.085 INFO:teuthology.orchestra.run.smithi148.stdout:879 read 0x4574c00 thru 0x4575e54 (0x1255 bytes) 2024-09-14T09:07:58.086 INFO:teuthology.orchestra.run.smithi148.stdout:882 read 0x3ee0000 thru 0x3eea4cc (0xa4cd bytes) 2024-09-14T09:07:58.086 INFO:teuthology.orchestra.run.smithi148.stdout:885 punch from 0x46e4400 to 0x46e8800, (0x4400 bytes) 2024-09-14T09:07:58.090 INFO:teuthology.orchestra.run.smithi148.stdout:886 punch from 0x507b400 to 0x5080200, (0x4e00 bytes) 2024-09-14T09:07:58.090 INFO:teuthology.orchestra.run.smithi148.stdout:892 read 0x1ea6800 thru 0x1eaf677 (0x8e78 bytes) 2024-09-14T09:07:58.101 INFO:teuthology.orchestra.run.smithi148.stdout:896 write 0x7343200 thru 0x7352d31 (0xfb32 bytes) 2024-09-14T09:07:58.103 INFO:teuthology.orchestra.run.smithi148.stdout:897 write 0x638f600 thru 0x6395903 (0x6304 bytes) 2024-09-14T09:07:58.103 INFO:teuthology.orchestra.run.smithi148.stdout:898 read 0x408ac00 thru 0x4095fdd (0xb3de bytes) 2024-09-14T09:07:58.104 INFO:teuthology.orchestra.run.smithi148.stdout:901 punch from 0x26da00 to 0x272a00, (0x5000 bytes) 2024-09-14T09:07:58.106 INFO:teuthology.orchestra.run.smithi148.stdout:902 trunc from 0x7352e00 to 0x8cc5400 2024-09-14T09:07:58.116 INFO:teuthology.orchestra.run.smithi148.stdout:905 read 0x20d3200 thru 0x20da10b (0x6f0c bytes) 2024-09-14T09:07:58.124 INFO:teuthology.orchestra.run.smithi148.stdout:907 read 0x4fbb400 thru 0x4fc4ac2 (0x96c3 bytes) 2024-09-14T09:07:58.124 INFO:teuthology.orchestra.run.smithi148.stdout:909 read 0x4b65e00 thru 0x4b719bb (0xbbbc bytes) 2024-09-14T09:07:58.125 INFO:teuthology.orchestra.run.smithi148.stdout:912 read 0x4eda00 thru 0x4ee928 (0xf29 bytes) 2024-09-14T09:07:58.125 INFO:teuthology.orchestra.run.smithi148.stdout:914 read 0x38b9800 thru 0x38c8779 (0xef7a bytes) 2024-09-14T09:07:58.126 INFO:teuthology.orchestra.run.smithi148.stdout:916 write 0x604b000 thru 0x604c94d (0x194e bytes) 2024-09-14T09:07:58.126 INFO:teuthology.orchestra.run.smithi148.stdout:917 punch from 0x1ddf000 to 0x1de9000, (0xa000 bytes) 2024-09-14T09:07:58.126 INFO:teuthology.orchestra.run.smithi148.stdout:921 write 0x407be00 thru 0x407dc31 (0x1e32 bytes) 2024-09-14T09:07:58.127 INFO:teuthology.orchestra.run.smithi148.stdout:923 write 0x16c4000 thru 0x16c9ff7 (0x5ff8 bytes) 2024-09-14T09:07:58.134 INFO:teuthology.orchestra.run.smithi148.stdout:924 trunc from 0x8cc5400 to 0xd7cb400 2024-09-14T09:07:58.144 INFO:teuthology.orchestra.run.smithi148.stdout:925 write 0x62c4200 thru 0x62c7b93 (0x3994 bytes) 2024-09-14T09:07:58.145 INFO:teuthology.orchestra.run.smithi148.stdout:truncating to largest ever: 0xec9b200 2024-09-14T09:07:58.146 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:58.148+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:07:58.147 INFO:teuthology.orchestra.run.smithi148.stdout:926 trunc from 0xd7cb400 to 0xec9b200 2024-09-14T09:07:58.157 INFO:teuthology.orchestra.run.smithi148.stdout:927 read 0x899d600 thru 0x89a2f28 (0x5929 bytes) 2024-09-14T09:07:58.158 INFO:teuthology.orchestra.run.smithi148.stdout:930 write 0xcd6c200 thru 0xcd7b937 (0xf738 bytes) 2024-09-14T09:07:58.159 INFO:teuthology.orchestra.run.smithi148.stdout:932 write 0x871aa00 thru 0x8724975 (0x9f76 bytes) 2024-09-14T09:07:58.159 INFO:teuthology.orchestra.run.smithi148.stdout:933 punch from 0x90e5000 to 0x90ea600, (0x5600 bytes) 2024-09-14T09:07:58.162 INFO:teuthology.orchestra.run.smithi148.stdout:934 write 0x5dde600 thru 0x5de0c5a (0x265b bytes) 2024-09-14T09:07:58.172 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:58.172 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:58.179 INFO:teuthology.orchestra.run.smithi148.stdout:936 trunc from 0xec9b200 to 0xf70000 2024-09-14T09:07:58.181 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:07:58.204 INFO:teuthology.orchestra.run.smithi148.stdout:938 punch from 0x5ffc00 to 0x600800, (0xc00 bytes) 2024-09-14T09:07:58.208 INFO:teuthology.orchestra.run.smithi148.stdout:939 trunc from 0xf70000 to 0x22e5e00 2024-09-14T09:07:58.219 INFO:teuthology.orchestra.run.smithi148.stdout:940 read 0x1d2a200 thru 0x1d33c04 (0x9a05 bytes) 2024-09-14T09:07:58.220 INFO:teuthology.orchestra.run.smithi148.stdout:941 read 0x1c6a400 thru 0x1c78641 (0xe242 bytes) 2024-09-14T09:07:58.236 INFO:teuthology.orchestra.run.smithi148.stdout:942 write 0x727cc00 thru 0x727fb88 (0x2f89 bytes) 2024-09-14T09:07:58.237 INFO:teuthology.orchestra.run.smithi148.stdout:944 read 0x2446800 thru 0x2449461 (0x2c62 bytes) 2024-09-14T09:07:58.237 INFO:teuthology.orchestra.run.smithi148.stdout:945 read 0xc76000 thru 0xc7e8f2 (0x88f3 bytes) 2024-09-14T09:07:58.246 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:58.248+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:07:58.254 INFO:teuthology.orchestra.run.smithi148.stdout:946 write 0xd8b7000 thru 0xd8c6b2a (0xfb2b bytes) 2024-09-14T09:07:58.255 INFO:teuthology.orchestra.run.smithi148.stdout:947 read 0xb866200 thru 0xb86b0b8 (0x4eb9 bytes) 2024-09-14T09:07:58.255 INFO:teuthology.orchestra.run.smithi148.stdout:950 read 0x72d2c00 thru 0x72de839 (0xbc3a bytes) 2024-09-14T09:07:58.259 INFO:teuthology.orchestra.run.smithi148.stdout:953 trunc from 0xd8c6c00 to 0x9fc9a00 2024-09-14T09:07:58.280 INFO:teuthology.orchestra.run.smithi148.stdout:955 trunc from 0x9fc9a00 to 0x7f21800 2024-09-14T09:07:58.296 INFO:teuthology.orchestra.run.smithi148.stdout:956 trunc from 0x7f21800 to 0x6703800 2024-09-14T09:07:58.297 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:58.297 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:58.307 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:07:58.309 INFO:teuthology.orchestra.run.smithi148.stdout:957 punch from 0x4620600 to 0x4625000, (0x4a00 bytes) 2024-09-14T09:07:58.313 INFO:teuthology.orchestra.run.smithi148.stdout:958 read 0x5458e00 thru 0x5461705 (0x8906 bytes) 2024-09-14T09:07:58.322 INFO:teuthology.orchestra.run.smithi148.stdout:962 write 0x6fe8200 thru 0x6feb4ec (0x32ed bytes) 2024-09-14T09:07:58.330 INFO:teuthology.orchestra.run.smithi148.stdout:965 read 0x64d7000 thru 0x64dd71c (0x671d bytes) 2024-09-14T09:07:58.330 INFO:teuthology.orchestra.run.smithi148.stdout:966 punch from 0x6c27400 to 0x6c2bc00, (0x4800 bytes) 2024-09-14T09:07:58.347 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:07:58.349+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:07:58.348 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T09:07:58.349 INFO:teuthology.orchestra.run.smithi148.stdout:967 write 0xb902a00 thru 0xb91265a (0xfc5b bytes) 2024-09-14T09:07:58.349 INFO:teuthology.orchestra.run.smithi148.stdout:972 punch from 0x75c5400 to 0x75c7800, (0x2400 bytes) 2024-09-14T09:07:58.350 INFO:teuthology.orchestra.run.smithi148.stdout:975 read 0x8acd400 thru 0x8acd4e6 (0xe7 bytes) 2024-09-14T09:07:58.350 INFO:teuthology.orchestra.run.smithi148.stdout:976 read 0x2f34000 thru 0x2f385e0 (0x45e1 bytes) 2024-09-14T09:07:58.356 INFO:teuthology.orchestra.run.smithi148.stdout:978 trunc from 0xb912800 to 0x69a4a00 2024-09-14T09:07:58.387 INFO:teuthology.orchestra.run.smithi148.stdout:979 trunc from 0x69a4a00 to 0xc481c00 2024-09-14T09:07:58.397 INFO:teuthology.orchestra.run.smithi148.stdout:984 punch from 0xa718e00 to 0xa720600, (0x7800 bytes) 2024-09-14T09:07:58.399 INFO:teuthology.orchestra.run.smithi148.stdout:987 write 0x20e0400 thru 0x20e2df7 (0x29f8 bytes) 2024-09-14T09:07:58.399 INFO:teuthology.orchestra.run.smithi148.stdout:988 write 0x3847000 thru 0x384a07b (0x307c bytes) 2024-09-14T09:07:58.402 INFO:teuthology.orchestra.run.smithi148.stdout:989 trunc from 0xc481c00 to 0xa58e600 2024-09-14T09:07:58.414 INFO:teuthology.orchestra.run.smithi148.stdout:999 read 0x7dd2200 thru 0x7de14fb (0xf2fc bytes) 2024-09-14T09:07:58.421 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:58.422 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:58.429 INFO:teuthology.orchestra.run.smithi148.stdout:1001 trunc from 0xa58e600 to 0x2502200 2024-09-14T09:07:58.431 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:07:58.448 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:58.450+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:58.471 INFO:teuthology.orchestra.run.smithi148.stdout:1002 write 0x48f4400 thru 0x48fd049 (0x8c4a bytes) 2024-09-14T09:07:58.474 INFO:teuthology.orchestra.run.smithi148.stdout:1004 trunc from 0x48fd200 to 0x2215400 2024-09-14T09:07:58.489 INFO:teuthology.orchestra.run.smithi148.stdout:1005 read 0x170d800 thru 0x1712a29 (0x522a bytes) 2024-09-14T09:07:58.490 INFO:teuthology.orchestra.run.smithi148.stdout:1006 read 0x1c27600 thru 0x1c2a1f6 (0x2bf7 bytes) 2024-09-14T09:07:58.491 INFO:teuthology.orchestra.run.smithi148.stdout:1007 read 0x10ba00 thru 0x1145d7 (0x8bd8 bytes) 2024-09-14T09:07:58.494 INFO:teuthology.orchestra.run.smithi148.stdout:1009 trunc from 0x2215400 to 0x4341600 2024-09-14T09:07:58.513 INFO:teuthology.orchestra.run.smithi148.stdout:1010 trunc from 0x4341600 to 0xe460200 2024-09-14T09:07:58.521 INFO:teuthology.orchestra.run.smithi148.stdout:1012 punch from 0xbf1a800 to 0xbf1b600, (0xe00 bytes) 2024-09-14T09:07:58.525 INFO:teuthology.orchestra.run.smithi148.stdout:1013 trunc from 0xe460200 to 0xcade600 2024-09-14T09:07:58.539 INFO:teuthology.orchestra.run.smithi148.stdout:1015 read 0x577e200 thru 0x57814b0 (0x32b1 bytes) 2024-09-14T09:07:58.540 INFO:teuthology.orchestra.run.smithi148.stdout:1017 read 0x711f600 thru 0x712140b (0x1e0c bytes) 2024-09-14T09:07:58.544 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:58.544 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:58.544 INFO:teuthology.orchestra.run.smithi148.stdout:1020 trunc from 0xcade600 to 0xa453e00 2024-09-14T09:07:58.548 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:58.550+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:07:58.554 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:07:58.558 INFO:teuthology.orchestra.run.smithi148.stdout:1021 trunc from 0xa453e00 to 0xcac3000 2024-09-14T09:07:58.567 INFO:teuthology.orchestra.run.smithi148.stdout:1022 punch from 0xa973200 to 0xa97a800, (0x7600 bytes) 2024-09-14T09:07:58.569 INFO:teuthology.orchestra.run.smithi148.stdout:1023 clone 6 order 18 su 16384 sc 14 2024-09-14T09:07:58.650 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:58.652+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:58.658 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:58.659 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:58.667 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:07:58.750 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:58.752+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:58.786 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is set 2024-09-14T09:07:58.816 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:58.816 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:58.825 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:07:58.863 INFO:teuthology.orchestra.run.smithi148.stdout:leaving image image_client.0-clone5 intact 2024-09-14T09:07:58.876 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:07:58.885 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:58.887+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:07:58.946 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:07:58.947 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:07:58.952 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:58.954+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:07:58.955 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:07:59.004 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:07:59.004 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:07:59.021 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:07:59.022 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:07:59.039 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:07:59.039 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:07:59.053 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:07:59.054+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:07:59.056 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:07:59.056 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:07:59.072 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:07:59.073 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:07:59.090 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:07:59.090 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:07:59.107 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:59.108 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:07:59.108 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:07:59.108 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:07:59.108 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:59.116 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:07:59.154 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:59.156+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:59.217 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #4, image image_client.0-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent5 2024-09-14T09:07:59.254 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:07:59.257+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:07:59.269 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:59.270 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:07:59.270 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:07:59.270 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:07:59.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.270 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:654 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 1179648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:59.270 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862916+0000", 2024-09-14T09:07:59.270 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.4082380840000002, 2024-09-14T09:07:59.270 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012658305, 2024-09-14T09:07:59.270 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.270 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.270 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:59.270 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.271 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:59.271 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:59.271 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 654 2024-09-14T09:07:59.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.271 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.271 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.271 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862916+0000", 2024-09-14T09:07:59.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862916+0000", 2024-09-14T09:07:59.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862916+0000", 2024-09-14T09:07:59.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:07:59.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862918+0000", 2024-09-14T09:07:59.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.018e-06 2024-09-14T09:07:59.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862924+0000", 2024-09-14T09:07:59.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7799999999999997e-06 2024-09-14T09:07:59.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862929+0000", 2024-09-14T09:07:59.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6160000000000004e-06 2024-09-14T09:07:59.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.274 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.274 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875412+0000", 2024-09-14T09:07:59.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012482804 2024-09-14T09:07:59.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.274 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.274 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875479+0000", 2024-09-14T09:07:59.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7661000000000002e-05 2024-09-14T09:07:59.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.274 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.274 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875574+0000", 2024-09-14T09:07:59.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5050999999999995e-05 2024-09-14T09:07:59.274 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.275 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.275 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.275 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:655 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 2621440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:59.275 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862936+0000", 2024-09-14T09:07:59.275 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.4082182670000001, 2024-09-14T09:07:59.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012886771999999999, 2024-09-14T09:07:59.275 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.275 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.275 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:59.275 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.275 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:59.275 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:59.276 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 655 2024-09-14T09:07:59.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.276 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862936+0000", 2024-09-14T09:07:59.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862936+0000", 2024-09-14T09:07:59.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862936+0000", 2024-09-14T09:07:59.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.41e-07 2024-09-14T09:07:59.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862938+0000", 2024-09-14T09:07:59.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0480000000000001e-06 2024-09-14T09:07:59.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862944+0000", 2024-09-14T09:07:59.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9710000000000001e-06 2024-09-14T09:07:59.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862957+0000", 2024-09-14T09:07:59.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2438e-05 2024-09-14T09:07:59.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875625+0000", 2024-09-14T09:07:59.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012668789 2024-09-14T09:07:59.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875710+0000", 2024-09-14T09:07:59.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4753999999999995e-05 2024-09-14T09:07:59.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875823+0000", 2024-09-14T09:07:59.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011243099999999999 2024-09-14T09:07:59.279 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.279 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.280 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.280 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:656 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:59.280 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862975+0000", 2024-09-14T09:07:59.280 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.408179649, 2024-09-14T09:07:59.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013016366999999999, 2024-09-14T09:07:59.280 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.280 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.280 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:59.280 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.280 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:59.280 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:59.280 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 656 2024-09-14T09:07:59.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.281 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862975+0000", 2024-09-14T09:07:59.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862975+0000", 2024-09-14T09:07:59.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862975+0000", 2024-09-14T09:07:59.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5099999999999999e-07 2024-09-14T09:07:59.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862977+0000", 2024-09-14T09:07:59.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2819999999999999e-06 2024-09-14T09:07:59.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862984+0000", 2024-09-14T09:07:59.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4489999999999996e-06 2024-09-14T09:07:59.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862995+0000", 2024-09-14T09:07:59.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0655999999999999e-05 2024-09-14T09:07:59.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875873+0000", 2024-09-14T09:07:59.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012878466999999999 2024-09-14T09:07:59.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875922+0000", 2024-09-14T09:07:59.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9038e-05 2024-09-14T09:07:59.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875991+0000", 2024-09-14T09:07:59.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8824000000000004e-05 2024-09-14T09:07:59.286 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.286 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.286 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.286 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:657 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:59.286 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863002+0000", 2024-09-14T09:07:59.286 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.4081522089999998, 2024-09-14T09:07:59.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013236974, 2024-09-14T09:07:59.286 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.287 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.287 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:59.287 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.287 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:59.287 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:59.287 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 657 2024-09-14T09:07:59.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.287 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863002+0000", 2024-09-14T09:07:59.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863002+0000", 2024-09-14T09:07:59.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863002+0000", 2024-09-14T09:07:59.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3000000000000001e-07 2024-09-14T09:07:59.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863005+0000", 2024-09-14T09:07:59.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0329999999999998e-06 2024-09-14T09:07:59.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863010+0000", 2024-09-14T09:07:59.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7799999999999997e-06 2024-09-14T09:07:59.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863015+0000", 2024-09-14T09:07:59.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6070000000000001e-06 2024-09-14T09:07:59.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876045+0000", 2024-09-14T09:07:59.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013029987999999999 2024-09-14T09:07:59.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876130+0000", 2024-09-14T09:07:59.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5347999999999997e-05 2024-09-14T09:07:59.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876239+0000", 2024-09-14T09:07:59.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000108688 2024-09-14T09:07:59.290 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.290 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.290 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.291 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:690 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:59.291 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863199+0000", 2024-09-14T09:07:59.291 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.4079551000000001, 2024-09-14T09:07:59.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013255059, 2024-09-14T09:07:59.291 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.291 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.291 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:59.291 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.291 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:59.291 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:59.291 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 690 2024-09-14T09:07:59.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.291 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863199+0000", 2024-09-14T09:07:59.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863199+0000", 2024-09-14T09:07:59.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863200+0000", 2024-09-14T09:07:59.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9800000000000004e-07 2024-09-14T09:07:59.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863201+0000", 2024-09-14T09:07:59.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8080000000000001e-06 2024-09-14T09:07:59.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863207+0000", 2024-09-14T09:07:59.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7790000000000001e-06 2024-09-14T09:07:59.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863212+0000", 2024-09-14T09:07:59.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2789999999999998e-06 2024-09-14T09:07:59.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876282+0000", 2024-09-14T09:07:59.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013069414999999999 2024-09-14T09:07:59.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876363+0000", 2024-09-14T09:07:59.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1055000000000002e-05 2024-09-14T09:07:59.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876454+0000", 2024-09-14T09:07:59.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1224999999999995e-05 2024-09-14T09:07:59.295 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.295 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.295 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.295 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:691 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 2752512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:59.295 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863219+0000", 2024-09-14T09:07:59.295 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.407935154, 2024-09-14T09:07:59.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013427955, 2024-09-14T09:07:59.295 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.295 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.295 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:59.296 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.296 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:59.296 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:59.296 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 691 2024-09-14T09:07:59.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.296 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863219+0000", 2024-09-14T09:07:59.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863219+0000", 2024-09-14T09:07:59.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863219+0000", 2024-09-14T09:07:59.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.39e-07 2024-09-14T09:07:59.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863221+0000", 2024-09-14T09:07:59.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.753e-06 2024-09-14T09:07:59.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863227+0000", 2024-09-14T09:07:59.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.896e-06 2024-09-14T09:07:59.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863232+0000", 2024-09-14T09:07:59.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5310000000000003e-06 2024-09-14T09:07:59.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876501+0000", 2024-09-14T09:07:59.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013269197999999999 2024-09-14T09:07:59.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876580+0000", 2024-09-14T09:07:59.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9487999999999995e-05 2024-09-14T09:07:59.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876647+0000", 2024-09-14T09:07:59.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6749999999999996e-05 2024-09-14T09:07:59.299 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.299 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.299 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.299 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:692 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:59.299 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863238+0000", 2024-09-14T09:07:59.299 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.407916374, 2024-09-14T09:07:59.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013610064, 2024-09-14T09:07:59.299 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.299 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.300 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:59.300 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.300 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:59.300 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:59.300 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 692 2024-09-14T09:07:59.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.300 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863238+0000", 2024-09-14T09:07:59.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863238+0000", 2024-09-14T09:07:59.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863238+0000", 2024-09-14T09:07:59.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.39e-07 2024-09-14T09:07:59.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863240+0000", 2024-09-14T09:07:59.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.649e-06 2024-09-14T09:07:59.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863246+0000", 2024-09-14T09:07:59.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7869999999999998e-06 2024-09-14T09:07:59.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863250+0000", 2024-09-14T09:07:59.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5850000000000001e-06 2024-09-14T09:07:59.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876683+0000", 2024-09-14T09:07:59.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013432372999999999 2024-09-14T09:07:59.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876763+0000", 2024-09-14T09:07:59.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9951999999999996e-05 2024-09-14T09:07:59.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876848+0000", 2024-09-14T09:07:59.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5278999999999994e-05 2024-09-14T09:07:59.303 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.303 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.303 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.304 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:693 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 5701632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:59.304 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863257+0000", 2024-09-14T09:07:59.304 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.4078972859999999, 2024-09-14T09:07:59.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013728496999999999, 2024-09-14T09:07:59.304 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.304 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.304 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:59.304 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.304 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:59.304 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:59.304 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 693 2024-09-14T09:07:59.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.304 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863257+0000", 2024-09-14T09:07:59.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863257+0000", 2024-09-14T09:07:59.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863257+0000", 2024-09-14T09:07:59.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5600000000000001e-07 2024-09-14T09:07:59.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863259+0000", 2024-09-14T09:07:59.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.736e-06 2024-09-14T09:07:59.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863265+0000", 2024-09-14T09:07:59.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9150000000000001e-06 2024-09-14T09:07:59.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863269+0000", 2024-09-14T09:07:59.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5390000000000001e-06 2024-09-14T09:07:59.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876880+0000", 2024-09-14T09:07:59.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013610587 2024-09-14T09:07:59.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876925+0000", 2024-09-14T09:07:59.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4820000000000001e-05 2024-09-14T09:07:59.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876985+0000", 2024-09-14T09:07:59.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0544000000000002e-05 2024-09-14T09:07:59.308 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.308 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.308 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.308 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:694 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:59.308 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863275+0000", 2024-09-14T09:07:59.308 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.4078790159999999, 2024-09-14T09:07:59.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013905130999999999, 2024-09-14T09:07:59.308 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.308 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.308 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:59.308 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.308 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:59.308 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:59.309 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 694 2024-09-14T09:07:59.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.309 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863275+0000", 2024-09-14T09:07:59.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863275+0000", 2024-09-14T09:07:59.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863275+0000", 2024-09-14T09:07:59.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3200000000000001e-07 2024-09-14T09:07:59.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863277+0000", 2024-09-14T09:07:59.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7799999999999999e-06 2024-09-14T09:07:59.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863283+0000", 2024-09-14T09:07:59.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6529999999999999e-06 2024-09-14T09:07:59.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863287+0000", 2024-09-14T09:07:59.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.374e-06 2024-09-14T09:07:59.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877018+0000", 2024-09-14T09:07:59.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01373095 2024-09-14T09:07:59.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877088+0000", 2024-09-14T09:07:59.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9986000000000004e-05 2024-09-14T09:07:59.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877180+0000", 2024-09-14T09:07:59.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2056000000000001e-05 2024-09-14T09:07:59.312 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.312 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.312 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.312 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:695 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 2752512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:59.312 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863293+0000", 2024-09-14T09:07:59.312 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.4078609809999998, 2024-09-14T09:07:59.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014059326, 2024-09-14T09:07:59.313 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.313 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.313 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:59.313 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.313 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:59.313 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:59.313 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 695 2024-09-14T09:07:59.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.313 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863293+0000", 2024-09-14T09:07:59.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863293+0000", 2024-09-14T09:07:59.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863294+0000", 2024-09-14T09:07:59.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2800000000000003e-07 2024-09-14T09:07:59.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863308+0000", 2024-09-14T09:07:59.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.453e-05 2024-09-14T09:07:59.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863316+0000", 2024-09-14T09:07:59.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4730000000000003e-06 2024-09-14T09:07:59.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863321+0000", 2024-09-14T09:07:59.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1159999999999998e-06 2024-09-14T09:07:59.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877217+0000", 2024-09-14T09:07:59.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013896116 2024-09-14T09:07:59.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877271+0000", 2024-09-14T09:07:59.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4450000000000002e-05 2024-09-14T09:07:59.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877353+0000", 2024-09-14T09:07:59.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1312999999999999e-05 2024-09-14T09:07:59.316 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.316 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.316 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.317 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:696 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:59.317 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863341+0000", 2024-09-14T09:07:59.317 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.407813285, 2024-09-14T09:07:59.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01426848, 2024-09-14T09:07:59.317 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.317 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.317 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:59.317 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.317 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:59.317 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:59.317 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 696 2024-09-14T09:07:59.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.317 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863341+0000", 2024-09-14T09:07:59.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863341+0000", 2024-09-14T09:07:59.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863342+0000", 2024-09-14T09:07:59.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.44e-07 2024-09-14T09:07:59.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863344+0000", 2024-09-14T09:07:59.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2400000000000002e-06 2024-09-14T09:07:59.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863350+0000", 2024-09-14T09:07:59.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.579e-06 2024-09-14T09:07:59.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863355+0000", 2024-09-14T09:07:59.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.549e-06 2024-09-14T09:07:59.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877400+0000", 2024-09-14T09:07:59.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014044911 2024-09-14T09:07:59.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877496+0000", 2024-09-14T09:07:59.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6105000000000002e-05 2024-09-14T09:07:59.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877609+0000", 2024-09-14T09:07:59.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000113452 2024-09-14T09:07:59.321 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.321 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.321 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.321 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:697 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 5701632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:59.321 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863362+0000", 2024-09-14T09:07:59.321 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.4077926440000001, 2024-09-14T09:07:59.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014418841999999999, 2024-09-14T09:07:59.321 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.321 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.322 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:59.322 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.322 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:59.322 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:59.322 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 697 2024-09-14T09:07:59.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.322 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863362+0000", 2024-09-14T09:07:59.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863362+0000", 2024-09-14T09:07:59.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863362+0000", 2024-09-14T09:07:59.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.46e-07 2024-09-14T09:07:59.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863364+0000", 2024-09-14T09:07:59.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.624e-06 2024-09-14T09:07:59.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863369+0000", 2024-09-14T09:07:59.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7400000000000001e-06 2024-09-14T09:07:59.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863383+0000", 2024-09-14T09:07:59.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3582e-05 2024-09-14T09:07:59.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877652+0000", 2024-09-14T09:07:59.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014269298999999999 2024-09-14T09:07:59.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877721+0000", 2024-09-14T09:07:59.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8881999999999995e-05 2024-09-14T09:07:59.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877780+0000", 2024-09-14T09:07:59.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9268999999999998e-05 2024-09-14T09:07:59.325 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.325 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.325 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.325 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:730 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 1376256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:59.326 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863562+0000", 2024-09-14T09:07:59.326 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.4075921199999999, 2024-09-14T09:07:59.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014435170000000001, 2024-09-14T09:07:59.326 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.326 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.326 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:59.326 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.326 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:59.326 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:59.326 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 730 2024-09-14T09:07:59.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.326 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863562+0000", 2024-09-14T09:07:59.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863562+0000", 2024-09-14T09:07:59.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863562+0000", 2024-09-14T09:07:59.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.65e-07 2024-09-14T09:07:59.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863570+0000", 2024-09-14T09:07:59.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8189999999999992e-06 2024-09-14T09:07:59.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863576+0000", 2024-09-14T09:07:59.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7420000000000003e-06 2024-09-14T09:07:59.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863585+0000", 2024-09-14T09:07:59.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3000000000000007e-06 2024-09-14T09:07:59.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877818+0000", 2024-09-14T09:07:59.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014232463000000001 2024-09-14T09:07:59.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877898+0000", 2024-09-14T09:07:59.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0012999999999994e-05 2024-09-14T09:07:59.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877997+0000", 2024-09-14T09:07:59.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9468000000000004e-05 2024-09-14T09:07:59.329 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.329 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.329 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.330 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:731 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:59.330 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863593+0000", 2024-09-14T09:07:59.330 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.4075612780000002, 2024-09-14T09:07:59.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014635227000000001, 2024-09-14T09:07:59.330 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.330 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.330 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:59.330 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.330 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:59.330 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:59.330 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 731 2024-09-14T09:07:59.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.330 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863593+0000", 2024-09-14T09:07:59.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863593+0000", 2024-09-14T09:07:59.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863593+0000", 2024-09-14T09:07:59.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.08e-07 2024-09-14T09:07:59.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863600+0000", 2024-09-14T09:07:59.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6250000000000001e-06 2024-09-14T09:07:59.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863606+0000", 2024-09-14T09:07:59.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0270000000000001e-06 2024-09-14T09:07:59.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863611+0000", 2024-09-14T09:07:59.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1420000000000001e-06 2024-09-14T09:07:59.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878041+0000", 2024-09-14T09:07:59.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014430121000000001 2024-09-14T09:07:59.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878128+0000", 2024-09-14T09:07:59.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6562000000000002e-05 2024-09-14T09:07:59.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878228+0000", 2024-09-14T09:07:59.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000100342 2024-09-14T09:07:59.334 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.334 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.334 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.334 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:732 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 4325376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:59.334 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863618+0000", 2024-09-14T09:07:59.334 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.4075365990000002, 2024-09-14T09:07:59.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014825102999999999, 2024-09-14T09:07:59.334 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.334 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.334 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:59.334 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.334 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:59.334 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:59.335 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 732 2024-09-14T09:07:59.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.335 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863618+0000", 2024-09-14T09:07:59.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863618+0000", 2024-09-14T09:07:59.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863618+0000", 2024-09-14T09:07:59.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6399999999999998e-07 2024-09-14T09:07:59.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863620+0000", 2024-09-14T09:07:59.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6559999999999999e-06 2024-09-14T09:07:59.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863626+0000", 2024-09-14T09:07:59.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5799999999999997e-06 2024-09-14T09:07:59.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863631+0000", 2024-09-14T09:07:59.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2830000000000001e-06 2024-09-14T09:07:59.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878274+0000", 2024-09-14T09:07:59.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014642426 2024-09-14T09:07:59.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878348+0000", 2024-09-14T09:07:59.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4209999999999996e-05 2024-09-14T09:07:59.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878443+0000", 2024-09-14T09:07:59.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4584000000000001e-05 2024-09-14T09:07:59.338 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.338 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.338 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.338 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:733 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:59.338 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863638+0000", 2024-09-14T09:07:59.338 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.4075165370000002, 2024-09-14T09:07:59.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01497658, 2024-09-14T09:07:59.339 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.339 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.339 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:59.339 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.339 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:59.339 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:59.339 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 733 2024-09-14T09:07:59.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.339 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863638+0000", 2024-09-14T09:07:59.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863638+0000", 2024-09-14T09:07:59.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863638+0000", 2024-09-14T09:07:59.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7e-07 2024-09-14T09:07:59.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863640+0000", 2024-09-14T09:07:59.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.765e-06 2024-09-14T09:07:59.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863646+0000", 2024-09-14T09:07:59.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9109999999999998e-06 2024-09-14T09:07:59.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863650+0000", 2024-09-14T09:07:59.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7099999999999998e-06 2024-09-14T09:07:59.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878476+0000", 2024-09-14T09:07:59.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014825408 2024-09-14T09:07:59.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878522+0000", 2024-09-14T09:07:59.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5731e-05 2024-09-14T09:07:59.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878614+0000", 2024-09-14T09:07:59.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2684999999999998e-05 2024-09-14T09:07:59.342 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.342 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.342 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.343 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:734 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 1376256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:59.343 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863656+0000", 2024-09-14T09:07:59.343 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.407498178, 2024-09-14T09:07:59.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015170861000000001, 2024-09-14T09:07:59.343 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.343 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.343 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:59.343 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.343 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:59.343 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:59.343 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 734 2024-09-14T09:07:59.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.343 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863656+0000", 2024-09-14T09:07:59.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863656+0000", 2024-09-14T09:07:59.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863656+0000", 2024-09-14T09:07:59.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4200000000000002e-07 2024-09-14T09:07:59.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863658+0000", 2024-09-14T09:07:59.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.685e-06 2024-09-14T09:07:59.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863665+0000", 2024-09-14T09:07:59.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5610000000000004e-06 2024-09-14T09:07:59.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863669+0000", 2024-09-14T09:07:59.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7899999999999999e-06 2024-09-14T09:07:59.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878654+0000", 2024-09-14T09:07:59.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014984877000000001 2024-09-14T09:07:59.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878731+0000", 2024-09-14T09:07:59.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6627999999999999e-05 2024-09-14T09:07:59.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878827+0000", 2024-09-14T09:07:59.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5977999999999995e-05 2024-09-14T09:07:59.347 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.347 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.347 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.347 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:735 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 2818048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:59.347 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863676+0000", 2024-09-14T09:07:59.347 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.4074786260000001, 2024-09-14T09:07:59.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015314884000000001, 2024-09-14T09:07:59.347 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.347 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.347 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:59.348 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.348 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:59.348 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:59.348 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 735 2024-09-14T09:07:59.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.348 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863676+0000", 2024-09-14T09:07:59.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863676+0000", 2024-09-14T09:07:59.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863676+0000", 2024-09-14T09:07:59.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9699999999999996e-07 2024-09-14T09:07:59.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863678+0000", 2024-09-14T09:07:59.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.73e-06 2024-09-14T09:07:59.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863683+0000", 2024-09-14T09:07:59.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7089999999999999e-06 2024-09-14T09:07:59.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863688+0000", 2024-09-14T09:07:59.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4209999999999997e-06 2024-09-14T09:07:59.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878858+0000", 2024-09-14T09:07:59.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015170243 2024-09-14T09:07:59.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878898+0000", 2024-09-14T09:07:59.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9471999999999997e-05 2024-09-14T09:07:59.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878990+0000", 2024-09-14T09:07:59.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2812000000000005e-05 2024-09-14T09:07:59.351 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.351 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.351 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.351 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:736 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 4325376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:59.351 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863711+0000", 2024-09-14T09:07:59.351 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.4074436320000001, 2024-09-14T09:07:59.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015489134, 2024-09-14T09:07:59.352 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.352 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.352 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:59.352 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.352 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:59.352 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:59.352 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 736 2024-09-14T09:07:59.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.352 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863711+0000", 2024-09-14T09:07:59.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863711+0000", 2024-09-14T09:07:59.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863711+0000", 2024-09-14T09:07:59.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7599999999999997e-07 2024-09-14T09:07:59.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863713+0000", 2024-09-14T09:07:59.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.04e-06 2024-09-14T09:07:59.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863720+0000", 2024-09-14T09:07:59.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4570000000000002e-06 2024-09-14T09:07:59.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863724+0000", 2024-09-14T09:07:59.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4490000000000001e-06 2024-09-14T09:07:59.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.879030+0000", 2024-09-14T09:07:59.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01530606 2024-09-14T09:07:59.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.879104+0000", 2024-09-14T09:07:59.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4023000000000006e-05 2024-09-14T09:07:59.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.879200+0000", 2024-09-14T09:07:59.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5529e-05 2024-09-14T09:07:59.356 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.356 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.356 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.356 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:737 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:07:59.356 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863731+0000", 2024-09-14T09:07:59.356 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.4074234900000002, 2024-09-14T09:07:59.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015612793999999999, 2024-09-14T09:07:59.357 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.357 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.357 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:07:59.357 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.357 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:07:59.357 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:07:59.357 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 737 2024-09-14T09:07:59.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.357 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863731+0000", 2024-09-14T09:07:59.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863731+0000", 2024-09-14T09:07:59.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863731+0000", 2024-09-14T09:07:59.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3000000000000001e-07 2024-09-14T09:07:59.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863733+0000", 2024-09-14T09:07:59.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.821e-06 2024-09-14T09:07:59.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863739+0000", 2024-09-14T09:07:59.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-09-14T09:07:59.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863744+0000", 2024-09-14T09:07:59.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1699999999999996e-06 2024-09-14T09:07:59.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.879230+0000", 2024-09-14T09:07:59.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015485478 2024-09-14T09:07:59.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.879276+0000", 2024-09-14T09:07:59.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6489999999999997e-05 2024-09-14T09:07:59.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.879343+0000", 2024-09-14T09:07:59.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7047999999999999e-05 2024-09-14T09:07:59.360 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.360 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.360 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.360 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.360 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.360 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:59.362 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:59.364+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:59.362 INFO:teuthology.orchestra.run.smithi148.stdout:1026 write 0x6ad0600 thru 0x6adeb5c (0xe55d bytes) 2024-09-14T09:07:59.362 INFO:teuthology.orchestra.run.smithi148.stdout:1027 write 0x20d600 thru 0x210749 (0x314a bytes) 2024-09-14T09:07:59.362 INFO:teuthology.orchestra.run.smithi148.stdout:1028 trunc from 0xcac3000 to 0x2670c00 2024-09-14T09:07:59.363 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:07:59.385 INFO:teuthology.orchestra.run.smithi148.stdout:1029 read 0x38a600 thru 0x38a8fd (0x2fe bytes) 2024-09-14T09:07:59.386 INFO:teuthology.orchestra.run.smithi148.stdout:1030 read 0xe51e00 thru 0xe5672c (0x492d bytes) 2024-09-14T09:07:59.386 INFO:teuthology.orchestra.run.smithi148.stdout:1031 read 0xc3e600 thru 0xc3edc9 (0x7ca bytes) 2024-09-14T09:07:59.387 INFO:teuthology.orchestra.run.smithi148.stdout:1037 read 0xba4e00 thru 0xba8808 (0x3a09 bytes) 2024-09-14T09:07:59.387 INFO:teuthology.orchestra.run.smithi148.stdout:1039 write 0x1a24e00 thru 0x1a26e24 (0x2025 bytes) 2024-09-14T09:07:59.402 INFO:teuthology.orchestra.run.smithi148.stdout:1041 trunc from 0x2670c00 to 0xdff1200 2024-09-14T09:07:59.414 INFO:teuthology.orchestra.run.smithi148.stdout:1043 read 0x6ee4800 thru 0x6eee86a (0xa06b bytes) 2024-09-14T09:07:59.421 INFO:teuthology.orchestra.run.smithi148.stdout:1044 read 0x48acc00 thru 0x48b0625 (0x3a26 bytes) 2024-09-14T09:07:59.421 INFO:teuthology.orchestra.run.smithi148.stdout:1045 punch from 0x6bbca00 to 0x6bc2800, (0x5e00 bytes) 2024-09-14T09:07:59.421 INFO:teuthology.orchestra.run.smithi148.stdout:1047 read 0x3d4d800 thru 0x3d4ef61 (0x1762 bytes) 2024-09-14T09:07:59.432 INFO:teuthology.orchestra.run.smithi148.stdout:1048 trunc from 0xdff1200 to 0x4a1d600 2024-09-14T09:07:59.449 INFO:teuthology.orchestra.run.smithi148.stdout:1051 trunc from 0x4a1d600 to 0x34da600 2024-09-14T09:07:59.463 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:07:59.465+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:07:59.468 INFO:teuthology.orchestra.run.smithi148.stdout:1052 trunc from 0x34da600 to 0x610ca00 2024-09-14T09:07:59.482 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:07:59.482 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:07:59.482 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:59.492 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:07:59.494 INFO:teuthology.orchestra.run.smithi148.stdout:1053 write 0x8672a00 thru 0x867d5e5 (0xabe6 bytes) 2024-09-14T09:07:59.495 INFO:teuthology.orchestra.run.smithi148.stdout:1054 read 0xc77400 thru 0xc7f3a2 (0x7fa3 bytes) 2024-09-14T09:07:59.499 INFO:teuthology.orchestra.run.smithi148.stdout:1055 read 0xea3200 thru 0xeaa164 (0x6f65 bytes) 2024-09-14T09:07:59.518 INFO:teuthology.orchestra.run.smithi148.stdout:1057 write 0x9651c00 thru 0x965eb39 (0xcf3a bytes) 2024-09-14T09:07:59.525 INFO:teuthology.orchestra.run.smithi148.stdout:1059 write 0x2bc7800 thru 0x2bd3b2d (0xc32e bytes) 2024-09-14T09:07:59.525 INFO:teuthology.orchestra.run.smithi148.stdout:1060 read 0x51c0200 thru 0x51c45da (0x43db bytes) 2024-09-14T09:07:59.525 INFO:teuthology.orchestra.run.smithi148.stdout:1065 read 0x7c28200 thru 0x7c381be (0xffbf bytes) 2024-09-14T09:07:59.525 INFO:teuthology.orchestra.run.smithi148.stdout:1067 clone 7 order 22 su 2097152 sc 14 2024-09-14T09:07:59.540 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T09:07:59.540 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:07:59.540 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-14T09:07:59.541 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T09:07:59.584 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:59.586+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:07:59.606 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:59.606 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:07:59.606 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:07:59.606 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:07:59.606 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:59.615 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:07:59.665 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:07:59.667+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:07:59.762 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:59.762 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:07:59.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:07:59.762 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:07:59.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.762 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:59.762 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:07:59.762 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 29.528824984, 2024-09-14T09:07:59.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72111598600000004, 2024-09-14T09:07:59.763 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.763 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.763 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:59.763 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.763 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:59.763 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:59.763 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1 2024-09-14T09:07:59.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.763 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:07:59.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:07:59.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233065+0000", 2024-09-14T09:07:59.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1909999999999999e-06 2024-09-14T09:07:59.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233071+0000", 2024-09-14T09:07:59.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5300000000000002e-06 2024-09-14T09:07:59.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233081+0000", 2024-09-14T09:07:59.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0339e-05 2024-09-14T09:07:59.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233093+0000", 2024-09-14T09:07:59.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1252e-05 2024-09-14T09:07:59.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233162+0000", 2024-09-14T09:07:59.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9678999999999995e-05 2024-09-14T09:07:59.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:07:59.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233171+0000", 2024-09-14T09:07:59.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.132e-06 2024-09-14T09:07:59.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952480+0000", 2024-09-14T09:07:59.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.71930839899999999 2024-09-14T09:07:59.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952655+0000", 2024-09-14T09:07:59.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017552 2024-09-14T09:07:59.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:59.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952835+0000", 2024-09-14T09:07:59.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001797 2024-09-14T09:07:59.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:59.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.953648+0000", 2024-09-14T09:07:59.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00081291700000000002 2024-09-14T09:07:59.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:59.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954108+0000", 2024-09-14T09:07:59.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045992800000000002 2024-09-14T09:07:59.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:59.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954149+0000", 2024-09-14T09:07:59.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1214999999999998e-05 2024-09-14T09:07:59.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954178+0000", 2024-09-14T09:07:59.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9184e-05 2024-09-14T09:07:59.769 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.769 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.769 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.769 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:59.769 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153119+0000", 2024-09-14T09:07:59.770 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.608768712, 2024-09-14T09:07:59.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011276675999999999, 2024-09-14T09:07:59.770 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.770 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.770 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:59.770 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.770 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:59.770 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:59.770 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 41 2024-09-14T09:07:59.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.770 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153119+0000", 2024-09-14T09:07:59.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153119+0000", 2024-09-14T09:07:59.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153119+0000", 2024-09-14T09:07:59.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8800000000000002e-07 2024-09-14T09:07:59.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153170+0000", 2024-09-14T09:07:59.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1020000000000003e-05 2024-09-14T09:07:59.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153176+0000", 2024-09-14T09:07:59.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1739999999999997e-06 2024-09-14T09:07:59.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153182+0000", 2024-09-14T09:07:59.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4430000000000002e-06 2024-09-14T09:07:59.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.154147+0000", 2024-09-14T09:07:59.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00096519900000000003 2024-09-14T09:07:59.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.154220+0000", 2024-09-14T09:07:59.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3339999999999999e-05 2024-09-14T09:07:59.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:59.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.154305+0000", 2024-09-14T09:07:59.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4266999999999998e-05 2024-09-14T09:07:59.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:59.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157785+0000", 2024-09-14T09:07:59.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034801369999999999 2024-09-14T09:07:59.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:59.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164340+0000", 2024-09-14T09:07:59.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0065547349999999999 2024-09-14T09:07:59.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:59.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164370+0000", 2024-09-14T09:07:59.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0944000000000001e-05 2024-09-14T09:07:59.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164395+0000", 2024-09-14T09:07:59.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4828999999999999e-05 2024-09-14T09:07:59.776 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.776 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.776 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.776 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:59.776 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153190+0000", 2024-09-14T09:07:59.776 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.608697279000001, 2024-09-14T09:07:59.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011298134, 2024-09-14T09:07:59.776 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.777 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.777 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:59.777 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.777 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:59.777 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:59.777 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 42 2024-09-14T09:07:59.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.777 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153190+0000", 2024-09-14T09:07:59.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153190+0000", 2024-09-14T09:07:59.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153191+0000", 2024-09-14T09:07:59.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4099999999999999e-07 2024-09-14T09:07:59.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153193+0000", 2024-09-14T09:07:59.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1900000000000002e-06 2024-09-14T09:07:59.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153197+0000", 2024-09-14T09:07:59.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3479999999999997e-06 2024-09-14T09:07:59.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153200+0000", 2024-09-14T09:07:59.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8669999999999998e-06 2024-09-14T09:07:59.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.154763+0000", 2024-09-14T09:07:59.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0015633719999999999 2024-09-14T09:07:59.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.154811+0000", 2024-09-14T09:07:59.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7797000000000003e-05 2024-09-14T09:07:59.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:59.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.154889+0000", 2024-09-14T09:07:59.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7742000000000002e-05 2024-09-14T09:07:59.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:59.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157790+0000", 2024-09-14T09:07:59.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0029008710000000002 2024-09-14T09:07:59.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:59.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164429+0000", 2024-09-14T09:07:59.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066394710000000001 2024-09-14T09:07:59.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:59.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164462+0000", 2024-09-14T09:07:59.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2827000000000003e-05 2024-09-14T09:07:59.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164488+0000", 2024-09-14T09:07:59.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6208e-05 2024-09-14T09:07:59.784 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.784 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.784 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.785 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:59.785 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153280+0000", 2024-09-14T09:07:59.785 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.608607377999999, 2024-09-14T09:07:59.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011598466999999999, 2024-09-14T09:07:59.785 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.785 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.785 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:59.785 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.785 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:59.786 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:59.786 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 43 2024-09-14T09:07:59.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.786 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153280+0000", 2024-09-14T09:07:59.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153280+0000", 2024-09-14T09:07:59.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153281+0000", 2024-09-14T09:07:59.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2200000000000004e-07 2024-09-14T09:07:59.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153284+0000", 2024-09-14T09:07:59.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9779999999999999e-06 2024-09-14T09:07:59.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153290+0000", 2024-09-14T09:07:59.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9569999999999999e-06 2024-09-14T09:07:59.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153294+0000", 2024-09-14T09:07:59.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3060000000000002e-06 2024-09-14T09:07:59.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.155173+0000", 2024-09-14T09:07:59.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00187929 2024-09-14T09:07:59.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.155222+0000", 2024-09-14T09:07:59.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9249000000000002e-05 2024-09-14T09:07:59.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:59.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.155299+0000", 2024-09-14T09:07:59.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6755999999999995e-05 2024-09-14T09:07:59.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:59.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157795+0000", 2024-09-14T09:07:59.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024964359999999999 2024-09-14T09:07:59.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:59.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164785+0000", 2024-09-14T09:07:59.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069898729999999997 2024-09-14T09:07:59.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:59.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164837+0000", 2024-09-14T09:07:59.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2061999999999997e-05 2024-09-14T09:07:59.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164878+0000", 2024-09-14T09:07:59.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1038000000000002e-05 2024-09-14T09:07:59.791 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.791 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.791 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.791 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:59.791 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153342+0000", 2024-09-14T09:07:59.791 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.608545501999998, 2024-09-14T09:07:59.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011654108, 2024-09-14T09:07:59.792 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.792 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.792 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:59.792 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.792 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:59.792 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:59.792 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 44 2024-09-14T09:07:59.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.792 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153342+0000", 2024-09-14T09:07:59.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153342+0000", 2024-09-14T09:07:59.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153342+0000", 2024-09-14T09:07:59.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.53e-07 2024-09-14T09:07:59.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153414+0000", 2024-09-14T09:07:59.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1952000000000005e-05 2024-09-14T09:07:59.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153420+0000", 2024-09-14T09:07:59.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8390000000000003e-06 2024-09-14T09:07:59.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153425+0000", 2024-09-14T09:07:59.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7509999999999999e-06 2024-09-14T09:07:59.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.155556+0000", 2024-09-14T09:07:59.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0021313389999999999 2024-09-14T09:07:59.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.155607+0000", 2024-09-14T09:07:59.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0756e-05 2024-09-14T09:07:59.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:59.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.155686+0000", 2024-09-14T09:07:59.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9008e-05 2024-09-14T09:07:59.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:59.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157800+0000", 2024-09-14T09:07:59.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0021143030000000001 2024-09-14T09:07:59.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:59.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164927+0000", 2024-09-14T09:07:59.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071267029999999999 2024-09-14T09:07:59.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:59.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164959+0000", 2024-09-14T09:07:59.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2289999999999997e-05 2024-09-14T09:07:59.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.164996+0000", 2024-09-14T09:07:59.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6813999999999997e-05 2024-09-14T09:07:59.799 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.799 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.799 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.799 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:59.799 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153439+0000", 2024-09-14T09:07:59.799 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.608448794000001, 2024-09-14T09:07:59.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011648581999999999, 2024-09-14T09:07:59.799 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.799 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.800 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:59.800 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.800 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:59.800 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:59.800 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 45 2024-09-14T09:07:59.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.800 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153439+0000", 2024-09-14T09:07:59.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153439+0000", 2024-09-14T09:07:59.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153439+0000", 2024-09-14T09:07:59.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0499999999999999e-07 2024-09-14T09:07:59.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153442+0000", 2024-09-14T09:07:59.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0070000000000002e-06 2024-09-14T09:07:59.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153448+0000", 2024-09-14T09:07:59.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7540000000000003e-06 2024-09-14T09:07:59.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153452+0000", 2024-09-14T09:07:59.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0559999999999998e-06 2024-09-14T09:07:59.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.156116+0000", 2024-09-14T09:07:59.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026643560000000001 2024-09-14T09:07:59.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.156165+0000", 2024-09-14T09:07:59.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8362000000000002e-05 2024-09-14T09:07:59.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:59.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.156261+0000", 2024-09-14T09:07:59.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6164999999999998e-05 2024-09-14T09:07:59.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:59.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159642+0000", 2024-09-14T09:07:59.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033813599999999999 2024-09-14T09:07:59.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:59.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165035+0000", 2024-09-14T09:07:59.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0053929889999999999 2024-09-14T09:07:59.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:59.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165064+0000", 2024-09-14T09:07:59.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9229000000000001e-05 2024-09-14T09:07:59.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165087+0000", 2024-09-14T09:07:59.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2898999999999999e-05 2024-09-14T09:07:59.805 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.805 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.805 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.805 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:59.805 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153458+0000", 2024-09-14T09:07:59.805 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.608429761, 2024-09-14T09:07:59.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011717188999999999, 2024-09-14T09:07:59.805 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.805 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.806 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:59.806 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.806 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:59.806 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:59.806 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 46 2024-09-14T09:07:59.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.806 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153458+0000", 2024-09-14T09:07:59.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153458+0000", 2024-09-14T09:07:59.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153458+0000", 2024-09-14T09:07:59.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3200000000000001e-07 2024-09-14T09:07:59.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153462+0000", 2024-09-14T09:07:59.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0969999999999999e-06 2024-09-14T09:07:59.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153465+0000", 2024-09-14T09:07:59.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.455e-06 2024-09-14T09:07:59.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153468+0000", 2024-09-14T09:07:59.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6460000000000002e-06 2024-09-14T09:07:59.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.156541+0000", 2024-09-14T09:07:59.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030729059999999998 2024-09-14T09:07:59.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.156597+0000", 2024-09-14T09:07:59.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6496999999999998e-05 2024-09-14T09:07:59.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:59.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.156674+0000", 2024-09-14T09:07:59.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6483000000000006e-05 2024-09-14T09:07:59.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:59.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159649+0000", 2024-09-14T09:07:59.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0029750750000000002 2024-09-14T09:07:59.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:59.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165122+0000", 2024-09-14T09:07:59.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054732100000000001 2024-09-14T09:07:59.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:59.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165151+0000", 2024-09-14T09:07:59.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8535999999999999e-05 2024-09-14T09:07:59.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165175+0000", 2024-09-14T09:07:59.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4051999999999999e-05 2024-09-14T09:07:59.811 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.811 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.811 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.811 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:59.811 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153481+0000", 2024-09-14T09:07:59.811 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.608406849000001, 2024-09-14T09:07:59.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011772726000000001, 2024-09-14T09:07:59.811 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.812 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.812 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:59.812 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.812 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:59.812 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:59.812 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 47 2024-09-14T09:07:59.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.812 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153481+0000", 2024-09-14T09:07:59.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153481+0000", 2024-09-14T09:07:59.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153481+0000", 2024-09-14T09:07:59.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3099999999999999e-07 2024-09-14T09:07:59.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153532+0000", 2024-09-14T09:07:59.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1536999999999998e-05 2024-09-14T09:07:59.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153540+0000", 2024-09-14T09:07:59.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4000000000000003e-06 2024-09-14T09:07:59.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153545+0000", 2024-09-14T09:07:59.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7069999999999997e-06 2024-09-14T09:07:59.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.156923+0000", 2024-09-14T09:07:59.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003377082 2024-09-14T09:07:59.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157005+0000", 2024-09-14T09:07:59.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2547999999999996e-05 2024-09-14T09:07:59.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:59.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157082+0000", 2024-09-14T09:07:59.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6829000000000006e-05 2024-09-14T09:07:59.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:59.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159653+0000", 2024-09-14T09:07:59.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025711549999999999 2024-09-14T09:07:59.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:59.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165208+0000", 2024-09-14T09:07:59.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055549429999999997 2024-09-14T09:07:59.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:59.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165234+0000", 2024-09-14T09:07:59.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6274999999999998e-05 2024-09-14T09:07:59.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165253+0000", 2024-09-14T09:07:59.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8919e-05 2024-09-14T09:07:59.818 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.818 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.818 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.819 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:59.819 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153559+0000", 2024-09-14T09:07:59.819 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.608328484000001, 2024-09-14T09:07:59.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011777464, 2024-09-14T09:07:59.819 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.819 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.819 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:59.819 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.819 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:59.819 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:59.820 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 48 2024-09-14T09:07:59.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.820 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153559+0000", 2024-09-14T09:07:59.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153559+0000", 2024-09-14T09:07:59.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153559+0000", 2024-09-14T09:07:59.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0399999999999996e-07 2024-09-14T09:07:59.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153563+0000", 2024-09-14T09:07:59.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9049999999999999e-06 2024-09-14T09:07:59.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153572+0000", 2024-09-14T09:07:59.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0219999999999993e-06 2024-09-14T09:07:59.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153578+0000", 2024-09-14T09:07:59.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5369999999999997e-06 2024-09-14T09:07:59.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157446+0000", 2024-09-14T09:07:59.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0038676159999999999 2024-09-14T09:07:59.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157493+0000", 2024-09-14T09:07:59.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7661999999999999e-05 2024-09-14T09:07:59.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:59.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157568+0000", 2024-09-14T09:07:59.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4548999999999994e-05 2024-09-14T09:07:59.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:59.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159656+0000", 2024-09-14T09:07:59.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002088389 2024-09-14T09:07:59.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:59.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165286+0000", 2024-09-14T09:07:59.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056303350000000002 2024-09-14T09:07:59.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:59.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165313+0000", 2024-09-14T09:07:59.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6050999999999998e-05 2024-09-14T09:07:59.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165336+0000", 2024-09-14T09:07:59.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3794e-05 2024-09-14T09:07:59.826 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.826 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.826 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.826 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:59.826 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153590+0000", 2024-09-14T09:07:59.827 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.608297100000001, 2024-09-14T09:07:59.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011822174, 2024-09-14T09:07:59.827 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.827 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.827 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:59.827 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.827 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:59.827 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:59.827 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 49 2024-09-14T09:07:59.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.828 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153590+0000", 2024-09-14T09:07:59.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153590+0000", 2024-09-14T09:07:59.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153591+0000", 2024-09-14T09:07:59.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.37e-07 2024-09-14T09:07:59.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153595+0000", 2024-09-14T09:07:59.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1609999999999996e-06 2024-09-14T09:07:59.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153602+0000", 2024-09-14T09:07:59.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1099999999999997e-06 2024-09-14T09:07:59.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153609+0000", 2024-09-14T09:07:59.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8369999999999999e-06 2024-09-14T09:07:59.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157833+0000", 2024-09-14T09:07:59.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.004223699 2024-09-14T09:07:59.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157882+0000", 2024-09-14T09:07:59.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9592999999999998e-05 2024-09-14T09:07:59.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:59.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.157956+0000", 2024-09-14T09:07:59.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4196999999999995e-05 2024-09-14T09:07:59.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:59.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159658+0000", 2024-09-14T09:07:59.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0017020749999999999 2024-09-14T09:07:59.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:59.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165369+0000", 2024-09-14T09:07:59.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057103309999999999 2024-09-14T09:07:59.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:59.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165394+0000", 2024-09-14T09:07:59.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5205999999999999e-05 2024-09-14T09:07:59.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165412+0000", 2024-09-14T09:07:59.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8428e-05 2024-09-14T09:07:59.833 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.833 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.833 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.833 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:59.833 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153631+0000", 2024-09-14T09:07:59.833 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.608256544, 2024-09-14T09:07:59.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011869523999999999, 2024-09-14T09:07:59.834 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.834 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.834 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:59.834 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.834 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:59.834 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:59.834 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 50 2024-09-14T09:07:59.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.834 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153631+0000", 2024-09-14T09:07:59.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153631+0000", 2024-09-14T09:07:59.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153631+0000", 2024-09-14T09:07:59.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999998e-07 2024-09-14T09:07:59.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153681+0000", 2024-09-14T09:07:59.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9688000000000003e-05 2024-09-14T09:07:59.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153689+0000", 2024-09-14T09:07:59.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:07:59.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153696+0000", 2024-09-14T09:07:59.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4159999999999998e-06 2024-09-14T09:07:59.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.158221+0000", 2024-09-14T09:07:59.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045246430000000001 2024-09-14T09:07:59.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.158275+0000", 2024-09-14T09:07:59.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3517999999999998e-05 2024-09-14T09:07:59.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:59.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.158354+0000", 2024-09-14T09:07:59.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9426999999999997e-05 2024-09-14T09:07:59.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:59.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159661+0000", 2024-09-14T09:07:59.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013065310000000001 2024-09-14T09:07:59.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:59.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165449+0000", 2024-09-14T09:07:59.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057885610000000002 2024-09-14T09:07:59.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:59.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165476+0000", 2024-09-14T09:07:59.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6959999999999999e-05 2024-09-14T09:07:59.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165500+0000", 2024-09-14T09:07:59.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4261e-05 2024-09-14T09:07:59.839 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.839 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.839 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.839 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:59.839 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153710+0000", 2024-09-14T09:07:59.840 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.608177314999999, 2024-09-14T09:07:59.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011866623999999999, 2024-09-14T09:07:59.840 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.840 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.840 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:59.840 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.840 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:59.840 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:59.840 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 51 2024-09-14T09:07:59.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.840 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153710+0000", 2024-09-14T09:07:59.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153710+0000", 2024-09-14T09:07:59.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153711+0000", 2024-09-14T09:07:59.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6000000000000003e-07 2024-09-14T09:07:59.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153715+0000", 2024-09-14T09:07:59.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8990000000000003e-06 2024-09-14T09:07:59.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153723+0000", 2024-09-14T09:07:59.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9899999999999997e-06 2024-09-14T09:07:59.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153739+0000", 2024-09-14T09:07:59.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6524999999999998e-05 2024-09-14T09:07:59.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.158746+0000", 2024-09-14T09:07:59.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00500717 2024-09-14T09:07:59.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.158796+0000", 2024-09-14T09:07:59.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9327999999999999e-05 2024-09-14T09:07:59.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:59.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.158897+0000", 2024-09-14T09:07:59.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010135400000000001 2024-09-14T09:07:59.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:59.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.162214+0000", 2024-09-14T09:07:59.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033173500000000002 2024-09-14T09:07:59.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:59.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165533+0000", 2024-09-14T09:07:59.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033186309999999998 2024-09-14T09:07:59.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:59.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165558+0000", 2024-09-14T09:07:59.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5007999999999998e-05 2024-09-14T09:07:59.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165577+0000", 2024-09-14T09:07:59.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8709e-05 2024-09-14T09:07:59.846 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.846 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.847 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.847 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:07:59.847 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.153750+0000", 2024-09-14T09:07:59.847 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.608136863999999, 2024-09-14T09:07:59.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011903145, 2024-09-14T09:07:59.847 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.847 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.847 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:59.847 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.847 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:59.848 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:59.848 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 52 2024-09-14T09:07:59.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.848 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153750+0000", 2024-09-14T09:07:59.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153750+0000", 2024-09-14T09:07:59.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153751+0000", 2024-09-14T09:07:59.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0699999999999997e-07 2024-09-14T09:07:59.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153755+0000", 2024-09-14T09:07:59.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.053e-06 2024-09-14T09:07:59.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153762+0000", 2024-09-14T09:07:59.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8210000000000004e-06 2024-09-14T09:07:59.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.153768+0000", 2024-09-14T09:07:59.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9190000000000004e-06 2024-09-14T09:07:59.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159302+0000", 2024-09-14T09:07:59.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055338100000000001 2024-09-14T09:07:59.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159356+0000", 2024-09-14T09:07:59.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4203999999999998e-05 2024-09-14T09:07:59.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:59.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.159437+0000", 2024-09-14T09:07:59.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0883999999999993e-05 2024-09-14T09:07:59.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:59.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.162440+0000", 2024-09-14T09:07:59.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003003136 2024-09-14T09:07:59.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:59.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165604+0000", 2024-09-14T09:07:59.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031642760000000002 2024-09-14T09:07:59.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:59.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165632+0000", 2024-09-14T09:07:59.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7883999999999999e-05 2024-09-14T09:07:59.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.165654+0000", 2024-09-14T09:07:59.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1651e-05 2024-09-14T09:07:59.853 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.853 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.853 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.854 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-14T09:07:59.854 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.429665+0000", 2024-09-14T09:07:59.854 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.332222850000001, 2024-09-14T09:07:59.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095381779999999996, 2024-09-14T09:07:59.854 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.854 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.854 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:59.854 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.855 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:59.855 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:59.855 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 72 2024-09-14T09:07:59.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.855 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429665+0000", 2024-09-14T09:07:59.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429665+0000", 2024-09-14T09:07:59.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429665+0000", 2024-09-14T09:07:59.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.35e-07 2024-09-14T09:07:59.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429773+0000", 2024-09-14T09:07:59.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000107864 2024-09-14T09:07:59.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429778+0000", 2024-09-14T09:07:59.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9459999999999997e-06 2024-09-14T09:07:59.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429781+0000", 2024-09-14T09:07:59.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2629999999999999e-06 2024-09-14T09:07:59.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.432292+0000", 2024-09-14T09:07:59.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025115150000000002 2024-09-14T09:07:59.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.432349+0000", 2024-09-14T09:07:59.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6866000000000001e-05 2024-09-14T09:07:59.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:59.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.432419+0000", 2024-09-14T09:07:59.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9407999999999997e-05 2024-09-14T09:07:59.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:59.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434667+0000", 2024-09-14T09:07:59.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022485199999999999 2024-09-14T09:07:59.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:59.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439157+0000", 2024-09-14T09:07:59.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044895890000000004 2024-09-14T09:07:59.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:59.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439183+0000", 2024-09-14T09:07:59.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6659999999999999e-05 2024-09-14T09:07:59.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439203+0000", 2024-09-14T09:07:59.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9312000000000001e-05 2024-09-14T09:07:59.862 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.862 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.862 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.862 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-14T09:07:59.863 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.429802+0000", 2024-09-14T09:07:59.863 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.332085277000001, 2024-09-14T09:07:59.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099135869999999997, 2024-09-14T09:07:59.863 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.863 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.863 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:59.863 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.863 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:59.863 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:59.863 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73 2024-09-14T09:07:59.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.863 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429802+0000", 2024-09-14T09:07:59.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429802+0000", 2024-09-14T09:07:59.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429802+0000", 2024-09-14T09:07:59.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3999999999999997e-07 2024-09-14T09:07:59.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429805+0000", 2024-09-14T09:07:59.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2330000000000001e-06 2024-09-14T09:07:59.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429808+0000", 2024-09-14T09:07:59.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.681e-06 2024-09-14T09:07:59.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429811+0000", 2024-09-14T09:07:59.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7879999999999998e-06 2024-09-14T09:07:59.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.432914+0000", 2024-09-14T09:07:59.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031032640000000001 2024-09-14T09:07:59.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.432957+0000", 2024-09-14T09:07:59.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3006999999999997e-05 2024-09-14T09:07:59.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:59.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.433035+0000", 2024-09-14T09:07:59.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7952000000000002e-05 2024-09-14T09:07:59.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:59.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434669+0000", 2024-09-14T09:07:59.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001633736 2024-09-14T09:07:59.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:59.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439664+0000", 2024-09-14T09:07:59.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.004995396 2024-09-14T09:07:59.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:59.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439694+0000", 2024-09-14T09:07:59.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9428999999999999e-05 2024-09-14T09:07:59.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439716+0000", 2024-09-14T09:07:59.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1761000000000001e-05 2024-09-14T09:07:59.868 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.868 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.868 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.869 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-14T09:07:59.869 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.429827+0000", 2024-09-14T09:07:59.869 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.332060054999999, 2024-09-14T09:07:59.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099733119999999998, 2024-09-14T09:07:59.869 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.869 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.869 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:59.869 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.869 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:59.869 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:59.869 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 74 2024-09-14T09:07:59.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.870 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429827+0000", 2024-09-14T09:07:59.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429827+0000", 2024-09-14T09:07:59.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429828+0000", 2024-09-14T09:07:59.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4900000000000001e-07 2024-09-14T09:07:59.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429831+0000", 2024-09-14T09:07:59.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.619e-06 2024-09-14T09:07:59.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429835+0000", 2024-09-14T09:07:59.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-06 2024-09-14T09:07:59.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429843+0000", 2024-09-14T09:07:59.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8350000000000004e-06 2024-09-14T09:07:59.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.433290+0000", 2024-09-14T09:07:59.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003446827 2024-09-14T09:07:59.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.433335+0000", 2024-09-14T09:07:59.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5195999999999999e-05 2024-09-14T09:07:59.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:59.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.433403+0000", 2024-09-14T09:07:59.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8124e-05 2024-09-14T09:07:59.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:59.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434673+0000", 2024-09-14T09:07:59.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0012694519999999999 2024-09-14T09:07:59.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:59.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439754+0000", 2024-09-14T09:07:59.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050815319999999997 2024-09-14T09:07:59.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:59.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439780+0000", 2024-09-14T09:07:59.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6171999999999999e-05 2024-09-14T09:07:59.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439801+0000", 2024-09-14T09:07:59.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0356e-05 2024-09-14T09:07:59.874 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.875 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.875 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.875 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-14T09:07:59.875 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.429864+0000", 2024-09-14T09:07:59.875 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.332023595999999, 2024-09-14T09:07:59.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010013004000000001, 2024-09-14T09:07:59.875 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.875 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.875 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:59.876 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.876 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:59.876 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:59.876 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 75 2024-09-14T09:07:59.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.876 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429864+0000", 2024-09-14T09:07:59.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429864+0000", 2024-09-14T09:07:59.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.429864+0000", 2024-09-14T09:07:59.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.34e-07 2024-09-14T09:07:59.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430015+0000", 2024-09-14T09:07:59.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000150579 2024-09-14T09:07:59.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430026+0000", 2024-09-14T09:07:59.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0883999999999999e-05 2024-09-14T09:07:59.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430032+0000", 2024-09-14T09:07:59.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6699999999999997e-06 2024-09-14T09:07:59.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.433709+0000", 2024-09-14T09:07:59.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0036764050000000002 2024-09-14T09:07:59.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.433753+0000", 2024-09-14T09:07:59.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4345000000000003e-05 2024-09-14T09:07:59.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:59.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.433817+0000", 2024-09-14T09:07:59.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3909000000000001e-05 2024-09-14T09:07:59.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:59.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434675+0000", 2024-09-14T09:07:59.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00085810499999999996 2024-09-14T09:07:59.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:59.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439833+0000", 2024-09-14T09:07:59.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0051584350000000003 2024-09-14T09:07:59.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:59.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439859+0000", 2024-09-14T09:07:59.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5573999999999999e-05 2024-09-14T09:07:59.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439877+0000", 2024-09-14T09:07:59.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7764000000000001e-05 2024-09-14T09:07:59.882 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.882 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.882 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.882 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-14T09:07:59.882 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:31.430045+0000", 2024-09-14T09:07:59.882 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.331842188, 2024-09-14T09:07:59.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098923150000000005, 2024-09-14T09:07:59.883 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.883 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.883 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:59.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:07:59.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:07:59.883 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 76 2024-09-14T09:07:59.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.883 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430045+0000", 2024-09-14T09:07:59.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430045+0000", 2024-09-14T09:07:59.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430046+0000", 2024-09-14T09:07:59.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1099999999999995e-07 2024-09-14T09:07:59.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430051+0000", 2024-09-14T09:07:59.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5659999999999997e-06 2024-09-14T09:07:59.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430059+0000", 2024-09-14T09:07:59.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3699999999999997e-06 2024-09-14T09:07:59.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.430063+0000", 2024-09-14T09:07:59.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6999999999999999e-06 2024-09-14T09:07:59.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434330+0000", 2024-09-14T09:07:59.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042661929999999997 2024-09-14T09:07:59.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434372+0000", 2024-09-14T09:07:59.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1950000000000003e-05 2024-09-14T09:07:59.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:59.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434444+0000", 2024-09-14T09:07:59.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2775999999999996e-05 2024-09-14T09:07:59.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:59.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.434913+0000", 2024-09-14T09:07:59.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046910499999999999 2024-09-14T09:07:59.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:59.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439898+0000", 2024-09-14T09:07:59.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.004984128 2024-09-14T09:07:59.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:59.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439921+0000", 2024-09-14T09:07:59.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3564999999999999e-05 2024-09-14T09:07:59.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:31.439937+0000", 2024-09-14T09:07:59.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6351e-05 2024-09-14T09:07:59.889 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.889 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.889 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.890 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4217.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-14T09:07:59.890 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:35.248793+0000", 2024-09-14T09:07:59.890 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.513094852000002, 2024-09-14T09:07:59.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00936297, 2024-09-14T09:07:59.890 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.890 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.890 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:59.890 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.891 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4217", 2024-09-14T09:07:59.891 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.116:0/2127928146", 2024-09-14T09:07:59.891 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1 2024-09-14T09:07:59.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.891 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248793+0000", 2024-09-14T09:07:59.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248793+0000", 2024-09-14T09:07:59.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248794+0000", 2024-09-14T09:07:59.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.192e-06 2024-09-14T09:07:59.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248798+0000", 2024-09-14T09:07:59.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4580000000000003e-06 2024-09-14T09:07:59.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248808+0000", 2024-09-14T09:07:59.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5859999999999994e-06 2024-09-14T09:07:59.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248815+0000", 2024-09-14T09:07:59.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5499999999999997e-06 2024-09-14T09:07:59.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248874+0000", 2024-09-14T09:07:59.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.91e-05 2024-09-14T09:07:59.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:07:59.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.248884+0000", 2024-09-14T09:07:59.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6830000000000003e-06 2024-09-14T09:07:59.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.253902+0000", 2024-09-14T09:07:59.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050176420000000001 2024-09-14T09:07:59.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254042+0000", 2024-09-14T09:07:59.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000139806 2024-09-14T09:07:59.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-09-14T09:07:59.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.254160+0000", 2024-09-14T09:07:59.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000118373 2024-09-14T09:07:59.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:59.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.257976+0000", 2024-09-14T09:07:59.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0038157299999999998 2024-09-14T09:07:59.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:59.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.258103+0000", 2024-09-14T09:07:59.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000127494 2024-09-14T09:07:59.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:59.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.258132+0000", 2024-09-14T09:07:59.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8809000000000001e-05 2024-09-14T09:07:59.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:35.258155+0000", 2024-09-14T09:07:59.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3547e-05 2024-09-14T09:07:59.897 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.897 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.897 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.897 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:9 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-14T09:07:59.897 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:47.299228+0000", 2024-09-14T09:07:59.897 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.462659625000001, 2024-09-14T09:07:59.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011322218, 2024-09-14T09:07:59.898 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:07:59.898 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:07:59.898 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:07:59.898 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:07:59.898 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:07:59.898 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:07:59.898 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9 2024-09-14T09:07:59.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.898 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:07:59.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:07:59.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.299228+0000", 2024-09-14T09:07:59.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:07:59.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.299228+0000", 2024-09-14T09:07:59.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:07:59.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:07:59.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.299229+0000", 2024-09-14T09:07:59.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.637e-06 2024-09-14T09:07:59.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:07:59.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.299238+0000", 2024-09-14T09:07:59.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.439e-06 2024-09-14T09:07:59.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:07:59.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.299252+0000", 2024-09-14T09:07:59.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4062e-05 2024-09-14T09:07:59.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:07:59.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.299260+0000", 2024-09-14T09:07:59.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3529999999999995e-06 2024-09-14T09:07:59.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.299316+0000", 2024-09-14T09:07:59.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6010000000000001e-05 2024-09-14T09:07:59.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:07:59.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.299321+0000", 2024-09-14T09:07:59.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4390000000000002e-06 2024-09-14T09:07:59.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:07:59.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.301057+0000", 2024-09-14T09:07:59.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001735919 2024-09-14T09:07:59.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:07:59.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.301163+0000", 2024-09-14T09:07:59.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106419 2024-09-14T09:07:59.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:07:59.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.301299+0000", 2024-09-14T09:07:59.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000136122 2024-09-14T09:07:59.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:07:59.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.302353+0000", 2024-09-14T09:07:59.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001054176 2024-09-14T09:07:59.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:07:59.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.310463+0000", 2024-09-14T09:07:59.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0081098469999999999 2024-09-14T09:07:59.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:07:59.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.310510+0000", 2024-09-14T09:07:59.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6563999999999997e-05 2024-09-14T09:07:59.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:07:59.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:47.310550+0000", 2024-09-14T09:07:59.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0231000000000002e-05 2024-09-14T09:07:59.906 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.906 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.906 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.907 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.907 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.907 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:59.908 INFO:teuthology.orchestra.run.smithi148.stdout:flattening image image_client.0-clone6 2024-09-14T09:07:59.909 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:07:59.910 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:07:59.910 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:07:59.911 INFO:teuthology.orchestra.run.smithi116.stdout: "epoch": 34, 2024-09-14T09:07:59.911 INFO:teuthology.orchestra.run.smithi116.stdout: "fsid": "c991ac1c-978d-48b3-a540-4d3d4755e125", 2024-09-14T09:07:59.911 INFO:teuthology.orchestra.run.smithi116.stdout: "created": "2024-09-14T09:07:16.982473+0000", 2024-09-14T09:07:59.911 INFO:teuthology.orchestra.run.smithi116.stdout: "modified": "2024-09-14T09:07:59.783744+0000", 2024-09-14T09:07:59.911 INFO:teuthology.orchestra.run.smithi116.stdout: "last_up_change": "2024-09-14T09:07:28.201361+0000", 2024-09-14T09:07:59.911 INFO:teuthology.orchestra.run.smithi116.stdout: "last_in_change": "2024-09-14T09:07:18.560664+0000", 2024-09-14T09:07:59.911 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T09:07:59.911 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_num": 5806080, 2024-09-14T09:07:59.911 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_set": [ 2024-09-14T09:07:59.911 INFO:teuthology.orchestra.run.smithi116.stdout: "nodeep-scrub", 2024-09-14T09:07:59.911 INFO:teuthology.orchestra.run.smithi116.stdout: "noscrub", 2024-09-14T09:07:59.912 INFO:teuthology.orchestra.run.smithi116.stdout: "pglog_hardlimit", 2024-09-14T09:07:59.912 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snapdirs", 2024-09-14T09:07:59.912 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_deletes", 2024-09-14T09:07:59.912 INFO:teuthology.orchestra.run.smithi116.stdout: "sortbitwise" 2024-09-14T09:07:59.912 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:07:59.912 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_version": 5, 2024-09-14T09:07:59.912 INFO:teuthology.orchestra.run.smithi116.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T09:07:59.912 INFO:teuthology.orchestra.run.smithi116.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T09:07:59.912 INFO:teuthology.orchestra.run.smithi116.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T09:07:59.912 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_snapshot": "", 2024-09-14T09:07:59.912 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_max": 3, 2024-09-14T09:07:59.913 INFO:teuthology.orchestra.run.smithi116.stdout: "max_osd": 6, 2024-09-14T09:07:59.913 INFO:teuthology.orchestra.run.smithi116.stdout: "require_min_compat_client": "luminous", 2024-09-14T09:07:59.913 INFO:teuthology.orchestra.run.smithi116.stdout: "min_compat_client": "jewel", 2024-09-14T09:07:59.913 INFO:teuthology.orchestra.run.smithi116.stdout: "require_osd_release": "squid", 2024-09-14T09:07:59.913 INFO:teuthology.orchestra.run.smithi116.stdout: "allow_crimson": false, 2024-09-14T09:07:59.913 INFO:teuthology.orchestra.run.smithi116.stdout: "pools": [ 2024-09-14T09:07:59.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.913 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 1, 2024-09-14T09:07:59.913 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": ".mgr", 2024-09-14T09:07:59.913 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:29.194849+0000", 2024-09-14T09:07:59.914 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 1, 2024-09-14T09:07:59.914 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool", 2024-09-14T09:07:59.914 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:07:59.914 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:07:59.914 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:07:59.914 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:07:59.914 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:07:59.914 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:07:59.914 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:07:59.914 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:07:59.914 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:07:59.915 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:07:59.915 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:07:59.915 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 1, 2024-09-14T09:07:59.915 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 1, 2024-09-14T09:07:59.915 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 1, 2024-09-14T09:07:59.915 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 1, 2024-09-14T09:07:59.915 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 1, 2024-09-14T09:07:59.915 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:07:59.915 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:07:59.915 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:07:59.915 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:07:59.916 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:07:59.916 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:07:59.916 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:07:59.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.916 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "16", 2024-09-14T09:07:59.916 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:07:59.916 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:07:59.916 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:07:59.916 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:07:59.916 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:07:59.916 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 0, 2024-09-14T09:07:59.917 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 0, 2024-09-14T09:07:59.917 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:07:59.917 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:07:59.917 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:07:59.917 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:07:59.917 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:07:59.917 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:07:59.917 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:07:59.917 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:07:59.917 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:07:59.917 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:07:59.918 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:07:59.918 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:07:59.918 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:07:59.918 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:07:59.918 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:07:59.918 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:07:59.918 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:07:59.918 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:07:59.918 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:07:59.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.918 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:07:59.918 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:07:59.919 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:07:59.919 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:07:59.919 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:07:59.919 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:07:59.919 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:07:59.919 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:07:59.919 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:07:59.919 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:07:59.919 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:07:59.919 INFO:teuthology.orchestra.run.smithi116.stdout: "options": { 2024-09-14T09:07:59.919 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_max": 32, 2024-09-14T09:07:59.920 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_min": 1 2024-09-14T09:07:59.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.920 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:07:59.920 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": {} 2024-09-14T09:07:59.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.920 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:07:59.920 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:07:59.920 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 6.059999942779541, 2024-09-14T09:07:59.920 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 6.059999942779541, 2024-09-14T09:07:59.920 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 0.33000001311302185, 2024-09-14T09:07:59.920 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 2, 2024-09-14T09:07:59.921 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 2, 2024-09-14T09:07:59.921 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:07:59.921 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:07:59.921 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:07:59.921 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.921 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 2, 2024-09-14T09:07:59.921 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": "rbd", 2024-09-14T09:07:59.921 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:33.684592+0000", 2024-09-14T09:07:59.921 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 8193, 2024-09-14T09:07:59.921 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T09:07:59.921 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:07:59.922 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:07:59.922 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:07:59.922 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:07:59.922 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:07:59.922 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:07:59.922 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:07:59.922 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:07:59.922 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:07:59.922 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:07:59.922 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:07:59.922 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 8, 2024-09-14T09:07:59.922 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 8, 2024-09-14T09:07:59.922 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 8, 2024-09-14T09:07:59.923 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 8, 2024-09-14T09:07:59.923 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 8, 2024-09-14T09:07:59.923 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:07:59.923 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:07:59.923 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:07:59.923 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:07:59.923 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:07:59.923 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:07:59.923 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:07:59.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.923 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "20", 2024-09-14T09:07:59.923 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:07:59.923 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:07:59.923 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:07:59.924 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:07:59.924 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:07:59.924 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 2, 2024-09-14T09:07:59.924 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 20, 2024-09-14T09:07:59.924 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:07:59.924 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:07:59.924 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:07:59.924 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:07:59.924 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:07:59.924 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:07:59.924 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:07:59.924 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:07:59.924 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:07:59.924 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:07:59.925 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:07:59.925 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:07:59.925 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:07:59.925 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:07:59.925 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:07:59.925 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:07:59.925 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:07:59.925 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:07:59.925 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:07:59.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.925 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:07:59.925 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:07:59.925 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:07:59.926 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:07:59.926 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:07:59.926 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:07:59.926 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:07:59.926 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:07:59.926 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:07:59.926 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:07:59.926 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:07:59.926 INFO:teuthology.orchestra.run.smithi116.stdout: "options": {}, 2024-09-14T09:07:59.926 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:07:59.926 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd": {} 2024-09-14T09:07:59.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.926 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:07:59.926 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:07:59.927 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 2.25, 2024-09-14T09:07:59.927 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 2.25, 2024-09-14T09:07:59.927 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 1, 2024-09-14T09:07:59.927 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 2.25, 2024-09-14T09:07:59.927 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 2.25, 2024-09-14T09:07:59.927 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:07:59.927 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:07:59.927 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:07:59.927 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.927 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 3, 2024-09-14T09:07:59.927 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": "pool_client.0", 2024-09-14T09:07:59.927 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:43.363542+0000", 2024-09-14T09:07:59.928 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 8193, 2024-09-14T09:07:59.928 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T09:07:59.928 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:07:59.928 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:07:59.928 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:07:59.928 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:07:59.928 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:07:59.928 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:07:59.928 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:07:59.928 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:07:59.928 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:07:59.928 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:07:59.928 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:07:59.928 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 32, 2024-09-14T09:07:59.929 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 32, 2024-09-14T09:07:59.929 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 32, 2024-09-14T09:07:59.929 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 32, 2024-09-14T09:07:59.929 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 32, 2024-09-14T09:07:59.929 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:07:59.929 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:07:59.929 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:07:59.929 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:07:59.929 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:07:59.929 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:07:59.929 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:07:59.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.929 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "34", 2024-09-14T09:07:59.930 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:07:59.930 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:07:59.930 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:07:59.930 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:07:59.930 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:07:59.930 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 9, 2024-09-14T09:07:59.930 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 34, 2024-09-14T09:07:59.930 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:07:59.930 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:07:59.930 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:07:59.930 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:07:59.930 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:07:59.930 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:07:59.931 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:07:59.931 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:07:59.931 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:07:59.931 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:07:59.931 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:07:59.931 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:07:59.931 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:07:59.931 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:07:59.931 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:07:59.931 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:07:59.931 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:07:59.931 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:07:59.931 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:07:59.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.932 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:07:59.932 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:07:59.932 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:07:59.932 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:07:59.932 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:07:59.932 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:07:59.932 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:07:59.932 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:07:59.932 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:07:59.932 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:07:59.932 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:07:59.932 INFO:teuthology.orchestra.run.smithi116.stdout: "options": {}, 2024-09-14T09:07:59.932 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:07:59.932 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd": {} 2024-09-14T09:07:59.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.933 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:07:59.933 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:07:59.933 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 1.309999942779541, 2024-09-14T09:07:59.933 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 1.309999942779541, 2024-09-14T09:07:59.933 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 1, 2024-09-14T09:07:59.933 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 1.309999942779541, 2024-09-14T09:07:59.933 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 1.309999942779541, 2024-09-14T09:07:59.933 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:07:59.933 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:07:59.933 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:07:59.933 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.933 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.934 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:07:59.934 INFO:teuthology.orchestra.run.smithi116.stdout: "osds": [ 2024-09-14T09:07:59.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.934 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 0, 2024-09-14T09:07:59.934 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "b3c13086-1183-454b-8e62-3aec9b69cdf5", 2024-09-14T09:07:59.934 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:07:59.934 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:07:59.934 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:07:59.934 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:07:59.934 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:07:59.934 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:07:59.934 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 11, 2024-09-14T09:07:59.934 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 22, 2024-09-14T09:07:59.934 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:07:59.935 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:07:59.935 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:07:59.935 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.935 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.935 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6816", 2024-09-14T09:07:59.935 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:07:59.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.935 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.935 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6817", 2024-09-14T09:07:59.935 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:07:59.935 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.936 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.936 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:07:59.936 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.936 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.936 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6818", 2024-09-14T09:07:59.936 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:07:59.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.936 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.936 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6819", 2024-09-14T09:07:59.936 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:07:59.936 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.937 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.937 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:07:59.937 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.937 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.937 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6822", 2024-09-14T09:07:59.937 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:07:59.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.937 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.937 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6823", 2024-09-14T09:07:59.937 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:07:59.937 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.938 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.938 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:07:59.938 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.938 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.938 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6820", 2024-09-14T09:07:59.938 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:07:59.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.938 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.938 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6821", 2024-09-14T09:07:59.938 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:07:59.938 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6817/1856142608", 2024-09-14T09:07:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6819/1856142608", 2024-09-14T09:07:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6823/1856142608", 2024-09-14T09:07:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6821/1856142608", 2024-09-14T09:07:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:07:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:07:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:07:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 1, 2024-09-14T09:07:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "8ee6a373-9d0d-4cd2-96f4-9673de96f546", 2024-09-14T09:07:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:07:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:07:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:07:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:07:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:07:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:07:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 13, 2024-09-14T09:07:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 22, 2024-09-14T09:07:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:07:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:07:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:07:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6800", 2024-09-14T09:07:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:07:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6801", 2024-09-14T09:07:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:07:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:07:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6802", 2024-09-14T09:07:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:07:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6803", 2024-09-14T09:07:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:07:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:07:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6806", 2024-09-14T09:07:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:07:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6807", 2024-09-14T09:07:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:07:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:07:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6804", 2024-09-14T09:07:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:07:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6805", 2024-09-14T09:07:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:07:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6801/3469105275", 2024-09-14T09:07:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6803/3469105275", 2024-09-14T09:07:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6807/3469105275", 2024-09-14T09:07:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6805/3469105275", 2024-09-14T09:07:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:07:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:07:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:07:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 2, 2024-09-14T09:07:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "958a9363-d751-49c3-9ec7-7330d377ee53", 2024-09-14T09:07:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:07:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:07:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:07:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:07:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:07:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:07:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 13, 2024-09-14T09:07:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 22, 2024-09-14T09:07:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:07:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:07:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:07:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6808", 2024-09-14T09:07:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:07:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6809", 2024-09-14T09:07:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:07:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:07:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6810", 2024-09-14T09:07:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:07:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6811", 2024-09-14T09:07:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:07:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:07:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6814", 2024-09-14T09:07:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:07:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6815", 2024-09-14T09:07:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:07:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:07:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6812", 2024-09-14T09:07:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:07:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6813", 2024-09-14T09:07:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:07:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6809/2660214336", 2024-09-14T09:07:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6811/2660214336", 2024-09-14T09:07:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6815/2660214336", 2024-09-14T09:07:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6813/2660214336", 2024-09-14T09:07:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:07:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:07:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:07:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 3, 2024-09-14T09:07:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "7fafd519-b2e9-498c-a409-f55cfe45a51a", 2024-09-14T09:07:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:07:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:07:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:07:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 0.2435760498046875, 2024-09-14T09:07:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:07:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:07:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:07:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 22, 2024-09-14T09:07:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:07:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:07:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:07:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6816", 2024-09-14T09:07:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:07:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6817", 2024-09-14T09:07:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:07:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:07:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6818", 2024-09-14T09:07:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:07:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6819", 2024-09-14T09:07:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:07:59.955 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.955 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.955 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:07:59.955 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.955 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6822", 2024-09-14T09:07:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:07:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6823", 2024-09-14T09:07:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:07:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:07:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6820", 2024-09-14T09:07:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:07:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6821", 2024-09-14T09:07:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:07:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6817/2855061278", 2024-09-14T09:07:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6819/2855061278", 2024-09-14T09:07:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6823/2855061278", 2024-09-14T09:07:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6821/2855061278", 2024-09-14T09:07:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:07:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:07:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:07:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 4, 2024-09-14T09:07:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "63d99552-5fea-4367-bf86-0addc8cceb98", 2024-09-14T09:07:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:07:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:07:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:07:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:07:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:07:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:07:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:07:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 22, 2024-09-14T09:07:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:07:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:07:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:07:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6808", 2024-09-14T09:07:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:07:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6809", 2024-09-14T09:07:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:07:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:07:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6810", 2024-09-14T09:07:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:07:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6811", 2024-09-14T09:07:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:07:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:07:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6814", 2024-09-14T09:07:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:07:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6815", 2024-09-14T09:07:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:07:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:07:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6812", 2024-09-14T09:07:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:07:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6813", 2024-09-14T09:07:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:07:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6809/369903047", 2024-09-14T09:07:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6811/369903047", 2024-09-14T09:07:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6815/369903047", 2024-09-14T09:07:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6813/369903047", 2024-09-14T09:07:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:07:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:07:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:07:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 5, 2024-09-14T09:07:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "e4bcb224-662f-4530-b477-c0dd9c4ddbf4", 2024-09-14T09:07:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:07:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:07:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:07:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:07:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:07:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:07:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:07:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 22, 2024-09-14T09:07:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:07:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:07:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:07:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6800", 2024-09-14T09:07:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:07:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6801", 2024-09-14T09:07:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:07:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:07:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6802", 2024-09-14T09:07:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:07:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6803", 2024-09-14T09:07:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:07:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:07:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6806", 2024-09-14T09:07:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:07:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6807", 2024-09-14T09:07:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:07:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:07:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:07:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:07:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6804", 2024-09-14T09:07:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:07:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:07:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6805", 2024-09-14T09:07:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:07:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6801/2878111293", 2024-09-14T09:07:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6803/2878111293", 2024-09-14T09:07:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6807/2878111293", 2024-09-14T09:07:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6805/2878111293", 2024-09-14T09:07:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:07:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:07:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:07:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:07:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:07:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_xinfo": [ 2024-09-14T09:07:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 0, 2024-09-14T09:07:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:07:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:07:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:07:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:07:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:07:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:24.757990+0000", 2024-09-14T09:07:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:07:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 1, 2024-09-14T09:07:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:07:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:07:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:07:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:07:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:07:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.277795+0000", 2024-09-14T09:07:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:07:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 2, 2024-09-14T09:07:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:07:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:07:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:07:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:07:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:07:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.290172+0000", 2024-09-14T09:07:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:07:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 3, 2024-09-14T09:07:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:07:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:07:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:07:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:07:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:07:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.324594+0000", 2024-09-14T09:07:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:07:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 4, 2024-09-14T09:07:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:07:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:07:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:07:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:07:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:07:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:24.865136+0000", 2024-09-14T09:07:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:07:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:07:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 5, 2024-09-14T09:07:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:07:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:07:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:07:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:07:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:07:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.020572+0000", 2024-09-14T09:07:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:07:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:07:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap": [], 2024-09-14T09:07:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap_items": [], 2024-09-14T09:07:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap_primaries": [], 2024-09-14T09:07:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_temp": [], 2024-09-14T09:07:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_temp": [], 2024-09-14T09:07:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: "blocklist": {}, 2024-09-14T09:07:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: "range_blocklist": {}, 2024-09-14T09:07:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profiles": { 2024-09-14T09:07:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: "default": { 2024-09-14T09:07:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: "crush-failure-domain": "osd", 2024-09-14T09:07:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: "k": "2", 2024-09-14T09:07:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: "m": "1", 2024-09-14T09:07:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: "plugin": "jerasure", 2024-09-14T09:07:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: "technique": "reed_sol_van" 2024-09-14T09:07:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:07:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps_queue": [], 2024-09-14T09:07:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: "new_removed_snaps": [], 2024-09-14T09:07:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: "new_purged_snaps": [], 2024-09-14T09:07:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_node_flags": {}, 2024-09-14T09:07:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: "device_class_flags": {}, 2024-09-14T09:07:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode": { 2024-09-14T09:07:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode_enabled": false, 2024-09-14T09:07:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_bucket_count": 0, 2024-09-14T09:07:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: "degraded_stretch_mode": 0, 2024-09-14T09:07:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: "recovering_stretch_mode": 0, 2024-09-14T09:07:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode_bucket": 0 2024-09-14T09:07:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:07:59.978 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:07:59.979 INFO:tasks.thrashosds.thrasher:j is {'epoch': 34, 'fsid': 'c991ac1c-978d-48b3-a540-4d3d4755e125', 'created': '2024-09-14T09:07:16.982473+0000', 'modified': '2024-09-14T09:07:59.783744+0000', 'last_up_change': '2024-09-14T09:07:28.201361+0000', 'last_in_change': '2024-09-14T09:07:18.560664+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T09:07:29.194849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T09:07:33.684592+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-14T09:07:43.363542+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 34, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}], 'osds': [{'osd': 0, 'uuid': 'b3c13086-1183-454b-8e62-3aec9b69cdf5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6816', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6817', 'nonce': 1856142608}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6818', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6819', 'nonce': 1856142608}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6822', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6823', 'nonce': 1856142608}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6820', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6821', 'nonce': 1856142608}]}, 'public_addr': '172.21.15.116:6817/1856142608', 'cluster_addr': '172.21.15.116:6819/1856142608', 'heartbeat_back_addr': '172.21.15.116:6823/1856142608', 'heartbeat_front_addr': '172.21.15.116:6821/1856142608', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '8ee6a373-9d0d-4cd2-96f4-9673de96f546', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6800', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6801', 'nonce': 3469105275}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6802', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6803', 'nonce': 3469105275}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6806', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6807', 'nonce': 3469105275}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6804', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6805', 'nonce': 3469105275}]}, 'public_addr': '172.21.15.116:6801/3469105275', 'cluster_addr': '172.21.15.116:6803/3469105275', 'heartbeat_back_addr': '172.21.15.116:6807/3469105275', 'heartbeat_front_addr': '172.21.15.116:6805/3469105275', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '958a9363-d751-49c3-9ec7-7330d377ee53', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6808', 'nonce': 2660214336}, {'type': 'v1', 'addr': '172.21.15.116:6809', 'nonce': 2660214336}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6810', 'nonce': 2660214336}, {'type': 'v1', 'addr': '172.21.15.116:6811', 'nonce': 2660214336}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6814', 'nonce': 2660214336}, {'type': 'v1', 'addr': '172.21.15.116:6815', 'nonce': 2660214336}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6812', 'nonce': 2660214336}, {'type': 'v1', 'addr': '172.21.15.116:6813', 'nonce': 2660214336}]}, 'public_addr': '172.21.15.116:6809/2660214336', 'cluster_addr': '172.21.15.116:6811/2660214336', 'heartbeat_back_addr': '172.21.15.116:6815/2660214336', 'heartbeat_front_addr': '172.21.15.116:6813/2660214336', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '7fafd519-b2e9-498c-a409-f55cfe45a51a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.2435760498046875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6816', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6817', 'nonce': 2855061278}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6818', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6819', 'nonce': 2855061278}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6822', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6823', 'nonce': 2855061278}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6820', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6821', 'nonce': 2855061278}]}, 'public_addr': '172.21.15.144:6817/2855061278', 'cluster_addr': '172.21.15.144:6819/2855061278', 'heartbeat_back_addr': '172.21.15.144:6823/2855061278', 'heartbeat_front_addr': '172.21.15.144:6821/2855061278', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '63d99552-5fea-4367-bf86-0addc8cceb98', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6808', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6809', 'nonce': 369903047}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6810', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6811', 'nonce': 369903047}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6814', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6815', 'nonce': 369903047}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6812', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6813', 'nonce': 369903047}]}, 'public_addr': '172.21.15.144:6809/369903047', 'cluster_addr': '172.21.15.144:6811/369903047', 'heartbeat_back_addr': '172.21.15.144:6815/369903047', 'heartbeat_front_addr': '172.21.15.144:6813/369903047', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e4bcb224-662f-4530-b477-c0dd9c4ddbf4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6800', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6801', 'nonce': 2878111293}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6802', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6803', 'nonce': 2878111293}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6806', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6807', 'nonce': 2878111293}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6804', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6805', 'nonce': 2878111293}]}, 'public_addr': '172.21.15.144:6801/2878111293', 'cluster_addr': '172.21.15.144:6803/2878111293', 'heartbeat_back_addr': '172.21.15.144:6807/2878111293', 'heartbeat_front_addr': '172.21.15.144:6805/2878111293', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:24.757990+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.277795+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.290172+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.324594+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:24.865136+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.020572+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T09:07:59.979 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-14T09:07:59.980 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:07:59.910+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:00.023 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:00.025+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:00.106 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:00.106 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:00.106 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:08:00.106 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:00.110 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:00.113+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:00.114 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:08:00.211 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:00.213+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:00.263 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:00.263 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:00.263 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:00.263 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:00.263 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:00.272 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:08:00.313 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:00.315+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:00.375 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #5, image image_client.0-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent6 2024-09-14T09:08:00.412 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:00.415+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:00.419 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:00.419 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:00.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:00.419 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:00.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.419 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:702 3.1d 3:baa4605b:::rbd_data.11122fa6a16d.0000000000000004:6 [sparse-read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:00.419 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862479+0000", 2024-09-14T09:08:00.420 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.5580917730000001, 2024-09-14T09:08:00.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019424800999999998, 2024-09-14T09:08:00.420 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:00.420 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:00.420 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:00.420 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:00.420 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:00.420 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:00.420 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 702 2024-09-14T09:08:00.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.420 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:00.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:00.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862479+0000", 2024-09-14T09:08:00.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:00.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862479+0000", 2024-09-14T09:08:00.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:00.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862480+0000", 2024-09-14T09:08:00.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7599999999999997e-07 2024-09-14T09:08:00.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:00.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862488+0000", 2024-09-14T09:08:00.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5349999999999999e-06 2024-09-14T09:08:00.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:00.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862495+0000", 2024-09-14T09:08:00.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9630000000000001e-06 2024-09-14T09:08:00.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862500+0000", 2024-09-14T09:08:00.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3310000000000003e-06 2024-09-14T09:08:00.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:00.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.881787+0000", 2024-09-14T09:08:00.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019287100000000001 2024-09-14T09:08:00.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:00.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.881834+0000", 2024-09-14T09:08:00.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7218000000000001e-05 2024-09-14T09:08:00.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:00.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.881904+0000", 2024-09-14T09:08:00.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0078000000000002e-05 2024-09-14T09:08:00.423 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.424 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:00.424 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.424 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:703 3.1d 3:baa4605b:::rbd_data.11122fa6a16d.0000000000000004:6 [sparse-read 2752512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:00.424 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862508+0000", 2024-09-14T09:08:00.424 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.5580637199999998, 2024-09-14T09:08:00.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019513532, 2024-09-14T09:08:00.424 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:00.424 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:00.424 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:00.424 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:00.424 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:00.424 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:00.425 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 703 2024-09-14T09:08:00.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.425 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:00.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:00.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862508+0000", 2024-09-14T09:08:00.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:00.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862508+0000", 2024-09-14T09:08:00.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:00.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862508+0000", 2024-09-14T09:08:00.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1899999999999998e-07 2024-09-14T09:08:00.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:00.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862510+0000", 2024-09-14T09:08:00.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.858e-06 2024-09-14T09:08:00.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:00.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862516+0000", 2024-09-14T09:08:00.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3840000000000002e-06 2024-09-14T09:08:00.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862527+0000", 2024-09-14T09:08:00.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0651e-05 2024-09-14T09:08:00.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:00.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.881919+0000", 2024-09-14T09:08:00.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019392136000000001 2024-09-14T09:08:00.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:00.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.881968+0000", 2024-09-14T09:08:00.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9480000000000001e-05 2024-09-14T09:08:00.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:00.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882021+0000", 2024-09-14T09:08:00.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2604e-05 2024-09-14T09:08:00.428 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.428 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:00.428 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.428 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:704 3.1d 3:baa4605b:::rbd_data.11122fa6a16d.0000000000000004:6 [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:00.428 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862604+0000", 2024-09-14T09:08:00.428 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.5579672210000002, 2024-09-14T09:08:00.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019622902000000001, 2024-09-14T09:08:00.428 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:00.429 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:00.429 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:00.429 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:00.429 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:00.429 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:00.429 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 704 2024-09-14T09:08:00.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.429 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:00.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:00.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862604+0000", 2024-09-14T09:08:00.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:00.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862604+0000", 2024-09-14T09:08:00.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:00.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862605+0000", 2024-09-14T09:08:00.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9699999999999996e-07 2024-09-14T09:08:00.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:00.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862607+0000", 2024-09-14T09:08:00.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.295e-06 2024-09-14T09:08:00.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:00.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862614+0000", 2024-09-14T09:08:00.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1439999999999997e-06 2024-09-14T09:08:00.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862621+0000", 2024-09-14T09:08:00.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6499999999999999e-06 2024-09-14T09:08:00.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:00.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882056+0000", 2024-09-14T09:08:00.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019435109999999998 2024-09-14T09:08:00.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:00.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882132+0000", 2024-09-14T09:08:00.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6224999999999996e-05 2024-09-14T09:08:00.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:00.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882227+0000", 2024-09-14T09:08:00.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4881000000000002e-05 2024-09-14T09:08:00.432 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.432 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:00.432 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.433 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:705 3.1d 3:baa4605b:::rbd_data.11122fa6a16d.0000000000000004:6 [sparse-read 5636096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:00.433 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862631+0000", 2024-09-14T09:08:00.433 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.557940511, 2024-09-14T09:08:00.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019725718999999999, 2024-09-14T09:08:00.433 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:00.433 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:00.433 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:00.433 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:00.433 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:00.433 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:00.433 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 705 2024-09-14T09:08:00.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.433 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:00.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:00.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862631+0000", 2024-09-14T09:08:00.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:00.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862631+0000", 2024-09-14T09:08:00.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:00.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862631+0000", 2024-09-14T09:08:00.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.37e-07 2024-09-14T09:08:00.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:00.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862633+0000", 2024-09-14T09:08:00.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0099999999999998e-06 2024-09-14T09:08:00.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:00.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862640+0000", 2024-09-14T09:08:00.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5710000000000003e-06 2024-09-14T09:08:00.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862645+0000", 2024-09-14T09:08:00.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0610000000000003e-06 2024-09-14T09:08:00.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:00.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882257+0000", 2024-09-14T09:08:00.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019612181999999999 2024-09-14T09:08:00.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:00.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882299+0000", 2024-09-14T09:08:00.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1999999999999998e-05 2024-09-14T09:08:00.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:00.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882356+0000", 2024-09-14T09:08:00.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7358000000000002e-05 2024-09-14T09:08:00.437 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.437 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:00.437 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.437 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:718 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:00.437 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862653+0000", 2024-09-14T09:08:00.437 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.5579186319999998, 2024-09-14T09:08:00.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019756607999999998, 2024-09-14T09:08:00.437 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:00.437 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:00.437 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:00.438 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:00.438 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:00.438 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:00.438 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 718 2024-09-14T09:08:00.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.438 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:00.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:00.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862653+0000", 2024-09-14T09:08:00.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:00.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862653+0000", 2024-09-14T09:08:00.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:00.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862653+0000", 2024-09-14T09:08:00.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7e-07 2024-09-14T09:08:00.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:00.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862655+0000", 2024-09-14T09:08:00.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.962e-06 2024-09-14T09:08:00.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:00.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862662+0000", 2024-09-14T09:08:00.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6229999999999999e-06 2024-09-14T09:08:00.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862667+0000", 2024-09-14T09:08:00.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.045e-06 2024-09-14T09:08:00.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:00.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882255+0000", 2024-09-14T09:08:00.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019588164000000002 2024-09-14T09:08:00.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:00.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882325+0000", 2024-09-14T09:08:00.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0232000000000001e-05 2024-09-14T09:08:00.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:00.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882409+0000", 2024-09-14T09:08:00.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4111999999999997e-05 2024-09-14T09:08:00.441 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.441 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:00.441 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.442 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:719 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 2686976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:00.442 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862674+0000", 2024-09-14T09:08:00.442 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.5578977070000004, 2024-09-14T09:08:00.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019857377999999998, 2024-09-14T09:08:00.442 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:00.442 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:00.442 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:00.442 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:00.442 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:00.442 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:00.442 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 719 2024-09-14T09:08:00.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.442 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:00.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:00.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862674+0000", 2024-09-14T09:08:00.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:00.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862674+0000", 2024-09-14T09:08:00.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:00.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862674+0000", 2024-09-14T09:08:00.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2500000000000001e-07 2024-09-14T09:08:00.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:00.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862676+0000", 2024-09-14T09:08:00.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.827e-06 2024-09-14T09:08:00.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:00.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862684+0000", 2024-09-14T09:08:00.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1920000000000005e-06 2024-09-14T09:08:00.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862689+0000", 2024-09-14T09:08:00.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.882e-06 2024-09-14T09:08:00.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:00.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882435+0000", 2024-09-14T09:08:00.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019746260000000002 2024-09-14T09:08:00.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:00.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882477+0000", 2024-09-14T09:08:00.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1471999999999999e-05 2024-09-14T09:08:00.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:00.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882531+0000", 2024-09-14T09:08:00.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4320000000000002e-05 2024-09-14T09:08:00.446 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.446 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:00.446 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.446 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:720 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:00.446 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862696+0000", 2024-09-14T09:08:00.446 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.5578756419999999, 2024-09-14T09:08:00.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020031767999999998, 2024-09-14T09:08:00.446 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:00.446 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:00.446 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:00.446 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:00.446 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:00.447 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:00.447 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 720 2024-09-14T09:08:00.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.447 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:00.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:00.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862696+0000", 2024-09-14T09:08:00.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:00.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862696+0000", 2024-09-14T09:08:00.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:00.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862696+0000", 2024-09-14T09:08:00.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4499999999999997e-07 2024-09-14T09:08:00.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:00.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862698+0000", 2024-09-14T09:08:00.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.835e-06 2024-09-14T09:08:00.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:00.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862718+0000", 2024-09-14T09:08:00.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9646000000000001e-05 2024-09-14T09:08:00.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862726+0000", 2024-09-14T09:08:00.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3690000000000007e-06 2024-09-14T09:08:00.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:00.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882564+0000", 2024-09-14T09:08:00.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019838198000000001 2024-09-14T09:08:00.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:00.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882635+0000", 2024-09-14T09:08:00.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1054000000000001e-05 2024-09-14T09:08:00.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:00.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882727+0000", 2024-09-14T09:08:00.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2220999999999997e-05 2024-09-14T09:08:00.450 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.450 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:00.450 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.451 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:721 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 5636096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:00.451 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862735+0000", 2024-09-14T09:08:00.451 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.557836515, 2024-09-14T09:08:00.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020095227, 2024-09-14T09:08:00.451 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:00.451 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:00.451 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:00.451 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:00.451 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:00.451 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:00.451 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 721 2024-09-14T09:08:00.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.452 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:00.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:00.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862735+0000", 2024-09-14T09:08:00.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:00.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862735+0000", 2024-09-14T09:08:00.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:00.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862735+0000", 2024-09-14T09:08:00.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0200000000000002e-07 2024-09-14T09:08:00.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:00.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862738+0000", 2024-09-14T09:08:00.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4169999999999999e-06 2024-09-14T09:08:00.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:00.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862766+0000", 2024-09-14T09:08:00.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8093999999999999e-05 2024-09-14T09:08:00.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862772+0000", 2024-09-14T09:08:00.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3160000000000002e-06 2024-09-14T09:08:00.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:00.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882742+0000", 2024-09-14T09:08:00.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019970102 2024-09-14T09:08:00.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:00.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882779+0000", 2024-09-14T09:08:00.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7181000000000002e-05 2024-09-14T09:08:00.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:00.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882830+0000", 2024-09-14T09:08:00.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0615000000000002e-05 2024-09-14T09:08:00.455 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.455 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:00.455 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.455 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:726 3.5 3:a28365af:::rbd_data.11122fa6a16d.0000000000000000:6 [sparse-read 1376256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:00.455 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862793+0000", 2024-09-14T09:08:00.455 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.5577784279999998, 2024-09-14T09:08:00.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020238376999999998, 2024-09-14T09:08:00.455 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:00.455 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:00.456 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:00.456 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:00.456 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:00.456 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:00.456 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 726 2024-09-14T09:08:00.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.456 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:00.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:00.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862793+0000", 2024-09-14T09:08:00.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:00.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862793+0000", 2024-09-14T09:08:00.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:00.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862793+0000", 2024-09-14T09:08:00.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5599999999999995e-07 2024-09-14T09:08:00.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:00.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862796+0000", 2024-09-14T09:08:00.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6850000000000001e-06 2024-09-14T09:08:00.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:00.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862812+0000", 2024-09-14T09:08:00.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6002999999999999e-05 2024-09-14T09:08:00.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862827+0000", 2024-09-14T09:08:00.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.47e-05 2024-09-14T09:08:00.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:00.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882861+0000", 2024-09-14T09:08:00.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020034206999999998 2024-09-14T09:08:00.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:00.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882936+0000", 2024-09-14T09:08:00.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4624999999999998e-05 2024-09-14T09:08:00.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:00.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883031+0000", 2024-09-14T09:08:00.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5600999999999995e-05 2024-09-14T09:08:00.459 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.459 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:00.459 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.459 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:727 3.5 3:a28365af:::rbd_data.11122fa6a16d.0000000000000000:6 [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:00.459 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862836+0000", 2024-09-14T09:08:00.459 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.5577349959999998, 2024-09-14T09:08:00.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020407364000000001, 2024-09-14T09:08:00.460 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:00.460 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:00.460 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:00.460 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:00.460 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:00.460 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:00.460 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 727 2024-09-14T09:08:00.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.460 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:00.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:00.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862836+0000", 2024-09-14T09:08:00.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:00.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862836+0000", 2024-09-14T09:08:00.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:00.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862837+0000", 2024-09-14T09:08:00.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.13e-07 2024-09-14T09:08:00.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:00.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862839+0000", 2024-09-14T09:08:00.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:08:00.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:00.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862847+0000", 2024-09-14T09:08:00.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5039999999999996e-06 2024-09-14T09:08:00.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862852+0000", 2024-09-14T09:08:00.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2050000000000001e-06 2024-09-14T09:08:00.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:00.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883068+0000", 2024-09-14T09:08:00.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020216369000000001 2024-09-14T09:08:00.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:00.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883145+0000", 2024-09-14T09:08:00.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6790000000000002e-05 2024-09-14T09:08:00.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:00.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883244+0000", 2024-09-14T09:08:00.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8697999999999996e-05 2024-09-14T09:08:00.463 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.463 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:00.463 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.463 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:728 3.5 3:a28365af:::rbd_data.11122fa6a16d.0000000000000000:6 [sparse-read 4325376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:00.464 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862859+0000", 2024-09-14T09:08:00.464 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.5577120850000004, 2024-09-14T09:08:00.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020577419, 2024-09-14T09:08:00.464 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:00.464 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:00.464 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:00.464 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:00.464 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:00.464 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:00.464 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 728 2024-09-14T09:08:00.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.464 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:00.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:00.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862859+0000", 2024-09-14T09:08:00.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:00.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862859+0000", 2024-09-14T09:08:00.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:00.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862860+0000", 2024-09-14T09:08:00.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7199999999999999e-07 2024-09-14T09:08:00.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:00.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862874+0000", 2024-09-14T09:08:00.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4124000000000001e-05 2024-09-14T09:08:00.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:00.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862886+0000", 2024-09-14T09:08:00.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2353e-05 2024-09-14T09:08:00.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862900+0000", 2024-09-14T09:08:00.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3872e-05 2024-09-14T09:08:00.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:00.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883274+0000", 2024-09-14T09:08:00.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020373544 2024-09-14T09:08:00.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:00.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883352+0000", 2024-09-14T09:08:00.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8394999999999997e-05 2024-09-14T09:08:00.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:00.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883437+0000", 2024-09-14T09:08:00.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4559000000000001e-05 2024-09-14T09:08:00.467 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.467 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:00.468 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.468 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:729 3.5 3:a28365af:::rbd_data.11122fa6a16d.0000000000000000:6 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:00.468 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862909+0000", 2024-09-14T09:08:00.468 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.5576621450000001, 2024-09-14T09:08:00.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020750004999999998, 2024-09-14T09:08:00.468 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:00.468 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:00.468 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:00.468 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:00.468 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:00.468 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:00.468 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 729 2024-09-14T09:08:00.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.469 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:00.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:00.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862909+0000", 2024-09-14T09:08:00.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:00.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862909+0000", 2024-09-14T09:08:00.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:00.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862910+0000", 2024-09-14T09:08:00.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6699999999999999e-07 2024-09-14T09:08:00.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:00.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862917+0000", 2024-09-14T09:08:00.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0520000000000004e-06 2024-09-14T09:08:00.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:00.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862924+0000", 2024-09-14T09:08:00.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4510000000000003e-06 2024-09-14T09:08:00.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862929+0000", 2024-09-14T09:08:00.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2549999999999997e-06 2024-09-14T09:08:00.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:00.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883484+0000", 2024-09-14T09:08:00.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.02055446 2024-09-14T09:08:00.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:00.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883558+0000", 2024-09-14T09:08:00.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3916000000000002e-05 2024-09-14T09:08:00.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:00.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883659+0000", 2024-09-14T09:08:00.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010140399999999999 2024-09-14T09:08:00.472 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.472 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:00.472 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.472 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:742 3.1d 3:baa4605b:::rbd_data.11122fa6a16d.0000000000000004:6 [sparse-read 1376256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:00.472 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862936+0000", 2024-09-14T09:08:00.472 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.5576348869999999, 2024-09-14T09:08:00.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020679486, 2024-09-14T09:08:00.472 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:00.472 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:00.472 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:00.472 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:00.473 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:00.473 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:00.473 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 742 2024-09-14T09:08:00.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.473 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:00.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:00.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862936+0000", 2024-09-14T09:08:00.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:00.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862936+0000", 2024-09-14T09:08:00.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:00.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862937+0000", 2024-09-14T09:08:00.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0200000000000002e-07 2024-09-14T09:08:00.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:00.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862939+0000", 2024-09-14T09:08:00.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0099999999999998e-06 2024-09-14T09:08:00.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:00.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862945+0000", 2024-09-14T09:08:00.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4180000000000002e-06 2024-09-14T09:08:00.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862950+0000", 2024-09-14T09:08:00.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0799999999999996e-06 2024-09-14T09:08:00.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:00.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883465+0000", 2024-09-14T09:08:00.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020514549999999999 2024-09-14T09:08:00.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:00.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883527+0000", 2024-09-14T09:08:00.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2494000000000002e-05 2024-09-14T09:08:00.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:00.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883616+0000", 2024-09-14T09:08:00.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8431999999999996e-05 2024-09-14T09:08:00.476 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.476 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:00.476 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.476 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:743 3.1d 3:baa4605b:::rbd_data.11122fa6a16d.0000000000000004:6 [sparse-read 2818048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:00.476 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862957+0000", 2024-09-14T09:08:00.477 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.5576140560000002, 2024-09-14T09:08:00.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020911032, 2024-09-14T09:08:00.477 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:00.477 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:00.477 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:00.477 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:00.477 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:00.477 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:00.477 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 743 2024-09-14T09:08:00.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.477 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:00.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:00.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862957+0000", 2024-09-14T09:08:00.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:00.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862957+0000", 2024-09-14T09:08:00.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:00.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862958+0000", 2024-09-14T09:08:00.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9500000000000003e-07 2024-09-14T09:08:00.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:00.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862959+0000", 2024-09-14T09:08:00.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.756e-06 2024-09-14T09:08:00.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:00.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862972+0000", 2024-09-14T09:08:00.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2567e-05 2024-09-14T09:08:00.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862978+0000", 2024-09-14T09:08:00.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9499999999999998e-06 2024-09-14T09:08:00.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:00.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883651+0000", 2024-09-14T09:08:00.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020673305999999999 2024-09-14T09:08:00.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:00.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883759+0000", 2024-09-14T09:08:00.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001075 2024-09-14T09:08:00.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:00.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883868+0000", 2024-09-14T09:08:00.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010945799999999999 2024-09-14T09:08:00.480 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.480 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:00.481 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.481 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:744 3.1d 3:baa4605b:::rbd_data.11122fa6a16d.0000000000000004:6 [sparse-read 4325376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:00.481 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862986+0000", 2024-09-14T09:08:00.481 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.5575856479999999, 2024-09-14T09:08:00.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021124403, 2024-09-14T09:08:00.481 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:00.481 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:00.481 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:00.481 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:00.481 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:00.481 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:00.481 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 744 2024-09-14T09:08:00.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.482 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:00.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:00.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862986+0000", 2024-09-14T09:08:00.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:00.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862986+0000", 2024-09-14T09:08:00.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:00.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862986+0000", 2024-09-14T09:08:00.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7e-07 2024-09-14T09:08:00.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:00.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862988+0000", 2024-09-14T09:08:00.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9769999999999999e-06 2024-09-14T09:08:00.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:00.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862995+0000", 2024-09-14T09:08:00.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7510000000000002e-06 2024-09-14T09:08:00.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863000+0000", 2024-09-14T09:08:00.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.259e-06 2024-09-14T09:08:00.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:00.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883908+0000", 2024-09-14T09:08:00.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020908095000000002 2024-09-14T09:08:00.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:00.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883999+0000", 2024-09-14T09:08:00.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0741000000000004e-05 2024-09-14T09:08:00.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:00.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884110+0000", 2024-09-14T09:08:00.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011111 2024-09-14T09:08:00.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.485 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:00.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.485 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:745 3.1d 3:baa4605b:::rbd_data.11122fa6a16d.0000000000000004:6 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:00.485 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863007+0000", 2024-09-14T09:08:00.485 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.5575639250000002, 2024-09-14T09:08:00.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021273830000000001, 2024-09-14T09:08:00.485 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:00.485 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:00.486 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:00.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:00.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:00.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:00.486 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 745 2024-09-14T09:08:00.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.486 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:00.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:00.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863007+0000", 2024-09-14T09:08:00.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:00.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863007+0000", 2024-09-14T09:08:00.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:00.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863008+0000", 2024-09-14T09:08:00.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:08:00.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:00.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863010+0000", 2024-09-14T09:08:00.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.903e-06 2024-09-14T09:08:00.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:00.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863018+0000", 2024-09-14T09:08:00.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0970000000000006e-06 2024-09-14T09:08:00.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863023+0000", 2024-09-14T09:08:00.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1030000000000001e-06 2024-09-14T09:08:00.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:00.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884157+0000", 2024-09-14T09:08:00.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021134303 2024-09-14T09:08:00.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:00.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884226+0000", 2024-09-14T09:08:00.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9004000000000005e-05 2024-09-14T09:08:00.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:00.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884281+0000", 2024-09-14T09:08:00.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4994000000000002e-05 2024-09-14T09:08:00.489 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.489 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:00.489 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.490 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:758 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:00.490 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863037+0000", 2024-09-14T09:08:00.490 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.5575347180000003, 2024-09-14T09:08:00.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021271691999999998, 2024-09-14T09:08:00.490 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:00.490 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:00.490 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:00.490 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:00.490 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:00.490 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:00.490 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 758 2024-09-14T09:08:00.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.490 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:00.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:00.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863037+0000", 2024-09-14T09:08:00.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:00.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863037+0000", 2024-09-14T09:08:00.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:00.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863037+0000", 2024-09-14T09:08:00.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5699999999999998e-07 2024-09-14T09:08:00.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:00.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863039+0000", 2024-09-14T09:08:00.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2709999999999999e-06 2024-09-14T09:08:00.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:00.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863046+0000", 2024-09-14T09:08:00.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1380000000000001e-06 2024-09-14T09:08:00.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863052+0000", 2024-09-14T09:08:00.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1399999999999999e-06 2024-09-14T09:08:00.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:00.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884146+0000", 2024-09-14T09:08:00.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021094497 2024-09-14T09:08:00.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:00.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884217+0000", 2024-09-14T09:08:00.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0797999999999995e-05 2024-09-14T09:08:00.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:00.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884308+0000", 2024-09-14T09:08:00.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1391000000000006e-05 2024-09-14T09:08:00.494 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.494 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:00.494 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.494 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:759 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 2818048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:00.494 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863059+0000", 2024-09-14T09:08:00.494 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.5575118410000002, 2024-09-14T09:08:00.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021357939999999999, 2024-09-14T09:08:00.494 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:00.494 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:00.494 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:00.494 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:00.495 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:00.495 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:00.495 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 759 2024-09-14T09:08:00.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.495 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:00.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:00.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863059+0000", 2024-09-14T09:08:00.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:00.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863059+0000", 2024-09-14T09:08:00.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:00.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863060+0000", 2024-09-14T09:08:00.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0499999999999999e-07 2024-09-14T09:08:00.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:00.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863062+0000", 2024-09-14T09:08:00.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8500000000000001e-06 2024-09-14T09:08:00.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:00.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863068+0000", 2024-09-14T09:08:00.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.81e-06 2024-09-14T09:08:00.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863073+0000", 2024-09-14T09:08:00.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9280000000000001e-06 2024-09-14T09:08:00.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:00.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884326+0000", 2024-09-14T09:08:00.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021252407000000001 2024-09-14T09:08:00.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:00.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884367+0000", 2024-09-14T09:08:00.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0932e-05 2024-09-14T09:08:00.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:00.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884417+0000", 2024-09-14T09:08:00.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0608000000000001e-05 2024-09-14T09:08:00.498 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.498 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:00.498 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.498 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:760 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 4259840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:00.498 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863080+0000", 2024-09-14T09:08:00.498 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.5574915379999998, 2024-09-14T09:08:00.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021531615, 2024-09-14T09:08:00.499 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:00.499 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:00.499 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:00.499 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:00.499 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:00.499 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:00.499 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 760 2024-09-14T09:08:00.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.499 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:00.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:00.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863080+0000", 2024-09-14T09:08:00.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:00.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863080+0000", 2024-09-14T09:08:00.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:00.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863080+0000", 2024-09-14T09:08:00.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:08:00.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:00.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863082+0000", 2024-09-14T09:08:00.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7460000000000001e-06 2024-09-14T09:08:00.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:00.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863088+0000", 2024-09-14T09:08:00.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2319999999999998e-06 2024-09-14T09:08:00.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863093+0000", 2024-09-14T09:08:00.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5199999999999999e-06 2024-09-14T09:08:00.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:00.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884449+0000", 2024-09-14T09:08:00.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021356639 2024-09-14T09:08:00.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:00.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884522+0000", 2024-09-14T09:08:00.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2696999999999999e-05 2024-09-14T09:08:00.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:00.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884611+0000", 2024-09-14T09:08:00.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9389999999999996e-05 2024-09-14T09:08:00.502 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.502 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:00.503 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.503 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:761 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:00.503 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863099+0000", 2024-09-14T09:08:00.503 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.5574721700000005, 2024-09-14T09:08:00.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021615771999999998, 2024-09-14T09:08:00.503 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:00.503 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:00.503 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:00.503 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:00.503 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:00.503 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:00.503 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 761 2024-09-14T09:08:00.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.504 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:00.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:00.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863099+0000", 2024-09-14T09:08:00.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:00.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863099+0000", 2024-09-14T09:08:00.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:00.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:00.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863100+0000", 2024-09-14T09:08:00.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7199999999999999e-07 2024-09-14T09:08:00.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:00.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863101+0000", 2024-09-14T09:08:00.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6810000000000001e-06 2024-09-14T09:08:00.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:00.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863108+0000", 2024-09-14T09:08:00.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.19e-06 2024-09-14T09:08:00.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863119+0000", 2024-09-14T09:08:00.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1107000000000001e-05 2024-09-14T09:08:00.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:00.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884625+0000", 2024-09-14T09:08:00.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021506464999999999 2024-09-14T09:08:00.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:00.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884665+0000", 2024-09-14T09:08:00.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9473e-05 2024-09-14T09:08:00.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:00.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:00.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:00.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884715+0000", 2024-09-14T09:08:00.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0284000000000002e-05 2024-09-14T09:08:00.507 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.507 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:00.507 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.507 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:00.507 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:00.507 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:00.508 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:08:00.512 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:00.514+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:00.613 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:00.615+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:00.616 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:00.617 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:00.617 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:00.617 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:00.626 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:08:00.716 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:00.718+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:00.771 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:00.771 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:00.771 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:00.771 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:00.771 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:00.779 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:08:00.801 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T09:08:00.822 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:00.824+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:00.919 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:00.921+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:00.926 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:00.926 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:00.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:00.926 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:00.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.926 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4471.0:521 3.c e27/22 3:35a5bd89:::rbd_data.1112b98aa287.0000000000000004:head v 27'7, mlcod=26'4)", 2024-09-14T09:08:00.926 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.591279+0000", 2024-09-14T09:08:00.926 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.336200436, 2024-09-14T09:08:00.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001127292, 2024-09-14T09:08:00.926 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:00.926 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:00.926 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:00.927 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:00.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:00.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591279+0000", 2024-09-14T09:08:00.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:00.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591279+0000", 2024-09-14T09:08:00.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:00.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591281+0000", 2024-09-14T09:08:00.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5799999999999999e-06 2024-09-14T09:08:00.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:00.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591293+0000", 2024-09-14T09:08:00.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2052000000000001e-05 2024-09-14T09:08:00.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:00.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591317+0000", 2024-09-14T09:08:00.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4406999999999999e-05 2024-09-14T09:08:00.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591329+0000", 2024-09-14T09:08:00.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2303000000000001e-05 2024-09-14T09:08:00.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:00.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591466+0000", 2024-09-14T09:08:00.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013648100000000001 2024-09-14T09:08:00.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:00.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591504+0000", 2024-09-14T09:08:00.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8306000000000002e-05 2024-09-14T09:08:00.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:00.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592379+0000", 2024-09-14T09:08:00.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000874806 2024-09-14T09:08:00.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:00.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592406+0000", 2024-09-14T09:08:00.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7356999999999999e-05 2024-09-14T09:08:00.930 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.930 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:00.930 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.931 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4471.0:523 3.1b 3:de381ce0:::rbd_data.1112b98aa287.000000000000000a:head [delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:08:00.931 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.592885+0000", 2024-09-14T09:08:00.931 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.334594055, 2024-09-14T09:08:00.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016302420000000001, 2024-09-14T09:08:00.931 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:00.931 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:00.931 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:00.931 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:00.931 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4471", 2024-09-14T09:08:00.931 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2207718190", 2024-09-14T09:08:00.931 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 523 2024-09-14T09:08:00.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.931 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:00.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:00.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592885+0000", 2024-09-14T09:08:00.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:00.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592885+0000", 2024-09-14T09:08:00.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:00.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592887+0000", 2024-09-14T09:08:00.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.364e-06 2024-09-14T09:08:00.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:00.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592891+0000", 2024-09-14T09:08:00.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5900000000000001e-06 2024-09-14T09:08:00.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:00.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592904+0000", 2024-09-14T09:08:00.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2481e-05 2024-09-14T09:08:00.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592911+0000", 2024-09-14T09:08:00.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.644e-06 2024-09-14T09:08:00.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:00.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592957+0000", 2024-09-14T09:08:00.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5979999999999997e-05 2024-09-14T09:08:00.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:00.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.593007+0000", 2024-09-14T09:08:00.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9568999999999999e-05 2024-09-14T09:08:00.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:00.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.593104+0000", 2024-09-14T09:08:00.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6877000000000001e-05 2024-09-14T09:08:00.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:00.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.593837+0000", 2024-09-14T09:08:00.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073326499999999998 2024-09-14T09:08:00.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:00.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.594459+0000", 2024-09-14T09:08:00.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00062228800000000003 2024-09-14T09:08:00.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:00.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.594490+0000", 2024-09-14T09:08:00.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0178000000000001e-05 2024-09-14T09:08:00.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:00.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.594516+0000", 2024-09-14T09:08:00.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6006000000000001e-05 2024-09-14T09:08:00.936 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.936 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:00.936 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.936 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:771 3.19 e30/22 3:9844a71f:::rbd_data.111276489662.0000000000000002:head v 30'22, mlcod=29'20)", 2024-09-14T09:08:00.937 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.872592+0000", 2024-09-14T09:08:00.937 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.0548874990000003, 2024-09-14T09:08:00.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001230996, 2024-09-14T09:08:00.937 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:00.937 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:00.937 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:00.937 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:00.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:00.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872592+0000", 2024-09-14T09:08:00.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:00.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872592+0000", 2024-09-14T09:08:00.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:00.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872593+0000", 2024-09-14T09:08:00.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2399999999999997e-07 2024-09-14T09:08:00.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:00.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872702+0000", 2024-09-14T09:08:00.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010938900000000001 2024-09-14T09:08:00.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:00.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872715+0000", 2024-09-14T09:08:00.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2679e-05 2024-09-14T09:08:00.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872722+0000", 2024-09-14T09:08:00.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3470000000000001e-06 2024-09-14T09:08:00.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:00.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872785+0000", 2024-09-14T09:08:00.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3355000000000006e-05 2024-09-14T09:08:00.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:00.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872804+0000", 2024-09-14T09:08:00.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8637000000000001e-05 2024-09-14T09:08:00.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:00.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.873784+0000", 2024-09-14T09:08:00.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00098006299999999998 2024-09-14T09:08:00.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:00.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.873823+0000", 2024-09-14T09:08:00.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8801999999999999e-05 2024-09-14T09:08:00.941 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.941 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:00.941 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.941 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:780 3.c e30/22 3:348fce71:::rbd_data.111276489662.0000000000000007:head v 30'15, mlcod=28'12)", 2024-09-14T09:08:00.941 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.877170+0000", 2024-09-14T09:08:00.941 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.0503089440000002, 2024-09-14T09:08:00.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024747509999999999, 2024-09-14T09:08:00.941 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:00.941 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:00.941 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:00.941 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:00.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:00.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877170+0000", 2024-09-14T09:08:00.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:00.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877170+0000", 2024-09-14T09:08:00.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:00.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877171+0000", 2024-09-14T09:08:00.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3300000000000001e-07 2024-09-14T09:08:00.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:00.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877179+0000", 2024-09-14T09:08:00.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5170000000000002e-06 2024-09-14T09:08:00.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:00.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877188+0000", 2024-09-14T09:08:00.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4199999999999996e-06 2024-09-14T09:08:00.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877193+0000", 2024-09-14T09:08:00.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5290000000000002e-06 2024-09-14T09:08:00.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:00.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877248+0000", 2024-09-14T09:08:00.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5012000000000001e-05 2024-09-14T09:08:00.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:00.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877270+0000", 2024-09-14T09:08:00.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2540000000000001e-05 2024-09-14T09:08:00.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:00.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.879613+0000", 2024-09-14T09:08:00.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0023428899999999998 2024-09-14T09:08:00.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:00.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.879645+0000", 2024-09-14T09:08:00.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2110000000000003e-05 2024-09-14T09:08:00.945 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.945 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:00.945 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.945 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:783 3.1e e30/22 3:7d74d199:::rbd_data.111276489662.0000000000000008:head v 30'19, mlcod=29'17)", 2024-09-14T09:08:00.945 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.880224+0000", 2024-09-14T09:08:00.945 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.0472557309999999, 2024-09-14T09:08:00.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020308650000000002, 2024-09-14T09:08:00.945 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:00.945 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:00.946 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:00.946 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:00.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:00.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880224+0000", 2024-09-14T09:08:00.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:00.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880224+0000", 2024-09-14T09:08:00.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880224+0000", 2024-09-14T09:08:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2200000000000004e-07 2024-09-14T09:08:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880229+0000", 2024-09-14T09:08:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7419999999999997e-06 2024-09-14T09:08:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880238+0000", 2024-09-14T09:08:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6759999999999996e-06 2024-09-14T09:08:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880243+0000", 2024-09-14T09:08:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8609999999999997e-06 2024-09-14T09:08:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880288+0000", 2024-09-14T09:08:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5668999999999999e-05 2024-09-14T09:08:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880302+0000", 2024-09-14T09:08:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3489000000000001e-05 2024-09-14T09:08:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.882221+0000", 2024-09-14T09:08:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001919362 2024-09-14T09:08:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.882255+0000", 2024-09-14T09:08:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3444e-05 2024-09-14T09:08:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1028 3.c e30/22 3:348fce71:::rbd_data.111276489662.0000000000000007:head v 30'16, mlcod=28'14)", 2024-09-14T09:08:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.969928+0000", 2024-09-14T09:08:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.9575518289999998, 2024-09-14T09:08:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00099903600000000002, 2024-09-14T09:08:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.969928+0000", 2024-09-14T09:08:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.969928+0000", 2024-09-14T09:08:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.969928+0000", 2024-09-14T09:08:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6000000000000003e-07 2024-09-14T09:08:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.970026+0000", 2024-09-14T09:08:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7744999999999993e-05 2024-09-14T09:08:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.970035+0000", 2024-09-14T09:08:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0520000000000007e-06 2024-09-14T09:08:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.970040+0000", 2024-09-14T09:08:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5499999999999996e-06 2024-09-14T09:08:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.970078+0000", 2024-09-14T09:08:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8260000000000003e-05 2024-09-14T09:08:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.970092+0000", 2024-09-14T09:08:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.437e-05 2024-09-14T09:08:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.970898+0000", 2024-09-14T09:08:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00080594900000000003 2024-09-14T09:08:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.970927+0000", 2024-09-14T09:08:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.845e-05 2024-09-14T09:08:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1159 3.7 e31/22 3:e6c13853:::rbd_object_map.111276489662.0000000000000007:head v 31'235, mlcod=30'233)", 2024-09-14T09:08:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.343595+0000", 2024-09-14T09:08:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5838843269999998, 2024-09-14T09:08:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031037040000000001, 2024-09-14T09:08:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343595+0000", 2024-09-14T09:08:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343595+0000", 2024-09-14T09:08:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343595+0000", 2024-09-14T09:08:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6899999999999999e-07 2024-09-14T09:08:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343599+0000", 2024-09-14T09:08:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0090000000000001e-06 2024-09-14T09:08:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343610+0000", 2024-09-14T09:08:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0661e-05 2024-09-14T09:08:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343619+0000", 2024-09-14T09:08:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2059999999999996e-06 2024-09-14T09:08:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343667+0000", 2024-09-14T09:08:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7611999999999997e-05 2024-09-14T09:08:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343683+0000", 2024-09-14T09:08:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5917999999999999e-05 2024-09-14T09:08:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.346665+0000", 2024-09-14T09:08:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029824840000000001 2024-09-14T09:08:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.346699+0000", 2024-09-14T09:08:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3645000000000001e-05 2024-09-14T09:08:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1188 3.2 e31/22 3:40adc02d:::rbd_data.111276489662.000000000000001a:head v 31'4, mlcod=26'1)", 2024-09-14T09:08:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.413813+0000", 2024-09-14T09:08:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5136665999999996, 2024-09-14T09:08:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010148119999999999, 2024-09-14T09:08:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.413813+0000", 2024-09-14T09:08:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.413813+0000", 2024-09-14T09:08:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.413813+0000", 2024-09-14T09:08:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2399999999999999e-07 2024-09-14T09:08:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.413817+0000", 2024-09-14T09:08:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5999999999999998e-06 2024-09-14T09:08:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.413836+0000", 2024-09-14T09:08:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9330999999999998e-05 2024-09-14T09:08:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.413842+0000", 2024-09-14T09:08:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7049999999999996e-06 2024-09-14T09:08:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.413892+0000", 2024-09-14T09:08:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0782999999999998e-05 2024-09-14T09:08:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.413913+0000", 2024-09-14T09:08:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0599999999999999e-05 2024-09-14T09:08:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.414781+0000", 2024-09-14T09:08:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00086807799999999999 2024-09-14T09:08:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.414828+0000", 2024-09-14T09:08:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6490999999999999e-05 2024-09-14T09:08:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1214 3.6 e31/22 3:65f8ce2a:::rbd_data.111276489662.0000000000000003:head v 31'12, mlcod=30'9)", 2024-09-14T09:08:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.423831+0000", 2024-09-14T09:08:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5036481349999997, 2024-09-14T09:08:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001391209, 2024-09-14T09:08:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.423831+0000", 2024-09-14T09:08:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.423831+0000", 2024-09-14T09:08:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.423832+0000", 2024-09-14T09:08:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:08:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.423840+0000", 2024-09-14T09:08:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9489999999999996e-06 2024-09-14T09:08:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.423855+0000", 2024-09-14T09:08:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4491999999999999e-05 2024-09-14T09:08:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.423865+0000", 2024-09-14T09:08:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0737000000000001e-05 2024-09-14T09:08:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424096+0000", 2024-09-14T09:08:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000230609 2024-09-14T09:08:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424116+0000", 2024-09-14T09:08:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0358000000000001e-05 2024-09-14T09:08:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425172+0000", 2024-09-14T09:08:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010554220000000001 2024-09-14T09:08:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425222+0000", 2024-09-14T09:08:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0776999999999999e-05 2024-09-14T09:08:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1213 3.19 e31/22 3:9844a71f:::rbd_data.111276489662.0000000000000002:head v 31'26, mlcod=30'23)", 2024-09-14T09:08:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.424067+0000", 2024-09-14T09:08:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5034125190000003, 2024-09-14T09:08:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013787420000000001, 2024-09-14T09:08:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424067+0000", 2024-09-14T09:08:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424067+0000", 2024-09-14T09:08:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424067+0000", 2024-09-14T09:08:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4700000000000002e-07 2024-09-14T09:08:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424072+0000", 2024-09-14T09:08:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6779999999999999e-06 2024-09-14T09:08:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424081+0000", 2024-09-14T09:08:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5790000000000004e-06 2024-09-14T09:08:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424086+0000", 2024-09-14T09:08:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7910000000000001e-06 2024-09-14T09:08:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424140+0000", 2024-09-14T09:08:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3668999999999997e-05 2024-09-14T09:08:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424158+0000", 2024-09-14T09:08:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7827999999999999e-05 2024-09-14T09:08:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425404+0000", 2024-09-14T09:08:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001246402 2024-09-14T09:08:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425446+0000", 2024-09-14T09:08:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1347999999999998e-05 2024-09-14T09:08:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1217 3.19 e31/22 3:9ebf855b:::rbd_data.111276489662.0000000000000006:head v 31'28, mlcod=30'23)", 2024-09-14T09:08:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.424967+0000", 2024-09-14T09:08:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5025125599999996, 2024-09-14T09:08:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026944790000000001, 2024-09-14T09:08:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424967+0000", 2024-09-14T09:08:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424967+0000", 2024-09-14T09:08:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424967+0000", 2024-09-14T09:08:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3099999999999997e-07 2024-09-14T09:08:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424982+0000", 2024-09-14T09:08:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4528999999999999e-05 2024-09-14T09:08:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424992+0000", 2024-09-14T09:08:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0428000000000001e-05 2024-09-14T09:08:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424999+0000", 2024-09-14T09:08:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7649999999999996e-06 2024-09-14T09:08:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425051+0000", 2024-09-14T09:08:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2234999999999997e-05 2024-09-14T09:08:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425072+0000", 2024-09-14T09:08:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0429999999999999e-05 2024-09-14T09:08:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427624+0000", 2024-09-14T09:08:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025518250000000002 2024-09-14T09:08:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427661+0000", 2024-09-14T09:08:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7635999999999997e-05 2024-09-14T09:08:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1220 3.c e31/22 3:348fce71:::rbd_data.111276489662.0000000000000007:head v 31'18, mlcod=30'15)", 2024-09-14T09:08:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.426613+0000", 2024-09-14T09:08:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5008661009999997, 2024-09-14T09:08:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014701790000000001, 2024-09-14T09:08:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426613+0000", 2024-09-14T09:08:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426613+0000", 2024-09-14T09:08:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426614+0000", 2024-09-14T09:08:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0800000000000004e-07 2024-09-14T09:08:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426622+0000", 2024-09-14T09:08:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7279999999999995e-06 2024-09-14T09:08:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426631+0000", 2024-09-14T09:08:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3179999999999996e-06 2024-09-14T09:08:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426636+0000", 2024-09-14T09:08:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0130000000000001e-06 2024-09-14T09:08:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426675+0000", 2024-09-14T09:08:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8677999999999998e-05 2024-09-14T09:08:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426687+0000", 2024-09-14T09:08:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2670000000000001e-05 2024-09-14T09:08:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428046+0000", 2024-09-14T09:08:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001358132 2024-09-14T09:08:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428083+0000", 2024-09-14T09:08:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7832e-05 2024-09-14T09:08:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1221 3.1e e31/22 3:7d74d199:::rbd_data.111276489662.0000000000000008:head v 31'22, mlcod=30'19)", 2024-09-14T09:08:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.428334+0000", 2024-09-14T09:08:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4991457669999999, 2024-09-14T09:08:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020988309999999998, 2024-09-14T09:08:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428334+0000", 2024-09-14T09:08:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428334+0000", 2024-09-14T09:08:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428334+0000", 2024-09-14T09:08:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2099999999999996e-07 2024-09-14T09:08:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428339+0000", 2024-09-14T09:08:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8369999999999996e-06 2024-09-14T09:08:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428349+0000", 2024-09-14T09:08:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9480000000000003e-06 2024-09-14T09:08:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428354+0000", 2024-09-14T09:08:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6349999999999997e-06 2024-09-14T09:08:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428395+0000", 2024-09-14T09:08:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1566000000000001e-05 2024-09-14T09:08:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428427+0000", 2024-09-14T09:08:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1761999999999998e-05 2024-09-14T09:08:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.430398+0000", 2024-09-14T09:08:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00197079 2024-09-14T09:08:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.430432+0000", 2024-09-14T09:08:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4572e-05 2024-09-14T09:08:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1222 3.6 e31/22 3:62148812:::rbd_data.111276489662.0000000000000009:head v 31'14, mlcod=30'10)", 2024-09-14T09:08:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.428442+0000", 2024-09-14T09:08:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4990373000000004, 2024-09-14T09:08:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022360380000000001, 2024-09-14T09:08:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428442+0000", 2024-09-14T09:08:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428442+0000", 2024-09-14T09:08:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428443+0000", 2024-09-14T09:08:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8100000000000002e-07 2024-09-14T09:08:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428448+0000", 2024-09-14T09:08:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7389999999999996e-06 2024-09-14T09:08:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428459+0000", 2024-09-14T09:08:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0098000000000001e-05 2024-09-14T09:08:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428465+0000", 2024-09-14T09:08:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4509999999999997e-06 2024-09-14T09:08:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428546+0000", 2024-09-14T09:08:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1191000000000002e-05 2024-09-14T09:08:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428566+0000", 2024-09-14T09:08:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9939999999999999e-05 2024-09-14T09:08:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.430646+0000", 2024-09-14T09:08:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020798050000000001 2024-09-14T09:08:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.430678+0000", 2024-09-14T09:08:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2132999999999999e-05 2024-09-14T09:08:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1225 3.19 e31/22 3:982fc283:::rbd_data.111276489662.000000000000000c:head v 31'30, mlcod=31'26)", 2024-09-14T09:08:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.432647+0000", 2024-09-14T09:08:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4948327990000001, 2024-09-14T09:08:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003008578, 2024-09-14T09:08:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432647+0000", 2024-09-14T09:08:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432647+0000", 2024-09-14T09:08:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432647+0000", 2024-09-14T09:08:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8400000000000005e-07 2024-09-14T09:08:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432651+0000", 2024-09-14T09:08:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.092e-06 2024-09-14T09:08:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432659+0000", 2024-09-14T09:08:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2770000000000005e-06 2024-09-14T09:08:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432664+0000", 2024-09-14T09:08:00.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.746e-06 2024-09-14T09:08:00.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:00.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432708+0000", 2024-09-14T09:08:00.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3458000000000003e-05 2024-09-14T09:08:00.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:00.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432724+0000", 2024-09-14T09:08:00.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6339999999999999e-05 2024-09-14T09:08:00.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:00.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.435617+0000", 2024-09-14T09:08:00.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028927929999999998 2024-09-14T09:08:00.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:00.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.435655+0000", 2024-09-14T09:08:00.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8387999999999999e-05 2024-09-14T09:08:00.993 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.993 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:00.993 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4617.0:1744 3.5 e34/22 3:a289215f:::rbd_data.11126408a170.0000000000000023:head v 34'101, mlcod=33'99)", 2024-09-14T09:08:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:59.932121+0000", 2024-09-14T09:08:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.99535805899999996, 2024-09-14T09:08:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001577513, 2024-09-14T09:08:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.932121+0000", 2024-09-14T09:08:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.932121+0000", 2024-09-14T09:08:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.932122+0000", 2024-09-14T09:08:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4699999999999998e-07 2024-09-14T09:08:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.932515+0000", 2024-09-14T09:08:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00039362499999999999 2024-09-14T09:08:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.932524+0000", 2024-09-14T09:08:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8319999999999995e-06 2024-09-14T09:08:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.932529+0000", 2024-09-14T09:08:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1309999999999997e-06 2024-09-14T09:08:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.932594+0000", 2024-09-14T09:08:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5343000000000001e-05 2024-09-14T09:08:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.932610+0000", 2024-09-14T09:08:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5554e-05 2024-09-14T09:08:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.933664+0000", 2024-09-14T09:08:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010542380000000001 2024-09-14T09:08:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.933699+0000", 2024-09-14T09:08:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4542999999999998e-05 2024-09-14T09:08:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4617.0:1784 3.18 e34/22 3:1c3e1bc5:::rbd_data.11126408a170.0000000000000025:head v 34'21, mlcod=29'19)", 2024-09-14T09:08:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:59.934667+0000", 2024-09-14T09:08:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.99281283799999998, 2024-09-14T09:08:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001508157, 2024-09-14T09:08:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.934667+0000", 2024-09-14T09:08:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.934667+0000", 2024-09-14T09:08:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.934667+0000", 2024-09-14T09:08:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1799999999999999e-07 2024-09-14T09:08:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.934741+0000", 2024-09-14T09:08:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4148999999999998e-05 2024-09-14T09:08:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.934753+0000", 2024-09-14T09:08:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2601e-05 2024-09-14T09:08:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.934761+0000", 2024-09-14T09:08:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2200000000000003e-06 2024-09-14T09:08:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.934808+0000", 2024-09-14T09:08:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7670000000000003e-05 2024-09-14T09:08:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.934830+0000", 2024-09-14T09:08:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2098000000000001e-05 2024-09-14T09:08:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.936139+0000", 2024-09-14T09:08:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001308172 2024-09-14T09:08:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.936175+0000", 2024-09-14T09:08:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6028999999999997e-05 2024-09-14T09:08:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4617.0:1785 3.18 e34/22 3:1c3e1bc5:::rbd_data.11126408a170.0000000000000025:head v 34'23, mlcod=29'19)", 2024-09-14T09:08:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:59.935521+0000", 2024-09-14T09:08:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.99195833300000003, 2024-09-14T09:08:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001064995, 2024-09-14T09:08:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.935521+0000", 2024-09-14T09:08:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.935521+0000", 2024-09-14T09:08:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.935522+0000", 2024-09-14T09:08:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3099999999999997e-07 2024-09-14T09:08:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.935529+0000", 2024-09-14T09:08:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8329999999999996e-06 2024-09-14T09:08:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.935540+0000", 2024-09-14T09:08:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1314e-05 2024-09-14T09:08:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.935547+0000", 2024-09-14T09:08:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.114e-06 2024-09-14T09:08:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.935618+0000", 2024-09-14T09:08:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1043000000000004e-05 2024-09-14T09:08:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.935641+0000", 2024-09-14T09:08:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2685999999999999e-05 2024-09-14T09:08:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.936538+0000", 2024-09-14T09:08:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00089718700000000003 2024-09-14T09:08:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.936586+0000", 2024-09-14T09:08:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8087000000000002e-05 2024-09-14T09:08:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4617.0:1818 3.9 e34/22 3:92316a3d:::rbd_data.11126408a170.0000000000000027:head v 34'55, mlcod=29'53)", 2024-09-14T09:08:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:59.936777+0000", 2024-09-14T09:08:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.99070225999999995, 2024-09-14T09:08:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014205380000000001, 2024-09-14T09:08:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.936777+0000", 2024-09-14T09:08:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.936777+0000", 2024-09-14T09:08:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.936778+0000", 2024-09-14T09:08:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6799999999999999e-07 2024-09-14T09:08:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.937108+0000", 2024-09-14T09:08:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000330052 2024-09-14T09:08:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.937120+0000", 2024-09-14T09:08:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1973999999999999e-05 2024-09-14T09:08:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.937128+0000", 2024-09-14T09:08:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.106e-06 2024-09-14T09:08:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.937185+0000", 2024-09-14T09:08:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6561000000000003e-05 2024-09-14T09:08:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.937200+0000", 2024-09-14T09:08:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5e-05 2024-09-14T09:08:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.938149+0000", 2024-09-14T09:08:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00094965700000000002 2024-09-14T09:08:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.938198+0000", 2024-09-14T09:08:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8420000000000001e-05 2024-09-14T09:08:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4617.0:1992 3.5 e34/22 3:a1eaa24f:::rbd_data.11126408a170.000000000000002d:head v 34'104, mlcod=34'101)", 2024-09-14T09:08:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:59.947596+0000", 2024-09-14T09:08:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.97988336899999995, 2024-09-14T09:08:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00097535199999999997, 2024-09-14T09:08:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.947596+0000", 2024-09-14T09:08:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.947596+0000", 2024-09-14T09:08:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.947598+0000", 2024-09-14T09:08:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8700000000000001e-06 2024-09-14T09:08:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.947758+0000", 2024-09-14T09:08:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015980200000000001 2024-09-14T09:08:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.947768+0000", 2024-09-14T09:08:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0030999999999999e-05 2024-09-14T09:08:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.947772+0000", 2024-09-14T09:08:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7330000000000003e-06 2024-09-14T09:08:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.947812+0000", 2024-09-14T09:08:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9969000000000003e-05 2024-09-14T09:08:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.947825+0000", 2024-09-14T09:08:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2714999999999999e-05 2024-09-14T09:08:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.948539+0000", 2024-09-14T09:08:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00071396000000000003 2024-09-14T09:08:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.948571+0000", 2024-09-14T09:08:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2271999999999999e-05 2024-09-14T09:08:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:01.015 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:01.016 INFO:teuthology.orchestra.run.smithi148.stdout:1068 write 0x236bc00 thru 0x236db89 (0x1f8a bytes) 2024-09-14T09:08:01.017 INFO:teuthology.orchestra.run.smithi148.stdout:1069 trunc from 0x965ec00 to 0x394bc00 2024-09-14T09:08:01.017 INFO:teuthology.orchestra.run.smithi148.stdout:1070 punch from 0x2e0c800 to 0x2e19e00, (0xd600 bytes) 2024-09-14T09:08:01.017 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:08:01.018 INFO:teuthology.orchestra.run.smithi148.stdout:1071 write 0xd6e2800 thru 0xd6e8344 (0x5b45 bytes) 2024-09-14T09:08:01.019 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:01.021+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:01.019 INFO:teuthology.orchestra.run.smithi148.stdout:1072 read 0x16fbc00 thru 0x16ffedc (0x42dd bytes) 2024-09-14T09:08:01.020 INFO:teuthology.orchestra.run.smithi148.stdout:1074 punch from 0x3669600 to 0x3675000, (0xba00 bytes) 2024-09-14T09:08:01.020 INFO:teuthology.orchestra.run.smithi148.stdout:1075 punch from 0x3e92400 to 0x3e96a00, (0x4600 bytes) 2024-09-14T09:08:01.020 INFO:teuthology.orchestra.run.smithi148.stdout:1077 read 0x86f800 thru 0x8789c4 (0x91c5 bytes) 2024-09-14T09:08:01.021 INFO:teuthology.orchestra.run.smithi148.stdout:1078 read 0xbe31800 thru 0xbe3cfb7 (0xb7b8 bytes) 2024-09-14T09:08:01.021 INFO:teuthology.orchestra.run.smithi148.stdout:1079 read 0xc391a00 thru 0xc399de7 (0x83e8 bytes) 2024-09-14T09:08:01.021 INFO:teuthology.orchestra.run.smithi148.stdout:1081 read 0x171d400 thru 0x17238a0 (0x64a1 bytes) 2024-09-14T09:08:01.021 INFO:teuthology.orchestra.run.smithi148.stdout:1082 write 0x3287c00 thru 0x3292062 (0xa463 bytes) 2024-09-14T09:08:01.021 INFO:teuthology.orchestra.run.smithi148.stdout:1083 read 0x196b000 thru 0x1972382 (0x7383 bytes) 2024-09-14T09:08:01.035 INFO:teuthology.orchestra.run.smithi148.stdout:1084 write 0xecbe800 thru 0xecbfd42 (0x1543 bytes) 2024-09-14T09:08:01.048 INFO:teuthology.orchestra.run.smithi148.stdout:1087 trunc from 0xecbfe00 to 0x8ce1000 2024-09-14T09:08:01.068 INFO:teuthology.orchestra.run.smithi148.stdout:1088 write 0x50c1200 thru 0x50c5dd9 (0x4bda bytes) 2024-09-14T09:08:01.073 INFO:teuthology.orchestra.run.smithi148.stdout:1090 trunc from 0x8ce1000 to 0xc10d600 2024-09-14T09:08:01.093 INFO:teuthology.orchestra.run.smithi148.stdout:1092 trunc from 0xc10d600 to 0x564a000 2024-09-14T09:08:01.102 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:08:01.103 INFO:teuthology.orchestra.run.smithi148.stdout:1094 read 0x4ddcc00 thru 0x4de771f (0xab20 bytes) 2024-09-14T09:08:01.108 INFO:teuthology.orchestra.run.smithi148.stdout:1097 clone 8 order 19 su 16384 sc 15 2024-09-14T09:08:01.146 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:01.148+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:01.162 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:01.162 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:01.162 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:01.162 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:01.170 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:08:01.221 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:01.221 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:01.221 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:01.223+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:01.237 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:01.237 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:01.253 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:08:01.253 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:08:01.269 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:01.269 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:01.275 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:01.275 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:01.275 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:01.275 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:01.275 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:01.283 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:08:01.285 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:01.286 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:01.303 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:01.303 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:01.325 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:01.327+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:01.422 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:01.424+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:01.427 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:01.427 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:01.435 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:08:01.523 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:01.526+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:01.539 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:01.539 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:01.548 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:08:01.624 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:01.626+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:01.691 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:01.691 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:01.700 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:08:01.744 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:01.746+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:01.795 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is unset 2024-09-14T09:08:01.804 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:01.804 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:01.813 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:08:01.855 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:01.857+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:01.874 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone7 from 0x564a000 (overlap 0x394bc00) to 0x2dd6200 2024-09-14T09:08:01.927 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:01.929+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:01.962 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:01.962 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:01.971 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:08:02.028 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:02.031+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:02.079 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:02.079 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:02.088 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:08:02.131 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:02.133+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:02.167 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #6, image image_client.0-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent7 2024-09-14T09:08:02.198 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:02.199 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:02.209 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:08:02.250 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:02.252+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:02.331 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:02.333+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:02.396 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:02.397 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:02.408 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:08:02.452 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:02.454+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:02.533 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:02.535+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:02.556 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:02.556 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:02.568 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:08:02.652 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:02.654+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:02.717 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:02.717 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:02.726 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:08:02.767 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:02.769+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:02.781 INFO:teuthology.orchestra.run.smithi148.stdout:1099 punch from 0x21ec00 to 0x225000, (0x6400 bytes) 2024-09-14T09:08:02.797 INFO:teuthology.orchestra.run.smithi148.stdout:1101 punch from 0x15cc600 to 0x15d9e00, (0xd800 bytes) 2024-09-14T09:08:02.812 INFO:teuthology.orchestra.run.smithi148.stdout:1102 write 0x261b000 thru 0x2628b4c (0xdb4d bytes) 2024-09-14T09:08:02.812 INFO:teuthology.orchestra.run.smithi148.stdout:1103 read 0x323e600 thru 0x324a535 (0xbf36 bytes) 2024-09-14T09:08:02.835 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:02.837+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:02.835 INFO:teuthology.orchestra.run.smithi148.stdout:1107 write 0x5db9200 thru 0x5dc771e (0xe51f bytes) 2024-09-14T09:08:02.835 INFO:teuthology.orchestra.run.smithi148.stdout:1108 punch from 0x5934400 to 0x5943200, (0xee00 bytes) 2024-09-14T09:08:02.836 INFO:teuthology.orchestra.run.smithi148.stdout:1109 punch from 0x23bac00 to 0x23c3600, (0x8a00 bytes) 2024-09-14T09:08:02.836 INFO:teuthology.orchestra.run.smithi148.stdout:1110 read 0x34f0000 thru 0x34ff5ae (0xf5af bytes) 2024-09-14T09:08:02.837 INFO:teuthology.orchestra.run.smithi148.stdout:1112 read 0x5a2e600 thru 0x5a2f6f9 (0x10fa bytes) 2024-09-14T09:08:02.858 INFO:teuthology.orchestra.run.smithi148.stdout:1113 write 0xce51e00 thru 0xce54699 (0x289a bytes) 2024-09-14T09:08:02.859 INFO:teuthology.orchestra.run.smithi148.stdout:1115 punch from 0x8a5a400 to 0x8a66a00, (0xc600 bytes) 2024-09-14T09:08:02.862 INFO:teuthology.orchestra.run.smithi148.stdout:1116 read 0xc5e7e00 thru 0xc5f6830 (0xea31 bytes) 2024-09-14T09:08:02.862 INFO:teuthology.orchestra.run.smithi148.stdout:1119 read 0x2add000 thru 0x2ae6c32 (0x9c33 bytes) 2024-09-14T09:08:02.862 INFO:teuthology.orchestra.run.smithi148.stdout:1122 read 0x8f30400 thru 0x8f3aaff (0xa700 bytes) 2024-09-14T09:08:02.862 INFO:teuthology.orchestra.run.smithi148.stdout:1123 punch from 0x3dab200 to 0x3dabe00, (0xc00 bytes) 2024-09-14T09:08:02.862 INFO:teuthology.orchestra.run.smithi148.stdout:1124 punch from 0xb880600 to 0xb88da00, (0xd400 bytes) 2024-09-14T09:08:02.862 INFO:teuthology.orchestra.run.smithi148.stdout:1125 write 0x2e36e00 thru 0x2e423be (0xb5bf bytes) 2024-09-14T09:08:02.862 INFO:teuthology.orchestra.run.smithi148.stdout:1126 write 0x55eb800 thru 0x55ebf5b (0x75c bytes) 2024-09-14T09:08:02.862 INFO:teuthology.orchestra.run.smithi148.stdout:1127 read 0xb5f5a00 thru 0xb5f5c23 (0x224 bytes) 2024-09-14T09:08:02.865 INFO:teuthology.orchestra.run.smithi148.stdout:1128 trunc from 0xce54800 to 0x9e99e00 2024-09-14T09:08:02.890 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:02.891 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:02.900 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:08:02.901 INFO:teuthology.orchestra.run.smithi148.stdout:1129 punch from 0x86d8400 to 0x86e7a00, (0xf600 bytes) 2024-09-14T09:08:02.901 INFO:teuthology.orchestra.run.smithi148.stdout:1130 write 0x8491c00 thru 0x849c394 (0xa795 bytes) 2024-09-14T09:08:02.905 INFO:teuthology.orchestra.run.smithi148.stdout:1133 trunc from 0x9e99e00 to 0x56e1600 2024-09-14T09:08:02.944 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:02.946+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:02.952 INFO:teuthology.orchestra.run.smithi148.stdout:1136 trunc from 0x56e1600 to 0x11cd600 2024-09-14T09:08:03.006 INFO:teuthology.orchestra.run.smithi148.stdout:1138 trunc from 0x11cd600 to 0x1208c00 2024-09-14T09:08:03.020 INFO:teuthology.orchestra.run.smithi148.stdout:1140 read 0xb5ce00 thru 0xb661a6 (0x93a7 bytes) 2024-09-14T09:08:03.021 INFO:teuthology.orchestra.run.smithi148.stdout:1141 read 0x100ac00 thru 0x100c7e8 (0x1be9 bytes) 2024-09-14T09:08:03.021 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:03.021 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:03.032 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:08:03.035 INFO:teuthology.orchestra.run.smithi148.stdout:1142 trunc from 0x1208c00 to 0xcdf4e00 2024-09-14T09:08:03.036 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:03.038+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:03.049 INFO:teuthology.orchestra.run.smithi148.stdout:1143 read 0x41a5600 thru 0x41a5a8a (0x48b bytes) 2024-09-14T09:08:03.049 INFO:teuthology.orchestra.run.smithi148.stdout:1144 punch from 0x8b08a00 to 0x8b10200, (0x7800 bytes) 2024-09-14T09:08:03.050 INFO:teuthology.orchestra.run.smithi148.stdout:1145 write 0x11b8a00 thru 0x11c6b05 (0xe106 bytes) 2024-09-14T09:08:03.062 INFO:teuthology.orchestra.run.smithi148.stdout:1146 trunc from 0xcdf4e00 to 0x2fbac00 2024-09-14T09:08:03.102 INFO:teuthology.orchestra.run.smithi148.stdout:1153 write 0x813be00 thru 0x8149081 (0xd282 bytes) 2024-09-14T09:08:03.103 INFO:teuthology.orchestra.run.smithi148.stdout:1155 read 0x3dffc00 thru 0x3e04305 (0x4706 bytes) 2024-09-14T09:08:03.103 INFO:teuthology.orchestra.run.smithi148.stdout:1156 punch from 0x6878000 to 0x687fa00, (0x7a00 bytes) 2024-09-14T09:08:03.103 INFO:teuthology.orchestra.run.smithi148.stdout:1157 write 0x686000 thru 0x68aefd (0x4efe bytes) 2024-09-14T09:08:03.104 INFO:teuthology.orchestra.run.smithi148.stdout:1160 trunc from 0x8149200 to 0x768fe00 2024-09-14T09:08:03.137 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:03.139+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:03.143 INFO:teuthology.orchestra.run.smithi148.stdout:1161 read 0x3a27600 thru 0x3a3337e (0xbd7f bytes) 2024-09-14T09:08:03.144 INFO:teuthology.orchestra.run.smithi148.stdout:1163 punch from 0x4154400 to 0x4163a00, (0xf600 bytes) 2024-09-14T09:08:03.145 INFO:teuthology.orchestra.run.smithi148.stdout:1164 trunc from 0x768fe00 to 0x7a50800 2024-09-14T09:08:03.184 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:03.184 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:03.193 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:08:03.207 INFO:teuthology.orchestra.run.smithi148.stdout:1165 trunc from 0x7a50800 to 0x9d67c00 2024-09-14T09:08:03.222 INFO:teuthology.orchestra.run.smithi148.stdout:1166 read 0x185d600 thru 0x186bc37 (0xe638 bytes) 2024-09-14T09:08:03.232 INFO:teuthology.orchestra.run.smithi148.stdout:1169 write 0xa630200 thru 0xa63ec3d (0xea3e bytes) 2024-09-14T09:08:03.238 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:03.240+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:03.238 INFO:teuthology.orchestra.run.smithi148.stdout:1171 punch from 0x268d000 to 0x269a800, (0xd800 bytes) 2024-09-14T09:08:03.260 INFO:teuthology.orchestra.run.smithi148.stdout:1172 write 0xc12d400 thru 0xc1308e1 (0x34e2 bytes) 2024-09-14T09:08:03.267 INFO:teuthology.orchestra.run.smithi148.stdout:1175 write 0x5776c00 thru 0x577737d (0x77e bytes) 2024-09-14T09:08:03.267 INFO:teuthology.orchestra.run.smithi148.stdout:1178 punch from 0xae1be00 to 0xae1c600, (0x800 bytes) 2024-09-14T09:08:03.267 INFO:teuthology.orchestra.run.smithi148.stdout:1180 punch from 0x727fa00 to 0x7286200, (0x6800 bytes) 2024-09-14T09:08:03.278 INFO:teuthology.orchestra.run.smithi148.stdout:1183 trunc from 0xc130a00 to 0x3556600 2024-09-14T09:08:03.307 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:03.307 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:03.312 INFO:teuthology.orchestra.run.smithi148.stdout:1185 write 0x59f1600 thru 0x59f9237 (0x7c38 bytes) 2024-09-14T09:08:03.312 INFO:teuthology.orchestra.run.smithi148.stdout:1186 read 0x213b200 thru 0x2143f91 (0x8d92 bytes) 2024-09-14T09:08:03.314 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:08:03.316 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:08:03.334 INFO:teuthology.orchestra.run.smithi148.stdout:1187 write 0xa14e000 thru 0xa14e380 (0x381 bytes) 2024-09-14T09:08:03.335 INFO:teuthology.orchestra.run.smithi148.stdout:1190 write 0x732bc00 thru 0x73357f9 (0x9bfa bytes) 2024-09-14T09:08:03.335 INFO:teuthology.orchestra.run.smithi148.stdout:1191 read 0x2587c00 thru 0x258db9e (0x5f9f bytes) 2024-09-14T09:08:03.339 INFO:teuthology.orchestra.run.smithi148.stdout:1193 trunc from 0xa14e400 to 0x6cde600 2024-09-14T09:08:03.359 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:03.361+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:03.368 INFO:teuthology.orchestra.run.smithi148.stdout:1195 read 0x1ff2400 thru 0x1ff8d10 (0x6911 bytes) 2024-09-14T09:08:03.369 INFO:teuthology.orchestra.run.smithi148.stdout:1197 read 0x3c66400 thru 0x3c6adb6 (0x49b7 bytes) 2024-09-14T09:08:03.369 INFO:teuthology.orchestra.run.smithi148.stdout:1198 punch from 0x5d79200 to 0x5d7ee00, (0x5c00 bytes) 2024-09-14T09:08:03.370 INFO:teuthology.orchestra.run.smithi148.stdout:1199 write 0x1b8400 thru 0x1bc64c (0x424d bytes) 2024-09-14T09:08:03.390 INFO:teuthology.orchestra.run.smithi148.stdout:1200 write 0x726ba00 thru 0x7278de4 (0xd3e5 bytes) 2024-09-14T09:08:03.411 INFO:teuthology.orchestra.run.smithi148.stdout:1201 write 0xb57d000 thru 0xb58c0ed (0xf0ee bytes) 2024-09-14T09:08:03.433 INFO:teuthology.orchestra.run.smithi148.stdout:1202 write 0xeb7be00 thru 0xeb81e65 (0x6066 bytes) 2024-09-14T09:08:03.435 INFO:teuthology.orchestra.run.smithi148.stdout:1203 punch from 0x3b4ee00 to 0x3b5d400, (0xe600 bytes) 2024-09-14T09:08:03.440 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:03.442+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:03.447 INFO:teuthology.orchestra.run.smithi148.stdout:1204 trunc from 0xeb82000 to 0x45f7000 2024-09-14T09:08:03.449 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:03.449 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:03.466 INFO:teuthology.orchestra.run.smithi148.stdout:1205 read 0x2135e00 thru 0x213998b (0x3b8c bytes) 2024-09-14T09:08:03.469 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:03.469 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:03.473 INFO:teuthology.orchestra.run.smithi148.stdout:1206 clone 9 order 25 su 16777216 sc 2 2024-09-14T09:08:03.477 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:03.477 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:03.486 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:08:03.487 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:08:03.487 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:08:03.503 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:03.503 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:03.519 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:03.520 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:03.536 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:03.536 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:03.540 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:03.542+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:03.591 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:03.592 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:03.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:03.592 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:03.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.592 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4471.0:521 3.c e27/22 3:35a5bd89:::rbd_data.1112b98aa287.0000000000000004:head v 27'7, mlcod=26'4)", 2024-09-14T09:08:03.592 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.591279+0000", 2024-09-14T09:08:03.592 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.00179681, 2024-09-14T09:08:03.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001127292, 2024-09-14T09:08:03.592 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:03.592 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:03.592 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:03.592 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:03.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:03.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591279+0000", 2024-09-14T09:08:03.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:03.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591279+0000", 2024-09-14T09:08:03.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:03.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591281+0000", 2024-09-14T09:08:03.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5799999999999999e-06 2024-09-14T09:08:03.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:03.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591293+0000", 2024-09-14T09:08:03.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2052000000000001e-05 2024-09-14T09:08:03.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:03.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591317+0000", 2024-09-14T09:08:03.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4406999999999999e-05 2024-09-14T09:08:03.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:03.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591329+0000", 2024-09-14T09:08:03.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2303000000000001e-05 2024-09-14T09:08:03.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:03.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591466+0000", 2024-09-14T09:08:03.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013648100000000001 2024-09-14T09:08:03.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:03.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.591504+0000", 2024-09-14T09:08:03.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8306000000000002e-05 2024-09-14T09:08:03.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:03.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592379+0000", 2024-09-14T09:08:03.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000874806 2024-09-14T09:08:03.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:03.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592406+0000", 2024-09-14T09:08:03.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7356999999999999e-05 2024-09-14T09:08:03.596 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.596 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:03.596 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.597 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4471.0:523 3.1b 3:de381ce0:::rbd_data.1112b98aa287.000000000000000a:head [delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-14T09:08:03.597 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:50.592885+0000", 2024-09-14T09:08:03.597 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.000190429, 2024-09-14T09:08:03.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016302420000000001, 2024-09-14T09:08:03.597 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:03.597 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:03.597 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:03.597 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:03.597 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4471", 2024-09-14T09:08:03.597 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2207718190", 2024-09-14T09:08:03.597 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 523 2024-09-14T09:08:03.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.597 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:03.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:03.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592885+0000", 2024-09-14T09:08:03.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:03.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592885+0000", 2024-09-14T09:08:03.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:03.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592887+0000", 2024-09-14T09:08:03.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.364e-06 2024-09-14T09:08:03.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:03.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592891+0000", 2024-09-14T09:08:03.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5900000000000001e-06 2024-09-14T09:08:03.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:03.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592904+0000", 2024-09-14T09:08:03.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2481e-05 2024-09-14T09:08:03.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:03.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592911+0000", 2024-09-14T09:08:03.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.644e-06 2024-09-14T09:08:03.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:03.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.592957+0000", 2024-09-14T09:08:03.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5979999999999997e-05 2024-09-14T09:08:03.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:03.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.593007+0000", 2024-09-14T09:08:03.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9568999999999999e-05 2024-09-14T09:08:03.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:03.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.593104+0000", 2024-09-14T09:08:03.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6877000000000001e-05 2024-09-14T09:08:03.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:03.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.593837+0000", 2024-09-14T09:08:03.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073326499999999998 2024-09-14T09:08:03.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:03.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.594459+0000", 2024-09-14T09:08:03.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00062228800000000003 2024-09-14T09:08:03.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:03.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.594490+0000", 2024-09-14T09:08:03.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0178000000000001e-05 2024-09-14T09:08:03.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:03.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:50.594516+0000", 2024-09-14T09:08:03.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6006000000000001e-05 2024-09-14T09:08:03.602 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.602 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:03.602 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.603 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:771 3.19 e30/22 3:9844a71f:::rbd_data.111276489662.0000000000000002:head v 30'22, mlcod=29'20)", 2024-09-14T09:08:03.603 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.872592+0000", 2024-09-14T09:08:03.603 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7204838730000001, 2024-09-14T09:08:03.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001230996, 2024-09-14T09:08:03.603 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:03.603 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:03.603 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:03.603 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:03.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:03.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872592+0000", 2024-09-14T09:08:03.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:03.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872592+0000", 2024-09-14T09:08:03.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:03.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872593+0000", 2024-09-14T09:08:03.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2399999999999997e-07 2024-09-14T09:08:03.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:03.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872702+0000", 2024-09-14T09:08:03.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010938900000000001 2024-09-14T09:08:03.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:03.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872715+0000", 2024-09-14T09:08:03.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2679e-05 2024-09-14T09:08:03.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:03.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872722+0000", 2024-09-14T09:08:03.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3470000000000001e-06 2024-09-14T09:08:03.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:03.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872785+0000", 2024-09-14T09:08:03.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3355000000000006e-05 2024-09-14T09:08:03.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:03.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872804+0000", 2024-09-14T09:08:03.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8637000000000001e-05 2024-09-14T09:08:03.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:03.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.873784+0000", 2024-09-14T09:08:03.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00098006299999999998 2024-09-14T09:08:03.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:03.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.873823+0000", 2024-09-14T09:08:03.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8801999999999999e-05 2024-09-14T09:08:03.607 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.607 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:03.607 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.607 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:780 3.c e30/22 3:348fce71:::rbd_data.111276489662.0000000000000007:head v 30'15, mlcod=28'12)", 2024-09-14T09:08:03.607 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.877170+0000", 2024-09-14T09:08:03.607 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7159053179999999, 2024-09-14T09:08:03.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024747509999999999, 2024-09-14T09:08:03.607 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:03.608 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:03.608 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:03.608 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:03.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:03.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877170+0000", 2024-09-14T09:08:03.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:03.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877170+0000", 2024-09-14T09:08:03.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:03.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877171+0000", 2024-09-14T09:08:03.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3300000000000001e-07 2024-09-14T09:08:03.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:03.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877179+0000", 2024-09-14T09:08:03.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5170000000000002e-06 2024-09-14T09:08:03.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:03.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877188+0000", 2024-09-14T09:08:03.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4199999999999996e-06 2024-09-14T09:08:03.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:03.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877193+0000", 2024-09-14T09:08:03.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5290000000000002e-06 2024-09-14T09:08:03.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:03.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877248+0000", 2024-09-14T09:08:03.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5012000000000001e-05 2024-09-14T09:08:03.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:03.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877270+0000", 2024-09-14T09:08:03.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2540000000000001e-05 2024-09-14T09:08:03.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:03.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.879613+0000", 2024-09-14T09:08:03.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0023428899999999998 2024-09-14T09:08:03.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:03.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.879645+0000", 2024-09-14T09:08:03.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2110000000000003e-05 2024-09-14T09:08:03.612 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.612 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:03.612 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.612 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:783 3.1e e30/22 3:7d74d199:::rbd_data.111276489662.0000000000000008:head v 30'19, mlcod=29'17)", 2024-09-14T09:08:03.612 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.880224+0000", 2024-09-14T09:08:03.613 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7128521049999996, 2024-09-14T09:08:03.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020308650000000002, 2024-09-14T09:08:03.613 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:03.613 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:03.613 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:03.613 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:03.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:03.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880224+0000", 2024-09-14T09:08:03.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:03.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880224+0000", 2024-09-14T09:08:03.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:03.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880224+0000", 2024-09-14T09:08:03.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2200000000000004e-07 2024-09-14T09:08:03.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:03.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880229+0000", 2024-09-14T09:08:03.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7419999999999997e-06 2024-09-14T09:08:03.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:03.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880238+0000", 2024-09-14T09:08:03.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6759999999999996e-06 2024-09-14T09:08:03.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:03.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880243+0000", 2024-09-14T09:08:03.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8609999999999997e-06 2024-09-14T09:08:03.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:03.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880288+0000", 2024-09-14T09:08:03.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5668999999999999e-05 2024-09-14T09:08:03.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:03.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880302+0000", 2024-09-14T09:08:03.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3489000000000001e-05 2024-09-14T09:08:03.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:03.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.882221+0000", 2024-09-14T09:08:03.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001919362 2024-09-14T09:08:03.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:03.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.882255+0000", 2024-09-14T09:08:03.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3444e-05 2024-09-14T09:08:03.617 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.617 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:03.617 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.617 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1159 3.7 e31/22 3:e6c13853:::rbd_object_map.111276489662.0000000000000007:head v 31'235, mlcod=30'233)", 2024-09-14T09:08:03.617 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.343595+0000", 2024-09-14T09:08:03.617 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.2494807010000004, 2024-09-14T09:08:03.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031037040000000001, 2024-09-14T09:08:03.617 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:03.617 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:03.617 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:03.617 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:03.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:03.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343595+0000", 2024-09-14T09:08:03.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:03.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343595+0000", 2024-09-14T09:08:03.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:03.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343595+0000", 2024-09-14T09:08:03.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6899999999999999e-07 2024-09-14T09:08:03.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:03.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343599+0000", 2024-09-14T09:08:03.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0090000000000001e-06 2024-09-14T09:08:03.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:03.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343610+0000", 2024-09-14T09:08:03.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0661e-05 2024-09-14T09:08:03.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:03.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343619+0000", 2024-09-14T09:08:03.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2059999999999996e-06 2024-09-14T09:08:03.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:03.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343667+0000", 2024-09-14T09:08:03.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7611999999999997e-05 2024-09-14T09:08:03.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:03.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343683+0000", 2024-09-14T09:08:03.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5917999999999999e-05 2024-09-14T09:08:03.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:03.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.346665+0000", 2024-09-14T09:08:03.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029824840000000001 2024-09-14T09:08:03.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:03.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.346699+0000", 2024-09-14T09:08:03.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3645000000000001e-05 2024-09-14T09:08:03.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.621 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:03.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.621 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1214 3.6 e31/22 3:65f8ce2a:::rbd_data.111276489662.0000000000000003:head v 31'12, mlcod=30'9)", 2024-09-14T09:08:03.621 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.423831+0000", 2024-09-14T09:08:03.621 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.1692445090000003, 2024-09-14T09:08:03.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001391209, 2024-09-14T09:08:03.622 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:03.622 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:03.622 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:03.622 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:03.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:03.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.423831+0000", 2024-09-14T09:08:03.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:03.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.423831+0000", 2024-09-14T09:08:03.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:03.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.423832+0000", 2024-09-14T09:08:03.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:08:03.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:03.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.423840+0000", 2024-09-14T09:08:03.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9489999999999996e-06 2024-09-14T09:08:03.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:03.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.423855+0000", 2024-09-14T09:08:03.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4491999999999999e-05 2024-09-14T09:08:03.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:03.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.423865+0000", 2024-09-14T09:08:03.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0737000000000001e-05 2024-09-14T09:08:03.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:03.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424096+0000", 2024-09-14T09:08:03.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000230609 2024-09-14T09:08:03.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:03.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424116+0000", 2024-09-14T09:08:03.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0358000000000001e-05 2024-09-14T09:08:03.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:03.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425172+0000", 2024-09-14T09:08:03.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010554220000000001 2024-09-14T09:08:03.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:03.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425222+0000", 2024-09-14T09:08:03.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0776999999999999e-05 2024-09-14T09:08:03.626 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.626 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:03.626 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.626 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1213 3.19 e31/22 3:9844a71f:::rbd_data.111276489662.0000000000000002:head v 31'26, mlcod=30'23)", 2024-09-14T09:08:03.626 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.424067+0000", 2024-09-14T09:08:03.626 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.169008893, 2024-09-14T09:08:03.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013787420000000001, 2024-09-14T09:08:03.626 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:03.626 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:03.626 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:03.626 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:03.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:03.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424067+0000", 2024-09-14T09:08:03.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:03.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424067+0000", 2024-09-14T09:08:03.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:03.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424067+0000", 2024-09-14T09:08:03.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4700000000000002e-07 2024-09-14T09:08:03.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:03.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424072+0000", 2024-09-14T09:08:03.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6779999999999999e-06 2024-09-14T09:08:03.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:03.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424081+0000", 2024-09-14T09:08:03.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5790000000000004e-06 2024-09-14T09:08:03.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:03.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424086+0000", 2024-09-14T09:08:03.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7910000000000001e-06 2024-09-14T09:08:03.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:03.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424140+0000", 2024-09-14T09:08:03.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3668999999999997e-05 2024-09-14T09:08:03.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:03.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424158+0000", 2024-09-14T09:08:03.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7827999999999999e-05 2024-09-14T09:08:03.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:03.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425404+0000", 2024-09-14T09:08:03.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001246402 2024-09-14T09:08:03.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:03.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425446+0000", 2024-09-14T09:08:03.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1347999999999998e-05 2024-09-14T09:08:03.630 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.630 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:03.630 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.630 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1217 3.19 e31/22 3:9ebf855b:::rbd_data.111276489662.0000000000000006:head v 31'28, mlcod=30'23)", 2024-09-14T09:08:03.630 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.424967+0000", 2024-09-14T09:08:03.630 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.1681089340000002, 2024-09-14T09:08:03.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026944790000000001, 2024-09-14T09:08:03.631 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:03.631 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:03.631 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:03.631 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:03.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:03.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424967+0000", 2024-09-14T09:08:03.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:03.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424967+0000", 2024-09-14T09:08:03.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:03.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424967+0000", 2024-09-14T09:08:03.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3099999999999997e-07 2024-09-14T09:08:03.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:03.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424982+0000", 2024-09-14T09:08:03.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4528999999999999e-05 2024-09-14T09:08:03.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:03.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424992+0000", 2024-09-14T09:08:03.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0428000000000001e-05 2024-09-14T09:08:03.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:03.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424999+0000", 2024-09-14T09:08:03.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7649999999999996e-06 2024-09-14T09:08:03.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:03.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425051+0000", 2024-09-14T09:08:03.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2234999999999997e-05 2024-09-14T09:08:03.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:03.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425072+0000", 2024-09-14T09:08:03.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0429999999999999e-05 2024-09-14T09:08:03.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:03.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427624+0000", 2024-09-14T09:08:03.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025518250000000002 2024-09-14T09:08:03.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:03.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427661+0000", 2024-09-14T09:08:03.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7635999999999997e-05 2024-09-14T09:08:03.634 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.634 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:03.634 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.635 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1220 3.c e31/22 3:348fce71:::rbd_data.111276489662.0000000000000007:head v 31'18, mlcod=30'15)", 2024-09-14T09:08:03.635 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.426613+0000", 2024-09-14T09:08:03.635 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.1664624750000003, 2024-09-14T09:08:03.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014701790000000001, 2024-09-14T09:08:03.635 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:03.635 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:03.635 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:03.635 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:03.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:03.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426613+0000", 2024-09-14T09:08:03.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:03.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426613+0000", 2024-09-14T09:08:03.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:03.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426614+0000", 2024-09-14T09:08:03.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0800000000000004e-07 2024-09-14T09:08:03.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:03.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426622+0000", 2024-09-14T09:08:03.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7279999999999995e-06 2024-09-14T09:08:03.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:03.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426631+0000", 2024-09-14T09:08:03.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3179999999999996e-06 2024-09-14T09:08:03.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:03.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426636+0000", 2024-09-14T09:08:03.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0130000000000001e-06 2024-09-14T09:08:03.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:03.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426675+0000", 2024-09-14T09:08:03.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8677999999999998e-05 2024-09-14T09:08:03.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:03.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426687+0000", 2024-09-14T09:08:03.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2670000000000001e-05 2024-09-14T09:08:03.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:03.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428046+0000", 2024-09-14T09:08:03.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001358132 2024-09-14T09:08:03.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:03.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428083+0000", 2024-09-14T09:08:03.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7832e-05 2024-09-14T09:08:03.639 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.639 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:03.639 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.639 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1221 3.1e e31/22 3:7d74d199:::rbd_data.111276489662.0000000000000008:head v 31'22, mlcod=30'19)", 2024-09-14T09:08:03.639 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.428334+0000", 2024-09-14T09:08:03.639 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.1647421409999996, 2024-09-14T09:08:03.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020988309999999998, 2024-09-14T09:08:03.640 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:03.640 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:03.640 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:03.640 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:03.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:03.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428334+0000", 2024-09-14T09:08:03.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:03.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428334+0000", 2024-09-14T09:08:03.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:03.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428334+0000", 2024-09-14T09:08:03.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2099999999999996e-07 2024-09-14T09:08:03.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:03.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428339+0000", 2024-09-14T09:08:03.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8369999999999996e-06 2024-09-14T09:08:03.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:03.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428349+0000", 2024-09-14T09:08:03.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9480000000000003e-06 2024-09-14T09:08:03.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:03.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428354+0000", 2024-09-14T09:08:03.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6349999999999997e-06 2024-09-14T09:08:03.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:03.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428395+0000", 2024-09-14T09:08:03.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1566000000000001e-05 2024-09-14T09:08:03.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:03.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428427+0000", 2024-09-14T09:08:03.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1761999999999998e-05 2024-09-14T09:08:03.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:03.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.430398+0000", 2024-09-14T09:08:03.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00197079 2024-09-14T09:08:03.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:03.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.430432+0000", 2024-09-14T09:08:03.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4572e-05 2024-09-14T09:08:03.643 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.643 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:03.643 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.644 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1222 3.6 e31/22 3:62148812:::rbd_data.111276489662.0000000000000009:head v 31'14, mlcod=30'10)", 2024-09-14T09:08:03.644 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.428442+0000", 2024-09-14T09:08:03.644 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.1646336740000001, 2024-09-14T09:08:03.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022360380000000001, 2024-09-14T09:08:03.644 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:03.644 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:03.644 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:03.644 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:03.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:03.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428442+0000", 2024-09-14T09:08:03.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:03.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428442+0000", 2024-09-14T09:08:03.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:03.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428443+0000", 2024-09-14T09:08:03.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8100000000000002e-07 2024-09-14T09:08:03.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:03.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428448+0000", 2024-09-14T09:08:03.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7389999999999996e-06 2024-09-14T09:08:03.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:03.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428459+0000", 2024-09-14T09:08:03.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0098000000000001e-05 2024-09-14T09:08:03.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:03.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428465+0000", 2024-09-14T09:08:03.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4509999999999997e-06 2024-09-14T09:08:03.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:03.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428546+0000", 2024-09-14T09:08:03.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1191000000000002e-05 2024-09-14T09:08:03.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:03.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428566+0000", 2024-09-14T09:08:03.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9939999999999999e-05 2024-09-14T09:08:03.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:03.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.430646+0000", 2024-09-14T09:08:03.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020798050000000001 2024-09-14T09:08:03.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:03.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.430678+0000", 2024-09-14T09:08:03.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2132999999999999e-05 2024-09-14T09:08:03.648 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.648 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:03.648 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.648 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1225 3.19 e31/22 3:982fc283:::rbd_data.111276489662.000000000000000c:head v 31'30, mlcod=31'26)", 2024-09-14T09:08:03.648 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.432647+0000", 2024-09-14T09:08:03.648 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.1604291729999998, 2024-09-14T09:08:03.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003008578, 2024-09-14T09:08:03.648 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:03.648 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:03.649 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:03.649 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:03.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:03.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432647+0000", 2024-09-14T09:08:03.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:03.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432647+0000", 2024-09-14T09:08:03.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:03.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432647+0000", 2024-09-14T09:08:03.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8400000000000005e-07 2024-09-14T09:08:03.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:03.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432651+0000", 2024-09-14T09:08:03.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.092e-06 2024-09-14T09:08:03.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:03.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432659+0000", 2024-09-14T09:08:03.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2770000000000005e-06 2024-09-14T09:08:03.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:03.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432664+0000", 2024-09-14T09:08:03.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.746e-06 2024-09-14T09:08:03.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:03.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432708+0000", 2024-09-14T09:08:03.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3458000000000003e-05 2024-09-14T09:08:03.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:03.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432724+0000", 2024-09-14T09:08:03.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6339999999999999e-05 2024-09-14T09:08:03.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:03.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.435617+0000", 2024-09-14T09:08:03.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028927929999999998 2024-09-14T09:08:03.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:03.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.435655+0000", 2024-09-14T09:08:03.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8387999999999999e-05 2024-09-14T09:08:03.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.652 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:03.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.653 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4617.0:1744 3.5 e34/22 3:a289215f:::rbd_data.11126408a170.0000000000000023:head v 34'101, mlcod=33'99)", 2024-09-14T09:08:03.653 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:59.932121+0000", 2024-09-14T09:08:03.653 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.6609544330000001, 2024-09-14T09:08:03.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001577513, 2024-09-14T09:08:03.653 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:03.653 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:03.653 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:03.653 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:03.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:03.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.932121+0000", 2024-09-14T09:08:03.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:03.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.932121+0000", 2024-09-14T09:08:03.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:03.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.932122+0000", 2024-09-14T09:08:03.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4699999999999998e-07 2024-09-14T09:08:03.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:03.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.932515+0000", 2024-09-14T09:08:03.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00039362499999999999 2024-09-14T09:08:03.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:03.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.932524+0000", 2024-09-14T09:08:03.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8319999999999995e-06 2024-09-14T09:08:03.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:03.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.932529+0000", 2024-09-14T09:08:03.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1309999999999997e-06 2024-09-14T09:08:03.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:03.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.932594+0000", 2024-09-14T09:08:03.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5343000000000001e-05 2024-09-14T09:08:03.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:03.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.932610+0000", 2024-09-14T09:08:03.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5554e-05 2024-09-14T09:08:03.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:03.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.933664+0000", 2024-09-14T09:08:03.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010542380000000001 2024-09-14T09:08:03.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:03.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.933699+0000", 2024-09-14T09:08:03.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4542999999999998e-05 2024-09-14T09:08:03.657 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.657 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:03.657 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.657 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4617.0:1784 3.18 e34/22 3:1c3e1bc5:::rbd_data.11126408a170.0000000000000025:head v 34'21, mlcod=29'19)", 2024-09-14T09:08:03.657 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:59.934667+0000", 2024-09-14T09:08:03.657 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.658409212, 2024-09-14T09:08:03.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001508157, 2024-09-14T09:08:03.658 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:03.658 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:03.658 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:03.658 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:03.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:03.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.934667+0000", 2024-09-14T09:08:03.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:03.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.934667+0000", 2024-09-14T09:08:03.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:03.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.934667+0000", 2024-09-14T09:08:03.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1799999999999999e-07 2024-09-14T09:08:03.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:03.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.934741+0000", 2024-09-14T09:08:03.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4148999999999998e-05 2024-09-14T09:08:03.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:03.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.934753+0000", 2024-09-14T09:08:03.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2601e-05 2024-09-14T09:08:03.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:03.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.934761+0000", 2024-09-14T09:08:03.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2200000000000003e-06 2024-09-14T09:08:03.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:03.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.934808+0000", 2024-09-14T09:08:03.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7670000000000003e-05 2024-09-14T09:08:03.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:03.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.934830+0000", 2024-09-14T09:08:03.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2098000000000001e-05 2024-09-14T09:08:03.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:03.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.936139+0000", 2024-09-14T09:08:03.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001308172 2024-09-14T09:08:03.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:03.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.936175+0000", 2024-09-14T09:08:03.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6028999999999997e-05 2024-09-14T09:08:03.661 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.661 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:03.661 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.662 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4617.0:1785 3.18 e34/22 3:1c3e1bc5:::rbd_data.11126408a170.0000000000000025:head v 34'23, mlcod=29'19)", 2024-09-14T09:08:03.662 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:59.935521+0000", 2024-09-14T09:08:03.662 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.6575547070000001, 2024-09-14T09:08:03.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001064995, 2024-09-14T09:08:03.662 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:03.662 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:03.662 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:03.662 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:03.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:03.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.935521+0000", 2024-09-14T09:08:03.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:03.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.935521+0000", 2024-09-14T09:08:03.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:03.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.935522+0000", 2024-09-14T09:08:03.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3099999999999997e-07 2024-09-14T09:08:03.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:03.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.935529+0000", 2024-09-14T09:08:03.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8329999999999996e-06 2024-09-14T09:08:03.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:03.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.935540+0000", 2024-09-14T09:08:03.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1314e-05 2024-09-14T09:08:03.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:03.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.935547+0000", 2024-09-14T09:08:03.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.114e-06 2024-09-14T09:08:03.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:03.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.935618+0000", 2024-09-14T09:08:03.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1043000000000004e-05 2024-09-14T09:08:03.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:03.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.935641+0000", 2024-09-14T09:08:03.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2685999999999999e-05 2024-09-14T09:08:03.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:03.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.936538+0000", 2024-09-14T09:08:03.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00089718700000000003 2024-09-14T09:08:03.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:03.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.936586+0000", 2024-09-14T09:08:03.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8087000000000002e-05 2024-09-14T09:08:03.666 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.666 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:03.666 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.666 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4617.0:1818 3.9 e34/22 3:92316a3d:::rbd_data.11126408a170.0000000000000027:head v 34'55, mlcod=29'53)", 2024-09-14T09:08:03.666 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:59.936777+0000", 2024-09-14T09:08:03.666 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.6562986340000001, 2024-09-14T09:08:03.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014205380000000001, 2024-09-14T09:08:03.667 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:03.667 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:03.667 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:03.667 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:03.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:03.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.936777+0000", 2024-09-14T09:08:03.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:03.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.936777+0000", 2024-09-14T09:08:03.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:03.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.936778+0000", 2024-09-14T09:08:03.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6799999999999999e-07 2024-09-14T09:08:03.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:03.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.937108+0000", 2024-09-14T09:08:03.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000330052 2024-09-14T09:08:03.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:03.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.937120+0000", 2024-09-14T09:08:03.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1973999999999999e-05 2024-09-14T09:08:03.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:03.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.937128+0000", 2024-09-14T09:08:03.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.106e-06 2024-09-14T09:08:03.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:03.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.937185+0000", 2024-09-14T09:08:03.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6561000000000003e-05 2024-09-14T09:08:03.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:03.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.937200+0000", 2024-09-14T09:08:03.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5e-05 2024-09-14T09:08:03.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:03.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.938149+0000", 2024-09-14T09:08:03.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00094965700000000002 2024-09-14T09:08:03.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:03.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:59.938198+0000", 2024-09-14T09:08:03.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8420000000000001e-05 2024-09-14T09:08:03.670 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.670 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:03.671 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.671 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4644.0:137 3.1b 3:d8181712:::rbd_data.1112386fdc4.0000000000000014:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:03.671 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:00.991729+0000", 2024-09-14T09:08:03.671 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 2.6013467009999998, 2024-09-14T09:08:03.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016133320000000001, 2024-09-14T09:08:03.671 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:03.671 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:03.671 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:03.671 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:03.671 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4644", 2024-09-14T09:08:03.671 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/3036864332", 2024-09-14T09:08:03.671 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137 2024-09-14T09:08:03.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.672 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:03.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:03.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.991729+0000", 2024-09-14T09:08:03.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:03.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.991729+0000", 2024-09-14T09:08:03.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:03.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.991730+0000", 2024-09-14T09:08:03.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.406e-06 2024-09-14T09:08:03.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:03.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.991742+0000", 2024-09-14T09:08:03.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1724e-05 2024-09-14T09:08:03.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:03.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.991755+0000", 2024-09-14T09:08:03.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2859e-05 2024-09-14T09:08:03.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:03.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.991763+0000", 2024-09-14T09:08:03.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5059999999999998e-06 2024-09-14T09:08:03.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:03.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.991812+0000", 2024-09-14T09:08:03.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8999000000000003e-05 2024-09-14T09:08:03.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:03.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.991883+0000", 2024-09-14T09:08:03.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1542e-05 2024-09-14T09:08:03.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:03.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.993342+0000", 2024-09-14T09:08:03.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014592959999999999 2024-09-14T09:08:03.675 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.675 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:03.675 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.675 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4644.0:142 3.1b 3:de924930:::rbd_data.1112386fdc4.000000000000000e:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,truncate 1358848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:03.675 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:00.992575+0000", 2024-09-14T09:08:03.675 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 2.600501167, 2024-09-14T09:08:03.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016522749999999999, 2024-09-14T09:08:03.675 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:03.675 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:03.676 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:03.676 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:03.676 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4644", 2024-09-14T09:08:03.676 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/3036864332", 2024-09-14T09:08:03.676 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 142 2024-09-14T09:08:03.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.676 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:03.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:03.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.992575+0000", 2024-09-14T09:08:03.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:03.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.992575+0000", 2024-09-14T09:08:03.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:03.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.992575+0000", 2024-09-14T09:08:03.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2299999999999999e-07 2024-09-14T09:08:03.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:03.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.992581+0000", 2024-09-14T09:08:03.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.31e-06 2024-09-14T09:08:03.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:03.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.992593+0000", 2024-09-14T09:08:03.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1698999999999999e-05 2024-09-14T09:08:03.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:03.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.992613+0000", 2024-09-14T09:08:03.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0429999999999999e-05 2024-09-14T09:08:03.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:03.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.992670+0000", 2024-09-14T09:08:03.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6946e-05 2024-09-14T09:08:03.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:03.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.992775+0000", 2024-09-14T09:08:03.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105454 2024-09-14T09:08:03.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:03.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.992970+0000", 2024-09-14T09:08:03.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019499799999999999 2024-09-14T09:08:03.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:03.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.994083+0000", 2024-09-14T09:08:03.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0011127680000000001 2024-09-14T09:08:03.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:03.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.994143+0000", 2024-09-14T09:08:03.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0282000000000003e-05 2024-09-14T09:08:03.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:03.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.994191+0000", 2024-09-14T09:08:03.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7392000000000003e-05 2024-09-14T09:08:03.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:03.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.994227+0000", 2024-09-14T09:08:03.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6072999999999998e-05 2024-09-14T09:08:03.681 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.681 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:03.681 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.681 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing(3.9 epoch 34/22 rep_tid 392 entries 34'59 (0'0) error 3:95f00cef:::rbd_data.1112386fdc4.0000000000000018:head by client.4644.0:141 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 34'57)", 2024-09-14T09:08:03.682 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:00.992701+0000", 2024-09-14T09:08:03.682 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 2.6003744960000001, 2024-09-14T09:08:03.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001438946, 2024-09-14T09:08:03.682 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:03.682 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:03.682 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:08:03.682 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:03.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:03.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.992701+0000", 2024-09-14T09:08:03.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:03.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.992701+0000", 2024-09-14T09:08:03.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:03.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:03.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.992702+0000", 2024-09-14T09:08:03.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0699999999999996e-07 2024-09-14T09:08:03.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:03.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.992716+0000", 2024-09-14T09:08:03.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3689000000000001e-05 2024-09-14T09:08:03.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:03.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.992749+0000", 2024-09-14T09:08:03.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3402999999999999e-05 2024-09-14T09:08:03.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:03.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.992766+0000", 2024-09-14T09:08:03.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7158000000000001e-05 2024-09-14T09:08:03.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:03.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.992851+0000", 2024-09-14T09:08:03.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5067000000000004e-05 2024-09-14T09:08:03.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:03.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:03.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:03.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:00.994140+0000", 2024-09-14T09:08:03.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0012889220000000001 2024-09-14T09:08:03.685 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.685 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:03.685 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.685 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:03.685 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:03.685 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:03.687 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:08:03.687 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:03.688+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:03.787 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:03.789+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:03.788 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:03.788 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:03.788 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:03.789 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:03.796 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:08:03.811 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T09:08:03.885 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone8 from 0x45f7000 (overlap 0x11cd600) to 0x8e6a00 2024-09-14T09:08:03.888 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:03.890+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:03.911 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:03.912 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:03.921 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:08:03.988 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:03.991+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:04.031 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:04.031 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:04.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:04.031 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:04.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.031 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:669 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:04.031 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862212+0000", 2024-09-14T09:08:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1703707600000008, 2024-09-14T09:08:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0073209269999999996, 2024-09-14T09:08:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 669 2024-09-14T09:08:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862212+0000", 2024-09-14T09:08:04.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862212+0000", 2024-09-14T09:08:04.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862212+0000", 2024-09-14T09:08:04.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7999999999999995e-07 2024-09-14T09:08:04.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862214+0000", 2024-09-14T09:08:04.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.26e-06 2024-09-14T09:08:04.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862221+0000", 2024-09-14T09:08:04.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6270000000000002e-06 2024-09-14T09:08:04.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862226+0000", 2024-09-14T09:08:04.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0989999999999998e-06 2024-09-14T09:08:04.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869365+0000", 2024-09-14T09:08:04.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0071387109999999998 2024-09-14T09:08:04.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869434+0000", 2024-09-14T09:08:04.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9441000000000001e-05 2024-09-14T09:08:04.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869532+0000", 2024-09-14T09:08:04.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8109000000000005e-05 2024-09-14T09:08:04.036 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.037 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.037 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.037 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:683 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 2621440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:04.037 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862256+0000", 2024-09-14T09:08:04.037 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1703263740000001, 2024-09-14T09:08:04.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074734199999999997, 2024-09-14T09:08:04.037 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.037 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.037 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:04.037 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.037 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.038 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.038 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 683 2024-09-14T09:08:04.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.038 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862256+0000", 2024-09-14T09:08:04.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862256+0000", 2024-09-14T09:08:04.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862256+0000", 2024-09-14T09:08:04.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3599999999999999e-07 2024-09-14T09:08:04.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862258+0000", 2024-09-14T09:08:04.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8610000000000001e-06 2024-09-14T09:08:04.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862264+0000", 2024-09-14T09:08:04.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0959999999999997e-06 2024-09-14T09:08:04.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862269+0000", 2024-09-14T09:08:04.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5850000000000001e-06 2024-09-14T09:08:04.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869554+0000", 2024-09-14T09:08:04.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0072851410000000002 2024-09-14T09:08:04.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869629+0000", 2024-09-14T09:08:04.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4537999999999997e-05 2024-09-14T09:08:04.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869729+0000", 2024-09-14T09:08:04.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100763 2024-09-14T09:08:04.042 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.042 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.042 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.042 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:684 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 4063232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:04.042 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862276+0000", 2024-09-14T09:08:04.042 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1703063510000007, 2024-09-14T09:08:04.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076148459999999998, 2024-09-14T09:08:04.042 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.042 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.042 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:04.043 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.043 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.043 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.043 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 684 2024-09-14T09:08:04.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.043 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862276+0000", 2024-09-14T09:08:04.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862276+0000", 2024-09-14T09:08:04.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862277+0000", 2024-09-14T09:08:04.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9599999999999999e-07 2024-09-14T09:08:04.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862278+0000", 2024-09-14T09:08:04.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.858e-06 2024-09-14T09:08:04.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862285+0000", 2024-09-14T09:08:04.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1800000000000001e-06 2024-09-14T09:08:04.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862289+0000", 2024-09-14T09:08:04.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8890000000000001e-06 2024-09-14T09:08:04.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869764+0000", 2024-09-14T09:08:04.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074748949999999996 2024-09-14T09:08:04.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869817+0000", 2024-09-14T09:08:04.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2132999999999997e-05 2024-09-14T09:08:04.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869891+0000", 2024-09-14T09:08:04.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4295000000000006e-05 2024-09-14T09:08:04.047 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.047 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.047 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.047 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:685 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 5505024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:04.047 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862311+0000", 2024-09-14T09:08:04.047 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.170271584, 2024-09-14T09:08:04.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0078557420000000006, 2024-09-14T09:08:04.048 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.048 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.048 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:04.048 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.048 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.048 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.048 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 685 2024-09-14T09:08:04.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.048 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862311+0000", 2024-09-14T09:08:04.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862311+0000", 2024-09-14T09:08:04.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862311+0000", 2024-09-14T09:08:04.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5000000000000002e-07 2024-09-14T09:08:04.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862314+0000", 2024-09-14T09:08:04.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.165e-06 2024-09-14T09:08:04.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862320+0000", 2024-09-14T09:08:04.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5699999999999998e-06 2024-09-14T09:08:04.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862326+0000", 2024-09-14T09:08:04.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0549999999999996e-06 2024-09-14T09:08:04.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869941+0000", 2024-09-14T09:08:04.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.007614829 2024-09-14T09:08:04.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870020+0000", 2024-09-14T09:08:04.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8563e-05 2024-09-14T09:08:04.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870166+0000", 2024-09-14T09:08:04.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014690999999999999 2024-09-14T09:08:04.051 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.051 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.052 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.052 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:706 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:04.052 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862467+0000", 2024-09-14T09:08:04.052 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.170115676, 2024-09-14T09:08:04.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0075686479999999999, 2024-09-14T09:08:04.052 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.052 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.052 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:04.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.052 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 706 2024-09-14T09:08:04.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.053 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862467+0000", 2024-09-14T09:08:04.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862467+0000", 2024-09-14T09:08:04.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862467+0000", 2024-09-14T09:08:04.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4499999999999997e-07 2024-09-14T09:08:04.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862470+0000", 2024-09-14T09:08:04.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3130000000000001e-06 2024-09-14T09:08:04.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862477+0000", 2024-09-14T09:08:04.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9240000000000001e-06 2024-09-14T09:08:04.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862482+0000", 2024-09-14T09:08:04.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0039999999999999e-06 2024-09-14T09:08:04.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869922+0000", 2024-09-14T09:08:04.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074403009999999999 2024-09-14T09:08:04.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869982+0000", 2024-09-14T09:08:04.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9746e-05 2024-09-14T09:08:04.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870035+0000", 2024-09-14T09:08:04.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3715000000000003e-05 2024-09-14T09:08:04.056 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.056 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.056 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.057 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:707 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 2752512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:04.057 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862490+0000", 2024-09-14T09:08:04.057 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1700925299999998, 2024-09-14T09:08:04.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076711289999999996, 2024-09-14T09:08:04.057 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.057 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.057 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:04.057 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.057 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.057 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.057 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 707 2024-09-14T09:08:04.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.057 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862490+0000", 2024-09-14T09:08:04.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862490+0000", 2024-09-14T09:08:04.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862490+0000", 2024-09-14T09:08:04.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3300000000000003e-07 2024-09-14T09:08:04.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862492+0000", 2024-09-14T09:08:04.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.996e-06 2024-09-14T09:08:04.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862499+0000", 2024-09-14T09:08:04.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.776e-06 2024-09-14T09:08:04.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862504+0000", 2024-09-14T09:08:04.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8670000000000002e-06 2024-09-14T09:08:04.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870051+0000", 2024-09-14T09:08:04.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0075471089999999998 2024-09-14T09:08:04.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870104+0000", 2024-09-14T09:08:04.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3439000000000001e-05 2024-09-14T09:08:04.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870161+0000", 2024-09-14T09:08:04.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6508999999999997e-05 2024-09-14T09:08:04.061 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.061 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.061 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.061 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:708 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:04.061 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862512+0000", 2024-09-14T09:08:04.061 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1700701500000008, 2024-09-14T09:08:04.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0078051250000000004, 2024-09-14T09:08:04.061 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.061 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.061 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:04.062 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.062 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.062 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.062 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 708 2024-09-14T09:08:04.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.062 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862512+0000", 2024-09-14T09:08:04.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862512+0000", 2024-09-14T09:08:04.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862513+0000", 2024-09-14T09:08:04.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1300000000000001e-07 2024-09-14T09:08:04.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862515+0000", 2024-09-14T09:08:04.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.922e-06 2024-09-14T09:08:04.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862521+0000", 2024-09-14T09:08:04.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3160000000000002e-06 2024-09-14T09:08:04.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862526+0000", 2024-09-14T09:08:04.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0209999999999999e-06 2024-09-14T09:08:04.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870177+0000", 2024-09-14T09:08:04.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076510720000000001 2024-09-14T09:08:04.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870244+0000", 2024-09-14T09:08:04.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6613999999999996e-05 2024-09-14T09:08:04.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870317+0000", 2024-09-14T09:08:04.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3767e-05 2024-09-14T09:08:04.066 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.066 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.066 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.066 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:709 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 5636096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:04.066 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862547+0000", 2024-09-14T09:08:04.066 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1700351589999993, 2024-09-14T09:08:04.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080137230000000004, 2024-09-14T09:08:04.066 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.066 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.066 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:04.066 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.066 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.067 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.067 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 709 2024-09-14T09:08:04.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.067 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862547+0000", 2024-09-14T09:08:04.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862547+0000", 2024-09-14T09:08:04.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862548+0000", 2024-09-14T09:08:04.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3200000000000005e-07 2024-09-14T09:08:04.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862550+0000", 2024-09-14T09:08:04.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0650000000000001e-06 2024-09-14T09:08:04.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862557+0000", 2024-09-14T09:08:04.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8170000000000001e-06 2024-09-14T09:08:04.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862561+0000", 2024-09-14T09:08:04.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7090000000000001e-06 2024-09-14T09:08:04.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870358+0000", 2024-09-14T09:08:04.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0077970690000000002 2024-09-14T09:08:04.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870437+0000", 2024-09-14T09:08:04.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8059999999999995e-05 2024-09-14T09:08:04.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870561+0000", 2024-09-14T09:08:04.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012437099999999999 2024-09-14T09:08:04.070 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.070 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.070 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.070 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:722 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:04.071 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862576+0000", 2024-09-14T09:08:04.071 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1700066160000002, 2024-09-14T09:08:04.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0078555269999999993, 2024-09-14T09:08:04.071 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.071 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.071 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:04.071 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.071 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.071 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.071 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 722 2024-09-14T09:08:04.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.071 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862576+0000", 2024-09-14T09:08:04.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862576+0000", 2024-09-14T09:08:04.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862576+0000", 2024-09-14T09:08:04.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3399999999999999e-07 2024-09-14T09:08:04.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862579+0000", 2024-09-14T09:08:04.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4159999999999998e-06 2024-09-14T09:08:04.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862586+0000", 2024-09-14T09:08:04.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9500000000000004e-06 2024-09-14T09:08:04.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862591+0000", 2024-09-14T09:08:04.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2480000000000004e-06 2024-09-14T09:08:04.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870335+0000", 2024-09-14T09:08:04.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0077443319999999996 2024-09-14T09:08:04.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870379+0000", 2024-09-14T09:08:04.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4092999999999999e-05 2024-09-14T09:08:04.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870431+0000", 2024-09-14T09:08:04.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1953999999999998e-05 2024-09-14T09:08:04.075 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.075 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.075 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.075 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:723 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 2686976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:04.075 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862598+0000", 2024-09-14T09:08:04.075 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1699840659999996, 2024-09-14T09:08:04.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079559650000000006, 2024-09-14T09:08:04.075 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.075 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 723 2024-09-14T09:08:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862598+0000", 2024-09-14T09:08:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862598+0000", 2024-09-14T09:08:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862599+0000", 2024-09-14T09:08:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2024-09-14T09:08:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862601+0000", 2024-09-14T09:08:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0789999999999999e-06 2024-09-14T09:08:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862607+0000", 2024-09-14T09:08:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.365e-06 2024-09-14T09:08:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862618+0000", 2024-09-14T09:08:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1214e-05 2024-09-14T09:08:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870446+0000", 2024-09-14T09:08:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0078275419999999998 2024-09-14T09:08:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870491+0000", 2024-09-14T09:08:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4901000000000003e-05 2024-09-14T09:08:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870554+0000", 2024-09-14T09:08:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3417999999999995e-05 2024-09-14T09:08:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:724 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862626+0000", 2024-09-14T09:08:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1699566160000003, 2024-09-14T09:08:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0081322540000000002, 2024-09-14T09:08:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 724 2024-09-14T09:08:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862626+0000", 2024-09-14T09:08:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862626+0000", 2024-09-14T09:08:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862626+0000", 2024-09-14T09:08:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5799999999999999e-07 2024-09-14T09:08:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862628+0000", 2024-09-14T09:08:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1459999999999999e-06 2024-09-14T09:08:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862635+0000", 2024-09-14T09:08:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3330000000000002e-06 2024-09-14T09:08:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862640+0000", 2024-09-14T09:08:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5480000000000001e-06 2024-09-14T09:08:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870580+0000", 2024-09-14T09:08:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079394909999999999 2024-09-14T09:08:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870649+0000", 2024-09-14T09:08:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8748e-05 2024-09-14T09:08:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870758+0000", 2024-09-14T09:08:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010943 2024-09-14T09:08:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:725 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 5636096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862648+0000", 2024-09-14T09:08:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.169934713, 2024-09-14T09:08:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0083906950000000001, 2024-09-14T09:08:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 725 2024-09-14T09:08:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862648+0000", 2024-09-14T09:08:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862648+0000", 2024-09-14T09:08:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862648+0000", 2024-09-14T09:08:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1099999999999995e-07 2024-09-14T09:08:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862650+0000", 2024-09-14T09:08:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0880000000000002e-06 2024-09-14T09:08:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862656+0000", 2024-09-14T09:08:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9850000000000003e-06 2024-09-14T09:08:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862661+0000", 2024-09-14T09:08:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.775e-06 2024-09-14T09:08:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870815+0000", 2024-09-14T09:08:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0081533850000000008 2024-09-14T09:08:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870897+0000", 2024-09-14T09:08:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2235000000000001e-05 2024-09-14T09:08:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871038+0000", 2024-09-14T09:08:04.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014151600000000001 2024-09-14T09:08:04.089 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.089 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.089 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.089 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:746 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 1376256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:04.089 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862897+0000", 2024-09-14T09:08:04.089 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1696853820000008, 2024-09-14T09:08:04.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080739269999999998, 2024-09-14T09:08:04.089 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.090 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.090 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:04.090 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.090 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.090 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.090 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 746 2024-09-14T09:08:04.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.090 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862897+0000", 2024-09-14T09:08:04.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862897+0000", 2024-09-14T09:08:04.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862898+0000", 2024-09-14T09:08:04.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8100000000000003e-07 2024-09-14T09:08:04.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862901+0000", 2024-09-14T09:08:04.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5080000000000001e-06 2024-09-14T09:08:04.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862909+0000", 2024-09-14T09:08:04.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1610000000000003e-06 2024-09-14T09:08:04.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862914+0000", 2024-09-14T09:08:04.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6689999999999997e-06 2024-09-14T09:08:04.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870788+0000", 2024-09-14T09:08:04.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0078740319999999996 2024-09-14T09:08:04.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870870+0000", 2024-09-14T09:08:04.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2169000000000006e-05 2024-09-14T09:08:04.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870971+0000", 2024-09-14T09:08:04.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100807 2024-09-14T09:08:04.093 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.094 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.094 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.094 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:747 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 2818048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:04.094 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862922+0000", 2024-09-14T09:08:04.094 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1696608180000005, 2024-09-14T09:08:04.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082517779999999995, 2024-09-14T09:08:04.094 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.094 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.094 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:04.094 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.094 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.095 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.095 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 747 2024-09-14T09:08:04.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.095 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862922+0000", 2024-09-14T09:08:04.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862922+0000", 2024-09-14T09:08:04.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862922+0000", 2024-09-14T09:08:04.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.51e-07 2024-09-14T09:08:04.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862924+0000", 2024-09-14T09:08:04.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-06 2024-09-14T09:08:04.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862933+0000", 2024-09-14T09:08:04.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6039999999999993e-06 2024-09-14T09:08:04.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862938+0000", 2024-09-14T09:08:04.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0180000000000001e-06 2024-09-14T09:08:04.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870996+0000", 2024-09-14T09:08:04.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080584820000000005 2024-09-14T09:08:04.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871073+0000", 2024-09-14T09:08:04.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6641e-05 2024-09-14T09:08:04.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871173+0000", 2024-09-14T09:08:04.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100462 2024-09-14T09:08:04.098 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.098 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.098 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.098 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:748 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 4325376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:04.098 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862945+0000", 2024-09-14T09:08:04.098 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1696368429999993, 2024-09-14T09:08:04.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084586330000000001, 2024-09-14T09:08:04.099 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.099 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.099 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:04.099 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.099 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.099 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.099 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 748 2024-09-14T09:08:04.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.099 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862945+0000", 2024-09-14T09:08:04.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862945+0000", 2024-09-14T09:08:04.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862946+0000", 2024-09-14T09:08:04.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6499999999999999e-07 2024-09-14T09:08:04.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862948+0000", 2024-09-14T09:08:04.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0269999999999998e-06 2024-09-14T09:08:04.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862954+0000", 2024-09-14T09:08:04.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3049999999999998e-06 2024-09-14T09:08:04.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862966+0000", 2024-09-14T09:08:04.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1773999999999999e-05 2024-09-14T09:08:04.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871217+0000", 2024-09-14T09:08:04.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082510350000000003 2024-09-14T09:08:04.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871302+0000", 2024-09-14T09:08:04.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4940999999999999e-05 2024-09-14T09:08:04.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871404+0000", 2024-09-14T09:08:04.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102086 2024-09-14T09:08:04.102 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.103 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.103 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.103 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:749 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:04.103 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862974+0000", 2024-09-14T09:08:04.103 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1696084720000002, 2024-09-14T09:08:04.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0086102100000000001, 2024-09-14T09:08:04.103 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.103 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.103 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:04.103 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.103 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.103 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.103 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 749 2024-09-14T09:08:04.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.104 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862974+0000", 2024-09-14T09:08:04.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862974+0000", 2024-09-14T09:08:04.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862974+0000", 2024-09-14T09:08:04.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9500000000000002e-07 2024-09-14T09:08:04.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862977+0000", 2024-09-14T09:08:04.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2699999999999999e-06 2024-09-14T09:08:04.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862984+0000", 2024-09-14T09:08:04.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7489999999999998e-06 2024-09-14T09:08:04.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862989+0000", 2024-09-14T09:08:04.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9490000000000004e-06 2024-09-14T09:08:04.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871452+0000", 2024-09-14T09:08:04.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084624399999999999 2024-09-14T09:08:04.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871525+0000", 2024-09-14T09:08:04.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3413999999999999e-05 2024-09-14T09:08:04.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871584+0000", 2024-09-14T09:08:04.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8792999999999998e-05 2024-09-14T09:08:04.107 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.107 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.107 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.107 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:762 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:04.107 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.863007+0000", 2024-09-14T09:08:04.107 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1695749630000005, 2024-09-14T09:08:04.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0086029390000000004, 2024-09-14T09:08:04.108 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.108 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.108 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:04.108 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.108 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.108 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.108 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 762 2024-09-14T09:08:04.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.108 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863007+0000", 2024-09-14T09:08:04.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863007+0000", 2024-09-14T09:08:04.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863008+0000", 2024-09-14T09:08:04.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6599999999999996e-07 2024-09-14T09:08:04.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863011+0000", 2024-09-14T09:08:04.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7030000000000002e-06 2024-09-14T09:08:04.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863018+0000", 2024-09-14T09:08:04.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9569999999999996e-06 2024-09-14T09:08:04.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863030+0000", 2024-09-14T09:08:04.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2415000000000001e-05 2024-09-14T09:08:04.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871436+0000", 2024-09-14T09:08:04.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084056819999999994 2024-09-14T09:08:04.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871510+0000", 2024-09-14T09:08:04.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3997000000000003e-05 2024-09-14T09:08:04.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871610+0000", 2024-09-14T09:08:04.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100519 2024-09-14T09:08:04.111 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.111 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.112 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.112 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:763 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 2818048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:04.112 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.863039+0000", 2024-09-14T09:08:04.112 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1695433170000005, 2024-09-14T09:08:04.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087689180000000005, 2024-09-14T09:08:04.112 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.112 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.112 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:04.112 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.112 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.112 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.112 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 763 2024-09-14T09:08:04.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.113 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863039+0000", 2024-09-14T09:08:04.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863039+0000", 2024-09-14T09:08:04.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863040+0000", 2024-09-14T09:08:04.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8800000000000002e-07 2024-09-14T09:08:04.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863042+0000", 2024-09-14T09:08:04.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.351e-06 2024-09-14T09:08:04.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863049+0000", 2024-09-14T09:08:04.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7499999999999997e-06 2024-09-14T09:08:04.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863057+0000", 2024-09-14T09:08:04.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9999999999999996e-06 2024-09-14T09:08:04.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871629+0000", 2024-09-14T09:08:04.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0085725560000000003 2024-09-14T09:08:04.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871702+0000", 2024-09-14T09:08:04.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2677999999999998e-05 2024-09-14T09:08:04.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871808+0000", 2024-09-14T09:08:04.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105995 2024-09-14T09:08:04.116 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.116 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.116 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.117 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:764 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 4259840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:04.117 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.863071+0000", 2024-09-14T09:08:04.117 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.169510893, 2024-09-14T09:08:04.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0089758600000000004, 2024-09-14T09:08:04.117 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.117 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.117 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:04.117 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.117 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.117 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.117 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 764 2024-09-14T09:08:04.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.118 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863071+0000", 2024-09-14T09:08:04.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863071+0000", 2024-09-14T09:08:04.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863072+0000", 2024-09-14T09:08:04.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7400000000000003e-07 2024-09-14T09:08:04.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863074+0000", 2024-09-14T09:08:04.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4530000000000001e-06 2024-09-14T09:08:04.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863081+0000", 2024-09-14T09:08:04.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.776e-06 2024-09-14T09:08:04.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863087+0000", 2024-09-14T09:08:04.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7409999999999998e-06 2024-09-14T09:08:04.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871853+0000", 2024-09-14T09:08:04.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087656309999999994 2024-09-14T09:08:04.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871938+0000", 2024-09-14T09:08:04.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5846000000000004e-05 2024-09-14T09:08:04.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872047+0000", 2024-09-14T09:08:04.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010883900000000001 2024-09-14T09:08:04.121 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.121 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.121 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.121 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:765 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:04.121 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.863094+0000", 2024-09-14T09:08:04.121 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1694880029999997, 2024-09-14T09:08:04.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0091722320000000006, 2024-09-14T09:08:04.121 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.121 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.122 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:04.122 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.122 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.122 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.122 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 765 2024-09-14T09:08:04.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.122 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863094+0000", 2024-09-14T09:08:04.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863094+0000", 2024-09-14T09:08:04.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863095+0000", 2024-09-14T09:08:04.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3799999999999997e-07 2024-09-14T09:08:04.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863097+0000", 2024-09-14T09:08:04.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.996e-06 2024-09-14T09:08:04.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863103+0000", 2024-09-14T09:08:04.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.443e-06 2024-09-14T09:08:04.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863110+0000", 2024-09-14T09:08:04.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6479999999999997e-06 2024-09-14T09:08:04.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872117+0000", 2024-09-14T09:08:04.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0090066590000000002 2024-09-14T09:08:04.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872183+0000", 2024-09-14T09:08:04.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6200999999999999e-05 2024-09-14T09:08:04.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872267+0000", 2024-09-14T09:08:04.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3746999999999996e-05 2024-09-14T09:08:04.125 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.125 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.125 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.125 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.125 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.125 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:04.127 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:08:04.128 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:04.128+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:04.227 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:04.229+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:04.244 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #7, image image_client.0-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent8 2024-09-14T09:08:04.271 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:04.272 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:04.272 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:04.272 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:04.280 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:08:04.366 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:04.368+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:04.423 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:04.423 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:04.423 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:04.423 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:04.423 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:04.429 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:04.432+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:04.431 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:08:04.531 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:04.533+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:04.580 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:04.580 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:04.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:04.581 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:04.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.581 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:41 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'19)", 2024-09-14T09:08:04.581 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.154530+0000", 2024-09-14T09:08:04.581 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 33.426533053, 2024-09-14T09:08:04.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097193060000000005, 2024-09-14T09:08:04.581 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.581 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.582 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:04.582 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154530+0000", 2024-09-14T09:08:04.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154530+0000", 2024-09-14T09:08:04.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154531+0000", 2024-09-14T09:08:04.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6199999999999997e-07 2024-09-14T09:08:04.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154567+0000", 2024-09-14T09:08:04.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5988000000000002e-05 2024-09-14T09:08:04.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154577+0000", 2024-09-14T09:08:04.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0366999999999999e-05 2024-09-14T09:08:04.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154583+0000", 2024-09-14T09:08:04.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3929999999999996e-06 2024-09-14T09:08:04.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154630+0000", 2024-09-14T09:08:04.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6980000000000001e-05 2024-09-14T09:08:04.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154650+0000", 2024-09-14T09:08:04.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9817999999999999e-05 2024-09-14T09:08:04.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:04.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164200+0000", 2024-09-14T09:08:04.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0095500770000000006 2024-09-14T09:08:04.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164249+0000", 2024-09-14T09:08:04.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9020999999999997e-05 2024-09-14T09:08:04.587 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.587 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.587 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.588 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:42 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'24, mlcod=15'19)", 2024-09-14T09:08:04.588 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:08:04.588 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 33.425957629999999, 2024-09-14T09:08:04.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0091673220000000003, 2024-09-14T09:08:04.588 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.588 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.588 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:04.589 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:08:04.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:08:04.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:08:04.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5000000000000001e-07 2024-09-14T09:08:04.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155113+0000", 2024-09-14T09:08:04.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8719999999999996e-06 2024-09-14T09:08:04.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155126+0000", 2024-09-14T09:08:04.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2951e-05 2024-09-14T09:08:04.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155132+0000", 2024-09-14T09:08:04.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9270000000000002e-06 2024-09-14T09:08:04.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158468+0000", 2024-09-14T09:08:04.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033357980000000001 2024-09-14T09:08:04.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158510+0000", 2024-09-14T09:08:04.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2138999999999998e-05 2024-09-14T09:08:04.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:04.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164251+0000", 2024-09-14T09:08:04.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0057413209999999998 2024-09-14T09:08:04.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164273+0000", 2024-09-14T09:08:04.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1364000000000001e-05 2024-09-14T09:08:04.593 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.593 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.593 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.593 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:43 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'25, mlcod=15'19)", 2024-09-14T09:08:04.593 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.155476+0000", 2024-09-14T09:08:04.593 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 33.425586942000002, 2024-09-14T09:08:04.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0092500399999999993, 2024-09-14T09:08:04.593 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.593 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.594 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:04.594 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155476+0000", 2024-09-14T09:08:04.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155476+0000", 2024-09-14T09:08:04.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155477+0000", 2024-09-14T09:08:04.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5300000000000002e-07 2024-09-14T09:08:04.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155486+0000", 2024-09-14T09:08:04.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2024-09-14T09:08:04.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155498+0000", 2024-09-14T09:08:04.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2911999999999999e-05 2024-09-14T09:08:04.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155506+0000", 2024-09-14T09:08:04.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3390000000000004e-06 2024-09-14T09:08:04.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158814+0000", 2024-09-14T09:08:04.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033078309999999998 2024-09-14T09:08:04.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158849+0000", 2024-09-14T09:08:04.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5330000000000002e-05 2024-09-14T09:08:04.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:04.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164691+0000", 2024-09-14T09:08:04.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005842346 2024-09-14T09:08:04.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164726+0000", 2024-09-14T09:08:04.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4978999999999998e-05 2024-09-14T09:08:04.600 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.600 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.600 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.600 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:44 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'26, mlcod=15'19)", 2024-09-14T09:08:04.600 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.155917+0000", 2024-09-14T09:08:04.600 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 33.425146425000001, 2024-09-14T09:08:04.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0088430230000000002, 2024-09-14T09:08:04.600 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.601 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.601 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:04.601 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155917+0000", 2024-09-14T09:08:04.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155917+0000", 2024-09-14T09:08:04.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155918+0000", 2024-09-14T09:08:04.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0359999999999999e-06 2024-09-14T09:08:04.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155951+0000", 2024-09-14T09:08:04.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3256999999999997e-05 2024-09-14T09:08:04.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155965+0000", 2024-09-14T09:08:04.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3692e-05 2024-09-14T09:08:04.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155971+0000", 2024-09-14T09:08:04.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0510000000000002e-06 2024-09-14T09:08:04.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159107+0000", 2024-09-14T09:08:04.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031363430000000002 2024-09-14T09:08:04.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159127+0000", 2024-09-14T09:08:04.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0268999999999999e-05 2024-09-14T09:08:04.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:04.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164728+0000", 2024-09-14T09:08:04.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056003629999999997 2024-09-14T09:08:04.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164760+0000", 2024-09-14T09:08:04.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2011999999999998e-05 2024-09-14T09:08:04.605 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.605 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.605 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.605 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:45 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'27, mlcod=15'19)", 2024-09-14T09:08:04.605 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.156503+0000", 2024-09-14T09:08:04.605 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 33.424559737000003, 2024-09-14T09:08:04.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082756970000000003, 2024-09-14T09:08:04.605 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.605 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.605 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:04.605 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156503+0000", 2024-09-14T09:08:04.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156503+0000", 2024-09-14T09:08:04.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156505+0000", 2024-09-14T09:08:04.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8139999999999999e-06 2024-09-14T09:08:04.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156516+0000", 2024-09-14T09:08:04.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1019000000000001e-05 2024-09-14T09:08:04.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156543+0000", 2024-09-14T09:08:04.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.692e-05 2024-09-14T09:08:04.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156556+0000", 2024-09-14T09:08:04.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3063e-05 2024-09-14T09:08:04.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159573+0000", 2024-09-14T09:08:04.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003016712 2024-09-14T09:08:04.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159589+0000", 2024-09-14T09:08:04.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6494000000000002e-05 2024-09-14T09:08:04.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:04.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164762+0000", 2024-09-14T09:08:04.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051722519999999996 2024-09-14T09:08:04.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164779+0000", 2024-09-14T09:08:04.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7422999999999999e-05 2024-09-14T09:08:04.609 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.609 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.609 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.610 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:46 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'28, mlcod=15'19)", 2024-09-14T09:08:04.610 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.156804+0000", 2024-09-14T09:08:04.610 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 33.424258647999999, 2024-09-14T09:08:04.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079926879999999995, 2024-09-14T09:08:04.610 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.610 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.610 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:04.610 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156804+0000", 2024-09-14T09:08:04.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156804+0000", 2024-09-14T09:08:04.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156805+0000", 2024-09-14T09:08:04.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3099999999999998e-07 2024-09-14T09:08:04.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156809+0000", 2024-09-14T09:08:04.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8299999999999998e-06 2024-09-14T09:08:04.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156817+0000", 2024-09-14T09:08:04.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7579999999999992e-06 2024-09-14T09:08:04.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156831+0000", 2024-09-14T09:08:04.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4256999999999999e-05 2024-09-14T09:08:04.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159903+0000", 2024-09-14T09:08:04.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030721590000000001 2024-09-14T09:08:04.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159922+0000", 2024-09-14T09:08:04.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8994000000000001e-05 2024-09-14T09:08:04.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:04.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164780+0000", 2024-09-14T09:08:04.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048582879999999997 2024-09-14T09:08:04.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164797+0000", 2024-09-14T09:08:04.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6971000000000001e-05 2024-09-14T09:08:04.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.614 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.614 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:47 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'29, mlcod=15'19)", 2024-09-14T09:08:04.614 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.157344+0000", 2024-09-14T09:08:04.614 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 33.423719439999999, 2024-09-14T09:08:04.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074729030000000004, 2024-09-14T09:08:04.614 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.614 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.615 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:04.615 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157344+0000", 2024-09-14T09:08:04.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157344+0000", 2024-09-14T09:08:04.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157346+0000", 2024-09-14T09:08:04.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.81e-06 2024-09-14T09:08:04.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157406+0000", 2024-09-14T09:08:04.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0523000000000003e-05 2024-09-14T09:08:04.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157434+0000", 2024-09-14T09:08:04.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8059999999999999e-05 2024-09-14T09:08:04.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157447+0000", 2024-09-14T09:08:04.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2666e-05 2024-09-14T09:08:04.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160183+0000", 2024-09-14T09:08:04.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002736413 2024-09-14T09:08:04.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160203+0000", 2024-09-14T09:08:04.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9545e-05 2024-09-14T09:08:04.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:04.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164798+0000", 2024-09-14T09:08:04.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045953890000000001 2024-09-14T09:08:04.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164817+0000", 2024-09-14T09:08:04.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8496999999999999e-05 2024-09-14T09:08:04.618 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.618 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.619 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.619 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:48 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'30, mlcod=15'19)", 2024-09-14T09:08:04.619 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.157693+0000", 2024-09-14T09:08:04.619 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 33.423370175000002, 2024-09-14T09:08:04.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0071445789999999999, 2024-09-14T09:08:04.619 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.619 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.619 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:04.619 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157693+0000", 2024-09-14T09:08:04.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157693+0000", 2024-09-14T09:08:04.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157694+0000", 2024-09-14T09:08:04.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2024-09-14T09:08:04.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157701+0000", 2024-09-14T09:08:04.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0230000000000004e-06 2024-09-14T09:08:04.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157709+0000", 2024-09-14T09:08:04.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7819999999999999e-06 2024-09-14T09:08:04.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157714+0000", 2024-09-14T09:08:04.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2440000000000004e-06 2024-09-14T09:08:04.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160598+0000", 2024-09-14T09:08:04.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028844280000000001 2024-09-14T09:08:04.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160618+0000", 2024-09-14T09:08:04.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0435e-05 2024-09-14T09:08:04.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:04.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164818+0000", 2024-09-14T09:08:04.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042000329999999997 2024-09-14T09:08:04.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164838+0000", 2024-09-14T09:08:04.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9054000000000001e-05 2024-09-14T09:08:04.623 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.623 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.623 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.623 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:49 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'31, mlcod=15'19)", 2024-09-14T09:08:04.623 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.158173+0000", 2024-09-14T09:08:04.623 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 33.422890512000002, 2024-09-14T09:08:04.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0066833700000000001, 2024-09-14T09:08:04.624 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.624 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.624 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:04.624 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158173+0000", 2024-09-14T09:08:04.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158173+0000", 2024-09-14T09:08:04.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158175+0000", 2024-09-14T09:08:04.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8840000000000001e-06 2024-09-14T09:08:04.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158188+0000", 2024-09-14T09:08:04.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3842999999999999e-05 2024-09-14T09:08:04.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158225+0000", 2024-09-14T09:08:04.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7039000000000002e-05 2024-09-14T09:08:04.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158243+0000", 2024-09-14T09:08:04.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7932999999999999e-05 2024-09-14T09:08:04.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160875+0000", 2024-09-14T09:08:04.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002632045 2024-09-14T09:08:04.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160887+0000", 2024-09-14T09:08:04.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2084e-05 2024-09-14T09:08:04.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:04.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164839+0000", 2024-09-14T09:08:04.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039511390000000002 2024-09-14T09:08:04.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164856+0000", 2024-09-14T09:08:04.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7402999999999999e-05 2024-09-14T09:08:04.627 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.627 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.628 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.628 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:66 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'44, mlcod=15'40)", 2024-09-14T09:08:04.628 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.430075+0000", 2024-09-14T09:08:04.628 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 33.150988325999997, 2024-09-14T09:08:04.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070127770000000004, 2024-09-14T09:08:04.628 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.628 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.628 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:04.628 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430075+0000", 2024-09-14T09:08:04.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430075+0000", 2024-09-14T09:08:04.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430076+0000", 2024-09-14T09:08:04.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4200000000000005e-07 2024-09-14T09:08:04.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430131+0000", 2024-09-14T09:08:04.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099000000000002e-05 2024-09-14T09:08:04.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430141+0000", 2024-09-14T09:08:04.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.978e-06 2024-09-14T09:08:04.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430145+0000", 2024-09-14T09:08:04.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4519999999999999e-06 2024-09-14T09:08:04.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430189+0000", 2024-09-14T09:08:04.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3924000000000002e-05 2024-09-14T09:08:04.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430202+0000", 2024-09-14T09:08:04.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3319000000000001e-05 2024-09-14T09:08:04.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:04.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437052+0000", 2024-09-14T09:08:04.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0068491389999999997 2024-09-14T09:08:04.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437088+0000", 2024-09-14T09:08:04.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6023999999999999e-05 2024-09-14T09:08:04.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.632 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.632 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:67 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'45, mlcod=15'40)", 2024-09-14T09:08:04.632 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.430561+0000", 2024-09-14T09:08:04.633 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 33.150501798000001, 2024-09-14T09:08:04.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065458490000000003, 2024-09-14T09:08:04.633 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.633 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.633 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:04.633 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430561+0000", 2024-09-14T09:08:04.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430561+0000", 2024-09-14T09:08:04.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430562+0000", 2024-09-14T09:08:04.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1500000000000005e-07 2024-09-14T09:08:04.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430566+0000", 2024-09-14T09:08:04.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8589999999999998e-06 2024-09-14T09:08:04.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430572+0000", 2024-09-14T09:08:04.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5390000000000004e-06 2024-09-14T09:08:04.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430576+0000", 2024-09-14T09:08:04.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4879999999999999e-06 2024-09-14T09:08:04.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430724+0000", 2024-09-14T09:08:04.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000148107 2024-09-14T09:08:04.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430775+0000", 2024-09-14T09:08:04.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1010000000000001e-05 2024-09-14T09:08:04.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:04.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437090+0000", 2024-09-14T09:08:04.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063148129999999998 2024-09-14T09:08:04.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437107+0000", 2024-09-14T09:08:04.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7518000000000001e-05 2024-09-14T09:08:04.637 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.637 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.637 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.637 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:72 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'50, mlcod=15'41)", 2024-09-14T09:08:04.637 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.432562+0000", 2024-09-14T09:08:04.637 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 33.148501275000001, 2024-09-14T09:08:04.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065129940000000002, 2024-09-14T09:08:04.637 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.638 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.638 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:04.638 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.432562+0000", 2024-09-14T09:08:04.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.432562+0000", 2024-09-14T09:08:04.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.432562+0000", 2024-09-14T09:08:04.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:08:04.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.432632+0000", 2024-09-14T09:08:04.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9482999999999999e-05 2024-09-14T09:08:04.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.432641+0000", 2024-09-14T09:08:04.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6950000000000006e-06 2024-09-14T09:08:04.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.432644+0000", 2024-09-14T09:08:04.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3000000000000002e-06 2024-09-14T09:08:04.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.434040+0000", 2024-09-14T09:08:04.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001395683 2024-09-14T09:08:04.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.434053+0000", 2024-09-14T09:08:04.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3013000000000001e-05 2024-09-14T09:08:04.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:04.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.439046+0000", 2024-09-14T09:08:04.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049934749999999998 2024-09-14T09:08:04.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.439075+0000", 2024-09-14T09:08:04.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8846000000000001e-05 2024-09-14T09:08:04.641 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.641 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.641 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.642 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1024 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:04.642 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.966579+0000", 2024-09-14T09:08:04.642 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.6144837600000006, 2024-09-14T09:08:04.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069169419999999997, 2024-09-14T09:08:04.642 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.642 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.642 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:04.642 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.642 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.642 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.642 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1024 2024-09-14T09:08:04.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.643 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966579+0000", 2024-09-14T09:08:04.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966579+0000", 2024-09-14T09:08:04.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966580+0000", 2024-09-14T09:08:04.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000002e-07 2024-09-14T09:08:04.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966582+0000", 2024-09-14T09:08:04.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0040000000000002e-06 2024-09-14T09:08:04.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966588+0000", 2024-09-14T09:08:04.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6959999999999999e-06 2024-09-14T09:08:04.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966592+0000", 2024-09-14T09:08:04.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2370000000000001e-06 2024-09-14T09:08:04.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.967468+0000", 2024-09-14T09:08:04.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00087601900000000002 2024-09-14T09:08:04.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.967562+0000", 2024-09-14T09:08:04.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4543000000000006e-05 2024-09-14T09:08:04.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:04.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.967905+0000", 2024-09-14T09:08:04.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00034289100000000001 2024-09-14T09:08:04.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:04.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.968973+0000", 2024-09-14T09:08:04.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010677530000000001 2024-09-14T09:08:04.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:04.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.973420+0000", 2024-09-14T09:08:04.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044470810000000003 2024-09-14T09:08:04.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:04.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.973455+0000", 2024-09-14T09:08:04.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5018000000000003e-05 2024-09-14T09:08:04.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.973496+0000", 2024-09-14T09:08:04.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1303000000000001e-05 2024-09-14T09:08:04.647 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.647 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.647 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.648 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1206 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:04.648 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417812+0000", 2024-09-14T09:08:04.648 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1632512360000007, 2024-09-14T09:08:04.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082937259999999995, 2024-09-14T09:08:04.648 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.648 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.648 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:04.648 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.648 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.648 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.648 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1206 2024-09-14T09:08:04.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.648 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417812+0000", 2024-09-14T09:08:04.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417812+0000", 2024-09-14T09:08:04.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417812+0000", 2024-09-14T09:08:04.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1e-07 2024-09-14T09:08:04.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417813+0000", 2024-09-14T09:08:04.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2470000000000001e-06 2024-09-14T09:08:04.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417817+0000", 2024-09-14T09:08:04.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3720000000000001e-06 2024-09-14T09:08:04.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417819+0000", 2024-09-14T09:08:04.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3980000000000002e-06 2024-09-14T09:08:04.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.422429+0000", 2024-09-14T09:08:04.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046098040000000003 2024-09-14T09:08:04.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.422477+0000", 2024-09-14T09:08:04.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8000999999999997e-05 2024-09-14T09:08:04.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:04.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.422680+0000", 2024-09-14T09:08:04.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000202986 2024-09-14T09:08:04.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:04.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425417+0000", 2024-09-14T09:08:04.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00273742 2024-09-14T09:08:04.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:04.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426055+0000", 2024-09-14T09:08:04.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00063756800000000003 2024-09-14T09:08:04.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:04.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426083+0000", 2024-09-14T09:08:04.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7616000000000001e-05 2024-09-14T09:08:04.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426106+0000", 2024-09-14T09:08:04.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3104000000000001e-05 2024-09-14T09:08:04.653 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.653 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.653 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.654 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1207 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:04.654 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417822+0000", 2024-09-14T09:08:04.654 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1632411410000003, 2024-09-14T09:08:04.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.009748909, 2024-09-14T09:08:04.654 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.654 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.654 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:04.654 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.654 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.654 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.654 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1207 2024-09-14T09:08:04.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.654 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417822+0000", 2024-09-14T09:08:04.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417822+0000", 2024-09-14T09:08:04.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417822+0000", 2024-09-14T09:08:04.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.36e-07 2024-09-14T09:08:04.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417824+0000", 2024-09-14T09:08:04.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4410000000000001e-06 2024-09-14T09:08:04.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417827+0000", 2024-09-14T09:08:04.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8600000000000001e-06 2024-09-14T09:08:04.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417829+0000", 2024-09-14T09:08:04.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4200000000000001e-06 2024-09-14T09:08:04.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.423665+0000", 2024-09-14T09:08:04.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058360590000000002 2024-09-14T09:08:04.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.423755+0000", 2024-09-14T09:08:04.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9999000000000003e-05 2024-09-14T09:08:04.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:04.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424113+0000", 2024-09-14T09:08:04.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00035816599999999999 2024-09-14T09:08:04.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:04.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426112+0000", 2024-09-14T09:08:04.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019984209999999998 2024-09-14T09:08:04.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:04.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427498+0000", 2024-09-14T09:08:04.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013862049999999999 2024-09-14T09:08:04.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:04.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427534+0000", 2024-09-14T09:08:04.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6609999999999997e-05 2024-09-14T09:08:04.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427571+0000", 2024-09-14T09:08:04.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6492000000000002e-05 2024-09-14T09:08:04.659 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.659 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.659 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.660 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1208 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:04.660 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417832+0000", 2024-09-14T09:08:04.660 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1632313649999997, 2024-09-14T09:08:04.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0098905280000000009, 2024-09-14T09:08:04.660 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.660 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.660 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:04.660 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.661 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.661 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.661 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1208 2024-09-14T09:08:04.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.661 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417832+0000", 2024-09-14T09:08:04.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417832+0000", 2024-09-14T09:08:04.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417832+0000", 2024-09-14T09:08:04.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2399999999999999e-07 2024-09-14T09:08:04.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417833+0000", 2024-09-14T09:08:04.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0950000000000001e-06 2024-09-14T09:08:04.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417842+0000", 2024-09-14T09:08:04.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3959999999999995e-06 2024-09-14T09:08:04.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417846+0000", 2024-09-14T09:08:04.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4649999999999999e-06 2024-09-14T09:08:04.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424607+0000", 2024-09-14T09:08:04.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067611750000000003 2024-09-14T09:08:04.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424690+0000", 2024-09-14T09:08:04.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2890000000000001e-05 2024-09-14T09:08:04.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:04.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425029+0000", 2024-09-14T09:08:04.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033934900000000002 2024-09-14T09:08:04.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:04.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427460+0000", 2024-09-14T09:08:04.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024307619999999999 2024-09-14T09:08:04.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:04.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427624+0000", 2024-09-14T09:08:04.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000163404 2024-09-14T09:08:04.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:04.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427681+0000", 2024-09-14T09:08:04.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7748999999999999e-05 2024-09-14T09:08:04.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427722+0000", 2024-09-14T09:08:04.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1019000000000001e-05 2024-09-14T09:08:04.666 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.666 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.666 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.666 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1209 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:04.666 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417851+0000", 2024-09-14T09:08:04.666 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1632118590000005, 2024-09-14T09:08:04.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010012681000000001, 2024-09-14T09:08:04.666 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.667 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.667 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:04.667 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.667 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.667 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.667 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1209 2024-09-14T09:08:04.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.667 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417851+0000", 2024-09-14T09:08:04.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417851+0000", 2024-09-14T09:08:04.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417852+0000", 2024-09-14T09:08:04.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.84e-07 2024-09-14T09:08:04.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417853+0000", 2024-09-14T09:08:04.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6589999999999999e-06 2024-09-14T09:08:04.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417857+0000", 2024-09-14T09:08:04.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7050000000000001e-06 2024-09-14T09:08:04.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417860+0000", 2024-09-14T09:08:04.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.242e-06 2024-09-14T09:08:04.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425469+0000", 2024-09-14T09:08:04.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076089 2024-09-14T09:08:04.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425553+0000", 2024-09-14T09:08:04.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3657000000000002e-05 2024-09-14T09:08:04.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:04.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425782+0000", 2024-09-14T09:08:04.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000229519 2024-09-14T09:08:04.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:04.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427775+0000", 2024-09-14T09:08:04.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019930289999999999 2024-09-14T09:08:04.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:04.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427794+0000", 2024-09-14T09:08:04.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8238999999999999e-05 2024-09-14T09:08:04.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:04.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427827+0000", 2024-09-14T09:08:04.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3045e-05 2024-09-14T09:08:04.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427864+0000", 2024-09-14T09:08:04.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7401999999999999e-05 2024-09-14T09:08:04.672 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.672 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.672 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.672 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1210 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:04.672 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417864+0000", 2024-09-14T09:08:04.672 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1631987860000006, 2024-09-14T09:08:04.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011675377000000001, 2024-09-14T09:08:04.673 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.673 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.673 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:04.673 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.673 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.673 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.673 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1210 2024-09-14T09:08:04.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.673 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417864+0000", 2024-09-14T09:08:04.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417864+0000", 2024-09-14T09:08:04.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417865+0000", 2024-09-14T09:08:04.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.34e-07 2024-09-14T09:08:04.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417866+0000", 2024-09-14T09:08:04.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.384e-06 2024-09-14T09:08:04.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417869+0000", 2024-09-14T09:08:04.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.971e-06 2024-09-14T09:08:04.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417872+0000", 2024-09-14T09:08:04.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5979999999999999e-06 2024-09-14T09:08:04.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426155+0000", 2024-09-14T09:08:04.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082832389999999995 2024-09-14T09:08:04.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426236+0000", 2024-09-14T09:08:04.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1241000000000004e-05 2024-09-14T09:08:04.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:04.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426477+0000", 2024-09-14T09:08:04.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024123999999999999 2024-09-14T09:08:04.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:04.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427872+0000", 2024-09-14T09:08:04.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001394714 2024-09-14T09:08:04.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:04.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.429483+0000", 2024-09-14T09:08:04.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001611124 2024-09-14T09:08:04.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:04.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.429515+0000", 2024-09-14T09:08:04.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2243000000000003e-05 2024-09-14T09:08:04.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.429540+0000", 2024-09-14T09:08:04.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4389e-05 2024-09-14T09:08:04.678 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.678 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.678 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.678 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1218 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:04.678 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.425295+0000", 2024-09-14T09:08:04.678 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1557683900000004, 2024-09-14T09:08:04.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0068691480000000003, 2024-09-14T09:08:04.679 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.679 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.679 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:04.679 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.679 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.679 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.679 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1218 2024-09-14T09:08:04.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.679 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425295+0000", 2024-09-14T09:08:04.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425295+0000", 2024-09-14T09:08:04.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425296+0000", 2024-09-14T09:08:04.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3489999999999999e-06 2024-09-14T09:08:04.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425302+0000", 2024-09-14T09:08:04.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4709999999999998e-06 2024-09-14T09:08:04.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425317+0000", 2024-09-14T09:08:04.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5438999999999999e-05 2024-09-14T09:08:04.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425325+0000", 2024-09-14T09:08:04.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5229999999999998e-06 2024-09-14T09:08:04.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426759+0000", 2024-09-14T09:08:04.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001434399 2024-09-14T09:08:04.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426846+0000", 2024-09-14T09:08:04.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7529999999999997e-05 2024-09-14T09:08:04.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:04.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427211+0000", 2024-09-14T09:08:04.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00036427200000000001 2024-09-14T09:08:04.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:04.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428665+0000", 2024-09-14T09:08:04.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014539659999999999 2024-09-14T09:08:04.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:04.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432108+0000", 2024-09-14T09:08:04.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034428229999999998 2024-09-14T09:08:04.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:04.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432139+0000", 2024-09-14T09:08:04.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1319000000000003e-05 2024-09-14T09:08:04.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432164+0000", 2024-09-14T09:08:04.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5057000000000001e-05 2024-09-14T09:08:04.684 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.684 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.684 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.684 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1219 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:04.684 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.425715+0000", 2024-09-14T09:08:04.684 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1553480619999998, 2024-09-14T09:08:04.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065717709999999997, 2024-09-14T09:08:04.685 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:04.685 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:04.685 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:04.685 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:04.685 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:04.685 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:04.685 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1219 2024-09-14T09:08:04.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.685 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:04.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:04.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425715+0000", 2024-09-14T09:08:04.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:04.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425715+0000", 2024-09-14T09:08:04.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:04.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:04.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425716+0000", 2024-09-14T09:08:04.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0599999999999999e-07 2024-09-14T09:08:04.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:04.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425726+0000", 2024-09-14T09:08:04.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0122999999999999e-05 2024-09-14T09:08:04.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:04.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425743+0000", 2024-09-14T09:08:04.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7110000000000001e-05 2024-09-14T09:08:04.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:04.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425749+0000", 2024-09-14T09:08:04.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2099999999999998e-06 2024-09-14T09:08:04.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:04.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427903+0000", 2024-09-14T09:08:04.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021539969999999999 2024-09-14T09:08:04.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:04.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427985+0000", 2024-09-14T09:08:04.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1458999999999994e-05 2024-09-14T09:08:04.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:04.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428277+0000", 2024-09-14T09:08:04.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029251100000000002 2024-09-14T09:08:04.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:04.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.430127+0000", 2024-09-14T09:08:04.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018491950000000001 2024-09-14T09:08:04.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:04.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432234+0000", 2024-09-14T09:08:04.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002107458 2024-09-14T09:08:04.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:04.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432267+0000", 2024-09-14T09:08:04.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3291999999999999e-05 2024-09-14T09:08:04.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:04.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:04.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:04.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432287+0000", 2024-09-14T09:08:04.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9510000000000001e-05 2024-09-14T09:08:04.690 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.690 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.690 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.690 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:04.690 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:04.690 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:04.691 INFO:teuthology.orchestra.run.smithi148.stdout:1207 punch from 0x2b4e800 to 0x2b57200, (0x8a00 bytes) 2024-09-14T09:08:04.692 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:08:04.693 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:04.693+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:04.730 INFO:teuthology.orchestra.run.smithi148.stdout:1208 write 0x82ff200 thru 0x830e633 (0xf434 bytes) 2024-09-14T09:08:04.731 INFO:teuthology.orchestra.run.smithi148.stdout:1209 punch from 0x1e49800 to 0x1e4aa00, (0x1200 bytes) 2024-09-14T09:08:04.732 INFO:teuthology.orchestra.run.smithi148.stdout:1210 read 0x1f7f600 thru 0x1f80ecc (0x18cd bytes) 2024-09-14T09:08:04.749 INFO:teuthology.orchestra.run.smithi148.stdout:1212 write 0xc01cc00 thru 0xc020f5c (0x435d bytes) 2024-09-14T09:08:04.749 INFO:teuthology.orchestra.run.smithi148.stdout:1213 read 0x66f0400 thru 0x66fbc95 (0xb896 bytes) 2024-09-14T09:08:04.760 INFO:teuthology.orchestra.run.smithi148.stdout:1214 trunc from 0xc021000 to 0x3644a00 2024-09-14T09:08:04.784 INFO:teuthology.orchestra.run.smithi148.stdout:1215 trunc from 0x3644a00 to 0x3a7ee00 2024-09-14T09:08:04.791 INFO:teuthology.orchestra.run.smithi148.stdout:1217 read 0x1552800 thru 0x1553704 (0xf05 bytes) 2024-09-14T09:08:04.792 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:04.794+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:04.805 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:04.805 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:04.805 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:08:04.805 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:04.805 INFO:teuthology.orchestra.run.smithi148.stdout:1218 write 0x5552800 thru 0x555efb1 (0xc7b2 bytes) 2024-09-14T09:08:04.806 INFO:teuthology.orchestra.run.smithi148.stdout:1224 read 0x2a5a200 thru 0x2a5fb87 (0x5988 bytes) 2024-09-14T09:08:04.807 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is unset 2024-09-14T09:08:04.816 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:08:04.816 INFO:teuthology.orchestra.run.smithi148.stdout:1225 trunc from 0x555f000 to 0xd643400 2024-09-14T09:08:04.836 INFO:teuthology.orchestra.run.smithi148.stdout:1226 flatten 2024-09-14T09:08:04.844 INFO:teuthology.orchestra.run.smithi148.stdout:1228 punch from 0xbf7ea00 to 0xbf80600, (0x1c00 bytes) 2024-09-14T09:08:04.845 INFO:teuthology.orchestra.run.smithi148.stdout:1229 write 0x5d64600 thru 0x5d6df57 (0x9958 bytes) 2024-09-14T09:08:04.848 INFO:teuthology.orchestra.run.smithi148.stdout:1233 trunc from 0xd643400 to 0xae7c400 2024-09-14T09:08:04.860 INFO:teuthology.orchestra.run.smithi148.stdout:1234 punch from 0xa26ce00 to 0xa26f400, (0x2600 bytes) 2024-09-14T09:08:04.860 INFO:teuthology.orchestra.run.smithi148.stdout:1235 read 0x1cfca00 thru 0x1d03eed (0x74ee bytes) 2024-09-14T09:08:04.861 INFO:teuthology.orchestra.run.smithi148.stdout:1237 punch from 0x7468800 to 0x746a000, (0x1800 bytes) 2024-09-14T09:08:04.868 INFO:teuthology.orchestra.run.smithi148.stdout:1240 trunc from 0xae7c400 to 0x597a600 2024-09-14T09:08:04.882 INFO:teuthology.orchestra.run.smithi148.stdout:1241 write 0x13c4600 thru 0x13ccf96 (0x8997 bytes) 2024-09-14T09:08:04.883 INFO:teuthology.orchestra.run.smithi148.stdout:1242 write 0x1db3a00 thru 0x1dbbe8e (0x848f bytes) 2024-09-14T09:08:04.884 INFO:teuthology.orchestra.run.smithi148.stdout:1243 read 0x47af600 thru 0x47b4b6d (0x556e bytes) 2024-09-14T09:08:04.888 INFO:teuthology.orchestra.run.smithi148.stdout:1246 trunc from 0x597a600 to 0x91fb800 2024-09-14T09:08:04.892 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:04.894+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:04.898 INFO:teuthology.orchestra.run.smithi148.stdout:1248 read 0x1eda200 thru 0x1edf299 (0x509a bytes) 2024-09-14T09:08:04.899 INFO:teuthology.orchestra.run.smithi148.stdout:1249 read 0x71ed400 thru 0x71fbdea (0xe9eb bytes) 2024-09-14T09:08:04.900 INFO:teuthology.orchestra.run.smithi148.stdout:1252 read 0x4cfe800 thru 0x4d0d687 (0xee88 bytes) 2024-09-14T09:08:04.901 INFO:teuthology.orchestra.run.smithi148.stdout:1254 punch from 0x8ef2a00 to 0x8efb600, (0x8c00 bytes) 2024-09-14T09:08:04.901 INFO:teuthology.orchestra.run.smithi148.stdout:1255 punch from 0x5d28800 to 0x5d33c00, (0xb400 bytes) 2024-09-14T09:08:04.901 INFO:teuthology.orchestra.run.smithi148.stdout:1256 write 0x1ac0000 thru 0x1acd432 (0xd433 bytes) 2024-09-14T09:08:04.901 INFO:teuthology.orchestra.run.smithi148.stdout:1257 read 0x4f8fc00 thru 0x4f9c658 (0xca59 bytes) 2024-09-14T09:08:04.901 INFO:teuthology.orchestra.run.smithi148.stdout:1260 read 0x8663c00 thru 0x866924b (0x564c bytes) 2024-09-14T09:08:04.913 INFO:teuthology.orchestra.run.smithi148.stdout:1263 write 0x99ee600 thru 0x99f9293 (0xac94 bytes) 2024-09-14T09:08:04.914 INFO:teuthology.orchestra.run.smithi148.stdout:1264 read 0x5035a00 thru 0x503b39a (0x599b bytes) 2024-09-14T09:08:04.920 INFO:teuthology.orchestra.run.smithi148.stdout:1267 trunc from 0x99f9400 to 0x48a5200 2024-09-14T09:08:04.931 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:04.931 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:04.931 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:04.931 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:04.931 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:04.940 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:08:04.943 INFO:teuthology.orchestra.run.smithi148.stdout:1269 read 0x2b1a400 thru 0x2b2560a (0xb20b bytes) 2024-09-14T09:08:04.945 INFO:teuthology.orchestra.run.smithi148.stdout:1272 read 0x1cf9200 thru 0x1d08dda (0xfbdb bytes) 2024-09-14T09:08:04.945 INFO:teuthology.orchestra.run.smithi148.stdout:1274 read 0x1e5a400 thru 0x1e659d8 (0xb5d9 bytes) 2024-09-14T09:08:04.955 INFO:teuthology.orchestra.run.smithi148.stdout:1275 trunc from 0x48a5200 to 0xc336600 2024-09-14T09:08:04.963 INFO:teuthology.orchestra.run.smithi148.stdout:1276 write 0x1ed600 thru 0x1f1f04 (0x4905 bytes) 2024-09-14T09:08:04.966 INFO:teuthology.orchestra.run.smithi148.stdout:1277 write 0x7273200 thru 0x727d799 (0xa59a bytes) 2024-09-14T09:08:04.979 INFO:teuthology.orchestra.run.smithi148.stdout:1278 trunc from 0xc336600 to 0x162c400 2024-09-14T09:08:04.980 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T09:08:04.981 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:08:04.981 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-14T09:08:04.981 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T09:08:05.001 INFO:teuthology.orchestra.run.smithi148.stdout:1282 read 0x46a800 thru 0x46cd6e (0x256f bytes) 2024-09-14T09:08:05.003 INFO:teuthology.orchestra.run.smithi148.stdout:1285 punch from 0x15ce600 to 0x15db600, (0xd000 bytes) 2024-09-14T09:08:05.009 INFO:teuthology.orchestra.run.smithi148.stdout:1287 trunc from 0x162c400 to 0x5d2ac00 2024-09-14T09:08:05.025 INFO:teuthology.orchestra.run.smithi148.stdout:1290 trunc from 0x5d2ac00 to 0xb7ecc00 2024-09-14T09:08:05.025 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:05.027+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:05.033 INFO:teuthology.orchestra.run.smithi148.stdout:1291 read 0x112ca00 thru 0x113b86b (0xee6c bytes) 2024-09-14T09:08:05.035 INFO:teuthology.orchestra.run.smithi148.stdout:1292 write 0x6e66a00 thru 0x6e6ce7b (0x647c bytes) 2024-09-14T09:08:05.035 INFO:teuthology.orchestra.run.smithi148.stdout:1295 punch from 0x5cc600 to 0x5cf200, (0x2c00 bytes) 2024-09-14T09:08:05.035 INFO:teuthology.orchestra.run.smithi148.stdout:1296 write 0x5083e00 thru 0x5084228 (0x429 bytes) 2024-09-14T09:08:05.035 INFO:teuthology.orchestra.run.smithi148.stdout:1298 trunc from 0xb7ecc00 to 0xb553c00 2024-09-14T09:08:05.048 INFO:teuthology.orchestra.run.smithi148.stdout:1299 read 0x19bb600 thru 0x19c180b (0x620c bytes) 2024-09-14T09:08:05.051 INFO:teuthology.orchestra.run.smithi148.stdout:1302 trunc from 0xb553c00 to 0x95fda00 2024-09-14T09:08:05.063 INFO:teuthology.orchestra.run.smithi148.stdout:1303 trunc from 0x95fda00 to 0xbeba200 2024-09-14T09:08:05.074 INFO:teuthology.orchestra.run.smithi148.stdout:1304 write 0x7c41800 thru 0x7c4d4ed (0xbcee bytes) 2024-09-14T09:08:05.082 INFO:teuthology.orchestra.run.smithi148.stdout:1305 write 0x7d76600 thru 0x7d84a50 (0xe451 bytes) 2024-09-14T09:08:05.094 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:05.096+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:05.095 INFO:teuthology.orchestra.run.smithi148.stdout:1306 trunc from 0xbeba200 to 0xa0e800 2024-09-14T09:08:05.096 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:05.096 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:05.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:05.097 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:05.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.097 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:655 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 2621440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:05.097 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862936+0000", 2024-09-14T09:08:05.097 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2349647969999999, 2024-09-14T09:08:05.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012886771999999999, 2024-09-14T09:08:05.097 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.097 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.097 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.097 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.097 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:05.098 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:05.098 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 655 2024-09-14T09:08:05.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.098 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862936+0000", 2024-09-14T09:08:05.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862936+0000", 2024-09-14T09:08:05.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862936+0000", 2024-09-14T09:08:05.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.41e-07 2024-09-14T09:08:05.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862938+0000", 2024-09-14T09:08:05.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0480000000000001e-06 2024-09-14T09:08:05.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862944+0000", 2024-09-14T09:08:05.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9710000000000001e-06 2024-09-14T09:08:05.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862957+0000", 2024-09-14T09:08:05.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2438e-05 2024-09-14T09:08:05.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875625+0000", 2024-09-14T09:08:05.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012668789 2024-09-14T09:08:05.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875710+0000", 2024-09-14T09:08:05.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4753999999999995e-05 2024-09-14T09:08:05.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875823+0000", 2024-09-14T09:08:05.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011243099999999999 2024-09-14T09:08:05.101 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.101 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.101 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.101 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:656 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:05.101 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862975+0000", 2024-09-14T09:08:05.101 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2349261790000003, 2024-09-14T09:08:05.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013016366999999999, 2024-09-14T09:08:05.102 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.102 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.102 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:05.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:05.102 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 656 2024-09-14T09:08:05.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.102 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862975+0000", 2024-09-14T09:08:05.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862975+0000", 2024-09-14T09:08:05.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862975+0000", 2024-09-14T09:08:05.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5099999999999999e-07 2024-09-14T09:08:05.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862977+0000", 2024-09-14T09:08:05.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2819999999999999e-06 2024-09-14T09:08:05.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862984+0000", 2024-09-14T09:08:05.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4489999999999996e-06 2024-09-14T09:08:05.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862995+0000", 2024-09-14T09:08:05.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0655999999999999e-05 2024-09-14T09:08:05.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875873+0000", 2024-09-14T09:08:05.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012878466999999999 2024-09-14T09:08:05.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875922+0000", 2024-09-14T09:08:05.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9038e-05 2024-09-14T09:08:05.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.875991+0000", 2024-09-14T09:08:05.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8824000000000004e-05 2024-09-14T09:08:05.105 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.105 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.106 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.106 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:657 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:05.106 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863002+0000", 2024-09-14T09:08:05.106 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2348987390000001, 2024-09-14T09:08:05.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013236974, 2024-09-14T09:08:05.106 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.106 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.106 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.106 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.106 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:05.106 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:05.106 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 657 2024-09-14T09:08:05.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.107 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863002+0000", 2024-09-14T09:08:05.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863002+0000", 2024-09-14T09:08:05.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863002+0000", 2024-09-14T09:08:05.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3000000000000001e-07 2024-09-14T09:08:05.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863005+0000", 2024-09-14T09:08:05.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0329999999999998e-06 2024-09-14T09:08:05.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863010+0000", 2024-09-14T09:08:05.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7799999999999997e-06 2024-09-14T09:08:05.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863015+0000", 2024-09-14T09:08:05.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6070000000000001e-06 2024-09-14T09:08:05.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876045+0000", 2024-09-14T09:08:05.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013029987999999999 2024-09-14T09:08:05.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876130+0000", 2024-09-14T09:08:05.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5347999999999997e-05 2024-09-14T09:08:05.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876239+0000", 2024-09-14T09:08:05.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000108688 2024-09-14T09:08:05.110 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.110 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.110 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.110 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:690 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:05.110 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863199+0000", 2024-09-14T09:08:05.110 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.23470163, 2024-09-14T09:08:05.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013255059, 2024-09-14T09:08:05.110 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.110 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.110 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.111 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.111 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:05.111 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:05.111 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 690 2024-09-14T09:08:05.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.111 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863199+0000", 2024-09-14T09:08:05.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863199+0000", 2024-09-14T09:08:05.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863200+0000", 2024-09-14T09:08:05.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9800000000000004e-07 2024-09-14T09:08:05.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863201+0000", 2024-09-14T09:08:05.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8080000000000001e-06 2024-09-14T09:08:05.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863207+0000", 2024-09-14T09:08:05.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7790000000000001e-06 2024-09-14T09:08:05.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863212+0000", 2024-09-14T09:08:05.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2789999999999998e-06 2024-09-14T09:08:05.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876282+0000", 2024-09-14T09:08:05.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013069414999999999 2024-09-14T09:08:05.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876363+0000", 2024-09-14T09:08:05.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1055000000000002e-05 2024-09-14T09:08:05.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876454+0000", 2024-09-14T09:08:05.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1224999999999995e-05 2024-09-14T09:08:05.114 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.115 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.115 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.115 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:691 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 2752512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:05.115 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863219+0000", 2024-09-14T09:08:05.115 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2346816839999999, 2024-09-14T09:08:05.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013427955, 2024-09-14T09:08:05.115 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.115 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.115 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.115 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.115 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:05.115 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:05.116 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 691 2024-09-14T09:08:05.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.116 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863219+0000", 2024-09-14T09:08:05.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863219+0000", 2024-09-14T09:08:05.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863219+0000", 2024-09-14T09:08:05.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.39e-07 2024-09-14T09:08:05.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863221+0000", 2024-09-14T09:08:05.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.753e-06 2024-09-14T09:08:05.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863227+0000", 2024-09-14T09:08:05.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.896e-06 2024-09-14T09:08:05.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863232+0000", 2024-09-14T09:08:05.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5310000000000003e-06 2024-09-14T09:08:05.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876501+0000", 2024-09-14T09:08:05.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013269197999999999 2024-09-14T09:08:05.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876580+0000", 2024-09-14T09:08:05.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9487999999999995e-05 2024-09-14T09:08:05.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876647+0000", 2024-09-14T09:08:05.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6749999999999996e-05 2024-09-14T09:08:05.119 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.119 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.119 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.119 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:692 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:05.119 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863238+0000", 2024-09-14T09:08:05.119 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2346629040000003, 2024-09-14T09:08:05.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013610064, 2024-09-14T09:08:05.119 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.120 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.120 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.120 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.120 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:05.120 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:05.120 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 692 2024-09-14T09:08:05.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.120 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863238+0000", 2024-09-14T09:08:05.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863238+0000", 2024-09-14T09:08:05.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863238+0000", 2024-09-14T09:08:05.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.39e-07 2024-09-14T09:08:05.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863240+0000", 2024-09-14T09:08:05.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.649e-06 2024-09-14T09:08:05.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863246+0000", 2024-09-14T09:08:05.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7869999999999998e-06 2024-09-14T09:08:05.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863250+0000", 2024-09-14T09:08:05.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5850000000000001e-06 2024-09-14T09:08:05.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876683+0000", 2024-09-14T09:08:05.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013432372999999999 2024-09-14T09:08:05.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876763+0000", 2024-09-14T09:08:05.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9951999999999996e-05 2024-09-14T09:08:05.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876848+0000", 2024-09-14T09:08:05.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5278999999999994e-05 2024-09-14T09:08:05.123 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.123 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.123 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.124 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:693 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 5701632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:05.124 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863257+0000", 2024-09-14T09:08:05.124 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2346438160000002, 2024-09-14T09:08:05.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013728496999999999, 2024-09-14T09:08:05.124 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.124 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.124 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.124 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.124 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:05.124 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:05.124 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 693 2024-09-14T09:08:05.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.124 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863257+0000", 2024-09-14T09:08:05.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863257+0000", 2024-09-14T09:08:05.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863257+0000", 2024-09-14T09:08:05.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5600000000000001e-07 2024-09-14T09:08:05.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863259+0000", 2024-09-14T09:08:05.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.736e-06 2024-09-14T09:08:05.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863265+0000", 2024-09-14T09:08:05.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9150000000000001e-06 2024-09-14T09:08:05.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863269+0000", 2024-09-14T09:08:05.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5390000000000001e-06 2024-09-14T09:08:05.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876880+0000", 2024-09-14T09:08:05.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013610587 2024-09-14T09:08:05.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876925+0000", 2024-09-14T09:08:05.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4820000000000001e-05 2024-09-14T09:08:05.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.876985+0000", 2024-09-14T09:08:05.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0544000000000002e-05 2024-09-14T09:08:05.128 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.128 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.128 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.128 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:694 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:05.128 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863275+0000", 2024-09-14T09:08:05.128 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2346255460000002, 2024-09-14T09:08:05.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013905130999999999, 2024-09-14T09:08:05.128 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.128 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.128 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.128 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.129 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:05.129 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:05.129 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 694 2024-09-14T09:08:05.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.129 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863275+0000", 2024-09-14T09:08:05.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863275+0000", 2024-09-14T09:08:05.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863275+0000", 2024-09-14T09:08:05.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3200000000000001e-07 2024-09-14T09:08:05.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863277+0000", 2024-09-14T09:08:05.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7799999999999999e-06 2024-09-14T09:08:05.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863283+0000", 2024-09-14T09:08:05.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6529999999999999e-06 2024-09-14T09:08:05.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863287+0000", 2024-09-14T09:08:05.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.374e-06 2024-09-14T09:08:05.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877018+0000", 2024-09-14T09:08:05.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01373095 2024-09-14T09:08:05.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877088+0000", 2024-09-14T09:08:05.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9986000000000004e-05 2024-09-14T09:08:05.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877180+0000", 2024-09-14T09:08:05.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2056000000000001e-05 2024-09-14T09:08:05.132 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.132 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.132 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.132 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:695 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 2752512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:05.132 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863293+0000", 2024-09-14T09:08:05.133 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2346075110000001, 2024-09-14T09:08:05.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014059326, 2024-09-14T09:08:05.133 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.133 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.133 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.133 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.133 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:05.133 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:05.133 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 695 2024-09-14T09:08:05.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.133 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863293+0000", 2024-09-14T09:08:05.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863293+0000", 2024-09-14T09:08:05.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863294+0000", 2024-09-14T09:08:05.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2800000000000003e-07 2024-09-14T09:08:05.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863308+0000", 2024-09-14T09:08:05.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.453e-05 2024-09-14T09:08:05.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863316+0000", 2024-09-14T09:08:05.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4730000000000003e-06 2024-09-14T09:08:05.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863321+0000", 2024-09-14T09:08:05.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1159999999999998e-06 2024-09-14T09:08:05.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877217+0000", 2024-09-14T09:08:05.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013896116 2024-09-14T09:08:05.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877271+0000", 2024-09-14T09:08:05.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4450000000000002e-05 2024-09-14T09:08:05.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877353+0000", 2024-09-14T09:08:05.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1312999999999999e-05 2024-09-14T09:08:05.137 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.137 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.137 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.137 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:696 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:05.137 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863341+0000", 2024-09-14T09:08:05.137 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2345598150000008, 2024-09-14T09:08:05.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01426848, 2024-09-14T09:08:05.137 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.137 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.137 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.137 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.138 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:05.138 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:05.138 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 696 2024-09-14T09:08:05.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.138 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863341+0000", 2024-09-14T09:08:05.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863341+0000", 2024-09-14T09:08:05.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863342+0000", 2024-09-14T09:08:05.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.44e-07 2024-09-14T09:08:05.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863344+0000", 2024-09-14T09:08:05.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2400000000000002e-06 2024-09-14T09:08:05.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863350+0000", 2024-09-14T09:08:05.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.579e-06 2024-09-14T09:08:05.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863355+0000", 2024-09-14T09:08:05.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.549e-06 2024-09-14T09:08:05.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877400+0000", 2024-09-14T09:08:05.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014044911 2024-09-14T09:08:05.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877496+0000", 2024-09-14T09:08:05.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6105000000000002e-05 2024-09-14T09:08:05.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877609+0000", 2024-09-14T09:08:05.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000113452 2024-09-14T09:08:05.141 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.141 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.141 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.141 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:697 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 5701632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:05.141 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863362+0000", 2024-09-14T09:08:05.142 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.234539174, 2024-09-14T09:08:05.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014418841999999999, 2024-09-14T09:08:05.142 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.142 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.142 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.142 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.142 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:05.142 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:05.142 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 697 2024-09-14T09:08:05.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.142 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863362+0000", 2024-09-14T09:08:05.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863362+0000", 2024-09-14T09:08:05.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863362+0000", 2024-09-14T09:08:05.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.46e-07 2024-09-14T09:08:05.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863364+0000", 2024-09-14T09:08:05.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.624e-06 2024-09-14T09:08:05.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863369+0000", 2024-09-14T09:08:05.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7400000000000001e-06 2024-09-14T09:08:05.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863383+0000", 2024-09-14T09:08:05.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3582e-05 2024-09-14T09:08:05.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877652+0000", 2024-09-14T09:08:05.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014269298999999999 2024-09-14T09:08:05.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877721+0000", 2024-09-14T09:08:05.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8881999999999995e-05 2024-09-14T09:08:05.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877780+0000", 2024-09-14T09:08:05.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9268999999999998e-05 2024-09-14T09:08:05.146 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.146 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.146 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.146 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:730 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 1376256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:05.146 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863562+0000", 2024-09-14T09:08:05.146 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2343386499999998, 2024-09-14T09:08:05.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014435170000000001, 2024-09-14T09:08:05.146 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.146 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.146 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.146 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.147 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:05.147 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:05.147 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 730 2024-09-14T09:08:05.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.147 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863562+0000", 2024-09-14T09:08:05.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863562+0000", 2024-09-14T09:08:05.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863562+0000", 2024-09-14T09:08:05.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.65e-07 2024-09-14T09:08:05.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863570+0000", 2024-09-14T09:08:05.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8189999999999992e-06 2024-09-14T09:08:05.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863576+0000", 2024-09-14T09:08:05.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7420000000000003e-06 2024-09-14T09:08:05.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863585+0000", 2024-09-14T09:08:05.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3000000000000007e-06 2024-09-14T09:08:05.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877818+0000", 2024-09-14T09:08:05.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014232463000000001 2024-09-14T09:08:05.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877898+0000", 2024-09-14T09:08:05.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0012999999999994e-05 2024-09-14T09:08:05.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.877997+0000", 2024-09-14T09:08:05.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9468000000000004e-05 2024-09-14T09:08:05.150 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.150 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.150 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.150 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:731 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:05.151 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863593+0000", 2024-09-14T09:08:05.151 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2343078080000005, 2024-09-14T09:08:05.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014635227000000001, 2024-09-14T09:08:05.151 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.151 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.151 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.151 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.151 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:05.151 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:05.151 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 731 2024-09-14T09:08:05.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.151 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863593+0000", 2024-09-14T09:08:05.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863593+0000", 2024-09-14T09:08:05.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863593+0000", 2024-09-14T09:08:05.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.08e-07 2024-09-14T09:08:05.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863600+0000", 2024-09-14T09:08:05.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6250000000000001e-06 2024-09-14T09:08:05.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863606+0000", 2024-09-14T09:08:05.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0270000000000001e-06 2024-09-14T09:08:05.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863611+0000", 2024-09-14T09:08:05.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1420000000000001e-06 2024-09-14T09:08:05.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878041+0000", 2024-09-14T09:08:05.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014430121000000001 2024-09-14T09:08:05.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878128+0000", 2024-09-14T09:08:05.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6562000000000002e-05 2024-09-14T09:08:05.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878228+0000", 2024-09-14T09:08:05.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000100342 2024-09-14T09:08:05.155 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.155 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.155 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.155 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:732 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 4325376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:05.155 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863618+0000", 2024-09-14T09:08:05.155 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2342831289999996, 2024-09-14T09:08:05.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014825102999999999, 2024-09-14T09:08:05.155 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.155 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.155 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.155 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.156 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:05.156 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:05.156 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 732 2024-09-14T09:08:05.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.156 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863618+0000", 2024-09-14T09:08:05.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863618+0000", 2024-09-14T09:08:05.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863618+0000", 2024-09-14T09:08:05.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6399999999999998e-07 2024-09-14T09:08:05.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863620+0000", 2024-09-14T09:08:05.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6559999999999999e-06 2024-09-14T09:08:05.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863626+0000", 2024-09-14T09:08:05.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5799999999999997e-06 2024-09-14T09:08:05.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863631+0000", 2024-09-14T09:08:05.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2830000000000001e-06 2024-09-14T09:08:05.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878274+0000", 2024-09-14T09:08:05.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014642426 2024-09-14T09:08:05.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878348+0000", 2024-09-14T09:08:05.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4209999999999996e-05 2024-09-14T09:08:05.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878443+0000", 2024-09-14T09:08:05.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4584000000000001e-05 2024-09-14T09:08:05.159 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.159 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.159 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.159 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:733 3.9 3:905ab9d3:::rbd_data.11122fa6a16d.0000000000000001:6 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:05.159 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863638+0000", 2024-09-14T09:08:05.159 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2342630670000005, 2024-09-14T09:08:05.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01497658, 2024-09-14T09:08:05.160 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.160 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.160 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.160 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.160 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:05.160 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:05.160 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 733 2024-09-14T09:08:05.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.160 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863638+0000", 2024-09-14T09:08:05.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863638+0000", 2024-09-14T09:08:05.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863638+0000", 2024-09-14T09:08:05.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7e-07 2024-09-14T09:08:05.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863640+0000", 2024-09-14T09:08:05.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.765e-06 2024-09-14T09:08:05.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863646+0000", 2024-09-14T09:08:05.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9109999999999998e-06 2024-09-14T09:08:05.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863650+0000", 2024-09-14T09:08:05.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7099999999999998e-06 2024-09-14T09:08:05.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878476+0000", 2024-09-14T09:08:05.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014825408 2024-09-14T09:08:05.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878522+0000", 2024-09-14T09:08:05.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5731e-05 2024-09-14T09:08:05.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878614+0000", 2024-09-14T09:08:05.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2684999999999998e-05 2024-09-14T09:08:05.164 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.164 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.164 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.164 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:734 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 1376256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:05.164 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863656+0000", 2024-09-14T09:08:05.164 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2342447080000003, 2024-09-14T09:08:05.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015170861000000001, 2024-09-14T09:08:05.164 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.164 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.164 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.164 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.164 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:05.165 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:05.165 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 734 2024-09-14T09:08:05.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.165 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863656+0000", 2024-09-14T09:08:05.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863656+0000", 2024-09-14T09:08:05.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863656+0000", 2024-09-14T09:08:05.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4200000000000002e-07 2024-09-14T09:08:05.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863658+0000", 2024-09-14T09:08:05.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.685e-06 2024-09-14T09:08:05.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863665+0000", 2024-09-14T09:08:05.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5610000000000004e-06 2024-09-14T09:08:05.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863669+0000", 2024-09-14T09:08:05.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7899999999999999e-06 2024-09-14T09:08:05.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878654+0000", 2024-09-14T09:08:05.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014984877000000001 2024-09-14T09:08:05.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878731+0000", 2024-09-14T09:08:05.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6627999999999999e-05 2024-09-14T09:08:05.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878827+0000", 2024-09-14T09:08:05.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5977999999999995e-05 2024-09-14T09:08:05.168 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.168 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.168 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.168 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:735 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 2818048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:05.168 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863676+0000", 2024-09-14T09:08:05.168 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2342251560000008, 2024-09-14T09:08:05.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015314884000000001, 2024-09-14T09:08:05.169 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.169 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.169 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.169 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.169 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:05.169 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:05.169 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 735 2024-09-14T09:08:05.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.169 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863676+0000", 2024-09-14T09:08:05.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863676+0000", 2024-09-14T09:08:05.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863676+0000", 2024-09-14T09:08:05.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9699999999999996e-07 2024-09-14T09:08:05.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863678+0000", 2024-09-14T09:08:05.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.73e-06 2024-09-14T09:08:05.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863683+0000", 2024-09-14T09:08:05.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7089999999999999e-06 2024-09-14T09:08:05.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863688+0000", 2024-09-14T09:08:05.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4209999999999997e-06 2024-09-14T09:08:05.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878858+0000", 2024-09-14T09:08:05.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015170243 2024-09-14T09:08:05.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878898+0000", 2024-09-14T09:08:05.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9471999999999997e-05 2024-09-14T09:08:05.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.878990+0000", 2024-09-14T09:08:05.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2812000000000005e-05 2024-09-14T09:08:05.172 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.172 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.173 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.173 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:736 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 4325376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:05.173 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863711+0000", 2024-09-14T09:08:05.173 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2341901620000009, 2024-09-14T09:08:05.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015489134, 2024-09-14T09:08:05.173 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.173 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.173 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.173 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.173 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:05.173 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:05.173 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 736 2024-09-14T09:08:05.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.174 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863711+0000", 2024-09-14T09:08:05.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863711+0000", 2024-09-14T09:08:05.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863711+0000", 2024-09-14T09:08:05.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7599999999999997e-07 2024-09-14T09:08:05.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863713+0000", 2024-09-14T09:08:05.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.04e-06 2024-09-14T09:08:05.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863720+0000", 2024-09-14T09:08:05.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4570000000000002e-06 2024-09-14T09:08:05.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863724+0000", 2024-09-14T09:08:05.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4490000000000001e-06 2024-09-14T09:08:05.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.879030+0000", 2024-09-14T09:08:05.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01530606 2024-09-14T09:08:05.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.879104+0000", 2024-09-14T09:08:05.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4023000000000006e-05 2024-09-14T09:08:05.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.879200+0000", 2024-09-14T09:08:05.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5529e-05 2024-09-14T09:08:05.177 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.177 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.177 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.177 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:737 3.9 3:9075e1ca:::rbd_data.11122fa6a16d.0000000000000002:6 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:05.177 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863731+0000", 2024-09-14T09:08:05.177 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2341700200000005, 2024-09-14T09:08:05.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015612793999999999, 2024-09-14T09:08:05.177 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.177 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.178 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.178 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.178 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:05.178 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:05.178 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 737 2024-09-14T09:08:05.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.178 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863731+0000", 2024-09-14T09:08:05.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863731+0000", 2024-09-14T09:08:05.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863731+0000", 2024-09-14T09:08:05.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3000000000000001e-07 2024-09-14T09:08:05.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863733+0000", 2024-09-14T09:08:05.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.821e-06 2024-09-14T09:08:05.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863739+0000", 2024-09-14T09:08:05.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-09-14T09:08:05.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863744+0000", 2024-09-14T09:08:05.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1699999999999996e-06 2024-09-14T09:08:05.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.879230+0000", 2024-09-14T09:08:05.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015485478 2024-09-14T09:08:05.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.879276+0000", 2024-09-14T09:08:05.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6489999999999997e-05 2024-09-14T09:08:05.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.879343+0000", 2024-09-14T09:08:05.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7047999999999999e-05 2024-09-14T09:08:05.181 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.181 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.181 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.181 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4604.0:364 3.1d e36/22 3:bb0fb96d:::rbd_data.1112609a9334.0000000000000000:head v 36'85, mlcod=35'82)", 2024-09-14T09:08:05.181 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:04.683445+0000", 2024-09-14T09:08:05.182 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.41445562499999999, 2024-09-14T09:08:05.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036040981, 2024-09-14T09:08:05.182 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.182 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.182 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:05.182 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.683445+0000", 2024-09-14T09:08:05.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.683445+0000", 2024-09-14T09:08:05.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.683447+0000", 2024-09-14T09:08:05.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7010000000000001e-06 2024-09-14T09:08:05.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.690176+0000", 2024-09-14T09:08:05.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0067292979999999999 2024-09-14T09:08:05.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.690196+0000", 2024-09-14T09:08:05.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0250000000000001e-05 2024-09-14T09:08:05.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.690206+0000", 2024-09-14T09:08:05.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0053e-05 2024-09-14T09:08:05.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.690280+0000", 2024-09-14T09:08:05.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3694000000000003e-05 2024-09-14T09:08:05.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.690305+0000", 2024-09-14T09:08:05.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5403999999999999e-05 2024-09-14T09:08:05.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:05.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719431+0000", 2024-09-14T09:08:05.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029125245000000001 2024-09-14T09:08:05.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719486+0000", 2024-09-14T09:08:05.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5336e-05 2024-09-14T09:08:05.185 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.185 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.186 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.186 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.186 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.186 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:05.188 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:08:05.188 INFO:teuthology.orchestra.run.smithi148.stdout:1309 read 0x624000 thru 0x630eb2 (0xceb3 bytes) 2024-09-14T09:08:05.189 INFO:teuthology.orchestra.run.smithi148.stdout:1311 punch from 0x8a2400 to 0x8ae200, (0xbe00 bytes) 2024-09-14T09:08:05.189 INFO:teuthology.orchestra.run.smithi148.stdout:truncating to largest ever: 0xedc2400 2024-09-14T09:08:05.189 INFO:teuthology.orchestra.run.smithi148.stdout:1313 trunc from 0xa0e800 to 0xedc2400 2024-09-14T09:08:05.189 INFO:teuthology.orchestra.run.smithi148.stdout:1314 punch from 0x8312600 to 0x8317000, (0x4a00 bytes) 2024-09-14T09:08:05.189 INFO:teuthology.orchestra.run.smithi148.stdout:1318 write 0x5141e00 thru 0x514b35e (0x955f bytes) 2024-09-14T09:08:05.189 INFO:teuthology.orchestra.run.smithi148.stdout:1320 read 0xe235a00 thru 0xe245758 (0xfd59 bytes) 2024-09-14T09:08:05.189 INFO:teuthology.orchestra.run.smithi148.stdout:1323 trunc from 0xedc2400 to 0xea13a00 2024-09-14T09:08:05.189 INFO:teuthology.orchestra.run.smithi148.stdout:1325 read 0x3ce9a00 thru 0x3cebbd7 (0x21d8 bytes) 2024-09-14T09:08:05.189 INFO:teuthology.orchestra.run.smithi148.stdout:1327 read 0xd6d4e00 thru 0xd6d88ce (0x3acf bytes) 2024-09-14T09:08:05.189 INFO:teuthology.orchestra.run.smithi148.stdout:1328 write 0xeaeca00 thru 0xeaece27 (0x428 bytes) 2024-09-14T09:08:05.189 INFO:teuthology.orchestra.run.smithi148.stdout:1329 write 0x839cc00 thru 0x83a1355 (0x4756 bytes) 2024-09-14T09:08:05.190 INFO:teuthology.orchestra.run.smithi148.stdout:1331 read 0x2786e00 thru 0x278e86f (0x7a70 bytes) 2024-09-14T09:08:05.190 INFO:teuthology.orchestra.run.smithi148.stdout:1334 punch from 0x5cb1600 to 0x5cbcc00, (0xb600 bytes) 2024-09-14T09:08:05.190 INFO:teuthology.orchestra.run.smithi148.stdout:1335 write 0x6272400 thru 0x627d17d (0xad7e bytes) 2024-09-14T09:08:05.190 INFO:teuthology.orchestra.run.smithi148.stdout:1336 read 0xd493c00 thru 0xd49d4d7 (0x98d8 bytes) 2024-09-14T09:08:05.190 INFO:teuthology.orchestra.run.smithi148.stdout:1337 read 0xc7bca00 thru 0xc7c6fd1 (0xa5d2 bytes) 2024-09-14T09:08:05.194 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:05.197+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:05.195 INFO:teuthology.orchestra.run.smithi148.stdout:1338 trunc from 0xeaed000 to 0xa709a00 2024-09-14T09:08:05.212 INFO:teuthology.orchestra.run.smithi148.stdout:1339 read 0x6397000 thru 0x639a629 (0x362a bytes) 2024-09-14T09:08:05.230 INFO:teuthology.orchestra.run.smithi148.stdout:1340 trunc from 0xa709a00 to 0x1162400 2024-09-14T09:08:05.245 INFO:teuthology.orchestra.run.smithi148.stdout:1341 clone 10 order 20 su 131072 sc 15 2024-09-14T09:08:05.292 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:08:05.292 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:05.292 INFO:teuthology.orchestra.run.smithi116.stdout: "epoch": 37, 2024-09-14T09:08:05.292 INFO:teuthology.orchestra.run.smithi116.stdout: "fsid": "c991ac1c-978d-48b3-a540-4d3d4755e125", 2024-09-14T09:08:05.293 INFO:teuthology.orchestra.run.smithi116.stdout: "created": "2024-09-14T09:07:16.982473+0000", 2024-09-14T09:08:05.293 INFO:teuthology.orchestra.run.smithi116.stdout: "modified": "2024-09-14T09:08:04.803831+0000", 2024-09-14T09:08:05.293 INFO:teuthology.orchestra.run.smithi116.stdout: "last_up_change": "2024-09-14T09:07:28.201361+0000", 2024-09-14T09:08:05.293 INFO:teuthology.orchestra.run.smithi116.stdout: "last_in_change": "2024-09-14T09:07:18.560664+0000", 2024-09-14T09:08:05.293 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T09:08:05.293 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_num": 5799936, 2024-09-14T09:08:05.293 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_set": [ 2024-09-14T09:08:05.293 INFO:teuthology.orchestra.run.smithi116.stdout: "pglog_hardlimit", 2024-09-14T09:08:05.293 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snapdirs", 2024-09-14T09:08:05.293 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_deletes", 2024-09-14T09:08:05.293 INFO:teuthology.orchestra.run.smithi116.stdout: "sortbitwise" 2024-09-14T09:08:05.293 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:08:05.293 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_version": 5, 2024-09-14T09:08:05.294 INFO:teuthology.orchestra.run.smithi116.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T09:08:05.294 INFO:teuthology.orchestra.run.smithi116.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T09:08:05.294 INFO:teuthology.orchestra.run.smithi116.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T09:08:05.294 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_snapshot": "", 2024-09-14T09:08:05.294 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_max": 3, 2024-09-14T09:08:05.294 INFO:teuthology.orchestra.run.smithi116.stdout: "max_osd": 6, 2024-09-14T09:08:05.294 INFO:teuthology.orchestra.run.smithi116.stdout: "require_min_compat_client": "luminous", 2024-09-14T09:08:05.294 INFO:teuthology.orchestra.run.smithi116.stdout: "min_compat_client": "jewel", 2024-09-14T09:08:05.294 INFO:teuthology.orchestra.run.smithi116.stdout: "require_osd_release": "squid", 2024-09-14T09:08:05.294 INFO:teuthology.orchestra.run.smithi116.stdout: "allow_crimson": false, 2024-09-14T09:08:05.294 INFO:teuthology.orchestra.run.smithi116.stdout: "pools": [ 2024-09-14T09:08:05.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.294 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 1, 2024-09-14T09:08:05.294 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": ".mgr", 2024-09-14T09:08:05.295 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:29.194849+0000", 2024-09-14T09:08:05.295 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 1, 2024-09-14T09:08:05.295 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool", 2024-09-14T09:08:05.295 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:08:05.295 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:08:05.295 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:08:05.295 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:08:05.295 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:08:05.295 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:08:05.295 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:08:05.295 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:08:05.295 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:08:05.295 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:08:05.295 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:08:05.296 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 1, 2024-09-14T09:08:05.296 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 1, 2024-09-14T09:08:05.296 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 1, 2024-09-14T09:08:05.296 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 1, 2024-09-14T09:08:05.296 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 1, 2024-09-14T09:08:05.296 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:08:05.296 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:08:05.296 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:08:05.296 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:08:05.296 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:08:05.296 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:08:05.296 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:08:05.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.297 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "16", 2024-09-14T09:08:05.297 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:08:05.297 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:08:05.297 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:08:05.297 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:08:05.297 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:08:05.297 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 0, 2024-09-14T09:08:05.297 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 0, 2024-09-14T09:08:05.297 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:08:05.297 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:08:05.297 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:08:05.297 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:08:05.297 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:08:05.297 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:08:05.298 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:08:05.298 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:08:05.298 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:08:05.298 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:08:05.298 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:08:05.298 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:08:05.298 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:08:05.298 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:08:05.298 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:08:05.298 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:08:05.298 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:08:05.298 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:08:05.298 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:08:05.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.299 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:08:05.299 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:08:05.299 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:08:05.299 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:08:05.299 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:08:05.299 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:08:05.299 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:08:05.299 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:08:05.299 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:08:05.299 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:08:05.299 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:08:05.299 INFO:teuthology.orchestra.run.smithi116.stdout: "options": { 2024-09-14T09:08:05.300 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_max": 32, 2024-09-14T09:08:05.300 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_min": 1 2024-09-14T09:08:05.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.300 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:08:05.300 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": {} 2024-09-14T09:08:05.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.300 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:08:05.300 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:08:05.300 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 6.059999942779541, 2024-09-14T09:08:05.300 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 6.059999942779541, 2024-09-14T09:08:05.300 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 0.33000001311302185, 2024-09-14T09:08:05.300 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 2, 2024-09-14T09:08:05.300 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 2, 2024-09-14T09:08:05.301 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:08:05.301 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:08:05.301 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:08:05.301 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.301 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 2, 2024-09-14T09:08:05.301 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": "rbd", 2024-09-14T09:08:05.301 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:33.684592+0000", 2024-09-14T09:08:05.301 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 8193, 2024-09-14T09:08:05.301 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T09:08:05.301 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:08:05.301 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:08:05.301 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:08:05.302 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:08:05.302 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:08:05.302 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:08:05.302 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:08:05.302 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:08:05.302 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:08:05.302 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:08:05.302 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:08:05.302 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 8, 2024-09-14T09:08:05.302 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 8, 2024-09-14T09:08:05.302 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 8, 2024-09-14T09:08:05.302 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 8, 2024-09-14T09:08:05.302 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 8, 2024-09-14T09:08:05.303 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:08:05.303 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:08:05.303 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:08:05.303 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:08:05.303 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:08:05.303 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:08:05.303 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:08:05.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.303 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "20", 2024-09-14T09:08:05.303 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:08:05.303 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:08:05.303 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:08:05.303 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:08:05.304 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:08:05.304 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 2, 2024-09-14T09:08:05.304 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 20, 2024-09-14T09:08:05.304 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:08:05.304 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:08:05.304 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:08:05.304 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:08:05.304 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:08:05.304 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:08:05.304 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:08:05.304 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:08:05.304 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:08:05.304 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:08:05.305 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:08:05.305 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:08:05.305 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:08:05.305 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:08:05.305 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:08:05.305 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:08:05.305 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:08:05.305 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:08:05.305 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:08:05.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.305 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:08:05.305 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:08:05.305 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:08:05.305 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:08:05.306 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:08:05.306 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:08:05.306 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:08:05.306 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:08:05.306 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:08:05.306 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:08:05.306 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:08:05.306 INFO:teuthology.orchestra.run.smithi116.stdout: "options": {}, 2024-09-14T09:08:05.306 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:08:05.306 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd": {} 2024-09-14T09:08:05.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.306 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:08:05.306 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:08:05.307 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 2.25, 2024-09-14T09:08:05.307 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 2.25, 2024-09-14T09:08:05.307 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 1, 2024-09-14T09:08:05.307 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 2.25, 2024-09-14T09:08:05.307 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 2.25, 2024-09-14T09:08:05.307 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:08:05.307 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:08:05.307 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:08:05.307 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.307 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 3, 2024-09-14T09:08:05.307 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": "pool_client.0", 2024-09-14T09:08:05.307 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:43.363542+0000", 2024-09-14T09:08:05.308 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 8193, 2024-09-14T09:08:05.308 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T09:08:05.308 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:08:05.308 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:08:05.308 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:08:05.308 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:08:05.308 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:08:05.308 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:08:05.308 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:08:05.308 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:08:05.308 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:08:05.308 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:08:05.308 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:08:05.309 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 32, 2024-09-14T09:08:05.309 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 32, 2024-09-14T09:08:05.309 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 32, 2024-09-14T09:08:05.309 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 32, 2024-09-14T09:08:05.309 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 32, 2024-09-14T09:08:05.309 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:08:05.309 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:08:05.309 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:08:05.309 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:08:05.309 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:08:05.309 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:08:05.309 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:08:05.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.309 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "36", 2024-09-14T09:08:05.310 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:08:05.310 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:08:05.310 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:08:05.310 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:08:05.310 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:08:05.310 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 11, 2024-09-14T09:08:05.310 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 36, 2024-09-14T09:08:05.310 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:08:05.310 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:08:05.310 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:08:05.310 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:08:05.310 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:08:05.310 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:08:05.310 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:08:05.311 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:08:05.311 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:08:05.311 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:08:05.311 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:08:05.311 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:08:05.311 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:08:05.311 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:08:05.311 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:08:05.311 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:08:05.311 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:08:05.311 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:08:05.311 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:08:05.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.311 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:08:05.312 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:08:05.312 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:08:05.312 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:08:05.312 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:08:05.312 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:08:05.312 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:08:05.312 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:08:05.312 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:08:05.312 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:08:05.312 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:08:05.312 INFO:teuthology.orchestra.run.smithi116.stdout: "options": {}, 2024-09-14T09:08:05.312 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:08:05.312 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd": {} 2024-09-14T09:08:05.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.313 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:08:05.313 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:08:05.313 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 1.309999942779541, 2024-09-14T09:08:05.313 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 1.309999942779541, 2024-09-14T09:08:05.313 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 1, 2024-09-14T09:08:05.313 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 1.309999942779541, 2024-09-14T09:08:05.313 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 1.309999942779541, 2024-09-14T09:08:05.313 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:08:05.313 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:08:05.313 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:08:05.313 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.313 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:08:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "osds": [ 2024-09-14T09:08:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 0, 2024-09-14T09:08:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "b3c13086-1183-454b-8e62-3aec9b69cdf5", 2024-09-14T09:08:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:08:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:08:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:08:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:08:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:08:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:08:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 11, 2024-09-14T09:08:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 22, 2024-09-14T09:08:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:08:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:08:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:08:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6816", 2024-09-14T09:08:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:08:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6817", 2024-09-14T09:08:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:08:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.316 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:08:05.316 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.316 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.316 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6818", 2024-09-14T09:08:05.316 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:08:05.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.316 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.316 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6819", 2024-09-14T09:08:05.316 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:08:05.316 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.317 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.317 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:08:05.317 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.317 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.317 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6822", 2024-09-14T09:08:05.317 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:08:05.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.317 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.317 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6823", 2024-09-14T09:08:05.317 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:08:05.317 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.318 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.318 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:08:05.318 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.318 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.318 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6820", 2024-09-14T09:08:05.318 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:08:05.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.318 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.318 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6821", 2024-09-14T09:08:05.318 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:08:05.318 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.319 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.319 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6817/1856142608", 2024-09-14T09:08:05.319 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6819/1856142608", 2024-09-14T09:08:05.319 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6823/1856142608", 2024-09-14T09:08:05.319 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6821/1856142608", 2024-09-14T09:08:05.319 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:08:05.319 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:08:05.319 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:08:05.319 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.319 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 1, 2024-09-14T09:08:05.319 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "8ee6a373-9d0d-4cd2-96f4-9673de96f546", 2024-09-14T09:08:05.320 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:08:05.320 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:08:05.320 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:08:05.320 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:08:05.320 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:08:05.320 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:08:05.320 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 13, 2024-09-14T09:08:05.320 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 22, 2024-09-14T09:08:05.320 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:08:05.320 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:08:05.320 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:08:05.320 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.321 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.321 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6800", 2024-09-14T09:08:05.321 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:08:05.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.321 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.321 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6801", 2024-09-14T09:08:05.321 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:08:05.321 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.321 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.321 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:08:05.321 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.322 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.322 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6802", 2024-09-14T09:08:05.322 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:08:05.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.322 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.322 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6803", 2024-09-14T09:08:05.322 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:08:05.322 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.322 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.322 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:08:05.322 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.323 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.323 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6806", 2024-09-14T09:08:05.323 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:08:05.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.323 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.323 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6807", 2024-09-14T09:08:05.323 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:08:05.323 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.323 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.323 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:08:05.323 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.324 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.324 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6804", 2024-09-14T09:08:05.324 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:08:05.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.324 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.324 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6805", 2024-09-14T09:08:05.324 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:08:05.324 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.324 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.324 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6801/3469105275", 2024-09-14T09:08:05.324 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6803/3469105275", 2024-09-14T09:08:05.325 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6807/3469105275", 2024-09-14T09:08:05.325 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6805/3469105275", 2024-09-14T09:08:05.325 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:08:05.325 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:08:05.325 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:08:05.325 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.325 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 2, 2024-09-14T09:08:05.325 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "958a9363-d751-49c3-9ec7-7330d377ee53", 2024-09-14T09:08:05.325 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:08:05.325 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:08:05.325 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:08:05.325 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:08:05.326 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:08:05.326 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:08:05.326 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 13, 2024-09-14T09:08:05.326 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 22, 2024-09-14T09:08:05.326 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:08:05.326 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:08:05.326 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:08:05.326 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.326 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.326 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6808", 2024-09-14T09:08:05.326 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:08:05.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.327 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.327 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6809", 2024-09-14T09:08:05.327 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:08:05.327 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.327 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.327 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:08:05.327 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.327 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.327 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6810", 2024-09-14T09:08:05.327 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:08:05.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.328 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.328 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6811", 2024-09-14T09:08:05.328 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:08:05.328 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.328 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.328 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:08:05.328 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.328 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.328 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6814", 2024-09-14T09:08:05.328 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:08:05.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.329 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.329 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6815", 2024-09-14T09:08:05.329 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:08:05.329 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.329 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.329 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:08:05.329 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.329 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.329 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6812", 2024-09-14T09:08:05.329 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:08:05.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.330 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.330 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6813", 2024-09-14T09:08:05.330 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:08:05.330 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.330 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.330 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6809/2660214336", 2024-09-14T09:08:05.330 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6811/2660214336", 2024-09-14T09:08:05.330 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6815/2660214336", 2024-09-14T09:08:05.330 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6813/2660214336", 2024-09-14T09:08:05.330 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:08:05.331 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:08:05.331 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:08:05.331 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.331 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 3, 2024-09-14T09:08:05.331 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "7fafd519-b2e9-498c-a409-f55cfe45a51a", 2024-09-14T09:08:05.331 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:08:05.331 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:08:05.331 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:08:05.331 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 0.2435760498046875, 2024-09-14T09:08:05.331 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:08:05.331 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:08:05.331 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:08:05.331 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 22, 2024-09-14T09:08:05.332 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:08:05.332 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:08:05.332 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:08:05.332 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.332 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.332 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6816", 2024-09-14T09:08:05.332 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:08:05.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.332 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.332 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6817", 2024-09-14T09:08:05.332 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:08:05.333 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.333 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.333 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:08:05.333 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.333 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.333 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6818", 2024-09-14T09:08:05.333 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:08:05.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.333 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.333 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6819", 2024-09-14T09:08:05.333 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:08:05.334 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.334 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.334 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:08:05.334 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.334 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.334 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6822", 2024-09-14T09:08:05.334 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:08:05.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.334 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.334 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6823", 2024-09-14T09:08:05.334 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:08:05.334 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.335 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.335 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:08:05.335 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.335 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.335 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6820", 2024-09-14T09:08:05.335 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:08:05.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.335 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.335 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6821", 2024-09-14T09:08:05.335 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:08:05.335 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.335 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.336 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6817/2855061278", 2024-09-14T09:08:05.336 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6819/2855061278", 2024-09-14T09:08:05.336 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6823/2855061278", 2024-09-14T09:08:05.336 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6821/2855061278", 2024-09-14T09:08:05.336 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:08:05.336 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:08:05.336 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:08:05.336 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.336 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 4, 2024-09-14T09:08:05.336 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "63d99552-5fea-4367-bf86-0addc8cceb98", 2024-09-14T09:08:05.336 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:08:05.336 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:08:05.337 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:08:05.337 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:08:05.337 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:08:05.337 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:08:05.337 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:08:05.337 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 22, 2024-09-14T09:08:05.337 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:08:05.337 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:08:05.337 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:08:05.337 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.337 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.337 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6808", 2024-09-14T09:08:05.337 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:08:05.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.338 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.338 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6809", 2024-09-14T09:08:05.338 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:08:05.338 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.338 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.338 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:08:05.338 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.338 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.338 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6810", 2024-09-14T09:08:05.338 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:08:05.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.339 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.339 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6811", 2024-09-14T09:08:05.339 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:08:05.339 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.339 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.339 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:08:05.339 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.339 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.339 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6814", 2024-09-14T09:08:05.339 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:08:05.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.340 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.340 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6815", 2024-09-14T09:08:05.340 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:08:05.340 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.340 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.340 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:08:05.340 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.340 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.340 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6812", 2024-09-14T09:08:05.340 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:08:05.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.341 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.341 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6813", 2024-09-14T09:08:05.341 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:08:05.341 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.341 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.341 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6809/369903047", 2024-09-14T09:08:05.341 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6811/369903047", 2024-09-14T09:08:05.341 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6815/369903047", 2024-09-14T09:08:05.341 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6813/369903047", 2024-09-14T09:08:05.341 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:08:05.342 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:08:05.342 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:08:05.342 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.342 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 5, 2024-09-14T09:08:05.342 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "e4bcb224-662f-4530-b477-c0dd9c4ddbf4", 2024-09-14T09:08:05.342 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:08:05.342 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:08:05.342 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:08:05.342 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:08:05.342 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:08:05.342 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:08:05.342 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:08:05.343 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 22, 2024-09-14T09:08:05.343 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:08:05.343 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:08:05.343 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:08:05.343 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.343 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.343 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6800", 2024-09-14T09:08:05.343 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:08:05.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.343 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.344 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6801", 2024-09-14T09:08:05.344 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:08:05.344 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.344 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.344 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:08:05.344 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.344 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.344 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6802", 2024-09-14T09:08:05.344 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:08:05.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.345 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.345 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6803", 2024-09-14T09:08:05.345 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:08:05.345 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.345 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.345 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:08:05.345 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.345 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.345 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6806", 2024-09-14T09:08:05.345 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:08:05.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.346 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.346 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6807", 2024-09-14T09:08:05.346 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:08:05.346 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.346 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.346 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:08:05.346 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:05.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.346 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:05.346 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6804", 2024-09-14T09:08:05.346 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:08:05.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.347 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:05.347 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6805", 2024-09-14T09:08:05.347 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:08:05.347 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.347 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.347 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6801/2878111293", 2024-09-14T09:08:05.347 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6803/2878111293", 2024-09-14T09:08:05.347 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6807/2878111293", 2024-09-14T09:08:05.347 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6805/2878111293", 2024-09-14T09:08:05.347 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:08:05.347 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:08:05.347 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:08:05.348 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.348 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.348 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:08:05.348 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_xinfo": [ 2024-09-14T09:08:05.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.348 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 0, 2024-09-14T09:08:05.348 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:08:05.348 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:08:05.348 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:08:05.348 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:08:05.348 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:08:05.348 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:24.757990+0000", 2024-09-14T09:08:05.348 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:08:05.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.349 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 1, 2024-09-14T09:08:05.349 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:08:05.349 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:08:05.349 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:08:05.349 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:08:05.349 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:08:05.349 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.277795+0000", 2024-09-14T09:08:05.349 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:08:05.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.349 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 2, 2024-09-14T09:08:05.349 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:08:05.350 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:08:05.350 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:08:05.350 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:08:05.350 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:08:05.350 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.290172+0000", 2024-09-14T09:08:05.350 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:08:05.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.350 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 3, 2024-09-14T09:08:05.350 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:08:05.350 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:08:05.350 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:08:05.350 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:08:05.350 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:08:05.351 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.324594+0000", 2024-09-14T09:08:05.351 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:08:05.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.351 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 4, 2024-09-14T09:08:05.351 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:08:05.351 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:08:05.351 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:08:05.351 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:08:05.351 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:08:05.351 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:24.865136+0000", 2024-09-14T09:08:05.351 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:08:05.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.352 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 5, 2024-09-14T09:08:05.352 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:08:05.352 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:08:05.352 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:08:05.352 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:08:05.352 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:08:05.352 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.020572+0000", 2024-09-14T09:08:05.352 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:08:05.352 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.352 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:08:05.352 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap": [], 2024-09-14T09:08:05.352 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap_items": [], 2024-09-14T09:08:05.352 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap_primaries": [], 2024-09-14T09:08:05.352 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_temp": [], 2024-09-14T09:08:05.353 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_temp": [], 2024-09-14T09:08:05.353 INFO:teuthology.orchestra.run.smithi116.stdout: "blocklist": {}, 2024-09-14T09:08:05.353 INFO:teuthology.orchestra.run.smithi116.stdout: "range_blocklist": {}, 2024-09-14T09:08:05.353 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profiles": { 2024-09-14T09:08:05.353 INFO:teuthology.orchestra.run.smithi116.stdout: "default": { 2024-09-14T09:08:05.353 INFO:teuthology.orchestra.run.smithi116.stdout: "crush-failure-domain": "osd", 2024-09-14T09:08:05.353 INFO:teuthology.orchestra.run.smithi116.stdout: "k": "2", 2024-09-14T09:08:05.353 INFO:teuthology.orchestra.run.smithi116.stdout: "m": "1", 2024-09-14T09:08:05.353 INFO:teuthology.orchestra.run.smithi116.stdout: "plugin": "jerasure", 2024-09-14T09:08:05.353 INFO:teuthology.orchestra.run.smithi116.stdout: "technique": "reed_sol_van" 2024-09-14T09:08:05.353 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.353 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps_queue": [], 2024-09-14T09:08:05.353 INFO:teuthology.orchestra.run.smithi116.stdout: "new_removed_snaps": [], 2024-09-14T09:08:05.354 INFO:teuthology.orchestra.run.smithi116.stdout: "new_purged_snaps": [], 2024-09-14T09:08:05.354 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_node_flags": {}, 2024-09-14T09:08:05.354 INFO:teuthology.orchestra.run.smithi116.stdout: "device_class_flags": {}, 2024-09-14T09:08:05.354 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode": { 2024-09-14T09:08:05.354 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode_enabled": false, 2024-09-14T09:08:05.354 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_bucket_count": 0, 2024-09-14T09:08:05.354 INFO:teuthology.orchestra.run.smithi116.stdout: "degraded_stretch_mode": 0, 2024-09-14T09:08:05.354 INFO:teuthology.orchestra.run.smithi116.stdout: "recovering_stretch_mode": 0, 2024-09-14T09:08:05.354 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode_bucket": 0 2024-09-14T09:08:05.354 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.354 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:05.356 INFO:tasks.thrashosds.thrasher:j is {'epoch': 37, 'fsid': 'c991ac1c-978d-48b3-a540-4d3d4755e125', 'created': '2024-09-14T09:07:16.982473+0000', 'modified': '2024-09-14T09:08:04.803831+0000', 'last_up_change': '2024-09-14T09:07:28.201361+0000', 'last_in_change': '2024-09-14T09:07:18.560664+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T09:07:29.194849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T09:07:33.684592+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-14T09:07:43.363542+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 11, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}], 'osds': [{'osd': 0, 'uuid': 'b3c13086-1183-454b-8e62-3aec9b69cdf5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6816', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6817', 'nonce': 1856142608}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6818', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6819', 'nonce': 1856142608}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6822', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6823', 'nonce': 1856142608}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6820', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6821', 'nonce': 1856142608}]}, 'public_addr': '172.21.15.116:6817/1856142608', 'cluster_addr': '172.21.15.116:6819/1856142608', 'heartbeat_back_addr': '172.21.15.116:6823/1856142608', 'heartbeat_front_addr': '172.21.15.116:6821/1856142608', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '8ee6a373-9d0d-4cd2-96f4-9673de96f546', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6800', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6801', 'nonce': 3469105275}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6802', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6803', 'nonce': 3469105275}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6806', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6807', 'nonce': 3469105275}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6804', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6805', 'nonce': 3469105275}]}, 'public_addr': '172.21.15.116:6801/3469105275', 'cluster_addr': '172.21.15.116:6803/3469105275', 'heartbeat_back_addr': '172.21.15.116:6807/3469105275', 'heartbeat_front_addr': '172.21.15.116:6805/3469105275', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '958a9363-d751-49c3-9ec7-7330d377ee53', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6808', 'nonce': 2660214336}, {'type': 'v1', 'addr': '172.21.15.116:6809', 'nonce': 2660214336}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6810', 'nonce': 2660214336}, {'type': 'v1', 'addr': '172.21.15.116:6811', 'nonce': 2660214336}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6814', 'nonce': 2660214336}, {'type': 'v1', 'addr': '172.21.15.116:6815', 'nonce': 2660214336}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6812', 'nonce': 2660214336}, {'type': 'v1', 'addr': '172.21.15.116:6813', 'nonce': 2660214336}]}, 'public_addr': '172.21.15.116:6809/2660214336', 'cluster_addr': '172.21.15.116:6811/2660214336', 'heartbeat_back_addr': '172.21.15.116:6815/2660214336', 'heartbeat_front_addr': '172.21.15.116:6813/2660214336', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '7fafd519-b2e9-498c-a409-f55cfe45a51a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.2435760498046875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6816', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6817', 'nonce': 2855061278}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6818', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6819', 'nonce': 2855061278}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6822', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6823', 'nonce': 2855061278}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6820', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6821', 'nonce': 2855061278}]}, 'public_addr': '172.21.15.144:6817/2855061278', 'cluster_addr': '172.21.15.144:6819/2855061278', 'heartbeat_back_addr': '172.21.15.144:6823/2855061278', 'heartbeat_front_addr': '172.21.15.144:6821/2855061278', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '63d99552-5fea-4367-bf86-0addc8cceb98', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6808', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6809', 'nonce': 369903047}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6810', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6811', 'nonce': 369903047}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6814', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6815', 'nonce': 369903047}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6812', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6813', 'nonce': 369903047}]}, 'public_addr': '172.21.15.144:6809/369903047', 'cluster_addr': '172.21.15.144:6811/369903047', 'heartbeat_back_addr': '172.21.15.144:6815/369903047', 'heartbeat_front_addr': '172.21.15.144:6813/369903047', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e4bcb224-662f-4530-b477-c0dd9c4ddbf4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6800', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6801', 'nonce': 2878111293}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6802', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6803', 'nonce': 2878111293}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6806', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6807', 'nonce': 2878111293}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6804', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6805', 'nonce': 2878111293}]}, 'public_addr': '172.21.15.144:6801/2878111293', 'cluster_addr': '172.21.15.144:6803/2878111293', 'heartbeat_back_addr': '172.21.15.144:6807/2878111293', 'heartbeat_front_addr': '172.21.15.144:6805/2878111293', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:24.757990+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.277795+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.290172+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.324594+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:24.865136+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.020572+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T09:08:05.357 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-14T09:08:05.357 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:05.357 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:05.357 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:08:05.357 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:05.358 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:08:05.358 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:05.358+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:05.457 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:05.459+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:05.460 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:05.460 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:05.460 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:05.460 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:05.460 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:05.469 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:08:05.548 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:08:05.557 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:05.560+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:05.573 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:05.573 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:05.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:05.573 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:05.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.574 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:08:05.574 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:05.574 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 35.341329023, 2024-09-14T09:08:05.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72111598600000004, 2024-09-14T09:08:05.574 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.574 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.574 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:05.574 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.574 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:08:05.574 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:08:05.574 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1 2024-09-14T09:08:05.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.574 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:05.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:05.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233065+0000", 2024-09-14T09:08:05.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1909999999999999e-06 2024-09-14T09:08:05.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233071+0000", 2024-09-14T09:08:05.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5300000000000002e-06 2024-09-14T09:08:05.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233081+0000", 2024-09-14T09:08:05.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0339e-05 2024-09-14T09:08:05.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233093+0000", 2024-09-14T09:08:05.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1252e-05 2024-09-14T09:08:05.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233162+0000", 2024-09-14T09:08:05.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9678999999999995e-05 2024-09-14T09:08:05.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:08:05.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233171+0000", 2024-09-14T09:08:05.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.132e-06 2024-09-14T09:08:05.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952480+0000", 2024-09-14T09:08:05.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.71930839899999999 2024-09-14T09:08:05.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952655+0000", 2024-09-14T09:08:05.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017552 2024-09-14T09:08:05.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:05.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952835+0000", 2024-09-14T09:08:05.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001797 2024-09-14T09:08:05.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:05.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.953648+0000", 2024-09-14T09:08:05.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00081291700000000002 2024-09-14T09:08:05.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:05.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954108+0000", 2024-09-14T09:08:05.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045992800000000002 2024-09-14T09:08:05.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:05.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954149+0000", 2024-09-14T09:08:05.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1214999999999998e-05 2024-09-14T09:08:05.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954178+0000", 2024-09-14T09:08:05.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9184e-05 2024-09-14T09:08:05.580 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.580 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.580 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.580 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1493 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1196032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:05.580 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:05.580 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.6656298329999997, 2024-09-14T09:08:05.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012302112, 2024-09-14T09:08:05.581 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.581 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.581 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.581 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.581 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:05.581 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:05.581 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1493 2024-09-14T09:08:05.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.581 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:05.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:05.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:05.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.65e-07 2024-09-14T09:08:05.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908764+0000", 2024-09-14T09:08:05.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8589999999999999e-06 2024-09-14T09:08:05.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908770+0000", 2024-09-14T09:08:05.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.728e-06 2024-09-14T09:08:05.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908774+0000", 2024-09-14T09:08:05.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7609999999999998e-06 2024-09-14T09:08:05.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.920899+0000", 2024-09-14T09:08:05.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012125004999999999 2024-09-14T09:08:05.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.920977+0000", 2024-09-14T09:08:05.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7564000000000005e-05 2024-09-14T09:08:05.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.921064+0000", 2024-09-14T09:08:05.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6829999999999994e-05 2024-09-14T09:08:05.585 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.585 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.585 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.585 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1510 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 983040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:05.585 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:05.585 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.6646456430000001, 2024-09-14T09:08:05.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012360968999999999, 2024-09-14T09:08:05.585 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.585 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.585 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.585 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.585 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:05.586 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:05.586 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1510 2024-09-14T09:08:05.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.586 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:05.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:05.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:05.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8799999999999998e-07 2024-09-14T09:08:05.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909748+0000", 2024-09-14T09:08:05.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9810000000000002e-06 2024-09-14T09:08:05.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909754+0000", 2024-09-14T09:08:05.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3609999999999997e-06 2024-09-14T09:08:05.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909760+0000", 2024-09-14T09:08:05.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1850000000000003e-06 2024-09-14T09:08:05.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.921974+0000", 2024-09-14T09:08:05.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012214426 2024-09-14T09:08:05.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922015+0000", 2024-09-14T09:08:05.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0407000000000001e-05 2024-09-14T09:08:05.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922107+0000", 2024-09-14T09:08:05.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2220999999999997e-05 2024-09-14T09:08:05.589 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.589 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.589 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.589 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1511 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1212416~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:05.590 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.909766+0000", 2024-09-14T09:08:05.590 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.664625236, 2024-09-14T09:08:05.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012473141, 2024-09-14T09:08:05.590 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.590 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.590 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.590 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.590 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:05.590 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:05.590 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1511 2024-09-14T09:08:05.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.590 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909766+0000", 2024-09-14T09:08:05.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909766+0000", 2024-09-14T09:08:05.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909767+0000", 2024-09-14T09:08:05.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-07 2024-09-14T09:08:05.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909768+0000", 2024-09-14T09:08:05.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8050000000000001e-06 2024-09-14T09:08:05.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909775+0000", 2024-09-14T09:08:05.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8210000000000004e-06 2024-09-14T09:08:05.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909780+0000", 2024-09-14T09:08:05.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3120000000000001e-06 2024-09-14T09:08:05.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922138+0000", 2024-09-14T09:08:05.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012358012 2024-09-14T09:08:05.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922181+0000", 2024-09-14T09:08:05.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2876000000000001e-05 2024-09-14T09:08:05.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922239+0000", 2024-09-14T09:08:05.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7960000000000001e-05 2024-09-14T09:08:05.594 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.594 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.594 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.594 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1517 3.d 3:b36f6c76:::rbd_data.1112f61fa773.0000000000000002:8 [read 966656~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:05.594 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910035+0000", 2024-09-14T09:08:05.595 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.6643567189999997, 2024-09-14T09:08:05.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012318664999999999, 2024-09-14T09:08:05.595 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.595 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.595 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.595 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.595 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:05.595 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:05.595 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1517 2024-09-14T09:08:05.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.595 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910035+0000", 2024-09-14T09:08:05.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910035+0000", 2024-09-14T09:08:05.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910036+0000", 2024-09-14T09:08:05.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7000000000000003e-07 2024-09-14T09:08:05.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910040+0000", 2024-09-14T09:08:05.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3220000000000003e-06 2024-09-14T09:08:05.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910051+0000", 2024-09-14T09:08:05.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1476e-05 2024-09-14T09:08:05.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910059+0000", 2024-09-14T09:08:05.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:08:05.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922268+0000", 2024-09-14T09:08:05.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012208910999999999 2024-09-14T09:08:05.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922305+0000", 2024-09-14T09:08:05.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7069e-05 2024-09-14T09:08:05.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922353+0000", 2024-09-14T09:08:05.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7976999999999998e-05 2024-09-14T09:08:05.599 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.599 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.599 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.599 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1518 3.d 3:b36f6c76:::rbd_data.1112f61fa773.0000000000000002:8 [read 1196032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:05.599 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910078+0000", 2024-09-14T09:08:05.599 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.6643130299999997, 2024-09-14T09:08:05.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012415053000000001, 2024-09-14T09:08:05.599 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.599 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.599 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.599 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.599 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:05.600 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:05.600 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1518 2024-09-14T09:08:05.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.600 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910078+0000", 2024-09-14T09:08:05.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910078+0000", 2024-09-14T09:08:05.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910079+0000", 2024-09-14T09:08:05.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0999999999999998e-07 2024-09-14T09:08:05.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910082+0000", 2024-09-14T09:08:05.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7779999999999999e-06 2024-09-14T09:08:05.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910089+0000", 2024-09-14T09:08:05.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4599999999999997e-06 2024-09-14T09:08:05.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910095+0000", 2024-09-14T09:08:05.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.66e-06 2024-09-14T09:08:05.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922380+0000", 2024-09-14T09:08:05.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012285275 2024-09-14T09:08:05.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922434+0000", 2024-09-14T09:08:05.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3925000000000003e-05 2024-09-14T09:08:05.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922493+0000", 2024-09-14T09:08:05.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9345000000000002e-05 2024-09-14T09:08:05.603 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.603 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.603 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.603 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1519 3.d 3:b36f6c76:::rbd_data.1112f61fa773.0000000000000002:8 [read 1425408~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:05.603 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910131+0000", 2024-09-14T09:08:05.603 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.6642602570000005, 2024-09-14T09:08:05.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012535421999999999, 2024-09-14T09:08:05.604 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.604 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.604 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.604 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.604 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:05.604 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:05.604 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1519 2024-09-14T09:08:05.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.604 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910131+0000", 2024-09-14T09:08:05.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910131+0000", 2024-09-14T09:08:05.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910132+0000", 2024-09-14T09:08:05.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1399999999999997e-07 2024-09-14T09:08:05.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910134+0000", 2024-09-14T09:08:05.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6340000000000001e-06 2024-09-14T09:08:05.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910142+0000", 2024-09-14T09:08:05.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8809999999999996e-06 2024-09-14T09:08:05.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910148+0000", 2024-09-14T09:08:05.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1750000000000002e-06 2024-09-14T09:08:05.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922521+0000", 2024-09-14T09:08:05.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012372726000000001 2024-09-14T09:08:05.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922585+0000", 2024-09-14T09:08:05.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4169000000000002e-05 2024-09-14T09:08:05.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922667+0000", 2024-09-14T09:08:05.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1322999999999994e-05 2024-09-14T09:08:05.607 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.608 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.608 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.608 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1524 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 1032192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:05.608 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:05.608 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.6642314870000003, 2024-09-14T09:08:05.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012717483, 2024-09-14T09:08:05.608 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.608 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.608 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.608 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.608 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:05.609 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:05.609 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1524 2024-09-14T09:08:05.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.609 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:05.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:05.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:05.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5499999999999998e-07 2024-09-14T09:08:05.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910163+0000", 2024-09-14T09:08:05.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3180000000000001e-06 2024-09-14T09:08:05.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910169+0000", 2024-09-14T09:08:05.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5139999999999998e-06 2024-09-14T09:08:05.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910176+0000", 2024-09-14T09:08:05.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5169999999999996e-06 2024-09-14T09:08:05.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922695+0000", 2024-09-14T09:08:05.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012519007 2024-09-14T09:08:05.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922775+0000", 2024-09-14T09:08:05.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9958999999999998e-05 2024-09-14T09:08:05.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922877+0000", 2024-09-14T09:08:05.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000102613 2024-09-14T09:08:05.612 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.612 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.612 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.612 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1525 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 1261568~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:05.612 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910183+0000", 2024-09-14T09:08:05.612 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.664208157, 2024-09-14T09:08:05.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012942067999999999, 2024-09-14T09:08:05.613 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.613 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.613 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.613 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.613 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:05.613 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:05.613 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1525 2024-09-14T09:08:05.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.613 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910183+0000", 2024-09-14T09:08:05.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910183+0000", 2024-09-14T09:08:05.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910184+0000", 2024-09-14T09:08:05.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9999999999999998e-07 2024-09-14T09:08:05.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910186+0000", 2024-09-14T09:08:05.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.165e-06 2024-09-14T09:08:05.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910192+0000", 2024-09-14T09:08:05.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3080000000000004e-06 2024-09-14T09:08:05.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910203+0000", 2024-09-14T09:08:05.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0586e-05 2024-09-14T09:08:05.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922932+0000", 2024-09-14T09:08:05.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012728882 2024-09-14T09:08:05.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923028+0000", 2024-09-14T09:08:05.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6531000000000001e-05 2024-09-14T09:08:05.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923125+0000", 2024-09-14T09:08:05.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7195999999999996e-05 2024-09-14T09:08:05.617 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.617 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.617 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.617 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1527 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 999424~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:05.617 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910210+0000", 2024-09-14T09:08:05.617 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.6641812500000004, 2024-09-14T09:08:05.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013037887999999999, 2024-09-14T09:08:05.617 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.617 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.617 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.617 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.618 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:05.618 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:05.618 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1527 2024-09-14T09:08:05.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.618 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910210+0000", 2024-09-14T09:08:05.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910210+0000", 2024-09-14T09:08:05.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910211+0000", 2024-09-14T09:08:05.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8800000000000003e-07 2024-09-14T09:08:05.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910213+0000", 2024-09-14T09:08:05.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0820000000000001e-06 2024-09-14T09:08:05.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910219+0000", 2024-09-14T09:08:05.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0789999999999997e-06 2024-09-14T09:08:05.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910224+0000", 2024-09-14T09:08:05.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7299999999999996e-06 2024-09-14T09:08:05.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923158+0000", 2024-09-14T09:08:05.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012934200999999999 2024-09-14T09:08:05.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923197+0000", 2024-09-14T09:08:05.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9020999999999998e-05 2024-09-14T09:08:05.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923248+0000", 2024-09-14T09:08:05.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1286999999999999e-05 2024-09-14T09:08:05.622 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.622 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.622 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.622 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1528 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1228800~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:05.623 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:05.623 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.6641614019999995, 2024-09-14T09:08:05.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013235419, 2024-09-14T09:08:05.623 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.623 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.623 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.623 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.623 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:05.623 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:05.623 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1528 2024-09-14T09:08:05.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.623 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:05.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:05.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:05.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.01e-07 2024-09-14T09:08:05.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910232+0000", 2024-09-14T09:08:05.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9589999999999998e-06 2024-09-14T09:08:05.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910238+0000", 2024-09-14T09:08:05.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8200000000000002e-06 2024-09-14T09:08:05.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910243+0000", 2024-09-14T09:08:05.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8369999999999996e-06 2024-09-14T09:08:05.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923281+0000", 2024-09-14T09:08:05.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013037613 2024-09-14T09:08:05.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923360+0000", 2024-09-14T09:08:05.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9717999999999998e-05 2024-09-14T09:08:05.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923465+0000", 2024-09-14T09:08:05.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000105071 2024-09-14T09:08:05.627 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.627 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.627 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.627 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1544 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 1277952~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:05.627 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:05.627 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.6626024179999996, 2024-09-14T09:08:05.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012301747, 2024-09-14T09:08:05.627 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.627 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.627 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.628 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.628 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:05.628 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:05.628 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1544 2024-09-14T09:08:05.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.628 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:05.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:05.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:05.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1500000000000005e-07 2024-09-14T09:08:05.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911793+0000", 2024-09-14T09:08:05.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6689999999999999e-06 2024-09-14T09:08:05.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911802+0000", 2024-09-14T09:08:05.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4710000000000007e-06 2024-09-14T09:08:05.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911807+0000", 2024-09-14T09:08:05.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5799999999999999e-06 2024-09-14T09:08:05.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923930+0000", 2024-09-14T09:08:05.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012123083 2024-09-14T09:08:05.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924013+0000", 2024-09-14T09:08:05.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2560999999999998e-05 2024-09-14T09:08:05.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924091+0000", 2024-09-14T09:08:05.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7867999999999994e-05 2024-09-14T09:08:05.631 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.631 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.631 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.632 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1547 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:05.632 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.911814+0000", 2024-09-14T09:08:05.632 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.662577314, 2024-09-14T09:08:05.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012405057000000001, 2024-09-14T09:08:05.632 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.632 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.632 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.632 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.632 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:05.632 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:05.632 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1547 2024-09-14T09:08:05.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.633 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911814+0000", 2024-09-14T09:08:05.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911814+0000", 2024-09-14T09:08:05.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911815+0000", 2024-09-14T09:08:05.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3000000000000001e-07 2024-09-14T09:08:05.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911816+0000", 2024-09-14T09:08:05.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.75e-06 2024-09-14T09:08:05.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911823+0000", 2024-09-14T09:08:05.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6189999999999996e-06 2024-09-14T09:08:05.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911828+0000", 2024-09-14T09:08:05.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5539999999999997e-06 2024-09-14T09:08:05.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924119+0000", 2024-09-14T09:08:05.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012290967 2024-09-14T09:08:05.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924162+0000", 2024-09-14T09:08:05.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2422999999999997e-05 2024-09-14T09:08:05.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924219+0000", 2024-09-14T09:08:05.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7314e-05 2024-09-14T09:08:05.636 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.636 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.636 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.636 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1548 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1245184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:05.636 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.911850+0000", 2024-09-14T09:08:05.636 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.6625413580000004, 2024-09-14T09:08:05.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012607343, 2024-09-14T09:08:05.637 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.637 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.637 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.637 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.637 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:05.637 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:05.637 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1548 2024-09-14T09:08:05.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.637 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911850+0000", 2024-09-14T09:08:05.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911850+0000", 2024-09-14T09:08:05.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911851+0000", 2024-09-14T09:08:05.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4199999999999996e-07 2024-09-14T09:08:05.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911853+0000", 2024-09-14T09:08:05.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.283e-06 2024-09-14T09:08:05.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911860+0000", 2024-09-14T09:08:05.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2069999999999998e-06 2024-09-14T09:08:05.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911866+0000", 2024-09-14T09:08:05.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.161e-06 2024-09-14T09:08:05.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924276+0000", 2024-09-14T09:08:05.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012409531 2024-09-14T09:08:05.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924371+0000", 2024-09-14T09:08:05.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4826000000000003e-05 2024-09-14T09:08:05.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924457+0000", 2024-09-14T09:08:05.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6792999999999994e-05 2024-09-14T09:08:05.641 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.641 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.641 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.641 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1566 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1032192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:05.641 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.913266+0000", 2024-09-14T09:08:05.641 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.6611253069999998, 2024-09-14T09:08:05.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012340884999999999, 2024-09-14T09:08:05.641 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.641 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.641 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.642 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.642 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:05.642 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:05.642 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1566 2024-09-14T09:08:05.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.642 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913266+0000", 2024-09-14T09:08:05.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913266+0000", 2024-09-14T09:08:05.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913267+0000", 2024-09-14T09:08:05.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6899999999999998e-07 2024-09-14T09:08:05.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913269+0000", 2024-09-14T09:08:05.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9589999999999998e-06 2024-09-14T09:08:05.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913275+0000", 2024-09-14T09:08:05.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4969999999999998e-06 2024-09-14T09:08:05.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913280+0000", 2024-09-14T09:08:05.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2039999999999996e-06 2024-09-14T09:08:05.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925517+0000", 2024-09-14T09:08:05.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012236784000000001 2024-09-14T09:08:05.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925556+0000", 2024-09-14T09:08:05.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9121e-05 2024-09-14T09:08:05.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925607+0000", 2024-09-14T09:08:05.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0850999999999998e-05 2024-09-14T09:08:05.645 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.645 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.645 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.645 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1567 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1261568~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:05.646 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:05.646 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.6611047150000005, 2024-09-14T09:08:05.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012537243, 2024-09-14T09:08:05.646 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.646 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.646 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.646 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.646 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:05.646 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:05.646 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1567 2024-09-14T09:08:05.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.646 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:05.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:05.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:05.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8099999999999998e-07 2024-09-14T09:08:05.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913289+0000", 2024-09-14T09:08:05.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9350000000000001e-06 2024-09-14T09:08:05.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913295+0000", 2024-09-14T09:08:05.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4540000000000004e-06 2024-09-14T09:08:05.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913300+0000", 2024-09-14T09:08:05.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9189999999999998e-06 2024-09-14T09:08:05.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925641+0000", 2024-09-14T09:08:05.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012340378000000001 2024-09-14T09:08:05.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925726+0000", 2024-09-14T09:08:05.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5504e-05 2024-09-14T09:08:05.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925824+0000", 2024-09-14T09:08:05.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7671999999999996e-05 2024-09-14T09:08:05.650 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.650 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.650 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.650 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3470 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 4374528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:05.650 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039718+0000", 2024-09-14T09:08:05.650 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.5346730600000003, 2024-09-14T09:08:05.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012430363, 2024-09-14T09:08:05.650 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.650 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.650 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.650 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.651 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:05.651 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:05.651 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3470 2024-09-14T09:08:05.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.651 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039718+0000", 2024-09-14T09:08:05.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039718+0000", 2024-09-14T09:08:05.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039719+0000", 2024-09-14T09:08:05.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0200000000000003e-07 2024-09-14T09:08:05.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039721+0000", 2024-09-14T09:08:05.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4380000000000002e-06 2024-09-14T09:08:05.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039727+0000", 2024-09-14T09:08:05.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2620000000000004e-06 2024-09-14T09:08:05.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039733+0000", 2024-09-14T09:08:05.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1730000000000003e-06 2024-09-14T09:08:05.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.051980+0000", 2024-09-14T09:08:05.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012247872999999999 2024-09-14T09:08:05.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052056+0000", 2024-09-14T09:08:05.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5766999999999995e-05 2024-09-14T09:08:05.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052149+0000", 2024-09-14T09:08:05.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2448000000000007e-05 2024-09-14T09:08:05.654 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.654 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.654 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.654 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3473 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 4112384~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:05.654 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039746+0000", 2024-09-14T09:08:05.655 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.5346452990000001, 2024-09-14T09:08:05.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012654228999999999, 2024-09-14T09:08:05.655 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.655 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.655 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.655 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.655 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:05.655 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:05.655 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3473 2024-09-14T09:08:05.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.655 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039746+0000", 2024-09-14T09:08:05.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039746+0000", 2024-09-14T09:08:05.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039747+0000", 2024-09-14T09:08:05.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5499999999999998e-07 2024-09-14T09:08:05.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039749+0000", 2024-09-14T09:08:05.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4380000000000002e-06 2024-09-14T09:08:05.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039759+0000", 2024-09-14T09:08:05.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7110000000000007e-06 2024-09-14T09:08:05.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039764+0000", 2024-09-14T09:08:05.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3680000000000001e-06 2024-09-14T09:08:05.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052199+0000", 2024-09-14T09:08:05.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012434726 2024-09-14T09:08:05.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052283+0000", 2024-09-14T09:08:05.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4091000000000005e-05 2024-09-14T09:08:05.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052400+0000", 2024-09-14T09:08:05.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011744 2024-09-14T09:08:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3474 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 4341760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039772+0000", 2024-09-14T09:08:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.5346190669999995, 2024-09-14T09:08:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012822623999999999, 2024-09-14T09:08:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3474 2024-09-14T09:08:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039772+0000", 2024-09-14T09:08:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039772+0000", 2024-09-14T09:08:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039773+0000", 2024-09-14T09:08:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1199999999999998e-07 2024-09-14T09:08:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039775+0000", 2024-09-14T09:08:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9709999999999998e-06 2024-09-14T09:08:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039781+0000", 2024-09-14T09:08:05.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5150000000000003e-06 2024-09-14T09:08:05.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039786+0000", 2024-09-14T09:08:05.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9710000000000003e-06 2024-09-14T09:08:05.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052437+0000", 2024-09-14T09:08:05.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012650539000000001 2024-09-14T09:08:05.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052508+0000", 2024-09-14T09:08:05.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1038999999999995e-05 2024-09-14T09:08:05.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052595+0000", 2024-09-14T09:08:05.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7176999999999996e-05 2024-09-14T09:08:05.663 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.663 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.663 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.663 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3475 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 4571136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:05.663 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:05.664 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.5345987540000001, 2024-09-14T09:08:05.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013000444999999999, 2024-09-14T09:08:05.664 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:05.664 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:05.664 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:05.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:05.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:05.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:05.664 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3475 2024-09-14T09:08:05.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.664 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:05.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:05.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:05.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:05.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:05.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:05.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:05.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:05.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.46e-07 2024-09-14T09:08:05.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:05.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039795+0000", 2024-09-14T09:08:05.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.863e-06 2024-09-14T09:08:05.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:05.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039802+0000", 2024-09-14T09:08:05.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3780000000000003e-06 2024-09-14T09:08:05.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:05.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039807+0000", 2024-09-14T09:08:05.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2170000000000002e-06 2024-09-14T09:08:05.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:05.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052636+0000", 2024-09-14T09:08:05.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012828278 2024-09-14T09:08:05.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:05.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052714+0000", 2024-09-14T09:08:05.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7824999999999994e-05 2024-09-14T09:08:05.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:05.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:05.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:05.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052793+0000", 2024-09-14T09:08:05.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9537999999999996e-05 2024-09-14T09:08:05.667 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.668 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.668 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.668 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:05.668 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:05.668 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:05.670 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:08:05.670 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:05.670 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:05.671 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:05.671+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:05.683 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:05.683 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:05.700 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:08:05.700 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:08:05.717 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:05.717 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:05.733 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:05.733 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:05.750 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:05.750 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:05.770 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:05.773+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:05.787 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:05.787 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:05.796 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:08:05.880 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:05.882+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:05.945 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:05.945 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:05.954 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:08:05.972 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:05.974+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:06.073 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:06.075+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:06.101 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:06.101 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:06.110 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:08:06.135 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #8, image image_client.0-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent9 2024-09-14T09:08:06.174 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:06.176+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:06.224 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:06.224 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:06.233 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:08:06.264 INFO:teuthology.orchestra.run.smithi148.stdout:1342 write 0xe100800 thru 0xe10bc06 (0xb407 bytes) 2024-09-14T09:08:06.265 INFO:teuthology.orchestra.run.smithi148.stdout:1343 write 0xc793000 thru 0xc79e415 (0xb416 bytes) 2024-09-14T09:08:06.265 INFO:teuthology.orchestra.run.smithi148.stdout:1344 write 0xc1a7000 thru 0xc1a7631 (0x632 bytes) 2024-09-14T09:08:06.265 INFO:teuthology.orchestra.run.smithi148.stdout:1345 write 0x7e60200 thru 0x7e63521 (0x3322 bytes) 2024-09-14T09:08:06.275 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:06.277+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:06.277 INFO:teuthology.orchestra.run.smithi148.stdout:1347 trunc from 0xe10be00 to 0x3097800 2024-09-14T09:08:06.308 INFO:teuthology.orchestra.run.smithi148.stdout:1348 punch from 0x14af200 to 0x14af800, (0x600 bytes) 2024-09-14T09:08:06.308 INFO:teuthology.orchestra.run.smithi148.stdout:1352 read 0x3014200 thru 0x30166f7 (0x24f8 bytes) 2024-09-14T09:08:06.308 INFO:teuthology.orchestra.run.smithi148.stdout:1353 read 0x1730e00 thru 0x173f1e0 (0xe3e1 bytes) 2024-09-14T09:08:06.321 INFO:teuthology.orchestra.run.smithi148.stdout:1355 write 0x5e0f200 thru 0x5e17fc0 (0x8dc1 bytes) 2024-09-14T09:08:06.327 INFO:teuthology.orchestra.run.smithi148.stdout:1357 read 0x4b09000 thru 0x4b09202 (0x203 bytes) 2024-09-14T09:08:06.340 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:06.340 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:06.344 INFO:teuthology.orchestra.run.smithi148.stdout:1359 write 0x5e5c000 thru 0x5e627f0 (0x67f1 bytes) 2024-09-14T09:08:06.346 INFO:teuthology.orchestra.run.smithi148.stdout:1360 read 0x10c3200 thru 0x10c51dd (0x1fde bytes) 2024-09-14T09:08:06.346 INFO:teuthology.orchestra.run.smithi148.stdout:1362 read 0x156d400 thru 0x15782ee (0xaeef bytes) 2024-09-14T09:08:06.346 INFO:teuthology.orchestra.run.smithi148.stdout:1363 punch from 0xf47800 to 0xf4b200, (0x3a00 bytes) 2024-09-14T09:08:06.347 INFO:teuthology.orchestra.run.smithi148.stdout:1364 punch from 0x58db000 to 0x58eaa00, (0xfa00 bytes) 2024-09-14T09:08:06.347 INFO:teuthology.orchestra.run.smithi148.stdout:1365 punch from 0x40afe00 to 0x40b7e00, (0x8000 bytes) 2024-09-14T09:08:06.348 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:08:06.369 INFO:teuthology.orchestra.run.smithi148.stdout:1366 write 0xc6ba200 thru 0xc6be8a8 (0x46a9 bytes) 2024-09-14T09:08:06.373 INFO:teuthology.orchestra.run.smithi148.stdout:1368 trunc from 0xc6bea00 to 0x953fa00 2024-09-14T09:08:06.388 INFO:teuthology.orchestra.run.smithi148.stdout:1371 write 0x307c000 thru 0x308584d (0x984e bytes) 2024-09-14T09:08:06.389 INFO:teuthology.orchestra.run.smithi148.stdout:1374 punch from 0x2dfa400 to 0x2e00600, (0x6200 bytes) 2024-09-14T09:08:06.389 INFO:teuthology.orchestra.run.smithi148.stdout:1376 read 0xf37400 thru 0xf4688f (0xf490 bytes) 2024-09-14T09:08:06.392 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:06.395+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:06.398 INFO:teuthology.orchestra.run.smithi148.stdout:1377 trunc from 0x953fa00 to 0x2c51000 2024-09-14T09:08:06.418 INFO:teuthology.orchestra.run.smithi148.stdout:1378 write 0x271ba00 thru 0x272154d (0x5b4e bytes) 2024-09-14T09:08:06.450 INFO:teuthology.orchestra.run.smithi148.stdout:1380 write 0xbc39600 thru 0xbc48ce7 (0xf6e8 bytes) 2024-09-14T09:08:06.453 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:06.453 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:06.461 INFO:teuthology.orchestra.run.smithi148.stdout:1381 trunc from 0xbc48e00 to 0x280fe00 2024-09-14T09:08:06.462 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:08:06.477 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:06.478+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:06.485 INFO:teuthology.orchestra.run.smithi148.stdout:1382 read 0x239de00 thru 0x23a8fe4 (0xb1e5 bytes) 2024-09-14T09:08:06.500 INFO:teuthology.orchestra.run.smithi148.stdout:1383 write 0x2b5b200 thru 0x2b62fe8 (0x7de9 bytes) 2024-09-14T09:08:06.500 INFO:teuthology.orchestra.run.smithi148.stdout:1384 punch from 0x1d98e00 to 0x1d9b800, (0x2a00 bytes) 2024-09-14T09:08:06.500 INFO:teuthology.orchestra.run.smithi148.stdout:1385 punch from 0x90f400 to 0x916000, (0x6c00 bytes) 2024-09-14T09:08:06.513 INFO:teuthology.orchestra.run.smithi148.stdout:1386 trunc from 0x2b63000 to 0xd369e00 2024-09-14T09:08:06.521 INFO:teuthology.orchestra.run.smithi148.stdout:1389 read 0x4ca3400 thru 0x4cad829 (0xa42a bytes) 2024-09-14T09:08:06.528 INFO:teuthology.orchestra.run.smithi148.stdout:1390 punch from 0x6a66400 to 0x6a6f800, (0x9400 bytes) 2024-09-14T09:08:06.528 INFO:teuthology.orchestra.run.smithi148.stdout:1391 punch from 0x2931800 to 0x2934c00, (0x3400 bytes) 2024-09-14T09:08:06.545 INFO:teuthology.orchestra.run.smithi148.stdout:1397 write 0xd8c7800 thru 0xd8c8560 (0xd61 bytes) 2024-09-14T09:08:06.546 INFO:teuthology.orchestra.run.smithi148.stdout:1399 read 0x2177600 thru 0x21850b2 (0xdab3 bytes) 2024-09-14T09:08:06.547 INFO:teuthology.orchestra.run.smithi148.stdout:1400 punch from 0x633f000 to 0x6347400, (0x8400 bytes) 2024-09-14T09:08:06.547 INFO:teuthology.orchestra.run.smithi148.stdout:1401 write 0x655a00 thru 0x657871 (0x1e72 bytes) 2024-09-14T09:08:06.562 INFO:teuthology.orchestra.run.smithi148.stdout:1405 trunc from 0xd8c8600 to 0x153ba00 2024-09-14T09:08:06.577 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:06.580+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:06.596 INFO:teuthology.orchestra.run.smithi148.stdout:1406 read 0x649c00 thru 0x6526da (0x8adb bytes) 2024-09-14T09:08:06.610 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:06.611 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:06.620 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:08:06.626 INFO:teuthology.orchestra.run.smithi148.stdout:1410 write 0x91a4600 thru 0x91b04dc (0xbedd bytes) 2024-09-14T09:08:06.626 INFO:teuthology.orchestra.run.smithi148.stdout:1412 read 0x5e9d000 thru 0x5e9fb74 (0x2b75 bytes) 2024-09-14T09:08:06.626 INFO:teuthology.orchestra.run.smithi148.stdout:1413 read 0x6800000 thru 0x68072a5 (0x72a6 bytes) 2024-09-14T09:08:06.647 INFO:teuthology.orchestra.run.smithi148.stdout:1417 write 0xbafd000 thru 0xbb062f3 (0x92f4 bytes) 2024-09-14T09:08:06.648 INFO:teuthology.orchestra.run.smithi148.stdout:1419 punch from 0x73bf400 to 0x73c2e00, (0x3a00 bytes) 2024-09-14T09:08:06.648 INFO:teuthology.orchestra.run.smithi148.stdout:1420 read 0x8cd7000 thru 0x8ce5501 (0xe502 bytes) 2024-09-14T09:08:06.648 INFO:teuthology.orchestra.run.smithi148.stdout:1421 write 0x9db8000 thru 0x9db8902 (0x903 bytes) 2024-09-14T09:08:06.648 INFO:teuthology.orchestra.run.smithi148.stdout:1424 read 0xb1d5600 thru 0xb1d89f3 (0x33f4 bytes) 2024-09-14T09:08:06.651 INFO:teuthology.orchestra.run.smithi148.stdout:1425 trunc from 0xbb06400 to 0x88eec00 2024-09-14T09:08:06.678 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:06.680+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:06.679 INFO:teuthology.orchestra.run.smithi148.stdout:1426 read 0x2703200 thru 0x270c483 (0x9284 bytes) 2024-09-14T09:08:06.679 INFO:teuthology.orchestra.run.smithi148.stdout:1427 read 0x1f24e00 thru 0x1f26295 (0x1496 bytes) 2024-09-14T09:08:06.679 INFO:teuthology.orchestra.run.smithi148.stdout:1430 read 0x5fef800 thru 0x5ffaa1b (0xb21c bytes) 2024-09-14T09:08:06.680 INFO:teuthology.orchestra.run.smithi148.stdout:1431 punch from 0xf9aa00 to 0xfa6200, (0xb800 bytes) 2024-09-14T09:08:06.680 INFO:teuthology.orchestra.run.smithi148.stdout:1433 write 0xf4d400 thru 0xf59d61 (0xc962 bytes) 2024-09-14T09:08:06.680 INFO:teuthology.orchestra.run.smithi148.stdout:1435 write 0x2c1ae00 thru 0x2c283a8 (0xd5a9 bytes) 2024-09-14T09:08:06.680 INFO:teuthology.orchestra.run.smithi148.stdout:1436 read 0x54b5a00 thru 0x54be9ff (0x9000 bytes) 2024-09-14T09:08:06.680 INFO:teuthology.orchestra.run.smithi148.stdout:1437 punch from 0x69c6a00 to 0x69d0400, (0x9a00 bytes) 2024-09-14T09:08:06.699 INFO:teuthology.orchestra.run.smithi148.stdout:1438 write 0xbe29e00 thru 0xbe324cb (0x86cc bytes) 2024-09-14T09:08:06.699 INFO:teuthology.orchestra.run.smithi148.stdout:1443 write 0x505c800 thru 0x5065821 (0x9022 bytes) 2024-09-14T09:08:06.700 INFO:teuthology.orchestra.run.smithi148.stdout:1444 trunc from 0xbe32600 to 0xb01f800 2024-09-14T09:08:06.716 INFO:teuthology.orchestra.run.smithi148.stdout:1445 read 0x4f6f400 thru 0x4f78cfb (0x98fc bytes) 2024-09-14T09:08:06.723 INFO:teuthology.orchestra.run.smithi148.stdout:1446 read 0x7d26e00 thru 0x7d30a5d (0x9c5e bytes) 2024-09-14T09:08:06.723 INFO:teuthology.orchestra.run.smithi148.stdout:1448 read 0xa3d800 thru 0xa4b63f (0xde40 bytes) 2024-09-14T09:08:06.734 INFO:teuthology.orchestra.run.smithi148.stdout:1449 write 0xc10a200 thru 0xc10fb76 (0x5977 bytes) 2024-09-14T09:08:06.735 INFO:teuthology.orchestra.run.smithi148.stdout:1452 read 0x5fff600 thru 0x60084ef (0x8ef0 bytes) 2024-09-14T09:08:06.736 INFO:teuthology.orchestra.run.smithi148.stdout:1453 trunc from 0xc10fc00 to 0xbba6000 2024-09-14T09:08:06.752 INFO:teuthology.orchestra.run.smithi148.stdout:1454 trunc from 0xbba6000 to 0xedb5a00 2024-09-14T09:08:06.760 INFO:teuthology.orchestra.run.smithi148.stdout:1457 punch from 0xa65d800 to 0xa661c00, (0x4400 bytes) 2024-09-14T09:08:06.765 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:06.765 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:06.769 INFO:teuthology.orchestra.run.smithi148.stdout:1459 read 0x19ba000 thru 0x19bebb8 (0x4bb9 bytes) 2024-09-14T09:08:06.770 INFO:teuthology.orchestra.run.smithi148.stdout:1460 write 0x36e0a00 thru 0x36ecc52 (0xc253 bytes) 2024-09-14T09:08:06.770 INFO:teuthology.orchestra.run.smithi148.stdout:1461 write 0x88b6000 thru 0x88c42ef (0xe2f0 bytes) 2024-09-14T09:08:06.770 INFO:teuthology.orchestra.run.smithi148.stdout:1463 read 0x43a6800 thru 0x43ac7a1 (0x5fa2 bytes) 2024-09-14T09:08:06.770 INFO:teuthology.orchestra.run.smithi148.stdout:1464 write 0x689b400 thru 0x689f076 (0x3c77 bytes) 2024-09-14T09:08:06.770 INFO:teuthology.orchestra.run.smithi148.stdout:1466 write 0x91b3400 thru 0x91bdb6c (0xa76d bytes) 2024-09-14T09:08:06.772 INFO:teuthology.orchestra.run.smithi148.stdout:1469 trunc from 0xedb5a00 to 0xd832c00 2024-09-14T09:08:06.775 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:08:06.779 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:06.781+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:06.795 INFO:teuthology.orchestra.run.smithi148.stdout:1474 read 0x6b9000 thru 0x6c1330 (0x8331 bytes) 2024-09-14T09:08:06.797 INFO:teuthology.orchestra.run.smithi148.stdout:1475 write 0xcaf8200 thru 0xcaff1e0 (0x6fe1 bytes) 2024-09-14T09:08:06.797 INFO:teuthology.orchestra.run.smithi148.stdout:1478 read 0x735e00 thru 0x73c575 (0x6776 bytes) 2024-09-14T09:08:06.797 INFO:teuthology.orchestra.run.smithi148.stdout:1479 read 0xba78400 thru 0xba78961 (0x562 bytes) 2024-09-14T09:08:06.809 INFO:teuthology.orchestra.run.smithi148.stdout:1484 trunc from 0xd832c00 to 0x3f63c00 2024-09-14T09:08:06.823 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T09:08:06.836 INFO:teuthology.orchestra.run.smithi148.stdout:1485 read 0x733600 thru 0x73c9fc (0x93fd bytes) 2024-09-14T09:08:06.863 INFO:teuthology.orchestra.run.smithi148.stdout:1486 write 0xca93000 thru 0xca98cfd (0x5cfe bytes) 2024-09-14T09:08:06.872 INFO:teuthology.orchestra.run.smithi148.stdout:1487 trunc from 0xca98e00 to 0x4cb5600 2024-09-14T09:08:06.879 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:06.881+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:06.880 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:06.880 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:06.889 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:08:06.909 INFO:teuthology.orchestra.run.smithi148.stdout:1488 write 0xb89bc00 thru 0xb8a8a72 (0xce73 bytes) 2024-09-14T09:08:06.916 INFO:teuthology.orchestra.run.smithi148.stdout:1489 write 0x9674200 thru 0x967f1f4 (0xaff5 bytes) 2024-09-14T09:08:06.916 INFO:teuthology.orchestra.run.smithi148.stdout:1492 write 0xa354400 thru 0xa35f87b (0xb47c bytes) 2024-09-14T09:08:06.929 INFO:teuthology.orchestra.run.smithi148.stdout:1493 trunc from 0xb8a8c00 to 0x317200 2024-09-14T09:08:06.980 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:06.983+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:06.999 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:06.999 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:07.008 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:08:07.027 INFO:teuthology.orchestra.run.smithi148.stdout:1494 trunc from 0x317200 to 0x9c3e600 2024-09-14T09:08:07.035 INFO:teuthology.orchestra.run.smithi148.stdout:1496 punch from 0x893de00 to 0x8949200, (0xb400 bytes) 2024-09-14T09:08:07.041 INFO:teuthology.orchestra.run.smithi148.stdout:1499 read 0x20f7600 thru 0x2106698 (0xf099 bytes) 2024-09-14T09:08:07.041 INFO:teuthology.orchestra.run.smithi148.stdout:1500 punch from 0x4df9200 to 0x4e09000, (0xfe00 bytes) 2024-09-14T09:08:07.047 INFO:teuthology.orchestra.run.smithi148.stdout:1503 trunc from 0x9c3e600 to 0xeca4a00 2024-09-14T09:08:07.055 INFO:teuthology.orchestra.run.smithi148.stdout:1504 read 0x1adb600 thru 0x1ae62fc (0xacfd bytes) 2024-09-14T09:08:07.057 INFO:teuthology.orchestra.run.smithi148.stdout:1509 write 0xbb4fa00 thru 0xbb5e936 (0xef37 bytes) 2024-09-14T09:08:07.057 INFO:teuthology.orchestra.run.smithi148.stdout:1510 read 0xd1dce00 thru 0xd1e7bee (0xadef bytes) 2024-09-14T09:08:07.066 INFO:teuthology.orchestra.run.smithi148.stdout:1511 trunc from 0xeca4a00 to 0x7273800 2024-09-14T09:08:07.084 INFO:teuthology.orchestra.run.smithi148.stdout:1512 punch from 0x2385e00 to 0x2392600, (0xc800 bytes) 2024-09-14T09:08:07.085 INFO:teuthology.orchestra.run.smithi148.stdout:1515 read 0x43aee00 thru 0x43b89ca (0x9bcb bytes) 2024-09-14T09:08:07.090 INFO:teuthology.orchestra.run.smithi148.stdout:1516 trunc from 0x7273800 to 0xb050c00 2024-09-14T09:08:07.093 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:07.095+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:07.111 INFO:teuthology.orchestra.run.smithi148.stdout:1517 write 0xe8bf000 thru 0xe8c4132 (0x5133 bytes) 2024-09-14T09:08:07.112 INFO:teuthology.orchestra.run.smithi148.stdout:1519 write 0xc909a00 thru 0xc90d108 (0x3709 bytes) 2024-09-14T09:08:07.112 INFO:teuthology.orchestra.run.smithi148.stdout:1521 punch from 0x47efc00 to 0x47ff400, (0xf800 bytes) 2024-09-14T09:08:07.113 INFO:teuthology.orchestra.run.smithi148.stdout:1523 punch from 0x7ff6800 to 0x8001600, (0xae00 bytes) 2024-09-14T09:08:07.130 INFO:teuthology.orchestra.run.smithi148.stdout:1524 trunc from 0xe8c4200 to 0x2ca400 2024-09-14T09:08:07.148 INFO:teuthology.orchestra.run.smithi148.stdout:1525 read 0x1a9400 thru 0x1b1509 (0x810a bytes) 2024-09-14T09:08:07.155 INFO:teuthology.orchestra.run.smithi148.stdout:1526 trunc from 0x2ca400 to 0x38ffe00 2024-09-14T09:08:07.158 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:07.158 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:07.162 INFO:teuthology.orchestra.run.smithi148.stdout:1527 read 0x24ca600 thru 0x24cf1bd (0x4bbe bytes) 2024-09-14T09:08:07.167 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:08:07.168 INFO:teuthology.orchestra.run.smithi148.stdout:1528 clone 11 order 23 su 1048576 sc 3 2024-09-14T09:08:07.182 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:07.184+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:07.283 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:07.285+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:07.311 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:07.311 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:07.319 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:08:07.384 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:07.386+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:07.422 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:07.422 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:07.430 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:08:07.515 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:07.517+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:07.573 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:07.573 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:07.581 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:08:07.585 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:07.588+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:07.686 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:07.688+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:07.723 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:07.723 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:07.732 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:08:07.762 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:08:07.816 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:07.818+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:07.827 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is set 2024-09-14T09:08:07.888 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:07.890+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:07.890 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:07.890 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:07.900 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:08:07.902 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:07.903 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:07.906 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone10 from 0x38ffe00 (overlap 0x2ca400) to 0x47600 2024-09-14T09:08:07.926 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:07.927 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:07.950 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:08:07.950 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:08:07.967 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:07.967 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:07.984 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:07.984 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:07.989 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:07.992+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:08.001 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:08.001 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:08.019 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:08.020 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:08.020 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:08.020 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:08.020 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:08.028 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:08:08.113 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:08.115+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:08.173 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:08:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 37.941790378, 2024-09-14T09:08:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72111598600000004, 2024-09-14T09:08:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:08:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:08:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1 2024-09-14T09:08:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233065+0000", 2024-09-14T09:08:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1909999999999999e-06 2024-09-14T09:08:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233071+0000", 2024-09-14T09:08:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5300000000000002e-06 2024-09-14T09:08:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233081+0000", 2024-09-14T09:08:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0339e-05 2024-09-14T09:08:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233093+0000", 2024-09-14T09:08:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1252e-05 2024-09-14T09:08:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233162+0000", 2024-09-14T09:08:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9678999999999995e-05 2024-09-14T09:08:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:08:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233171+0000", 2024-09-14T09:08:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.132e-06 2024-09-14T09:08:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952480+0000", 2024-09-14T09:08:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.71930839899999999 2024-09-14T09:08:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952655+0000", 2024-09-14T09:08:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017552 2024-09-14T09:08:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952835+0000", 2024-09-14T09:08:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001797 2024-09-14T09:08:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.953648+0000", 2024-09-14T09:08:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00081291700000000002 2024-09-14T09:08:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954108+0000", 2024-09-14T09:08:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045992800000000002 2024-09-14T09:08:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954149+0000", 2024-09-14T09:08:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1214999999999998e-05 2024-09-14T09:08:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954178+0000", 2024-09-14T09:08:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9184e-05 2024-09-14T09:08:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1493 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1196032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.2660911880000008, 2024-09-14T09:08:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012302112, 2024-09-14T09:08:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1493 2024-09-14T09:08:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.65e-07 2024-09-14T09:08:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908764+0000", 2024-09-14T09:08:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8589999999999999e-06 2024-09-14T09:08:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908770+0000", 2024-09-14T09:08:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.728e-06 2024-09-14T09:08:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908774+0000", 2024-09-14T09:08:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7609999999999998e-06 2024-09-14T09:08:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.920899+0000", 2024-09-14T09:08:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012125004999999999 2024-09-14T09:08:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.920977+0000", 2024-09-14T09:08:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7564000000000005e-05 2024-09-14T09:08:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.921064+0000", 2024-09-14T09:08:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6829999999999994e-05 2024-09-14T09:08:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1510 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 983040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.2651069980000003, 2024-09-14T09:08:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012360968999999999, 2024-09-14T09:08:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1510 2024-09-14T09:08:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8799999999999998e-07 2024-09-14T09:08:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909748+0000", 2024-09-14T09:08:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9810000000000002e-06 2024-09-14T09:08:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909754+0000", 2024-09-14T09:08:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3609999999999997e-06 2024-09-14T09:08:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909760+0000", 2024-09-14T09:08:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1850000000000003e-06 2024-09-14T09:08:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.921974+0000", 2024-09-14T09:08:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012214426 2024-09-14T09:08:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922015+0000", 2024-09-14T09:08:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0407000000000001e-05 2024-09-14T09:08:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922107+0000", 2024-09-14T09:08:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2220999999999997e-05 2024-09-14T09:08:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1511 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1212416~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.909766+0000", 2024-09-14T09:08:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.2650865909999993, 2024-09-14T09:08:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012473141, 2024-09-14T09:08:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1511 2024-09-14T09:08:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909766+0000", 2024-09-14T09:08:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909766+0000", 2024-09-14T09:08:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909767+0000", 2024-09-14T09:08:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-07 2024-09-14T09:08:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909768+0000", 2024-09-14T09:08:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8050000000000001e-06 2024-09-14T09:08:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909775+0000", 2024-09-14T09:08:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8210000000000004e-06 2024-09-14T09:08:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909780+0000", 2024-09-14T09:08:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3120000000000001e-06 2024-09-14T09:08:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922138+0000", 2024-09-14T09:08:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012358012 2024-09-14T09:08:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922181+0000", 2024-09-14T09:08:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2876000000000001e-05 2024-09-14T09:08:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922239+0000", 2024-09-14T09:08:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7960000000000001e-05 2024-09-14T09:08:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1517 3.d 3:b36f6c76:::rbd_data.1112f61fa773.0000000000000002:8 [read 966656~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910035+0000", 2024-09-14T09:08:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.2648180740000008, 2024-09-14T09:08:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012318664999999999, 2024-09-14T09:08:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1517 2024-09-14T09:08:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910035+0000", 2024-09-14T09:08:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910035+0000", 2024-09-14T09:08:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910036+0000", 2024-09-14T09:08:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7000000000000003e-07 2024-09-14T09:08:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910040+0000", 2024-09-14T09:08:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3220000000000003e-06 2024-09-14T09:08:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910051+0000", 2024-09-14T09:08:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1476e-05 2024-09-14T09:08:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910059+0000", 2024-09-14T09:08:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:08:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922268+0000", 2024-09-14T09:08:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012208910999999999 2024-09-14T09:08:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922305+0000", 2024-09-14T09:08:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7069e-05 2024-09-14T09:08:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922353+0000", 2024-09-14T09:08:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7976999999999998e-05 2024-09-14T09:08:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1518 3.d 3:b36f6c76:::rbd_data.1112f61fa773.0000000000000002:8 [read 1196032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910078+0000", 2024-09-14T09:08:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.2647743850000008, 2024-09-14T09:08:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012415053000000001, 2024-09-14T09:08:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1518 2024-09-14T09:08:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910078+0000", 2024-09-14T09:08:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910078+0000", 2024-09-14T09:08:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910079+0000", 2024-09-14T09:08:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0999999999999998e-07 2024-09-14T09:08:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910082+0000", 2024-09-14T09:08:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7779999999999999e-06 2024-09-14T09:08:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910089+0000", 2024-09-14T09:08:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4599999999999997e-06 2024-09-14T09:08:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910095+0000", 2024-09-14T09:08:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.66e-06 2024-09-14T09:08:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922380+0000", 2024-09-14T09:08:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012285275 2024-09-14T09:08:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922434+0000", 2024-09-14T09:08:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3925000000000003e-05 2024-09-14T09:08:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922493+0000", 2024-09-14T09:08:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9345000000000002e-05 2024-09-14T09:08:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1519 3.d 3:b36f6c76:::rbd_data.1112f61fa773.0000000000000002:8 [read 1425408~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910131+0000", 2024-09-14T09:08:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.2647216120000007, 2024-09-14T09:08:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012535421999999999, 2024-09-14T09:08:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1519 2024-09-14T09:08:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910131+0000", 2024-09-14T09:08:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910131+0000", 2024-09-14T09:08:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910132+0000", 2024-09-14T09:08:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1399999999999997e-07 2024-09-14T09:08:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910134+0000", 2024-09-14T09:08:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6340000000000001e-06 2024-09-14T09:08:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910142+0000", 2024-09-14T09:08:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8809999999999996e-06 2024-09-14T09:08:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910148+0000", 2024-09-14T09:08:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1750000000000002e-06 2024-09-14T09:08:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922521+0000", 2024-09-14T09:08:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012372726000000001 2024-09-14T09:08:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922585+0000", 2024-09-14T09:08:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4169000000000002e-05 2024-09-14T09:08:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922667+0000", 2024-09-14T09:08:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1322999999999994e-05 2024-09-14T09:08:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1524 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 1032192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.2646928420000005, 2024-09-14T09:08:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012717483, 2024-09-14T09:08:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1524 2024-09-14T09:08:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5499999999999998e-07 2024-09-14T09:08:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910163+0000", 2024-09-14T09:08:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3180000000000001e-06 2024-09-14T09:08:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910169+0000", 2024-09-14T09:08:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5139999999999998e-06 2024-09-14T09:08:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910176+0000", 2024-09-14T09:08:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5169999999999996e-06 2024-09-14T09:08:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922695+0000", 2024-09-14T09:08:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012519007 2024-09-14T09:08:08.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.214 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.214 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922775+0000", 2024-09-14T09:08:08.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9958999999999998e-05 2024-09-14T09:08:08.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.214 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.214 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922877+0000", 2024-09-14T09:08:08.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000102613 2024-09-14T09:08:08.214 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.214 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.214 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.215 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1525 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 1261568~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:08.215 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910183+0000", 2024-09-14T09:08:08.215 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.2646695119999993, 2024-09-14T09:08:08.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012942067999999999, 2024-09-14T09:08:08.215 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.215 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.215 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.215 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.215 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:08.216 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:08.216 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1525 2024-09-14T09:08:08.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.216 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910183+0000", 2024-09-14T09:08:08.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910183+0000", 2024-09-14T09:08:08.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910184+0000", 2024-09-14T09:08:08.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9999999999999998e-07 2024-09-14T09:08:08.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910186+0000", 2024-09-14T09:08:08.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.165e-06 2024-09-14T09:08:08.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910192+0000", 2024-09-14T09:08:08.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3080000000000004e-06 2024-09-14T09:08:08.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910203+0000", 2024-09-14T09:08:08.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0586e-05 2024-09-14T09:08:08.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922932+0000", 2024-09-14T09:08:08.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012728882 2024-09-14T09:08:08.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923028+0000", 2024-09-14T09:08:08.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6531000000000001e-05 2024-09-14T09:08:08.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.219 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.219 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923125+0000", 2024-09-14T09:08:08.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7195999999999996e-05 2024-09-14T09:08:08.219 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.219 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.219 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.219 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1527 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 999424~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:08.219 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910210+0000", 2024-09-14T09:08:08.219 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.2646426050000006, 2024-09-14T09:08:08.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013037887999999999, 2024-09-14T09:08:08.220 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.220 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.220 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.220 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.220 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:08.220 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:08.220 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1527 2024-09-14T09:08:08.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.220 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910210+0000", 2024-09-14T09:08:08.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910210+0000", 2024-09-14T09:08:08.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910211+0000", 2024-09-14T09:08:08.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8800000000000003e-07 2024-09-14T09:08:08.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910213+0000", 2024-09-14T09:08:08.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0820000000000001e-06 2024-09-14T09:08:08.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910219+0000", 2024-09-14T09:08:08.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0789999999999997e-06 2024-09-14T09:08:08.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910224+0000", 2024-09-14T09:08:08.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7299999999999996e-06 2024-09-14T09:08:08.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923158+0000", 2024-09-14T09:08:08.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012934200999999999 2024-09-14T09:08:08.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923197+0000", 2024-09-14T09:08:08.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9020999999999998e-05 2024-09-14T09:08:08.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923248+0000", 2024-09-14T09:08:08.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1286999999999999e-05 2024-09-14T09:08:08.223 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.223 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.224 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.224 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1528 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1228800~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:08.224 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:08.224 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.2646227569999997, 2024-09-14T09:08:08.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013235419, 2024-09-14T09:08:08.224 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.224 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.224 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.224 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.224 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:08.224 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:08.225 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1528 2024-09-14T09:08:08.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.225 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.225 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:08.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.225 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:08.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.226 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:08.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.01e-07 2024-09-14T09:08:08.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.226 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910232+0000", 2024-09-14T09:08:08.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9589999999999998e-06 2024-09-14T09:08:08.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.226 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910238+0000", 2024-09-14T09:08:08.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8200000000000002e-06 2024-09-14T09:08:08.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910243+0000", 2024-09-14T09:08:08.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8369999999999996e-06 2024-09-14T09:08:08.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923281+0000", 2024-09-14T09:08:08.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013037613 2024-09-14T09:08:08.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923360+0000", 2024-09-14T09:08:08.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9717999999999998e-05 2024-09-14T09:08:08.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923465+0000", 2024-09-14T09:08:08.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000105071 2024-09-14T09:08:08.228 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.228 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.228 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.228 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1544 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 1277952~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:08.228 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:08.228 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.2630637730000007, 2024-09-14T09:08:08.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012301747, 2024-09-14T09:08:08.229 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.229 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.229 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.229 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.229 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:08.229 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:08.229 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1544 2024-09-14T09:08:08.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.229 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:08.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.230 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.230 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:08.230 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.230 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.230 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:08.230 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1500000000000005e-07 2024-09-14T09:08:08.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.230 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.230 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911793+0000", 2024-09-14T09:08:08.230 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6689999999999999e-06 2024-09-14T09:08:08.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911802+0000", 2024-09-14T09:08:08.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4710000000000007e-06 2024-09-14T09:08:08.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911807+0000", 2024-09-14T09:08:08.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5799999999999999e-06 2024-09-14T09:08:08.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923930+0000", 2024-09-14T09:08:08.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012123083 2024-09-14T09:08:08.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924013+0000", 2024-09-14T09:08:08.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2560999999999998e-05 2024-09-14T09:08:08.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924091+0000", 2024-09-14T09:08:08.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7867999999999994e-05 2024-09-14T09:08:08.232 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.233 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.233 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.233 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1547 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:08.233 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.911814+0000", 2024-09-14T09:08:08.233 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.2630386690000002, 2024-09-14T09:08:08.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012405057000000001, 2024-09-14T09:08:08.233 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.233 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.233 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.233 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.233 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:08.234 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:08.234 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1547 2024-09-14T09:08:08.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.234 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.234 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.234 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911814+0000", 2024-09-14T09:08:08.234 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.234 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.234 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911814+0000", 2024-09-14T09:08:08.234 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.235 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.235 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911815+0000", 2024-09-14T09:08:08.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3000000000000001e-07 2024-09-14T09:08:08.235 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.235 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.235 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911816+0000", 2024-09-14T09:08:08.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.75e-06 2024-09-14T09:08:08.235 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.235 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.235 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911823+0000", 2024-09-14T09:08:08.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6189999999999996e-06 2024-09-14T09:08:08.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.236 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.236 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911828+0000", 2024-09-14T09:08:08.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5539999999999997e-06 2024-09-14T09:08:08.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.236 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.236 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924119+0000", 2024-09-14T09:08:08.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012290967 2024-09-14T09:08:08.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.236 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924162+0000", 2024-09-14T09:08:08.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2422999999999997e-05 2024-09-14T09:08:08.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924219+0000", 2024-09-14T09:08:08.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7314e-05 2024-09-14T09:08:08.237 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.237 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.237 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.237 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1548 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1245184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:08.237 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.911850+0000", 2024-09-14T09:08:08.238 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.2630027130000006, 2024-09-14T09:08:08.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012607343, 2024-09-14T09:08:08.238 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.238 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.238 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.238 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.238 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:08.238 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:08.238 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1548 2024-09-14T09:08:08.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.238 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.238 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.238 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911850+0000", 2024-09-14T09:08:08.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.239 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911850+0000", 2024-09-14T09:08:08.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.239 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911851+0000", 2024-09-14T09:08:08.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4199999999999996e-07 2024-09-14T09:08:08.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911853+0000", 2024-09-14T09:08:08.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.283e-06 2024-09-14T09:08:08.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.240 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911860+0000", 2024-09-14T09:08:08.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2069999999999998e-06 2024-09-14T09:08:08.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.240 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911866+0000", 2024-09-14T09:08:08.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.161e-06 2024-09-14T09:08:08.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924276+0000", 2024-09-14T09:08:08.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012409531 2024-09-14T09:08:08.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924371+0000", 2024-09-14T09:08:08.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4826000000000003e-05 2024-09-14T09:08:08.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924457+0000", 2024-09-14T09:08:08.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6792999999999994e-05 2024-09-14T09:08:08.241 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.242 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.242 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.242 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.242 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1566 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1032192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:08.242 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.913266+0000", 2024-09-14T09:08:08.242 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.2615866619999991, 2024-09-14T09:08:08.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012340884999999999, 2024-09-14T09:08:08.242 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.242 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.242 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.242 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.242 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:08.242 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:08.243 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1566 2024-09-14T09:08:08.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.243 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913266+0000", 2024-09-14T09:08:08.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913266+0000", 2024-09-14T09:08:08.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913267+0000", 2024-09-14T09:08:08.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6899999999999998e-07 2024-09-14T09:08:08.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913269+0000", 2024-09-14T09:08:08.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9589999999999998e-06 2024-09-14T09:08:08.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913275+0000", 2024-09-14T09:08:08.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4969999999999998e-06 2024-09-14T09:08:08.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913280+0000", 2024-09-14T09:08:08.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2039999999999996e-06 2024-09-14T09:08:08.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925517+0000", 2024-09-14T09:08:08.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012236784000000001 2024-09-14T09:08:08.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925556+0000", 2024-09-14T09:08:08.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9121e-05 2024-09-14T09:08:08.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.246 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.246 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.246 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925607+0000", 2024-09-14T09:08:08.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0850999999999998e-05 2024-09-14T09:08:08.246 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.246 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.246 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.246 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.246 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.246 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1567 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1261568~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:08.246 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:08.246 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.2615660700000006, 2024-09-14T09:08:08.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012537243, 2024-09-14T09:08:08.246 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.247 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.247 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.247 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.247 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:08.247 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:08.247 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1567 2024-09-14T09:08:08.247 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.247 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.247 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.247 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.247 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:08.247 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.247 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.247 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.248 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.248 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:08.248 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.248 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.248 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.248 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.248 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:08.248 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8099999999999998e-07 2024-09-14T09:08:08.248 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.248 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.248 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.248 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913289+0000", 2024-09-14T09:08:08.248 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9350000000000001e-06 2024-09-14T09:08:08.248 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.249 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.249 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.249 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913295+0000", 2024-09-14T09:08:08.249 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4540000000000004e-06 2024-09-14T09:08:08.249 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.249 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.249 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.249 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913300+0000", 2024-09-14T09:08:08.249 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9189999999999998e-06 2024-09-14T09:08:08.249 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.249 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.249 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.249 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925641+0000", 2024-09-14T09:08:08.250 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012340378000000001 2024-09-14T09:08:08.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.250 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.250 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925726+0000", 2024-09-14T09:08:08.250 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5504e-05 2024-09-14T09:08:08.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.250 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.250 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925824+0000", 2024-09-14T09:08:08.250 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7671999999999996e-05 2024-09-14T09:08:08.250 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.250 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.251 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.251 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3470 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 4374528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:08.251 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039718+0000", 2024-09-14T09:08:08.251 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.1351344149999996, 2024-09-14T09:08:08.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012430363, 2024-09-14T09:08:08.251 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.251 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.251 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.251 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.251 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:08.251 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:08.251 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3470 2024-09-14T09:08:08.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.252 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039718+0000", 2024-09-14T09:08:08.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039718+0000", 2024-09-14T09:08:08.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039719+0000", 2024-09-14T09:08:08.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0200000000000003e-07 2024-09-14T09:08:08.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039721+0000", 2024-09-14T09:08:08.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4380000000000002e-06 2024-09-14T09:08:08.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039727+0000", 2024-09-14T09:08:08.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2620000000000004e-06 2024-09-14T09:08:08.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039733+0000", 2024-09-14T09:08:08.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1730000000000003e-06 2024-09-14T09:08:08.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.051980+0000", 2024-09-14T09:08:08.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012247872999999999 2024-09-14T09:08:08.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052056+0000", 2024-09-14T09:08:08.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5766999999999995e-05 2024-09-14T09:08:08.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.255 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.255 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052149+0000", 2024-09-14T09:08:08.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2448000000000007e-05 2024-09-14T09:08:08.255 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.255 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.255 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.255 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3473 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 4112384~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:08.255 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039746+0000", 2024-09-14T09:08:08.255 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.1351066539999994, 2024-09-14T09:08:08.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012654228999999999, 2024-09-14T09:08:08.255 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.256 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.256 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.256 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.256 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:08.256 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:08.256 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3473 2024-09-14T09:08:08.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.256 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.256 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039746+0000", 2024-09-14T09:08:08.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039746+0000", 2024-09-14T09:08:08.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039747+0000", 2024-09-14T09:08:08.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5499999999999998e-07 2024-09-14T09:08:08.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039749+0000", 2024-09-14T09:08:08.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4380000000000002e-06 2024-09-14T09:08:08.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.258 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039759+0000", 2024-09-14T09:08:08.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7110000000000007e-06 2024-09-14T09:08:08.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.258 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039764+0000", 2024-09-14T09:08:08.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3680000000000001e-06 2024-09-14T09:08:08.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.258 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052199+0000", 2024-09-14T09:08:08.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012434726 2024-09-14T09:08:08.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052283+0000", 2024-09-14T09:08:08.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4091000000000005e-05 2024-09-14T09:08:08.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052400+0000", 2024-09-14T09:08:08.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011744 2024-09-14T09:08:08.259 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.259 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.259 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.260 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3474 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 4341760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:08.260 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039772+0000", 2024-09-14T09:08:08.260 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.1350804219999997, 2024-09-14T09:08:08.260 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012822623999999999, 2024-09-14T09:08:08.260 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.260 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.260 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.260 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.260 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:08.260 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:08.260 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3474 2024-09-14T09:08:08.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.260 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.261 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039772+0000", 2024-09-14T09:08:08.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.261 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039772+0000", 2024-09-14T09:08:08.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.261 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039773+0000", 2024-09-14T09:08:08.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1199999999999998e-07 2024-09-14T09:08:08.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.262 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039775+0000", 2024-09-14T09:08:08.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9709999999999998e-06 2024-09-14T09:08:08.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.262 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039781+0000", 2024-09-14T09:08:08.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5150000000000003e-06 2024-09-14T09:08:08.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.263 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039786+0000", 2024-09-14T09:08:08.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9710000000000003e-06 2024-09-14T09:08:08.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.263 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.263 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052437+0000", 2024-09-14T09:08:08.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012650539000000001 2024-09-14T09:08:08.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052508+0000", 2024-09-14T09:08:08.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1038999999999995e-05 2024-09-14T09:08:08.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052595+0000", 2024-09-14T09:08:08.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7176999999999996e-05 2024-09-14T09:08:08.264 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.264 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.264 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.265 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3475 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 4571136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:08.265 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:08.265 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.1350601089999994, 2024-09-14T09:08:08.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013000444999999999, 2024-09-14T09:08:08.265 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.265 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.265 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.265 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.265 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:08.265 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:08.265 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3475 2024-09-14T09:08:08.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.266 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.266 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:08.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.266 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:08.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.266 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:08.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.46e-07 2024-09-14T09:08:08.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039795+0000", 2024-09-14T09:08:08.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.863e-06 2024-09-14T09:08:08.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039802+0000", 2024-09-14T09:08:08.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3780000000000003e-06 2024-09-14T09:08:08.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039807+0000", 2024-09-14T09:08:08.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2170000000000002e-06 2024-09-14T09:08:08.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052636+0000", 2024-09-14T09:08:08.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012828278 2024-09-14T09:08:08.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052714+0000", 2024-09-14T09:08:08.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7824999999999994e-05 2024-09-14T09:08:08.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052793+0000", 2024-09-14T09:08:08.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9537999999999996e-05 2024-09-14T09:08:08.269 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.269 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.269 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.269 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.269 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.269 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:08.270 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #9, image image_client.0-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent10 2024-09-14T09:08:08.271 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:08:08.272 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:08.272+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:08.301 INFO:teuthology.orchestra.run.smithi148.stdout:1529 trunc from 0x38ffe00 to 0x817f600 2024-09-14T09:08:08.314 INFO:teuthology.orchestra.run.smithi148.stdout:1530 write 0x5ab7a00 thru 0x5abcc64 (0x5265 bytes) 2024-09-14T09:08:08.320 INFO:teuthology.orchestra.run.smithi148.stdout:1532 punch from 0x1720800 to 0x172c400, (0xbc00 bytes) 2024-09-14T09:08:08.322 INFO:teuthology.orchestra.run.smithi148.stdout:1533 read 0x9f2200 thru 0x9f5573 (0x3374 bytes) 2024-09-14T09:08:08.337 INFO:teuthology.orchestra.run.smithi148.stdout:1535 write 0xd57f000 thru 0xd586971 (0x7972 bytes) 2024-09-14T09:08:08.342 INFO:teuthology.orchestra.run.smithi148.stdout:1536 write 0x1170e00 thru 0x1174daa (0x3fab bytes) 2024-09-14T09:08:08.343 INFO:teuthology.orchestra.run.smithi148.stdout:1537 punch from 0x2762200 to 0x2764200, (0x2000 bytes) 2024-09-14T09:08:08.344 INFO:teuthology.orchestra.run.smithi148.stdout:1542 read 0x3ba7800 thru 0x3ba80c6 (0x8c7 bytes) 2024-09-14T09:08:08.344 INFO:teuthology.orchestra.run.smithi148.stdout:1545 write 0xa9f1600 thru 0xa9fa420 (0x8e21 bytes) 2024-09-14T09:08:08.344 INFO:teuthology.orchestra.run.smithi148.stdout:1546 read 0x81a2c00 thru 0x81a9466 (0x6867 bytes) 2024-09-14T09:08:08.344 INFO:teuthology.orchestra.run.smithi148.stdout:1554 write 0xaf86a00 thru 0xaf92f09 (0xc50a bytes) 2024-09-14T09:08:08.356 INFO:teuthology.orchestra.run.smithi148.stdout:1556 write 0xdd4d600 thru 0xdd562d7 (0x8cd8 bytes) 2024-09-14T09:08:08.363 INFO:teuthology.orchestra.run.smithi148.stdout:1557 read 0x9830c00 thru 0x983a93b (0x9d3c bytes) 2024-09-14T09:08:08.363 INFO:teuthology.orchestra.run.smithi148.stdout:1558 write 0xd543800 thru 0xd544175 (0x976 bytes) 2024-09-14T09:08:08.365 INFO:teuthology.orchestra.run.smithi148.stdout:1559 read 0xa13d600 thru 0xa14afd3 (0xd9d4 bytes) 2024-09-14T09:08:08.365 INFO:teuthology.orchestra.run.smithi148.stdout:1560 write 0xa7d3400 thru 0xa7ddda8 (0xa9a9 bytes) 2024-09-14T09:08:08.371 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:08.373+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:08.376 INFO:teuthology.orchestra.run.smithi148.stdout:1561 trunc from 0xdd56400 to 0x4867400 2024-09-14T09:08:08.394 INFO:teuthology.orchestra.run.smithi148.stdout:1562 read 0xecf000 thru 0xed3733 (0x4734 bytes) 2024-09-14T09:08:08.402 INFO:teuthology.orchestra.run.smithi148.stdout:1564 read 0x154a400 thru 0x154e331 (0x3f32 bytes) 2024-09-14T09:08:08.409 INFO:teuthology.orchestra.run.smithi148.stdout:1566 trunc from 0x4867400 to 0xb5ff000 2024-09-14T09:08:08.418 INFO:teuthology.orchestra.run.smithi148.stdout:1569 read 0x3fc8400 thru 0x3fd0d4b (0x894c bytes) 2024-09-14T09:08:08.419 INFO:teuthology.orchestra.run.smithi148.stdout:1573 write 0x6052600 thru 0x6058b62 (0x6563 bytes) 2024-09-14T09:08:08.419 INFO:teuthology.orchestra.run.smithi148.stdout:1574 punch from 0x3eef000 to 0x3ef7a00, (0x8a00 bytes) 2024-09-14T09:08:08.421 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4767.0:428 3.5 3:a7a3a0ba:::rbd_object_map.11127821cd14:head [call lock.assert_locked in=44b,call rbd.object_map_update in=38b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-14T09:08:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:08.422252+0000", 2024-09-14T09:08:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0015687909999999999, 2024-09-14T09:08:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001587069, 2024-09-14T09:08:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-09-14T09:08:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4767", 2024-09-14T09:08:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1937220723", 2024-09-14T09:08:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 428 2024-09-14T09:08:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.422252+0000", 2024-09-14T09:08:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.422252+0000", 2024-09-14T09:08:08.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.422253+0000", 2024-09-14T09:08:08.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9500000000000001e-07 2024-09-14T09:08:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.422258+0000", 2024-09-14T09:08:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8559999999999998e-06 2024-09-14T09:08:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.422271+0000", 2024-09-14T09:08:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3337e-05 2024-09-14T09:08:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.422279+0000", 2024-09-14T09:08:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.627e-06 2024-09-14T09:08:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.422329+0000", 2024-09-14T09:08:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0138e-05 2024-09-14T09:08:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.422416+0000", 2024-09-14T09:08:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6909000000000004e-05 2024-09-14T09:08:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 3", 2024-09-14T09:08:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.422664+0000", 2024-09-14T09:08:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000247996 2024-09-14T09:08:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.423215+0000", 2024-09-14T09:08:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000550666 2024-09-14T09:08:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4767.0:430 3.5 3:a7a3a0ba:::rbd_object_map.11127821cd14:head [call lock.assert_locked in=44b,call rbd.object_map_update in=38b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-14T09:08:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:08.423296+0000", 2024-09-14T09:08:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00052506700000000005, 2024-09-14T09:08:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058591600000000002, 2024-09-14T09:08:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-09-14T09:08:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4767", 2024-09-14T09:08:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1937220723", 2024-09-14T09:08:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 430 2024-09-14T09:08:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.423296+0000", 2024-09-14T09:08:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.423296+0000", 2024-09-14T09:08:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.423297+0000", 2024-09-14T09:08:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2300000000000001e-07 2024-09-14T09:08:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.423301+0000", 2024-09-14T09:08:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9330000000000003e-06 2024-09-14T09:08:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.423309+0000", 2024-09-14T09:08:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0770000000000008e-06 2024-09-14T09:08:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.423313+0000", 2024-09-14T09:08:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6369999999999998e-06 2024-09-14T09:08:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.423350+0000", 2024-09-14T09:08:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6501000000000002e-05 2024-09-14T09:08:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.423421+0000", 2024-09-14T09:08:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1050999999999994e-05 2024-09-14T09:08:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 3", 2024-09-14T09:08:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.423688+0000", 2024-09-14T09:08:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026727199999999998 2024-09-14T09:08:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.432 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop_reply(client.4767.0:428 3.5 e39/22)", 2024-09-14T09:08:08.432 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:08.423374+0000", 2024-09-14T09:08:08.432 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00044677300000000003, 2024-09-14T09:08:08.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00053782099999999996, 2024-09-14T09:08:08.432 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.432 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.423374+0000", 2024-09-14T09:08:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.423374+0000", 2024-09-14T09:08:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.423375+0000", 2024-09-14T09:08:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0400000000000002e-07 2024-09-14T09:08:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.423377+0000", 2024-09-14T09:08:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4940000000000002e-06 2024-09-14T09:08:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.423387+0000", 2024-09-14T09:08:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2869999999999993e-06 2024-09-14T09:08:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:08.423391+0000", 2024-09-14T09:08:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0110000000000002e-06 2024-09-14T09:08:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.436 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:08:08.436 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 3 2024-09-14T09:08:08.436 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:08.436 INFO:teuthology.orchestra.run.smithi148.stdout:1575 clone 12 order 22 su 131072 sc 15 2024-09-14T09:08:08.437 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:08:08.478 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:08.480+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:08.573 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:08.576+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:08.579 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:08.579 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:08.580 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:08.580 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:08.580 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:08.588 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:08:08.674 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:08.676+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:08.692 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:08.692 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:08.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:08.693 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:08.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.693 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:703 3.1d 3:baa4605b:::rbd_data.11122fa6a16d.0000000000000004:6 [sparse-read 2752512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:08.694 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862508+0000", 2024-09-14T09:08:08.694 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.831132775, 2024-09-14T09:08:08.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019513532, 2024-09-14T09:08:08.694 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.694 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.694 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.694 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.694 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:08.694 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:08.694 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 703 2024-09-14T09:08:08.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.694 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862508+0000", 2024-09-14T09:08:08.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862508+0000", 2024-09-14T09:08:08.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862508+0000", 2024-09-14T09:08:08.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1899999999999998e-07 2024-09-14T09:08:08.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862510+0000", 2024-09-14T09:08:08.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.858e-06 2024-09-14T09:08:08.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862516+0000", 2024-09-14T09:08:08.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3840000000000002e-06 2024-09-14T09:08:08.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862527+0000", 2024-09-14T09:08:08.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0651e-05 2024-09-14T09:08:08.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.881919+0000", 2024-09-14T09:08:08.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019392136000000001 2024-09-14T09:08:08.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.881968+0000", 2024-09-14T09:08:08.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9480000000000001e-05 2024-09-14T09:08:08.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882021+0000", 2024-09-14T09:08:08.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2604e-05 2024-09-14T09:08:08.698 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.698 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.698 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.698 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:704 3.1d 3:baa4605b:::rbd_data.11122fa6a16d.0000000000000004:6 [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:08.698 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862604+0000", 2024-09-14T09:08:08.698 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.831036276000001, 2024-09-14T09:08:08.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019622902000000001, 2024-09-14T09:08:08.699 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.699 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.699 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.699 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.699 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:08.699 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:08.699 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 704 2024-09-14T09:08:08.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.699 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862604+0000", 2024-09-14T09:08:08.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862604+0000", 2024-09-14T09:08:08.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862605+0000", 2024-09-14T09:08:08.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9699999999999996e-07 2024-09-14T09:08:08.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862607+0000", 2024-09-14T09:08:08.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.295e-06 2024-09-14T09:08:08.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862614+0000", 2024-09-14T09:08:08.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1439999999999997e-06 2024-09-14T09:08:08.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862621+0000", 2024-09-14T09:08:08.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6499999999999999e-06 2024-09-14T09:08:08.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882056+0000", 2024-09-14T09:08:08.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019435109999999998 2024-09-14T09:08:08.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882132+0000", 2024-09-14T09:08:08.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6224999999999996e-05 2024-09-14T09:08:08.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882227+0000", 2024-09-14T09:08:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4881000000000002e-05 2024-09-14T09:08:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:705 3.1d 3:baa4605b:::rbd_data.11122fa6a16d.0000000000000004:6 [sparse-read 5636096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862631+0000", 2024-09-14T09:08:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.831009566000001, 2024-09-14T09:08:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019725718999999999, 2024-09-14T09:08:08.703 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 705 2024-09-14T09:08:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862631+0000", 2024-09-14T09:08:08.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862631+0000", 2024-09-14T09:08:08.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862631+0000", 2024-09-14T09:08:08.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.37e-07 2024-09-14T09:08:08.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862633+0000", 2024-09-14T09:08:08.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0099999999999998e-06 2024-09-14T09:08:08.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862640+0000", 2024-09-14T09:08:08.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5710000000000003e-06 2024-09-14T09:08:08.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862645+0000", 2024-09-14T09:08:08.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0610000000000003e-06 2024-09-14T09:08:08.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882257+0000", 2024-09-14T09:08:08.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019612181999999999 2024-09-14T09:08:08.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882299+0000", 2024-09-14T09:08:08.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1999999999999998e-05 2024-09-14T09:08:08.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882356+0000", 2024-09-14T09:08:08.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7358000000000002e-05 2024-09-14T09:08:08.708 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.708 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.708 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.708 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:718 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:08.708 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862653+0000", 2024-09-14T09:08:08.708 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.830987687, 2024-09-14T09:08:08.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019756607999999998, 2024-09-14T09:08:08.709 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.709 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.709 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.709 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.709 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:08.709 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:08.709 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 718 2024-09-14T09:08:08.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.709 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862653+0000", 2024-09-14T09:08:08.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862653+0000", 2024-09-14T09:08:08.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862653+0000", 2024-09-14T09:08:08.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7e-07 2024-09-14T09:08:08.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862655+0000", 2024-09-14T09:08:08.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.962e-06 2024-09-14T09:08:08.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862662+0000", 2024-09-14T09:08:08.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6229999999999999e-06 2024-09-14T09:08:08.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862667+0000", 2024-09-14T09:08:08.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.045e-06 2024-09-14T09:08:08.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882255+0000", 2024-09-14T09:08:08.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019588164000000002 2024-09-14T09:08:08.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882325+0000", 2024-09-14T09:08:08.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0232000000000001e-05 2024-09-14T09:08:08.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882409+0000", 2024-09-14T09:08:08.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4111999999999997e-05 2024-09-14T09:08:08.713 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.713 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.713 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.713 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:719 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 2686976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:08.713 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862674+0000", 2024-09-14T09:08:08.713 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.830966761999999, 2024-09-14T09:08:08.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019857377999999998, 2024-09-14T09:08:08.713 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.713 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.713 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.713 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.713 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:08.714 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:08.714 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 719 2024-09-14T09:08:08.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.714 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862674+0000", 2024-09-14T09:08:08.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862674+0000", 2024-09-14T09:08:08.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862674+0000", 2024-09-14T09:08:08.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2500000000000001e-07 2024-09-14T09:08:08.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862676+0000", 2024-09-14T09:08:08.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.827e-06 2024-09-14T09:08:08.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862684+0000", 2024-09-14T09:08:08.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1920000000000005e-06 2024-09-14T09:08:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862689+0000", 2024-09-14T09:08:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.882e-06 2024-09-14T09:08:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882435+0000", 2024-09-14T09:08:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019746260000000002 2024-09-14T09:08:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882477+0000", 2024-09-14T09:08:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1471999999999999e-05 2024-09-14T09:08:08.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882531+0000", 2024-09-14T09:08:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4320000000000002e-05 2024-09-14T09:08:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:720 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862696+0000", 2024-09-14T09:08:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.830944697, 2024-09-14T09:08:08.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020031767999999998, 2024-09-14T09:08:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 720 2024-09-14T09:08:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862696+0000", 2024-09-14T09:08:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862696+0000", 2024-09-14T09:08:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862696+0000", 2024-09-14T09:08:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4499999999999997e-07 2024-09-14T09:08:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862698+0000", 2024-09-14T09:08:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.835e-06 2024-09-14T09:08:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862718+0000", 2024-09-14T09:08:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9646000000000001e-05 2024-09-14T09:08:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862726+0000", 2024-09-14T09:08:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3690000000000007e-06 2024-09-14T09:08:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882564+0000", 2024-09-14T09:08:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019838198000000001 2024-09-14T09:08:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882635+0000", 2024-09-14T09:08:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1054000000000001e-05 2024-09-14T09:08:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882727+0000", 2024-09-14T09:08:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2220999999999997e-05 2024-09-14T09:08:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:721 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 5636096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862735+0000", 2024-09-14T09:08:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.830905570000001, 2024-09-14T09:08:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020095227, 2024-09-14T09:08:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 721 2024-09-14T09:08:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862735+0000", 2024-09-14T09:08:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862735+0000", 2024-09-14T09:08:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862735+0000", 2024-09-14T09:08:08.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0200000000000002e-07 2024-09-14T09:08:08.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862738+0000", 2024-09-14T09:08:08.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4169999999999999e-06 2024-09-14T09:08:08.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862766+0000", 2024-09-14T09:08:08.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8093999999999999e-05 2024-09-14T09:08:08.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862772+0000", 2024-09-14T09:08:08.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3160000000000002e-06 2024-09-14T09:08:08.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882742+0000", 2024-09-14T09:08:08.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019970102 2024-09-14T09:08:08.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882779+0000", 2024-09-14T09:08:08.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7181000000000002e-05 2024-09-14T09:08:08.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882830+0000", 2024-09-14T09:08:08.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0615000000000002e-05 2024-09-14T09:08:08.726 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.726 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.726 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.727 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:726 3.5 3:a28365af:::rbd_data.11122fa6a16d.0000000000000000:6 [sparse-read 1376256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:08.727 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862793+0000", 2024-09-14T09:08:08.727 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.830847482999999, 2024-09-14T09:08:08.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020238376999999998, 2024-09-14T09:08:08.727 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.727 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.727 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.727 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.727 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:08.727 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:08.727 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 726 2024-09-14T09:08:08.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.728 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862793+0000", 2024-09-14T09:08:08.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862793+0000", 2024-09-14T09:08:08.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862793+0000", 2024-09-14T09:08:08.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5599999999999995e-07 2024-09-14T09:08:08.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862796+0000", 2024-09-14T09:08:08.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6850000000000001e-06 2024-09-14T09:08:08.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862812+0000", 2024-09-14T09:08:08.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6002999999999999e-05 2024-09-14T09:08:08.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862827+0000", 2024-09-14T09:08:08.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.47e-05 2024-09-14T09:08:08.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882861+0000", 2024-09-14T09:08:08.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020034206999999998 2024-09-14T09:08:08.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882936+0000", 2024-09-14T09:08:08.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4624999999999998e-05 2024-09-14T09:08:08.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883031+0000", 2024-09-14T09:08:08.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5600999999999995e-05 2024-09-14T09:08:08.731 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.731 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.731 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.732 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:727 3.5 3:a28365af:::rbd_data.11122fa6a16d.0000000000000000:6 [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:08.732 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862836+0000", 2024-09-14T09:08:08.732 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.830804050999999, 2024-09-14T09:08:08.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020407364000000001, 2024-09-14T09:08:08.732 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.732 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.732 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.732 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.732 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:08.732 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:08.733 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 727 2024-09-14T09:08:08.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.733 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862836+0000", 2024-09-14T09:08:08.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862836+0000", 2024-09-14T09:08:08.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862837+0000", 2024-09-14T09:08:08.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.13e-07 2024-09-14T09:08:08.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862839+0000", 2024-09-14T09:08:08.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:08:08.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862847+0000", 2024-09-14T09:08:08.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5039999999999996e-06 2024-09-14T09:08:08.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862852+0000", 2024-09-14T09:08:08.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2050000000000001e-06 2024-09-14T09:08:08.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883068+0000", 2024-09-14T09:08:08.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020216369000000001 2024-09-14T09:08:08.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883145+0000", 2024-09-14T09:08:08.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6790000000000002e-05 2024-09-14T09:08:08.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883244+0000", 2024-09-14T09:08:08.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8697999999999996e-05 2024-09-14T09:08:08.737 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.737 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.737 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.737 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:728 3.5 3:a28365af:::rbd_data.11122fa6a16d.0000000000000000:6 [sparse-read 4325376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:08.737 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862859+0000", 2024-09-14T09:08:08.737 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.830781139999999, 2024-09-14T09:08:08.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020577419, 2024-09-14T09:08:08.737 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.737 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.738 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.738 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.738 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:08.738 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:08.738 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 728 2024-09-14T09:08:08.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.738 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862859+0000", 2024-09-14T09:08:08.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862859+0000", 2024-09-14T09:08:08.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862860+0000", 2024-09-14T09:08:08.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7199999999999999e-07 2024-09-14T09:08:08.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862874+0000", 2024-09-14T09:08:08.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4124000000000001e-05 2024-09-14T09:08:08.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862886+0000", 2024-09-14T09:08:08.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2353e-05 2024-09-14T09:08:08.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862900+0000", 2024-09-14T09:08:08.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3872e-05 2024-09-14T09:08:08.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883274+0000", 2024-09-14T09:08:08.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020373544 2024-09-14T09:08:08.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883352+0000", 2024-09-14T09:08:08.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8394999999999997e-05 2024-09-14T09:08:08.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883437+0000", 2024-09-14T09:08:08.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4559000000000001e-05 2024-09-14T09:08:08.741 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.741 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.741 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.742 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:729 3.5 3:a28365af:::rbd_data.11122fa6a16d.0000000000000000:6 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:08.742 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862909+0000", 2024-09-14T09:08:08.742 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.830731200000001, 2024-09-14T09:08:08.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020750004999999998, 2024-09-14T09:08:08.742 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.742 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.742 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.742 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.742 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:08.742 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:08.742 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 729 2024-09-14T09:08:08.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.742 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862909+0000", 2024-09-14T09:08:08.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862909+0000", 2024-09-14T09:08:08.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862910+0000", 2024-09-14T09:08:08.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6699999999999999e-07 2024-09-14T09:08:08.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862917+0000", 2024-09-14T09:08:08.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0520000000000004e-06 2024-09-14T09:08:08.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862924+0000", 2024-09-14T09:08:08.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4510000000000003e-06 2024-09-14T09:08:08.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862929+0000", 2024-09-14T09:08:08.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2549999999999997e-06 2024-09-14T09:08:08.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883484+0000", 2024-09-14T09:08:08.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.02055446 2024-09-14T09:08:08.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883558+0000", 2024-09-14T09:08:08.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3916000000000002e-05 2024-09-14T09:08:08.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883659+0000", 2024-09-14T09:08:08.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010140399999999999 2024-09-14T09:08:08.745 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.746 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.746 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.746 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:742 3.1d 3:baa4605b:::rbd_data.11122fa6a16d.0000000000000004:6 [sparse-read 1376256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:08.746 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862936+0000", 2024-09-14T09:08:08.746 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.830703942, 2024-09-14T09:08:08.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020679486, 2024-09-14T09:08:08.746 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.746 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.746 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.747 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.747 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:08.747 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:08.747 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 742 2024-09-14T09:08:08.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.747 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862936+0000", 2024-09-14T09:08:08.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862936+0000", 2024-09-14T09:08:08.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862937+0000", 2024-09-14T09:08:08.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0200000000000002e-07 2024-09-14T09:08:08.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862939+0000", 2024-09-14T09:08:08.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0099999999999998e-06 2024-09-14T09:08:08.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862945+0000", 2024-09-14T09:08:08.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4180000000000002e-06 2024-09-14T09:08:08.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862950+0000", 2024-09-14T09:08:08.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0799999999999996e-06 2024-09-14T09:08:08.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883465+0000", 2024-09-14T09:08:08.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020514549999999999 2024-09-14T09:08:08.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883527+0000", 2024-09-14T09:08:08.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2494000000000002e-05 2024-09-14T09:08:08.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883616+0000", 2024-09-14T09:08:08.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8431999999999996e-05 2024-09-14T09:08:08.750 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.750 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.750 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.751 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:743 3.1d 3:baa4605b:::rbd_data.11122fa6a16d.0000000000000004:6 [sparse-read 2818048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:08.751 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862957+0000", 2024-09-14T09:08:08.751 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.830683111000001, 2024-09-14T09:08:08.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020911032, 2024-09-14T09:08:08.751 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.751 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.751 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.751 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.751 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:08.751 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:08.751 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 743 2024-09-14T09:08:08.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.751 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.752 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862957+0000", 2024-09-14T09:08:08.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.752 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862957+0000", 2024-09-14T09:08:08.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862958+0000", 2024-09-14T09:08:08.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9500000000000003e-07 2024-09-14T09:08:08.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862959+0000", 2024-09-14T09:08:08.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.756e-06 2024-09-14T09:08:08.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862972+0000", 2024-09-14T09:08:08.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2567e-05 2024-09-14T09:08:08.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862978+0000", 2024-09-14T09:08:08.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9499999999999998e-06 2024-09-14T09:08:08.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883651+0000", 2024-09-14T09:08:08.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020673305999999999 2024-09-14T09:08:08.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883759+0000", 2024-09-14T09:08:08.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001075 2024-09-14T09:08:08.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883868+0000", 2024-09-14T09:08:08.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010945799999999999 2024-09-14T09:08:08.755 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.755 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.755 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.756 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:744 3.1d 3:baa4605b:::rbd_data.11122fa6a16d.0000000000000004:6 [sparse-read 4325376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:08.756 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862986+0000", 2024-09-14T09:08:08.756 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.830654703, 2024-09-14T09:08:08.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021124403, 2024-09-14T09:08:08.756 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.756 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.756 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.756 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.756 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:08.756 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:08.756 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 744 2024-09-14T09:08:08.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.757 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862986+0000", 2024-09-14T09:08:08.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862986+0000", 2024-09-14T09:08:08.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862986+0000", 2024-09-14T09:08:08.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7e-07 2024-09-14T09:08:08.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862988+0000", 2024-09-14T09:08:08.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9769999999999999e-06 2024-09-14T09:08:08.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862995+0000", 2024-09-14T09:08:08.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7510000000000002e-06 2024-09-14T09:08:08.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863000+0000", 2024-09-14T09:08:08.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.259e-06 2024-09-14T09:08:08.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883908+0000", 2024-09-14T09:08:08.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020908095000000002 2024-09-14T09:08:08.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883999+0000", 2024-09-14T09:08:08.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0741000000000004e-05 2024-09-14T09:08:08.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884110+0000", 2024-09-14T09:08:08.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011111 2024-09-14T09:08:08.760 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.760 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.760 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.760 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:745 3.1d 3:baa4605b:::rbd_data.11122fa6a16d.0000000000000004:6 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:08.761 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863007+0000", 2024-09-14T09:08:08.761 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.830632980000001, 2024-09-14T09:08:08.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021273830000000001, 2024-09-14T09:08:08.761 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.761 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.761 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.761 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.761 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:08.761 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:08.761 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 745 2024-09-14T09:08:08.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.761 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863007+0000", 2024-09-14T09:08:08.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863007+0000", 2024-09-14T09:08:08.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863008+0000", 2024-09-14T09:08:08.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:08:08.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863010+0000", 2024-09-14T09:08:08.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.903e-06 2024-09-14T09:08:08.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863018+0000", 2024-09-14T09:08:08.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0970000000000006e-06 2024-09-14T09:08:08.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863023+0000", 2024-09-14T09:08:08.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1030000000000001e-06 2024-09-14T09:08:08.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884157+0000", 2024-09-14T09:08:08.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021134303 2024-09-14T09:08:08.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884226+0000", 2024-09-14T09:08:08.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9004000000000005e-05 2024-09-14T09:08:08.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884281+0000", 2024-09-14T09:08:08.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4994000000000002e-05 2024-09-14T09:08:08.765 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.765 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.766 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.766 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:758 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:08.766 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863037+0000", 2024-09-14T09:08:08.766 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.830603773, 2024-09-14T09:08:08.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021271691999999998, 2024-09-14T09:08:08.766 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.766 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.766 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.766 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.766 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:08.767 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:08.767 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 758 2024-09-14T09:08:08.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.767 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863037+0000", 2024-09-14T09:08:08.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863037+0000", 2024-09-14T09:08:08.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863037+0000", 2024-09-14T09:08:08.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5699999999999998e-07 2024-09-14T09:08:08.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863039+0000", 2024-09-14T09:08:08.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2709999999999999e-06 2024-09-14T09:08:08.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863046+0000", 2024-09-14T09:08:08.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1380000000000001e-06 2024-09-14T09:08:08.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863052+0000", 2024-09-14T09:08:08.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1399999999999999e-06 2024-09-14T09:08:08.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884146+0000", 2024-09-14T09:08:08.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021094497 2024-09-14T09:08:08.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884217+0000", 2024-09-14T09:08:08.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0797999999999995e-05 2024-09-14T09:08:08.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884308+0000", 2024-09-14T09:08:08.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1391000000000006e-05 2024-09-14T09:08:08.771 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.771 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.771 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.771 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:759 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 2818048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:08.771 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863059+0000", 2024-09-14T09:08:08.771 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.830580896000001, 2024-09-14T09:08:08.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021357939999999999, 2024-09-14T09:08:08.771 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.771 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.771 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.771 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.772 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:08.772 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:08.772 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 759 2024-09-14T09:08:08.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.772 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863059+0000", 2024-09-14T09:08:08.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863059+0000", 2024-09-14T09:08:08.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863060+0000", 2024-09-14T09:08:08.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0499999999999999e-07 2024-09-14T09:08:08.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863062+0000", 2024-09-14T09:08:08.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8500000000000001e-06 2024-09-14T09:08:08.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863068+0000", 2024-09-14T09:08:08.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.81e-06 2024-09-14T09:08:08.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863073+0000", 2024-09-14T09:08:08.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9280000000000001e-06 2024-09-14T09:08:08.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884326+0000", 2024-09-14T09:08:08.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021252407000000001 2024-09-14T09:08:08.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884367+0000", 2024-09-14T09:08:08.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0932e-05 2024-09-14T09:08:08.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884417+0000", 2024-09-14T09:08:08.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0608000000000001e-05 2024-09-14T09:08:08.775 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.775 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.775 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.775 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:760 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 4259840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:08.776 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863080+0000", 2024-09-14T09:08:08.776 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.830560593, 2024-09-14T09:08:08.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021531615, 2024-09-14T09:08:08.776 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.776 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.776 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.776 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.776 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:08.776 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:08.776 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 760 2024-09-14T09:08:08.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.776 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863080+0000", 2024-09-14T09:08:08.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863080+0000", 2024-09-14T09:08:08.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863080+0000", 2024-09-14T09:08:08.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:08:08.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863082+0000", 2024-09-14T09:08:08.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7460000000000001e-06 2024-09-14T09:08:08.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863088+0000", 2024-09-14T09:08:08.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2319999999999998e-06 2024-09-14T09:08:08.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863093+0000", 2024-09-14T09:08:08.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5199999999999999e-06 2024-09-14T09:08:08.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884449+0000", 2024-09-14T09:08:08.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021356639 2024-09-14T09:08:08.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884522+0000", 2024-09-14T09:08:08.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2696999999999999e-05 2024-09-14T09:08:08.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884611+0000", 2024-09-14T09:08:08.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9389999999999996e-05 2024-09-14T09:08:08.780 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.780 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.780 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.780 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:761 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:08.780 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863099+0000", 2024-09-14T09:08:08.780 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.830541224999999, 2024-09-14T09:08:08.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021615771999999998, 2024-09-14T09:08:08.780 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.780 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.780 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:08.781 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.781 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:08.781 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:08.781 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 761 2024-09-14T09:08:08.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.781 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863099+0000", 2024-09-14T09:08:08.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863099+0000", 2024-09-14T09:08:08.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863100+0000", 2024-09-14T09:08:08.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7199999999999999e-07 2024-09-14T09:08:08.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863101+0000", 2024-09-14T09:08:08.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6810000000000001e-06 2024-09-14T09:08:08.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863108+0000", 2024-09-14T09:08:08.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.19e-06 2024-09-14T09:08:08.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863119+0000", 2024-09-14T09:08:08.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1107000000000001e-05 2024-09-14T09:08:08.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884625+0000", 2024-09-14T09:08:08.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021506464999999999 2024-09-14T09:08:08.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884665+0000", 2024-09-14T09:08:08.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9473e-05 2024-09-14T09:08:08.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884715+0000", 2024-09-14T09:08:08.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0284000000000002e-05 2024-09-14T09:08:08.785 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.785 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.785 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.785 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4604.0:364 3.1d 3:bb0fb96d:::rbd_data.1112609a9334.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 28633088~35328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-14T09:08:08.785 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:04.667444+0000", 2024-09-14T09:08:08.785 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.0261962210000002, 2024-09-14T09:08:08.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052308081999999999, 2024-09-14T09:08:08.786 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:08.786 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:08.786 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:08.786 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:08.786 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4604", 2024-09-14T09:08:08.786 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/335524879", 2024-09-14T09:08:08.786 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 364 2024-09-14T09:08:08.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.786 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:08.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:08.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.667444+0000", 2024-09-14T09:08:08.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:08.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.667444+0000", 2024-09-14T09:08:08.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:08.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:08.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.667445+0000", 2024-09-14T09:08:08.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1999999999999998e-07 2024-09-14T09:08:08.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:08.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681087+0000", 2024-09-14T09:08:08.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013641863000000001 2024-09-14T09:08:08.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:08.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681113+0000", 2024-09-14T09:08:08.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6310000000000001e-05 2024-09-14T09:08:08.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681123+0000", 2024-09-14T09:08:08.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7289999999999995e-06 2024-09-14T09:08:08.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:08.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681203+0000", 2024-09-14T09:08:08.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0628000000000001e-05 2024-09-14T09:08:08.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:08.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681323+0000", 2024-09-14T09:08:08.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000119722 2024-09-14T09:08:08.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:08.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.682203+0000", 2024-09-14T09:08:08.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00087938299999999997 2024-09-14T09:08:08.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:08.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719043+0000", 2024-09-14T09:08:08.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036840218000000001 2024-09-14T09:08:08.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:08.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719654+0000", 2024-09-14T09:08:08.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00061077199999999999 2024-09-14T09:08:08.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:08.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719698+0000", 2024-09-14T09:08:08.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4177000000000001e-05 2024-09-14T09:08:08.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:08.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:08.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:08.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719752+0000", 2024-09-14T09:08:08.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4459999999999997e-05 2024-09-14T09:08:08.792 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.792 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.792 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.792 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:08.792 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:08.792 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:08.794 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:08:08.794 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:08.796+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:08.894 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:08.896+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:08.902 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:08.902 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:08.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:08.903 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4370.0:5329 3.1e e40/22)", 2024-09-14T09:08:08.903 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:08.905309+0000", 2024-09-14T09:08:08.903 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.773e-05, 2024-09-14T09:08:08.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3121999999999997e-05, 2024-09-14T09:08:08.903 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:08.903 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:08.903 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:08.903 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:08.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:08.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:08.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:08.905309+0000", 2024-09-14T09:08:08.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:08.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:08.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:08.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:08.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:08.905309+0000", 2024-09-14T09:08:08.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:08.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:08.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:08.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:08.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:08.905310+0000", 2024-09-14T09:08:08.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1500000000000004e-07 2024-09-14T09:08:08.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:08.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:08.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:08.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:08.905315+0000", 2024-09-14T09:08:08.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.22e-06 2024-09-14T09:08:08.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:08.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:08.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:08.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:08.905326+0000", 2024-09-14T09:08:08.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1474999999999999e-05 2024-09-14T09:08:08.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:08.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:08.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:08.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:08.905333+0000", 2024-09-14T09:08:08.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3550000000000001e-06 2024-09-14T09:08:08.906 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:08.906 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:08.906 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:08.906 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:08.906 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-14T09:08:08.906 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 1 2024-09-14T09:08:08.906 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:08.911 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:08:08.914 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone11 from 0xb5ff000 (overlap 0x38ffe00) to 0x5b3200 2024-09-14T09:08:08.995 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:08.997+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:09.058 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:09.058 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:09.058 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:09.058 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:09.058 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:09.067 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:08:09.096 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:09.098+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:09.174 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:09.174 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:09.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:09.174 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:09.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.174 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:780 3.c e30/22 3:348fce71:::rbd_data.111276489662.0000000000000007:head v 30'15, mlcod=28'12)", 2024-09-14T09:08:09.174 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.877170+0000", 2024-09-14T09:08:09.174 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.297942113, 2024-09-14T09:08:09.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024747509999999999, 2024-09-14T09:08:09.175 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.175 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.175 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:09.175 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877170+0000", 2024-09-14T09:08:09.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877170+0000", 2024-09-14T09:08:09.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877171+0000", 2024-09-14T09:08:09.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3300000000000001e-07 2024-09-14T09:08:09.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877179+0000", 2024-09-14T09:08:09.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5170000000000002e-06 2024-09-14T09:08:09.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877188+0000", 2024-09-14T09:08:09.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4199999999999996e-06 2024-09-14T09:08:09.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877193+0000", 2024-09-14T09:08:09.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5290000000000002e-06 2024-09-14T09:08:09.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877248+0000", 2024-09-14T09:08:09.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5012000000000001e-05 2024-09-14T09:08:09.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.877270+0000", 2024-09-14T09:08:09.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2540000000000001e-05 2024-09-14T09:08:09.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:09.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.879613+0000", 2024-09-14T09:08:09.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0023428899999999998 2024-09-14T09:08:09.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.879645+0000", 2024-09-14T09:08:09.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2110000000000003e-05 2024-09-14T09:08:09.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.180 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.180 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:783 3.1e e30/22 3:7d74d199:::rbd_data.111276489662.0000000000000008:head v 30'19, mlcod=29'17)", 2024-09-14T09:08:09.180 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.880224+0000", 2024-09-14T09:08:09.180 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.2948889, 2024-09-14T09:08:09.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020308650000000002, 2024-09-14T09:08:09.180 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.181 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.181 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:09.181 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880224+0000", 2024-09-14T09:08:09.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880224+0000", 2024-09-14T09:08:09.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880224+0000", 2024-09-14T09:08:09.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2200000000000004e-07 2024-09-14T09:08:09.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880229+0000", 2024-09-14T09:08:09.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7419999999999997e-06 2024-09-14T09:08:09.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880238+0000", 2024-09-14T09:08:09.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6759999999999996e-06 2024-09-14T09:08:09.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880243+0000", 2024-09-14T09:08:09.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8609999999999997e-06 2024-09-14T09:08:09.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880288+0000", 2024-09-14T09:08:09.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5668999999999999e-05 2024-09-14T09:08:09.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.880302+0000", 2024-09-14T09:08:09.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3489000000000001e-05 2024-09-14T09:08:09.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:09.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.882221+0000", 2024-09-14T09:08:09.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001919362 2024-09-14T09:08:09.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.882255+0000", 2024-09-14T09:08:09.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3444e-05 2024-09-14T09:08:09.185 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.185 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.185 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.185 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1159 3.7 e31/22 3:e6c13853:::rbd_object_map.111276489662.0000000000000007:head v 31'235, mlcod=30'233)", 2024-09-14T09:08:09.185 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.343595+0000", 2024-09-14T09:08:09.185 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.831517496, 2024-09-14T09:08:09.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031037040000000001, 2024-09-14T09:08:09.186 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.186 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.186 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:09.186 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343595+0000", 2024-09-14T09:08:09.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343595+0000", 2024-09-14T09:08:09.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343595+0000", 2024-09-14T09:08:09.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6899999999999999e-07 2024-09-14T09:08:09.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343599+0000", 2024-09-14T09:08:09.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0090000000000001e-06 2024-09-14T09:08:09.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343610+0000", 2024-09-14T09:08:09.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0661e-05 2024-09-14T09:08:09.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343619+0000", 2024-09-14T09:08:09.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2059999999999996e-06 2024-09-14T09:08:09.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343667+0000", 2024-09-14T09:08:09.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7611999999999997e-05 2024-09-14T09:08:09.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343683+0000", 2024-09-14T09:08:09.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5917999999999999e-05 2024-09-14T09:08:09.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:09.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.346665+0000", 2024-09-14T09:08:09.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029824840000000001 2024-09-14T09:08:09.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.346699+0000", 2024-09-14T09:08:09.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3645000000000001e-05 2024-09-14T09:08:09.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.190 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.190 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1217 3.19 e31/22 3:9ebf855b:::rbd_data.111276489662.0000000000000006:head v 31'28, mlcod=30'23)", 2024-09-14T09:08:09.190 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.424967+0000", 2024-09-14T09:08:09.190 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.750145729, 2024-09-14T09:08:09.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026944790000000001, 2024-09-14T09:08:09.190 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.191 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.191 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:09.191 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424967+0000", 2024-09-14T09:08:09.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424967+0000", 2024-09-14T09:08:09.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424967+0000", 2024-09-14T09:08:09.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3099999999999997e-07 2024-09-14T09:08:09.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424982+0000", 2024-09-14T09:08:09.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4528999999999999e-05 2024-09-14T09:08:09.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424992+0000", 2024-09-14T09:08:09.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0428000000000001e-05 2024-09-14T09:08:09.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424999+0000", 2024-09-14T09:08:09.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7649999999999996e-06 2024-09-14T09:08:09.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425051+0000", 2024-09-14T09:08:09.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2234999999999997e-05 2024-09-14T09:08:09.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425072+0000", 2024-09-14T09:08:09.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0429999999999999e-05 2024-09-14T09:08:09.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:09.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427624+0000", 2024-09-14T09:08:09.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025518250000000002 2024-09-14T09:08:09.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427661+0000", 2024-09-14T09:08:09.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7635999999999997e-05 2024-09-14T09:08:09.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.196 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.196 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.196 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1221 3.1e e31/22 3:7d74d199:::rbd_data.111276489662.0000000000000008:head v 31'22, mlcod=30'19)", 2024-09-14T09:08:09.196 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.428334+0000", 2024-09-14T09:08:09.196 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.746778936, 2024-09-14T09:08:09.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020988309999999998, 2024-09-14T09:08:09.196 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.196 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.197 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:09.197 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428334+0000", 2024-09-14T09:08:09.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428334+0000", 2024-09-14T09:08:09.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428334+0000", 2024-09-14T09:08:09.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2099999999999996e-07 2024-09-14T09:08:09.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428339+0000", 2024-09-14T09:08:09.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8369999999999996e-06 2024-09-14T09:08:09.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428349+0000", 2024-09-14T09:08:09.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9480000000000003e-06 2024-09-14T09:08:09.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428354+0000", 2024-09-14T09:08:09.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6349999999999997e-06 2024-09-14T09:08:09.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428395+0000", 2024-09-14T09:08:09.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1566000000000001e-05 2024-09-14T09:08:09.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428427+0000", 2024-09-14T09:08:09.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1761999999999998e-05 2024-09-14T09:08:09.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:09.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.430398+0000", 2024-09-14T09:08:09.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00197079 2024-09-14T09:08:09.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.430432+0000", 2024-09-14T09:08:09.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4572e-05 2024-09-14T09:08:09.201 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.201 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.201 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.201 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1222 3.6 e31/22 3:62148812:::rbd_data.111276489662.0000000000000009:head v 31'14, mlcod=30'10)", 2024-09-14T09:08:09.201 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.428442+0000", 2024-09-14T09:08:09.201 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.746670469, 2024-09-14T09:08:09.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022360380000000001, 2024-09-14T09:08:09.202 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.202 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.202 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:09.202 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428442+0000", 2024-09-14T09:08:09.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428442+0000", 2024-09-14T09:08:09.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428443+0000", 2024-09-14T09:08:09.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8100000000000002e-07 2024-09-14T09:08:09.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428448+0000", 2024-09-14T09:08:09.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7389999999999996e-06 2024-09-14T09:08:09.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428459+0000", 2024-09-14T09:08:09.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0098000000000001e-05 2024-09-14T09:08:09.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428465+0000", 2024-09-14T09:08:09.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4509999999999997e-06 2024-09-14T09:08:09.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428546+0000", 2024-09-14T09:08:09.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1191000000000002e-05 2024-09-14T09:08:09.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428566+0000", 2024-09-14T09:08:09.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9939999999999999e-05 2024-09-14T09:08:09.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:09.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.430646+0000", 2024-09-14T09:08:09.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020798050000000001 2024-09-14T09:08:09.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.430678+0000", 2024-09-14T09:08:09.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2132999999999999e-05 2024-09-14T09:08:09.206 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.206 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.206 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.207 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1225 3.19 e31/22 3:982fc283:::rbd_data.111276489662.000000000000000c:head v 31'30, mlcod=31'26)", 2024-09-14T09:08:09.207 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.432647+0000", 2024-09-14T09:08:09.207 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.742465967999999, 2024-09-14T09:08:09.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003008578, 2024-09-14T09:08:09.207 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.207 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.207 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:09.207 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432647+0000", 2024-09-14T09:08:09.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432647+0000", 2024-09-14T09:08:09.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432647+0000", 2024-09-14T09:08:09.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8400000000000005e-07 2024-09-14T09:08:09.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432651+0000", 2024-09-14T09:08:09.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.092e-06 2024-09-14T09:08:09.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432659+0000", 2024-09-14T09:08:09.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2770000000000005e-06 2024-09-14T09:08:09.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432664+0000", 2024-09-14T09:08:09.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.746e-06 2024-09-14T09:08:09.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432708+0000", 2024-09-14T09:08:09.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3458000000000003e-05 2024-09-14T09:08:09.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432724+0000", 2024-09-14T09:08:09.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6339999999999999e-05 2024-09-14T09:08:09.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:09.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.435617+0000", 2024-09-14T09:08:09.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028927929999999998 2024-09-14T09:08:09.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.435655+0000", 2024-09-14T09:08:09.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8387999999999999e-05 2024-09-14T09:08:09.211 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.211 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.211 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.212 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4370.0:3932 3.6 e36/22 3:63e26f6f:::rbd_header.1112609a9334:head v 36'19, mlcod=35'17)", 2024-09-14T09:08:09.212 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.861553+0000", 2024-09-14T09:08:09.212 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.3135594570000002, 2024-09-14T09:08:09.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019972779999999999, 2024-09-14T09:08:09.212 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.212 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.212 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:09.212 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.861553+0000", 2024-09-14T09:08:09.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.861553+0000", 2024-09-14T09:08:09.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.861554+0000", 2024-09-14T09:08:09.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4099999999999999e-07 2024-09-14T09:08:09.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.861558+0000", 2024-09-14T09:08:09.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4399999999999998e-06 2024-09-14T09:08:09.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.861566+0000", 2024-09-14T09:08:09.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7889999999999995e-06 2024-09-14T09:08:09.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.861570+0000", 2024-09-14T09:08:09.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4839999999999998e-06 2024-09-14T09:08:09.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.861608+0000", 2024-09-14T09:08:09.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7846999999999999e-05 2024-09-14T09:08:09.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.861628+0000", 2024-09-14T09:08:09.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0285999999999999e-05 2024-09-14T09:08:09.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:09.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.863516+0000", 2024-09-14T09:08:09.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001887704 2024-09-14T09:08:09.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.863550+0000", 2024-09-14T09:08:09.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4187000000000003e-05 2024-09-14T09:08:09.216 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.216 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.216 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.216 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4671.0:2419 3.5 e36/22 3:a0893c4c:::rbd_data.1112ca7492e7.0000000000000020:head v 36'118, mlcod=35'115)", 2024-09-14T09:08:09.216 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.894400+0000", 2024-09-14T09:08:09.216 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.2807120440000004, 2024-09-14T09:08:09.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001971127, 2024-09-14T09:08:09.216 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.216 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.216 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:09.217 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.894400+0000", 2024-09-14T09:08:09.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.894400+0000", 2024-09-14T09:08:09.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.894401+0000", 2024-09-14T09:08:09.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2024-09-14T09:08:09.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.894408+0000", 2024-09-14T09:08:09.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0759999999999997e-06 2024-09-14T09:08:09.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.894420+0000", 2024-09-14T09:08:09.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1314e-05 2024-09-14T09:08:09.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.894426+0000", 2024-09-14T09:08:09.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4489999999999996e-06 2024-09-14T09:08:09.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.894489+0000", 2024-09-14T09:08:09.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2892999999999996e-05 2024-09-14T09:08:09.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.894506+0000", 2024-09-14T09:08:09.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6934000000000001e-05 2024-09-14T09:08:09.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:09.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896334+0000", 2024-09-14T09:08:09.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018279360000000001 2024-09-14T09:08:09.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896372+0000", 2024-09-14T09:08:09.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7675000000000001e-05 2024-09-14T09:08:09.220 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.220 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.220 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.220 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4671.0:2426 3.9 e36/22 3:972a2435:::rbd_data.1112ca7492e7.0000000000000024:head v 36'74, mlcod=35'71)", 2024-09-14T09:08:09.220 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.895232+0000", 2024-09-14T09:08:09.221 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.2798801869999998, 2024-09-14T09:08:09.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0041573369999999997, 2024-09-14T09:08:09.221 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.221 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.221 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:09.221 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895232+0000", 2024-09-14T09:08:09.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895232+0000", 2024-09-14T09:08:09.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895233+0000", 2024-09-14T09:08:09.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6399999999999998e-07 2024-09-14T09:08:09.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895237+0000", 2024-09-14T09:08:09.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1559999999999997e-06 2024-09-14T09:08:09.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895246+0000", 2024-09-14T09:08:09.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5310000000000007e-06 2024-09-14T09:08:09.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895253+0000", 2024-09-14T09:08:09.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9070000000000001e-06 2024-09-14T09:08:09.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895309+0000", 2024-09-14T09:08:09.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6187999999999998e-05 2024-09-14T09:08:09.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895327+0000", 2024-09-14T09:08:09.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7277000000000001e-05 2024-09-14T09:08:09.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:09.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.899348+0000", 2024-09-14T09:08:09.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040209130000000001 2024-09-14T09:08:09.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.899390+0000", 2024-09-14T09:08:09.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2101000000000002e-05 2024-09-14T09:08:09.225 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.225 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.226 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.226 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4671.0:2450 3.c e36/22 3:31a26635:::rbd_data.1112ca7492e7.0000000000000055:head v 36'33, mlcod=35'30)", 2024-09-14T09:08:09.226 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.895270+0000", 2024-09-14T09:08:09.226 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.2798423699999999, 2024-09-14T09:08:09.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0036394999999999999, 2024-09-14T09:08:09.226 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.226 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.226 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:09.226 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895270+0000", 2024-09-14T09:08:09.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895270+0000", 2024-09-14T09:08:09.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895270+0000", 2024-09-14T09:08:09.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4400000000000001e-07 2024-09-14T09:08:09.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895278+0000", 2024-09-14T09:08:09.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1269999999999997e-06 2024-09-14T09:08:09.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895286+0000", 2024-09-14T09:08:09.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7339999999999997e-06 2024-09-14T09:08:09.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895295+0000", 2024-09-14T09:08:09.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2240000000000001e-06 2024-09-14T09:08:09.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895394+0000", 2024-09-14T09:08:09.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8159000000000007e-05 2024-09-14T09:08:09.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895417+0000", 2024-09-14T09:08:09.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3235999999999999e-05 2024-09-14T09:08:09.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:09.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.898870+0000", 2024-09-14T09:08:09.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034533189999999998 2024-09-14T09:08:09.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.898910+0000", 2024-09-14T09:08:09.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9456999999999998e-05 2024-09-14T09:08:09.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4671.0:2457 3.15 e36/22 3:ab68b81a:::rbd_data.1112ca7492e7.000000000000006c:head v 36'61, mlcod=35'58)", 2024-09-14T09:08:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.895311+0000", 2024-09-14T09:08:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.2798020179999998, 2024-09-14T09:08:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063523160000000002, 2024-09-14T09:08:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.231 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895311+0000", 2024-09-14T09:08:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895311+0000", 2024-09-14T09:08:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895311+0000", 2024-09-14T09:08:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5100000000000001e-07 2024-09-14T09:08:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895317+0000", 2024-09-14T09:08:09.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.533e-06 2024-09-14T09:08:09.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895324+0000", 2024-09-14T09:08:09.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6039999999999998e-06 2024-09-14T09:08:09.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895329+0000", 2024-09-14T09:08:09.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6489999999999999e-06 2024-09-14T09:08:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895431+0000", 2024-09-14T09:08:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102632 2024-09-14T09:08:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895450+0000", 2024-09-14T09:08:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8929000000000001e-05 2024-09-14T09:08:09.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901619+0000", 2024-09-14T09:08:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061693399999999997 2024-09-14T09:08:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901663+0000", 2024-09-14T09:08:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3377999999999997e-05 2024-09-14T09:08:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.236 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4671.0:2459 3.2 e36/22 3:477686f7:::rbd_data.1112ca7492e7.000000000000006d:head v 36'16, mlcod=35'11)", 2024-09-14T09:08:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.895770+0000", 2024-09-14T09:08:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.2793421809999996, 2024-09-14T09:08:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058664190000000003, 2024-09-14T09:08:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895770+0000", 2024-09-14T09:08:09.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895770+0000", 2024-09-14T09:08:09.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895771+0000", 2024-09-14T09:08:09.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8500000000000001e-07 2024-09-14T09:08:09.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895776+0000", 2024-09-14T09:08:09.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3449999999999996e-06 2024-09-14T09:08:09.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895785+0000", 2024-09-14T09:08:09.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9930000000000001e-06 2024-09-14T09:08:09.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895792+0000", 2024-09-14T09:08:09.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3269999999999997e-06 2024-09-14T09:08:09.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895836+0000", 2024-09-14T09:08:09.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4474999999999997e-05 2024-09-14T09:08:09.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895855+0000", 2024-09-14T09:08:09.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8709999999999999e-05 2024-09-14T09:08:09.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:09.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901599+0000", 2024-09-14T09:08:09.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0057440019999999998 2024-09-14T09:08:09.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901637+0000", 2024-09-14T09:08:09.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7882000000000001e-05 2024-09-14T09:08:09.241 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.241 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.241 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.241 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4671.0:2452 3.5 e36/22 3:a0dd09af:::rbd_data.1112ca7492e7.0000000000000069:head v 36'120, mlcod=35'115)", 2024-09-14T09:08:09.241 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.896937+0000", 2024-09-14T09:08:09.242 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.2781758380000001, 2024-09-14T09:08:09.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050325939999999996, 2024-09-14T09:08:09.242 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.242 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.242 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:09.242 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896937+0000", 2024-09-14T09:08:09.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896937+0000", 2024-09-14T09:08:09.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896937+0000", 2024-09-14T09:08:09.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6799999999999999e-07 2024-09-14T09:08:09.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896946+0000", 2024-09-14T09:08:09.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.799e-06 2024-09-14T09:08:09.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896959+0000", 2024-09-14T09:08:09.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.308e-05 2024-09-14T09:08:09.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896967+0000", 2024-09-14T09:08:09.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1679999999999998e-06 2024-09-14T09:08:09.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.897028+0000", 2024-09-14T09:08:09.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1958000000000005e-05 2024-09-14T09:08:09.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.897049+0000", 2024-09-14T09:08:09.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0468000000000001e-05 2024-09-14T09:08:09.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:09.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901929+0000", 2024-09-14T09:08:09.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048796610000000004 2024-09-14T09:08:09.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901969+0000", 2024-09-14T09:08:09.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0692000000000003e-05 2024-09-14T09:08:09.245 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.246 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.246 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.246 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4671.0:2454 3.9 e36/22 3:9133dedc:::rbd_data.1112ca7492e7.000000000000006a:head v 36'76, mlcod=35'71)", 2024-09-14T09:08:09.246 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.898162+0000", 2024-09-14T09:08:09.246 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.2769509699999997, 2024-09-14T09:08:09.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037860620000000002, 2024-09-14T09:08:09.246 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.246 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.246 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:09.246 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.898162+0000", 2024-09-14T09:08:09.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.898162+0000", 2024-09-14T09:08:09.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.898162+0000", 2024-09-14T09:08:09.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1900000000000002e-07 2024-09-14T09:08:09.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.898167+0000", 2024-09-14T09:08:09.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9880000000000004e-06 2024-09-14T09:08:09.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.898184+0000", 2024-09-14T09:08:09.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6974999999999999e-05 2024-09-14T09:08:09.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.898191+0000", 2024-09-14T09:08:09.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7150000000000001e-06 2024-09-14T09:08:09.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.898236+0000", 2024-09-14T09:08:09.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5459e-05 2024-09-14T09:08:09.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.898265+0000", 2024-09-14T09:08:09.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8892000000000001e-05 2024-09-14T09:08:09.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:09.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901911+0000", 2024-09-14T09:08:09.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003646023 2024-09-14T09:08:09.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901948+0000", 2024-09-14T09:08:09.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6390999999999998e-05 2024-09-14T09:08:09.250 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.250 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.250 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.250 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4671.0:2670 3.6 e36/22 3:67203760:::rbd_data.1112ca7492e7.000000000000001a:head v 36'23, mlcod=36'21)", 2024-09-14T09:08:09.251 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.932069+0000", 2024-09-14T09:08:09.251 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.24304389, 2024-09-14T09:08:09.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021578859999999999, 2024-09-14T09:08:09.251 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.251 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.251 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:09.251 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.932069+0000", 2024-09-14T09:08:09.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.932069+0000", 2024-09-14T09:08:09.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.932070+0000", 2024-09-14T09:08:09.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.378e-06 2024-09-14T09:08:09.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.932379+0000", 2024-09-14T09:08:09.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000309446 2024-09-14T09:08:09.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.932398+0000", 2024-09-14T09:08:09.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8824000000000001e-05 2024-09-14T09:08:09.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.932408+0000", 2024-09-14T09:08:09.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2629999999999992e-06 2024-09-14T09:08:09.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.932471+0000", 2024-09-14T09:08:09.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2947000000000006e-05 2024-09-14T09:08:09.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.932492+0000", 2024-09-14T09:08:09.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1158999999999999e-05 2024-09-14T09:08:09.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:09.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.934195+0000", 2024-09-14T09:08:09.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017032989999999999 2024-09-14T09:08:09.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.934227+0000", 2024-09-14T09:08:09.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1569999999999998e-05 2024-09-14T09:08:09.256 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.256 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.256 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.256 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4671.0:2668 3.1e e36/22 3:7eb2cde1:::rbd_data.1112ca7492e7.0000000000000019:head v 36'59, mlcod=35'57)", 2024-09-14T09:08:09.256 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.932075+0000", 2024-09-14T09:08:09.256 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.2430377449999996, 2024-09-14T09:08:09.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027141940000000001, 2024-09-14T09:08:09.256 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.256 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.257 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:09.257 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.932075+0000", 2024-09-14T09:08:09.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.932075+0000", 2024-09-14T09:08:09.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.932076+0000", 2024-09-14T09:08:09.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.11e-06 2024-09-14T09:08:09.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.932698+0000", 2024-09-14T09:08:09.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00062203400000000004 2024-09-14T09:08:09.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.932712+0000", 2024-09-14T09:08:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3929e-05 2024-09-14T09:08:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.932721+0000", 2024-09-14T09:08:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9509999999999995e-06 2024-09-14T09:08:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.932780+0000", 2024-09-14T09:08:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9519999999999999e-05 2024-09-14T09:08:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.932800+0000", 2024-09-14T09:08:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9786999999999999e-05 2024-09-14T09:08:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.934753+0000", 2024-09-14T09:08:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019525300000000001 2024-09-14T09:08:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.934789+0000", 2024-09-14T09:08:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6332999999999999e-05 2024-09-14T09:08:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4671.0:2671 3.6 e36/22 3:67203760:::rbd_data.1112ca7492e7.000000000000001a:head v 36'25, mlcod=36'21)", 2024-09-14T09:08:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.933357+0000", 2024-09-14T09:08:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.2417556249999997, 2024-09-14T09:08:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020095360000000001, 2024-09-14T09:08:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.933357+0000", 2024-09-14T09:08:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.933357+0000", 2024-09-14T09:08:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.933358+0000", 2024-09-14T09:08:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.85e-07 2024-09-14T09:08:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.933365+0000", 2024-09-14T09:08:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2049999999999996e-06 2024-09-14T09:08:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.933376+0000", 2024-09-14T09:08:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1348999999999999e-05 2024-09-14T09:08:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.933384+0000", 2024-09-14T09:08:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7919999999999993e-06 2024-09-14T09:08:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.933468+0000", 2024-09-14T09:08:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3389999999999999e-05 2024-09-14T09:08:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.933485+0000", 2024-09-14T09:08:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7526000000000001e-05 2024-09-14T09:08:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.935331+0000", 2024-09-14T09:08:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001846215 2024-09-14T09:08:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.935366+0000", 2024-09-14T09:08:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5173999999999999e-05 2024-09-14T09:08:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4604.0:1231 3.6 e37/22 3:63e26f6f:::rbd_header.1112609a9334:head v 37'69, mlcod=37'67)", 2024-09-14T09:08:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:05.116613+0000", 2024-09-14T09:08:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.0584998939999997, 2024-09-14T09:08:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020647780000000002, 2024-09-14T09:08:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:05.116613+0000", 2024-09-14T09:08:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:05.116613+0000", 2024-09-14T09:08:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:05.116613+0000", 2024-09-14T09:08:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9800000000000004e-07 2024-09-14T09:08:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:05.116618+0000", 2024-09-14T09:08:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5789999999999997e-06 2024-09-14T09:08:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:05.116625+0000", 2024-09-14T09:08:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6399999999999997e-06 2024-09-14T09:08:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:05.116631+0000", 2024-09-14T09:08:09.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999998e-06 2024-09-14T09:08:09.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:05.116678+0000", 2024-09-14T09:08:09.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7324999999999998e-05 2024-09-14T09:08:09.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:05.116697+0000", 2024-09-14T09:08:09.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8929000000000001e-05 2024-09-14T09:08:09.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:09.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:05.118647+0000", 2024-09-14T09:08:09.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001950139 2024-09-14T09:08:09.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:05.118677+0000", 2024-09-14T09:08:09.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0077999999999999e-05 2024-09-14T09:08:09.271 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.271 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.271 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.271 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4604.0:1287 3.6 e37/22 3:63e26f6f:::rbd_header.1112609a9334:head v 37'71, mlcod=37'69)", 2024-09-14T09:08:09.271 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:05.152763+0000", 2024-09-14T09:08:09.272 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.0223495930000004, 2024-09-14T09:08:09.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021581679999999998, 2024-09-14T09:08:09.272 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.272 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.272 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:09.272 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:05.152763+0000", 2024-09-14T09:08:09.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:05.152763+0000", 2024-09-14T09:08:09.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:05.152763+0000", 2024-09-14T09:08:09.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:08:09.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:05.152768+0000", 2024-09-14T09:08:09.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2420000000000002e-06 2024-09-14T09:08:09.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:05.152775+0000", 2024-09-14T09:08:09.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8450000000000003e-06 2024-09-14T09:08:09.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:05.152782+0000", 2024-09-14T09:08:09.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.071e-06 2024-09-14T09:08:09.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:05.152820+0000", 2024-09-14T09:08:09.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7941999999999997e-05 2024-09-14T09:08:09.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:05.152831+0000", 2024-09-14T09:08:09.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1815e-05 2024-09-14T09:08:09.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:09.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:05.154892+0000", 2024-09-14T09:08:09.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020604859999999998 2024-09-14T09:08:09.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:05.154921+0000", 2024-09-14T09:08:09.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9305000000000001e-05 2024-09-14T09:08:09.276 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.276 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.276 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.276 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.276 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.276 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:09.277 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #10, image image_client.0-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent11 2024-09-14T09:08:09.277 INFO:teuthology.orchestra.run.smithi148.stdout:1576 write 0xa401600 thru 0xa40c195 (0xab96 bytes) 2024-09-14T09:08:09.278 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:08:09.279 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:09.279+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:09.296 INFO:teuthology.orchestra.run.smithi148.stdout:1577 write 0xba5f000 thru 0xba6dbbb (0xebbc bytes) 2024-09-14T09:08:09.296 INFO:teuthology.orchestra.run.smithi148.stdout:1579 write 0x3695000 thru 0x3699d14 (0x4d15 bytes) 2024-09-14T09:08:09.296 INFO:teuthology.orchestra.run.smithi148.stdout:1580 punch from 0x95a7000 to 0x95ad000, (0x6000 bytes) 2024-09-14T09:08:09.297 INFO:teuthology.orchestra.run.smithi148.stdout:1582 read 0x2661800 thru 0x2663a99 (0x229a bytes) 2024-09-14T09:08:09.297 INFO:teuthology.orchestra.run.smithi148.stdout:1589 punch from 0x6d84a00 to 0x6d94400, (0xfa00 bytes) 2024-09-14T09:08:09.303 INFO:teuthology.orchestra.run.smithi148.stdout:1590 trunc from 0xba6dc00 to 0x72fd200 2024-09-14T09:08:09.357 INFO:teuthology.orchestra.run.smithi148.stdout:1591 trunc from 0x72fd200 to 0x54dc000 2024-09-14T09:08:09.372 INFO:teuthology.orchestra.run.smithi148.stdout:1593 read 0x3f4e600 thru 0x3f5d0e6 (0xeae7 bytes) 2024-09-14T09:08:09.372 INFO:teuthology.orchestra.run.smithi148.stdout:1595 punch from 0x38c7e00 to 0x38c8c00, (0xe00 bytes) 2024-09-14T09:08:09.378 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:09.381+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:09.398 INFO:teuthology.orchestra.run.smithi148.stdout:1597 write 0xc57ee00 thru 0xc586180 (0x7381 bytes) 2024-09-14T09:08:09.398 INFO:teuthology.orchestra.run.smithi148.stdout:1600 read 0xa55200 thru 0xa60fb2 (0xbdb3 bytes) 2024-09-14T09:08:09.399 INFO:teuthology.orchestra.run.smithi148.stdout:1601 write 0x421b600 thru 0x422741e (0xbe1f bytes) 2024-09-14T09:08:09.399 INFO:teuthology.orchestra.run.smithi148.stdout:1602 write 0xb3ed800 thru 0xb3f1d85 (0x4586 bytes) 2024-09-14T09:08:09.399 INFO:teuthology.orchestra.run.smithi148.stdout:1604 write 0x75b0400 thru 0x75b4a28 (0x4629 bytes) 2024-09-14T09:08:09.400 INFO:teuthology.orchestra.run.smithi148.stdout:1605 read 0x7a4d000 thru 0x7a4dd4e (0xd4f bytes) 2024-09-14T09:08:09.400 INFO:teuthology.orchestra.run.smithi148.stdout:1606 write 0x49d0000 thru 0x49de92e (0xe92f bytes) 2024-09-14T09:08:09.405 INFO:teuthology.orchestra.run.smithi148.stdout:1607 trunc from 0xc586200 to 0x804d400 2024-09-14T09:08:09.430 INFO:teuthology.orchestra.run.smithi148.stdout:1608 read 0x475d400 thru 0x476a913 (0xd514 bytes) 2024-09-14T09:08:09.430 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:09.430 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:09.430 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:09.430 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:09.431 INFO:teuthology.orchestra.run.smithi148.stdout:1609 write 0x3c20a00 thru 0x3c24a55 (0x4056 bytes) 2024-09-14T09:08:09.435 INFO:teuthology.orchestra.run.smithi148.stdout:1610 trunc from 0x804d400 to 0xad34400 2024-09-14T09:08:09.440 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:08:09.449 INFO:teuthology.orchestra.run.smithi148.stdout:1611 read 0x6eb400 thru 0x6f9ed5 (0xead6 bytes) 2024-09-14T09:08:09.450 INFO:teuthology.orchestra.run.smithi148.stdout:1612 clone 13 order 24 su 131072 sc 12 2024-09-14T09:08:09.482 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:09.484+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:09.580 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:09.582+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:09.583 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:09.584 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:09.584 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:09.584 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:09.584 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:09.592 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:08:09.681 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:09.683+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:09.697 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:669 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862212+0000", 2024-09-14T09:08:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.836530147, 2024-09-14T09:08:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0073209269999999996, 2024-09-14T09:08:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 669 2024-09-14T09:08:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862212+0000", 2024-09-14T09:08:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862212+0000", 2024-09-14T09:08:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862212+0000", 2024-09-14T09:08:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7999999999999995e-07 2024-09-14T09:08:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862214+0000", 2024-09-14T09:08:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.26e-06 2024-09-14T09:08:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862221+0000", 2024-09-14T09:08:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6270000000000002e-06 2024-09-14T09:08:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862226+0000", 2024-09-14T09:08:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0989999999999998e-06 2024-09-14T09:08:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869365+0000", 2024-09-14T09:08:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0071387109999999998 2024-09-14T09:08:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869434+0000", 2024-09-14T09:08:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9441000000000001e-05 2024-09-14T09:08:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869532+0000", 2024-09-14T09:08:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8109000000000005e-05 2024-09-14T09:08:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:683 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 2621440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862256+0000", 2024-09-14T09:08:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.836485761, 2024-09-14T09:08:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074734199999999997, 2024-09-14T09:08:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 683 2024-09-14T09:08:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862256+0000", 2024-09-14T09:08:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862256+0000", 2024-09-14T09:08:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862256+0000", 2024-09-14T09:08:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3599999999999999e-07 2024-09-14T09:08:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862258+0000", 2024-09-14T09:08:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8610000000000001e-06 2024-09-14T09:08:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862264+0000", 2024-09-14T09:08:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0959999999999997e-06 2024-09-14T09:08:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862269+0000", 2024-09-14T09:08:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5850000000000001e-06 2024-09-14T09:08:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869554+0000", 2024-09-14T09:08:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0072851410000000002 2024-09-14T09:08:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869629+0000", 2024-09-14T09:08:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4537999999999997e-05 2024-09-14T09:08:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869729+0000", 2024-09-14T09:08:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100763 2024-09-14T09:08:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:684 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 4063232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862276+0000", 2024-09-14T09:08:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.836465737999999, 2024-09-14T09:08:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076148459999999998, 2024-09-14T09:08:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 684 2024-09-14T09:08:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862276+0000", 2024-09-14T09:08:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862276+0000", 2024-09-14T09:08:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862277+0000", 2024-09-14T09:08:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9599999999999999e-07 2024-09-14T09:08:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862278+0000", 2024-09-14T09:08:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.858e-06 2024-09-14T09:08:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862285+0000", 2024-09-14T09:08:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1800000000000001e-06 2024-09-14T09:08:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862289+0000", 2024-09-14T09:08:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8890000000000001e-06 2024-09-14T09:08:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869764+0000", 2024-09-14T09:08:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074748949999999996 2024-09-14T09:08:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869817+0000", 2024-09-14T09:08:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2132999999999997e-05 2024-09-14T09:08:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869891+0000", 2024-09-14T09:08:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4295000000000006e-05 2024-09-14T09:08:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:685 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 5505024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862311+0000", 2024-09-14T09:08:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.836430971, 2024-09-14T09:08:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0078557420000000006, 2024-09-14T09:08:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 685 2024-09-14T09:08:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862311+0000", 2024-09-14T09:08:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862311+0000", 2024-09-14T09:08:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862311+0000", 2024-09-14T09:08:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5000000000000002e-07 2024-09-14T09:08:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862314+0000", 2024-09-14T09:08:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.165e-06 2024-09-14T09:08:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862320+0000", 2024-09-14T09:08:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5699999999999998e-06 2024-09-14T09:08:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862326+0000", 2024-09-14T09:08:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0549999999999996e-06 2024-09-14T09:08:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869941+0000", 2024-09-14T09:08:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.007614829 2024-09-14T09:08:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870020+0000", 2024-09-14T09:08:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8563e-05 2024-09-14T09:08:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870166+0000", 2024-09-14T09:08:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014690999999999999 2024-09-14T09:08:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:706 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862467+0000", 2024-09-14T09:08:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.836275063, 2024-09-14T09:08:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0075686479999999999, 2024-09-14T09:08:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 706 2024-09-14T09:08:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862467+0000", 2024-09-14T09:08:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862467+0000", 2024-09-14T09:08:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862467+0000", 2024-09-14T09:08:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4499999999999997e-07 2024-09-14T09:08:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862470+0000", 2024-09-14T09:08:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3130000000000001e-06 2024-09-14T09:08:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862477+0000", 2024-09-14T09:08:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9240000000000001e-06 2024-09-14T09:08:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862482+0000", 2024-09-14T09:08:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0039999999999999e-06 2024-09-14T09:08:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869922+0000", 2024-09-14T09:08:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074403009999999999 2024-09-14T09:08:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869982+0000", 2024-09-14T09:08:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9746e-05 2024-09-14T09:08:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870035+0000", 2024-09-14T09:08:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3715000000000003e-05 2024-09-14T09:08:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:707 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 2752512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862490+0000", 2024-09-14T09:08:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.836251917, 2024-09-14T09:08:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076711289999999996, 2024-09-14T09:08:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 707 2024-09-14T09:08:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862490+0000", 2024-09-14T09:08:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862490+0000", 2024-09-14T09:08:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862490+0000", 2024-09-14T09:08:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3300000000000003e-07 2024-09-14T09:08:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862492+0000", 2024-09-14T09:08:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.996e-06 2024-09-14T09:08:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862499+0000", 2024-09-14T09:08:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.776e-06 2024-09-14T09:08:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862504+0000", 2024-09-14T09:08:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8670000000000002e-06 2024-09-14T09:08:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870051+0000", 2024-09-14T09:08:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0075471089999999998 2024-09-14T09:08:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870104+0000", 2024-09-14T09:08:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3439000000000001e-05 2024-09-14T09:08:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870161+0000", 2024-09-14T09:08:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6508999999999997e-05 2024-09-14T09:08:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:708 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862512+0000", 2024-09-14T09:08:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.836229536999999, 2024-09-14T09:08:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0078051250000000004, 2024-09-14T09:08:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 708 2024-09-14T09:08:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862512+0000", 2024-09-14T09:08:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862512+0000", 2024-09-14T09:08:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862513+0000", 2024-09-14T09:08:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1300000000000001e-07 2024-09-14T09:08:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862515+0000", 2024-09-14T09:08:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.922e-06 2024-09-14T09:08:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862521+0000", 2024-09-14T09:08:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3160000000000002e-06 2024-09-14T09:08:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862526+0000", 2024-09-14T09:08:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0209999999999999e-06 2024-09-14T09:08:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870177+0000", 2024-09-14T09:08:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076510720000000001 2024-09-14T09:08:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870244+0000", 2024-09-14T09:08:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6613999999999996e-05 2024-09-14T09:08:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870317+0000", 2024-09-14T09:08:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3767e-05 2024-09-14T09:08:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:709 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 5636096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862547+0000", 2024-09-14T09:08:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.836194546, 2024-09-14T09:08:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080137230000000004, 2024-09-14T09:08:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 709 2024-09-14T09:08:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862547+0000", 2024-09-14T09:08:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862547+0000", 2024-09-14T09:08:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862548+0000", 2024-09-14T09:08:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3200000000000005e-07 2024-09-14T09:08:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862550+0000", 2024-09-14T09:08:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0650000000000001e-06 2024-09-14T09:08:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862557+0000", 2024-09-14T09:08:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8170000000000001e-06 2024-09-14T09:08:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862561+0000", 2024-09-14T09:08:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7090000000000001e-06 2024-09-14T09:08:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870358+0000", 2024-09-14T09:08:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0077970690000000002 2024-09-14T09:08:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870437+0000", 2024-09-14T09:08:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8059999999999995e-05 2024-09-14T09:08:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870561+0000", 2024-09-14T09:08:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012437099999999999 2024-09-14T09:08:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:722 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862576+0000", 2024-09-14T09:08:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.836166003000001, 2024-09-14T09:08:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0078555269999999993, 2024-09-14T09:08:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 722 2024-09-14T09:08:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862576+0000", 2024-09-14T09:08:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862576+0000", 2024-09-14T09:08:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862576+0000", 2024-09-14T09:08:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3399999999999999e-07 2024-09-14T09:08:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862579+0000", 2024-09-14T09:08:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4159999999999998e-06 2024-09-14T09:08:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862586+0000", 2024-09-14T09:08:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9500000000000004e-06 2024-09-14T09:08:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862591+0000", 2024-09-14T09:08:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2480000000000004e-06 2024-09-14T09:08:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870335+0000", 2024-09-14T09:08:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0077443319999999996 2024-09-14T09:08:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870379+0000", 2024-09-14T09:08:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4092999999999999e-05 2024-09-14T09:08:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870431+0000", 2024-09-14T09:08:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1953999999999998e-05 2024-09-14T09:08:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:723 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 2686976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862598+0000", 2024-09-14T09:08:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.836143453, 2024-09-14T09:08:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079559650000000006, 2024-09-14T09:08:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 723 2024-09-14T09:08:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862598+0000", 2024-09-14T09:08:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862598+0000", 2024-09-14T09:08:09.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862599+0000", 2024-09-14T09:08:09.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2024-09-14T09:08:09.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862601+0000", 2024-09-14T09:08:09.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0789999999999999e-06 2024-09-14T09:08:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862607+0000", 2024-09-14T09:08:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.365e-06 2024-09-14T09:08:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862618+0000", 2024-09-14T09:08:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1214e-05 2024-09-14T09:08:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870446+0000", 2024-09-14T09:08:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0078275419999999998 2024-09-14T09:08:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870491+0000", 2024-09-14T09:08:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4901000000000003e-05 2024-09-14T09:08:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870554+0000", 2024-09-14T09:08:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3417999999999995e-05 2024-09-14T09:08:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:724 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862626+0000", 2024-09-14T09:08:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.836116003000001, 2024-09-14T09:08:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0081322540000000002, 2024-09-14T09:08:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 724 2024-09-14T09:08:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862626+0000", 2024-09-14T09:08:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862626+0000", 2024-09-14T09:08:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862626+0000", 2024-09-14T09:08:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5799999999999999e-07 2024-09-14T09:08:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862628+0000", 2024-09-14T09:08:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1459999999999999e-06 2024-09-14T09:08:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862635+0000", 2024-09-14T09:08:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3330000000000002e-06 2024-09-14T09:08:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862640+0000", 2024-09-14T09:08:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5480000000000001e-06 2024-09-14T09:08:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870580+0000", 2024-09-14T09:08:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079394909999999999 2024-09-14T09:08:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870649+0000", 2024-09-14T09:08:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8748e-05 2024-09-14T09:08:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870758+0000", 2024-09-14T09:08:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010943 2024-09-14T09:08:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:725 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 5636096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862648+0000", 2024-09-14T09:08:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.8360941, 2024-09-14T09:08:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0083906950000000001, 2024-09-14T09:08:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 725 2024-09-14T09:08:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862648+0000", 2024-09-14T09:08:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862648+0000", 2024-09-14T09:08:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862648+0000", 2024-09-14T09:08:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1099999999999995e-07 2024-09-14T09:08:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862650+0000", 2024-09-14T09:08:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0880000000000002e-06 2024-09-14T09:08:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862656+0000", 2024-09-14T09:08:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9850000000000003e-06 2024-09-14T09:08:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862661+0000", 2024-09-14T09:08:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.775e-06 2024-09-14T09:08:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870815+0000", 2024-09-14T09:08:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0081533850000000008 2024-09-14T09:08:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870897+0000", 2024-09-14T09:08:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2235000000000001e-05 2024-09-14T09:08:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871038+0000", 2024-09-14T09:08:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014151600000000001 2024-09-14T09:08:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:746 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 1376256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862897+0000", 2024-09-14T09:08:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.835844768999999, 2024-09-14T09:08:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080739269999999998, 2024-09-14T09:08:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 746 2024-09-14T09:08:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862897+0000", 2024-09-14T09:08:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862897+0000", 2024-09-14T09:08:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862898+0000", 2024-09-14T09:08:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8100000000000003e-07 2024-09-14T09:08:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862901+0000", 2024-09-14T09:08:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5080000000000001e-06 2024-09-14T09:08:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862909+0000", 2024-09-14T09:08:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1610000000000003e-06 2024-09-14T09:08:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862914+0000", 2024-09-14T09:08:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6689999999999997e-06 2024-09-14T09:08:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870788+0000", 2024-09-14T09:08:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0078740319999999996 2024-09-14T09:08:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870870+0000", 2024-09-14T09:08:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2169000000000006e-05 2024-09-14T09:08:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870971+0000", 2024-09-14T09:08:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100807 2024-09-14T09:08:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:747 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 2818048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862922+0000", 2024-09-14T09:08:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.835820204999999, 2024-09-14T09:08:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082517779999999995, 2024-09-14T09:08:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 747 2024-09-14T09:08:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862922+0000", 2024-09-14T09:08:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862922+0000", 2024-09-14T09:08:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862922+0000", 2024-09-14T09:08:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.51e-07 2024-09-14T09:08:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862924+0000", 2024-09-14T09:08:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-06 2024-09-14T09:08:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862933+0000", 2024-09-14T09:08:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6039999999999993e-06 2024-09-14T09:08:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862938+0000", 2024-09-14T09:08:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0180000000000001e-06 2024-09-14T09:08:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870996+0000", 2024-09-14T09:08:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080584820000000005 2024-09-14T09:08:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871073+0000", 2024-09-14T09:08:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6641e-05 2024-09-14T09:08:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871173+0000", 2024-09-14T09:08:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100462 2024-09-14T09:08:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:748 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 4325376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862945+0000", 2024-09-14T09:08:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.83579623, 2024-09-14T09:08:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084586330000000001, 2024-09-14T09:08:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 748 2024-09-14T09:08:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862945+0000", 2024-09-14T09:08:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862945+0000", 2024-09-14T09:08:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862946+0000", 2024-09-14T09:08:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6499999999999999e-07 2024-09-14T09:08:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862948+0000", 2024-09-14T09:08:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0269999999999998e-06 2024-09-14T09:08:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862954+0000", 2024-09-14T09:08:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3049999999999998e-06 2024-09-14T09:08:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862966+0000", 2024-09-14T09:08:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1773999999999999e-05 2024-09-14T09:08:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871217+0000", 2024-09-14T09:08:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082510350000000003 2024-09-14T09:08:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871302+0000", 2024-09-14T09:08:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4940999999999999e-05 2024-09-14T09:08:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871404+0000", 2024-09-14T09:08:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102086 2024-09-14T09:08:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:749 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862974+0000", 2024-09-14T09:08:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.835767859000001, 2024-09-14T09:08:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0086102100000000001, 2024-09-14T09:08:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 749 2024-09-14T09:08:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862974+0000", 2024-09-14T09:08:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862974+0000", 2024-09-14T09:08:09.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862974+0000", 2024-09-14T09:08:09.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9500000000000002e-07 2024-09-14T09:08:09.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862977+0000", 2024-09-14T09:08:09.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2699999999999999e-06 2024-09-14T09:08:09.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862984+0000", 2024-09-14T09:08:09.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7489999999999998e-06 2024-09-14T09:08:09.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862989+0000", 2024-09-14T09:08:09.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9490000000000004e-06 2024-09-14T09:08:09.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871452+0000", 2024-09-14T09:08:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084624399999999999 2024-09-14T09:08:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871525+0000", 2024-09-14T09:08:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3413999999999999e-05 2024-09-14T09:08:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871584+0000", 2024-09-14T09:08:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8792999999999998e-05 2024-09-14T09:08:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:762 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.863007+0000", 2024-09-14T09:08:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.835734349999999, 2024-09-14T09:08:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0086029390000000004, 2024-09-14T09:08:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 762 2024-09-14T09:08:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863007+0000", 2024-09-14T09:08:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863007+0000", 2024-09-14T09:08:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863008+0000", 2024-09-14T09:08:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6599999999999996e-07 2024-09-14T09:08:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863011+0000", 2024-09-14T09:08:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7030000000000002e-06 2024-09-14T09:08:09.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863018+0000", 2024-09-14T09:08:09.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9569999999999996e-06 2024-09-14T09:08:09.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863030+0000", 2024-09-14T09:08:09.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2415000000000001e-05 2024-09-14T09:08:09.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871436+0000", 2024-09-14T09:08:09.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084056819999999994 2024-09-14T09:08:09.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871510+0000", 2024-09-14T09:08:09.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3997000000000003e-05 2024-09-14T09:08:09.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871610+0000", 2024-09-14T09:08:09.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100519 2024-09-14T09:08:09.779 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.779 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.780 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.780 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:763 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 2818048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:09.780 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.863039+0000", 2024-09-14T09:08:09.780 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.835702703999999, 2024-09-14T09:08:09.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087689180000000005, 2024-09-14T09:08:09.780 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.780 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.780 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:09.780 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:09.780 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:09.780 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:09.780 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 763 2024-09-14T09:08:09.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.781 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863039+0000", 2024-09-14T09:08:09.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863039+0000", 2024-09-14T09:08:09.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863040+0000", 2024-09-14T09:08:09.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8800000000000002e-07 2024-09-14T09:08:09.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863042+0000", 2024-09-14T09:08:09.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.351e-06 2024-09-14T09:08:09.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863049+0000", 2024-09-14T09:08:09.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7499999999999997e-06 2024-09-14T09:08:09.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863057+0000", 2024-09-14T09:08:09.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9999999999999996e-06 2024-09-14T09:08:09.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871629+0000", 2024-09-14T09:08:09.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0085725560000000003 2024-09-14T09:08:09.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871702+0000", 2024-09-14T09:08:09.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2677999999999998e-05 2024-09-14T09:08:09.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871808+0000", 2024-09-14T09:08:09.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105995 2024-09-14T09:08:09.784 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.784 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.784 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.785 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:764 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 4259840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:09.785 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.863071+0000", 2024-09-14T09:08:09.785 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.83567028, 2024-09-14T09:08:09.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0089758600000000004, 2024-09-14T09:08:09.785 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.785 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.785 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:09.785 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:09.785 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:09.785 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:09.786 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 764 2024-09-14T09:08:09.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.786 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863071+0000", 2024-09-14T09:08:09.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863071+0000", 2024-09-14T09:08:09.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863072+0000", 2024-09-14T09:08:09.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7400000000000003e-07 2024-09-14T09:08:09.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863074+0000", 2024-09-14T09:08:09.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4530000000000001e-06 2024-09-14T09:08:09.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863081+0000", 2024-09-14T09:08:09.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.776e-06 2024-09-14T09:08:09.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863087+0000", 2024-09-14T09:08:09.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7409999999999998e-06 2024-09-14T09:08:09.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871853+0000", 2024-09-14T09:08:09.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087656309999999994 2024-09-14T09:08:09.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871938+0000", 2024-09-14T09:08:09.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5846000000000004e-05 2024-09-14T09:08:09.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872047+0000", 2024-09-14T09:08:09.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010883900000000001 2024-09-14T09:08:09.790 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.791 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.791 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.791 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:765 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:09.791 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.863094+0000", 2024-09-14T09:08:09.791 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.83564739, 2024-09-14T09:08:09.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0091722320000000006, 2024-09-14T09:08:09.792 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:09.792 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:09.792 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:09.792 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:09.792 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:09.792 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:09.792 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 765 2024-09-14T09:08:09.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.793 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:09.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:09.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863094+0000", 2024-09-14T09:08:09.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:09.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863094+0000", 2024-09-14T09:08:09.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:09.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:09.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863095+0000", 2024-09-14T09:08:09.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3799999999999997e-07 2024-09-14T09:08:09.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:09.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863097+0000", 2024-09-14T09:08:09.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.996e-06 2024-09-14T09:08:09.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:09.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863103+0000", 2024-09-14T09:08:09.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.443e-06 2024-09-14T09:08:09.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:09.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863110+0000", 2024-09-14T09:08:09.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6479999999999997e-06 2024-09-14T09:08:09.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:09.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872117+0000", 2024-09-14T09:08:09.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0090066590000000002 2024-09-14T09:08:09.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:09.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872183+0000", 2024-09-14T09:08:09.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6200999999999999e-05 2024-09-14T09:08:09.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:09.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:09.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:09.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872267+0000", 2024-09-14T09:08:09.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3746999999999996e-05 2024-09-14T09:08:09.799 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.799 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.799 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.799 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:09.799 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:09.799 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:09.800 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:09.802+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:09.801 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:08:09.843 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T09:08:09.901 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:09.904+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:09.913 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone12 from 0xad34400 (overlap 0x54dc000) to 0x3b66c00 2024-09-14T09:08:09.953 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:09.953 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:09.953 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:09.953 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:09.963 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:08:10.003 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:10.004+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:10.013 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:08:10.103 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:10.105+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:10.108 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:10.108 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:10.117 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:08:10.136 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:10.137 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:10.154 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:10.155 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:10.171 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:08:10.171 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:08:10.189 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:10.189 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:10.204 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:10.205+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:10.206 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:10.206 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:10.222 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:10.223 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:10.224 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:10.225 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:10.233 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:08:10.284 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #11, image image_client.0-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent12 2024-09-14T09:08:10.317 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:10.319+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:10.351 INFO:teuthology.orchestra.run.smithi148.stdout:1613 punch from 0x4380e00 to 0x4385400, (0x4600 bytes) 2024-09-14T09:08:10.357 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T09:08:10.358 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:08:10.358 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-14T09:08:10.358 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T09:08:10.358 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T09:08:10.358 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-14T09:08:10.379 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:10.379 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:10.389 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:08:10.391 INFO:teuthology.orchestra.run.smithi148.stdout:1614 trunc from 0xad34400 to 0xb746e00 2024-09-14T09:08:10.412 INFO:teuthology.orchestra.run.smithi148.stdout:1616 write 0xc8b6800 thru 0xc8bc31b (0x5b1c bytes) 2024-09-14T09:08:10.426 INFO:teuthology.orchestra.run.smithi148.stdout:1617 write 0xcbd1a00 thru 0xcbd53d9 (0x39da bytes) 2024-09-14T09:08:10.430 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:10.432+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:10.433 INFO:teuthology.orchestra.run.smithi148.stdout:1618 write 0xad1e600 thru 0xad284bc (0x9ebd bytes) 2024-09-14T09:08:10.433 INFO:teuthology.orchestra.run.smithi148.stdout:1619 write 0x6007600 thru 0x601664b (0xf04c bytes) 2024-09-14T09:08:10.434 INFO:teuthology.orchestra.run.smithi148.stdout:1620 read 0xc683a00 thru 0xc68da96 (0xa097 bytes) 2024-09-14T09:08:10.440 INFO:teuthology.orchestra.run.smithi148.stdout:1621 trunc from 0xcbd5400 to 0x8678a00 2024-09-14T09:08:10.485 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:10.485 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-14T09:08:10.485 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:10.506 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:10.508+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:10.558 INFO:teuthology.orchestra.run.smithi148.stdout:1622 write 0x194c800 thru 0x1954029 (0x782a bytes) 2024-09-14T09:08:10.565 INFO:teuthology.orchestra.run.smithi148.stdout:1625 write 0x3a55200 thru 0x3a5cda2 (0x7ba3 bytes) 2024-09-14T09:08:10.567 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:10.567 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:10.577 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:08:10.584 INFO:teuthology.orchestra.run.smithi148.stdout:1626 write 0xeab3400 thru 0xeaba9c7 (0x75c8 bytes) 2024-09-14T09:08:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:1627 punch from 0xfbe000 to 0xfcdc00, (0xfc00 bytes) 2024-09-14T09:08:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:1628 read 0xacb0600 thru 0xacb1096 (0xa97 bytes) 2024-09-14T09:08:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:1631 punch from 0x1d21a00 to 0x1d23200, (0x1800 bytes) 2024-09-14T09:08:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:1632 write 0xd61e800 thru 0xd6256f6 (0x6ef7 bytes) 2024-09-14T09:08:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:1633 write 0xa0b5000 thru 0xa0b646a (0x146b bytes) 2024-09-14T09:08:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:1635 read 0x6022e00 thru 0x602f4dd (0xc6de bytes) 2024-09-14T09:08:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:1636 read 0x7dade00 thru 0x7db4dd7 (0x6fd8 bytes) 2024-09-14T09:08:10.597 INFO:teuthology.orchestra.run.smithi148.stdout:1638 trunc from 0xeabaa00 to 0x6619c00 2024-09-14T09:08:10.607 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:10.609+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:10.626 INFO:teuthology.orchestra.run.smithi148.stdout:1641 read 0x2c79800 thru 0x2c8574c (0xbf4d bytes) 2024-09-14T09:08:10.632 INFO:teuthology.orchestra.run.smithi148.stdout:1643 trunc from 0x6619c00 to 0x243aa00 2024-09-14T09:08:10.661 INFO:teuthology.orchestra.run.smithi148.stdout:1644 trunc from 0x243aa00 to 0x8824a00 2024-09-14T09:08:10.669 INFO:teuthology.orchestra.run.smithi148.stdout:1645 read 0x6d23a00 thru 0x6d24999 (0xf9a bytes) 2024-09-14T09:08:10.674 INFO:teuthology.orchestra.run.smithi148.stdout:1648 read 0x532de00 thru 0x533aa62 (0xcc63 bytes) 2024-09-14T09:08:10.675 INFO:teuthology.orchestra.run.smithi148.stdout:1649 read 0x1c35800 thru 0x1c43519 (0xdd1a bytes) 2024-09-14T09:08:10.677 INFO:teuthology.orchestra.run.smithi148.stdout:1650 trunc from 0x8824a00 to 0x7b4ae00 2024-09-14T09:08:10.690 INFO:teuthology.orchestra.run.smithi148.stdout:1651 write 0x2f3200 thru 0x3020af (0xeeb0 bytes) 2024-09-14T09:08:10.691 INFO:teuthology.orchestra.run.smithi148.stdout:1652 write 0x3660200 thru 0x366d70d (0xd50e bytes) 2024-09-14T09:08:10.708 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:10.711+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:10.710 INFO:teuthology.orchestra.run.smithi148.stdout:1655 write 0xebe2a00 thru 0xebebcdb (0x92dc bytes) 2024-09-14T09:08:10.726 INFO:teuthology.orchestra.run.smithi148.stdout:1658 trunc from 0xebebe00 to 0x2073600 2024-09-14T09:08:10.730 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:10.730 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:10.740 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:08:10.762 INFO:teuthology.orchestra.run.smithi148.stdout:1659 read 0x9b4c00 thru 0x9c4443 (0xf844 bytes) 2024-09-14T09:08:10.764 INFO:teuthology.orchestra.run.smithi148.stdout:1660 read 0xd10600 thru 0xd1fabd (0xf4be bytes) 2024-09-14T09:08:10.779 INFO:teuthology.orchestra.run.smithi148.stdout:1661 trunc from 0x2073600 to 0xe991800 2024-09-14T09:08:10.788 INFO:teuthology.orchestra.run.smithi148.stdout:1662 punch from 0x70aec00 to 0x70b3800, (0x4c00 bytes) 2024-09-14T09:08:10.790 INFO:teuthology.orchestra.run.smithi148.stdout:1664 read 0x854c00 thru 0x85585a (0xc5b bytes) 2024-09-14T09:08:10.791 INFO:teuthology.orchestra.run.smithi148.stdout:1665 punch from 0x6dfe600 to 0x6e08600, (0xa000 bytes) 2024-09-14T09:08:10.791 INFO:teuthology.orchestra.run.smithi148.stdout:1666 write 0x56caa00 thru 0x56d7104 (0xc705 bytes) 2024-09-14T09:08:10.802 INFO:teuthology.orchestra.run.smithi148.stdout:1667 trunc from 0xe991800 to 0x5bb2c00 2024-09-14T09:08:10.809 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:10.811+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:10.821 INFO:teuthology.orchestra.run.smithi148.stdout:1669 write 0x25fc00 thru 0x25fefc (0x2fd bytes) 2024-09-14T09:08:10.823 INFO:teuthology.orchestra.run.smithi148.stdout:1671 read 0x218e200 thru 0x2192660 (0x4461 bytes) 2024-09-14T09:08:10.837 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is set 2024-09-14T09:08:10.841 INFO:teuthology.orchestra.run.smithi148.stdout:1673 write 0xa58fc00 thru 0xa597d14 (0x8115 bytes) 2024-09-14T09:08:10.851 INFO:teuthology.orchestra.run.smithi148.stdout:1674 trunc from 0xa597e00 to 0x35f6c00 2024-09-14T09:08:10.854 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:10.855 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:10.866 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:08:10.883 INFO:teuthology.orchestra.run.smithi148.stdout:1676 write 0x9bf6a00 thru 0x9c05b9e (0xf19f bytes) 2024-09-14T09:08:10.885 INFO:teuthology.orchestra.run.smithi148.stdout:1677 write 0x390e00 thru 0x399fde (0x91df bytes) 2024-09-14T09:08:10.886 INFO:teuthology.orchestra.run.smithi148.stdout:1678 read 0x9160600 thru 0x91652cb (0x4ccc bytes) 2024-09-14T09:08:10.887 INFO:teuthology.orchestra.run.smithi148.stdout:1680 read 0x61fc200 thru 0x61fc29a (0x9b bytes) 2024-09-14T09:08:10.887 INFO:teuthology.orchestra.run.smithi148.stdout:1683 read 0x7e3e00 thru 0x7f132d (0xd52e bytes) 2024-09-14T09:08:10.888 INFO:teuthology.orchestra.run.smithi148.stdout:1684 read 0x8335400 thru 0x833d8fe (0x84ff bytes) 2024-09-14T09:08:10.888 INFO:teuthology.orchestra.run.smithi148.stdout:1685 write 0x7882200 thru 0x788b46a (0x926b bytes) 2024-09-14T09:08:10.889 INFO:teuthology.orchestra.run.smithi148.stdout:1687 punch from 0x7f7e200 to 0x7f83600, (0x5400 bytes) 2024-09-14T09:08:10.889 INFO:teuthology.orchestra.run.smithi148.stdout:1688 write 0x889200 thru 0x88b2cf (0x20d0 bytes) 2024-09-14T09:08:10.900 INFO:teuthology.orchestra.run.smithi148.stdout:1689 trunc from 0x9c05c00 to 0xc98a00 2024-09-14T09:08:10.940 INFO:teuthology.orchestra.run.smithi148.stdout:1690 write 0xbca3e00 thru 0xbca5d5b (0x1f5c bytes) 2024-09-14T09:08:10.942 INFO:teuthology.orchestra.run.smithi148.stdout:1694 write 0x6a7800 thru 0x6b77c4 (0xffc5 bytes) 2024-09-14T09:08:10.942 INFO:teuthology.orchestra.run.smithi148.stdout:1695 read 0x369e600 thru 0x36a0519 (0x1f1a bytes) 2024-09-14T09:08:10.943 INFO:teuthology.orchestra.run.smithi148.stdout:1698 trunc from 0xbca5e00 to 0xc1cf800 2024-09-14T09:08:10.950 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:10.952+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:10.953 INFO:teuthology.orchestra.run.smithi148.stdout:1699 write 0x4089200 thru 0x409131d (0x811e bytes) 2024-09-14T09:08:10.955 INFO:teuthology.orchestra.run.smithi148.stdout:1700 read 0x8b52c00 thru 0x8b60fea (0xe3eb bytes) 2024-09-14T09:08:10.955 INFO:teuthology.orchestra.run.smithi148.stdout:1704 write 0x68bf400 thru 0x68c44a9 (0x50aa bytes) 2024-09-14T09:08:10.956 INFO:teuthology.orchestra.run.smithi148.stdout:1705 write 0x4935c00 thru 0x493e840 (0x8c41 bytes) 2024-09-14T09:08:10.956 INFO:teuthology.orchestra.run.smithi148.stdout:1708 write 0x74c200 thru 0x759920 (0xd721 bytes) 2024-09-14T09:08:10.957 INFO:teuthology.orchestra.run.smithi148.stdout:1710 read 0x579dc00 thru 0x57a20a6 (0x44a7 bytes) 2024-09-14T09:08:10.958 INFO:teuthology.orchestra.run.smithi148.stdout:1711 write 0x52b0000 thru 0x52b44bb (0x44bc bytes) 2024-09-14T09:08:10.958 INFO:teuthology.orchestra.run.smithi148.stdout:1715 read 0x8bf2000 thru 0x8c0139a (0xf39b bytes) 2024-09-14T09:08:10.958 INFO:teuthology.orchestra.run.smithi148.stdout:1716 punch from 0x69a4600 to 0x69b0800, (0xc200 bytes) 2024-09-14T09:08:10.959 INFO:teuthology.orchestra.run.smithi148.stdout:1718 write 0x38cc000 thru 0x38d9c9f (0xdca0 bytes) 2024-09-14T09:08:10.960 INFO:teuthology.orchestra.run.smithi148.stdout:1719 punch from 0x4744400 to 0x4748e00, (0x4a00 bytes) 2024-09-14T09:08:10.961 INFO:teuthology.orchestra.run.smithi148.stdout:1721 write 0x73a2600 thru 0x73a4430 (0x1e31 bytes) 2024-09-14T09:08:10.961 INFO:teuthology.orchestra.run.smithi148.stdout:1722 read 0x351d400 thru 0x351f274 (0x1e75 bytes) 2024-09-14T09:08:10.961 INFO:teuthology.orchestra.run.smithi148.stdout:1723 read 0x42d9a00 thru 0x42e7e16 (0xe417 bytes) 2024-09-14T09:08:10.963 INFO:teuthology.orchestra.run.smithi148.stdout:1724 read 0x1145400 thru 0x1153dac (0xe9ad bytes) 2024-09-14T09:08:10.976 INFO:teuthology.orchestra.run.smithi148.stdout:1725 write 0xdf85a00 thru 0xdf8d690 (0x7c91 bytes) 2024-09-14T09:08:10.980 INFO:teuthology.orchestra.run.smithi148.stdout:1727 trunc from 0xdf8d800 to 0xb47ac00 2024-09-14T09:08:11.001 INFO:teuthology.orchestra.run.smithi148.stdout:1728 write 0x48b1600 thru 0x48c0425 (0xee26 bytes) 2024-09-14T09:08:11.003 INFO:teuthology.orchestra.run.smithi148.stdout:1731 read 0x8a2da00 thru 0x8a3897b (0xaf7c bytes) 2024-09-14T09:08:11.004 INFO:teuthology.orchestra.run.smithi148.stdout:1733 write 0x7a0ac00 thru 0x7a0f818 (0x4c19 bytes) 2024-09-14T09:08:11.004 INFO:teuthology.orchestra.run.smithi148.stdout:1734 punch from 0x7409600 to 0x740ee00, (0x5800 bytes) 2024-09-14T09:08:11.011 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:11.013+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:11.014 INFO:teuthology.orchestra.run.smithi148.stdout:1735 trunc from 0xb47ac00 to 0x2a32000 2024-09-14T09:08:11.025 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:11.025 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:11.033 INFO:teuthology.orchestra.run.smithi148.stdout:1736 read 0x14bbe00 thru 0x14c8136 (0xc337 bytes) 2024-09-14T09:08:11.035 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:08:11.045 INFO:teuthology.orchestra.run.smithi148.stdout:1737 write 0x4a52c00 thru 0x4a56dfd (0x41fe bytes) 2024-09-14T09:08:11.046 INFO:teuthology.orchestra.run.smithi148.stdout:1738 read 0x658200 thru 0x6654e0 (0xd2e1 bytes) 2024-09-14T09:08:11.068 INFO:teuthology.orchestra.run.smithi148.stdout:1742 write 0xe147400 thru 0xe150a0c (0x960d bytes) 2024-09-14T09:08:11.069 INFO:teuthology.orchestra.run.smithi148.stdout:1747 write 0x87b6400 thru 0x87bcc7c (0x687d bytes) 2024-09-14T09:08:11.069 INFO:teuthology.orchestra.run.smithi148.stdout:1749 read 0x7cb5c00 thru 0x7cbd046 (0x7447 bytes) 2024-09-14T09:08:11.070 INFO:teuthology.orchestra.run.smithi148.stdout:1750 read 0x6046400 thru 0x60468ac (0x4ad bytes) 2024-09-14T09:08:11.070 INFO:teuthology.orchestra.run.smithi148.stdout:1751 read 0x4adf400 thru 0x4ae7d4c (0x894d bytes) 2024-09-14T09:08:11.070 INFO:teuthology.orchestra.run.smithi148.stdout:1753 read 0x8746400 thru 0x8755c9d (0xf89e bytes) 2024-09-14T09:08:11.071 INFO:teuthology.orchestra.run.smithi148.stdout:1754 punch from 0x9b37400 to 0x9b44400, (0xd000 bytes) 2024-09-14T09:08:11.071 INFO:teuthology.orchestra.run.smithi148.stdout:1758 write 0xdfc3000 thru 0xdfc48d2 (0x18d3 bytes) 2024-09-14T09:08:11.076 INFO:teuthology.orchestra.run.smithi148.stdout:1759 trunc from 0xe150c00 to 0x95d8e00 2024-09-14T09:08:11.107 INFO:teuthology.orchestra.run.smithi148.stdout:1762 write 0x9d4ca00 thru 0x9d553b8 (0x89b9 bytes) 2024-09-14T09:08:11.109 INFO:teuthology.orchestra.run.smithi148.stdout:1764 read 0x1beb000 thru 0x1bebba8 (0xba9 bytes) 2024-09-14T09:08:11.112 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:11.114+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:11.117 INFO:teuthology.orchestra.run.smithi148.stdout:1766 trunc from 0x9d55400 to 0x3a38a00 2024-09-14T09:08:11.149 INFO:teuthology.orchestra.run.smithi148.stdout:1769 write 0x851ce00 thru 0x852ca14 (0xfc15 bytes) 2024-09-14T09:08:11.150 INFO:teuthology.orchestra.run.smithi148.stdout:1770 read 0x8041c00 thru 0x804e7d1 (0xcbd2 bytes) 2024-09-14T09:08:11.151 INFO:teuthology.orchestra.run.smithi148.stdout:1773 write 0x1b94a00 thru 0x1b9d6fa (0x8cfb bytes) 2024-09-14T09:08:11.151 INFO:teuthology.orchestra.run.smithi148.stdout:1774 read 0x23c4a00 thru 0x23d3ecd (0xf4ce bytes) 2024-09-14T09:08:11.152 INFO:teuthology.orchestra.run.smithi148.stdout:1775 read 0x5b9ee00 thru 0x5b9f6a2 (0x8a3 bytes) 2024-09-14T09:08:11.153 INFO:teuthology.orchestra.run.smithi148.stdout:1776 read 0x6683c00 thru 0x668939c (0x579d bytes) 2024-09-14T09:08:11.153 INFO:teuthology.orchestra.run.smithi148.stdout:1777 write 0x1a41000 thru 0x1a48f3d (0x7f3e bytes) 2024-09-14T09:08:11.154 INFO:teuthology.orchestra.run.smithi148.stdout:1779 read 0x4289a00 thru 0x428b8cb (0x1ecc bytes) 2024-09-14T09:08:11.154 INFO:teuthology.orchestra.run.smithi148.stdout:1780 write 0x38d2000 thru 0x38d26c5 (0x6c6 bytes) 2024-09-14T09:08:11.154 INFO:teuthology.orchestra.run.smithi148.stdout:1781 read 0xcf3600 thru 0xcfe78a (0xb18b bytes) 2024-09-14T09:08:11.154 INFO:teuthology.orchestra.run.smithi148.stdout:1785 punch from 0x8134200 to 0x8137200, (0x3000 bytes) 2024-09-14T09:08:11.170 INFO:teuthology.orchestra.run.smithi148.stdout:1786 write 0xd8b0600 thru 0xd8b660f (0x6010 bytes) 2024-09-14T09:08:11.171 INFO:teuthology.orchestra.run.smithi148.stdout:1787 punch from 0x591ec00 to 0x5921a00, (0x2e00 bytes) 2024-09-14T09:08:11.172 INFO:teuthology.orchestra.run.smithi148.stdout:1788 read 0x838d200 thru 0x8391e86 (0x4c87 bytes) 2024-09-14T09:08:11.172 INFO:teuthology.orchestra.run.smithi148.stdout:1789 read 0xb596e00 thru 0xb5a55c8 (0xe7c9 bytes) 2024-09-14T09:08:11.173 INFO:teuthology.orchestra.run.smithi148.stdout:1790 read 0xc4ec200 thru 0xc4f68c3 (0xa6c4 bytes) 2024-09-14T09:08:11.173 INFO:teuthology.orchestra.run.smithi148.stdout:1791 read 0x4f17000 thru 0x4f25557 (0xe558 bytes) 2024-09-14T09:08:11.173 INFO:teuthology.orchestra.run.smithi148.stdout:1792 read 0x682000 thru 0x6821d5 (0x1d6 bytes) 2024-09-14T09:08:11.187 INFO:teuthology.orchestra.run.smithi148.stdout:1794 trunc from 0xd8b6800 to 0x3928200 2024-09-14T09:08:11.193 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:11.193 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:11.202 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:08:11.213 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:11.215+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:11.230 INFO:teuthology.orchestra.run.smithi148.stdout:1797 write 0xa31d000 thru 0xa329f60 (0xcf61 bytes) 2024-09-14T09:08:11.232 INFO:teuthology.orchestra.run.smithi148.stdout:1798 read 0x37df800 thru 0x37e472e (0x4f2f bytes) 2024-09-14T09:08:11.232 INFO:teuthology.orchestra.run.smithi148.stdout:1799 write 0x6ad2e00 thru 0x6ae15c5 (0xe7c6 bytes) 2024-09-14T09:08:11.233 INFO:teuthology.orchestra.run.smithi148.stdout:1801 punch from 0x332ae00 to 0x332b600, (0x800 bytes) 2024-09-14T09:08:11.233 INFO:teuthology.orchestra.run.smithi148.stdout:1804 read 0x4bac400 thru 0x4bb7322 (0xaf23 bytes) 2024-09-14T09:08:11.234 INFO:teuthology.orchestra.run.smithi148.stdout:1806 read 0x13ff400 thru 0x1407bf1 (0x87f2 bytes) 2024-09-14T09:08:11.236 INFO:teuthology.orchestra.run.smithi148.stdout:1807 trunc from 0xa32a000 to 0xad0e200 2024-09-14T09:08:11.245 INFO:teuthology.orchestra.run.smithi148.stdout:1808 punch from 0xab08000 to 0xab0d000, (0x5000 bytes) 2024-09-14T09:08:11.246 INFO:teuthology.orchestra.run.smithi148.stdout:1809 write 0x7c7d000 thru 0x7c8b91e (0xe91f bytes) 2024-09-14T09:08:11.253 INFO:teuthology.orchestra.run.smithi148.stdout:1810 trunc from 0xad0e200 to 0x647c000 2024-09-14T09:08:11.268 INFO:teuthology.orchestra.run.smithi148.stdout:1811 read 0x3f77a00 thru 0x3f78c5b (0x125c bytes) 2024-09-14T09:08:11.270 INFO:teuthology.orchestra.run.smithi148.stdout:1813 trunc from 0x647c000 to 0x5647400 2024-09-14T09:08:11.285 INFO:teuthology.orchestra.run.smithi148.stdout:1814 read 0x327c600 thru 0x3287535 (0xaf36 bytes) 2024-09-14T09:08:11.302 INFO:teuthology.orchestra.run.smithi148.stdout:1815 write 0xaff6e00 thru 0xaff8170 (0x1371 bytes) 2024-09-14T09:08:11.314 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:11.316+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:11.316 INFO:teuthology.orchestra.run.smithi148.stdout:1816 write 0xc2fde00 thru 0xc2fe182 (0x383 bytes) 2024-09-14T09:08:11.317 INFO:teuthology.orchestra.run.smithi148.stdout:1818 write 0x2969000 thru 0x29788e4 (0xf8e5 bytes) 2024-09-14T09:08:11.318 INFO:teuthology.orchestra.run.smithi148.stdout:1820 trunc from 0xc2fe200 to 0xc9dd000 2024-09-14T09:08:11.323 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:11.323 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:11.333 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:08:11.342 INFO:teuthology.orchestra.run.smithi148.stdout:1821 write 0xee0bc00 thru 0xee10acd (0x4ece bytes) 2024-09-14T09:08:11.343 INFO:teuthology.orchestra.run.smithi148.stdout:1822 punch from 0xca46e00 to 0xca47a00, (0xc00 bytes) 2024-09-14T09:08:11.348 INFO:teuthology.orchestra.run.smithi148.stdout:1823 read 0x5a70200 thru 0x5a746ea (0x44eb bytes) 2024-09-14T09:08:11.365 INFO:teuthology.orchestra.run.smithi148.stdout:1824 trunc from 0xee10c00 to 0x941200 2024-09-14T09:08:11.415 INFO:teuthology.orchestra.run.smithi148.stdout:1825 trunc from 0x941200 to 0xddbb200 2024-09-14T09:08:11.415 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:11.417+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:11.424 INFO:teuthology.orchestra.run.smithi148.stdout:1826 read 0x1e04800 thru 0x1e0b988 (0x7189 bytes) 2024-09-14T09:08:11.426 INFO:teuthology.orchestra.run.smithi148.stdout:1827 read 0xbc5a600 thru 0xbc5fb1b (0x551c bytes) 2024-09-14T09:08:11.441 INFO:teuthology.orchestra.run.smithi148.stdout:1828 trunc from 0xddbb200 to 0x44fba00 2024-09-14T09:08:11.457 INFO:teuthology.orchestra.run.smithi148.stdout:1832 punch from 0x2356400 to 0x2364c00, (0xe800 bytes) 2024-09-14T09:08:11.458 INFO:teuthology.orchestra.run.smithi148.stdout:1838 read 0x286be00 thru 0x286dc15 (0x1e16 bytes) 2024-09-14T09:08:11.475 INFO:teuthology.orchestra.run.smithi148.stdout:1840 write 0x9aeba00 thru 0x9af78e9 (0xbeea bytes) 2024-09-14T09:08:11.476 INFO:teuthology.orchestra.run.smithi148.stdout:1841 read 0x7a6a400 thru 0x7a6d3ec (0x2fed bytes) 2024-09-14T09:08:11.476 INFO:teuthology.orchestra.run.smithi148.stdout:1843 read 0x733cc00 thru 0x7345c24 (0x9025 bytes) 2024-09-14T09:08:11.477 INFO:teuthology.orchestra.run.smithi148.stdout:1844 read 0x68a800 thru 0x68de51 (0x3652 bytes) 2024-09-14T09:08:11.477 INFO:teuthology.orchestra.run.smithi148.stdout:1846 write 0x6476c00 thru 0x6485b56 (0xef57 bytes) 2024-09-14T09:08:11.479 INFO:teuthology.orchestra.run.smithi148.stdout:1848 trunc from 0x9af7a00 to 0xb1c3200 2024-09-14T09:08:11.487 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:11.487 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:11.490 INFO:teuthology.orchestra.run.smithi148.stdout:1850 read 0x8deae00 thru 0x8df194e (0x6b4f bytes) 2024-09-14T09:08:11.492 INFO:teuthology.orchestra.run.smithi148.stdout:1851 read 0x8c7a00 thru 0x8cf9ed (0x7fee bytes) 2024-09-14T09:08:11.492 INFO:teuthology.orchestra.run.smithi148.stdout:1853 write 0x2e2e400 thru 0x2e321c5 (0x3dc6 bytes) 2024-09-14T09:08:11.498 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:08:11.501 INFO:teuthology.orchestra.run.smithi148.stdout:1855 trunc from 0xb1c3200 to 0x3e2d400 2024-09-14T09:08:11.516 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:11.517+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:11.530 INFO:teuthology.orchestra.run.smithi148.stdout:1857 trunc from 0x3e2d400 to 0xdebf800 2024-09-14T09:08:11.540 INFO:teuthology.orchestra.run.smithi148.stdout:1858 read 0x676de00 thru 0x6779cb4 (0xbeb5 bytes) 2024-09-14T09:08:11.543 INFO:teuthology.orchestra.run.smithi148.stdout:1859 write 0x4be400 thru 0x4c0b99 (0x279a bytes) 2024-09-14T09:08:11.552 INFO:teuthology.orchestra.run.smithi148.stdout:1860 trunc from 0xdebf800 to 0x5c57800 2024-09-14T09:08:11.577 INFO:teuthology.orchestra.run.smithi148.stdout:1861 trunc from 0x5c57800 to 0xb2c2200 2024-09-14T09:08:11.585 INFO:teuthology.orchestra.run.smithi148.stdout:1862 write 0x6f70a00 thru 0x6f74b67 (0x4168 bytes) 2024-09-14T09:08:11.587 INFO:teuthology.orchestra.run.smithi148.stdout:1864 read 0x145a400 thru 0x145e726 (0x4327 bytes) 2024-09-14T09:08:11.587 INFO:teuthology.orchestra.run.smithi148.stdout:1869 write 0x5607600 thru 0x561022b (0x8c2c bytes) 2024-09-14T09:08:11.596 INFO:teuthology.orchestra.run.smithi148.stdout:1871 trunc from 0xb2c2200 to 0x4390800 2024-09-14T09:08:11.613 INFO:teuthology.orchestra.run.smithi148.stdout:1873 read 0x36fc800 thru 0x36fd830 (0x1031 bytes) 2024-09-14T09:08:11.614 INFO:teuthology.orchestra.run.smithi148.stdout:1874 write 0x124f800 thru 0x125ebd8 (0xf3d9 bytes) 2024-09-14T09:08:11.617 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:11.619+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:11.619 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:11.619 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:11.621 INFO:teuthology.orchestra.run.smithi148.stdout:1876 trunc from 0x4390800 to 0xa1c8800 2024-09-14T09:08:11.629 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:08:11.631 INFO:teuthology.orchestra.run.smithi148.stdout:1878 punch from 0xcece00 to 0xcfb600, (0xe800 bytes) 2024-09-14T09:08:11.633 INFO:teuthology.orchestra.run.smithi148.stdout:1879 write 0x840ae00 thru 0x84122a9 (0x74aa bytes) 2024-09-14T09:08:11.633 INFO:teuthology.orchestra.run.smithi148.stdout:1880 punch from 0x3836800 to 0x3842a00, (0xc200 bytes) 2024-09-14T09:08:11.638 INFO:teuthology.orchestra.run.smithi148.stdout:1882 trunc from 0xa1c8800 to 0xe21f400 2024-09-14T09:08:11.647 INFO:teuthology.orchestra.run.smithi148.stdout:1883 write 0x2b85600 thru 0x2b86e04 (0x1805 bytes) 2024-09-14T09:08:11.649 INFO:teuthology.orchestra.run.smithi148.stdout:1885 write 0xdece600 thru 0xdecf47d (0xe7e bytes) 2024-09-14T09:08:11.649 INFO:teuthology.orchestra.run.smithi148.stdout:1889 read 0xc3a8000 thru 0xc3b298e (0xa98f bytes) 2024-09-14T09:08:11.649 INFO:teuthology.orchestra.run.smithi148.stdout:1890 read 0xcf01200 thru 0xcf0b930 (0xa731 bytes) 2024-09-14T09:08:11.655 INFO:teuthology.orchestra.run.smithi148.stdout:1891 trunc from 0xe21f400 to 0x92bd600 2024-09-14T09:08:11.673 INFO:teuthology.orchestra.run.smithi148.stdout:1892 write 0x5e6d400 thru 0x5e7b088 (0xdc89 bytes) 2024-09-14T09:08:11.674 INFO:teuthology.orchestra.run.smithi148.stdout:1893 read 0x4ba4400 thru 0x4ba8a35 (0x4636 bytes) 2024-09-14T09:08:11.680 INFO:teuthology.orchestra.run.smithi148.stdout:1895 trunc from 0x92bd600 to 0x503d600 2024-09-14T09:08:11.711 INFO:teuthology.orchestra.run.smithi148.stdout:1896 write 0xbf23600 thru 0xbf2e7ff (0xb200 bytes) 2024-09-14T09:08:11.716 INFO:teuthology.orchestra.run.smithi148.stdout:1898 punch from 0x834a400 to 0x8350800, (0x6400 bytes) 2024-09-14T09:08:11.718 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:11.720+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:11.729 INFO:teuthology.orchestra.run.smithi148.stdout:1899 write 0xd75a800 thru 0xd763098 (0x8899 bytes) 2024-09-14T09:08:11.729 INFO:teuthology.orchestra.run.smithi148.stdout:1900 read 0x591f000 thru 0x5923377 (0x4378 bytes) 2024-09-14T09:08:11.730 INFO:teuthology.orchestra.run.smithi148.stdout:1901 read 0x9831200 thru 0x9835a5d (0x485e bytes) 2024-09-14T09:08:11.736 INFO:teuthology.orchestra.run.smithi148.stdout:1905 trunc from 0xd763200 to 0x812d200 2024-09-14T09:08:11.739 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:11.739 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:11.748 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:08:11.765 INFO:teuthology.orchestra.run.smithi148.stdout:1906 punch from 0x48f9e00 to 0x4905400, (0xb600 bytes) 2024-09-14T09:08:11.774 INFO:teuthology.orchestra.run.smithi148.stdout:1907 read 0x4c85c00 thru 0x4c8ba3f (0x5e40 bytes) 2024-09-14T09:08:11.774 INFO:teuthology.orchestra.run.smithi148.stdout:1909 write 0x4e49e00 thru 0x4e4fab4 (0x5cb5 bytes) 2024-09-14T09:08:11.774 INFO:teuthology.orchestra.run.smithi148.stdout:1910 write 0x778400 thru 0x77e541 (0x6142 bytes) 2024-09-14T09:08:11.775 INFO:teuthology.orchestra.run.smithi148.stdout:1915 read 0x2cc00 thru 0x38c4d (0xc04e bytes) 2024-09-14T09:08:11.775 INFO:teuthology.orchestra.run.smithi148.stdout:1916 read 0x1ecf600 thru 0x1ed07fd (0x11fe bytes) 2024-09-14T09:08:11.788 INFO:teuthology.orchestra.run.smithi148.stdout:1918 write 0xabc8800 thru 0xabd02a9 (0x7aaa bytes) 2024-09-14T09:08:11.790 INFO:teuthology.orchestra.run.smithi148.stdout:1921 read 0x3a5f200 thru 0x3a67540 (0x8341 bytes) 2024-09-14T09:08:11.790 INFO:teuthology.orchestra.run.smithi148.stdout:1923 clone 14 order 19 su 32768 sc 13 2024-09-14T09:08:11.833 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:11.834+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:11.895 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:11.896 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:11.904 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:08:11.919 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:11.921+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:11.944 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone13 from 0xabd0400 (overlap 0x941200) to 0xece00 2024-09-14T09:08:12.020 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:12.022+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:12.055 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:12.055 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:12.064 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:08:12.149 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:12.150+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:12.209 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:12.209 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:12.217 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:08:12.233 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:08:12.259 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:12.260+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:12.322 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:12.323+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:12.356 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:12.356 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:12.364 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:12.365 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:12.373 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:08:12.373 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:12.374 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:12.384 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #12, image image_client.0-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent13 2024-09-14T09:08:12.390 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:08:12.391 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:08:12.408 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:12.408 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:12.427 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:12.427 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:12.447 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:12.447 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:12.459 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:12.460+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:12.524 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:12.525+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:12.539 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:12.539 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:669 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862212+0000", 2024-09-14T09:08:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.676707802999999, 2024-09-14T09:08:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0073209269999999996, 2024-09-14T09:08:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:12.541 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:12.541 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 669 2024-09-14T09:08:12.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.541 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:12.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:12.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862212+0000", 2024-09-14T09:08:12.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:12.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862212+0000", 2024-09-14T09:08:12.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:12.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862212+0000", 2024-09-14T09:08:12.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7999999999999995e-07 2024-09-14T09:08:12.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:12.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862214+0000", 2024-09-14T09:08:12.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.26e-06 2024-09-14T09:08:12.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:12.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862221+0000", 2024-09-14T09:08:12.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6270000000000002e-06 2024-09-14T09:08:12.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:12.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862226+0000", 2024-09-14T09:08:12.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0989999999999998e-06 2024-09-14T09:08:12.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:12.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869365+0000", 2024-09-14T09:08:12.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0071387109999999998 2024-09-14T09:08:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869434+0000", 2024-09-14T09:08:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9441000000000001e-05 2024-09-14T09:08:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869532+0000", 2024-09-14T09:08:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8109000000000005e-05 2024-09-14T09:08:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:683 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 2621440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862256+0000", 2024-09-14T09:08:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.676663417, 2024-09-14T09:08:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074734199999999997, 2024-09-14T09:08:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 683 2024-09-14T09:08:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862256+0000", 2024-09-14T09:08:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862256+0000", 2024-09-14T09:08:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862256+0000", 2024-09-14T09:08:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3599999999999999e-07 2024-09-14T09:08:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862258+0000", 2024-09-14T09:08:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8610000000000001e-06 2024-09-14T09:08:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862264+0000", 2024-09-14T09:08:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0959999999999997e-06 2024-09-14T09:08:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862269+0000", 2024-09-14T09:08:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5850000000000001e-06 2024-09-14T09:08:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869554+0000", 2024-09-14T09:08:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0072851410000000002 2024-09-14T09:08:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869629+0000", 2024-09-14T09:08:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4537999999999997e-05 2024-09-14T09:08:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869729+0000", 2024-09-14T09:08:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100763 2024-09-14T09:08:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:684 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 4063232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862276+0000", 2024-09-14T09:08:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.676643393999999, 2024-09-14T09:08:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076148459999999998, 2024-09-14T09:08:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 684 2024-09-14T09:08:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862276+0000", 2024-09-14T09:08:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862276+0000", 2024-09-14T09:08:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862277+0000", 2024-09-14T09:08:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9599999999999999e-07 2024-09-14T09:08:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862278+0000", 2024-09-14T09:08:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.858e-06 2024-09-14T09:08:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862285+0000", 2024-09-14T09:08:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1800000000000001e-06 2024-09-14T09:08:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862289+0000", 2024-09-14T09:08:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8890000000000001e-06 2024-09-14T09:08:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869764+0000", 2024-09-14T09:08:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074748949999999996 2024-09-14T09:08:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869817+0000", 2024-09-14T09:08:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2132999999999997e-05 2024-09-14T09:08:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869891+0000", 2024-09-14T09:08:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4295000000000006e-05 2024-09-14T09:08:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:685 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 5505024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862311+0000", 2024-09-14T09:08:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.676608627, 2024-09-14T09:08:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0078557420000000006, 2024-09-14T09:08:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 685 2024-09-14T09:08:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862311+0000", 2024-09-14T09:08:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862311+0000", 2024-09-14T09:08:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862311+0000", 2024-09-14T09:08:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5000000000000002e-07 2024-09-14T09:08:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862314+0000", 2024-09-14T09:08:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.165e-06 2024-09-14T09:08:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862320+0000", 2024-09-14T09:08:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5699999999999998e-06 2024-09-14T09:08:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862326+0000", 2024-09-14T09:08:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0549999999999996e-06 2024-09-14T09:08:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869941+0000", 2024-09-14T09:08:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.007614829 2024-09-14T09:08:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870020+0000", 2024-09-14T09:08:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8563e-05 2024-09-14T09:08:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870166+0000", 2024-09-14T09:08:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014690999999999999 2024-09-14T09:08:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:706 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862467+0000", 2024-09-14T09:08:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.676452719, 2024-09-14T09:08:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0075686479999999999, 2024-09-14T09:08:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 706 2024-09-14T09:08:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862467+0000", 2024-09-14T09:08:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862467+0000", 2024-09-14T09:08:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862467+0000", 2024-09-14T09:08:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4499999999999997e-07 2024-09-14T09:08:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862470+0000", 2024-09-14T09:08:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3130000000000001e-06 2024-09-14T09:08:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862477+0000", 2024-09-14T09:08:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9240000000000001e-06 2024-09-14T09:08:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862482+0000", 2024-09-14T09:08:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0039999999999999e-06 2024-09-14T09:08:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869922+0000", 2024-09-14T09:08:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074403009999999999 2024-09-14T09:08:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.869982+0000", 2024-09-14T09:08:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9746e-05 2024-09-14T09:08:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870035+0000", 2024-09-14T09:08:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3715000000000003e-05 2024-09-14T09:08:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:707 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 2752512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862490+0000", 2024-09-14T09:08:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.676429573, 2024-09-14T09:08:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076711289999999996, 2024-09-14T09:08:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 707 2024-09-14T09:08:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862490+0000", 2024-09-14T09:08:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862490+0000", 2024-09-14T09:08:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862490+0000", 2024-09-14T09:08:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3300000000000003e-07 2024-09-14T09:08:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862492+0000", 2024-09-14T09:08:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.996e-06 2024-09-14T09:08:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862499+0000", 2024-09-14T09:08:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.776e-06 2024-09-14T09:08:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862504+0000", 2024-09-14T09:08:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8670000000000002e-06 2024-09-14T09:08:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870051+0000", 2024-09-14T09:08:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0075471089999999998 2024-09-14T09:08:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870104+0000", 2024-09-14T09:08:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3439000000000001e-05 2024-09-14T09:08:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870161+0000", 2024-09-14T09:08:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6508999999999997e-05 2024-09-14T09:08:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:708 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862512+0000", 2024-09-14T09:08:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.676407192999999, 2024-09-14T09:08:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0078051250000000004, 2024-09-14T09:08:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 708 2024-09-14T09:08:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862512+0000", 2024-09-14T09:08:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862512+0000", 2024-09-14T09:08:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862513+0000", 2024-09-14T09:08:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1300000000000001e-07 2024-09-14T09:08:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862515+0000", 2024-09-14T09:08:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.922e-06 2024-09-14T09:08:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862521+0000", 2024-09-14T09:08:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3160000000000002e-06 2024-09-14T09:08:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862526+0000", 2024-09-14T09:08:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0209999999999999e-06 2024-09-14T09:08:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870177+0000", 2024-09-14T09:08:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076510720000000001 2024-09-14T09:08:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870244+0000", 2024-09-14T09:08:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6613999999999996e-05 2024-09-14T09:08:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870317+0000", 2024-09-14T09:08:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3767e-05 2024-09-14T09:08:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:709 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 5636096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862547+0000", 2024-09-14T09:08:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.676372202, 2024-09-14T09:08:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080137230000000004, 2024-09-14T09:08:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 709 2024-09-14T09:08:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862547+0000", 2024-09-14T09:08:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862547+0000", 2024-09-14T09:08:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862548+0000", 2024-09-14T09:08:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3200000000000005e-07 2024-09-14T09:08:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862550+0000", 2024-09-14T09:08:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0650000000000001e-06 2024-09-14T09:08:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862557+0000", 2024-09-14T09:08:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8170000000000001e-06 2024-09-14T09:08:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862561+0000", 2024-09-14T09:08:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7090000000000001e-06 2024-09-14T09:08:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870358+0000", 2024-09-14T09:08:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0077970690000000002 2024-09-14T09:08:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870437+0000", 2024-09-14T09:08:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8059999999999995e-05 2024-09-14T09:08:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870561+0000", 2024-09-14T09:08:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012437099999999999 2024-09-14T09:08:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:722 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862576+0000", 2024-09-14T09:08:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.676343659, 2024-09-14T09:08:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0078555269999999993, 2024-09-14T09:08:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 722 2024-09-14T09:08:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862576+0000", 2024-09-14T09:08:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862576+0000", 2024-09-14T09:08:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862576+0000", 2024-09-14T09:08:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3399999999999999e-07 2024-09-14T09:08:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862579+0000", 2024-09-14T09:08:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4159999999999998e-06 2024-09-14T09:08:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862586+0000", 2024-09-14T09:08:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9500000000000004e-06 2024-09-14T09:08:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862591+0000", 2024-09-14T09:08:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2480000000000004e-06 2024-09-14T09:08:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870335+0000", 2024-09-14T09:08:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0077443319999999996 2024-09-14T09:08:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870379+0000", 2024-09-14T09:08:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4092999999999999e-05 2024-09-14T09:08:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870431+0000", 2024-09-14T09:08:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1953999999999998e-05 2024-09-14T09:08:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:723 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 2686976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862598+0000", 2024-09-14T09:08:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.676321109, 2024-09-14T09:08:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079559650000000006, 2024-09-14T09:08:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 723 2024-09-14T09:08:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862598+0000", 2024-09-14T09:08:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862598+0000", 2024-09-14T09:08:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862599+0000", 2024-09-14T09:08:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2024-09-14T09:08:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862601+0000", 2024-09-14T09:08:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0789999999999999e-06 2024-09-14T09:08:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862607+0000", 2024-09-14T09:08:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.365e-06 2024-09-14T09:08:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862618+0000", 2024-09-14T09:08:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1214e-05 2024-09-14T09:08:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870446+0000", 2024-09-14T09:08:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0078275419999999998 2024-09-14T09:08:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870491+0000", 2024-09-14T09:08:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4901000000000003e-05 2024-09-14T09:08:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870554+0000", 2024-09-14T09:08:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3417999999999995e-05 2024-09-14T09:08:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:724 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862626+0000", 2024-09-14T09:08:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.676293658999999, 2024-09-14T09:08:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0081322540000000002, 2024-09-14T09:08:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 724 2024-09-14T09:08:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862626+0000", 2024-09-14T09:08:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862626+0000", 2024-09-14T09:08:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862626+0000", 2024-09-14T09:08:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5799999999999999e-07 2024-09-14T09:08:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862628+0000", 2024-09-14T09:08:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1459999999999999e-06 2024-09-14T09:08:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862635+0000", 2024-09-14T09:08:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3330000000000002e-06 2024-09-14T09:08:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862640+0000", 2024-09-14T09:08:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5480000000000001e-06 2024-09-14T09:08:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870580+0000", 2024-09-14T09:08:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079394909999999999 2024-09-14T09:08:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870649+0000", 2024-09-14T09:08:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8748e-05 2024-09-14T09:08:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870758+0000", 2024-09-14T09:08:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010943 2024-09-14T09:08:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:725 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 5636096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862648+0000", 2024-09-14T09:08:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.676271755999998, 2024-09-14T09:08:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0083906950000000001, 2024-09-14T09:08:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 725 2024-09-14T09:08:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862648+0000", 2024-09-14T09:08:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862648+0000", 2024-09-14T09:08:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862648+0000", 2024-09-14T09:08:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1099999999999995e-07 2024-09-14T09:08:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862650+0000", 2024-09-14T09:08:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0880000000000002e-06 2024-09-14T09:08:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862656+0000", 2024-09-14T09:08:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9850000000000003e-06 2024-09-14T09:08:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862661+0000", 2024-09-14T09:08:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.775e-06 2024-09-14T09:08:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870815+0000", 2024-09-14T09:08:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0081533850000000008 2024-09-14T09:08:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870897+0000", 2024-09-14T09:08:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2235000000000001e-05 2024-09-14T09:08:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871038+0000", 2024-09-14T09:08:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014151600000000001 2024-09-14T09:08:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:746 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 1376256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862897+0000", 2024-09-14T09:08:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.676022424999999, 2024-09-14T09:08:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080739269999999998, 2024-09-14T09:08:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 746 2024-09-14T09:08:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862897+0000", 2024-09-14T09:08:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862897+0000", 2024-09-14T09:08:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862898+0000", 2024-09-14T09:08:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8100000000000003e-07 2024-09-14T09:08:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862901+0000", 2024-09-14T09:08:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5080000000000001e-06 2024-09-14T09:08:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862909+0000", 2024-09-14T09:08:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1610000000000003e-06 2024-09-14T09:08:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862914+0000", 2024-09-14T09:08:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6689999999999997e-06 2024-09-14T09:08:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870788+0000", 2024-09-14T09:08:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0078740319999999996 2024-09-14T09:08:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870870+0000", 2024-09-14T09:08:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2169000000000006e-05 2024-09-14T09:08:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870971+0000", 2024-09-14T09:08:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100807 2024-09-14T09:08:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:747 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 2818048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862922+0000", 2024-09-14T09:08:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.675997860999999, 2024-09-14T09:08:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082517779999999995, 2024-09-14T09:08:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 747 2024-09-14T09:08:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862922+0000", 2024-09-14T09:08:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862922+0000", 2024-09-14T09:08:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862922+0000", 2024-09-14T09:08:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.51e-07 2024-09-14T09:08:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862924+0000", 2024-09-14T09:08:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-06 2024-09-14T09:08:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862933+0000", 2024-09-14T09:08:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6039999999999993e-06 2024-09-14T09:08:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862938+0000", 2024-09-14T09:08:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0180000000000001e-06 2024-09-14T09:08:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.870996+0000", 2024-09-14T09:08:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080584820000000005 2024-09-14T09:08:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871073+0000", 2024-09-14T09:08:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6641e-05 2024-09-14T09:08:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871173+0000", 2024-09-14T09:08:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100462 2024-09-14T09:08:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:748 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 4325376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862945+0000", 2024-09-14T09:08:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.675973886000001, 2024-09-14T09:08:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084586330000000001, 2024-09-14T09:08:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 748 2024-09-14T09:08:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862945+0000", 2024-09-14T09:08:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862945+0000", 2024-09-14T09:08:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862946+0000", 2024-09-14T09:08:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6499999999999999e-07 2024-09-14T09:08:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862948+0000", 2024-09-14T09:08:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0269999999999998e-06 2024-09-14T09:08:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862954+0000", 2024-09-14T09:08:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3049999999999998e-06 2024-09-14T09:08:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862966+0000", 2024-09-14T09:08:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1773999999999999e-05 2024-09-14T09:08:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871217+0000", 2024-09-14T09:08:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082510350000000003 2024-09-14T09:08:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871302+0000", 2024-09-14T09:08:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4940999999999999e-05 2024-09-14T09:08:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871404+0000", 2024-09-14T09:08:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102086 2024-09-14T09:08:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:749 3.19 3:9ef01e98:::rbd_data.11122fa6a16d.0000000000000005:6 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.862974+0000", 2024-09-14T09:08:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.675945514999999, 2024-09-14T09:08:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0086102100000000001, 2024-09-14T09:08:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 749 2024-09-14T09:08:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862974+0000", 2024-09-14T09:08:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862974+0000", 2024-09-14T09:08:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862974+0000", 2024-09-14T09:08:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9500000000000002e-07 2024-09-14T09:08:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862977+0000", 2024-09-14T09:08:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2699999999999999e-06 2024-09-14T09:08:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862984+0000", 2024-09-14T09:08:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7489999999999998e-06 2024-09-14T09:08:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.862989+0000", 2024-09-14T09:08:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9490000000000004e-06 2024-09-14T09:08:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871452+0000", 2024-09-14T09:08:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084624399999999999 2024-09-14T09:08:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871525+0000", 2024-09-14T09:08:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3413999999999999e-05 2024-09-14T09:08:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871584+0000", 2024-09-14T09:08:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8792999999999998e-05 2024-09-14T09:08:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:762 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.863007+0000", 2024-09-14T09:08:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.675912006000001, 2024-09-14T09:08:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0086029390000000004, 2024-09-14T09:08:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 762 2024-09-14T09:08:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863007+0000", 2024-09-14T09:08:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863007+0000", 2024-09-14T09:08:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863008+0000", 2024-09-14T09:08:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6599999999999996e-07 2024-09-14T09:08:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863011+0000", 2024-09-14T09:08:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7030000000000002e-06 2024-09-14T09:08:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863018+0000", 2024-09-14T09:08:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9569999999999996e-06 2024-09-14T09:08:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863030+0000", 2024-09-14T09:08:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2415000000000001e-05 2024-09-14T09:08:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871436+0000", 2024-09-14T09:08:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084056819999999994 2024-09-14T09:08:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871510+0000", 2024-09-14T09:08:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3997000000000003e-05 2024-09-14T09:08:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871610+0000", 2024-09-14T09:08:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100519 2024-09-14T09:08:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:763 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 2818048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.863039+0000", 2024-09-14T09:08:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.675880360000001, 2024-09-14T09:08:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087689180000000005, 2024-09-14T09:08:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 763 2024-09-14T09:08:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863039+0000", 2024-09-14T09:08:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863039+0000", 2024-09-14T09:08:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863040+0000", 2024-09-14T09:08:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8800000000000002e-07 2024-09-14T09:08:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863042+0000", 2024-09-14T09:08:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.351e-06 2024-09-14T09:08:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863049+0000", 2024-09-14T09:08:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7499999999999997e-06 2024-09-14T09:08:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863057+0000", 2024-09-14T09:08:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9999999999999996e-06 2024-09-14T09:08:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871629+0000", 2024-09-14T09:08:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0085725560000000003 2024-09-14T09:08:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871702+0000", 2024-09-14T09:08:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2677999999999998e-05 2024-09-14T09:08:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871808+0000", 2024-09-14T09:08:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105995 2024-09-14T09:08:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:764 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 4259840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.863071+0000", 2024-09-14T09:08:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.675847936, 2024-09-14T09:08:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0089758600000000004, 2024-09-14T09:08:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 764 2024-09-14T09:08:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863071+0000", 2024-09-14T09:08:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863071+0000", 2024-09-14T09:08:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863072+0000", 2024-09-14T09:08:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7400000000000003e-07 2024-09-14T09:08:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863074+0000", 2024-09-14T09:08:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4530000000000001e-06 2024-09-14T09:08:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863081+0000", 2024-09-14T09:08:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.776e-06 2024-09-14T09:08:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863087+0000", 2024-09-14T09:08:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7409999999999998e-06 2024-09-14T09:08:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871853+0000", 2024-09-14T09:08:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087656309999999994 2024-09-14T09:08:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.871938+0000", 2024-09-14T09:08:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5846000000000004e-05 2024-09-14T09:08:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872047+0000", 2024-09-14T09:08:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010883900000000001 2024-09-14T09:08:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:765 3.1 3:826e05dc:::rbd_data.11122fa6a16d.0000000000000009:6 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.863094+0000", 2024-09-14T09:08:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.675825046, 2024-09-14T09:08:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0091722320000000006, 2024-09-14T09:08:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 765 2024-09-14T09:08:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863094+0000", 2024-09-14T09:08:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863094+0000", 2024-09-14T09:08:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863095+0000", 2024-09-14T09:08:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3799999999999997e-07 2024-09-14T09:08:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863097+0000", 2024-09-14T09:08:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.996e-06 2024-09-14T09:08:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863103+0000", 2024-09-14T09:08:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.443e-06 2024-09-14T09:08:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.863110+0000", 2024-09-14T09:08:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6479999999999997e-06 2024-09-14T09:08:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872117+0000", 2024-09-14T09:08:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0090066590000000002 2024-09-14T09:08:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872183+0000", 2024-09-14T09:08:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6200999999999999e-05 2024-09-14T09:08:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.872267+0000", 2024-09-14T09:08:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3746999999999996e-05 2024-09-14T09:08:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:12.638 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:12.639 INFO:teuthology.orchestra.run.smithi148.stdout:1924 punch from 0xab00400 to 0xab09e00, (0x9a00 bytes) 2024-09-14T09:08:12.640 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:12.641+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:12.640 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:08:12.653 INFO:teuthology.orchestra.run.smithi148.stdout:1925 trunc from 0xabd0400 to 0x45ef600 2024-09-14T09:08:12.689 INFO:teuthology.orchestra.run.smithi148.stdout:1926 trunc from 0x45ef600 to 0x7750a00 2024-09-14T09:08:12.701 INFO:teuthology.orchestra.run.smithi148.stdout:1929 read 0x2d47a00 thru 0x2d4a4be (0x2abf bytes) 2024-09-14T09:08:12.708 INFO:teuthology.orchestra.run.smithi148.stdout:1930 trunc from 0x7750a00 to 0xc542400 2024-09-14T09:08:12.717 INFO:teuthology.orchestra.run.smithi148.stdout:1932 write 0x11e4200 thru 0x11f1f24 (0xdd25 bytes) 2024-09-14T09:08:12.730 INFO:teuthology.orchestra.run.smithi148.stdout:1934 trunc from 0xc542400 to 0x25a6600 2024-09-14T09:08:12.739 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:12.741+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:12.785 INFO:teuthology.orchestra.run.smithi148.stdout:1935 trunc from 0x25a6600 to 0x8bd7600 2024-09-14T09:08:12.793 INFO:teuthology.orchestra.run.smithi148.stdout:1936 write 0x7818a00 thru 0x781ccfc (0x42fd bytes) 2024-09-14T09:08:12.794 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:12.794 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:12.794 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:12.794 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:12.795 INFO:teuthology.orchestra.run.smithi148.stdout:1937 write 0x6af5600 thru 0x6aff087 (0x9a88 bytes) 2024-09-14T09:08:12.795 INFO:teuthology.orchestra.run.smithi148.stdout:1938 read 0x4c32800 thru 0x4c3f644 (0xce45 bytes) 2024-09-14T09:08:12.795 INFO:teuthology.orchestra.run.smithi148.stdout:1939 write 0x6fa0600 thru 0x6fab6d2 (0xb0d3 bytes) 2024-09-14T09:08:12.798 INFO:teuthology.orchestra.run.smithi148.stdout:1941 trunc from 0x8bd7600 to 0xc8a1200 2024-09-14T09:08:12.803 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:08:12.815 INFO:teuthology.orchestra.run.smithi148.stdout:1942 trunc from 0xc8a1200 to 0xd35fe00 2024-09-14T09:08:12.823 INFO:teuthology.orchestra.run.smithi148.stdout:1943 punch from 0x6962600 to 0x6965000, (0x2a00 bytes) 2024-09-14T09:08:12.825 INFO:teuthology.orchestra.run.smithi148.stdout:1946 write 0xbc0d600 thru 0xbc11c88 (0x4689 bytes) 2024-09-14T09:08:12.825 INFO:teuthology.orchestra.run.smithi148.stdout:1947 write 0xcf8ca00 thru 0xcf973c0 (0xa9c1 bytes) 2024-09-14T09:08:12.825 INFO:teuthology.orchestra.run.smithi148.stdout:1948 read 0x7417000 thru 0x741c756 (0x5757 bytes) 2024-09-14T09:08:12.826 INFO:teuthology.orchestra.run.smithi148.stdout:1949 punch from 0x6982600 to 0x6984200, (0x1c00 bytes) 2024-09-14T09:08:12.826 INFO:teuthology.orchestra.run.smithi148.stdout:1951 write 0xa329e00 thru 0xa33155d (0x775e bytes) 2024-09-14T09:08:12.840 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:12.842+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:12.841 INFO:teuthology.orchestra.run.smithi148.stdout:1953 trunc from 0xd35fe00 to 0x5da000 2024-09-14T09:08:12.853 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T09:08:12.916 INFO:teuthology.orchestra.run.smithi148.stdout:1954 trunc from 0x5da000 to 0x8626a00 2024-09-14T09:08:12.924 INFO:teuthology.orchestra.run.smithi148.stdout:1955 punch from 0x35cfe00 to 0x35d0000, (0x200 bytes) 2024-09-14T09:08:12.926 INFO:teuthology.orchestra.run.smithi148.stdout:1956 read 0x3226400 thru 0x3234279 (0xde7a bytes) 2024-09-14T09:08:12.937 INFO:teuthology.orchestra.run.smithi148.stdout:1957 write 0x8f31e00 thru 0x8f3cb3c (0xad3d bytes) 2024-09-14T09:08:12.938 INFO:teuthology.orchestra.run.smithi148.stdout:1958 write 0x3691c00 thru 0x369a82f (0x8c30 bytes) 2024-09-14T09:08:12.939 INFO:teuthology.orchestra.run.smithi148.stdout:1960 write 0x529f200 thru 0x52acca8 (0xdaa9 bytes) 2024-09-14T09:08:12.941 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:12.942+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:12.945 INFO:teuthology.orchestra.run.smithi148.stdout:1961 trunc from 0x8f3cc00 to 0x3711e00 2024-09-14T09:08:12.957 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:12.957 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:12.957 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:12.957 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:12.957 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:12.966 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:08:12.984 INFO:teuthology.orchestra.run.smithi148.stdout:1962 write 0x8260600 thru 0x82613dd (0xdde bytes) 2024-09-14T09:08:12.985 INFO:teuthology.orchestra.run.smithi148.stdout:1964 read 0x366c00 thru 0x375766 (0xeb67 bytes) 2024-09-14T09:08:12.986 INFO:teuthology.orchestra.run.smithi148.stdout:1965 write 0xeb3400 thru 0xeb6a25 (0x3626 bytes) 2024-09-14T09:08:12.986 INFO:teuthology.orchestra.run.smithi148.stdout:1966 read 0xec5c00 thru 0xec9aed (0x3eee bytes) 2024-09-14T09:08:12.986 INFO:teuthology.orchestra.run.smithi148.stdout:1967 write 0x35d5600 thru 0x35e32f5 (0xdcf6 bytes) 2024-09-14T09:08:12.987 INFO:teuthology.orchestra.run.smithi148.stdout:1968 write 0xcda200 thru 0xce4fc0 (0xadc1 bytes) 2024-09-14T09:08:12.989 INFO:teuthology.orchestra.run.smithi148.stdout:1970 trunc from 0x8261400 to 0x5e1ec00 2024-09-14T09:08:13.023 INFO:teuthology.orchestra.run.smithi148.stdout:1972 write 0x7f8a200 thru 0x7f98157 (0xdf58 bytes) 2024-09-14T09:08:13.040 INFO:teuthology.orchestra.run.smithi148.stdout:1973 write 0x9eb6a00 thru 0x9ec34d0 (0xcad1 bytes) 2024-09-14T09:08:13.041 INFO:teuthology.orchestra.run.smithi148.stdout:1975 read 0x406ba00 thru 0x407abab (0xf1ac bytes) 2024-09-14T09:08:13.041 INFO:teuthology.orchestra.run.smithi148.stdout:1976 read 0x1177a00 thru 0x1180482 (0x8a83 bytes) 2024-09-14T09:08:13.046 INFO:teuthology.orchestra.run.smithi148.stdout:1977 trunc from 0x9ec3600 to 0xe0bce00 2024-09-14T09:08:13.050 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:13.052+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:13.068 INFO:teuthology.orchestra.run.smithi148.stdout:1981 trunc from 0xe0bce00 to 0xc2fd400 2024-09-14T09:08:13.084 INFO:teuthology.orchestra.run.smithi148.stdout:1982 read 0x9a95a00 thru 0x9aa4717 (0xed18 bytes) 2024-09-14T09:08:13.084 INFO:teuthology.orchestra.run.smithi148.stdout:1983 write 0x6e3a800 thru 0x6e3fda2 (0x55a3 bytes) 2024-09-14T09:08:13.094 INFO:teuthology.orchestra.run.smithi148.stdout:1985 trunc from 0xc2fd400 to 0x4764a00 2024-09-14T09:08:13.119 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:13.119 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:13.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:13.119 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:13.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.119 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:41 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'19)", 2024-09-14T09:08:13.119 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.154530+0000", 2024-09-14T09:08:13.119 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.965727278999999, 2024-09-14T09:08:13.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097193060000000005, 2024-09-14T09:08:13.120 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:13.120 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:13.120 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.120 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:13.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:13.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154530+0000", 2024-09-14T09:08:13.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:13.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154530+0000", 2024-09-14T09:08:13.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:13.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154531+0000", 2024-09-14T09:08:13.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6199999999999997e-07 2024-09-14T09:08:13.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:13.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154567+0000", 2024-09-14T09:08:13.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5988000000000002e-05 2024-09-14T09:08:13.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:13.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154577+0000", 2024-09-14T09:08:13.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0366999999999999e-05 2024-09-14T09:08:13.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154583+0000", 2024-09-14T09:08:13.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3929999999999996e-06 2024-09-14T09:08:13.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:13.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154630+0000", 2024-09-14T09:08:13.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6980000000000001e-05 2024-09-14T09:08:13.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:13.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154650+0000", 2024-09-14T09:08:13.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9817999999999999e-05 2024-09-14T09:08:13.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:13.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164200+0000", 2024-09-14T09:08:13.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0095500770000000006 2024-09-14T09:08:13.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:13.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164249+0000", 2024-09-14T09:08:13.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9020999999999997e-05 2024-09-14T09:08:13.124 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.124 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:13.124 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.124 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:42 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'24, mlcod=15'19)", 2024-09-14T09:08:13.124 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:08:13.124 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.965151855999999, 2024-09-14T09:08:13.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0091673220000000003, 2024-09-14T09:08:13.124 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:13.124 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:13.125 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.125 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:13.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:13.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:08:13.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:13.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:08:13.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:13.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:08:13.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5000000000000001e-07 2024-09-14T09:08:13.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:13.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155113+0000", 2024-09-14T09:08:13.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8719999999999996e-06 2024-09-14T09:08:13.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:13.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155126+0000", 2024-09-14T09:08:13.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2951e-05 2024-09-14T09:08:13.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155132+0000", 2024-09-14T09:08:13.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9270000000000002e-06 2024-09-14T09:08:13.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:13.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158468+0000", 2024-09-14T09:08:13.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033357980000000001 2024-09-14T09:08:13.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:13.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158510+0000", 2024-09-14T09:08:13.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2138999999999998e-05 2024-09-14T09:08:13.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:13.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164251+0000", 2024-09-14T09:08:13.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0057413209999999998 2024-09-14T09:08:13.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:13.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164273+0000", 2024-09-14T09:08:13.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1364000000000001e-05 2024-09-14T09:08:13.128 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.128 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:13.128 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.128 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:43 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'25, mlcod=15'19)", 2024-09-14T09:08:13.128 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.155476+0000", 2024-09-14T09:08:13.128 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.964781168000002, 2024-09-14T09:08:13.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0092500399999999993, 2024-09-14T09:08:13.129 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:13.129 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:13.129 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.129 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:13.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:13.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155476+0000", 2024-09-14T09:08:13.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:13.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155476+0000", 2024-09-14T09:08:13.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:13.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155477+0000", 2024-09-14T09:08:13.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5300000000000002e-07 2024-09-14T09:08:13.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:13.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155486+0000", 2024-09-14T09:08:13.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2024-09-14T09:08:13.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:13.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155498+0000", 2024-09-14T09:08:13.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2911999999999999e-05 2024-09-14T09:08:13.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155506+0000", 2024-09-14T09:08:13.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3390000000000004e-06 2024-09-14T09:08:13.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:13.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158814+0000", 2024-09-14T09:08:13.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033078309999999998 2024-09-14T09:08:13.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:13.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158849+0000", 2024-09-14T09:08:13.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5330000000000002e-05 2024-09-14T09:08:13.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:13.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164691+0000", 2024-09-14T09:08:13.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005842346 2024-09-14T09:08:13.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:13.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164726+0000", 2024-09-14T09:08:13.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4978999999999998e-05 2024-09-14T09:08:13.132 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.132 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:13.132 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.133 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:44 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'26, mlcod=15'19)", 2024-09-14T09:08:13.133 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.155917+0000", 2024-09-14T09:08:13.133 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.964340651000001, 2024-09-14T09:08:13.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0088430230000000002, 2024-09-14T09:08:13.133 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:13.133 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:13.133 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.133 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:13.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:13.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155917+0000", 2024-09-14T09:08:13.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:13.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155917+0000", 2024-09-14T09:08:13.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:13.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155918+0000", 2024-09-14T09:08:13.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0359999999999999e-06 2024-09-14T09:08:13.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:13.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155951+0000", 2024-09-14T09:08:13.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3256999999999997e-05 2024-09-14T09:08:13.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:13.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155965+0000", 2024-09-14T09:08:13.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3692e-05 2024-09-14T09:08:13.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155971+0000", 2024-09-14T09:08:13.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0510000000000002e-06 2024-09-14T09:08:13.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:13.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159107+0000", 2024-09-14T09:08:13.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031363430000000002 2024-09-14T09:08:13.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:13.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159127+0000", 2024-09-14T09:08:13.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0268999999999999e-05 2024-09-14T09:08:13.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:13.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164728+0000", 2024-09-14T09:08:13.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056003629999999997 2024-09-14T09:08:13.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:13.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164760+0000", 2024-09-14T09:08:13.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2011999999999998e-05 2024-09-14T09:08:13.137 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.137 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:13.137 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.137 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:45 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'27, mlcod=15'19)", 2024-09-14T09:08:13.137 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.156503+0000", 2024-09-14T09:08:13.137 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.963753963000002, 2024-09-14T09:08:13.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082756970000000003, 2024-09-14T09:08:13.137 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:13.137 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:13.137 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.137 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:13.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:13.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156503+0000", 2024-09-14T09:08:13.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:13.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156503+0000", 2024-09-14T09:08:13.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:13.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156505+0000", 2024-09-14T09:08:13.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8139999999999999e-06 2024-09-14T09:08:13.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:13.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156516+0000", 2024-09-14T09:08:13.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1019000000000001e-05 2024-09-14T09:08:13.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:13.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156543+0000", 2024-09-14T09:08:13.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.692e-05 2024-09-14T09:08:13.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156556+0000", 2024-09-14T09:08:13.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3063e-05 2024-09-14T09:08:13.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:13.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159573+0000", 2024-09-14T09:08:13.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003016712 2024-09-14T09:08:13.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:13.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159589+0000", 2024-09-14T09:08:13.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6494000000000002e-05 2024-09-14T09:08:13.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:13.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164762+0000", 2024-09-14T09:08:13.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051722519999999996 2024-09-14T09:08:13.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:13.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164779+0000", 2024-09-14T09:08:13.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7422999999999999e-05 2024-09-14T09:08:13.141 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.141 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:13.141 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.141 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:46 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'28, mlcod=15'19)", 2024-09-14T09:08:13.141 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.156804+0000", 2024-09-14T09:08:13.141 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.963452873999998, 2024-09-14T09:08:13.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079926879999999995, 2024-09-14T09:08:13.141 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:13.141 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:13.142 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.142 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:13.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:13.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156804+0000", 2024-09-14T09:08:13.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:13.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156804+0000", 2024-09-14T09:08:13.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:13.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156805+0000", 2024-09-14T09:08:13.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3099999999999998e-07 2024-09-14T09:08:13.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:13.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156809+0000", 2024-09-14T09:08:13.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8299999999999998e-06 2024-09-14T09:08:13.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:13.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156817+0000", 2024-09-14T09:08:13.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7579999999999992e-06 2024-09-14T09:08:13.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156831+0000", 2024-09-14T09:08:13.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4256999999999999e-05 2024-09-14T09:08:13.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:13.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159903+0000", 2024-09-14T09:08:13.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030721590000000001 2024-09-14T09:08:13.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:13.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159922+0000", 2024-09-14T09:08:13.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8994000000000001e-05 2024-09-14T09:08:13.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:13.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164780+0000", 2024-09-14T09:08:13.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048582879999999997 2024-09-14T09:08:13.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:13.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164797+0000", 2024-09-14T09:08:13.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6971000000000001e-05 2024-09-14T09:08:13.145 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.145 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:13.145 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.145 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:47 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'29, mlcod=15'19)", 2024-09-14T09:08:13.145 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.157344+0000", 2024-09-14T09:08:13.145 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.962913665999999, 2024-09-14T09:08:13.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074729030000000004, 2024-09-14T09:08:13.145 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:13.146 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:13.146 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.146 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:13.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:13.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157344+0000", 2024-09-14T09:08:13.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:13.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157344+0000", 2024-09-14T09:08:13.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:13.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157346+0000", 2024-09-14T09:08:13.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.81e-06 2024-09-14T09:08:13.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:13.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157406+0000", 2024-09-14T09:08:13.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0523000000000003e-05 2024-09-14T09:08:13.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:13.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157434+0000", 2024-09-14T09:08:13.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8059999999999999e-05 2024-09-14T09:08:13.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157447+0000", 2024-09-14T09:08:13.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2666e-05 2024-09-14T09:08:13.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:13.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160183+0000", 2024-09-14T09:08:13.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002736413 2024-09-14T09:08:13.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:13.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160203+0000", 2024-09-14T09:08:13.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9545e-05 2024-09-14T09:08:13.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:13.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164798+0000", 2024-09-14T09:08:13.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045953890000000001 2024-09-14T09:08:13.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:13.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164817+0000", 2024-09-14T09:08:13.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8496999999999999e-05 2024-09-14T09:08:13.149 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.149 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:13.149 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.149 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:48 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'30, mlcod=15'19)", 2024-09-14T09:08:13.149 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.157693+0000", 2024-09-14T09:08:13.149 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.962564401000002, 2024-09-14T09:08:13.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0071445789999999999, 2024-09-14T09:08:13.150 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:13.150 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:13.150 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.150 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:13.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:13.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157693+0000", 2024-09-14T09:08:13.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:13.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157693+0000", 2024-09-14T09:08:13.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:13.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157694+0000", 2024-09-14T09:08:13.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2024-09-14T09:08:13.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:13.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157701+0000", 2024-09-14T09:08:13.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0230000000000004e-06 2024-09-14T09:08:13.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:13.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157709+0000", 2024-09-14T09:08:13.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7819999999999999e-06 2024-09-14T09:08:13.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157714+0000", 2024-09-14T09:08:13.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2440000000000004e-06 2024-09-14T09:08:13.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:13.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160598+0000", 2024-09-14T09:08:13.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028844280000000001 2024-09-14T09:08:13.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:13.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160618+0000", 2024-09-14T09:08:13.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0435e-05 2024-09-14T09:08:13.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:13.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164818+0000", 2024-09-14T09:08:13.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042000329999999997 2024-09-14T09:08:13.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:13.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164838+0000", 2024-09-14T09:08:13.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9054000000000001e-05 2024-09-14T09:08:13.153 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.153 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:13.153 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.154 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:49 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'31, mlcod=15'19)", 2024-09-14T09:08:13.154 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.158173+0000", 2024-09-14T09:08:13.154 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.962084738000001, 2024-09-14T09:08:13.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0066833700000000001, 2024-09-14T09:08:13.154 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:13.154 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:13.154 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.154 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:13.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:13.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158173+0000", 2024-09-14T09:08:13.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:13.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158173+0000", 2024-09-14T09:08:13.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:13.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158175+0000", 2024-09-14T09:08:13.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8840000000000001e-06 2024-09-14T09:08:13.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:13.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158188+0000", 2024-09-14T09:08:13.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3842999999999999e-05 2024-09-14T09:08:13.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:13.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158225+0000", 2024-09-14T09:08:13.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7039000000000002e-05 2024-09-14T09:08:13.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158243+0000", 2024-09-14T09:08:13.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7932999999999999e-05 2024-09-14T09:08:13.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:13.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160875+0000", 2024-09-14T09:08:13.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002632045 2024-09-14T09:08:13.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:13.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160887+0000", 2024-09-14T09:08:13.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2084e-05 2024-09-14T09:08:13.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:13.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164839+0000", 2024-09-14T09:08:13.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039511390000000002 2024-09-14T09:08:13.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:13.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164856+0000", 2024-09-14T09:08:13.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7402999999999999e-05 2024-09-14T09:08:13.161 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.161 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:13.161 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.162 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:66 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'44, mlcod=15'40)", 2024-09-14T09:08:13.162 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.430075+0000", 2024-09-14T09:08:13.162 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.690182552000003, 2024-09-14T09:08:13.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070127770000000004, 2024-09-14T09:08:13.162 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:13.162 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:13.162 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.162 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:13.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:13.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430075+0000", 2024-09-14T09:08:13.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:13.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430075+0000", 2024-09-14T09:08:13.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:13.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430076+0000", 2024-09-14T09:08:13.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4200000000000005e-07 2024-09-14T09:08:13.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:13.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430131+0000", 2024-09-14T09:08:13.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099000000000002e-05 2024-09-14T09:08:13.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:13.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430141+0000", 2024-09-14T09:08:13.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.978e-06 2024-09-14T09:08:13.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430145+0000", 2024-09-14T09:08:13.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4519999999999999e-06 2024-09-14T09:08:13.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:13.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430189+0000", 2024-09-14T09:08:13.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3924000000000002e-05 2024-09-14T09:08:13.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:13.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430202+0000", 2024-09-14T09:08:13.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3319000000000001e-05 2024-09-14T09:08:13.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:13.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437052+0000", 2024-09-14T09:08:13.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0068491389999999997 2024-09-14T09:08:13.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:13.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437088+0000", 2024-09-14T09:08:13.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6023999999999999e-05 2024-09-14T09:08:13.166 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.166 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:13.166 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.166 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:67 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'45, mlcod=15'40)", 2024-09-14T09:08:13.166 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.430561+0000", 2024-09-14T09:08:13.166 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.689696024, 2024-09-14T09:08:13.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065458490000000003, 2024-09-14T09:08:13.166 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:13.166 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:13.167 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.167 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:13.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:13.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430561+0000", 2024-09-14T09:08:13.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:13.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430561+0000", 2024-09-14T09:08:13.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:13.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430562+0000", 2024-09-14T09:08:13.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1500000000000005e-07 2024-09-14T09:08:13.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:13.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430566+0000", 2024-09-14T09:08:13.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8589999999999998e-06 2024-09-14T09:08:13.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:13.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430572+0000", 2024-09-14T09:08:13.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5390000000000004e-06 2024-09-14T09:08:13.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430576+0000", 2024-09-14T09:08:13.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4879999999999999e-06 2024-09-14T09:08:13.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:13.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430724+0000", 2024-09-14T09:08:13.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000148107 2024-09-14T09:08:13.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:13.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430775+0000", 2024-09-14T09:08:13.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1010000000000001e-05 2024-09-14T09:08:13.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:13.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437090+0000", 2024-09-14T09:08:13.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063148129999999998 2024-09-14T09:08:13.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:13.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437107+0000", 2024-09-14T09:08:13.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7518000000000001e-05 2024-09-14T09:08:13.170 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.170 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:13.170 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1024 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.966579+0000", 2024-09-14T09:08:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.153677986000002, 2024-09-14T09:08:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069169419999999997, 2024-09-14T09:08:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1024 2024-09-14T09:08:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966579+0000", 2024-09-14T09:08:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966579+0000", 2024-09-14T09:08:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966580+0000", 2024-09-14T09:08:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000002e-07 2024-09-14T09:08:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966582+0000", 2024-09-14T09:08:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0040000000000002e-06 2024-09-14T09:08:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966588+0000", 2024-09-14T09:08:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6959999999999999e-06 2024-09-14T09:08:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966592+0000", 2024-09-14T09:08:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2370000000000001e-06 2024-09-14T09:08:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.967468+0000", 2024-09-14T09:08:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00087601900000000002 2024-09-14T09:08:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.967562+0000", 2024-09-14T09:08:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4543000000000006e-05 2024-09-14T09:08:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.967905+0000", 2024-09-14T09:08:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00034289100000000001 2024-09-14T09:08:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.968973+0000", 2024-09-14T09:08:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010677530000000001 2024-09-14T09:08:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.973420+0000", 2024-09-14T09:08:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044470810000000003 2024-09-14T09:08:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:13.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.973455+0000", 2024-09-14T09:08:13.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5018000000000003e-05 2024-09-14T09:08:13.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:13.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.973496+0000", 2024-09-14T09:08:13.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1303000000000001e-05 2024-09-14T09:08:13.176 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.176 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:13.176 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.176 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1206 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:13.176 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417812+0000", 2024-09-14T09:08:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.702445462, 2024-09-14T09:08:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082937259999999995, 2024-09-14T09:08:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1206 2024-09-14T09:08:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:13.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417812+0000", 2024-09-14T09:08:13.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:13.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417812+0000", 2024-09-14T09:08:13.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417812+0000", 2024-09-14T09:08:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1e-07 2024-09-14T09:08:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417813+0000", 2024-09-14T09:08:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2470000000000001e-06 2024-09-14T09:08:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417817+0000", 2024-09-14T09:08:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3720000000000001e-06 2024-09-14T09:08:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417819+0000", 2024-09-14T09:08:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3980000000000002e-06 2024-09-14T09:08:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.422429+0000", 2024-09-14T09:08:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046098040000000003 2024-09-14T09:08:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.422477+0000", 2024-09-14T09:08:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8000999999999997e-05 2024-09-14T09:08:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.422680+0000", 2024-09-14T09:08:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000202986 2024-09-14T09:08:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425417+0000", 2024-09-14T09:08:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00273742 2024-09-14T09:08:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426055+0000", 2024-09-14T09:08:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00063756800000000003 2024-09-14T09:08:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426083+0000", 2024-09-14T09:08:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7616000000000001e-05 2024-09-14T09:08:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426106+0000", 2024-09-14T09:08:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3104000000000001e-05 2024-09-14T09:08:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1207 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417822+0000", 2024-09-14T09:08:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.702435367, 2024-09-14T09:08:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.009748909, 2024-09-14T09:08:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1207 2024-09-14T09:08:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417822+0000", 2024-09-14T09:08:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417822+0000", 2024-09-14T09:08:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417822+0000", 2024-09-14T09:08:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.36e-07 2024-09-14T09:08:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417824+0000", 2024-09-14T09:08:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4410000000000001e-06 2024-09-14T09:08:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417827+0000", 2024-09-14T09:08:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8600000000000001e-06 2024-09-14T09:08:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417829+0000", 2024-09-14T09:08:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4200000000000001e-06 2024-09-14T09:08:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.423665+0000", 2024-09-14T09:08:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058360590000000002 2024-09-14T09:08:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.423755+0000", 2024-09-14T09:08:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9999000000000003e-05 2024-09-14T09:08:13.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:13.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424113+0000", 2024-09-14T09:08:13.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00035816599999999999 2024-09-14T09:08:13.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:13.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426112+0000", 2024-09-14T09:08:13.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019984209999999998 2024-09-14T09:08:13.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:13.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427498+0000", 2024-09-14T09:08:13.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013862049999999999 2024-09-14T09:08:13.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427534+0000", 2024-09-14T09:08:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6609999999999997e-05 2024-09-14T09:08:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427571+0000", 2024-09-14T09:08:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6492000000000002e-05 2024-09-14T09:08:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.194 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1208 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:13.194 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417832+0000", 2024-09-14T09:08:13.194 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.702425591000001, 2024-09-14T09:08:13.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0098905280000000009, 2024-09-14T09:08:13.194 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:13.194 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1208 2024-09-14T09:08:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417832+0000", 2024-09-14T09:08:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:13.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417832+0000", 2024-09-14T09:08:13.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:13.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417832+0000", 2024-09-14T09:08:13.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2399999999999999e-07 2024-09-14T09:08:13.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:13.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417833+0000", 2024-09-14T09:08:13.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0950000000000001e-06 2024-09-14T09:08:13.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417842+0000", 2024-09-14T09:08:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3959999999999995e-06 2024-09-14T09:08:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417846+0000", 2024-09-14T09:08:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4649999999999999e-06 2024-09-14T09:08:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424607+0000", 2024-09-14T09:08:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067611750000000003 2024-09-14T09:08:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424690+0000", 2024-09-14T09:08:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2890000000000001e-05 2024-09-14T09:08:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425029+0000", 2024-09-14T09:08:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033934900000000002 2024-09-14T09:08:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427460+0000", 2024-09-14T09:08:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024307619999999999 2024-09-14T09:08:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427624+0000", 2024-09-14T09:08:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000163404 2024-09-14T09:08:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427681+0000", 2024-09-14T09:08:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7748999999999999e-05 2024-09-14T09:08:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427722+0000", 2024-09-14T09:08:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1019000000000001e-05 2024-09-14T09:08:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1209 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417851+0000", 2024-09-14T09:08:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.702406085, 2024-09-14T09:08:13.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010012681000000001, 2024-09-14T09:08:13.202 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:13.202 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:13.202 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.202 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:13.202 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:13.202 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:13.202 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1209 2024-09-14T09:08:13.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.202 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417851+0000", 2024-09-14T09:08:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417851+0000", 2024-09-14T09:08:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417852+0000", 2024-09-14T09:08:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.84e-07 2024-09-14T09:08:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417853+0000", 2024-09-14T09:08:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6589999999999999e-06 2024-09-14T09:08:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417857+0000", 2024-09-14T09:08:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7050000000000001e-06 2024-09-14T09:08:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417860+0000", 2024-09-14T09:08:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.242e-06 2024-09-14T09:08:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425469+0000", 2024-09-14T09:08:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076089 2024-09-14T09:08:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425553+0000", 2024-09-14T09:08:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3657000000000002e-05 2024-09-14T09:08:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425782+0000", 2024-09-14T09:08:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000229519 2024-09-14T09:08:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427775+0000", 2024-09-14T09:08:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019930289999999999 2024-09-14T09:08:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427794+0000", 2024-09-14T09:08:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8238999999999999e-05 2024-09-14T09:08:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427827+0000", 2024-09-14T09:08:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3045e-05 2024-09-14T09:08:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427864+0000", 2024-09-14T09:08:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7401999999999999e-05 2024-09-14T09:08:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1210 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417864+0000", 2024-09-14T09:08:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.702393012000002, 2024-09-14T09:08:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011675377000000001, 2024-09-14T09:08:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1210 2024-09-14T09:08:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417864+0000", 2024-09-14T09:08:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417864+0000", 2024-09-14T09:08:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417865+0000", 2024-09-14T09:08:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.34e-07 2024-09-14T09:08:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417866+0000", 2024-09-14T09:08:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.384e-06 2024-09-14T09:08:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417869+0000", 2024-09-14T09:08:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.971e-06 2024-09-14T09:08:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417872+0000", 2024-09-14T09:08:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5979999999999999e-06 2024-09-14T09:08:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426155+0000", 2024-09-14T09:08:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082832389999999995 2024-09-14T09:08:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426236+0000", 2024-09-14T09:08:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1241000000000004e-05 2024-09-14T09:08:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426477+0000", 2024-09-14T09:08:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024123999999999999 2024-09-14T09:08:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427872+0000", 2024-09-14T09:08:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001394714 2024-09-14T09:08:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.429483+0000", 2024-09-14T09:08:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001611124 2024-09-14T09:08:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.429515+0000", 2024-09-14T09:08:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2243000000000003e-05 2024-09-14T09:08:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.429540+0000", 2024-09-14T09:08:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4389e-05 2024-09-14T09:08:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1218 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.425295+0000", 2024-09-14T09:08:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.694962616000002, 2024-09-14T09:08:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0068691480000000003, 2024-09-14T09:08:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1218 2024-09-14T09:08:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425295+0000", 2024-09-14T09:08:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425295+0000", 2024-09-14T09:08:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425296+0000", 2024-09-14T09:08:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3489999999999999e-06 2024-09-14T09:08:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425302+0000", 2024-09-14T09:08:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4709999999999998e-06 2024-09-14T09:08:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425317+0000", 2024-09-14T09:08:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5438999999999999e-05 2024-09-14T09:08:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425325+0000", 2024-09-14T09:08:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5229999999999998e-06 2024-09-14T09:08:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426759+0000", 2024-09-14T09:08:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001434399 2024-09-14T09:08:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426846+0000", 2024-09-14T09:08:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7529999999999997e-05 2024-09-14T09:08:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427211+0000", 2024-09-14T09:08:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00036427200000000001 2024-09-14T09:08:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428665+0000", 2024-09-14T09:08:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014539659999999999 2024-09-14T09:08:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432108+0000", 2024-09-14T09:08:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034428229999999998 2024-09-14T09:08:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432139+0000", 2024-09-14T09:08:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1319000000000003e-05 2024-09-14T09:08:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432164+0000", 2024-09-14T09:08:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5057000000000001e-05 2024-09-14T09:08:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1219 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.425715+0000", 2024-09-14T09:08:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.694542288000001, 2024-09-14T09:08:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065717709999999997, 2024-09-14T09:08:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1219 2024-09-14T09:08:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425715+0000", 2024-09-14T09:08:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425715+0000", 2024-09-14T09:08:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425716+0000", 2024-09-14T09:08:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0599999999999999e-07 2024-09-14T09:08:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425726+0000", 2024-09-14T09:08:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0122999999999999e-05 2024-09-14T09:08:13.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:13.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425743+0000", 2024-09-14T09:08:13.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7110000000000001e-05 2024-09-14T09:08:13.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425749+0000", 2024-09-14T09:08:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2099999999999998e-06 2024-09-14T09:08:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427903+0000", 2024-09-14T09:08:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021539969999999999 2024-09-14T09:08:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427985+0000", 2024-09-14T09:08:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1458999999999994e-05 2024-09-14T09:08:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428277+0000", 2024-09-14T09:08:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029251100000000002 2024-09-14T09:08:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.430127+0000", 2024-09-14T09:08:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018491950000000001 2024-09-14T09:08:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432234+0000", 2024-09-14T09:08:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002107458 2024-09-14T09:08:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432267+0000", 2024-09-14T09:08:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3291999999999999e-05 2024-09-14T09:08:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432287+0000", 2024-09-14T09:08:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9510000000000001e-05 2024-09-14T09:08:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4782.0:193 3.17 3:e98abfa9:::rbd_data.11127a12d636.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write 3887104~20480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-14T09:08:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:09.305741+0000", 2024-09-14T09:08:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.814516131, 2024-09-14T09:08:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0081452360000000001, 2024-09-14T09:08:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4782", 2024-09-14T09:08:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/353415140", 2024-09-14T09:08:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 193 2024-09-14T09:08:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.305741+0000", 2024-09-14T09:08:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.305741+0000", 2024-09-14T09:08:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.305742+0000", 2024-09-14T09:08:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5700000000000002e-07 2024-09-14T09:08:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.307981+0000", 2024-09-14T09:08:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022389200000000001 2024-09-14T09:08:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.307992+0000", 2024-09-14T09:08:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1681999999999999e-05 2024-09-14T09:08:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.307998+0000", 2024-09-14T09:08:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6520000000000003e-06 2024-09-14T09:08:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.308039+0000", 2024-09-14T09:08:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0611999999999997e-05 2024-09-14T09:08:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.308130+0000", 2024-09-14T09:08:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0896999999999994e-05 2024-09-14T09:08:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.308394+0000", 2024-09-14T09:08:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00026417600000000003 2024-09-14T09:08:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.312043+0000", 2024-09-14T09:08:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00364921 2024-09-14T09:08:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.313829+0000", 2024-09-14T09:08:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001785738 2024-09-14T09:08:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.313862+0000", 2024-09-14T09:08:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3096000000000003e-05 2024-09-14T09:08:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.313886+0000", 2024-09-14T09:08:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4695999999999999e-05 2024-09-14T09:08:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.233 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:13.233 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.233 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:13.233 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:13.233 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:13.234 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:13.236+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:13.236 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:08:13.238 INFO:teuthology.orchestra.run.smithi148.stdout:1986 read 0x2f8be00 thru 0x2f92c9e (0x6e9f bytes) 2024-09-14T09:08:13.238 INFO:teuthology.orchestra.run.smithi148.stdout:1988 punch from 0xab200 to 0xb8a00, (0xd800 bytes) 2024-09-14T09:08:13.238 INFO:teuthology.orchestra.run.smithi148.stdout:1990 trunc from 0x4764a00 to 0x74e7800 2024-09-14T09:08:13.238 INFO:teuthology.orchestra.run.smithi148.stdout:1992 write 0x5e45c00 thru 0x5e479be (0x1dbf bytes) 2024-09-14T09:08:13.239 INFO:teuthology.orchestra.run.smithi148.stdout:1994 write 0xdedaa00 thru 0xdee4ead (0xa4ae bytes) 2024-09-14T09:08:13.239 INFO:teuthology.orchestra.run.smithi148.stdout:1996 write 0xa221a00 thru 0xa22eb52 (0xd153 bytes) 2024-09-14T09:08:13.239 INFO:teuthology.orchestra.run.smithi148.stdout:1998 read 0xb46a800 thru 0xb473b52 (0x9353 bytes) 2024-09-14T09:08:13.239 INFO:teuthology.orchestra.run.smithi148.stdout:2007 write 0x2736e00 thru 0x2739ce1 (0x2ee2 bytes) 2024-09-14T09:08:13.239 INFO:teuthology.orchestra.run.smithi148.stdout:2008 read 0x2c13e00 thru 0x2c1e996 (0xab97 bytes) 2024-09-14T09:08:13.239 INFO:teuthology.orchestra.run.smithi148.stdout:2009 write 0x2b4f000 thru 0x2b5104f (0x2050 bytes) 2024-09-14T09:08:13.239 INFO:teuthology.orchestra.run.smithi148.stdout:2012 trunc from 0xdee5000 to 0x4b42200 2024-09-14T09:08:13.239 INFO:teuthology.orchestra.run.smithi148.stdout:2015 write 0x548400 thru 0x54c5b2 (0x41b3 bytes) 2024-09-14T09:08:13.239 INFO:teuthology.orchestra.run.smithi148.stdout:2019 punch from 0x42c3000 to 0x42c5c00, (0x2c00 bytes) 2024-09-14T09:08:13.239 INFO:teuthology.orchestra.run.smithi148.stdout:2021 punch from 0x171a200 to 0x1728a00, (0xe800 bytes) 2024-09-14T09:08:13.239 INFO:teuthology.orchestra.run.smithi148.stdout:2022 write 0x4face00 thru 0x4fbb68a (0xe88b bytes) 2024-09-14T09:08:13.239 INFO:teuthology.orchestra.run.smithi148.stdout:2025 write 0x18b2600 thru 0x18b72c9 (0x4cca bytes) 2024-09-14T09:08:13.239 INFO:teuthology.orchestra.run.smithi148.stdout:2026 read 0x256c800 thru 0x2577d1b (0xb51c bytes) 2024-09-14T09:08:13.240 INFO:teuthology.orchestra.run.smithi148.stdout:2027 read 0x476b800 thru 0x4774bbc (0x93bd bytes) 2024-09-14T09:08:13.240 INFO:teuthology.orchestra.run.smithi148.stdout:2029 read 0x2e21600 thru 0x2e2d849 (0xc24a bytes) 2024-09-14T09:08:13.240 INFO:teuthology.orchestra.run.smithi148.stdout:2030 punch from 0x12e8400 to 0x12f1600, (0x9200 bytes) 2024-09-14T09:08:13.240 INFO:teuthology.orchestra.run.smithi148.stdout:2033 read 0x23f2c00 thru 0x23f7c73 (0x5074 bytes) 2024-09-14T09:08:13.240 INFO:teuthology.orchestra.run.smithi148.stdout:2034 trunc from 0x4fbb800 to 0x475aa00 2024-09-14T09:08:13.259 INFO:teuthology.orchestra.run.smithi148.stdout:2036 trunc from 0x475aa00 to 0x99f4400 2024-09-14T09:08:13.284 INFO:teuthology.orchestra.run.smithi148.stdout:2038 write 0xda04800 thru 0xda0e0df (0x98e0 bytes) 2024-09-14T09:08:13.289 INFO:teuthology.orchestra.run.smithi148.stdout:2039 punch from 0x41e1000 to 0x41ef200, (0xe200 bytes) 2024-09-14T09:08:13.290 INFO:teuthology.orchestra.run.smithi148.stdout:2043 punch from 0x7a43400 to 0x7a47200, (0x3e00 bytes) 2024-09-14T09:08:13.290 INFO:teuthology.orchestra.run.smithi148.stdout:2044 write 0xd135a00 thru 0xd13ff51 (0xa552 bytes) 2024-09-14T09:08:13.290 INFO:teuthology.orchestra.run.smithi148.stdout:2048 read 0xccb6c00 thru 0xccbb191 (0x4592 bytes) 2024-09-14T09:08:13.290 INFO:teuthology.orchestra.run.smithi148.stdout:2049 read 0x853fa00 thru 0x854116a (0x176b bytes) 2024-09-14T09:08:13.294 INFO:teuthology.orchestra.run.smithi148.stdout:2050 trunc from 0xda0e200 to 0x9b55000 2024-09-14T09:08:13.314 INFO:teuthology.orchestra.run.smithi148.stdout:2053 read 0xaff200 thru 0xb070c4 (0x7ec5 bytes) 2024-09-14T09:08:13.319 INFO:teuthology.orchestra.run.smithi148.stdout:2054 trunc from 0x9b55000 to 0x9dc2e00 2024-09-14T09:08:13.329 INFO:teuthology.orchestra.run.smithi148.stdout:2055 punch from 0x1b63200 to 0x1b6c600, (0x9400 bytes) 2024-09-14T09:08:13.335 INFO:teuthology.orchestra.run.smithi148.stdout:2056 punch from 0x6bb3800 to 0x6bbda00, (0xa200 bytes) 2024-09-14T09:08:13.335 INFO:teuthology.orchestra.run.smithi148.stdout:2058 write 0x310de00 thru 0x310f75a (0x195b bytes) 2024-09-14T09:08:13.335 INFO:teuthology.orchestra.run.smithi148.stdout:2059 write 0x7477800 thru 0x747d279 (0x5a7a bytes) 2024-09-14T09:08:13.335 INFO:teuthology.orchestra.run.smithi148.stdout:2060 write 0x499fc00 thru 0x49a074d (0xb4e bytes) 2024-09-14T09:08:13.335 INFO:teuthology.orchestra.run.smithi148.stdout:2061 write 0xde3c00 thru 0xdee621 (0xaa22 bytes) 2024-09-14T09:08:13.336 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:13.336+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:13.341 INFO:teuthology.orchestra.run.smithi148.stdout:2062 trunc from 0x9dc2e00 to 0x51dda00 2024-09-14T09:08:13.365 INFO:teuthology.orchestra.run.smithi148.stdout:2063 punch from 0x4ae8200 to 0x4af2600, (0xa400 bytes) 2024-09-14T09:08:13.365 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:13.366 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:13.366 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:08:13.366 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:13.375 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:08:13.376 INFO:teuthology.orchestra.run.smithi148.stdout:2064 trunc from 0x51dda00 to 0x9b0b200 2024-09-14T09:08:13.385 INFO:teuthology.orchestra.run.smithi148.stdout:2066 read 0x33ea000 thru 0x33eb294 (0x1295 bytes) 2024-09-14T09:08:13.391 INFO:teuthology.orchestra.run.smithi148.stdout:2069 flatten 2024-09-14T09:08:13.403 INFO:teuthology.orchestra.run.smithi148.stdout:2071 read 0x4a2f800 thru 0x4a35bed (0x63ee bytes) 2024-09-14T09:08:13.403 INFO:teuthology.orchestra.run.smithi148.stdout:2072 write 0x89daa00 thru 0x89e9b9a (0xf19b bytes) 2024-09-14T09:08:13.407 INFO:teuthology.orchestra.run.smithi148.stdout:2073 trunc from 0x9b0b200 to 0xd731400 2024-09-14T09:08:13.429 INFO:teuthology.orchestra.run.smithi148.stdout:2075 write 0x545f800 thru 0x546d902 (0xe103 bytes) 2024-09-14T09:08:13.436 INFO:teuthology.orchestra.run.smithi148.stdout:2077 punch from 0x3a7f600 to 0x3a8f400, (0xfe00 bytes) 2024-09-14T09:08:13.436 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:13.437+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:13.437 INFO:teuthology.orchestra.run.smithi148.stdout:2078 read 0x5b6200 thru 0x5bd77b (0x757c bytes) 2024-09-14T09:08:13.438 INFO:teuthology.orchestra.run.smithi148.stdout:2082 punch from 0x2ec1a00 to 0x2ecb400, (0x9a00 bytes) 2024-09-14T09:08:13.438 INFO:teuthology.orchestra.run.smithi148.stdout:2086 write 0x8331200 thru 0x833a08f (0x8e90 bytes) 2024-09-14T09:08:13.438 INFO:teuthology.orchestra.run.smithi148.stdout:2089 write 0x173fa00 thru 0x174284d (0x2e4e bytes) 2024-09-14T09:08:13.438 INFO:teuthology.orchestra.run.smithi148.stdout:2090 read 0x34c1a00 thru 0x34cbb5e (0xa15f bytes) 2024-09-14T09:08:13.438 INFO:teuthology.orchestra.run.smithi148.stdout:2093 read 0xab0da00 thru 0xab0f265 (0x1866 bytes) 2024-09-14T09:08:13.438 INFO:teuthology.orchestra.run.smithi148.stdout:2094 punch from 0xb3ea200 to 0xb3ec000, (0x1e00 bytes) 2024-09-14T09:08:13.439 INFO:teuthology.orchestra.run.smithi148.stdout:2096 read 0x5e46c00 thru 0x5e4e327 (0x7728 bytes) 2024-09-14T09:08:13.439 INFO:teuthology.orchestra.run.smithi148.stdout:2097 write 0x310a400 thru 0x310dc55 (0x3856 bytes) 2024-09-14T09:08:13.439 INFO:teuthology.orchestra.run.smithi148.stdout:2098 write 0x85e0a00 thru 0x85ea605 (0x9c06 bytes) 2024-09-14T09:08:13.439 INFO:teuthology.orchestra.run.smithi148.stdout:2099 write 0xcaf1000 thru 0xcaf35bb (0x25bc bytes) 2024-09-14T09:08:13.439 INFO:teuthology.orchestra.run.smithi148.stdout:2101 write 0x926200 thru 0x934079 (0xde7a bytes) 2024-09-14T09:08:13.439 INFO:teuthology.orchestra.run.smithi148.stdout:2102 write 0x8014000 thru 0x801d76c (0x976d bytes) 2024-09-14T09:08:13.444 INFO:teuthology.orchestra.run.smithi148.stdout:2105 trunc from 0xd731400 to 0x9e2e400 2024-09-14T09:08:13.473 INFO:teuthology.orchestra.run.smithi148.stdout:2107 read 0x2297600 thru 0x229faa6 (0x84a7 bytes) 2024-09-14T09:08:13.489 INFO:teuthology.orchestra.run.smithi148.stdout:2108 write 0x9f9d600 thru 0x9fa28ac (0x52ad bytes) 2024-09-14T09:08:13.492 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:13.492 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:13.492 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:13.492 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:13.492 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:13.496 INFO:teuthology.orchestra.run.smithi148.stdout:2109 trunc from 0x9fa2a00 to 0xa82a200 2024-09-14T09:08:13.501 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:08:13.509 INFO:teuthology.orchestra.run.smithi148.stdout:2111 write 0xc2ea00 thru 0xc3b6b2 (0xccb3 bytes) 2024-09-14T09:08:13.516 INFO:teuthology.orchestra.run.smithi148.stdout:2113 read 0x2ac0a00 thru 0x2acaf20 (0xa521 bytes) 2024-09-14T09:08:13.516 INFO:teuthology.orchestra.run.smithi148.stdout:2116 read 0x4b3f600 thru 0x4b48605 (0x9006 bytes) 2024-09-14T09:08:13.517 INFO:teuthology.orchestra.run.smithi148.stdout:2118 write 0x5598a00 thru 0x55a458e (0xbb8f bytes) 2024-09-14T09:08:13.517 INFO:teuthology.orchestra.run.smithi148.stdout:2120 read 0x8d28000 thru 0x8d28613 (0x614 bytes) 2024-09-14T09:08:13.517 INFO:teuthology.orchestra.run.smithi148.stdout:2123 read 0x9c37600 thru 0x9c3fd62 (0x8763 bytes) 2024-09-14T09:08:13.538 INFO:teuthology.orchestra.run.smithi148.stdout:2126 write 0xe874200 thru 0xe883a5e (0xf85f bytes) 2024-09-14T09:08:13.545 INFO:teuthology.orchestra.run.smithi148.stdout:skipping zero length punch hole 2024-09-14T09:08:13.545 INFO:teuthology.orchestra.run.smithi148.stdout:2129 write 0x2c43e00 thru 0x2c48eec (0x50ed bytes) 2024-09-14T09:08:13.545 INFO:teuthology.orchestra.run.smithi148.stdout:2130 read 0xc81cc00 thru 0xc8275dc (0xa9dd bytes) 2024-09-14T09:08:13.545 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:13.547+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:13.553 INFO:teuthology.orchestra.run.smithi148.stdout:2131 trunc from 0xe883c00 to 0x775a600 2024-09-14T09:08:13.583 INFO:teuthology.orchestra.run.smithi148.stdout:2132 trunc from 0x775a600 to 0x4bfbc00 2024-09-14T09:08:13.607 INFO:teuthology.orchestra.run.smithi148.stdout:2133 punch from 0xa24600 to 0xa30600, (0xc000 bytes) 2024-09-14T09:08:13.607 INFO:teuthology.orchestra.run.smithi148.stdout:2134 write 0x38cd200 thru 0x38dd16e (0xff6f bytes) 2024-09-14T09:08:13.623 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4604.0:364 3.1d e36/22 3:bb0fb96d:::rbd_data.1112609a9334.0000000000000000:head v 36'85, mlcod=35'82)", 2024-09-14T09:08:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:04.683445+0000", 2024-09-14T09:08:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.9414139099999996, 2024-09-14T09:08:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036040981, 2024-09-14T09:08:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.683445+0000", 2024-09-14T09:08:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.683445+0000", 2024-09-14T09:08:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.683447+0000", 2024-09-14T09:08:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7010000000000001e-06 2024-09-14T09:08:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.690176+0000", 2024-09-14T09:08:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0067292979999999999 2024-09-14T09:08:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.690196+0000", 2024-09-14T09:08:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0250000000000001e-05 2024-09-14T09:08:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.690206+0000", 2024-09-14T09:08:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0053e-05 2024-09-14T09:08:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.690280+0000", 2024-09-14T09:08:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3694000000000003e-05 2024-09-14T09:08:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.690305+0000", 2024-09-14T09:08:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5403999999999999e-05 2024-09-14T09:08:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719431+0000", 2024-09-14T09:08:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029125245000000001 2024-09-14T09:08:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719486+0000", 2024-09-14T09:08:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5336e-05 2024-09-14T09:08:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4631.0:2255 3.a 3:55c89d2f:::rbd_object_map.11128e9202c2:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-14T09:08:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:07.913128+0000", 2024-09-14T09:08:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.7117314009999998, 2024-09-14T09:08:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020001346999999999, 2024-09-14T09:08:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4631", 2024-09-14T09:08:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2991362927", 2024-09-14T09:08:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2255 2024-09-14T09:08:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.913128+0000", 2024-09-14T09:08:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.913128+0000", 2024-09-14T09:08:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.913128+0000", 2024-09-14T09:08:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7e-07 2024-09-14T09:08:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.913131+0000", 2024-09-14T09:08:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.565e-06 2024-09-14T09:08:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.913140+0000", 2024-09-14T09:08:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6500000000000008e-06 2024-09-14T09:08:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.913145+0000", 2024-09-14T09:08:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8189999999999999e-06 2024-09-14T09:08:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.926202+0000", 2024-09-14T09:08:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01305663 2024-09-14T09:08:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.926286+0000", 2024-09-14T09:08:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4412000000000004e-05 2024-09-14T09:08:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:08:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.926882+0000", 2024-09-14T09:08:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00059642300000000001 2024-09-14T09:08:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.930398+0000", 2024-09-14T09:08:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0035154380000000001 2024-09-14T09:08:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.933071+0000", 2024-09-14T09:08:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026729610000000002 2024-09-14T09:08:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.933102+0000", 2024-09-14T09:08:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0806999999999998e-05 2024-09-14T09:08:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.933129+0000", 2024-09-14T09:08:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7271999999999999e-05 2024-09-14T09:08:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4631.0:2259 3.a 3:522a9fa7:::rbd_data.11128e9202c2.0000000000000001:head [stat,truncate 131072] snapc d=[d] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-14T09:08:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:07.917118+0000", 2024-09-14T09:08:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.7077408490000003, 2024-09-14T09:08:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022000008000000001, 2024-09-14T09:08:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4631", 2024-09-14T09:08:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2991362927", 2024-09-14T09:08:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2259 2024-09-14T09:08:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.917118+0000", 2024-09-14T09:08:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.917118+0000", 2024-09-14T09:08:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.917119+0000", 2024-09-14T09:08:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0979999999999999e-06 2024-09-14T09:08:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.917124+0000", 2024-09-14T09:08:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5719999999999996e-06 2024-09-14T09:08:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.917137+0000", 2024-09-14T09:08:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2965999999999999e-05 2024-09-14T09:08:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.917146+0000", 2024-09-14T09:08:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8100000000000004e-06 2024-09-14T09:08:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.927305+0000", 2024-09-14T09:08:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010158983 2024-09-14T09:08:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.927373+0000", 2024-09-14T09:08:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8608000000000004e-05 2024-09-14T09:08:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:08:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.927516+0000", 2024-09-14T09:08:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000142466 2024-09-14T09:08:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.934713+0000", 2024-09-14T09:08:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071975190000000003 2024-09-14T09:08:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.938996+0000", 2024-09-14T09:08:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042831099999999997 2024-09-14T09:08:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.939076+0000", 2024-09-14T09:08:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9659000000000004e-05 2024-09-14T09:08:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:07.939118+0000", 2024-09-14T09:08:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2216999999999999e-05 2024-09-14T09:08:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4819.0:1400 3.9 3:97e519e2:::rbd_data.1112f78a064a.0000000000000002:10 [read 229376~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-14T09:08:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:12.863952+0000", 2024-09-14T09:08:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.76090707599999996, 2024-09-14T09:08:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020110959000000001, 2024-09-14T09:08:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4819", 2024-09-14T09:08:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1400 2024-09-14T09:08:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.863952+0000", 2024-09-14T09:08:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.863952+0000", 2024-09-14T09:08:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.863952+0000", 2024-09-14T09:08:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7400000000000003e-07 2024-09-14T09:08:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.863954+0000", 2024-09-14T09:08:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9570000000000001e-06 2024-09-14T09:08:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.863972+0000", 2024-09-14T09:08:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7812000000000002e-05 2024-09-14T09:08:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.863978+0000", 2024-09-14T09:08:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8320000000000002e-06 2024-09-14T09:08:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.883668+0000", 2024-09-14T09:08:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019689439999999999 2024-09-14T09:08:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.883743+0000", 2024-09-14T09:08:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5526999999999997e-05 2024-09-14T09:08:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.884063+0000", 2024-09-14T09:08:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00031981700000000002 2024-09-14T09:08:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4819.0:1401 3.9 3:97e519e2:::rbd_data.1112f78a064a.0000000000000002:10 [read 589824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-14T09:08:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:12.864038+0000", 2024-09-14T09:08:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.76082112400000002, 2024-09-14T09:08:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020458147999999999, 2024-09-14T09:08:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4819", 2024-09-14T09:08:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1401 2024-09-14T09:08:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864038+0000", 2024-09-14T09:08:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864038+0000", 2024-09-14T09:08:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864038+0000", 2024-09-14T09:08:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.82e-07 2024-09-14T09:08:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864041+0000", 2024-09-14T09:08:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.796e-06 2024-09-14T09:08:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864048+0000", 2024-09-14T09:08:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3170000000000004e-06 2024-09-14T09:08:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864054+0000", 2024-09-14T09:08:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4940000000000003e-06 2024-09-14T09:08:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.884107+0000", 2024-09-14T09:08:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020052836000000001 2024-09-14T09:08:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.884188+0000", 2024-09-14T09:08:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0764000000000001e-05 2024-09-14T09:08:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.884496+0000", 2024-09-14T09:08:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030845900000000002 2024-09-14T09:08:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4819.0:1403 3.9 3:954f9c69:::rbd_data.1112f78a064a.0000000000000004:10 [read 491520~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-14T09:08:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:12.864062+0000", 2024-09-14T09:08:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.76079724500000001, 2024-09-14T09:08:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020968935000000001, 2024-09-14T09:08:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4819", 2024-09-14T09:08:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1403 2024-09-14T09:08:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864062+0000", 2024-09-14T09:08:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864062+0000", 2024-09-14T09:08:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864062+0000", 2024-09-14T09:08:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:08:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864064+0000", 2024-09-14T09:08:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.114e-06 2024-09-14T09:08:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864072+0000", 2024-09-14T09:08:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5769999999999996e-06 2024-09-14T09:08:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864077+0000", 2024-09-14T09:08:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.865e-06 2024-09-14T09:08:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.884601+0000", 2024-09-14T09:08:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020524754999999999 2024-09-14T09:08:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.884679+0000", 2024-09-14T09:08:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7602999999999995e-05 2024-09-14T09:08:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.885031+0000", 2024-09-14T09:08:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035159500000000001 2024-09-14T09:08:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4819.0:1415 3.9 3:97e519e2:::rbd_data.1112f78a064a.0000000000000002:10 [read 0~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-14T09:08:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:12.864087+0000", 2024-09-14T09:08:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.76077150800000004, 2024-09-14T09:08:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021182100999999998, 2024-09-14T09:08:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4819", 2024-09-14T09:08:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1415 2024-09-14T09:08:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864087+0000", 2024-09-14T09:08:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864087+0000", 2024-09-14T09:08:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864088+0000", 2024-09-14T09:08:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000003e-07 2024-09-14T09:08:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864090+0000", 2024-09-14T09:08:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4279999999999999e-06 2024-09-14T09:08:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864097+0000", 2024-09-14T09:08:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7710000000000001e-06 2024-09-14T09:08:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864102+0000", 2024-09-14T09:08:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2299999999999999e-06 2024-09-14T09:08:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.885078+0000", 2024-09-14T09:08:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020975639000000001 2024-09-14T09:08:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.885162+0000", 2024-09-14T09:08:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3912999999999994e-05 2024-09-14T09:08:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.885270+0000", 2024-09-14T09:08:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000107608 2024-09-14T09:08:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4819.0:1416 3.9 3:97e519e2:::rbd_data.1112f78a064a.0000000000000002:10 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-14T09:08:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:12.864137+0000", 2024-09-14T09:08:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.76072225699999996, 2024-09-14T09:08:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.023920935000000001, 2024-09-14T09:08:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4819", 2024-09-14T09:08:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1416 2024-09-14T09:08:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864137+0000", 2024-09-14T09:08:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864137+0000", 2024-09-14T09:08:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864137+0000", 2024-09-14T09:08:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1399999999999997e-07 2024-09-14T09:08:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864140+0000", 2024-09-14T09:08:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.824e-06 2024-09-14T09:08:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864148+0000", 2024-09-14T09:08:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7440000000000007e-06 2024-09-14T09:08:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864153+0000", 2024-09-14T09:08:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5049999999999998e-06 2024-09-14T09:08:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.885300+0000", 2024-09-14T09:08:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021146193000000001 2024-09-14T09:08:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.885375+0000", 2024-09-14T09:08:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5020999999999999e-05 2024-09-14T09:08:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.888058+0000", 2024-09-14T09:08:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026831340000000002 2024-09-14T09:08:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4819.0:1418 3.9 3:954f9c69:::rbd_data.1112f78a064a.0000000000000004:10 [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-14T09:08:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:12.864160+0000", 2024-09-14T09:08:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.76069890600000001, 2024-09-14T09:08:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.024355244000000002, 2024-09-14T09:08:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4819", 2024-09-14T09:08:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1418 2024-09-14T09:08:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864160+0000", 2024-09-14T09:08:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864160+0000", 2024-09-14T09:08:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864161+0000", 2024-09-14T09:08:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6599999999999996e-07 2024-09-14T09:08:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864163+0000", 2024-09-14T09:08:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9410000000000001e-06 2024-09-14T09:08:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864169+0000", 2024-09-14T09:08:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6549999999999998e-06 2024-09-14T09:08:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864176+0000", 2024-09-14T09:08:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.635e-06 2024-09-14T09:08:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.888101+0000", 2024-09-14T09:08:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.023925160000000001 2024-09-14T09:08:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.888191+0000", 2024-09-14T09:08:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0230999999999997e-05 2024-09-14T09:08:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.888515+0000", 2024-09-14T09:08:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032405599999999998 2024-09-14T09:08:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4819.0:1431 3.9 3:97e519e2:::rbd_data.1112f78a064a.0000000000000002:10 [read 32768~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-14T09:08:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:12.864182+0000", 2024-09-14T09:08:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.76067660699999995, 2024-09-14T09:08:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.024514113000000001, 2024-09-14T09:08:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4819", 2024-09-14T09:08:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1431 2024-09-14T09:08:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864182+0000", 2024-09-14T09:08:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864182+0000", 2024-09-14T09:08:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864183+0000", 2024-09-14T09:08:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5199999999999998e-07 2024-09-14T09:08:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864185+0000", 2024-09-14T09:08:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9599999999999999e-06 2024-09-14T09:08:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864191+0000", 2024-09-14T09:08:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5370000000000003e-06 2024-09-14T09:08:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864196+0000", 2024-09-14T09:08:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8169999999999998e-06 2024-09-14T09:08:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.888557+0000", 2024-09-14T09:08:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.024361146 2024-09-14T09:08:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.888630+0000", 2024-09-14T09:08:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3200000000000004e-05 2024-09-14T09:08:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.888696+0000", 2024-09-14T09:08:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6100999999999996e-05 2024-09-14T09:08:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4819.0:1432 3.9 3:97e519e2:::rbd_data.1112f78a064a.0000000000000002:10 [read 393216~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-14T09:08:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:12.864202+0000", 2024-09-14T09:08:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.76065658999999997, 2024-09-14T09:08:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.026720441000000001, 2024-09-14T09:08:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4819", 2024-09-14T09:08:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1432 2024-09-14T09:08:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864202+0000", 2024-09-14T09:08:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864202+0000", 2024-09-14T09:08:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864203+0000", 2024-09-14T09:08:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7999999999999996e-07 2024-09-14T09:08:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864205+0000", 2024-09-14T09:08:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0449999999999999e-06 2024-09-14T09:08:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864211+0000", 2024-09-14T09:08:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3369999999999996e-06 2024-09-14T09:08:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864216+0000", 2024-09-14T09:08:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.023e-06 2024-09-14T09:08:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.888733+0000", 2024-09-14T09:08:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.024517211000000001 2024-09-14T09:08:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.888822+0000", 2024-09-14T09:08:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8869000000000006e-05 2024-09-14T09:08:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.890923+0000", 2024-09-14T09:08:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002100476 2024-09-14T09:08:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4819.0:1435 3.9 3:954f9c69:::rbd_data.1112f78a064a.0000000000000004:10 [read 294912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-14T09:08:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:12.864223+0000", 2024-09-14T09:08:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.76063581000000002, 2024-09-14T09:08:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027152318000000002, 2024-09-14T09:08:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4819", 2024-09-14T09:08:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1435 2024-09-14T09:08:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864223+0000", 2024-09-14T09:08:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864223+0000", 2024-09-14T09:08:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864224+0000", 2024-09-14T09:08:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8299999999999997e-07 2024-09-14T09:08:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864226+0000", 2024-09-14T09:08:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9829999999999999e-06 2024-09-14T09:08:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864232+0000", 2024-09-14T09:08:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5100000000000004e-06 2024-09-14T09:08:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864237+0000", 2024-09-14T09:08:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8439999999999997e-06 2024-09-14T09:08:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.890971+0000", 2024-09-14T09:08:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.026734026000000001 2024-09-14T09:08:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.891069+0000", 2024-09-14T09:08:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8206000000000001e-05 2024-09-14T09:08:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.891375+0000", 2024-09-14T09:08:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030626600000000003 2024-09-14T09:08:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4819.0:1448 3.9 3:97e519e2:::rbd_data.1112f78a064a.0000000000000002:10 [read 65536~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-14T09:08:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:12.864243+0000", 2024-09-14T09:08:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.76061587100000005, 2024-09-14T09:08:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027281696000000001, 2024-09-14T09:08:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4819", 2024-09-14T09:08:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1448 2024-09-14T09:08:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864243+0000", 2024-09-14T09:08:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864243+0000", 2024-09-14T09:08:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864244+0000", 2024-09-14T09:08:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3300000000000003e-07 2024-09-14T09:08:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864245+0000", 2024-09-14T09:08:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.84e-06 2024-09-14T09:08:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864252+0000", 2024-09-14T09:08:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5860000000000001e-06 2024-09-14T09:08:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864257+0000", 2024-09-14T09:08:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4199999999999998e-06 2024-09-14T09:08:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.891407+0000", 2024-09-14T09:08:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027149196 2024-09-14T09:08:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.891458+0000", 2024-09-14T09:08:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1452999999999997e-05 2024-09-14T09:08:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.891525+0000", 2024-09-14T09:08:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6767999999999995e-05 2024-09-14T09:08:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4819.0:1449 3.9 3:97e519e2:::rbd_data.1112f78a064a.0000000000000002:10 [read 425984~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-14T09:08:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:12.864264+0000", 2024-09-14T09:08:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.76059494100000002, 2024-09-14T09:08:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027721437000000002, 2024-09-14T09:08:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4819", 2024-09-14T09:08:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1449 2024-09-14T09:08:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864264+0000", 2024-09-14T09:08:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864264+0000", 2024-09-14T09:08:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864264+0000", 2024-09-14T09:08:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2399999999999999e-07 2024-09-14T09:08:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864266+0000", 2024-09-14T09:08:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9400000000000001e-06 2024-09-14T09:08:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864273+0000", 2024-09-14T09:08:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4509999999999997e-06 2024-09-14T09:08:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864278+0000", 2024-09-14T09:08:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9840000000000001e-06 2024-09-14T09:08:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.891570+0000", 2024-09-14T09:08:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027292594 2024-09-14T09:08:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.891662+0000", 2024-09-14T09:08:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1848000000000006e-05 2024-09-14T09:08:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.891985+0000", 2024-09-14T09:08:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032319599999999999 2024-09-14T09:08:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4819.0:1452 3.9 3:954f9c69:::rbd_data.1112f78a064a.0000000000000004:10 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-14T09:08:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:12.864284+0000", 2024-09-14T09:08:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.76057506900000005, 2024-09-14T09:08:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.028119344000000001, 2024-09-14T09:08:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4819", 2024-09-14T09:08:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1452 2024-09-14T09:08:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864284+0000", 2024-09-14T09:08:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864284+0000", 2024-09-14T09:08:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864284+0000", 2024-09-14T09:08:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0200000000000002e-07 2024-09-14T09:08:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864286+0000", 2024-09-14T09:08:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9099999999999999e-06 2024-09-14T09:08:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864293+0000", 2024-09-14T09:08:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2260000000000002e-06 2024-09-14T09:08:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864298+0000", 2024-09-14T09:08:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9459999999999997e-06 2024-09-14T09:08:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.892019+0000", 2024-09-14T09:08:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027721114000000002 2024-09-14T09:08:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.892067+0000", 2024-09-14T09:08:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8408000000000001e-05 2024-09-14T09:08:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.892403+0000", 2024-09-14T09:08:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00033623799999999999 2024-09-14T09:08:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4819.0:1464 3.9 3:97e519e2:::rbd_data.1112f78a064a.0000000000000002:10 [read 98304~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-14T09:08:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:12.864303+0000", 2024-09-14T09:08:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.76055557600000001, 2024-09-14T09:08:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.028322612, 2024-09-14T09:08:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4819", 2024-09-14T09:08:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1464 2024-09-14T09:08:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864303+0000", 2024-09-14T09:08:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864303+0000", 2024-09-14T09:08:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864304+0000", 2024-09-14T09:08:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.01e-07 2024-09-14T09:08:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864306+0000", 2024-09-14T09:08:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8390000000000001e-06 2024-09-14T09:08:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864312+0000", 2024-09-14T09:08:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9059999999999999e-06 2024-09-14T09:08:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864316+0000", 2024-09-14T09:08:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9420000000000003e-06 2024-09-14T09:08:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.892436+0000", 2024-09-14T09:08:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.028119137999999998 2024-09-14T09:08:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.892520+0000", 2024-09-14T09:08:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4328999999999998e-05 2024-09-14T09:08:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.892626+0000", 2024-09-14T09:08:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106057 2024-09-14T09:08:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4819.0:1465 3.9 3:97e519e2:::rbd_data.1112f78a064a.0000000000000002:10 [read 458752~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-14T09:08:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:12.864322+0000", 2024-09-14T09:08:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.76053654800000003, 2024-09-14T09:08:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.028737904000000002, 2024-09-14T09:08:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4819", 2024-09-14T09:08:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1465 2024-09-14T09:08:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864322+0000", 2024-09-14T09:08:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864322+0000", 2024-09-14T09:08:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864323+0000", 2024-09-14T09:08:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6800000000000001e-07 2024-09-14T09:08:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864348+0000", 2024-09-14T09:08:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5452999999999998e-05 2024-09-14T09:08:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864356+0000", 2024-09-14T09:08:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1489999999999994e-06 2024-09-14T09:08:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864362+0000", 2024-09-14T09:08:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8869999999999997e-06 2024-09-14T09:08:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.892666+0000", 2024-09-14T09:08:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.028303500999999998 2024-09-14T09:08:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.892746+0000", 2024-09-14T09:08:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9855e-05 2024-09-14T09:08:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.893060+0000", 2024-09-14T09:08:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00031469100000000003 2024-09-14T09:08:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4819.0:1468 3.9 3:954f9c69:::rbd_data.1112f78a064a.0000000000000004:10 [read 360448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-14T09:08:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:12.864372+0000", 2024-09-14T09:08:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.76048741799999997, 2024-09-14T09:08:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029139660000000001, 2024-09-14T09:08:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4819", 2024-09-14T09:08:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1468 2024-09-14T09:08:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864372+0000", 2024-09-14T09:08:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864372+0000", 2024-09-14T09:08:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864372+0000", 2024-09-14T09:08:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6199999999999998e-07 2024-09-14T09:08:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864382+0000", 2024-09-14T09:08:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9089999999999995e-06 2024-09-14T09:08:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864390+0000", 2024-09-14T09:08:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0050000000000004e-06 2024-09-14T09:08:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864395+0000", 2024-09-14T09:08:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0220000000000004e-06 2024-09-14T09:08:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.893102+0000", 2024-09-14T09:08:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.028706532999999999 2024-09-14T09:08:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.893182+0000", 2024-09-14T09:08:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0889000000000004e-05 2024-09-14T09:08:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.893511+0000", 2024-09-14T09:08:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032874 2024-09-14T09:08:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4819.0:1480 3.9 3:97e519e2:::rbd_data.1112f78a064a.0000000000000002:10 [read 491520~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-14T09:08:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:12.864403+0000", 2024-09-14T09:08:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.76045556800000003, 2024-09-14T09:08:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029547415, 2024-09-14T09:08:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4819", 2024-09-14T09:08:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1480 2024-09-14T09:08:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864403+0000", 2024-09-14T09:08:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864403+0000", 2024-09-14T09:08:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864404+0000", 2024-09-14T09:08:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5400000000000001e-07 2024-09-14T09:08:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864406+0000", 2024-09-14T09:08:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2029999999999999e-06 2024-09-14T09:08:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864412+0000", 2024-09-14T09:08:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2689999999999996e-06 2024-09-14T09:08:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864417+0000", 2024-09-14T09:08:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.904e-06 2024-09-14T09:08:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.893555+0000", 2024-09-14T09:08:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029137196000000001 2024-09-14T09:08:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.893636+0000", 2024-09-14T09:08:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1143000000000006e-05 2024-09-14T09:08:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.893951+0000", 2024-09-14T09:08:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00031514599999999998 2024-09-14T09:08:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4819.0:1483 3.9 3:954f9c69:::rbd_data.1112f78a064a.0000000000000004:10 [read 131072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-14T09:08:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:12.864424+0000", 2024-09-14T09:08:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.76043489200000003, 2024-09-14T09:08:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032090004999999998, 2024-09-14T09:08:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4819", 2024-09-14T09:08:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1483 2024-09-14T09:08:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864424+0000", 2024-09-14T09:08:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864424+0000", 2024-09-14T09:08:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864425+0000", 2024-09-14T09:08:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.89e-07 2024-09-14T09:08:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864427+0000", 2024-09-14T09:08:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0590000000000001e-06 2024-09-14T09:08:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864433+0000", 2024-09-14T09:08:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2469999999999997e-06 2024-09-14T09:08:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.864438+0000", 2024-09-14T09:08:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7049999999999998e-06 2024-09-14T09:08:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.893978+0000", 2024-09-14T09:08:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029540317999999999 2024-09-14T09:08:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.894024+0000", 2024-09-14T09:08:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5884000000000003e-05 2024-09-14T09:08:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.896514+0000", 2024-09-14T09:08:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024903030000000001 2024-09-14T09:08:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:13.720 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:13.722 INFO:teuthology.orchestra.run.smithi148.stdout:2135 write 0x81ffc00 thru 0x820069f (0xaa0 bytes) 2024-09-14T09:08:13.722 INFO:teuthology.orchestra.run.smithi148.stdout:2136 write 0xd3a9200 thru 0xd3aa49c (0x129d bytes) 2024-09-14T09:08:13.722 INFO:teuthology.orchestra.run.smithi148.stdout:2138 write 0x10a6400 thru 0x10a685b (0x45c bytes) 2024-09-14T09:08:13.722 INFO:teuthology.orchestra.run.smithi148.stdout:2139 trunc from 0xd3aa600 to 0x7dfc00 2024-09-14T09:08:13.722 INFO:teuthology.orchestra.run.smithi148.stdout:2142 punch from 0x62a000 to 0x632600, (0x8600 bytes) 2024-09-14T09:08:13.722 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:08:13.723 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:13.722+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:13.741 INFO:teuthology.orchestra.run.smithi148.stdout:2143 write 0xb731000 thru 0xb735d32 (0x4d33 bytes) 2024-09-14T09:08:13.742 INFO:teuthology.orchestra.run.smithi148.stdout:2145 read 0x65b5400 thru 0x65c3363 (0xdf64 bytes) 2024-09-14T09:08:13.742 INFO:teuthology.orchestra.run.smithi148.stdout:2146 read 0x293b400 thru 0x293ef6d (0x3b6e bytes) 2024-09-14T09:08:13.742 INFO:teuthology.orchestra.run.smithi148.stdout:2148 write 0x8b600 thru 0x9a6c7 (0xf0c8 bytes) 2024-09-14T09:08:13.743 INFO:teuthology.orchestra.run.smithi148.stdout:2150 punch from 0x4c35800 to 0x4c3e400, (0x8c00 bytes) 2024-09-14T09:08:13.744 INFO:teuthology.orchestra.run.smithi148.stdout:2151 read 0x7d88c00 thru 0x7d91fee (0x93ef bytes) 2024-09-14T09:08:13.745 INFO:teuthology.orchestra.run.smithi148.stdout:2152 punch from 0x370a00 to 0x378400, (0x7a00 bytes) 2024-09-14T09:08:13.745 INFO:teuthology.orchestra.run.smithi148.stdout:2153 read 0x9017c00 thru 0x901e943 (0x6d44 bytes) 2024-09-14T09:08:13.745 INFO:teuthology.orchestra.run.smithi148.stdout:2154 write 0x78fe200 thru 0x790cc07 (0xea08 bytes) 2024-09-14T09:08:13.745 INFO:teuthology.orchestra.run.smithi148.stdout:2155 write 0xaa2dc00 thru 0xaa3b15b (0xd55c bytes) 2024-09-14T09:08:13.745 INFO:teuthology.orchestra.run.smithi148.stdout:2158 read 0x4f27a00 thru 0x4f32b4d (0xb14e bytes) 2024-09-14T09:08:13.768 INFO:teuthology.orchestra.run.smithi148.stdout:2159 write 0xc468e00 thru 0xc46e606 (0x5807 bytes) 2024-09-14T09:08:13.775 INFO:teuthology.orchestra.run.smithi148.stdout:2160 trunc from 0xc46e800 to 0x64b0600 2024-09-14T09:08:13.801 INFO:teuthology.orchestra.run.smithi148.stdout:2164 trunc from 0x64b0600 to 0xceb0e00 2024-09-14T09:08:13.810 INFO:teuthology.orchestra.run.smithi148.stdout:2165 write 0x2036000 thru 0x203c6ec (0x66ed bytes) 2024-09-14T09:08:13.822 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:13.823+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:13.830 INFO:teuthology.orchestra.run.smithi148.stdout:2166 trunc from 0xceb0e00 to 0x1ed6800 2024-09-14T09:08:13.849 INFO:teuthology.orchestra.run.smithi148.stdout:2167 punch from 0x102000 to 0x110e00, (0xee00 bytes) 2024-09-14T09:08:13.852 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is unset 2024-09-14T09:08:13.876 INFO:teuthology.orchestra.run.smithi148.stdout:2168 write 0x768d200 thru 0x76937e7 (0x65e8 bytes) 2024-09-14T09:08:13.879 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:13.880 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:13.880 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:08:13.880 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:13.888 INFO:teuthology.orchestra.run.smithi148.stdout:2169 trunc from 0x7693800 to 0x3633800 2024-09-14T09:08:13.889 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:08:13.919 INFO:teuthology.orchestra.run.smithi148.stdout:2170 trunc from 0x3633800 to 0xd479e00 2024-09-14T09:08:13.922 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:13.923+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:13.930 INFO:teuthology.orchestra.run.smithi148.stdout:2172 trunc from 0xd479e00 to 0xb5f7a00 2024-09-14T09:08:13.945 INFO:teuthology.orchestra.run.smithi148.stdout:2173 read 0x665ae00 thru 0x66621d6 (0x73d7 bytes) 2024-09-14T09:08:13.963 INFO:teuthology.orchestra.run.smithi148.stdout:2174 write 0xd94e200 thru 0xd94f860 (0x1661 bytes) 2024-09-14T09:08:13.965 INFO:teuthology.orchestra.run.smithi148.stdout:2175 trunc from 0xd94fa00 to 0xe999600 2024-09-14T09:08:13.978 INFO:teuthology.orchestra.run.smithi148.stdout:2177 write 0x35de000 thru 0x35de2ce (0x2cf bytes) 2024-09-14T09:08:13.979 INFO:teuthology.orchestra.run.smithi148.stdout:2178 read 0xba54e00 thru 0xba57e4b (0x304c bytes) 2024-09-14T09:08:13.979 INFO:teuthology.orchestra.run.smithi148.stdout:2179 read 0x52d3c00 thru 0x52d8483 (0x4884 bytes) 2024-09-14T09:08:13.980 INFO:teuthology.orchestra.run.smithi148.stdout:2180 read 0x36a0200 thru 0x36aabab (0xa9ac bytes) 2024-09-14T09:08:13.980 INFO:teuthology.orchestra.run.smithi148.stdout:2182 read 0xc56b200 thru 0xc5768f7 (0xb6f8 bytes) 2024-09-14T09:08:13.980 INFO:teuthology.orchestra.run.smithi148.stdout:2188 punch from 0x7631000 to 0x7638600, (0x7600 bytes) 2024-09-14T09:08:13.981 INFO:teuthology.orchestra.run.smithi148.stdout:2189 read 0xd99f600 thru 0xd9a6f7e (0x797f bytes) 2024-09-14T09:08:13.981 INFO:teuthology.orchestra.run.smithi148.stdout:2190 punch from 0x5822000 to 0x5823800, (0x1800 bytes) 2024-09-14T09:08:13.981 INFO:teuthology.orchestra.run.smithi148.stdout:2191 punch from 0x2431600 to 0x243da00, (0xc400 bytes) 2024-09-14T09:08:13.981 INFO:teuthology.orchestra.run.smithi148.stdout:2194 read 0x2b6f400 thru 0x2b72b98 (0x3799 bytes) 2024-09-14T09:08:13.981 INFO:teuthology.orchestra.run.smithi148.stdout:2196 punch from 0x55f5400 to 0x55f9c00, (0x4800 bytes) 2024-09-14T09:08:13.981 INFO:teuthology.orchestra.run.smithi148.stdout:2198 read 0x81d5a00 thru 0x81e5512 (0xfb13 bytes) 2024-09-14T09:08:13.981 INFO:teuthology.orchestra.run.smithi148.stdout:2205 punch from 0xd14a00 to 0xd21e00, (0xd400 bytes) 2024-09-14T09:08:14.003 INFO:teuthology.orchestra.run.smithi148.stdout:2206 write 0xee35800 thru 0xee3b3e7 (0x5be8 bytes) 2024-09-14T09:08:14.004 INFO:teuthology.orchestra.run.smithi148.stdout:2208 read 0xc2afa00 thru 0xc2b8272 (0x8873 bytes) 2024-09-14T09:08:14.004 INFO:teuthology.orchestra.run.smithi148.stdout:2211 punch from 0x8e35800 to 0x8e36200, (0xa00 bytes) 2024-09-14T09:08:14.006 INFO:teuthology.orchestra.run.smithi148.stdout:2216 trunc from 0xee3b400 to 0xde52800 2024-09-14T09:08:14.023 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:14.025+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:14.024 INFO:teuthology.orchestra.run.smithi148.stdout:2218 read 0x480600 thru 0x485983 (0x5384 bytes) 2024-09-14T09:08:14.030 INFO:teuthology.orchestra.run.smithi148.stdout:2220 write 0xac4d800 thru 0xac56c82 (0x9483 bytes) 2024-09-14T09:08:14.030 INFO:teuthology.orchestra.run.smithi148.stdout:2222 read 0x18e2a00 thru 0x18e2f2b (0x52c bytes) 2024-09-14T09:08:14.031 INFO:teuthology.orchestra.run.smithi148.stdout:2226 write 0x9799e00 thru 0x979d3fe (0x35ff bytes) 2024-09-14T09:08:14.031 INFO:teuthology.orchestra.run.smithi148.stdout:2228 write 0xc569c00 thru 0xc56ff05 (0x6306 bytes) 2024-09-14T09:08:14.031 INFO:teuthology.orchestra.run.smithi148.stdout:2230 punch from 0x79ff800 to 0x7a0e200, (0xea00 bytes) 2024-09-14T09:08:14.043 INFO:teuthology.orchestra.run.smithi148.stdout:2233 trunc from 0xde52800 to 0x3a5e200 2024-09-14T09:08:14.056 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:14.056 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:14.056 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:14.056 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:14.056 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:14.066 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:08:14.082 INFO:teuthology.orchestra.run.smithi148.stdout:2236 write 0xac12200 thru 0xac1b09e (0x8e9f bytes) 2024-09-14T09:08:14.082 INFO:teuthology.orchestra.run.smithi148.stdout:2237 write 0x1801a00 thru 0x180a719 (0x8d1a bytes) 2024-09-14T09:08:14.101 INFO:teuthology.orchestra.run.smithi148.stdout:2244 write 0xae2f200 thru 0xae3bd7e (0xcb7f bytes) 2024-09-14T09:08:14.107 INFO:teuthology.orchestra.run.smithi148.stdout:2245 read 0x1efe400 thru 0x1f02d94 (0x4995 bytes) 2024-09-14T09:08:14.107 INFO:teuthology.orchestra.run.smithi148.stdout:2246 punch from 0x24ad800 to 0x24bbe00, (0xe600 bytes) 2024-09-14T09:08:14.109 INFO:teuthology.orchestra.run.smithi148.stdout:2248 write 0x93a9200 thru 0x93b7851 (0xe652 bytes) 2024-09-14T09:08:14.109 INFO:teuthology.orchestra.run.smithi148.stdout:2249 write 0x4686e00 thru 0x468e10a (0x730b bytes) 2024-09-14T09:08:14.109 INFO:teuthology.orchestra.run.smithi148.stdout:2251 write 0x2c66e00 thru 0x2c6874b (0x194c bytes) 2024-09-14T09:08:14.109 INFO:teuthology.orchestra.run.smithi148.stdout:2252 write 0x2d09c00 thru 0x2d0aecf (0x12d0 bytes) 2024-09-14T09:08:14.109 INFO:teuthology.orchestra.run.smithi148.stdout:2253 read 0x95b8600 thru 0x95bf6e2 (0x70e3 bytes) 2024-09-14T09:08:14.109 INFO:teuthology.orchestra.run.smithi148.stdout:2255 write 0x890f000 thru 0x890f819 (0x81a bytes) 2024-09-14T09:08:14.109 INFO:teuthology.orchestra.run.smithi148.stdout:2257 read 0x9036600 thru 0x9040b0c (0xa50d bytes) 2024-09-14T09:08:14.110 INFO:teuthology.orchestra.run.smithi148.stdout:2259 trunc from 0xae3be00 to 0xa28d000 2024-09-14T09:08:14.123 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:14.124+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:14.172 INFO:teuthology.orchestra.run.smithi148.stdout:2260 write 0xe488400 thru 0xe493cdf (0xb8e0 bytes) 2024-09-14T09:08:14.173 INFO:teuthology.orchestra.run.smithi148.stdout:2261 read 0x5561400 thru 0x5570b7f (0xf780 bytes) 2024-09-14T09:08:14.173 INFO:teuthology.orchestra.run.smithi148.stdout:2262 write 0x861c600 thru 0x86229e6 (0x63e7 bytes) 2024-09-14T09:08:14.173 INFO:teuthology.orchestra.run.smithi148.stdout:2263 punch from 0x289c400 to 0x28a1200, (0x4e00 bytes) 2024-09-14T09:08:14.174 INFO:teuthology.orchestra.run.smithi148.stdout:2264 write 0xcc50200 thru 0xcc540e5 (0x3ee6 bytes) 2024-09-14T09:08:14.174 INFO:teuthology.orchestra.run.smithi148.stdout:2266 read 0x66dbc00 thru 0x66e76a3 (0xbaa4 bytes) 2024-09-14T09:08:14.174 INFO:teuthology.orchestra.run.smithi148.stdout:2269 punch from 0xb710000 to 0xb71fe00, (0xfe00 bytes) 2024-09-14T09:08:14.177 INFO:teuthology.orchestra.run.smithi148.stdout:2270 trunc from 0xe493e00 to 0xc375c00 2024-09-14T09:08:14.203 INFO:teuthology.orchestra.run.smithi148.stdout:2272 write 0x20d6800 thru 0x20d6a85 (0x286 bytes) 2024-09-14T09:08:14.204 INFO:teuthology.orchestra.run.smithi148.stdout:2274 read 0xa548400 thru 0xa548fe4 (0xbe5 bytes) 2024-09-14T09:08:14.204 INFO:teuthology.orchestra.run.smithi148.stdout:2276 punch from 0xb592c00 to 0xb59b800, (0x8c00 bytes) 2024-09-14T09:08:14.208 INFO:teuthology.orchestra.run.smithi148.stdout:2277 punch from 0x77a2600 to 0x77a5c00, (0x3600 bytes) 2024-09-14T09:08:14.208 INFO:teuthology.orchestra.run.smithi148.stdout:2279 punch from 0x9299c00 to 0x929c400, (0x2800 bytes) 2024-09-14T09:08:14.208 INFO:teuthology.orchestra.run.smithi148.stdout:2282 read 0x7fc9000 thru 0x7fcded2 (0x4ed3 bytes) 2024-09-14T09:08:14.208 INFO:teuthology.orchestra.run.smithi148.stdout:2283 read 0xbd0d000 thru 0xbd18cf7 (0xbcf8 bytes) 2024-09-14T09:08:14.221 INFO:teuthology.orchestra.run.smithi148.stdout:2285 write 0xce36c00 thru 0xce3c67f (0x5a80 bytes) 2024-09-14T09:08:14.223 INFO:teuthology.orchestra.run.smithi148.stdout:2287 write 0x5f77e00 thru 0x5f87534 (0xf735 bytes) 2024-09-14T09:08:14.223 INFO:teuthology.orchestra.run.smithi148.stdout:2288 read 0xc859000 thru 0xc860e3d (0x7e3e bytes) 2024-09-14T09:08:14.224 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:14.225+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:2293 read 0x6d59800 thru 0x6d666ff (0xcf00 bytes) 2024-09-14T09:08:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:2294 write 0x8804e00 thru 0x88123c6 (0xd5c7 bytes) 2024-09-14T09:08:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:2295 read 0x7ab1c00 thru 0x7ab2c66 (0x1067 bytes) 2024-09-14T09:08:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:2296 write 0xc5d3400 thru 0xc5e16bc (0xe2bd bytes) 2024-09-14T09:08:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:2297 write 0x5d1d600 thru 0x5d2c190 (0xeb91 bytes) 2024-09-14T09:08:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:2299 read 0x3022800 thru 0x302e081 (0xb882 bytes) 2024-09-14T09:08:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:2300 punch from 0x3b56c00 to 0x3b5e400, (0x7800 bytes) 2024-09-14T09:08:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:2301 write 0xbc27000 thru 0xbc3666c (0xf66d bytes) 2024-09-14T09:08:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:2302 read 0x6334800 thru 0x633b0fe (0x68ff bytes) 2024-09-14T09:08:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:2303 punch from 0x385400 to 0x394000, (0xec00 bytes) 2024-09-14T09:08:14.228 INFO:teuthology.orchestra.run.smithi148.stdout:2304 read 0x671c600 thru 0x672a33a (0xdd3b bytes) 2024-09-14T09:08:14.235 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:14.235 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:14.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:14.235 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:14.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.236 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:08:14.236 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:14.236 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.003228344, 2024-09-14T09:08:14.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72111598600000004, 2024-09-14T09:08:14.236 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:14.236 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:14.236 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:14.236 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:14.236 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:08:14.236 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:08:14.236 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1 2024-09-14T09:08:14.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.236 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:14.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:14.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:14.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:14.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:14.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:14.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233065+0000", 2024-09-14T09:08:14.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1909999999999999e-06 2024-09-14T09:08:14.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.238 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:14.238 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233071+0000", 2024-09-14T09:08:14.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5300000000000002e-06 2024-09-14T09:08:14.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.238 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:14.238 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233081+0000", 2024-09-14T09:08:14.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0339e-05 2024-09-14T09:08:14.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.238 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:14.239 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233093+0000", 2024-09-14T09:08:14.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1252e-05 2024-09-14T09:08:14.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:14.239 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233162+0000", 2024-09-14T09:08:14.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9678999999999995e-05 2024-09-14T09:08:14.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:08:14.239 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233171+0000", 2024-09-14T09:08:14.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.132e-06 2024-09-14T09:08:14.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:14.239 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952480+0000", 2024-09-14T09:08:14.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.71930839899999999 2024-09-14T09:08:14.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.240 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:14.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952655+0000", 2024-09-14T09:08:14.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017552 2024-09-14T09:08:14.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.240 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:14.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952835+0000", 2024-09-14T09:08:14.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001797 2024-09-14T09:08:14.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.240 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:14.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.953648+0000", 2024-09-14T09:08:14.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00081291700000000002 2024-09-14T09:08:14.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:14.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954108+0000", 2024-09-14T09:08:14.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045992800000000002 2024-09-14T09:08:14.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:14.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954149+0000", 2024-09-14T09:08:14.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1214999999999998e-05 2024-09-14T09:08:14.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.242 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:14.242 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954178+0000", 2024-09-14T09:08:14.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9184e-05 2024-09-14T09:08:14.242 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.242 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:14.242 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.242 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.242 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1493 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1196032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:14.242 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:14.242 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.327529154, 2024-09-14T09:08:14.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012302112, 2024-09-14T09:08:14.242 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:14.243 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:14.243 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:14.243 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:14.243 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:14.243 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:14.243 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1493 2024-09-14T09:08:14.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.243 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:14.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:14.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:14.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:14.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:14.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:14.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:14.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.65e-07 2024-09-14T09:08:14.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:14.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908764+0000", 2024-09-14T09:08:14.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8589999999999999e-06 2024-09-14T09:08:14.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:14.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908770+0000", 2024-09-14T09:08:14.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.728e-06 2024-09-14T09:08:14.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:14.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908774+0000", 2024-09-14T09:08:14.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7609999999999998e-06 2024-09-14T09:08:14.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:14.246 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.920899+0000", 2024-09-14T09:08:14.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012125004999999999 2024-09-14T09:08:14.246 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.246 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.246 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:14.246 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.920977+0000", 2024-09-14T09:08:14.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7564000000000005e-05 2024-09-14T09:08:14.246 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.246 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.246 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:14.246 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.921064+0000", 2024-09-14T09:08:14.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6829999999999994e-05 2024-09-14T09:08:14.246 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.247 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:14.247 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.247 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.247 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.247 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1510 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 983040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:14.247 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:14.247 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.326544964, 2024-09-14T09:08:14.247 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012360968999999999, 2024-09-14T09:08:14.247 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:14.247 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:14.247 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:14.247 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:14.247 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:14.247 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:14.248 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1510 2024-09-14T09:08:14.248 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.248 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:14.248 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.248 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:14.248 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:14.248 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.248 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.248 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.248 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:14.248 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:14.248 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.248 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.248 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.249 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:14.249 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:14.249 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8799999999999998e-07 2024-09-14T09:08:14.249 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.249 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.249 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:14.249 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909748+0000", 2024-09-14T09:08:14.249 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9810000000000002e-06 2024-09-14T09:08:14.249 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.249 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.249 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:14.249 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909754+0000", 2024-09-14T09:08:14.249 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3609999999999997e-06 2024-09-14T09:08:14.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.250 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:14.250 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909760+0000", 2024-09-14T09:08:14.250 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1850000000000003e-06 2024-09-14T09:08:14.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.250 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:14.250 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.921974+0000", 2024-09-14T09:08:14.250 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012214426 2024-09-14T09:08:14.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.250 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:14.250 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922015+0000", 2024-09-14T09:08:14.250 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0407000000000001e-05 2024-09-14T09:08:14.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:14.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922107+0000", 2024-09-14T09:08:14.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2220999999999997e-05 2024-09-14T09:08:14.251 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.251 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:14.251 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.251 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1511 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1212416~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:14.251 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.909766+0000", 2024-09-14T09:08:14.251 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.326524557000001, 2024-09-14T09:08:14.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012473141, 2024-09-14T09:08:14.252 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:14.252 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:14.252 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:14.252 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:14.252 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:14.252 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:14.252 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1511 2024-09-14T09:08:14.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.252 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:14.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:14.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909766+0000", 2024-09-14T09:08:14.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:14.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909766+0000", 2024-09-14T09:08:14.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:14.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909767+0000", 2024-09-14T09:08:14.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-07 2024-09-14T09:08:14.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:14.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909768+0000", 2024-09-14T09:08:14.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8050000000000001e-06 2024-09-14T09:08:14.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:14.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909775+0000", 2024-09-14T09:08:14.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8210000000000004e-06 2024-09-14T09:08:14.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:14.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909780+0000", 2024-09-14T09:08:14.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3120000000000001e-06 2024-09-14T09:08:14.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.255 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:14.255 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922138+0000", 2024-09-14T09:08:14.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012358012 2024-09-14T09:08:14.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.255 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:14.255 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922181+0000", 2024-09-14T09:08:14.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2876000000000001e-05 2024-09-14T09:08:14.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.255 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:14.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922239+0000", 2024-09-14T09:08:14.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7960000000000001e-05 2024-09-14T09:08:14.256 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.256 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:14.256 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.256 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1517 3.d 3:b36f6c76:::rbd_data.1112f61fa773.0000000000000002:8 [read 966656~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:14.256 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910035+0000", 2024-09-14T09:08:14.256 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.326256040000001, 2024-09-14T09:08:14.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012318664999999999, 2024-09-14T09:08:14.256 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:14.256 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:14.257 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:14.257 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:14.257 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:14.257 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:14.257 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1517 2024-09-14T09:08:14.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.257 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:14.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:14.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910035+0000", 2024-09-14T09:08:14.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:14.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910035+0000", 2024-09-14T09:08:14.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.258 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:14.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910036+0000", 2024-09-14T09:08:14.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7000000000000003e-07 2024-09-14T09:08:14.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.258 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:14.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910040+0000", 2024-09-14T09:08:14.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3220000000000003e-06 2024-09-14T09:08:14.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:14.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910051+0000", 2024-09-14T09:08:14.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1476e-05 2024-09-14T09:08:14.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:14.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910059+0000", 2024-09-14T09:08:14.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:08:14.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:14.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922268+0000", 2024-09-14T09:08:14.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012208910999999999 2024-09-14T09:08:14.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.260 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:14.260 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922305+0000", 2024-09-14T09:08:14.260 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7069e-05 2024-09-14T09:08:14.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.260 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:14.260 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922353+0000", 2024-09-14T09:08:14.260 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7976999999999998e-05 2024-09-14T09:08:14.260 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.260 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:14.260 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.260 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1518 3.d 3:b36f6c76:::rbd_data.1112f61fa773.0000000000000002:8 [read 1196032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:14.261 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910078+0000", 2024-09-14T09:08:14.261 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.326212351000001, 2024-09-14T09:08:14.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012415053000000001, 2024-09-14T09:08:14.261 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:14.261 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:14.261 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:14.261 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:14.261 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:14.261 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:14.261 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1518 2024-09-14T09:08:14.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.261 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:14.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:14.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910078+0000", 2024-09-14T09:08:14.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.262 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:14.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910078+0000", 2024-09-14T09:08:14.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.262 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:14.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910079+0000", 2024-09-14T09:08:14.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0999999999999998e-07 2024-09-14T09:08:14.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.263 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:14.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910082+0000", 2024-09-14T09:08:14.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7779999999999999e-06 2024-09-14T09:08:14.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.263 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.263 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:14.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910089+0000", 2024-09-14T09:08:14.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4599999999999997e-06 2024-09-14T09:08:14.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.263 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.263 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:14.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910095+0000", 2024-09-14T09:08:14.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.66e-06 2024-09-14T09:08:14.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:14.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922380+0000", 2024-09-14T09:08:14.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012285275 2024-09-14T09:08:14.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:14.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922434+0000", 2024-09-14T09:08:14.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3925000000000003e-05 2024-09-14T09:08:14.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:14.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922493+0000", 2024-09-14T09:08:14.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9345000000000002e-05 2024-09-14T09:08:14.265 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.265 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:14.265 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.265 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1519 3.d 3:b36f6c76:::rbd_data.1112f61fa773.0000000000000002:8 [read 1425408~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:14.265 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910131+0000", 2024-09-14T09:08:14.265 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.326159578, 2024-09-14T09:08:14.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012535421999999999, 2024-09-14T09:08:14.265 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:14.265 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:14.265 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:14.265 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:14.265 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:14.266 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:14.266 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1519 2024-09-14T09:08:14.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.266 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:14.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:14.266 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910131+0000", 2024-09-14T09:08:14.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:14.266 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910131+0000", 2024-09-14T09:08:14.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:14.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910132+0000", 2024-09-14T09:08:14.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1399999999999997e-07 2024-09-14T09:08:14.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:14.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910134+0000", 2024-09-14T09:08:14.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6340000000000001e-06 2024-09-14T09:08:14.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:14.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910142+0000", 2024-09-14T09:08:14.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8809999999999996e-06 2024-09-14T09:08:14.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:14.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910148+0000", 2024-09-14T09:08:14.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1750000000000002e-06 2024-09-14T09:08:14.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:14.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922521+0000", 2024-09-14T09:08:14.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012372726000000001 2024-09-14T09:08:14.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:14.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922585+0000", 2024-09-14T09:08:14.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4169000000000002e-05 2024-09-14T09:08:14.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:14.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922667+0000", 2024-09-14T09:08:14.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1322999999999994e-05 2024-09-14T09:08:14.269 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.269 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:14.269 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.269 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1524 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 1032192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:14.270 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:14.270 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.326130808, 2024-09-14T09:08:14.270 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012717483, 2024-09-14T09:08:14.270 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:14.270 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:14.270 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:14.270 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:14.270 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:14.270 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:14.270 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1524 2024-09-14T09:08:14.270 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.270 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:14.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.270 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:14.271 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:14.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.271 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:14.271 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:14.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.271 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:14.271 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:14.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5499999999999998e-07 2024-09-14T09:08:14.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:14.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910163+0000", 2024-09-14T09:08:14.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3180000000000001e-06 2024-09-14T09:08:14.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:14.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910169+0000", 2024-09-14T09:08:14.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5139999999999998e-06 2024-09-14T09:08:14.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:14.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910176+0000", 2024-09-14T09:08:14.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5169999999999996e-06 2024-09-14T09:08:14.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:14.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922695+0000", 2024-09-14T09:08:14.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012519007 2024-09-14T09:08:14.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:14.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922775+0000", 2024-09-14T09:08:14.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9958999999999998e-05 2024-09-14T09:08:14.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:14.274 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922877+0000", 2024-09-14T09:08:14.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000102613 2024-09-14T09:08:14.274 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.274 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:14.274 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.274 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1525 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 1261568~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:14.274 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910183+0000", 2024-09-14T09:08:14.274 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.326107478000001, 2024-09-14T09:08:14.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012942067999999999, 2024-09-14T09:08:14.274 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:14.274 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:14.274 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:14.275 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:14.275 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:14.275 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:14.275 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1525 2024-09-14T09:08:14.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.275 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:14.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:14.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910183+0000", 2024-09-14T09:08:14.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:14.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910183+0000", 2024-09-14T09:08:14.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:14.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910184+0000", 2024-09-14T09:08:14.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9999999999999998e-07 2024-09-14T09:08:14.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:14.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910186+0000", 2024-09-14T09:08:14.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.165e-06 2024-09-14T09:08:14.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:14.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910192+0000", 2024-09-14T09:08:14.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3080000000000004e-06 2024-09-14T09:08:14.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:14.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910203+0000", 2024-09-14T09:08:14.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0586e-05 2024-09-14T09:08:14.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:14.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922932+0000", 2024-09-14T09:08:14.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012728882 2024-09-14T09:08:14.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:14.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923028+0000", 2024-09-14T09:08:14.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6531000000000001e-05 2024-09-14T09:08:14.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:14.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923125+0000", 2024-09-14T09:08:14.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7195999999999996e-05 2024-09-14T09:08:14.278 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.278 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:14.278 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.278 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1527 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 999424~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:14.279 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910210+0000", 2024-09-14T09:08:14.279 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.326080571, 2024-09-14T09:08:14.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013037887999999999, 2024-09-14T09:08:14.279 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:14.279 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:14.279 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:14.279 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:14.279 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:14.279 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:14.279 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1527 2024-09-14T09:08:14.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.279 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:14.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:14.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910210+0000", 2024-09-14T09:08:14.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:14.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910210+0000", 2024-09-14T09:08:14.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:14.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910211+0000", 2024-09-14T09:08:14.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8800000000000003e-07 2024-09-14T09:08:14.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:14.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910213+0000", 2024-09-14T09:08:14.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0820000000000001e-06 2024-09-14T09:08:14.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:14.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910219+0000", 2024-09-14T09:08:14.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0789999999999997e-06 2024-09-14T09:08:14.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:14.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910224+0000", 2024-09-14T09:08:14.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7299999999999996e-06 2024-09-14T09:08:14.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:14.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923158+0000", 2024-09-14T09:08:14.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012934200999999999 2024-09-14T09:08:14.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:14.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923197+0000", 2024-09-14T09:08:14.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9020999999999998e-05 2024-09-14T09:08:14.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:14.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923248+0000", 2024-09-14T09:08:14.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1286999999999999e-05 2024-09-14T09:08:14.283 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.283 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:14.283 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.283 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1528 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1228800~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:14.283 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:14.283 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.326060722999999, 2024-09-14T09:08:14.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013235419, 2024-09-14T09:08:14.283 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:14.283 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:14.283 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:14.283 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:14.284 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:14.284 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:14.284 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1528 2024-09-14T09:08:14.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.284 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:14.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:14.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:14.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:14.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:14.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:14.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:14.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.01e-07 2024-09-14T09:08:14.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:14.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910232+0000", 2024-09-14T09:08:14.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9589999999999998e-06 2024-09-14T09:08:14.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:14.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910238+0000", 2024-09-14T09:08:14.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8200000000000002e-06 2024-09-14T09:08:14.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:14.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910243+0000", 2024-09-14T09:08:14.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8369999999999996e-06 2024-09-14T09:08:14.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:14.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923281+0000", 2024-09-14T09:08:14.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013037613 2024-09-14T09:08:14.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:14.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923360+0000", 2024-09-14T09:08:14.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9717999999999998e-05 2024-09-14T09:08:14.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:14.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923465+0000", 2024-09-14T09:08:14.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000105071 2024-09-14T09:08:14.287 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.287 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:14.287 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.287 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1544 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 1277952~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:14.288 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:14.288 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.324501739, 2024-09-14T09:08:14.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012301747, 2024-09-14T09:08:14.288 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:14.288 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:14.288 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:14.288 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:14.288 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:14.288 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:14.288 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1544 2024-09-14T09:08:14.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.288 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:14.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:14.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:14.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:14.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:14.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:14.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:14.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1500000000000005e-07 2024-09-14T09:08:14.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:14.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911793+0000", 2024-09-14T09:08:14.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6689999999999999e-06 2024-09-14T09:08:14.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:14.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911802+0000", 2024-09-14T09:08:14.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4710000000000007e-06 2024-09-14T09:08:14.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:14.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911807+0000", 2024-09-14T09:08:14.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5799999999999999e-06 2024-09-14T09:08:14.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:14.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923930+0000", 2024-09-14T09:08:14.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012123083 2024-09-14T09:08:14.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:14.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924013+0000", 2024-09-14T09:08:14.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2560999999999998e-05 2024-09-14T09:08:14.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:14.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924091+0000", 2024-09-14T09:08:14.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7867999999999994e-05 2024-09-14T09:08:14.292 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.292 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:14.292 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.292 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1547 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:14.292 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.911814+0000", 2024-09-14T09:08:14.292 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.324476635, 2024-09-14T09:08:14.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012405057000000001, 2024-09-14T09:08:14.292 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:14.292 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:14.292 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:14.293 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:14.293 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:14.293 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:14.293 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1547 2024-09-14T09:08:14.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.293 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:14.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:14.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911814+0000", 2024-09-14T09:08:14.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:14.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911814+0000", 2024-09-14T09:08:14.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:14.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911815+0000", 2024-09-14T09:08:14.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3000000000000001e-07 2024-09-14T09:08:14.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:14.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911816+0000", 2024-09-14T09:08:14.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.75e-06 2024-09-14T09:08:14.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:14.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911823+0000", 2024-09-14T09:08:14.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6189999999999996e-06 2024-09-14T09:08:14.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:14.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911828+0000", 2024-09-14T09:08:14.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5539999999999997e-06 2024-09-14T09:08:14.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:14.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924119+0000", 2024-09-14T09:08:14.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012290967 2024-09-14T09:08:14.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:14.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924162+0000", 2024-09-14T09:08:14.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2422999999999997e-05 2024-09-14T09:08:14.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:14.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924219+0000", 2024-09-14T09:08:14.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7314e-05 2024-09-14T09:08:14.296 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.296 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:14.296 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.297 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1548 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1245184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:14.297 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.911850+0000", 2024-09-14T09:08:14.297 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.324440679, 2024-09-14T09:08:14.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012607343, 2024-09-14T09:08:14.297 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:14.297 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:14.297 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:14.297 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:14.297 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:14.297 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:14.297 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1548 2024-09-14T09:08:14.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.298 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:14.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:14.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911850+0000", 2024-09-14T09:08:14.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:14.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911850+0000", 2024-09-14T09:08:14.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:14.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911851+0000", 2024-09-14T09:08:14.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4199999999999996e-07 2024-09-14T09:08:14.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:14.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911853+0000", 2024-09-14T09:08:14.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.283e-06 2024-09-14T09:08:14.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:14.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911860+0000", 2024-09-14T09:08:14.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2069999999999998e-06 2024-09-14T09:08:14.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:14.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911866+0000", 2024-09-14T09:08:14.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.161e-06 2024-09-14T09:08:14.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:14.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924276+0000", 2024-09-14T09:08:14.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012409531 2024-09-14T09:08:14.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:14.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924371+0000", 2024-09-14T09:08:14.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4826000000000003e-05 2024-09-14T09:08:14.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:14.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924457+0000", 2024-09-14T09:08:14.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6792999999999994e-05 2024-09-14T09:08:14.301 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.301 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:14.301 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.302 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1566 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1032192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:14.302 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.913266+0000", 2024-09-14T09:08:14.302 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.323024628000001, 2024-09-14T09:08:14.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012340884999999999, 2024-09-14T09:08:14.302 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:14.302 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:14.302 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:14.302 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:14.302 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:14.302 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:14.302 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1566 2024-09-14T09:08:14.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.303 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:14.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:14.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913266+0000", 2024-09-14T09:08:14.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:14.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913266+0000", 2024-09-14T09:08:14.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:14.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913267+0000", 2024-09-14T09:08:14.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6899999999999998e-07 2024-09-14T09:08:14.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:14.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913269+0000", 2024-09-14T09:08:14.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9589999999999998e-06 2024-09-14T09:08:14.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:14.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913275+0000", 2024-09-14T09:08:14.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4969999999999998e-06 2024-09-14T09:08:14.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:14.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913280+0000", 2024-09-14T09:08:14.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2039999999999996e-06 2024-09-14T09:08:14.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:14.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925517+0000", 2024-09-14T09:08:14.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012236784000000001 2024-09-14T09:08:14.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:14.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925556+0000", 2024-09-14T09:08:14.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9121e-05 2024-09-14T09:08:14.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:14.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925607+0000", 2024-09-14T09:08:14.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0850999999999998e-05 2024-09-14T09:08:14.306 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.306 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:14.306 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.306 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1567 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1261568~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:14.306 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:14.306 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.323004036, 2024-09-14T09:08:14.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012537243, 2024-09-14T09:08:14.307 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:14.307 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:14.307 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:14.307 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:14.307 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:14.307 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:14.307 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1567 2024-09-14T09:08:14.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.307 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:14.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:14.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:14.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:14.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:14.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:14.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:14.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8099999999999998e-07 2024-09-14T09:08:14.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:14.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913289+0000", 2024-09-14T09:08:14.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9350000000000001e-06 2024-09-14T09:08:14.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:14.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913295+0000", 2024-09-14T09:08:14.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4540000000000004e-06 2024-09-14T09:08:14.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:14.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913300+0000", 2024-09-14T09:08:14.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9189999999999998e-06 2024-09-14T09:08:14.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:14.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925641+0000", 2024-09-14T09:08:14.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012340378000000001 2024-09-14T09:08:14.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:14.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925726+0000", 2024-09-14T09:08:14.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5504e-05 2024-09-14T09:08:14.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:14.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925824+0000", 2024-09-14T09:08:14.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7671999999999996e-05 2024-09-14T09:08:14.311 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.311 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:14.311 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.311 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3470 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 4374528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:14.311 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039718+0000", 2024-09-14T09:08:14.311 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.196572380999999, 2024-09-14T09:08:14.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012430363, 2024-09-14T09:08:14.311 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:14.311 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:14.312 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:14.312 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:14.312 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:14.312 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:14.312 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3470 2024-09-14T09:08:14.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.312 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:14.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:14.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039718+0000", 2024-09-14T09:08:14.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:14.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039718+0000", 2024-09-14T09:08:14.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:14.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039719+0000", 2024-09-14T09:08:14.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0200000000000003e-07 2024-09-14T09:08:14.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:14.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039721+0000", 2024-09-14T09:08:14.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4380000000000002e-06 2024-09-14T09:08:14.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:14.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039727+0000", 2024-09-14T09:08:14.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2620000000000004e-06 2024-09-14T09:08:14.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:14.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039733+0000", 2024-09-14T09:08:14.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1730000000000003e-06 2024-09-14T09:08:14.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:14.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.051980+0000", 2024-09-14T09:08:14.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012247872999999999 2024-09-14T09:08:14.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:14.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052056+0000", 2024-09-14T09:08:14.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5766999999999995e-05 2024-09-14T09:08:14.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:14.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052149+0000", 2024-09-14T09:08:14.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2448000000000007e-05 2024-09-14T09:08:14.315 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.315 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:14.315 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.316 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3473 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 4112384~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:14.316 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039746+0000", 2024-09-14T09:08:14.316 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.196544619999999, 2024-09-14T09:08:14.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012654228999999999, 2024-09-14T09:08:14.316 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:14.316 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:14.316 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:14.316 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:14.316 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:14.316 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:14.316 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3473 2024-09-14T09:08:14.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.317 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:14.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:14.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039746+0000", 2024-09-14T09:08:14.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:14.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039746+0000", 2024-09-14T09:08:14.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:14.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039747+0000", 2024-09-14T09:08:14.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5499999999999998e-07 2024-09-14T09:08:14.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:14.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039749+0000", 2024-09-14T09:08:14.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4380000000000002e-06 2024-09-14T09:08:14.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:14.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039759+0000", 2024-09-14T09:08:14.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7110000000000007e-06 2024-09-14T09:08:14.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:14.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039764+0000", 2024-09-14T09:08:14.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3680000000000001e-06 2024-09-14T09:08:14.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:14.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052199+0000", 2024-09-14T09:08:14.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012434726 2024-09-14T09:08:14.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:14.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052283+0000", 2024-09-14T09:08:14.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4091000000000005e-05 2024-09-14T09:08:14.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:14.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052400+0000", 2024-09-14T09:08:14.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011744 2024-09-14T09:08:14.320 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.320 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:14.320 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.320 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3474 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 4341760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:14.320 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039772+0000", 2024-09-14T09:08:14.320 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.196518387999999, 2024-09-14T09:08:14.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012822623999999999, 2024-09-14T09:08:14.320 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:14.320 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:14.321 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:14.321 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:14.321 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:14.321 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:14.321 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3474 2024-09-14T09:08:14.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.321 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:14.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:14.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039772+0000", 2024-09-14T09:08:14.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:14.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039772+0000", 2024-09-14T09:08:14.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:14.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039773+0000", 2024-09-14T09:08:14.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1199999999999998e-07 2024-09-14T09:08:14.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:14.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039775+0000", 2024-09-14T09:08:14.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9709999999999998e-06 2024-09-14T09:08:14.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:14.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039781+0000", 2024-09-14T09:08:14.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5150000000000003e-06 2024-09-14T09:08:14.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:14.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039786+0000", 2024-09-14T09:08:14.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9710000000000003e-06 2024-09-14T09:08:14.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:14.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052437+0000", 2024-09-14T09:08:14.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012650539000000001 2024-09-14T09:08:14.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:14.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052508+0000", 2024-09-14T09:08:14.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1038999999999995e-05 2024-09-14T09:08:14.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:14.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052595+0000", 2024-09-14T09:08:14.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7176999999999996e-05 2024-09-14T09:08:14.324 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.324 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:14.324 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.325 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3475 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 4571136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:14.325 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:14.325 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.196498074999999, 2024-09-14T09:08:14.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013000444999999999, 2024-09-14T09:08:14.325 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:14.325 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:14.325 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:14.325 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:14.325 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:14.325 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:14.325 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3475 2024-09-14T09:08:14.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.325 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:14.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:14.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:14.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:14.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:14.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:14.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:14.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:14.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.46e-07 2024-09-14T09:08:14.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:14.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039795+0000", 2024-09-14T09:08:14.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.863e-06 2024-09-14T09:08:14.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:14.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039802+0000", 2024-09-14T09:08:14.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3780000000000003e-06 2024-09-14T09:08:14.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:14.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039807+0000", 2024-09-14T09:08:14.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2170000000000002e-06 2024-09-14T09:08:14.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:14.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052636+0000", 2024-09-14T09:08:14.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012828278 2024-09-14T09:08:14.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:14.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052714+0000", 2024-09-14T09:08:14.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7824999999999994e-05 2024-09-14T09:08:14.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:14.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:14.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:14.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052793+0000", 2024-09-14T09:08:14.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9537999999999996e-05 2024-09-14T09:08:14.329 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.329 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:14.329 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.329 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:14.329 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:14.329 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:14.330 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:14.331+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:14.331 INFO:teuthology.orchestra.run.smithi148.stdout:2307 trunc from 0xce3c800 to 0x1ab3800 2024-09-14T09:08:14.331 INFO:teuthology.orchestra.run.smithi148.stdout:2311 write 0xb975400 thru 0xb9849e3 (0xf5e4 bytes) 2024-09-14T09:08:14.331 INFO:teuthology.orchestra.run.smithi148.stdout:2314 punch from 0x1f25400 to 0x1f27e00, (0x2a00 bytes) 2024-09-14T09:08:14.331 INFO:teuthology.orchestra.run.smithi148.stdout:2319 write 0x480e800 thru 0x4819d20 (0xb521 bytes) 2024-09-14T09:08:14.332 INFO:teuthology.orchestra.run.smithi148.stdout:2321 write 0x5a3e600 thru 0x5a3f3e7 (0xde8 bytes) 2024-09-14T09:08:14.332 INFO:teuthology.orchestra.run.smithi148.stdout:2322 trunc from 0xb984a00 to 0xcab3a00 2024-09-14T09:08:14.332 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:08:14.350 INFO:teuthology.orchestra.run.smithi148.stdout:2323 write 0xd928400 thru 0xd9309b4 (0x85b5 bytes) 2024-09-14T09:08:14.358 INFO:teuthology.orchestra.run.smithi148.stdout:2325 trunc from 0xd930a00 to 0x7d04e00 2024-09-14T09:08:14.380 INFO:teuthology.orchestra.run.smithi148.stdout:2327 write 0x4a6a800 thru 0x4a6dd07 (0x3508 bytes) 2024-09-14T09:08:14.383 INFO:teuthology.orchestra.run.smithi148.stdout:2328 write 0x3c13400 thru 0x3c1b7f3 (0x83f4 bytes) 2024-09-14T09:08:14.383 INFO:teuthology.orchestra.run.smithi148.stdout:2329 trunc from 0x7d04e00 to 0x65b6800 2024-09-14T09:08:14.405 INFO:teuthology.orchestra.run.smithi148.stdout:2330 trunc from 0x65b6800 to 0xd27f600 2024-09-14T09:08:14.421 INFO:teuthology.orchestra.run.smithi148.stdout:2332 punch from 0x160ba00 to 0x1619c00, (0xe200 bytes) 2024-09-14T09:08:14.422 INFO:teuthology.orchestra.run.smithi148.stdout:2333 read 0x4ad7e00 thru 0x4adae7a (0x307b bytes) 2024-09-14T09:08:14.423 INFO:teuthology.orchestra.run.smithi148.stdout:2336 read 0x6c02800 thru 0x6c0ac70 (0x8471 bytes) 2024-09-14T09:08:14.423 INFO:teuthology.orchestra.run.smithi148.stdout:2338 read 0x87a5600 thru 0x87a830d (0x2d0e bytes) 2024-09-14T09:08:14.423 INFO:teuthology.orchestra.run.smithi148.stdout:2342 punch from 0x89c1a00 to 0x89ce400, (0xca00 bytes) 2024-09-14T09:08:14.423 INFO:teuthology.orchestra.run.smithi148.stdout:2347 read 0x249d600 thru 0x24a49aa (0x73ab bytes) 2024-09-14T09:08:14.423 INFO:teuthology.orchestra.run.smithi148.stdout:2348 punch from 0xa916800 to 0xa923a00, (0xd200 bytes) 2024-09-14T09:08:14.423 INFO:teuthology.orchestra.run.smithi148.stdout:2353 read 0x907400 thru 0x9128ec (0xb4ed bytes) 2024-09-14T09:08:14.423 INFO:teuthology.orchestra.run.smithi148.stdout:2354 read 0xa5c7800 thru 0xa5d1a20 (0xa221 bytes) 2024-09-14T09:08:14.431 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:14.433+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:14.437 INFO:teuthology.orchestra.run.smithi148.stdout:2355 trunc from 0xd27f600 to 0x8f3600 2024-09-14T09:08:14.452 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:14.452 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:14.452 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:08:14.452 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:14.459 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:08:14.462 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:08:14.484 INFO:teuthology.orchestra.run.smithi148.stdout:2356 write 0x8e92600 thru 0x8e9c585 (0x9f86 bytes) 2024-09-14T09:08:14.485 INFO:teuthology.orchestra.run.smithi148.stdout:2359 punch from 0x4919e00 to 0x491cc00, (0x2e00 bytes) 2024-09-14T09:08:14.489 INFO:teuthology.orchestra.run.smithi148.stdout:2360 punch from 0x6c7000 to 0x6d2e00, (0xbe00 bytes) 2024-09-14T09:08:14.494 INFO:teuthology.orchestra.run.smithi148.stdout:2362 trunc from 0x8e9c600 to 0x4935200 2024-09-14T09:08:14.514 INFO:teuthology.orchestra.run.smithi148.stdout:2363 write 0xeb1600 thru 0xeb309c (0x1a9d bytes) 2024-09-14T09:08:14.518 INFO:teuthology.orchestra.run.smithi148.stdout:2365 read 0xe53800 thru 0xe5acef (0x74f0 bytes) 2024-09-14T09:08:14.542 INFO:teuthology.orchestra.run.smithi148.stdout:2366 write 0xdb37800 thru 0xdb43d76 (0xc577 bytes) 2024-09-14T09:08:14.547 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:14.549+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:14.548 INFO:teuthology.orchestra.run.smithi148.stdout:2369 write 0xd1600 thru 0xd19ec (0x3ed bytes) 2024-09-14T09:08:14.549 INFO:teuthology.orchestra.run.smithi148.stdout:2370 read 0x74f2e00 thru 0x74f9c12 (0x6e13 bytes) 2024-09-14T09:08:14.550 INFO:teuthology.orchestra.run.smithi148.stdout:2371 punch from 0x4afb400 to 0x4b08e00, (0xda00 bytes) 2024-09-14T09:08:14.550 INFO:teuthology.orchestra.run.smithi148.stdout:2372 read 0xb6cd400 thru 0xb6d4c3f (0x7840 bytes) 2024-09-14T09:08:14.550 INFO:teuthology.orchestra.run.smithi148.stdout:2376 punch from 0xac17800 to 0xac19000, (0x1800 bytes) 2024-09-14T09:08:14.550 INFO:teuthology.orchestra.run.smithi148.stdout:2377 write 0xbe6a600 thru 0xbe6afcb (0x9cc bytes) 2024-09-14T09:08:14.550 INFO:teuthology.orchestra.run.smithi148.stdout:2379 read 0x30a200 thru 0x31336c (0x916d bytes) 2024-09-14T09:08:14.556 INFO:teuthology.orchestra.run.smithi148.stdout:2380 trunc from 0xdb43e00 to 0x920de00 2024-09-14T09:08:14.582 INFO:teuthology.orchestra.run.smithi148.stdout:2381 write 0x253b200 thru 0x2548a5f (0xd860 bytes) 2024-09-14T09:08:14.595 INFO:teuthology.orchestra.run.smithi148.stdout:2382 trunc from 0x920de00 to 0x2f43600 2024-09-14T09:08:14.597 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:14.597 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:14.619 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:14.619 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:14.621 INFO:teuthology.orchestra.run.smithi148.stdout:2386 punch from 0x4b1c00 to 0x4bf400, (0xd800 bytes) 2024-09-14T09:08:14.624 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:14.624 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:14.625 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:14.625 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:14.625 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:14.626 INFO:teuthology.orchestra.run.smithi148.stdout:2387 read 0x291da00 thru 0x2920f47 (0x3548 bytes) 2024-09-14T09:08:14.626 INFO:teuthology.orchestra.run.smithi148.stdout:2389 punch from 0xbfd000 to 0xc02400, (0x5400 bytes) 2024-09-14T09:08:14.626 INFO:teuthology.orchestra.run.smithi148.stdout:2390 read 0x1480400 thru 0x14840de (0x3cdf bytes) 2024-09-14T09:08:14.626 INFO:teuthology.orchestra.run.smithi148.stdout:2391 read 0x8cd000 thru 0x8cf5e0 (0x25e1 bytes) 2024-09-14T09:08:14.626 INFO:teuthology.orchestra.run.smithi148.stdout:2392 read 0xd3cc00 thru 0xd447e7 (0x7be8 bytes) 2024-09-14T09:08:14.634 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:08:14.635 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:14.635+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:14.636 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:08:14.637 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:08:14.651 INFO:teuthology.orchestra.run.smithi148.stdout:2394 write 0xeb5b600 thru 0xeb60f10 (0x5911 bytes) 2024-09-14T09:08:14.655 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:14.655 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:14.658 INFO:teuthology.orchestra.run.smithi148.stdout:2395 write 0x98ece00 thru 0x98f8208 (0xb409 bytes) 2024-09-14T09:08:14.658 INFO:teuthology.orchestra.run.smithi148.stdout:2396 read 0xb49d400 thru 0xb4a4728 (0x7329 bytes) 2024-09-14T09:08:14.668 INFO:teuthology.orchestra.run.smithi148.stdout:2398 trunc from 0xeb61000 to 0x5e94c00 2024-09-14T09:08:14.674 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:14.675 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:14.695 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:14.695 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:14.696 INFO:teuthology.orchestra.run.smithi148.stdout:2403 read 0xcf9c00 thru 0xcfc15a (0x255b bytes) 2024-09-14T09:08:14.713 INFO:teuthology.orchestra.run.smithi148.stdout:2404 trunc from 0x5e94c00 to 0xe0a8c00 2024-09-14T09:08:14.721 INFO:teuthology.orchestra.run.smithi148.stdout:2406 write 0xf69c00 thru 0xf74752 (0xab53 bytes) 2024-09-14T09:08:14.735 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:14.736+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:14.744 INFO:teuthology.orchestra.run.smithi148.stdout:2408 trunc from 0xe0a8c00 to 0x1570200 2024-09-14T09:08:14.755 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:14.755 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:14.765 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:08:14.782 INFO:teuthology.orchestra.run.smithi148.stdout:2409 write 0x9e9d200 thru 0x9ea07b3 (0x35b4 bytes) 2024-09-14T09:08:14.782 INFO:teuthology.orchestra.run.smithi148.stdout:2411 read 0x9a7b800 thru 0x9a89fae (0xe7af bytes) 2024-09-14T09:08:14.782 INFO:teuthology.orchestra.run.smithi148.stdout:2416 read 0x33ef400 thru 0x33f856c (0x916d bytes) 2024-09-14T09:08:14.783 INFO:teuthology.orchestra.run.smithi148.stdout:2417 read 0x580d400 thru 0x5819f7c (0xcb7d bytes) 2024-09-14T09:08:14.783 INFO:teuthology.orchestra.run.smithi148.stdout:2425 punch from 0x1c00 to 0x2a00, (0xe00 bytes) 2024-09-14T09:08:14.786 INFO:teuthology.orchestra.run.smithi148.stdout:2426 punch from 0x99e4e00 to 0x99e5800, (0xa00 bytes) 2024-09-14T09:08:14.787 INFO:teuthology.orchestra.run.smithi148.stdout:2427 read 0x9dad400 thru 0x9dae89f (0x14a0 bytes) 2024-09-14T09:08:14.787 INFO:teuthology.orchestra.run.smithi148.stdout:2430 read 0x94fe400 thru 0x94ffeaa (0x1aab bytes) 2024-09-14T09:08:14.793 INFO:teuthology.orchestra.run.smithi148.stdout:2432 trunc from 0x9ea0800 to 0x3e15800 2024-09-14T09:08:14.809 INFO:teuthology.orchestra.run.smithi148.stdout:2433 read 0x5f4600 thru 0x5fadf9 (0x67fa bytes) 2024-09-14T09:08:14.816 INFO:teuthology.orchestra.run.smithi148.stdout:2435 punch from 0x244f800 to 0x2456a00, (0x7200 bytes) 2024-09-14T09:08:14.817 INFO:teuthology.orchestra.run.smithi148.stdout:2439 punch from 0x551800 to 0x559800, (0x8000 bytes) 2024-09-14T09:08:14.817 INFO:teuthology.orchestra.run.smithi148.stdout:2440 punch from 0x30a200 to 0x30f400, (0x5200 bytes) 2024-09-14T09:08:14.817 INFO:teuthology.orchestra.run.smithi148.stdout:2441 read 0x3694400 thru 0x369fbac (0xb7ad bytes) 2024-09-14T09:08:14.821 INFO:teuthology.orchestra.run.smithi148.stdout:2442 write 0x2b71e00 thru 0x2b7c6a3 (0xa8a4 bytes) 2024-09-14T09:08:14.821 INFO:teuthology.orchestra.run.smithi148.stdout:2444 read 0x4e7200 thru 0x4edc41 (0x6a42 bytes) 2024-09-14T09:08:14.835 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:14.836+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:14.845 INFO:teuthology.orchestra.run.smithi148.stdout:2446 write 0xd2da600 thru 0xd2e21ab (0x7bac bytes) 2024-09-14T09:08:14.864 INFO:teuthology.orchestra.run.smithi148.stdout:2447 write 0xe570e00 thru 0xe579daf (0x8fb0 bytes) 2024-09-14T09:08:14.865 INFO:teuthology.orchestra.run.smithi148.stdout:2449 read 0x8e8c200 thru 0x8e8d638 (0x1439 bytes) 2024-09-14T09:08:14.865 INFO:teuthology.orchestra.run.smithi148.stdout:2450 write 0x7fe3e00 thru 0x7feb6fa (0x78fb bytes) 2024-09-14T09:08:14.866 INFO:teuthology.orchestra.run.smithi148.stdout:2451 write 0xa015800 thru 0xa01ce45 (0x7646 bytes) 2024-09-14T09:08:14.866 INFO:teuthology.orchestra.run.smithi148.stdout:2457 read 0x1f0ce00 thru 0x1f16c1b (0x9e1c bytes) 2024-09-14T09:08:14.866 INFO:teuthology.orchestra.run.smithi148.stdout:2460 write 0x9887400 thru 0x988e2be (0x6ebf bytes) 2024-09-14T09:08:14.866 INFO:teuthology.orchestra.run.smithi148.stdout:2463 clone 15 order 18 su 8192 sc 5 2024-09-14T09:08:14.878 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:14.878 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:14.887 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:08:14.936 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:14.938+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:15.030 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:15.030 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:15.037 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:15.038+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:15.039 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:08:15.137 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:15.139+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:15.183 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:15.183 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:15.192 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:08:15.239 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:15.240+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:15.336 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:15.336 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:15.340 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:15.342+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:15.345 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:08:15.441 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:15.442+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:15.447 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:15.447 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:15.456 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:08:15.498 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T09:08:15.498 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:08:15.498 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-14T09:08:15.498 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T09:08:15.498 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T09:08:15.498 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-14T09:08:15.543 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:15.544+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:15.602 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:15.602 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-14T09:08:15.602 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:15.602 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:15.603 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:15.612 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:08:15.653 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:15.654+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:15.743 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:15.744+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:15.755 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:15.756 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:15.764 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:08:15.849 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:15.850+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:15.867 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T09:08:15.910 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:15.911 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:15.919 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:08:15.961 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:15.962+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:16.046 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:16.047+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:16.064 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:16.064 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:16.074 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:08:16.147 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:16.149+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:16.181 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:16.181 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:16.190 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:08:16.274 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:16.276+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:16.336 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:16.336 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:16.338 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #13, image image_client.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent14 2024-09-14T09:08:16.346 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:08:16.388 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:16.390+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:16.395 INFO:teuthology.orchestra.run.smithi148.stdout:2464 write 0x5f9cc00 thru 0x5fa816f (0xb570 bytes) 2024-09-14T09:08:16.396 INFO:teuthology.orchestra.run.smithi148.stdout:2465 write 0x1063200 thru 0x10710e0 (0xdee1 bytes) 2024-09-14T09:08:16.396 INFO:teuthology.orchestra.run.smithi148.stdout:2467 read 0x6d2e00 thru 0x6dc625 (0x9826 bytes) 2024-09-14T09:08:16.404 INFO:teuthology.orchestra.run.smithi148.stdout:2468 trunc from 0xe579e00 to 0x853e800 2024-09-14T09:08:16.436 INFO:teuthology.orchestra.run.smithi148.stdout:2474 write 0x21b5600 thru 0x21b95d3 (0x3fd4 bytes) 2024-09-14T09:08:16.442 INFO:teuthology.orchestra.run.smithi148.stdout:2476 read 0x816e000 thru 0x8175ed2 (0x7ed3 bytes) 2024-09-14T09:08:16.442 INFO:teuthology.orchestra.run.smithi148.stdout:2478 punch from 0xcc0a00 to 0xcc9c00, (0x9200 bytes) 2024-09-14T09:08:16.449 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:16.451+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:16.461 INFO:teuthology.orchestra.run.smithi148.stdout:2480 write 0xd619c00 thru 0xd61e19c (0x459d bytes) 2024-09-14T09:08:16.466 INFO:teuthology.orchestra.run.smithi148.stdout:2483 trunc from 0xd61e200 to 0xa584200 2024-09-14T09:08:16.488 INFO:teuthology.orchestra.run.smithi148.stdout:2484 punch from 0x5ebd800 to 0x5ec2600, (0x4e00 bytes) 2024-09-14T09:08:16.497 INFO:teuthology.orchestra.run.smithi148.stdout:2485 trunc from 0xa584200 to 0x44c4200 2024-09-14T09:08:16.506 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:16.506 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:16.517 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:08:16.544 INFO:teuthology.orchestra.run.smithi148.stdout:2486 write 0xbea5400 thru 0xbeac03c (0x6c3d bytes) 2024-09-14T09:08:16.545 INFO:teuthology.orchestra.run.smithi148.stdout:2487 read 0x4efd800 thru 0x4efe4d4 (0xcd5 bytes) 2024-09-14T09:08:16.546 INFO:teuthology.orchestra.run.smithi148.stdout:2490 write 0x933a000 thru 0x933f4fb (0x54fc bytes) 2024-09-14T09:08:16.546 INFO:teuthology.orchestra.run.smithi148.stdout:2491 read 0x311a000 thru 0x3125830 (0xb831 bytes) 2024-09-14T09:08:16.546 INFO:teuthology.orchestra.run.smithi148.stdout:2493 punch from 0x6395e00 to 0x6396400, (0x600 bytes) 2024-09-14T09:08:16.546 INFO:teuthology.orchestra.run.smithi148.stdout:2495 punch from 0x54c7e00 to 0x54cc800, (0x4a00 bytes) 2024-09-14T09:08:16.546 INFO:teuthology.orchestra.run.smithi148.stdout:2496 read 0x28c3c00 thru 0x28d2afb (0xeefc bytes) 2024-09-14T09:08:16.550 INFO:teuthology.orchestra.run.smithi148.stdout:2498 read 0x3b5d400 thru 0x3b5ddf8 (0x9f9 bytes) 2024-09-14T09:08:16.550 INFO:teuthology.orchestra.run.smithi148.stdout:2500 write 0xb94e600 thru 0xb957de3 (0x97e4 bytes) 2024-09-14T09:08:16.550 INFO:teuthology.orchestra.run.smithi148.stdout:2501 punch from 0xa883600 to 0xa888800, (0x5200 bytes) 2024-09-14T09:08:16.550 INFO:teuthology.orchestra.run.smithi148.stdout:2503 write 0x69af600 thru 0x69b53a4 (0x5da5 bytes) 2024-09-14T09:08:16.550 INFO:teuthology.orchestra.run.smithi148.stdout:2504 write 0x6e9e400 thru 0x6ea1f5e (0x3b5f bytes) 2024-09-14T09:08:16.551 INFO:teuthology.orchestra.run.smithi148.stdout:2506 punch from 0x3992600 to 0x3996c00, (0x4600 bytes) 2024-09-14T09:08:16.551 INFO:teuthology.orchestra.run.smithi148.stdout:2508 punch from 0x88ba600 to 0x88bb600, (0x1000 bytes) 2024-09-14T09:08:16.551 INFO:teuthology.orchestra.run.smithi148.stdout:2509 read 0x760e000 thru 0x7619d07 (0xbd08 bytes) 2024-09-14T09:08:16.551 INFO:teuthology.orchestra.run.smithi148.stdout:2510 punch from 0xa9bc600 to 0xa9c2a00, (0x6400 bytes) 2024-09-14T09:08:16.551 INFO:teuthology.orchestra.run.smithi148.stdout:2511 read 0x3e400 thru 0x3f70b (0x130c bytes) 2024-09-14T09:08:16.551 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:16.551+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:16.580 INFO:teuthology.orchestra.run.smithi148.stdout:2515 trunc from 0xbeac200 to 0x637b800 2024-09-14T09:08:16.611 INFO:teuthology.orchestra.run.smithi148.stdout:2518 trunc from 0x637b800 to 0xc59c600 2024-09-14T09:08:16.627 INFO:teuthology.orchestra.run.smithi148.stdout:2521 trunc from 0xc59c600 to 0x5bab200 2024-09-14T09:08:16.641 INFO:teuthology.orchestra.run.smithi148.stdout:2522 punch from 0x4aaae00 to 0x4ab9200, (0xe400 bytes) 2024-09-14T09:08:16.650 INFO:teuthology.orchestra.run.smithi148.stdout:2523 trunc from 0x5bab200 to 0x1f0000 2024-09-14T09:08:16.651 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:16.652+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:16.681 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:16.681 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:16.690 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:08:16.707 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:08:16.711 INFO:teuthology.orchestra.run.smithi148.stdout:2524 write 0xdb3a000 thru 0xdb3bf21 (0x1f22 bytes) 2024-09-14T09:08:16.715 INFO:teuthology.orchestra.run.smithi148.stdout:2526 clone 16 order 19 su 2048 sc 7 2024-09-14T09:08:16.776 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:16.778+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:16.837 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:16.837 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:16.846 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:08:16.852 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:16.853+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:16.852 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:16.852 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:16.859 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is unset 2024-09-14T09:08:16.875 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:16.875 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:16.892 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:08:16.892 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:08:16.911 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:16.911 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:16.929 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:16.929 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:16.929 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone15 from 0xdb3c000 (overlap 0x1f0000) to 0xf8000 2024-09-14T09:08:16.952 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:16.952 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:16.953 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:16.954+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:16.971 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:16.971 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:16.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:16.971 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:16.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.971 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:08:16.972 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:16.972 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.739421102000001, 2024-09-14T09:08:16.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72111598600000004, 2024-09-14T09:08:16.972 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:16.972 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:16.972 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:16.972 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:16.972 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:08:16.972 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:08:16.972 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1 2024-09-14T09:08:16.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.972 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:16.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:16.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:16.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:16.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:16.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:16.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:16.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:16.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233065+0000", 2024-09-14T09:08:16.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1909999999999999e-06 2024-09-14T09:08:16.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:16.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233071+0000", 2024-09-14T09:08:16.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5300000000000002e-06 2024-09-14T09:08:16.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:16.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233081+0000", 2024-09-14T09:08:16.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0339e-05 2024-09-14T09:08:16.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:16.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233093+0000", 2024-09-14T09:08:16.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1252e-05 2024-09-14T09:08:16.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:16.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233162+0000", 2024-09-14T09:08:16.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9678999999999995e-05 2024-09-14T09:08:16.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:08:16.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233171+0000", 2024-09-14T09:08:16.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.132e-06 2024-09-14T09:08:16.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:16.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952480+0000", 2024-09-14T09:08:16.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.71930839899999999 2024-09-14T09:08:16.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:16.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952655+0000", 2024-09-14T09:08:16.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017552 2024-09-14T09:08:16.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:16.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952835+0000", 2024-09-14T09:08:16.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001797 2024-09-14T09:08:16.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:16.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.953648+0000", 2024-09-14T09:08:16.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00081291700000000002 2024-09-14T09:08:16.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:16.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954108+0000", 2024-09-14T09:08:16.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045992800000000002 2024-09-14T09:08:16.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:16.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954149+0000", 2024-09-14T09:08:16.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1214999999999998e-05 2024-09-14T09:08:16.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:16.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954178+0000", 2024-09-14T09:08:16.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9184e-05 2024-09-14T09:08:16.978 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:16.978 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:16.978 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:16.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.979 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1493 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1196032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:16.979 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:16.979 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.063721911999998, 2024-09-14T09:08:16.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012302112, 2024-09-14T09:08:16.979 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:16.979 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:16.979 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:16.979 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:16.979 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:16.979 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:16.979 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1493 2024-09-14T09:08:16.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.980 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:16.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:16.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:16.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:16.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:16.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:16.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:16.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:16.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:16.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.65e-07 2024-09-14T09:08:16.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:16.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908764+0000", 2024-09-14T09:08:16.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8589999999999999e-06 2024-09-14T09:08:16.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:16.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908770+0000", 2024-09-14T09:08:16.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.728e-06 2024-09-14T09:08:16.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:16.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908774+0000", 2024-09-14T09:08:16.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7609999999999998e-06 2024-09-14T09:08:16.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:16.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.920899+0000", 2024-09-14T09:08:16.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012125004999999999 2024-09-14T09:08:16.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:16.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.920977+0000", 2024-09-14T09:08:16.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7564000000000005e-05 2024-09-14T09:08:16.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:16.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.921064+0000", 2024-09-14T09:08:16.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6829999999999994e-05 2024-09-14T09:08:16.983 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:16.983 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:16.983 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:16.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.983 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1510 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 983040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:16.984 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:16.984 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.062737722000001, 2024-09-14T09:08:16.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012360968999999999, 2024-09-14T09:08:16.984 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:16.984 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:16.984 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:16.984 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:16.984 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:16.984 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:16.984 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1510 2024-09-14T09:08:16.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.984 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:16.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:16.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:16.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:16.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:16.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:16.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:16.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:16.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:16.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8799999999999998e-07 2024-09-14T09:08:16.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:16.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909748+0000", 2024-09-14T09:08:16.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9810000000000002e-06 2024-09-14T09:08:16.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:16.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909754+0000", 2024-09-14T09:08:16.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3609999999999997e-06 2024-09-14T09:08:16.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:16.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909760+0000", 2024-09-14T09:08:16.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1850000000000003e-06 2024-09-14T09:08:16.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:16.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.921974+0000", 2024-09-14T09:08:16.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012214426 2024-09-14T09:08:16.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:16.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922015+0000", 2024-09-14T09:08:16.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0407000000000001e-05 2024-09-14T09:08:16.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:16.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922107+0000", 2024-09-14T09:08:16.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2220999999999997e-05 2024-09-14T09:08:16.988 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:16.988 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:16.988 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:16.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.988 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1511 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1212416~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:16.988 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.909766+0000", 2024-09-14T09:08:16.988 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.062717315, 2024-09-14T09:08:16.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012473141, 2024-09-14T09:08:16.988 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:16.988 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:16.988 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:16.988 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:16.989 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:16.989 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:16.989 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1511 2024-09-14T09:08:16.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.989 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:16.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:16.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909766+0000", 2024-09-14T09:08:16.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:16.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:16.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909766+0000", 2024-09-14T09:08:16.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:16.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:16.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909767+0000", 2024-09-14T09:08:16.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-07 2024-09-14T09:08:16.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:16.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909768+0000", 2024-09-14T09:08:16.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8050000000000001e-06 2024-09-14T09:08:16.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:16.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909775+0000", 2024-09-14T09:08:16.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8210000000000004e-06 2024-09-14T09:08:16.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:16.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909780+0000", 2024-09-14T09:08:16.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3120000000000001e-06 2024-09-14T09:08:16.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:16.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922138+0000", 2024-09-14T09:08:16.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012358012 2024-09-14T09:08:16.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:16.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922181+0000", 2024-09-14T09:08:16.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2876000000000001e-05 2024-09-14T09:08:16.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:16.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922239+0000", 2024-09-14T09:08:16.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7960000000000001e-05 2024-09-14T09:08:16.992 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:16.992 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:16.992 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:16.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.993 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1517 3.d 3:b36f6c76:::rbd_data.1112f61fa773.0000000000000002:8 [read 966656~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:16.993 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910035+0000", 2024-09-14T09:08:16.993 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.062448797999998, 2024-09-14T09:08:16.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012318664999999999, 2024-09-14T09:08:16.993 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:16.993 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:16.993 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:16.993 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:16.993 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:16.993 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:16.993 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1517 2024-09-14T09:08:16.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.994 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:16.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:16.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910035+0000", 2024-09-14T09:08:16.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:16.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:16.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910035+0000", 2024-09-14T09:08:16.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:16.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:16.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910036+0000", 2024-09-14T09:08:16.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7000000000000003e-07 2024-09-14T09:08:16.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:16.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910040+0000", 2024-09-14T09:08:16.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3220000000000003e-06 2024-09-14T09:08:16.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:16.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910051+0000", 2024-09-14T09:08:16.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1476e-05 2024-09-14T09:08:16.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:16.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910059+0000", 2024-09-14T09:08:16.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:08:16.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:16.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922268+0000", 2024-09-14T09:08:16.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012208910999999999 2024-09-14T09:08:16.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:16.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922305+0000", 2024-09-14T09:08:16.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7069e-05 2024-09-14T09:08:16.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:16.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922353+0000", 2024-09-14T09:08:16.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7976999999999998e-05 2024-09-14T09:08:16.997 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:16.997 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:16.997 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:16.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.997 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1518 3.d 3:b36f6c76:::rbd_data.1112f61fa773.0000000000000002:8 [read 1196032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:16.997 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910078+0000", 2024-09-14T09:08:16.997 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.062405109, 2024-09-14T09:08:16.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012415053000000001, 2024-09-14T09:08:16.998 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:16.998 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:16.998 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:16.998 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:16.998 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:16.998 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:16.998 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1518 2024-09-14T09:08:16.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.998 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:16.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:16.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910078+0000", 2024-09-14T09:08:16.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:16.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:16.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910078+0000", 2024-09-14T09:08:16.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:16.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:16.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910079+0000", 2024-09-14T09:08:16.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0999999999999998e-07 2024-09-14T09:08:16.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:16.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:16.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:16.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910082+0000", 2024-09-14T09:08:16.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7779999999999999e-06 2024-09-14T09:08:17.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910089+0000", 2024-09-14T09:08:17.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4599999999999997e-06 2024-09-14T09:08:17.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910095+0000", 2024-09-14T09:08:17.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.66e-06 2024-09-14T09:08:17.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922380+0000", 2024-09-14T09:08:17.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012285275 2024-09-14T09:08:17.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922434+0000", 2024-09-14T09:08:17.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3925000000000003e-05 2024-09-14T09:08:17.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922493+0000", 2024-09-14T09:08:17.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9345000000000002e-05 2024-09-14T09:08:17.001 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.002 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.002 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.002 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1519 3.d 3:b36f6c76:::rbd_data.1112f61fa773.0000000000000002:8 [read 1425408~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:17.002 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910131+0000", 2024-09-14T09:08:17.002 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.062352336, 2024-09-14T09:08:17.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012535421999999999, 2024-09-14T09:08:17.002 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.002 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.002 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.002 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.002 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:17.003 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:17.003 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1519 2024-09-14T09:08:17.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.003 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910131+0000", 2024-09-14T09:08:17.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910131+0000", 2024-09-14T09:08:17.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910132+0000", 2024-09-14T09:08:17.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1399999999999997e-07 2024-09-14T09:08:17.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910134+0000", 2024-09-14T09:08:17.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6340000000000001e-06 2024-09-14T09:08:17.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910142+0000", 2024-09-14T09:08:17.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8809999999999996e-06 2024-09-14T09:08:17.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910148+0000", 2024-09-14T09:08:17.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1750000000000002e-06 2024-09-14T09:08:17.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922521+0000", 2024-09-14T09:08:17.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012372726000000001 2024-09-14T09:08:17.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922585+0000", 2024-09-14T09:08:17.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4169000000000002e-05 2024-09-14T09:08:17.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922667+0000", 2024-09-14T09:08:17.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1322999999999994e-05 2024-09-14T09:08:17.006 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.006 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.006 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.007 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1524 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 1032192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:17.007 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:17.007 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.062323566, 2024-09-14T09:08:17.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012717483, 2024-09-14T09:08:17.007 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.007 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.007 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.007 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.007 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:17.007 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:17.007 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1524 2024-09-14T09:08:17.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.007 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:17.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:17.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:17.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5499999999999998e-07 2024-09-14T09:08:17.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910163+0000", 2024-09-14T09:08:17.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3180000000000001e-06 2024-09-14T09:08:17.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910169+0000", 2024-09-14T09:08:17.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5139999999999998e-06 2024-09-14T09:08:17.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910176+0000", 2024-09-14T09:08:17.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5169999999999996e-06 2024-09-14T09:08:17.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922695+0000", 2024-09-14T09:08:17.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012519007 2024-09-14T09:08:17.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922775+0000", 2024-09-14T09:08:17.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9958999999999998e-05 2024-09-14T09:08:17.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922877+0000", 2024-09-14T09:08:17.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000102613 2024-09-14T09:08:17.011 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.011 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.011 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.011 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1525 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 1261568~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:17.012 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910183+0000", 2024-09-14T09:08:17.012 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.062300235999999, 2024-09-14T09:08:17.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012942067999999999, 2024-09-14T09:08:17.012 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.012 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.012 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.012 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.012 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:17.012 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:17.012 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1525 2024-09-14T09:08:17.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.012 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910183+0000", 2024-09-14T09:08:17.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910183+0000", 2024-09-14T09:08:17.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910184+0000", 2024-09-14T09:08:17.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9999999999999998e-07 2024-09-14T09:08:17.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910186+0000", 2024-09-14T09:08:17.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.165e-06 2024-09-14T09:08:17.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910192+0000", 2024-09-14T09:08:17.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3080000000000004e-06 2024-09-14T09:08:17.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910203+0000", 2024-09-14T09:08:17.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0586e-05 2024-09-14T09:08:17.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922932+0000", 2024-09-14T09:08:17.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012728882 2024-09-14T09:08:17.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923028+0000", 2024-09-14T09:08:17.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6531000000000001e-05 2024-09-14T09:08:17.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923125+0000", 2024-09-14T09:08:17.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7195999999999996e-05 2024-09-14T09:08:17.016 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.016 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.017 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.017 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1527 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 999424~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:17.017 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910210+0000", 2024-09-14T09:08:17.017 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.062273329, 2024-09-14T09:08:17.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013037887999999999, 2024-09-14T09:08:17.017 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.017 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.017 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.017 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.017 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:17.018 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:17.018 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1527 2024-09-14T09:08:17.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.018 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910210+0000", 2024-09-14T09:08:17.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910210+0000", 2024-09-14T09:08:17.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910211+0000", 2024-09-14T09:08:17.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8800000000000003e-07 2024-09-14T09:08:17.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910213+0000", 2024-09-14T09:08:17.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0820000000000001e-06 2024-09-14T09:08:17.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910219+0000", 2024-09-14T09:08:17.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0789999999999997e-06 2024-09-14T09:08:17.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910224+0000", 2024-09-14T09:08:17.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7299999999999996e-06 2024-09-14T09:08:17.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923158+0000", 2024-09-14T09:08:17.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012934200999999999 2024-09-14T09:08:17.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923197+0000", 2024-09-14T09:08:17.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9020999999999998e-05 2024-09-14T09:08:17.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923248+0000", 2024-09-14T09:08:17.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1286999999999999e-05 2024-09-14T09:08:17.021 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.021 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.021 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.021 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1528 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1228800~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:17.021 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:17.022 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.062253480999999, 2024-09-14T09:08:17.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013235419, 2024-09-14T09:08:17.022 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.022 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.022 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.022 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.022 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:17.022 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:17.022 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1528 2024-09-14T09:08:17.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.022 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:17.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:17.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:17.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.01e-07 2024-09-14T09:08:17.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910232+0000", 2024-09-14T09:08:17.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9589999999999998e-06 2024-09-14T09:08:17.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910238+0000", 2024-09-14T09:08:17.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8200000000000002e-06 2024-09-14T09:08:17.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910243+0000", 2024-09-14T09:08:17.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8369999999999996e-06 2024-09-14T09:08:17.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923281+0000", 2024-09-14T09:08:17.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013037613 2024-09-14T09:08:17.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923360+0000", 2024-09-14T09:08:17.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9717999999999998e-05 2024-09-14T09:08:17.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923465+0000", 2024-09-14T09:08:17.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000105071 2024-09-14T09:08:17.025 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.026 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.026 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.026 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1544 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 1277952~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:17.026 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:17.026 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.060694497, 2024-09-14T09:08:17.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012301747, 2024-09-14T09:08:17.026 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.026 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.026 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.026 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.026 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:17.026 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:17.026 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1544 2024-09-14T09:08:17.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.027 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:17.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:17.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:17.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1500000000000005e-07 2024-09-14T09:08:17.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911793+0000", 2024-09-14T09:08:17.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6689999999999999e-06 2024-09-14T09:08:17.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911802+0000", 2024-09-14T09:08:17.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4710000000000007e-06 2024-09-14T09:08:17.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911807+0000", 2024-09-14T09:08:17.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5799999999999999e-06 2024-09-14T09:08:17.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923930+0000", 2024-09-14T09:08:17.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012123083 2024-09-14T09:08:17.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924013+0000", 2024-09-14T09:08:17.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2560999999999998e-05 2024-09-14T09:08:17.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924091+0000", 2024-09-14T09:08:17.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7867999999999994e-05 2024-09-14T09:08:17.030 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.030 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.030 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.030 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1547 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:17.030 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.911814+0000", 2024-09-14T09:08:17.030 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.060669393000001, 2024-09-14T09:08:17.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012405057000000001, 2024-09-14T09:08:17.030 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.030 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.030 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.030 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.031 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:17.031 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:17.031 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1547 2024-09-14T09:08:17.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.031 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911814+0000", 2024-09-14T09:08:17.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911814+0000", 2024-09-14T09:08:17.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911815+0000", 2024-09-14T09:08:17.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3000000000000001e-07 2024-09-14T09:08:17.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911816+0000", 2024-09-14T09:08:17.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.75e-06 2024-09-14T09:08:17.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911823+0000", 2024-09-14T09:08:17.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6189999999999996e-06 2024-09-14T09:08:17.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911828+0000", 2024-09-14T09:08:17.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5539999999999997e-06 2024-09-14T09:08:17.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924119+0000", 2024-09-14T09:08:17.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012290967 2024-09-14T09:08:17.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924162+0000", 2024-09-14T09:08:17.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2422999999999997e-05 2024-09-14T09:08:17.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924219+0000", 2024-09-14T09:08:17.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7314e-05 2024-09-14T09:08:17.034 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.034 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.034 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.034 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1548 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1245184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:17.035 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.911850+0000", 2024-09-14T09:08:17.035 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.060633437, 2024-09-14T09:08:17.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012607343, 2024-09-14T09:08:17.035 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.035 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.035 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.035 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.035 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:17.035 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:17.035 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1548 2024-09-14T09:08:17.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.035 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911850+0000", 2024-09-14T09:08:17.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911850+0000", 2024-09-14T09:08:17.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911851+0000", 2024-09-14T09:08:17.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4199999999999996e-07 2024-09-14T09:08:17.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911853+0000", 2024-09-14T09:08:17.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.283e-06 2024-09-14T09:08:17.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911860+0000", 2024-09-14T09:08:17.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2069999999999998e-06 2024-09-14T09:08:17.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911866+0000", 2024-09-14T09:08:17.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.161e-06 2024-09-14T09:08:17.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924276+0000", 2024-09-14T09:08:17.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012409531 2024-09-14T09:08:17.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924371+0000", 2024-09-14T09:08:17.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4826000000000003e-05 2024-09-14T09:08:17.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924457+0000", 2024-09-14T09:08:17.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6792999999999994e-05 2024-09-14T09:08:17.039 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.039 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.039 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.039 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1566 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1032192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:17.039 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.913266+0000", 2024-09-14T09:08:17.039 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.059217386, 2024-09-14T09:08:17.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012340884999999999, 2024-09-14T09:08:17.039 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.040 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.040 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.040 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.040 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:17.040 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:17.040 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1566 2024-09-14T09:08:17.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.040 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913266+0000", 2024-09-14T09:08:17.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913266+0000", 2024-09-14T09:08:17.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913267+0000", 2024-09-14T09:08:17.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6899999999999998e-07 2024-09-14T09:08:17.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913269+0000", 2024-09-14T09:08:17.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9589999999999998e-06 2024-09-14T09:08:17.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913275+0000", 2024-09-14T09:08:17.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4969999999999998e-06 2024-09-14T09:08:17.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913280+0000", 2024-09-14T09:08:17.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2039999999999996e-06 2024-09-14T09:08:17.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925517+0000", 2024-09-14T09:08:17.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012236784000000001 2024-09-14T09:08:17.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925556+0000", 2024-09-14T09:08:17.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9121e-05 2024-09-14T09:08:17.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925607+0000", 2024-09-14T09:08:17.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0850999999999998e-05 2024-09-14T09:08:17.043 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.043 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.043 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.043 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1567 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1261568~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:17.043 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:17.043 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.059196794000002, 2024-09-14T09:08:17.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012537243, 2024-09-14T09:08:17.044 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.044 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.044 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.044 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.044 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:17.044 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:17.044 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1567 2024-09-14T09:08:17.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.044 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:17.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:17.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:17.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8099999999999998e-07 2024-09-14T09:08:17.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913289+0000", 2024-09-14T09:08:17.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9350000000000001e-06 2024-09-14T09:08:17.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913295+0000", 2024-09-14T09:08:17.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4540000000000004e-06 2024-09-14T09:08:17.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913300+0000", 2024-09-14T09:08:17.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9189999999999998e-06 2024-09-14T09:08:17.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925641+0000", 2024-09-14T09:08:17.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012340378000000001 2024-09-14T09:08:17.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925726+0000", 2024-09-14T09:08:17.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5504e-05 2024-09-14T09:08:17.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925824+0000", 2024-09-14T09:08:17.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7671999999999996e-05 2024-09-14T09:08:17.047 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.047 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.047 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.048 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3470 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 4374528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:17.048 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039718+0000", 2024-09-14T09:08:17.048 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.932765139000001, 2024-09-14T09:08:17.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012430363, 2024-09-14T09:08:17.048 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.048 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.048 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.048 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.048 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:17.048 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:17.048 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3470 2024-09-14T09:08:17.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.048 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039718+0000", 2024-09-14T09:08:17.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039718+0000", 2024-09-14T09:08:17.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039719+0000", 2024-09-14T09:08:17.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0200000000000003e-07 2024-09-14T09:08:17.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039721+0000", 2024-09-14T09:08:17.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4380000000000002e-06 2024-09-14T09:08:17.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039727+0000", 2024-09-14T09:08:17.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2620000000000004e-06 2024-09-14T09:08:17.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039733+0000", 2024-09-14T09:08:17.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1730000000000003e-06 2024-09-14T09:08:17.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.051980+0000", 2024-09-14T09:08:17.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012247872999999999 2024-09-14T09:08:17.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052056+0000", 2024-09-14T09:08:17.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5766999999999995e-05 2024-09-14T09:08:17.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052149+0000", 2024-09-14T09:08:17.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2448000000000007e-05 2024-09-14T09:08:17.051 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.052 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.052 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.052 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3473 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 4112384~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:17.052 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039746+0000", 2024-09-14T09:08:17.052 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.932737377999999, 2024-09-14T09:08:17.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012654228999999999, 2024-09-14T09:08:17.052 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.052 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.052 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.052 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.052 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:17.052 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:17.053 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3473 2024-09-14T09:08:17.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.053 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039746+0000", 2024-09-14T09:08:17.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039746+0000", 2024-09-14T09:08:17.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039747+0000", 2024-09-14T09:08:17.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5499999999999998e-07 2024-09-14T09:08:17.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039749+0000", 2024-09-14T09:08:17.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4380000000000002e-06 2024-09-14T09:08:17.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039759+0000", 2024-09-14T09:08:17.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7110000000000007e-06 2024-09-14T09:08:17.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039764+0000", 2024-09-14T09:08:17.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3680000000000001e-06 2024-09-14T09:08:17.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052199+0000", 2024-09-14T09:08:17.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012434726 2024-09-14T09:08:17.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052283+0000", 2024-09-14T09:08:17.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4091000000000005e-05 2024-09-14T09:08:17.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052400+0000", 2024-09-14T09:08:17.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011744 2024-09-14T09:08:17.056 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.056 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.056 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.056 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3474 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 4341760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:17.056 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039772+0000", 2024-09-14T09:08:17.056 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.932711145999999, 2024-09-14T09:08:17.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012822623999999999, 2024-09-14T09:08:17.056 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.056 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.056 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.057 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.057 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:17.057 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:17.057 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3474 2024-09-14T09:08:17.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.057 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039772+0000", 2024-09-14T09:08:17.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039772+0000", 2024-09-14T09:08:17.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039773+0000", 2024-09-14T09:08:17.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1199999999999998e-07 2024-09-14T09:08:17.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039775+0000", 2024-09-14T09:08:17.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9709999999999998e-06 2024-09-14T09:08:17.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039781+0000", 2024-09-14T09:08:17.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5150000000000003e-06 2024-09-14T09:08:17.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039786+0000", 2024-09-14T09:08:17.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9710000000000003e-06 2024-09-14T09:08:17.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052437+0000", 2024-09-14T09:08:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012650539000000001 2024-09-14T09:08:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052508+0000", 2024-09-14T09:08:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1038999999999995e-05 2024-09-14T09:08:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052595+0000", 2024-09-14T09:08:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7176999999999996e-05 2024-09-14T09:08:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3475 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 4571136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.932690832999999, 2024-09-14T09:08:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013000444999999999, 2024-09-14T09:08:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3475 2024-09-14T09:08:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.46e-07 2024-09-14T09:08:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039795+0000", 2024-09-14T09:08:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.863e-06 2024-09-14T09:08:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039802+0000", 2024-09-14T09:08:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3780000000000003e-06 2024-09-14T09:08:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039807+0000", 2024-09-14T09:08:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2170000000000002e-06 2024-09-14T09:08:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052636+0000", 2024-09-14T09:08:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012828278 2024-09-14T09:08:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052714+0000", 2024-09-14T09:08:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7824999999999994e-05 2024-09-14T09:08:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052793+0000", 2024-09-14T09:08:17.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9537999999999996e-05 2024-09-14T09:08:17.065 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.065 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.065 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.065 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.065 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.065 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:17.067 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:08:17.069 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:17.067+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:17.167 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:17.169+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:17.184 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #14, image image_client.0-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent15 2024-09-14T09:08:17.214 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:17.214 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:17.214 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:08:17.214 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:17.223 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:08:17.307 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:17.309+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:17.369 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:17.370+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:17.404 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:17.404 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:17.404 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:17.404 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:17.404 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:17.414 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:08:17.470 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:17.471+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:17.570 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:17.572+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:17.597 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:17.597 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:17.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:17.597 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:17.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.597 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:704 3.1d 3:baa4605b:::rbd_data.11122fa6a16d.0000000000000004:6 [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:17.597 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862604+0000", 2024-09-14T09:08:17.597 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.735377239000002, 2024-09-14T09:08:17.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019622902000000001, 2024-09-14T09:08:17.597 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.598 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.598 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.598 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.598 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:17.598 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:17.598 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 704 2024-09-14T09:08:17.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.598 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862604+0000", 2024-09-14T09:08:17.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862604+0000", 2024-09-14T09:08:17.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862605+0000", 2024-09-14T09:08:17.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9699999999999996e-07 2024-09-14T09:08:17.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862607+0000", 2024-09-14T09:08:17.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.295e-06 2024-09-14T09:08:17.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862614+0000", 2024-09-14T09:08:17.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1439999999999997e-06 2024-09-14T09:08:17.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862621+0000", 2024-09-14T09:08:17.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6499999999999999e-06 2024-09-14T09:08:17.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882056+0000", 2024-09-14T09:08:17.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019435109999999998 2024-09-14T09:08:17.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882132+0000", 2024-09-14T09:08:17.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6224999999999996e-05 2024-09-14T09:08:17.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882227+0000", 2024-09-14T09:08:17.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4881000000000002e-05 2024-09-14T09:08:17.601 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.602 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.602 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.602 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:705 3.1d 3:baa4605b:::rbd_data.11122fa6a16d.0000000000000004:6 [sparse-read 5636096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:17.602 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862631+0000", 2024-09-14T09:08:17.602 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.735350529000002, 2024-09-14T09:08:17.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019725718999999999, 2024-09-14T09:08:17.602 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.602 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.602 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.602 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.602 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:17.602 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:17.603 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 705 2024-09-14T09:08:17.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.603 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862631+0000", 2024-09-14T09:08:17.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862631+0000", 2024-09-14T09:08:17.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862631+0000", 2024-09-14T09:08:17.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.37e-07 2024-09-14T09:08:17.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862633+0000", 2024-09-14T09:08:17.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0099999999999998e-06 2024-09-14T09:08:17.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862640+0000", 2024-09-14T09:08:17.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5710000000000003e-06 2024-09-14T09:08:17.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862645+0000", 2024-09-14T09:08:17.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0610000000000003e-06 2024-09-14T09:08:17.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882257+0000", 2024-09-14T09:08:17.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019612181999999999 2024-09-14T09:08:17.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882299+0000", 2024-09-14T09:08:17.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1999999999999998e-05 2024-09-14T09:08:17.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882356+0000", 2024-09-14T09:08:17.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7358000000000002e-05 2024-09-14T09:08:17.606 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.606 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.606 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.607 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:718 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 1245184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:17.607 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862653+0000", 2024-09-14T09:08:17.607 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.73532865, 2024-09-14T09:08:17.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019756607999999998, 2024-09-14T09:08:17.607 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.607 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.607 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.607 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.607 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:17.607 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:17.607 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 718 2024-09-14T09:08:17.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.607 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862653+0000", 2024-09-14T09:08:17.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862653+0000", 2024-09-14T09:08:17.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862653+0000", 2024-09-14T09:08:17.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7e-07 2024-09-14T09:08:17.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862655+0000", 2024-09-14T09:08:17.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.962e-06 2024-09-14T09:08:17.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862662+0000", 2024-09-14T09:08:17.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6229999999999999e-06 2024-09-14T09:08:17.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862667+0000", 2024-09-14T09:08:17.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.045e-06 2024-09-14T09:08:17.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882255+0000", 2024-09-14T09:08:17.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019588164000000002 2024-09-14T09:08:17.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882325+0000", 2024-09-14T09:08:17.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0232000000000001e-05 2024-09-14T09:08:17.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882409+0000", 2024-09-14T09:08:17.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4111999999999997e-05 2024-09-14T09:08:17.611 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.611 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.611 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.611 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:719 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 2686976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:17.611 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862674+0000", 2024-09-14T09:08:17.611 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.735307724999998, 2024-09-14T09:08:17.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019857377999999998, 2024-09-14T09:08:17.611 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.611 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.612 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.612 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.612 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:17.612 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:17.612 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 719 2024-09-14T09:08:17.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.612 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862674+0000", 2024-09-14T09:08:17.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862674+0000", 2024-09-14T09:08:17.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862674+0000", 2024-09-14T09:08:17.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2500000000000001e-07 2024-09-14T09:08:17.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862676+0000", 2024-09-14T09:08:17.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.827e-06 2024-09-14T09:08:17.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862684+0000", 2024-09-14T09:08:17.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1920000000000005e-06 2024-09-14T09:08:17.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862689+0000", 2024-09-14T09:08:17.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.882e-06 2024-09-14T09:08:17.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882435+0000", 2024-09-14T09:08:17.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019746260000000002 2024-09-14T09:08:17.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882477+0000", 2024-09-14T09:08:17.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1471999999999999e-05 2024-09-14T09:08:17.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882531+0000", 2024-09-14T09:08:17.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4320000000000002e-05 2024-09-14T09:08:17.615 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.615 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.615 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.616 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:720 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:17.616 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862696+0000", 2024-09-14T09:08:17.616 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.735285659999999, 2024-09-14T09:08:17.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020031767999999998, 2024-09-14T09:08:17.616 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.616 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.616 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.616 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.616 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:17.616 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:17.616 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 720 2024-09-14T09:08:17.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.617 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862696+0000", 2024-09-14T09:08:17.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862696+0000", 2024-09-14T09:08:17.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862696+0000", 2024-09-14T09:08:17.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4499999999999997e-07 2024-09-14T09:08:17.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862698+0000", 2024-09-14T09:08:17.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.835e-06 2024-09-14T09:08:17.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862718+0000", 2024-09-14T09:08:17.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9646000000000001e-05 2024-09-14T09:08:17.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862726+0000", 2024-09-14T09:08:17.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3690000000000007e-06 2024-09-14T09:08:17.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882564+0000", 2024-09-14T09:08:17.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019838198000000001 2024-09-14T09:08:17.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882635+0000", 2024-09-14T09:08:17.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1054000000000001e-05 2024-09-14T09:08:17.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882727+0000", 2024-09-14T09:08:17.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2220999999999997e-05 2024-09-14T09:08:17.620 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.620 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.620 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.621 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:721 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 5636096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:17.621 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862735+0000", 2024-09-14T09:08:17.621 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.735246533000002, 2024-09-14T09:08:17.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020095227, 2024-09-14T09:08:17.621 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.621 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.621 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.621 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.621 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:17.621 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:17.621 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 721 2024-09-14T09:08:17.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.621 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862735+0000", 2024-09-14T09:08:17.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862735+0000", 2024-09-14T09:08:17.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862735+0000", 2024-09-14T09:08:17.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0200000000000002e-07 2024-09-14T09:08:17.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862738+0000", 2024-09-14T09:08:17.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4169999999999999e-06 2024-09-14T09:08:17.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862766+0000", 2024-09-14T09:08:17.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8093999999999999e-05 2024-09-14T09:08:17.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862772+0000", 2024-09-14T09:08:17.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3160000000000002e-06 2024-09-14T09:08:17.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882742+0000", 2024-09-14T09:08:17.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019970102 2024-09-14T09:08:17.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882779+0000", 2024-09-14T09:08:17.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7181000000000002e-05 2024-09-14T09:08:17.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882830+0000", 2024-09-14T09:08:17.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0615000000000002e-05 2024-09-14T09:08:17.625 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.625 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.625 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.625 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:726 3.5 3:a28365af:::rbd_data.11122fa6a16d.0000000000000000:6 [sparse-read 1376256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:17.625 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862793+0000", 2024-09-14T09:08:17.625 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.735188445999999, 2024-09-14T09:08:17.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020238376999999998, 2024-09-14T09:08:17.626 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.626 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.626 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.626 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.626 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:17.626 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:17.626 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 726 2024-09-14T09:08:17.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.626 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862793+0000", 2024-09-14T09:08:17.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862793+0000", 2024-09-14T09:08:17.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862793+0000", 2024-09-14T09:08:17.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5599999999999995e-07 2024-09-14T09:08:17.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862796+0000", 2024-09-14T09:08:17.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6850000000000001e-06 2024-09-14T09:08:17.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862812+0000", 2024-09-14T09:08:17.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6002999999999999e-05 2024-09-14T09:08:17.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862827+0000", 2024-09-14T09:08:17.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.47e-05 2024-09-14T09:08:17.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882861+0000", 2024-09-14T09:08:17.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020034206999999998 2024-09-14T09:08:17.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.882936+0000", 2024-09-14T09:08:17.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4624999999999998e-05 2024-09-14T09:08:17.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883031+0000", 2024-09-14T09:08:17.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5600999999999995e-05 2024-09-14T09:08:17.630 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.630 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.630 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.630 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:727 3.5 3:a28365af:::rbd_data.11122fa6a16d.0000000000000000:6 [sparse-read 2883584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:17.630 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862836+0000", 2024-09-14T09:08:17.630 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.735145014, 2024-09-14T09:08:17.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020407364000000001, 2024-09-14T09:08:17.631 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.631 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.631 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.631 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.631 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:17.631 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:17.631 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 727 2024-09-14T09:08:17.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.631 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862836+0000", 2024-09-14T09:08:17.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862836+0000", 2024-09-14T09:08:17.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862837+0000", 2024-09-14T09:08:17.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.13e-07 2024-09-14T09:08:17.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862839+0000", 2024-09-14T09:08:17.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:08:17.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862847+0000", 2024-09-14T09:08:17.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5039999999999996e-06 2024-09-14T09:08:17.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862852+0000", 2024-09-14T09:08:17.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2050000000000001e-06 2024-09-14T09:08:17.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883068+0000", 2024-09-14T09:08:17.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020216369000000001 2024-09-14T09:08:17.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883145+0000", 2024-09-14T09:08:17.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6790000000000002e-05 2024-09-14T09:08:17.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883244+0000", 2024-09-14T09:08:17.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8697999999999996e-05 2024-09-14T09:08:17.635 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.635 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.635 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.635 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:728 3.5 3:a28365af:::rbd_data.11122fa6a16d.0000000000000000:6 [sparse-read 4325376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:17.635 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862859+0000", 2024-09-14T09:08:17.635 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.735122102999998, 2024-09-14T09:08:17.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020577419, 2024-09-14T09:08:17.636 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.636 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.636 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.636 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.636 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:17.636 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:17.636 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 728 2024-09-14T09:08:17.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.636 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862859+0000", 2024-09-14T09:08:17.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862859+0000", 2024-09-14T09:08:17.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862860+0000", 2024-09-14T09:08:17.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7199999999999999e-07 2024-09-14T09:08:17.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862874+0000", 2024-09-14T09:08:17.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4124000000000001e-05 2024-09-14T09:08:17.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862886+0000", 2024-09-14T09:08:17.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2353e-05 2024-09-14T09:08:17.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862900+0000", 2024-09-14T09:08:17.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3872e-05 2024-09-14T09:08:17.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883274+0000", 2024-09-14T09:08:17.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020373544 2024-09-14T09:08:17.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883352+0000", 2024-09-14T09:08:17.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8394999999999997e-05 2024-09-14T09:08:17.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883437+0000", 2024-09-14T09:08:17.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4559000000000001e-05 2024-09-14T09:08:17.639 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.639 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.640 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.640 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:729 3.5 3:a28365af:::rbd_data.11122fa6a16d.0000000000000000:6 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:17.640 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862909+0000", 2024-09-14T09:08:17.640 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.735072163000002, 2024-09-14T09:08:17.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020750004999999998, 2024-09-14T09:08:17.640 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.640 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.640 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.640 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.640 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:17.640 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:17.641 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 729 2024-09-14T09:08:17.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.641 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862909+0000", 2024-09-14T09:08:17.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862909+0000", 2024-09-14T09:08:17.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862910+0000", 2024-09-14T09:08:17.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6699999999999999e-07 2024-09-14T09:08:17.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862917+0000", 2024-09-14T09:08:17.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0520000000000004e-06 2024-09-14T09:08:17.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862924+0000", 2024-09-14T09:08:17.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4510000000000003e-06 2024-09-14T09:08:17.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862929+0000", 2024-09-14T09:08:17.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2549999999999997e-06 2024-09-14T09:08:17.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883484+0000", 2024-09-14T09:08:17.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.02055446 2024-09-14T09:08:17.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883558+0000", 2024-09-14T09:08:17.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3916000000000002e-05 2024-09-14T09:08:17.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883659+0000", 2024-09-14T09:08:17.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010140399999999999 2024-09-14T09:08:17.644 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.644 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.644 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.645 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:742 3.1d 3:baa4605b:::rbd_data.11122fa6a16d.0000000000000004:6 [sparse-read 1376256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:17.645 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862936+0000", 2024-09-14T09:08:17.645 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.735044904999999, 2024-09-14T09:08:17.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020679486, 2024-09-14T09:08:17.645 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.645 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.645 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.645 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.645 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:17.645 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:17.645 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 742 2024-09-14T09:08:17.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.646 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862936+0000", 2024-09-14T09:08:17.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862936+0000", 2024-09-14T09:08:17.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862937+0000", 2024-09-14T09:08:17.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0200000000000002e-07 2024-09-14T09:08:17.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862939+0000", 2024-09-14T09:08:17.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0099999999999998e-06 2024-09-14T09:08:17.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862945+0000", 2024-09-14T09:08:17.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4180000000000002e-06 2024-09-14T09:08:17.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862950+0000", 2024-09-14T09:08:17.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0799999999999996e-06 2024-09-14T09:08:17.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883465+0000", 2024-09-14T09:08:17.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020514549999999999 2024-09-14T09:08:17.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883527+0000", 2024-09-14T09:08:17.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2494000000000002e-05 2024-09-14T09:08:17.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883616+0000", 2024-09-14T09:08:17.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8431999999999996e-05 2024-09-14T09:08:17.649 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.649 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.649 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.650 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:743 3.1d 3:baa4605b:::rbd_data.11122fa6a16d.0000000000000004:6 [sparse-read 2818048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:17.650 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862957+0000", 2024-09-14T09:08:17.650 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.735024074000002, 2024-09-14T09:08:17.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020911032, 2024-09-14T09:08:17.650 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.650 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.650 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.650 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.650 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:17.650 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:17.650 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 743 2024-09-14T09:08:17.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.651 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862957+0000", 2024-09-14T09:08:17.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862957+0000", 2024-09-14T09:08:17.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862958+0000", 2024-09-14T09:08:17.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9500000000000003e-07 2024-09-14T09:08:17.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862959+0000", 2024-09-14T09:08:17.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.756e-06 2024-09-14T09:08:17.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862972+0000", 2024-09-14T09:08:17.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2567e-05 2024-09-14T09:08:17.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862978+0000", 2024-09-14T09:08:17.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9499999999999998e-06 2024-09-14T09:08:17.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883651+0000", 2024-09-14T09:08:17.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020673305999999999 2024-09-14T09:08:17.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883759+0000", 2024-09-14T09:08:17.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001075 2024-09-14T09:08:17.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883868+0000", 2024-09-14T09:08:17.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010945799999999999 2024-09-14T09:08:17.654 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.654 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.654 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.654 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:744 3.1d 3:baa4605b:::rbd_data.11122fa6a16d.0000000000000004:6 [sparse-read 4325376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:17.654 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.862986+0000", 2024-09-14T09:08:17.654 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.734995666, 2024-09-14T09:08:17.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021124403, 2024-09-14T09:08:17.654 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.654 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.655 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.655 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.655 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:17.655 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:17.655 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 744 2024-09-14T09:08:17.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.655 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862986+0000", 2024-09-14T09:08:17.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862986+0000", 2024-09-14T09:08:17.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862986+0000", 2024-09-14T09:08:17.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7e-07 2024-09-14T09:08:17.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862988+0000", 2024-09-14T09:08:17.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9769999999999999e-06 2024-09-14T09:08:17.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.862995+0000", 2024-09-14T09:08:17.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7510000000000002e-06 2024-09-14T09:08:17.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863000+0000", 2024-09-14T09:08:17.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.259e-06 2024-09-14T09:08:17.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883908+0000", 2024-09-14T09:08:17.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020908095000000002 2024-09-14T09:08:17.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.883999+0000", 2024-09-14T09:08:17.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0741000000000004e-05 2024-09-14T09:08:17.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884110+0000", 2024-09-14T09:08:17.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011111 2024-09-14T09:08:17.658 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.659 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.659 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.659 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:745 3.1d 3:baa4605b:::rbd_data.11122fa6a16d.0000000000000004:6 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:17.659 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863007+0000", 2024-09-14T09:08:17.659 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.734973943, 2024-09-14T09:08:17.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021273830000000001, 2024-09-14T09:08:17.659 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.659 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.659 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.659 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.659 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:17.659 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:17.660 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 745 2024-09-14T09:08:17.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.660 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863007+0000", 2024-09-14T09:08:17.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863007+0000", 2024-09-14T09:08:17.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863008+0000", 2024-09-14T09:08:17.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:08:17.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863010+0000", 2024-09-14T09:08:17.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.903e-06 2024-09-14T09:08:17.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863018+0000", 2024-09-14T09:08:17.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0970000000000006e-06 2024-09-14T09:08:17.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863023+0000", 2024-09-14T09:08:17.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1030000000000001e-06 2024-09-14T09:08:17.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884157+0000", 2024-09-14T09:08:17.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021134303 2024-09-14T09:08:17.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884226+0000", 2024-09-14T09:08:17.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9004000000000005e-05 2024-09-14T09:08:17.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884281+0000", 2024-09-14T09:08:17.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4994000000000002e-05 2024-09-14T09:08:17.663 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.663 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.663 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.663 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:758 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:17.663 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863037+0000", 2024-09-14T09:08:17.663 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.734944735999999, 2024-09-14T09:08:17.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021271691999999998, 2024-09-14T09:08:17.664 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.664 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.664 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:17.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:17.664 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 758 2024-09-14T09:08:17.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.664 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863037+0000", 2024-09-14T09:08:17.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863037+0000", 2024-09-14T09:08:17.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863037+0000", 2024-09-14T09:08:17.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5699999999999998e-07 2024-09-14T09:08:17.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863039+0000", 2024-09-14T09:08:17.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2709999999999999e-06 2024-09-14T09:08:17.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863046+0000", 2024-09-14T09:08:17.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1380000000000001e-06 2024-09-14T09:08:17.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863052+0000", 2024-09-14T09:08:17.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1399999999999999e-06 2024-09-14T09:08:17.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884146+0000", 2024-09-14T09:08:17.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021094497 2024-09-14T09:08:17.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884217+0000", 2024-09-14T09:08:17.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0797999999999995e-05 2024-09-14T09:08:17.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884308+0000", 2024-09-14T09:08:17.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1391000000000006e-05 2024-09-14T09:08:17.667 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.667 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.668 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.668 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:759 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 2818048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:17.668 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863059+0000", 2024-09-14T09:08:17.668 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.734921859, 2024-09-14T09:08:17.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021357939999999999, 2024-09-14T09:08:17.668 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.668 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.668 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.668 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.668 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:17.668 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:17.668 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 759 2024-09-14T09:08:17.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.669 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863059+0000", 2024-09-14T09:08:17.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863059+0000", 2024-09-14T09:08:17.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863060+0000", 2024-09-14T09:08:17.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0499999999999999e-07 2024-09-14T09:08:17.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863062+0000", 2024-09-14T09:08:17.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8500000000000001e-06 2024-09-14T09:08:17.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863068+0000", 2024-09-14T09:08:17.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.81e-06 2024-09-14T09:08:17.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863073+0000", 2024-09-14T09:08:17.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9280000000000001e-06 2024-09-14T09:08:17.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884326+0000", 2024-09-14T09:08:17.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021252407000000001 2024-09-14T09:08:17.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884367+0000", 2024-09-14T09:08:17.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0932e-05 2024-09-14T09:08:17.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884417+0000", 2024-09-14T09:08:17.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0608000000000001e-05 2024-09-14T09:08:17.672 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.672 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.672 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.672 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:760 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 4259840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:17.672 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863080+0000", 2024-09-14T09:08:17.672 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.734901556000001, 2024-09-14T09:08:17.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021531615, 2024-09-14T09:08:17.672 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.673 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.673 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.673 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.673 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:17.673 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:17.673 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 760 2024-09-14T09:08:17.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.673 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863080+0000", 2024-09-14T09:08:17.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863080+0000", 2024-09-14T09:08:17.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863080+0000", 2024-09-14T09:08:17.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:08:17.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863082+0000", 2024-09-14T09:08:17.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7460000000000001e-06 2024-09-14T09:08:17.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863088+0000", 2024-09-14T09:08:17.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2319999999999998e-06 2024-09-14T09:08:17.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863093+0000", 2024-09-14T09:08:17.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5199999999999999e-06 2024-09-14T09:08:17.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884449+0000", 2024-09-14T09:08:17.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021356639 2024-09-14T09:08:17.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884522+0000", 2024-09-14T09:08:17.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2696999999999999e-05 2024-09-14T09:08:17.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884611+0000", 2024-09-14T09:08:17.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9389999999999996e-05 2024-09-14T09:08:17.676 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.676 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.676 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.677 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4563.0:761 3.5 3:a2f0fd1c:::rbd_data.11122fa6a16d.0000000000000008:6 [sparse-read 5767168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:17.677 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:55.863099+0000", 2024-09-14T09:08:17.677 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.734882188, 2024-09-14T09:08:17.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021615771999999998, 2024-09-14T09:08:17.677 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.677 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.677 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.677 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.677 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4563", 2024-09-14T09:08:17.677 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:17.677 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 761 2024-09-14T09:08:17.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.677 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863099+0000", 2024-09-14T09:08:17.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863099+0000", 2024-09-14T09:08:17.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863100+0000", 2024-09-14T09:08:17.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7199999999999999e-07 2024-09-14T09:08:17.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863101+0000", 2024-09-14T09:08:17.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6810000000000001e-06 2024-09-14T09:08:17.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863108+0000", 2024-09-14T09:08:17.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.19e-06 2024-09-14T09:08:17.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.863119+0000", 2024-09-14T09:08:17.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1107000000000001e-05 2024-09-14T09:08:17.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884625+0000", 2024-09-14T09:08:17.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021506464999999999 2024-09-14T09:08:17.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884665+0000", 2024-09-14T09:08:17.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9473e-05 2024-09-14T09:08:17.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:55.884715+0000", 2024-09-14T09:08:17.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0284000000000002e-05 2024-09-14T09:08:17.681 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.681 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.681 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.681 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4604.0:364 3.1d 3:bb0fb96d:::rbd_data.1112609a9334.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 28633088~35328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-14T09:08:17.681 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:04.667444+0000", 2024-09-14T09:08:17.681 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.930537184, 2024-09-14T09:08:17.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052308081999999999, 2024-09-14T09:08:17.682 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.682 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.682 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:17.682 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.682 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4604", 2024-09-14T09:08:17.682 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/335524879", 2024-09-14T09:08:17.682 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 364 2024-09-14T09:08:17.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.682 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.667444+0000", 2024-09-14T09:08:17.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.667444+0000", 2024-09-14T09:08:17.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.667445+0000", 2024-09-14T09:08:17.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1999999999999998e-07 2024-09-14T09:08:17.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681087+0000", 2024-09-14T09:08:17.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013641863000000001 2024-09-14T09:08:17.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681113+0000", 2024-09-14T09:08:17.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6310000000000001e-05 2024-09-14T09:08:17.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681123+0000", 2024-09-14T09:08:17.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7289999999999995e-06 2024-09-14T09:08:17.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681203+0000", 2024-09-14T09:08:17.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0628000000000001e-05 2024-09-14T09:08:17.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681323+0000", 2024-09-14T09:08:17.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000119722 2024-09-14T09:08:17.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:17.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.682203+0000", 2024-09-14T09:08:17.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00087938299999999997 2024-09-14T09:08:17.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:17.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719043+0000", 2024-09-14T09:08:17.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036840218000000001 2024-09-14T09:08:17.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:17.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719654+0000", 2024-09-14T09:08:17.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00061077199999999999 2024-09-14T09:08:17.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:17.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719698+0000", 2024-09-14T09:08:17.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4177000000000001e-05 2024-09-14T09:08:17.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719752+0000", 2024-09-14T09:08:17.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4459999999999997e-05 2024-09-14T09:08:17.687 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.687 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.687 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.687 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4819.0:1491 3.2 3:40286cb8:::rbd_data.1112f78a064a.000000000000000a:10 [read 196608~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-14T09:08:17.687 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:12.863936+0000", 2024-09-14T09:08:17.688 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.734044828, 2024-09-14T09:08:17.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019602169999999999, 2024-09-14T09:08:17.688 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:17.688 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:17.688 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:17.688 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:17.688 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4819", 2024-09-14T09:08:17.688 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:17.688 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1491 2024-09-14T09:08:17.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.688 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:17.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:17.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.863936+0000", 2024-09-14T09:08:17.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:17.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.863936+0000", 2024-09-14T09:08:17.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:17.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:17.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.863937+0000", 2024-09-14T09:08:17.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1e-07 2024-09-14T09:08:17.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:17.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.863938+0000", 2024-09-14T09:08:17.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.062e-06 2024-09-14T09:08:17.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:17.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.863941+0000", 2024-09-14T09:08:17.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9639999999999999e-06 2024-09-14T09:08:17.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:17.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.863943+0000", 2024-09-14T09:08:17.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.57e-06 2024-09-14T09:08:17.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:17.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.883405+0000", 2024-09-14T09:08:17.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019461790999999999 2024-09-14T09:08:17.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:17.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.883459+0000", 2024-09-14T09:08:17.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3859000000000001e-05 2024-09-14T09:08:17.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:17.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:17.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:17.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:12.883539+0000", 2024-09-14T09:08:17.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9714000000000003e-05 2024-09-14T09:08:17.692 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.692 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.692 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.692 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:17.692 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:17.692 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:17.693 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:08:17.694 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:17.695+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:17.794 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:17.795+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:17.802 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:17.802 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:17.803 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:17.803 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:17.811 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:08:17.894 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:17.897+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:17.948 INFO:teuthology.orchestra.run.smithi148.stdout:2528 write 0xde07200 thru 0xde0e988 (0x7789 bytes) 2024-09-14T09:08:17.949 INFO:teuthology.orchestra.run.smithi148.stdout:2529 write 0x6b06e00 thru 0x6b14bc5 (0xddc6 bytes) 2024-09-14T09:08:17.949 INFO:teuthology.orchestra.run.smithi148.stdout:2530 read 0x580d000 thru 0x581a004 (0xd005 bytes) 2024-09-14T09:08:17.955 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:17.956 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:17.956 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:17.956 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:17.956 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:17.957 INFO:teuthology.orchestra.run.smithi148.stdout:2531 trunc from 0xde0ea00 to 0x6d0a200 2024-09-14T09:08:17.967 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:08:17.996 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:17.998+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:18.020 INFO:teuthology.orchestra.run.smithi148.stdout:2532 write 0xdead000 thru 0xdebbe33 (0xee34 bytes) 2024-09-14T09:08:18.027 INFO:teuthology.orchestra.run.smithi148.stdout:2533 write 0x1ef9c00 thru 0x1f0721e (0xd61f bytes) 2024-09-14T09:08:18.027 INFO:teuthology.orchestra.run.smithi148.stdout:2534 read 0x52d9000 thru 0x52e0d3d (0x7d3e bytes) 2024-09-14T09:08:18.027 INFO:teuthology.orchestra.run.smithi148.stdout:2535 write 0x86d5400 thru 0x86daaef (0x56f0 bytes) 2024-09-14T09:08:18.040 INFO:teuthology.orchestra.run.smithi148.stdout:2536 trunc from 0xdebc000 to 0x30e6e00 2024-09-14T09:08:18.092 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:18.092 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:18.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4563.0:1159 3.7 e31/22 3:e6c13853:::rbd_object_map.111276489662.0000000000000007:head v 31'235, mlcod=30'233)", 2024-09-14T09:08:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.343595+0000", 2024-09-14T09:08:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 21.749796595999999, 2024-09-14T09:08:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031037040000000001, 2024-09-14T09:08:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343595+0000", 2024-09-14T09:08:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343595+0000", 2024-09-14T09:08:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343595+0000", 2024-09-14T09:08:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6899999999999999e-07 2024-09-14T09:08:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343599+0000", 2024-09-14T09:08:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0090000000000001e-06 2024-09-14T09:08:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343610+0000", 2024-09-14T09:08:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0661e-05 2024-09-14T09:08:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343619+0000", 2024-09-14T09:08:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2059999999999996e-06 2024-09-14T09:08:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343667+0000", 2024-09-14T09:08:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7611999999999997e-05 2024-09-14T09:08:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.343683+0000", 2024-09-14T09:08:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5917999999999999e-05 2024-09-14T09:08:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.346665+0000", 2024-09-14T09:08:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029824840000000001 2024-09-14T09:08:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.346699+0000", 2024-09-14T09:08:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3645000000000001e-05 2024-09-14T09:08:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4671.0:2426 3.9 e36/22 3:972a2435:::rbd_data.1112ca7492e7.0000000000000024:head v 36'74, mlcod=35'71)", 2024-09-14T09:08:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.895232+0000", 2024-09-14T09:08:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.198159286999999, 2024-09-14T09:08:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0041573369999999997, 2024-09-14T09:08:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895232+0000", 2024-09-14T09:08:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895232+0000", 2024-09-14T09:08:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895233+0000", 2024-09-14T09:08:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6399999999999998e-07 2024-09-14T09:08:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895237+0000", 2024-09-14T09:08:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1559999999999997e-06 2024-09-14T09:08:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895246+0000", 2024-09-14T09:08:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5310000000000007e-06 2024-09-14T09:08:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895253+0000", 2024-09-14T09:08:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9070000000000001e-06 2024-09-14T09:08:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895309+0000", 2024-09-14T09:08:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6187999999999998e-05 2024-09-14T09:08:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895327+0000", 2024-09-14T09:08:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7277000000000001e-05 2024-09-14T09:08:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.899348+0000", 2024-09-14T09:08:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040209130000000001 2024-09-14T09:08:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.899390+0000", 2024-09-14T09:08:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2101000000000002e-05 2024-09-14T09:08:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4671.0:2450 3.c e36/22 3:31a26635:::rbd_data.1112ca7492e7.0000000000000055:head v 36'33, mlcod=35'30)", 2024-09-14T09:08:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.895270+0000", 2024-09-14T09:08:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.19812147, 2024-09-14T09:08:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0036394999999999999, 2024-09-14T09:08:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895270+0000", 2024-09-14T09:08:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895270+0000", 2024-09-14T09:08:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895270+0000", 2024-09-14T09:08:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4400000000000001e-07 2024-09-14T09:08:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895278+0000", 2024-09-14T09:08:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1269999999999997e-06 2024-09-14T09:08:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895286+0000", 2024-09-14T09:08:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7339999999999997e-06 2024-09-14T09:08:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895295+0000", 2024-09-14T09:08:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2240000000000001e-06 2024-09-14T09:08:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895394+0000", 2024-09-14T09:08:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8159000000000007e-05 2024-09-14T09:08:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895417+0000", 2024-09-14T09:08:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3235999999999999e-05 2024-09-14T09:08:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.898870+0000", 2024-09-14T09:08:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034533189999999998 2024-09-14T09:08:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.898910+0000", 2024-09-14T09:08:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9456999999999998e-05 2024-09-14T09:08:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4671.0:2457 3.15 e36/22 3:ab68b81a:::rbd_data.1112ca7492e7.000000000000006c:head v 36'61, mlcod=35'58)", 2024-09-14T09:08:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.895311+0000", 2024-09-14T09:08:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.198081117999999, 2024-09-14T09:08:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063523160000000002, 2024-09-14T09:08:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895311+0000", 2024-09-14T09:08:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895311+0000", 2024-09-14T09:08:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895311+0000", 2024-09-14T09:08:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5100000000000001e-07 2024-09-14T09:08:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895317+0000", 2024-09-14T09:08:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.533e-06 2024-09-14T09:08:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895324+0000", 2024-09-14T09:08:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6039999999999998e-06 2024-09-14T09:08:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895329+0000", 2024-09-14T09:08:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6489999999999999e-06 2024-09-14T09:08:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895431+0000", 2024-09-14T09:08:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102632 2024-09-14T09:08:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895450+0000", 2024-09-14T09:08:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8929000000000001e-05 2024-09-14T09:08:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901619+0000", 2024-09-14T09:08:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061693399999999997 2024-09-14T09:08:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901663+0000", 2024-09-14T09:08:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3377999999999997e-05 2024-09-14T09:08:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4671.0:2459 3.2 e36/22 3:477686f7:::rbd_data.1112ca7492e7.000000000000006d:head v 36'16, mlcod=35'11)", 2024-09-14T09:08:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.895770+0000", 2024-09-14T09:08:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.197621281, 2024-09-14T09:08:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058664190000000003, 2024-09-14T09:08:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895770+0000", 2024-09-14T09:08:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895770+0000", 2024-09-14T09:08:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895771+0000", 2024-09-14T09:08:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8500000000000001e-07 2024-09-14T09:08:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895776+0000", 2024-09-14T09:08:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3449999999999996e-06 2024-09-14T09:08:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895785+0000", 2024-09-14T09:08:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9930000000000001e-06 2024-09-14T09:08:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895792+0000", 2024-09-14T09:08:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3269999999999997e-06 2024-09-14T09:08:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895836+0000", 2024-09-14T09:08:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4474999999999997e-05 2024-09-14T09:08:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895855+0000", 2024-09-14T09:08:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8709999999999999e-05 2024-09-14T09:08:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901599+0000", 2024-09-14T09:08:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0057440019999999998 2024-09-14T09:08:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901637+0000", 2024-09-14T09:08:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7882000000000001e-05 2024-09-14T09:08:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4671.0:2452 3.5 e36/22 3:a0dd09af:::rbd_data.1112ca7492e7.0000000000000069:head v 36'120, mlcod=35'115)", 2024-09-14T09:08:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.896937+0000", 2024-09-14T09:08:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.196454938, 2024-09-14T09:08:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050325939999999996, 2024-09-14T09:08:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896937+0000", 2024-09-14T09:08:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896937+0000", 2024-09-14T09:08:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896937+0000", 2024-09-14T09:08:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6799999999999999e-07 2024-09-14T09:08:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896946+0000", 2024-09-14T09:08:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.799e-06 2024-09-14T09:08:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896959+0000", 2024-09-14T09:08:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.308e-05 2024-09-14T09:08:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896967+0000", 2024-09-14T09:08:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1679999999999998e-06 2024-09-14T09:08:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.897028+0000", 2024-09-14T09:08:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1958000000000005e-05 2024-09-14T09:08:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.897049+0000", 2024-09-14T09:08:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0468000000000001e-05 2024-09-14T09:08:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901929+0000", 2024-09-14T09:08:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048796610000000004 2024-09-14T09:08:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901969+0000", 2024-09-14T09:08:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0692000000000003e-05 2024-09-14T09:08:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4671.0:2454 3.9 e36/22 3:9133dedc:::rbd_data.1112ca7492e7.000000000000006a:head v 36'76, mlcod=35'71)", 2024-09-14T09:08:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.898162+0000", 2024-09-14T09:08:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.195230069999999, 2024-09-14T09:08:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037860620000000002, 2024-09-14T09:08:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.898162+0000", 2024-09-14T09:08:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.898162+0000", 2024-09-14T09:08:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.898162+0000", 2024-09-14T09:08:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1900000000000002e-07 2024-09-14T09:08:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.898167+0000", 2024-09-14T09:08:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9880000000000004e-06 2024-09-14T09:08:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.898184+0000", 2024-09-14T09:08:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6974999999999999e-05 2024-09-14T09:08:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.898191+0000", 2024-09-14T09:08:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7150000000000001e-06 2024-09-14T09:08:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.898236+0000", 2024-09-14T09:08:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5459e-05 2024-09-14T09:08:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.898265+0000", 2024-09-14T09:08:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8892000000000001e-05 2024-09-14T09:08:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901911+0000", 2024-09-14T09:08:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003646023 2024-09-14T09:08:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901948+0000", 2024-09-14T09:08:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6390999999999998e-05 2024-09-14T09:08:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4782.0:403 3.1b 3:db2c1e17:::rbd_data.11127a12d636.0000000000000013:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,truncate 3920384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-14T09:08:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:09.334287+0000", 2024-09-14T09:08:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.7591049279999993, 2024-09-14T09:08:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004490529, 2024-09-14T09:08:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4782", 2024-09-14T09:08:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/353415140", 2024-09-14T09:08:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 403 2024-09-14T09:08:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334287+0000", 2024-09-14T09:08:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334287+0000", 2024-09-14T09:08:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334288+0000", 2024-09-14T09:08:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2860000000000001e-06 2024-09-14T09:08:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334294+0000", 2024-09-14T09:08:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8119999999999996e-06 2024-09-14T09:08:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334305+0000", 2024-09-14T09:08:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0710000000000001e-05 2024-09-14T09:08:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334310+0000", 2024-09-14T09:08:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1309999999999997e-06 2024-09-14T09:08:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334355+0000", 2024-09-14T09:08:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5002e-05 2024-09-14T09:08:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334441+0000", 2024-09-14T09:08:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6632999999999995e-05 2024-09-14T09:08:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334550+0000", 2024-09-14T09:08:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010870999999999999 2024-09-14T09:08:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334949+0000", 2024-09-14T09:08:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00039932800000000001 2024-09-14T09:08:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.338702+0000", 2024-09-14T09:08:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037526529999999999 2024-09-14T09:08:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.338749+0000", 2024-09-14T09:08:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6579999999999998e-05 2024-09-14T09:08:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.338777+0000", 2024-09-14T09:08:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8683999999999998e-05 2024-09-14T09:08:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4782.0:881 3.1b 3:d82d5c58:::rbd_data.11127a12d636.000000000000000b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,truncate 4063232] snapc f=[f] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T09:08:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:09.937996+0000", 2024-09-14T09:08:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1553960770000007, 2024-09-14T09:08:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0081376629999999998, 2024-09-14T09:08:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4782", 2024-09-14T09:08:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/353415140", 2024-09-14T09:08:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 881 2024-09-14T09:08:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.937996+0000", 2024-09-14T09:08:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.937996+0000", 2024-09-14T09:08:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.937997+0000", 2024-09-14T09:08:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2419999999999999e-06 2024-09-14T09:08:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938002+0000", 2024-09-14T09:08:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3870000000000003e-06 2024-09-14T09:08:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938014+0000", 2024-09-14T09:08:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.22e-05 2024-09-14T09:08:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938020+0000", 2024-09-14T09:08:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9619999999999998e-06 2024-09-14T09:08:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938062+0000", 2024-09-14T09:08:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2150000000000001e-05 2024-09-14T09:08:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938156+0000", 2024-09-14T09:08:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3344999999999995e-05 2024-09-14T09:08:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938275+0000", 2024-09-14T09:08:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000118983 2024-09-14T09:08:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941256+0000", 2024-09-14T09:08:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002981151 2024-09-14T09:08:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.946065+0000", 2024-09-14T09:08:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048087190000000004 2024-09-14T09:08:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.946104+0000", 2024-09-14T09:08:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9363000000000002e-05 2024-09-14T09:08:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.946133+0000", 2024-09-14T09:08:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9161000000000001e-05 2024-09-14T09:08:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4782.0:883 3.1b 3:de177a91:::rbd_data.11127a12d636.000000000000000d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T09:08:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:09.940054+0000", 2024-09-14T09:08:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1533372079999999, 2024-09-14T09:08:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080861400000000003, 2024-09-14T09:08:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4782", 2024-09-14T09:08:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/353415140", 2024-09-14T09:08:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 883 2024-09-14T09:08:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.940054+0000", 2024-09-14T09:08:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.940054+0000", 2024-09-14T09:08:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.940055+0000", 2024-09-14T09:08:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5899999999999995e-07 2024-09-14T09:08:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941937+0000", 2024-09-14T09:08:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018813230000000001 2024-09-14T09:08:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941948+0000", 2024-09-14T09:08:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1542999999999999e-05 2024-09-14T09:08:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941954+0000", 2024-09-14T09:08:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1109999999999996e-06 2024-09-14T09:08:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.942005+0000", 2024-09-14T09:08:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1286000000000003e-05 2024-09-14T09:08:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.942126+0000", 2024-09-14T09:08:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012029800000000001 2024-09-14T09:08:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.942401+0000", 2024-09-14T09:08:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00027493500000000002 2024-09-14T09:08:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.946143+0000", 2024-09-14T09:08:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037426130000000001 2024-09-14T09:08:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.948084+0000", 2024-09-14T09:08:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001940862 2024-09-14T09:08:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.948117+0000", 2024-09-14T09:08:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3309999999999998e-05 2024-09-14T09:08:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.948141+0000", 2024-09-14T09:08:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3099999999999999e-05 2024-09-14T09:08:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4782.0:884 3.1b 3:de177a91:::rbd_data.11127a12d636.000000000000000d:head [truncate 4063232] snapc f=[f] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T09:08:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:09.941969+0000", 2024-09-14T09:08:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1514229379999996, 2024-09-14T09:08:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065065640000000003, 2024-09-14T09:08:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4782", 2024-09-14T09:08:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/353415140", 2024-09-14T09:08:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 884 2024-09-14T09:08:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941969+0000", 2024-09-14T09:08:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941969+0000", 2024-09-14T09:08:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941969+0000", 2024-09-14T09:08:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6700000000000003e-07 2024-09-14T09:08:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941971+0000", 2024-09-14T09:08:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.748e-06 2024-09-14T09:08:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941980+0000", 2024-09-14T09:08:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7120000000000006e-06 2024-09-14T09:08:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941983+0000", 2024-09-14T09:08:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5549999999999998e-06 2024-09-14T09:08:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.944525+0000", 2024-09-14T09:08:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025416029999999999 2024-09-14T09:08:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.944592+0000", 2024-09-14T09:08:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6871000000000004e-05 2024-09-14T09:08:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.944720+0000", 2024-09-14T09:08:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012863600000000001 2024-09-14T09:08:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.946292+0000", 2024-09-14T09:08:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015713470000000001 2024-09-14T09:08:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.948426+0000", 2024-09-14T09:08:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021343669999999999 2024-09-14T09:08:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.948453+0000", 2024-09-14T09:08:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6574999999999999e-05 2024-09-14T09:08:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.948475+0000", 2024-09-14T09:08:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2483000000000001e-05 2024-09-14T09:08:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(client.4782.0:881 3.1b e41/22 ondisk, result = 0)", 2024-09-14T09:08:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:09.942117+0000", 2024-09-14T09:08:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.1512747189999999, 2024-09-14T09:08:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040219990000000001, 2024-09-14T09:08:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.942117+0000", 2024-09-14T09:08:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.942117+0000", 2024-09-14T09:08:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.942118+0000", 2024-09-14T09:08:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6500000000000008e-07 2024-09-14T09:08:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.942123+0000", 2024-09-14T09:08:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1139999999999997e-06 2024-09-14T09:08:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.942135+0000", 2024-09-14T09:08:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1522000000000001e-05 2024-09-14T09:08:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.942142+0000", 2024-09-14T09:08:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.374e-06 2024-09-14T09:08:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.946056+0000", 2024-09-14T09:08:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039138710000000002 2024-09-14T09:08:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.946061+0000", 2024-09-14T09:08:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.921e-06 2024-09-14T09:08:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.946139+0000", 2024-09-14T09:08:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8232000000000006e-05 2024-09-14T09:08:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4819.0:2996 3.1b 3:ddac6bbf:::rbd_data.111258e7abd2.000000000000002a:head [set-alloc-hint object_size 524288 write_size 524288,write 294912~11264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-14T09:08:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:13.454873+0000", 2024-09-14T09:08:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.6385191250000002, 2024-09-14T09:08:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035660510000000002, 2024-09-14T09:08:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4819", 2024-09-14T09:08:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2996 2024-09-14T09:08:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.454873+0000", 2024-09-14T09:08:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.454873+0000", 2024-09-14T09:08:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.454873+0000", 2024-09-14T09:08:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:08:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.454890+0000", 2024-09-14T09:08:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7133999999999999e-05 2024-09-14T09:08:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.454896+0000", 2024-09-14T09:08:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9460000000000003e-06 2024-09-14T09:08:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.454900+0000", 2024-09-14T09:08:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.653e-06 2024-09-14T09:08:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.455402+0000", 2024-09-14T09:08:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00050244000000000005 2024-09-14T09:08:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.455532+0000", 2024-09-14T09:08:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000130288 2024-09-14T09:08:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.455671+0000", 2024-09-14T09:08:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138133 2024-09-14T09:08:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.456399+0000", 2024-09-14T09:08:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00072844700000000001 2024-09-14T09:08:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.458347+0000", 2024-09-14T09:08:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019478029999999999 2024-09-14T09:08:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.458404+0000", 2024-09-14T09:08:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6916999999999997e-05 2024-09-14T09:08:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.458439+0000", 2024-09-14T09:08:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4780999999999998e-05 2024-09-14T09:08:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4819.0:3765 3.1b 3:d863f74f:::rbd_data.111258e7abd2.0000000000000096:head [set-alloc-hint object_size 524288 write_size 524288,write 382976~10240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-14T09:08:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:13.751791+0000", 2024-09-14T09:08:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3416006649999996, 2024-09-14T09:08:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003969775, 2024-09-14T09:08:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4819", 2024-09-14T09:08:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3765 2024-09-14T09:08:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.751791+0000", 2024-09-14T09:08:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.751791+0000", 2024-09-14T09:08:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.751792+0000", 2024-09-14T09:08:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2900000000000003e-07 2024-09-14T09:08:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.751801+0000", 2024-09-14T09:08:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8400000000000001e-06 2024-09-14T09:08:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.751810+0000", 2024-09-14T09:08:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7350000000000008e-06 2024-09-14T09:08:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.751816+0000", 2024-09-14T09:08:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2349999999999999e-06 2024-09-14T09:08:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.751857+0000", 2024-09-14T09:08:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1831e-05 2024-09-14T09:08:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.751943+0000", 2024-09-14T09:08:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5993000000000002e-05 2024-09-14T09:08:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.752029+0000", 2024-09-14T09:08:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6164999999999999e-05 2024-09-14T09:08:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.752745+0000", 2024-09-14T09:08:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00071513999999999996 2024-09-14T09:08:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.755706+0000", 2024-09-14T09:08:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029611080000000001 2024-09-14T09:08:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.755739+0000", 2024-09-14T09:08:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3648e-05 2024-09-14T09:08:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:13.755761+0000", 2024-09-14T09:08:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1350999999999999e-05 2024-09-14T09:08:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4819.0:4705 3.1b 3:da69c123:::rbd_data.111258e7abd2.0000000000000051:head [set-alloc-hint object_size 524288 write_size 524288,write 453632~5120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-14T09:08:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:14.120590+0000", 2024-09-14T09:08:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.9728016290000001, 2024-09-14T09:08:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043509020000000002, 2024-09-14T09:08:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4819", 2024-09-14T09:08:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4705 2024-09-14T09:08:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120590+0000", 2024-09-14T09:08:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120590+0000", 2024-09-14T09:08:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120591+0000", 2024-09-14T09:08:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6000000000000003e-07 2024-09-14T09:08:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120599+0000", 2024-09-14T09:08:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1070000000000005e-06 2024-09-14T09:08:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120609+0000", 2024-09-14T09:08:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0227000000000001e-05 2024-09-14T09:08:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120632+0000", 2024-09-14T09:08:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2833e-05 2024-09-14T09:08:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120678+0000", 2024-09-14T09:08:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6439e-05 2024-09-14T09:08:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120769+0000", 2024-09-14T09:08:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0919000000000001e-05 2024-09-14T09:08:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120846+0000", 2024-09-14T09:08:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6470999999999993e-05 2024-09-14T09:08:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.121356+0000", 2024-09-14T09:08:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00051052900000000002 2024-09-14T09:08:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.124889+0000", 2024-09-14T09:08:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035324879999999999 2024-09-14T09:08:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.124919+0000", 2024-09-14T09:08:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9768999999999999e-05 2024-09-14T09:08:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.124941+0000", 2024-09-14T09:08:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2359999999999999e-05 2024-09-14T09:08:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4819.0:5071 3.1b 3:dfbbb139:::rbd_data.111258e7abd2.000000000000016e:head [set-alloc-hint object_size 524288 write_size 524288,write 491520~32768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-14T09:08:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:14.249142+0000", 2024-09-14T09:08:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.844249316, 2024-09-14T09:08:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051714309999999998, 2024-09-14T09:08:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4819", 2024-09-14T09:08:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5071 2024-09-14T09:08:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249142+0000", 2024-09-14T09:08:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249142+0000", 2024-09-14T09:08:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249143+0000", 2024-09-14T09:08:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7400000000000002e-07 2024-09-14T09:08:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249170+0000", 2024-09-14T09:08:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7246e-05 2024-09-14T09:08:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249180+0000", 2024-09-14T09:08:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9890000000000004e-06 2024-09-14T09:08:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249185+0000", 2024-09-14T09:08:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0849999999999996e-06 2024-09-14T09:08:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249224+0000", 2024-09-14T09:08:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8828000000000002e-05 2024-09-14T09:08:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249296+0000", 2024-09-14T09:08:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1831999999999999e-05 2024-09-14T09:08:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249375+0000", 2024-09-14T09:08:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9177000000000004e-05 2024-09-14T09:08:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249839+0000", 2024-09-14T09:08:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00046331399999999999 2024-09-14T09:08:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.254263+0000", 2024-09-14T09:08:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044240089999999996 2024-09-14T09:08:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.254293+0000", 2024-09-14T09:08:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0018e-05 2024-09-14T09:08:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.254314+0000", 2024-09-14T09:08:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1158999999999999e-05 2024-09-14T09:08:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4819.0:5341 3.1b 3:de753bd2:::rbd_data.111258e7abd2.0000000000000173:head [set-alloc-hint object_size 524288 write_size 524288,write 262144~32768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-14T09:08:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:14.321846+0000", 2024-09-14T09:08:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.7715455840000001, 2024-09-14T09:08:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039703969999999996, 2024-09-14T09:08:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4819", 2024-09-14T09:08:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5341 2024-09-14T09:08:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.321846+0000", 2024-09-14T09:08:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.321846+0000", 2024-09-14T09:08:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.321847+0000", 2024-09-14T09:08:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0599999999999999e-07 2024-09-14T09:08:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.321863+0000", 2024-09-14T09:08:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5951999999999999e-05 2024-09-14T09:08:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.321873+0000", 2024-09-14T09:08:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0502999999999999e-05 2024-09-14T09:08:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.321878+0000", 2024-09-14T09:08:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9849999999999997e-06 2024-09-14T09:08:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.321939+0000", 2024-09-14T09:08:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0399999999999998e-05 2024-09-14T09:08:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.322023+0000", 2024-09-14T09:08:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3978000000000001e-05 2024-09-14T09:08:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.322101+0000", 2024-09-14T09:08:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7989000000000002e-05 2024-09-14T09:08:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.322609+0000", 2024-09-14T09:08:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00050820800000000001 2024-09-14T09:08:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.325763+0000", 2024-09-14T09:08:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031539670000000001 2024-09-14T09:08:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.325794+0000", 2024-09-14T09:08:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1634999999999998e-05 2024-09-14T09:08:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.325816+0000", 2024-09-14T09:08:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1974e-05 2024-09-14T09:08:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4819.0:5479 3.1b 3:de753bd2:::rbd_data.111258e7abd2.0000000000000173:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-14T09:08:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:14.369980+0000", 2024-09-14T09:08:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.7234120829999999, 2024-09-14T09:08:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051695830000000002, 2024-09-14T09:08:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4819", 2024-09-14T09:08:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5479 2024-09-14T09:08:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.369980+0000", 2024-09-14T09:08:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.369980+0000", 2024-09-14T09:08:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.369981+0000", 2024-09-14T09:08:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9130000000000001e-06 2024-09-14T09:08:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.369990+0000", 2024-09-14T09:08:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7329999999999992e-06 2024-09-14T09:08:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.370018+0000", 2024-09-14T09:08:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7710000000000001e-05 2024-09-14T09:08:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.370037+0000", 2024-09-14T09:08:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9196000000000001e-05 2024-09-14T09:08:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.370152+0000", 2024-09-14T09:08:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011479799999999999 2024-09-14T09:08:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.370236+0000", 2024-09-14T09:08:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3628999999999995e-05 2024-09-14T09:08:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.370348+0000", 2024-09-14T09:08:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112884 2024-09-14T09:08:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.371164+0000", 2024-09-14T09:08:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00081568199999999997 2024-09-14T09:08:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.375085+0000", 2024-09-14T09:08:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039209900000000001 2024-09-14T09:08:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.375114+0000", 2024-09-14T09:08:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9141000000000001e-05 2024-09-14T09:08:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.375149+0000", 2024-09-14T09:08:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4907000000000003e-05 2024-09-14T09:08:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4819.0:5648 3.1b 3:ddac6bbf:::rbd_data.111258e7abd2.000000000000002a:head [set-alloc-hint object_size 524288 write_size 524288,write 211456~17920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-14T09:08:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:14.428139+0000", 2024-09-14T09:08:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.6652528950000001, 2024-09-14T09:08:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043123170000000004, 2024-09-14T09:08:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4819", 2024-09-14T09:08:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5648 2024-09-14T09:08:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428139+0000", 2024-09-14T09:08:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428139+0000", 2024-09-14T09:08:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428139+0000", 2024-09-14T09:08:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.99e-07 2024-09-14T09:08:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428157+0000", 2024-09-14T09:08:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7706999999999998e-05 2024-09-14T09:08:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428168+0000", 2024-09-14T09:08:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1088e-05 2024-09-14T09:08:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428174+0000", 2024-09-14T09:08:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.942e-06 2024-09-14T09:08:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428211+0000", 2024-09-14T09:08:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6968000000000002e-05 2024-09-14T09:08:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428256+0000", 2024-09-14T09:08:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5207999999999998e-05 2024-09-14T09:08:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428371+0000", 2024-09-14T09:08:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114215 2024-09-14T09:08:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428917+0000", 2024-09-14T09:08:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00054596099999999997 2024-09-14T09:08:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.432364+0000", 2024-09-14T09:08:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003447327 2024-09-14T09:08:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.432415+0000", 2024-09-14T09:08:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0692000000000002e-05 2024-09-14T09:08:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.432451+0000", 2024-09-14T09:08:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6510000000000001e-05 2024-09-14T09:08:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4819.0:5992 3.1b 3:d863f74f:::rbd_data.111258e7abd2.0000000000000096:head [set-alloc-hint object_size 524288 write_size 524288,write 275456~19456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-14T09:08:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:14.561771+0000", 2024-09-14T09:08:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.5316207550000001, 2024-09-14T09:08:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044464300000000003, 2024-09-14T09:08:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4819", 2024-09-14T09:08:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5992 2024-09-14T09:08:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561771+0000", 2024-09-14T09:08:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561771+0000", 2024-09-14T09:08:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561772+0000", 2024-09-14T09:08:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1999999999999998e-07 2024-09-14T09:08:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561792+0000", 2024-09-14T09:08:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0615000000000002e-05 2024-09-14T09:08:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561803+0000", 2024-09-14T09:08:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0997e-05 2024-09-14T09:08:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561810+0000", 2024-09-14T09:08:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.353e-06 2024-09-14T09:08:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561853+0000", 2024-09-14T09:08:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2855999999999998e-05 2024-09-14T09:08:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561897+0000", 2024-09-14T09:08:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4978000000000002e-05 2024-09-14T09:08:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561976+0000", 2024-09-14T09:08:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8857999999999996e-05 2024-09-14T09:08:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.562543+0000", 2024-09-14T09:08:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056632500000000001 2024-09-14T09:08:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.566166+0000", 2024-09-14T09:08:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003623214 2024-09-14T09:08:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.566195+0000", 2024-09-14T09:08:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9349999999999999e-05 2024-09-14T09:08:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.566217+0000", 2024-09-14T09:08:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2064000000000001e-05 2024-09-14T09:08:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.198 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:18.200 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:18.201+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:18.201 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:08:18.202 INFO:teuthology.orchestra.run.smithi148.stdout:2540 write 0x9656a00 thru 0x9660111 (0x9712 bytes) 2024-09-14T09:08:18.202 INFO:teuthology.orchestra.run.smithi148.stdout:2541 punch from 0x632400 to 0x641400, (0xf000 bytes) 2024-09-14T09:08:18.202 INFO:teuthology.orchestra.run.smithi148.stdout:2543 write 0x7871c00 thru 0x787d1a1 (0xb5a2 bytes) 2024-09-14T09:08:18.202 INFO:teuthology.orchestra.run.smithi148.stdout:2550 read 0x81e7000 thru 0x81ed01b (0x601c bytes) 2024-09-14T09:08:18.202 INFO:teuthology.orchestra.run.smithi148.stdout:2552 trunc from 0x9660200 to 0x7740400 2024-09-14T09:08:18.202 INFO:teuthology.orchestra.run.smithi148.stdout:2553 write 0xd151c00 thru 0xd15fe1d (0xe21e bytes) 2024-09-14T09:08:18.202 INFO:teuthology.orchestra.run.smithi148.stdout:2554 read 0xd70a00 thru 0xd714e9 (0xaea bytes) 2024-09-14T09:08:18.203 INFO:teuthology.orchestra.run.smithi148.stdout:2555 read 0xa2bc000 thru 0xa2c1ec8 (0x5ec9 bytes) 2024-09-14T09:08:18.203 INFO:teuthology.orchestra.run.smithi148.stdout:2556 punch from 0xabf6400 to 0xac01400, (0xb000 bytes) 2024-09-14T09:08:18.203 INFO:teuthology.orchestra.run.smithi148.stdout:2557 read 0x2b67800 thru 0x2b72ab8 (0xb2b9 bytes) 2024-09-14T09:08:18.203 INFO:teuthology.orchestra.run.smithi148.stdout:2560 read 0x8124a00 thru 0x813194b (0xcf4c bytes) 2024-09-14T09:08:18.203 INFO:teuthology.orchestra.run.smithi148.stdout:2561 punch from 0x4cf5800 to 0x4d03a00, (0xe200 bytes) 2024-09-14T09:08:18.203 INFO:teuthology.orchestra.run.smithi148.stdout:2562 read 0x44f8800 thru 0x4504cb7 (0xc4b8 bytes) 2024-09-14T09:08:18.203 INFO:teuthology.orchestra.run.smithi148.stdout:2563 trunc from 0xd160000 to 0x10e1600 2024-09-14T09:08:18.267 INFO:teuthology.orchestra.run.smithi148.stdout:2565 write 0x8db9c00 thru 0x8dbbb9d (0x1f9e bytes) 2024-09-14T09:08:18.267 INFO:teuthology.orchestra.run.smithi148.stdout:2568 punch from 0x2c47000 to 0x2c50000, (0x9000 bytes) 2024-09-14T09:08:18.268 INFO:teuthology.orchestra.run.smithi148.stdout:2569 read 0x81c2000 thru 0x81c6922 (0x4923 bytes) 2024-09-14T09:08:18.268 INFO:teuthology.orchestra.run.smithi148.stdout:2570 write 0x204d600 thru 0x204d7dd (0x1de bytes) 2024-09-14T09:08:18.268 INFO:teuthology.orchestra.run.smithi148.stdout:2572 write 0x56d1a00 thru 0x56d2034 (0x635 bytes) 2024-09-14T09:08:18.269 INFO:teuthology.orchestra.run.smithi148.stdout:2573 trunc from 0x8dbbc00 to 0x93df000 2024-09-14T09:08:18.300 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:18.302+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:18.317 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:18.318 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:18.318 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:18.318 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:18.326 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:08:18.401 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:18.403+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:18.429 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:18.429 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:18.430 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:18.430 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:18.430 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:18.438 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:08:18.502 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:18.504+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:18.513 INFO:teuthology.orchestra.run.smithi148.stdout:2578 write 0xe462600 thru 0xe467fef (0x59f0 bytes) 2024-09-14T09:08:18.514 INFO:teuthology.orchestra.run.smithi148.stdout:2579 write 0xe21600 thru 0xe26880 (0x5281 bytes) 2024-09-14T09:08:18.514 INFO:teuthology.orchestra.run.smithi148.stdout:2580 read 0x9402400 thru 0x9406a9f (0x46a0 bytes) 2024-09-14T09:08:18.515 INFO:teuthology.orchestra.run.smithi148.stdout:2583 read 0x2040200 thru 0x204baeb (0xb8ec bytes) 2024-09-14T09:08:18.515 INFO:teuthology.orchestra.run.smithi148.stdout:2584 punch from 0x359e800 to 0x35a5600, (0x6e00 bytes) 2024-09-14T09:08:18.515 INFO:teuthology.orchestra.run.smithi148.stdout:2585 punch from 0xcbb9a00 to 0xcbc3400, (0x9a00 bytes) 2024-09-14T09:08:18.516 INFO:teuthology.orchestra.run.smithi148.stdout:2587 trunc from 0xe468000 to 0xe12d400 2024-09-14T09:08:18.559 INFO:teuthology.orchestra.run.smithi148.stdout:2590 write 0xca33400 thru 0xca33e09 (0xa0a bytes) 2024-09-14T09:08:18.561 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:18.561 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:18.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:18.561 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:18.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.561 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:1137 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:18.561 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.043863+0000", 2024-09-14T09:08:18.561 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.51825346699999997, 2024-09-14T09:08:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018224061, 2024-09-14T09:08:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1137 2024-09-14T09:08:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043863+0000", 2024-09-14T09:08:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043863+0000", 2024-09-14T09:08:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043863+0000", 2024-09-14T09:08:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3099999999999998e-07 2024-09-14T09:08:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043866+0000", 2024-09-14T09:08:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5620000000000002e-06 2024-09-14T09:08:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043872+0000", 2024-09-14T09:08:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5579999999999997e-06 2024-09-14T09:08:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043877+0000", 2024-09-14T09:08:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7299999999999996e-06 2024-09-14T09:08:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056308+0000", 2024-09-14T09:08:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012430925000000001 2024-09-14T09:08:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056382+0000", 2024-09-14T09:08:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3870999999999998e-05 2024-09-14T09:08:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056753+0000", 2024-09-14T09:08:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000371343 2024-09-14T09:08:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.061992+0000", 2024-09-14T09:08:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005238688 2024-09-14T09:08:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.062028+0000", 2024-09-14T09:08:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6040000000000001e-05 2024-09-14T09:08:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.062054+0000", 2024-09-14T09:08:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5856000000000001e-05 2024-09-14T09:08:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.062087+0000", 2024-09-14T09:08:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2957000000000003e-05 2024-09-14T09:08:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:1138 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.044298+0000", 2024-09-14T09:08:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.51781810399999995, 2024-09-14T09:08:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017846833999999999, 2024-09-14T09:08:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1138 2024-09-14T09:08:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044298+0000", 2024-09-14T09:08:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044298+0000", 2024-09-14T09:08:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044299+0000", 2024-09-14T09:08:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0800000000000003e-07 2024-09-14T09:08:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044304+0000", 2024-09-14T09:08:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6519999999999997e-06 2024-09-14T09:08:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044314+0000", 2024-09-14T09:08:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0383e-05 2024-09-14T09:08:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044321+0000", 2024-09-14T09:08:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6449999999999999e-06 2024-09-14T09:08:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.057262+0000", 2024-09-14T09:08:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012941543999999999 2024-09-14T09:08:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.057327+0000", 2024-09-14T09:08:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5013999999999998e-05 2024-09-14T09:08:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.057522+0000", 2024-09-14T09:08:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019433699999999999 2024-09-14T09:08:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.062021+0000", 2024-09-14T09:08:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044997420000000002 2024-09-14T09:08:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.062092+0000", 2024-09-14T09:08:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1182999999999999e-05 2024-09-14T09:08:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.062115+0000", 2024-09-14T09:08:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3019000000000001e-05 2024-09-14T09:08:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.062145+0000", 2024-09-14T09:08:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9407000000000002e-05 2024-09-14T09:08:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:1139 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.044918+0000", 2024-09-14T09:08:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.51719861300000003, 2024-09-14T09:08:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019100876999999999, 2024-09-14T09:08:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1139 2024-09-14T09:08:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044918+0000", 2024-09-14T09:08:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044918+0000", 2024-09-14T09:08:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044918+0000", 2024-09-14T09:08:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2500000000000004e-07 2024-09-14T09:08:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044924+0000", 2024-09-14T09:08:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2050000000000001e-06 2024-09-14T09:08:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044935+0000", 2024-09-14T09:08:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1321000000000001e-05 2024-09-14T09:08:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044942+0000", 2024-09-14T09:08:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.277e-06 2024-09-14T09:08:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.057831+0000", 2024-09-14T09:08:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012888692 2024-09-14T09:08:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.057912+0000", 2024-09-14T09:08:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0875000000000001e-05 2024-09-14T09:08:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.058249+0000", 2024-09-14T09:08:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033680100000000002 2024-09-14T09:08:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.063666+0000", 2024-09-14T09:08:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054178189999999999 2024-09-14T09:08:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.063922+0000", 2024-09-14T09:08:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00025591699999999998 2024-09-14T09:08:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.063978+0000", 2024-09-14T09:08:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5603000000000003e-05 2024-09-14T09:08:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064018+0000", 2024-09-14T09:08:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0441999999999997e-05 2024-09-14T09:08:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:1140 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.045510+0000", 2024-09-14T09:08:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.51660612299999997, 2024-09-14T09:08:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018615145, 2024-09-14T09:08:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1140 2024-09-14T09:08:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045510+0000", 2024-09-14T09:08:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045510+0000", 2024-09-14T09:08:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045511+0000", 2024-09-14T09:08:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8899999999999998e-07 2024-09-14T09:08:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045516+0000", 2024-09-14T09:08:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9749999999999998e-06 2024-09-14T09:08:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045530+0000", 2024-09-14T09:08:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4542000000000001e-05 2024-09-14T09:08:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045542+0000", 2024-09-14T09:08:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1984000000000001e-05 2024-09-14T09:08:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.058561+0000", 2024-09-14T09:08:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01301828 2024-09-14T09:08:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.058628+0000", 2024-09-14T09:08:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7049000000000001e-05 2024-09-14T09:08:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.058827+0000", 2024-09-14T09:08:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019901200000000001 2024-09-14T09:08:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.063672+0000", 2024-09-14T09:08:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048450339999999998 2024-09-14T09:08:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064068+0000", 2024-09-14T09:08:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00039579200000000001 2024-09-14T09:08:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064098+0000", 2024-09-14T09:08:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9940000000000001e-05 2024-09-14T09:08:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064125+0000", 2024-09-14T09:08:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7648e-05 2024-09-14T09:08:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:1141 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.046070+0000", 2024-09-14T09:08:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.51604614999999998, 2024-09-14T09:08:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018223119999999999, 2024-09-14T09:08:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1141 2024-09-14T09:08:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.046070+0000", 2024-09-14T09:08:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.046070+0000", 2024-09-14T09:08:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.046071+0000", 2024-09-14T09:08:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9299999999999997e-07 2024-09-14T09:08:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.046075+0000", 2024-09-14T09:08:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1180000000000002e-06 2024-09-14T09:08:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.046085+0000", 2024-09-14T09:08:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7909999999999999e-06 2024-09-14T09:08:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.046091+0000", 2024-09-14T09:08:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0310000000000004e-06 2024-09-14T09:08:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.059371+0000", 2024-09-14T09:08:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013280389 2024-09-14T09:08:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.059419+0000", 2024-09-14T09:08:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7608999999999998e-05 2024-09-14T09:08:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.059595+0000", 2024-09-14T09:08:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000175978 2024-09-14T09:08:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.063685+0000", 2024-09-14T09:08:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040906919999999999 2024-09-14T09:08:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064193+0000", 2024-09-14T09:08:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00050776800000000002 2024-09-14T09:08:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064258+0000", 2024-09-14T09:08:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4683000000000004e-05 2024-09-14T09:08:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064293+0000", 2024-09-14T09:08:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5268000000000002e-05 2024-09-14T09:08:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:1204 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.047040+0000", 2024-09-14T09:08:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.515076584, 2024-09-14T09:08:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017403802999999999, 2024-09-14T09:08:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1204 2024-09-14T09:08:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.047040+0000", 2024-09-14T09:08:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.047040+0000", 2024-09-14T09:08:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.047040+0000", 2024-09-14T09:08:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7300000000000005e-07 2024-09-14T09:08:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.047044+0000", 2024-09-14T09:08:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5140000000000002e-06 2024-09-14T09:08:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.047054+0000", 2024-09-14T09:08:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7200000000000001e-06 2024-09-14T09:08:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.047063+0000", 2024-09-14T09:08:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1430000000000004e-06 2024-09-14T09:08:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.059913+0000", 2024-09-14T09:08:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012850528999999999 2024-09-14T09:08:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.059995+0000", 2024-09-14T09:08:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1519000000000003e-05 2024-09-14T09:08:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.060182+0000", 2024-09-14T09:08:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018694100000000001 2024-09-14T09:08:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.063690+0000", 2024-09-14T09:08:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035079719999999998 2024-09-14T09:08:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064350+0000", 2024-09-14T09:08:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00065993400000000004 2024-09-14T09:08:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064400+0000", 2024-09-14T09:08:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0235000000000003e-05 2024-09-14T09:08:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064443+0000", 2024-09-14T09:08:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3523000000000003e-05 2024-09-14T09:08:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:1205 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.047376+0000", 2024-09-14T09:08:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.51474060899999996, 2024-09-14T09:08:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017251426, 2024-09-14T09:08:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1205 2024-09-14T09:08:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.047376+0000", 2024-09-14T09:08:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.047376+0000", 2024-09-14T09:08:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.047376+0000", 2024-09-14T09:08:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3300000000000001e-07 2024-09-14T09:08:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.047381+0000", 2024-09-14T09:08:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0089999999999998e-06 2024-09-14T09:08:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.047389+0000", 2024-09-14T09:08:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5020000000000003e-06 2024-09-14T09:08:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.047395+0000", 2024-09-14T09:08:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0159999999999997e-06 2024-09-14T09:08:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.060627+0000", 2024-09-14T09:08:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013231633 2024-09-14T09:08:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.060676+0000", 2024-09-14T09:08:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9778999999999999e-05 2024-09-14T09:08:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.061004+0000", 2024-09-14T09:08:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00032786600000000001 2024-09-14T09:08:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064492+0000", 2024-09-14T09:08:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034876500000000001 2024-09-14T09:08:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064544+0000", 2024-09-14T09:08:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2423999999999998e-05 2024-09-14T09:08:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064583+0000", 2024-09-14T09:08:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8611e-05 2024-09-14T09:08:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064627+0000", 2024-09-14T09:08:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4103000000000001e-05 2024-09-14T09:08:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:1206 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.047578+0000", 2024-09-14T09:08:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.51453849100000004, 2024-09-14T09:08:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017131699, 2024-09-14T09:08:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1206 2024-09-14T09:08:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.047578+0000", 2024-09-14T09:08:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.047578+0000", 2024-09-14T09:08:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.047579+0000", 2024-09-14T09:08:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0219999999999999e-06 2024-09-14T09:08:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.047584+0000", 2024-09-14T09:08:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0089999999999998e-06 2024-09-14T09:08:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.047594+0000", 2024-09-14T09:08:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0669999999999999e-05 2024-09-14T09:08:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.047601+0000", 2024-09-14T09:08:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7089999999999996e-06 2024-09-14T09:08:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.061344+0000", 2024-09-14T09:08:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013742895999999999 2024-09-14T09:08:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.061427+0000", 2024-09-14T09:08:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3116999999999997e-05 2024-09-14T09:08:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.061688+0000", 2024-09-14T09:08:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00026116699999999997 2024-09-14T09:08:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064532+0000", 2024-09-14T09:08:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028438169999999998 2024-09-14T09:08:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064635+0000", 2024-09-14T09:08:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000103312 2024-09-14T09:08:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064674+0000", 2024-09-14T09:08:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8670000000000001e-05 2024-09-14T09:08:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064709+0000", 2024-09-14T09:08:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5309999999999999e-05 2024-09-14T09:08:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2064 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.183863+0000", 2024-09-14T09:08:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.378252747, 2024-09-14T09:08:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016898172999999999, 2024-09-14T09:08:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2064 2024-09-14T09:08:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183863+0000", 2024-09-14T09:08:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183863+0000", 2024-09-14T09:08:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183864+0000", 2024-09-14T09:08:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9299999999999998e-07 2024-09-14T09:08:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183867+0000", 2024-09-14T09:08:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0019999999999998e-06 2024-09-14T09:08:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183877+0000", 2024-09-14T09:08:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8539999999999992e-06 2024-09-14T09:08:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183885+0000", 2024-09-14T09:08:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1429999999999998e-06 2024-09-14T09:08:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.195854+0000", 2024-09-14T09:08:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011968901000000001 2024-09-14T09:08:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.195963+0000", 2024-09-14T09:08:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000109206 2024-09-14T09:08:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.196302+0000", 2024-09-14T09:08:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033937600000000001 2024-09-14T09:08:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.199837+0000", 2024-09-14T09:08:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00353478 2024-09-14T09:08:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.200679+0000", 2024-09-14T09:08:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00084230000000000004 2024-09-14T09:08:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.200722+0000", 2024-09-14T09:08:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2518000000000002e-05 2024-09-14T09:08:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.200762+0000", 2024-09-14T09:08:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.96e-05 2024-09-14T09:08:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2065 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.183898+0000", 2024-09-14T09:08:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.37821864199999999, 2024-09-14T09:08:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017819933999999999, 2024-09-14T09:08:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2065 2024-09-14T09:08:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183898+0000", 2024-09-14T09:08:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183898+0000", 2024-09-14T09:08:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183898+0000", 2024-09-14T09:08:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9500000000000003e-07 2024-09-14T09:08:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183901+0000", 2024-09-14T09:08:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8090000000000001e-06 2024-09-14T09:08:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183908+0000", 2024-09-14T09:08:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9319999999999999e-06 2024-09-14T09:08:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183915+0000", 2024-09-14T09:08:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7870000000000004e-06 2024-09-14T09:08:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.196686+0000", 2024-09-14T09:08:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012771055 2024-09-14T09:08:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.196756+0000", 2024-09-14T09:08:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0127000000000001e-05 2024-09-14T09:08:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.197021+0000", 2024-09-14T09:08:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00026518599999999999 2024-09-14T09:08:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.200805+0000", 2024-09-14T09:08:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003784047 2024-09-14T09:08:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.201631+0000", 2024-09-14T09:08:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00082648200000000002 2024-09-14T09:08:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.201678+0000", 2024-09-14T09:08:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6245000000000002e-05 2024-09-14T09:08:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.201717+0000", 2024-09-14T09:08:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9768999999999998e-05 2024-09-14T09:08:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2066 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.183929+0000", 2024-09-14T09:08:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.378187563, 2024-09-14T09:08:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020663781999999999, 2024-09-14T09:08:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2066 2024-09-14T09:08:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183929+0000", 2024-09-14T09:08:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183929+0000", 2024-09-14T09:08:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183929+0000", 2024-09-14T09:08:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2500000000000001e-07 2024-09-14T09:08:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183932+0000", 2024-09-14T09:08:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.683e-06 2024-09-14T09:08:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183938+0000", 2024-09-14T09:08:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6220000000000003e-06 2024-09-14T09:08:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183943+0000", 2024-09-14T09:08:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0340000000000004e-06 2024-09-14T09:08:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.198098+0000", 2024-09-14T09:08:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014154645 2024-09-14T09:08:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.198170+0000", 2024-09-14T09:08:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2464000000000003e-05 2024-09-14T09:08:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.198494+0000", 2024-09-14T09:08:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00032338499999999998 2024-09-14T09:08:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.202395+0000", 2024-09-14T09:08:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003900714 2024-09-14T09:08:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204488+0000", 2024-09-14T09:08:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020932860000000002 2024-09-14T09:08:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204556+0000", 2024-09-14T09:08:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8021999999999993e-05 2024-09-14T09:08:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204592+0000", 2024-09-14T09:08:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6501999999999997e-05 2024-09-14T09:08:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2067 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.183952+0000", 2024-09-14T09:08:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.378164628, 2024-09-14T09:08:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020733690999999999, 2024-09-14T09:08:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2067 2024-09-14T09:08:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183952+0000", 2024-09-14T09:08:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183952+0000", 2024-09-14T09:08:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183952+0000", 2024-09-14T09:08:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4499999999999998e-07 2024-09-14T09:08:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183953+0000", 2024-09-14T09:08:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5659999999999999e-06 2024-09-14T09:08:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183961+0000", 2024-09-14T09:08:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8979999999999996e-06 2024-09-14T09:08:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183965+0000", 2024-09-14T09:08:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3440000000000001e-06 2024-09-14T09:08:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.199110+0000", 2024-09-14T09:08:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015145257000000001 2024-09-14T09:08:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.199183+0000", 2024-09-14T09:08:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3075000000000001e-05 2024-09-14T09:08:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.199495+0000", 2024-09-14T09:08:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00031204200000000001 2024-09-14T09:08:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204475+0000", 2024-09-14T09:08:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049796809999999997 2024-09-14T09:08:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204601+0000", 2024-09-14T09:08:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000126713 2024-09-14T09:08:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204644+0000", 2024-09-14T09:08:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2500999999999998e-05 2024-09-14T09:08:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204685+0000", 2024-09-14T09:08:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1369000000000003e-05 2024-09-14T09:08:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2068 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185491+0000", 2024-09-14T09:08:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.376625559, 2024-09-14T09:08:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019345701, 2024-09-14T09:08:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2068 2024-09-14T09:08:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185491+0000", 2024-09-14T09:08:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185491+0000", 2024-09-14T09:08:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185491+0000", 2024-09-14T09:08:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8100000000000002e-07 2024-09-14T09:08:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185495+0000", 2024-09-14T09:08:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7100000000000001e-06 2024-09-14T09:08:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185504+0000", 2024-09-14T09:08:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7069999999999998e-06 2024-09-14T09:08:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185508+0000", 2024-09-14T09:08:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6750000000000001e-06 2024-09-14T09:08:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.199874+0000", 2024-09-14T09:08:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014365833999999999 2024-09-14T09:08:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.199947+0000", 2024-09-14T09:08:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3010999999999996e-05 2024-09-14T09:08:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.200280+0000", 2024-09-14T09:08:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033280499999999998 2024-09-14T09:08:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204698+0000", 2024-09-14T09:08:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044175400000000002 2024-09-14T09:08:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204746+0000", 2024-09-14T09:08:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8340999999999997e-05 2024-09-14T09:08:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204799+0000", 2024-09-14T09:08:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2871999999999998e-05 2024-09-14T09:08:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204836+0000", 2024-09-14T09:08:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7524999999999997e-05 2024-09-14T09:08:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2069 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185519+0000", 2024-09-14T09:08:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.376597193, 2024-09-14T09:08:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019424951999999999, 2024-09-14T09:08:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2069 2024-09-14T09:08:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185519+0000", 2024-09-14T09:08:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185519+0000", 2024-09-14T09:08:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185519+0000", 2024-09-14T09:08:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8200000000000001e-07 2024-09-14T09:08:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185521+0000", 2024-09-14T09:08:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.655e-06 2024-09-14T09:08:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185525+0000", 2024-09-14T09:08:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8870000000000002e-06 2024-09-14T09:08:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185528+0000", 2024-09-14T09:08:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6689999999999999e-06 2024-09-14T09:08:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.200838+0000", 2024-09-14T09:08:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015309779000000001 2024-09-14T09:08:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.200913+0000", 2024-09-14T09:08:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4612999999999999e-05 2024-09-14T09:08:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.201269+0000", 2024-09-14T09:08:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00035585800000000002 2024-09-14T09:08:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204704+0000", 2024-09-14T09:08:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034355879999999998 2024-09-14T09:08:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204883+0000", 2024-09-14T09:08:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017857499999999999 2024-09-14T09:08:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204911+0000", 2024-09-14T09:08:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8007000000000001e-05 2024-09-14T09:08:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204944+0000", 2024-09-14T09:08:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3039e-05 2024-09-14T09:08:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2070 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185533+0000", 2024-09-14T09:08:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.37658361699999998, 2024-09-14T09:08:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019500197, 2024-09-14T09:08:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2070 2024-09-14T09:08:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185533+0000", 2024-09-14T09:08:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185533+0000", 2024-09-14T09:08:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185533+0000", 2024-09-14T09:08:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1500000000000001e-07 2024-09-14T09:08:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185534+0000", 2024-09-14T09:08:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.449e-06 2024-09-14T09:08:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185537+0000", 2024-09-14T09:08:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-09-14T09:08:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185541+0000", 2024-09-14T09:08:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2140000000000001e-06 2024-09-14T09:08:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.201762+0000", 2024-09-14T09:08:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016221197 2024-09-14T09:08:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.201815+0000", 2024-09-14T09:08:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2787000000000001e-05 2024-09-14T09:08:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.202011+0000", 2024-09-14T09:08:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019608200000000001 2024-09-14T09:08:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204709+0000", 2024-09-14T09:08:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026987109999999999 2024-09-14T09:08:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204987+0000", 2024-09-14T09:08:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000277636 2024-09-14T09:08:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205015+0000", 2024-09-14T09:08:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7710000000000001e-05 2024-09-14T09:08:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205033+0000", 2024-09-14T09:08:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7946000000000001e-05 2024-09-14T09:08:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2071 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185545+0000", 2024-09-14T09:08:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.37657130700000002, 2024-09-14T09:08:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021874615, 2024-09-14T09:08:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2071 2024-09-14T09:08:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185545+0000", 2024-09-14T09:08:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185545+0000", 2024-09-14T09:08:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185545+0000", 2024-09-14T09:08:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1799999999999999e-07 2024-09-14T09:08:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185546+0000", 2024-09-14T09:08:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.392e-06 2024-09-14T09:08:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185550+0000", 2024-09-14T09:08:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2179999999999999e-06 2024-09-14T09:08:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185552+0000", 2024-09-14T09:08:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6419999999999999e-06 2024-09-14T09:08:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.202430+0000", 2024-09-14T09:08:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016877728000000002 2024-09-14T09:08:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.202499+0000", 2024-09-14T09:08:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9259999999999998e-05 2024-09-14T09:08:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.203297+0000", 2024-09-14T09:08:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00079781399999999999 2024-09-14T09:08:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.207321+0000", 2024-09-14T09:08:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040234420000000003 2024-09-14T09:08:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.207349+0000", 2024-09-14T09:08:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8736000000000001e-05 2024-09-14T09:08:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.207381+0000", 2024-09-14T09:08:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1315000000000001e-05 2024-09-14T09:08:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.207419+0000", 2024-09-14T09:08:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8850000000000002e-05 2024-09-14T09:08:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2072 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185556+0000", 2024-09-14T09:08:18.658 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.37656050000000002, 2024-09-14T09:08:18.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023970933999999999, 2024-09-14T09:08:18.658 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.658 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.658 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.658 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.658 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:18.658 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:18.658 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2072 2024-09-14T09:08:18.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.658 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185556+0000", 2024-09-14T09:08:18.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185556+0000", 2024-09-14T09:08:18.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185556+0000", 2024-09-14T09:08:18.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.17e-07 2024-09-14T09:08:18.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185557+0000", 2024-09-14T09:08:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2860000000000001e-06 2024-09-14T09:08:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185560+0000", 2024-09-14T09:08:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0130000000000002e-06 2024-09-14T09:08:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185563+0000", 2024-09-14T09:08:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:08:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.203700+0000", 2024-09-14T09:08:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018137646 2024-09-14T09:08:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.203782+0000", 2024-09-14T09:08:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2082000000000005e-05 2024-09-14T09:08:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204106+0000", 2024-09-14T09:08:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000323345 2024-09-14T09:08:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209284+0000", 2024-09-14T09:08:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051778739999999998 2024-09-14T09:08:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209477+0000", 2024-09-14T09:08:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019348400000000001 2024-09-14T09:08:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209505+0000", 2024-09-14T09:08:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7358000000000001e-05 2024-09-14T09:08:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209527+0000", 2024-09-14T09:08:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2082999999999998e-05 2024-09-14T09:08:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2073 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185566+0000", 2024-09-14T09:08:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.37654976000000001, 2024-09-14T09:08:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024050449000000002, 2024-09-14T09:08:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2073 2024-09-14T09:08:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185566+0000", 2024-09-14T09:08:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185566+0000", 2024-09-14T09:08:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185567+0000", 2024-09-14T09:08:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2024-09-14T09:08:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185568+0000", 2024-09-14T09:08:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3e-06 2024-09-14T09:08:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185571+0000", 2024-09-14T09:08:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0460000000000001e-06 2024-09-14T09:08:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185574+0000", 2024-09-14T09:08:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5399999999999998e-06 2024-09-14T09:08:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205068+0000", 2024-09-14T09:08:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019494002999999999 2024-09-14T09:08:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205135+0000", 2024-09-14T09:08:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7056000000000003e-05 2024-09-14T09:08:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205421+0000", 2024-09-14T09:08:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00028621899999999999 2024-09-14T09:08:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209290+0000", 2024-09-14T09:08:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038688059999999998 2024-09-14T09:08:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209553+0000", 2024-09-14T09:08:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00026326600000000001 2024-09-14T09:08:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209587+0000", 2024-09-14T09:08:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4359000000000001e-05 2024-09-14T09:08:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209617+0000", 2024-09-14T09:08:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9643000000000001e-05 2024-09-14T09:08:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2074 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185577+0000", 2024-09-14T09:08:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.37653963099999999, 2024-09-14T09:08:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026839190999999998, 2024-09-14T09:08:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2074 2024-09-14T09:08:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185577+0000", 2024-09-14T09:08:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185577+0000", 2024-09-14T09:08:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185577+0000", 2024-09-14T09:08:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0800000000000001e-07 2024-09-14T09:08:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185578+0000", 2024-09-14T09:08:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3790000000000001e-06 2024-09-14T09:08:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185581+0000", 2024-09-14T09:08:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9639999999999999e-06 2024-09-14T09:08:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185584+0000", 2024-09-14T09:08:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.543e-06 2024-09-14T09:08:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205773+0000", 2024-09-14T09:08:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020189592999999999 2024-09-14T09:08:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205852+0000", 2024-09-14T09:08:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8825999999999994e-05 2024-09-14T09:08:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206078+0000", 2024-09-14T09:08:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022563999999999999 2024-09-14T09:08:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212216+0000", 2024-09-14T09:08:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061383940000000001 2024-09-14T09:08:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212346+0000", 2024-09-14T09:08:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000130195 2024-09-14T09:08:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212382+0000", 2024-09-14T09:08:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6009e-05 2024-09-14T09:08:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212416+0000", 2024-09-14T09:08:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3439999999999998e-05 2024-09-14T09:08:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2075 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185587+0000", 2024-09-14T09:08:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.37652948200000003, 2024-09-14T09:08:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026913308, 2024-09-14T09:08:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2075 2024-09-14T09:08:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185587+0000", 2024-09-14T09:08:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185587+0000", 2024-09-14T09:08:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185587+0000", 2024-09-14T09:08:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1e-07 2024-09-14T09:08:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185588+0000", 2024-09-14T09:08:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.308e-06 2024-09-14T09:08:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185592+0000", 2024-09-14T09:08:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5999999999999998e-06 2024-09-14T09:08:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185594+0000", 2024-09-14T09:08:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5799999999999999e-06 2024-09-14T09:08:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206511+0000", 2024-09-14T09:08:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020916338999999999 2024-09-14T09:08:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206591+0000", 2024-09-14T09:08:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0495999999999996e-05 2024-09-14T09:08:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206963+0000", 2024-09-14T09:08:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00037151300000000002 2024-09-14T09:08:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212222+0000", 2024-09-14T09:08:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052591469999999996 2024-09-14T09:08:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212449+0000", 2024-09-14T09:08:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022715699999999999 2024-09-14T09:08:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212478+0000", 2024-09-14T09:08:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8818000000000001e-05 2024-09-14T09:08:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:18.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212500+0000", 2024-09-14T09:08:18.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2140000000000001e-05 2024-09-14T09:08:18.681 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.681 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.681 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.681 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.681 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.681 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:18.683 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:18.684+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:18.683 INFO:teuthology.orchestra.run.smithi148.stdout:2591 trunc from 0xe12d400 to 0x670c00 2024-09-14T09:08:18.683 INFO:teuthology.orchestra.run.smithi148.stdout:2594 read 0x22fa00 thru 0x23500c (0x560d bytes) 2024-09-14T09:08:18.683 INFO:teuthology.orchestra.run.smithi148.stdout:2599 trunc from 0x670c00 to 0x9505800 2024-09-14T09:08:18.684 INFO:teuthology.orchestra.run.smithi148.stdout:2600 write 0x1e4a200 thru 0x1e4f22d (0x502e bytes) 2024-09-14T09:08:18.684 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:08:18.685 INFO:teuthology.orchestra.run.smithi148.stdout:2601 write 0x9b6a200 thru 0x9b79244 (0xf045 bytes) 2024-09-14T09:08:18.714 INFO:teuthology.orchestra.run.smithi148.stdout:2604 write 0xacae200 thru 0xacb253b (0x433c bytes) 2024-09-14T09:08:18.715 INFO:teuthology.orchestra.run.smithi148.stdout:2607 read 0x9ac5400 thru 0x9ad3435 (0xe036 bytes) 2024-09-14T09:08:18.719 INFO:teuthology.orchestra.run.smithi148.stdout:2608 trunc from 0xacb2600 to 0xdc49200 2024-09-14T09:08:18.743 INFO:teuthology.orchestra.run.smithi148.stdout:2609 read 0x1432e00 thru 0x1435b10 (0x2d11 bytes) 2024-09-14T09:08:18.744 INFO:teuthology.orchestra.run.smithi148.stdout:2610 read 0x2cac000 thru 0x2caca78 (0xa79 bytes) 2024-09-14T09:08:18.744 INFO:teuthology.orchestra.run.smithi148.stdout:2611 write 0x7486000 thru 0x7488c6f (0x2c70 bytes) 2024-09-14T09:08:18.753 INFO:teuthology.orchestra.run.smithi148.stdout:2612 trunc from 0xdc49200 to 0x6810600 2024-09-14T09:08:18.783 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:18.785+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:18.784 INFO:teuthology.orchestra.run.smithi148.stdout:2613 read 0x465e000 thru 0x466163a (0x363b bytes) 2024-09-14T09:08:18.786 INFO:teuthology.orchestra.run.smithi148.stdout:2615 read 0x5670c00 thru 0x567986d (0x8c6e bytes) 2024-09-14T09:08:18.786 INFO:teuthology.orchestra.run.smithi148.stdout:2616 punch from 0x34c2a00 to 0x34ce000, (0xb600 bytes) 2024-09-14T09:08:18.793 INFO:teuthology.orchestra.run.smithi148.stdout:2617 trunc from 0x6810600 to 0xc85ec00 2024-09-14T09:08:18.825 INFO:teuthology.orchestra.run.smithi148.stdout:2618 write 0xd1de400 thru 0xd1ec755 (0xe356 bytes) 2024-09-14T09:08:18.842 INFO:teuthology.orchestra.run.smithi148.stdout:2619 trunc from 0xd1ec800 to 0x39e2200 2024-09-14T09:08:18.847 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:18.848 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:18.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.848 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4766.0:5657 3.4 e46/22 3:25d26d04:::rbd_object_map.111232b23a18:head v 46'334, mlcod=46'330)", 2024-09-14T09:08:18.848 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.848079+0000", 2024-09-14T09:08:18.848 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0022377339999999999, 2024-09-14T09:08:18.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022578860000000002, 2024-09-14T09:08:18.848 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.848 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.848 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:18.848 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.848079+0000", 2024-09-14T09:08:18.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.848079+0000", 2024-09-14T09:08:18.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.848080+0000", 2024-09-14T09:08:18.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3799999999999997e-07 2024-09-14T09:08:18.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.848084+0000", 2024-09-14T09:08:18.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4479999999999996e-06 2024-09-14T09:08:18.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.848099+0000", 2024-09-14T09:08:18.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5228999999999999e-05 2024-09-14T09:08:18.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.848106+0000", 2024-09-14T09:08:18.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3799999999999999e-06 2024-09-14T09:08:18.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.848158+0000", 2024-09-14T09:08:18.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1900000000000001e-05 2024-09-14T09:08:18.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.848175+0000", 2024-09-14T09:08:18.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7272e-05 2024-09-14T09:08:18.852 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.852 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.852 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.852 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4766.0:5659 3.4 e46/22 3:25d26d04:::rbd_object_map.111232b23a18:head v 46'335, mlcod=46'330)", 2024-09-14T09:08:18.852 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.848719+0000", 2024-09-14T09:08:18.852 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001598117, 2024-09-14T09:08:18.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016753530000000001, 2024-09-14T09:08:18.852 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.852 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.852 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:18.852 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.848719+0000", 2024-09-14T09:08:18.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.848719+0000", 2024-09-14T09:08:18.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.848720+0000", 2024-09-14T09:08:18.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6400000000000002e-07 2024-09-14T09:08:18.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.848724+0000", 2024-09-14T09:08:18.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.933e-06 2024-09-14T09:08:18.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.848742+0000", 2024-09-14T09:08:18.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7643999999999999e-05 2024-09-14T09:08:18.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.848749+0000", 2024-09-14T09:08:18.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2910000000000002e-06 2024-09-14T09:08:18.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.848792+0000", 2024-09-14T09:08:18.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2450000000000002e-05 2024-09-14T09:08:18.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.848809+0000", 2024-09-14T09:08:18.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.685e-05 2024-09-14T09:08:18.855 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.855 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.855 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.856 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4766.0:5661 3.4 e46/22 3:25d26d04:::rbd_object_map.111232b23a18:head v 46'336, mlcod=46'332)", 2024-09-14T09:08:18.856 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.849959+0000", 2024-09-14T09:08:18.856 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00035789799999999999, 2024-09-14T09:08:18.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00048721799999999998, 2024-09-14T09:08:18.856 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.856 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.856 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:18.856 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.849959+0000", 2024-09-14T09:08:18.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.849959+0000", 2024-09-14T09:08:18.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.849960+0000", 2024-09-14T09:08:18.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3900000000000004e-07 2024-09-14T09:08:18.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.849965+0000", 2024-09-14T09:08:18.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5969999999999999e-06 2024-09-14T09:08:18.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.849977+0000", 2024-09-14T09:08:18.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1207e-05 2024-09-14T09:08:18.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.849983+0000", 2024-09-14T09:08:18.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5060000000000001e-06 2024-09-14T09:08:18.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:18.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.850047+0000", 2024-09-14T09:08:18.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4312000000000004e-05 2024-09-14T09:08:18.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:18.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.850066+0000", 2024-09-14T09:08:18.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.897e-05 2024-09-14T09:08:18.859 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.859 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.859 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.860 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4766.0:5731 3.1a e46/22)", 2024-09-14T09:08:18.860 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.850449+0000", 2024-09-14T09:08:18.860 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9998684, 2024-09-14T09:08:18.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6703999999999999e-05, 2024-09-14T09:08:18.860 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:18.860 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:18.860 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:18.860 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:18.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:18.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.850449+0000", 2024-09-14T09:08:18.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:18.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.850449+0000", 2024-09-14T09:08:18.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:18.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:18.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.850450+0000", 2024-09-14T09:08:18.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1200000000000002e-07 2024-09-14T09:08:18.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:18.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.850463+0000", 2024-09-14T09:08:18.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3767999999999999e-05 2024-09-14T09:08:18.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:18.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.850475+0000", 2024-09-14T09:08:18.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1979e-05 2024-09-14T09:08:18.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:18.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:18.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:18.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.850483+0000", 2024-09-14T09:08:18.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2200000000000003e-06 2024-09-14T09:08:18.862 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.862 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:18.862 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.862 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:18.863 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-14T09:08:18.863 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 4 2024-09-14T09:08:18.863 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:18.864 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:08:18.877 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T09:08:18.890 INFO:teuthology.orchestra.run.smithi148.stdout:2620 write 0x9e27600 thru 0x9e2c4f9 (0x4efa bytes) 2024-09-14T09:08:18.899 INFO:teuthology.orchestra.run.smithi148.stdout:2621 trunc from 0x9e2c600 to 0x284e600 2024-09-14T09:08:18.908 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:18.909+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:18.937 INFO:teuthology.orchestra.run.smithi148.stdout:2623 trunc from 0x284e600 to 0x166ea00 2024-09-14T09:08:18.965 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:08:18.973 INFO:teuthology.orchestra.run.smithi148.stdout:2626 write 0x22d0400 thru 0x22db446 (0xb047 bytes) 2024-09-14T09:08:18.980 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:18.981 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:18.981 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:18.981 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:18.981 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:18.981 INFO:teuthology.orchestra.run.smithi148.stdout:2627 punch from 0x1b11800 to 0x1b19400, (0x7c00 bytes) 2024-09-14T09:08:18.984 INFO:teuthology.orchestra.run.smithi148.stdout:2628 read 0x1787a00 thru 0x1789d3f (0x2340 bytes) 2024-09-14T09:08:18.985 INFO:teuthology.orchestra.run.smithi148.stdout:2631 trunc from 0x22db600 to 0x2f86400 2024-09-14T09:08:18.985 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:18.986+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:18.992 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:08:19.007 INFO:teuthology.orchestra.run.smithi148.stdout:2634 read 0x2c4be00 thru 0x2c4c03c (0x23d bytes) 2024-09-14T09:08:19.014 INFO:teuthology.orchestra.run.smithi148.stdout:2635 read 0x1fb800 thru 0x204174 (0x8975 bytes) 2024-09-14T09:08:19.016 INFO:teuthology.orchestra.run.smithi148.stdout:2638 punch from 0x246800 to 0x251200, (0xaa00 bytes) 2024-09-14T09:08:19.042 INFO:teuthology.orchestra.run.smithi148.stdout:2639 trunc from 0x2f86400 to 0x9fda400 2024-09-14T09:08:19.085 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:19.086+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:19.127 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:19.128 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:19.129 INFO:teuthology.orchestra.run.smithi148.stdout:2642 read 0x7960200 thru 0x7960530 (0x331 bytes) 2024-09-14T09:08:19.145 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:19.145 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:19.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:19.145 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:19.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.145 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:41 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'19)", 2024-09-14T09:08:19.145 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.154530+0000", 2024-09-14T09:08:19.146 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.991785368999999, 2024-09-14T09:08:19.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097193060000000005, 2024-09-14T09:08:19.146 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:19.146 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:19.146 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:19.146 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:19.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:19.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154530+0000", 2024-09-14T09:08:19.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:19.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154530+0000", 2024-09-14T09:08:19.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:19.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154531+0000", 2024-09-14T09:08:19.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6199999999999997e-07 2024-09-14T09:08:19.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:19.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154567+0000", 2024-09-14T09:08:19.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5988000000000002e-05 2024-09-14T09:08:19.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:19.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154577+0000", 2024-09-14T09:08:19.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0366999999999999e-05 2024-09-14T09:08:19.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:19.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154583+0000", 2024-09-14T09:08:19.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3929999999999996e-06 2024-09-14T09:08:19.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:19.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154630+0000", 2024-09-14T09:08:19.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6980000000000001e-05 2024-09-14T09:08:19.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:19.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154650+0000", 2024-09-14T09:08:19.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9817999999999999e-05 2024-09-14T09:08:19.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:19.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164200+0000", 2024-09-14T09:08:19.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0095500770000000006 2024-09-14T09:08:19.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:19.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164249+0000", 2024-09-14T09:08:19.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9020999999999997e-05 2024-09-14T09:08:19.149 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.150 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:19.150 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.150 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:42 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'24, mlcod=15'19)", 2024-09-14T09:08:19.150 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:08:19.150 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.991209945999998, 2024-09-14T09:08:19.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0091673220000000003, 2024-09-14T09:08:19.150 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:19.150 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:19.150 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:19.151 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:19.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:19.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:08:19.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:19.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:08:19.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:19.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:08:19.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5000000000000001e-07 2024-09-14T09:08:19.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:19.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155113+0000", 2024-09-14T09:08:19.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8719999999999996e-06 2024-09-14T09:08:19.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:19.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155126+0000", 2024-09-14T09:08:19.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2951e-05 2024-09-14T09:08:19.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:19.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155132+0000", 2024-09-14T09:08:19.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9270000000000002e-06 2024-09-14T09:08:19.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:19.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158468+0000", 2024-09-14T09:08:19.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033357980000000001 2024-09-14T09:08:19.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:19.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158510+0000", 2024-09-14T09:08:19.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2138999999999998e-05 2024-09-14T09:08:19.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:19.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164251+0000", 2024-09-14T09:08:19.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0057413209999999998 2024-09-14T09:08:19.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:19.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164273+0000", 2024-09-14T09:08:19.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1364000000000001e-05 2024-09-14T09:08:19.155 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.155 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:19.155 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.155 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:43 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'25, mlcod=15'19)", 2024-09-14T09:08:19.155 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.155476+0000", 2024-09-14T09:08:19.155 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.990839258000001, 2024-09-14T09:08:19.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0092500399999999993, 2024-09-14T09:08:19.155 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:19.155 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:19.155 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:19.155 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:19.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:19.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155476+0000", 2024-09-14T09:08:19.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:19.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155476+0000", 2024-09-14T09:08:19.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:19.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155477+0000", 2024-09-14T09:08:19.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5300000000000002e-07 2024-09-14T09:08:19.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:19.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155486+0000", 2024-09-14T09:08:19.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2024-09-14T09:08:19.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:19.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155498+0000", 2024-09-14T09:08:19.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2911999999999999e-05 2024-09-14T09:08:19.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:19.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155506+0000", 2024-09-14T09:08:19.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3390000000000004e-06 2024-09-14T09:08:19.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:19.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158814+0000", 2024-09-14T09:08:19.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033078309999999998 2024-09-14T09:08:19.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:19.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158849+0000", 2024-09-14T09:08:19.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5330000000000002e-05 2024-09-14T09:08:19.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:19.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164691+0000", 2024-09-14T09:08:19.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005842346 2024-09-14T09:08:19.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:19.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164726+0000", 2024-09-14T09:08:19.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4978999999999998e-05 2024-09-14T09:08:19.159 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.159 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:19.159 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.159 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:44 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'26, mlcod=15'19)", 2024-09-14T09:08:19.160 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.155917+0000", 2024-09-14T09:08:19.160 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.990398741, 2024-09-14T09:08:19.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0088430230000000002, 2024-09-14T09:08:19.160 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:19.160 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:19.160 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:19.160 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:19.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:19.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155917+0000", 2024-09-14T09:08:19.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:19.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155917+0000", 2024-09-14T09:08:19.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:19.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155918+0000", 2024-09-14T09:08:19.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0359999999999999e-06 2024-09-14T09:08:19.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:19.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155951+0000", 2024-09-14T09:08:19.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3256999999999997e-05 2024-09-14T09:08:19.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:19.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155965+0000", 2024-09-14T09:08:19.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3692e-05 2024-09-14T09:08:19.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:19.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155971+0000", 2024-09-14T09:08:19.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0510000000000002e-06 2024-09-14T09:08:19.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:19.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159107+0000", 2024-09-14T09:08:19.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031363430000000002 2024-09-14T09:08:19.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:19.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159127+0000", 2024-09-14T09:08:19.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0268999999999999e-05 2024-09-14T09:08:19.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:19.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164728+0000", 2024-09-14T09:08:19.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056003629999999997 2024-09-14T09:08:19.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:19.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164760+0000", 2024-09-14T09:08:19.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2011999999999998e-05 2024-09-14T09:08:19.164 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.164 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:19.164 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.164 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:45 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'27, mlcod=15'19)", 2024-09-14T09:08:19.164 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.156503+0000", 2024-09-14T09:08:19.164 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.989812053000001, 2024-09-14T09:08:19.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082756970000000003, 2024-09-14T09:08:19.165 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:19.165 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:19.165 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:19.165 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:19.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:19.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156503+0000", 2024-09-14T09:08:19.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:19.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156503+0000", 2024-09-14T09:08:19.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:19.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156505+0000", 2024-09-14T09:08:19.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8139999999999999e-06 2024-09-14T09:08:19.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:19.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156516+0000", 2024-09-14T09:08:19.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1019000000000001e-05 2024-09-14T09:08:19.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:19.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156543+0000", 2024-09-14T09:08:19.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.692e-05 2024-09-14T09:08:19.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:19.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156556+0000", 2024-09-14T09:08:19.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3063e-05 2024-09-14T09:08:19.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:19.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159573+0000", 2024-09-14T09:08:19.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003016712 2024-09-14T09:08:19.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:19.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159589+0000", 2024-09-14T09:08:19.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6494000000000002e-05 2024-09-14T09:08:19.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:19.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164762+0000", 2024-09-14T09:08:19.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051722519999999996 2024-09-14T09:08:19.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:19.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164779+0000", 2024-09-14T09:08:19.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7422999999999999e-05 2024-09-14T09:08:19.170 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.170 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:19.171 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.171 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:46 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'28, mlcod=15'19)", 2024-09-14T09:08:19.171 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.156804+0000", 2024-09-14T09:08:19.171 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.989510963999997, 2024-09-14T09:08:19.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079926879999999995, 2024-09-14T09:08:19.172 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:19.172 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:19.172 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:19.172 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:19.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:19.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156804+0000", 2024-09-14T09:08:19.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:19.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156804+0000", 2024-09-14T09:08:19.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:19.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156805+0000", 2024-09-14T09:08:19.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3099999999999998e-07 2024-09-14T09:08:19.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:19.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156809+0000", 2024-09-14T09:08:19.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8299999999999998e-06 2024-09-14T09:08:19.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:19.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156817+0000", 2024-09-14T09:08:19.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7579999999999992e-06 2024-09-14T09:08:19.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:19.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156831+0000", 2024-09-14T09:08:19.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4256999999999999e-05 2024-09-14T09:08:19.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:19.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159903+0000", 2024-09-14T09:08:19.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030721590000000001 2024-09-14T09:08:19.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:19.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159922+0000", 2024-09-14T09:08:19.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8994000000000001e-05 2024-09-14T09:08:19.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:19.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164780+0000", 2024-09-14T09:08:19.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048582879999999997 2024-09-14T09:08:19.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:19.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164797+0000", 2024-09-14T09:08:19.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6971000000000001e-05 2024-09-14T09:08:19.176 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.176 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:19.176 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.176 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:47 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'29, mlcod=15'19)", 2024-09-14T09:08:19.176 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.157344+0000", 2024-09-14T09:08:19.177 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.988971755999998, 2024-09-14T09:08:19.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074729030000000004, 2024-09-14T09:08:19.177 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:19.177 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:19.177 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:19.177 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:19.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:19.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157344+0000", 2024-09-14T09:08:19.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:19.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157344+0000", 2024-09-14T09:08:19.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:19.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157346+0000", 2024-09-14T09:08:19.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.81e-06 2024-09-14T09:08:19.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:19.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157406+0000", 2024-09-14T09:08:19.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0523000000000003e-05 2024-09-14T09:08:19.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:19.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157434+0000", 2024-09-14T09:08:19.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8059999999999999e-05 2024-09-14T09:08:19.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:19.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157447+0000", 2024-09-14T09:08:19.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2666e-05 2024-09-14T09:08:19.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:19.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160183+0000", 2024-09-14T09:08:19.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002736413 2024-09-14T09:08:19.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:19.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160203+0000", 2024-09-14T09:08:19.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9545e-05 2024-09-14T09:08:19.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:19.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164798+0000", 2024-09-14T09:08:19.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045953890000000001 2024-09-14T09:08:19.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:19.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164817+0000", 2024-09-14T09:08:19.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8496999999999999e-05 2024-09-14T09:08:19.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.180 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:19.181 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.181 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:48 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'30, mlcod=15'19)", 2024-09-14T09:08:19.181 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.157693+0000", 2024-09-14T09:08:19.181 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.988622491000001, 2024-09-14T09:08:19.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0071445789999999999, 2024-09-14T09:08:19.181 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:19.181 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:19.181 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:19.181 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:19.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:19.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157693+0000", 2024-09-14T09:08:19.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:19.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157693+0000", 2024-09-14T09:08:19.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:19.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157694+0000", 2024-09-14T09:08:19.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2024-09-14T09:08:19.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:19.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157701+0000", 2024-09-14T09:08:19.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0230000000000004e-06 2024-09-14T09:08:19.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:19.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157709+0000", 2024-09-14T09:08:19.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7819999999999999e-06 2024-09-14T09:08:19.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:19.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157714+0000", 2024-09-14T09:08:19.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2440000000000004e-06 2024-09-14T09:08:19.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:19.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160598+0000", 2024-09-14T09:08:19.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028844280000000001 2024-09-14T09:08:19.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:19.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160618+0000", 2024-09-14T09:08:19.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0435e-05 2024-09-14T09:08:19.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:19.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164818+0000", 2024-09-14T09:08:19.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042000329999999997 2024-09-14T09:08:19.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:19.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164838+0000", 2024-09-14T09:08:19.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9054000000000001e-05 2024-09-14T09:08:19.185 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.185 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:19.185 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.186 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:49 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'31, mlcod=15'19)", 2024-09-14T09:08:19.186 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.158173+0000", 2024-09-14T09:08:19.186 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.988142828000001, 2024-09-14T09:08:19.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0066833700000000001, 2024-09-14T09:08:19.186 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:19.186 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:19.186 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:19.186 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:19.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:19.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158173+0000", 2024-09-14T09:08:19.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:19.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158173+0000", 2024-09-14T09:08:19.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:19.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158175+0000", 2024-09-14T09:08:19.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8840000000000001e-06 2024-09-14T09:08:19.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:19.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158188+0000", 2024-09-14T09:08:19.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3842999999999999e-05 2024-09-14T09:08:19.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:19.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158225+0000", 2024-09-14T09:08:19.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7039000000000002e-05 2024-09-14T09:08:19.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:19.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158243+0000", 2024-09-14T09:08:19.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7932999999999999e-05 2024-09-14T09:08:19.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:19.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160875+0000", 2024-09-14T09:08:19.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002632045 2024-09-14T09:08:19.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:19.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160887+0000", 2024-09-14T09:08:19.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2084e-05 2024-09-14T09:08:19.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:19.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164839+0000", 2024-09-14T09:08:19.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039511390000000002 2024-09-14T09:08:19.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:19.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164856+0000", 2024-09-14T09:08:19.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7402999999999999e-05 2024-09-14T09:08:19.189 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.190 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:19.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.190 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:66 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'44, mlcod=15'40)", 2024-09-14T09:08:19.190 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.430075+0000", 2024-09-14T09:08:19.190 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.716240642000002, 2024-09-14T09:08:19.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070127770000000004, 2024-09-14T09:08:19.190 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:19.190 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:19.190 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:19.190 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:19.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:19.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430075+0000", 2024-09-14T09:08:19.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:19.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430075+0000", 2024-09-14T09:08:19.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:19.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430076+0000", 2024-09-14T09:08:19.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4200000000000005e-07 2024-09-14T09:08:19.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:19.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430131+0000", 2024-09-14T09:08:19.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099000000000002e-05 2024-09-14T09:08:19.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:19.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430141+0000", 2024-09-14T09:08:19.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.978e-06 2024-09-14T09:08:19.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:19.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430145+0000", 2024-09-14T09:08:19.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4519999999999999e-06 2024-09-14T09:08:19.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:19.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430189+0000", 2024-09-14T09:08:19.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3924000000000002e-05 2024-09-14T09:08:19.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:19.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430202+0000", 2024-09-14T09:08:19.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3319000000000001e-05 2024-09-14T09:08:19.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:19.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437052+0000", 2024-09-14T09:08:19.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0068491389999999997 2024-09-14T09:08:19.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:19.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437088+0000", 2024-09-14T09:08:19.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6023999999999999e-05 2024-09-14T09:08:19.194 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.194 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:19.194 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.194 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1024 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:19.194 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.966579+0000", 2024-09-14T09:08:19.194 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.179736076000001, 2024-09-14T09:08:19.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069169419999999997, 2024-09-14T09:08:19.194 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:19.194 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:19.194 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:19.194 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:19.194 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:19.195 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:19.195 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1024 2024-09-14T09:08:19.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.195 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:19.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:19.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966579+0000", 2024-09-14T09:08:19.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:19.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966579+0000", 2024-09-14T09:08:19.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:19.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966580+0000", 2024-09-14T09:08:19.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000002e-07 2024-09-14T09:08:19.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:19.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966582+0000", 2024-09-14T09:08:19.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0040000000000002e-06 2024-09-14T09:08:19.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:19.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966588+0000", 2024-09-14T09:08:19.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6959999999999999e-06 2024-09-14T09:08:19.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:19.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966592+0000", 2024-09-14T09:08:19.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2370000000000001e-06 2024-09-14T09:08:19.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:19.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.967468+0000", 2024-09-14T09:08:19.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00087601900000000002 2024-09-14T09:08:19.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:19.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.967562+0000", 2024-09-14T09:08:19.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4543000000000006e-05 2024-09-14T09:08:19.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:19.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.967905+0000", 2024-09-14T09:08:19.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00034289100000000001 2024-09-14T09:08:19.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:19.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.968973+0000", 2024-09-14T09:08:19.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010677530000000001 2024-09-14T09:08:19.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:19.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.973420+0000", 2024-09-14T09:08:19.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044470810000000003 2024-09-14T09:08:19.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:19.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.973455+0000", 2024-09-14T09:08:19.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5018000000000003e-05 2024-09-14T09:08:19.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:19.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.973496+0000", 2024-09-14T09:08:19.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1303000000000001e-05 2024-09-14T09:08:19.200 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.200 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:19.200 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.201 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1206 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:19.201 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417812+0000", 2024-09-14T09:08:19.201 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.728503551999999, 2024-09-14T09:08:19.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082937259999999995, 2024-09-14T09:08:19.201 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:19.201 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:19.201 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:19.201 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:19.201 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:19.201 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:19.201 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1206 2024-09-14T09:08:19.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.201 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:19.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:19.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417812+0000", 2024-09-14T09:08:19.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:19.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417812+0000", 2024-09-14T09:08:19.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:19.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417812+0000", 2024-09-14T09:08:19.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1e-07 2024-09-14T09:08:19.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:19.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417813+0000", 2024-09-14T09:08:19.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2470000000000001e-06 2024-09-14T09:08:19.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:19.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417817+0000", 2024-09-14T09:08:19.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3720000000000001e-06 2024-09-14T09:08:19.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:19.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417819+0000", 2024-09-14T09:08:19.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3980000000000002e-06 2024-09-14T09:08:19.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:19.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.422429+0000", 2024-09-14T09:08:19.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046098040000000003 2024-09-14T09:08:19.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:19.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.422477+0000", 2024-09-14T09:08:19.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8000999999999997e-05 2024-09-14T09:08:19.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:19.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.422680+0000", 2024-09-14T09:08:19.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000202986 2024-09-14T09:08:19.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:19.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425417+0000", 2024-09-14T09:08:19.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00273742 2024-09-14T09:08:19.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:19.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426055+0000", 2024-09-14T09:08:19.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00063756800000000003 2024-09-14T09:08:19.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:19.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426083+0000", 2024-09-14T09:08:19.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7616000000000001e-05 2024-09-14T09:08:19.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:19.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426106+0000", 2024-09-14T09:08:19.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3104000000000001e-05 2024-09-14T09:08:19.206 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.206 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:19.206 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.207 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1207 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:19.207 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417822+0000", 2024-09-14T09:08:19.207 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.728493456999999, 2024-09-14T09:08:19.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.009748909, 2024-09-14T09:08:19.207 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:19.207 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:19.207 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:19.207 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:19.207 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:19.207 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:19.207 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1207 2024-09-14T09:08:19.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.208 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:19.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:19.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417822+0000", 2024-09-14T09:08:19.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:19.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417822+0000", 2024-09-14T09:08:19.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:19.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417822+0000", 2024-09-14T09:08:19.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.36e-07 2024-09-14T09:08:19.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:19.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417824+0000", 2024-09-14T09:08:19.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4410000000000001e-06 2024-09-14T09:08:19.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:19.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417827+0000", 2024-09-14T09:08:19.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8600000000000001e-06 2024-09-14T09:08:19.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:19.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417829+0000", 2024-09-14T09:08:19.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4200000000000001e-06 2024-09-14T09:08:19.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:19.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.423665+0000", 2024-09-14T09:08:19.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058360590000000002 2024-09-14T09:08:19.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:19.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.423755+0000", 2024-09-14T09:08:19.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9999000000000003e-05 2024-09-14T09:08:19.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:19.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424113+0000", 2024-09-14T09:08:19.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00035816599999999999 2024-09-14T09:08:19.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:19.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426112+0000", 2024-09-14T09:08:19.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019984209999999998 2024-09-14T09:08:19.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:19.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427498+0000", 2024-09-14T09:08:19.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013862049999999999 2024-09-14T09:08:19.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:19.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427534+0000", 2024-09-14T09:08:19.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6609999999999997e-05 2024-09-14T09:08:19.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:19.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427571+0000", 2024-09-14T09:08:19.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6492000000000002e-05 2024-09-14T09:08:19.215 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.215 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:19.215 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.216 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1208 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:19.216 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417832+0000", 2024-09-14T09:08:19.216 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.728483681, 2024-09-14T09:08:19.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0098905280000000009, 2024-09-14T09:08:19.217 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:19.217 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:19.217 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:19.217 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:19.218 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:19.218 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:19.218 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1208 2024-09-14T09:08:19.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.218 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:19.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:19.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417832+0000", 2024-09-14T09:08:19.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:19.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417832+0000", 2024-09-14T09:08:19.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:19.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417832+0000", 2024-09-14T09:08:19.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2399999999999999e-07 2024-09-14T09:08:19.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:19.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417833+0000", 2024-09-14T09:08:19.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0950000000000001e-06 2024-09-14T09:08:19.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:19.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417842+0000", 2024-09-14T09:08:19.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3959999999999995e-06 2024-09-14T09:08:19.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:19.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417846+0000", 2024-09-14T09:08:19.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4649999999999999e-06 2024-09-14T09:08:19.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:19.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424607+0000", 2024-09-14T09:08:19.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067611750000000003 2024-09-14T09:08:19.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:19.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424690+0000", 2024-09-14T09:08:19.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2890000000000001e-05 2024-09-14T09:08:19.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:19.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425029+0000", 2024-09-14T09:08:19.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033934900000000002 2024-09-14T09:08:19.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:19.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427460+0000", 2024-09-14T09:08:19.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024307619999999999 2024-09-14T09:08:19.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:19.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427624+0000", 2024-09-14T09:08:19.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000163404 2024-09-14T09:08:19.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427681+0000", 2024-09-14T09:08:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7748999999999999e-05 2024-09-14T09:08:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427722+0000", 2024-09-14T09:08:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1019000000000001e-05 2024-09-14T09:08:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1209 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417851+0000", 2024-09-14T09:08:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.728464174999999, 2024-09-14T09:08:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010012681000000001, 2024-09-14T09:08:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1209 2024-09-14T09:08:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417851+0000", 2024-09-14T09:08:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417851+0000", 2024-09-14T09:08:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417852+0000", 2024-09-14T09:08:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.84e-07 2024-09-14T09:08:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417853+0000", 2024-09-14T09:08:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6589999999999999e-06 2024-09-14T09:08:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417857+0000", 2024-09-14T09:08:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7050000000000001e-06 2024-09-14T09:08:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417860+0000", 2024-09-14T09:08:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.242e-06 2024-09-14T09:08:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425469+0000", 2024-09-14T09:08:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076089 2024-09-14T09:08:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425553+0000", 2024-09-14T09:08:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3657000000000002e-05 2024-09-14T09:08:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425782+0000", 2024-09-14T09:08:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000229519 2024-09-14T09:08:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427775+0000", 2024-09-14T09:08:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019930289999999999 2024-09-14T09:08:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427794+0000", 2024-09-14T09:08:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8238999999999999e-05 2024-09-14T09:08:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427827+0000", 2024-09-14T09:08:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3045e-05 2024-09-14T09:08:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427864+0000", 2024-09-14T09:08:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7401999999999999e-05 2024-09-14T09:08:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1210 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417864+0000", 2024-09-14T09:08:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.728451102000001, 2024-09-14T09:08:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011675377000000001, 2024-09-14T09:08:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1210 2024-09-14T09:08:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417864+0000", 2024-09-14T09:08:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417864+0000", 2024-09-14T09:08:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417865+0000", 2024-09-14T09:08:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.34e-07 2024-09-14T09:08:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417866+0000", 2024-09-14T09:08:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.384e-06 2024-09-14T09:08:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417869+0000", 2024-09-14T09:08:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.971e-06 2024-09-14T09:08:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417872+0000", 2024-09-14T09:08:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5979999999999999e-06 2024-09-14T09:08:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426155+0000", 2024-09-14T09:08:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082832389999999995 2024-09-14T09:08:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426236+0000", 2024-09-14T09:08:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1241000000000004e-05 2024-09-14T09:08:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426477+0000", 2024-09-14T09:08:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024123999999999999 2024-09-14T09:08:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427872+0000", 2024-09-14T09:08:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001394714 2024-09-14T09:08:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.429483+0000", 2024-09-14T09:08:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001611124 2024-09-14T09:08:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.429515+0000", 2024-09-14T09:08:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2243000000000003e-05 2024-09-14T09:08:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.429540+0000", 2024-09-14T09:08:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4389e-05 2024-09-14T09:08:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:19.235 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.235 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1218 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:19.235 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.425295+0000", 2024-09-14T09:08:19.235 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.721020706000001, 2024-09-14T09:08:19.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0068691480000000003, 2024-09-14T09:08:19.235 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:19.235 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:19.235 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:19.235 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:19.235 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:19.235 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:19.236 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1218 2024-09-14T09:08:19.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.236 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:19.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:19.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425295+0000", 2024-09-14T09:08:19.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:19.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425295+0000", 2024-09-14T09:08:19.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:19.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425296+0000", 2024-09-14T09:08:19.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3489999999999999e-06 2024-09-14T09:08:19.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:19.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425302+0000", 2024-09-14T09:08:19.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4709999999999998e-06 2024-09-14T09:08:19.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:19.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425317+0000", 2024-09-14T09:08:19.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5438999999999999e-05 2024-09-14T09:08:19.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:19.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425325+0000", 2024-09-14T09:08:19.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5229999999999998e-06 2024-09-14T09:08:19.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:19.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426759+0000", 2024-09-14T09:08:19.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001434399 2024-09-14T09:08:19.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:19.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426846+0000", 2024-09-14T09:08:19.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7529999999999997e-05 2024-09-14T09:08:19.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:19.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427211+0000", 2024-09-14T09:08:19.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00036427200000000001 2024-09-14T09:08:19.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:19.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428665+0000", 2024-09-14T09:08:19.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014539659999999999 2024-09-14T09:08:19.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:19.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432108+0000", 2024-09-14T09:08:19.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034428229999999998 2024-09-14T09:08:19.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:19.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432139+0000", 2024-09-14T09:08:19.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1319000000000003e-05 2024-09-14T09:08:19.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:19.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432164+0000", 2024-09-14T09:08:19.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5057000000000001e-05 2024-09-14T09:08:19.241 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.241 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:19.241 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.241 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1219 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:19.241 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.425715+0000", 2024-09-14T09:08:19.241 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.720600378, 2024-09-14T09:08:19.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065717709999999997, 2024-09-14T09:08:19.241 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:19.241 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:19.241 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:19.242 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:19.242 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:19.242 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:19.242 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1219 2024-09-14T09:08:19.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.242 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:19.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:19.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425715+0000", 2024-09-14T09:08:19.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:19.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425715+0000", 2024-09-14T09:08:19.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:19.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425716+0000", 2024-09-14T09:08:19.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0599999999999999e-07 2024-09-14T09:08:19.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:19.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425726+0000", 2024-09-14T09:08:19.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0122999999999999e-05 2024-09-14T09:08:19.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:19.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425743+0000", 2024-09-14T09:08:19.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7110000000000001e-05 2024-09-14T09:08:19.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:19.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425749+0000", 2024-09-14T09:08:19.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2099999999999998e-06 2024-09-14T09:08:19.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:19.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427903+0000", 2024-09-14T09:08:19.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021539969999999999 2024-09-14T09:08:19.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:19.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427985+0000", 2024-09-14T09:08:19.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1458999999999994e-05 2024-09-14T09:08:19.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:19.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428277+0000", 2024-09-14T09:08:19.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029251100000000002 2024-09-14T09:08:19.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:19.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.430127+0000", 2024-09-14T09:08:19.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018491950000000001 2024-09-14T09:08:19.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:19.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432234+0000", 2024-09-14T09:08:19.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002107458 2024-09-14T09:08:19.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:19.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432267+0000", 2024-09-14T09:08:19.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3291999999999999e-05 2024-09-14T09:08:19.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:19.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432287+0000", 2024-09-14T09:08:19.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9510000000000001e-05 2024-09-14T09:08:19.247 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.247 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:19.247 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.247 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4782.0:193 3.17 3:e98abfa9:::rbd_data.11127a12d636.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write 3887104~20480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-14T09:08:19.247 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:09.305741+0000", 2024-09-14T09:08:19.247 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.8405742210000007, 2024-09-14T09:08:19.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0081452360000000001, 2024-09-14T09:08:19.247 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:19.247 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:19.247 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:19.247 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:19.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4782", 2024-09-14T09:08:19.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/353415140", 2024-09-14T09:08:19.248 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 193 2024-09-14T09:08:19.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.248 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:19.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:19.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.305741+0000", 2024-09-14T09:08:19.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:19.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.305741+0000", 2024-09-14T09:08:19.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:19.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.305742+0000", 2024-09-14T09:08:19.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5700000000000002e-07 2024-09-14T09:08:19.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:19.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.307981+0000", 2024-09-14T09:08:19.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022389200000000001 2024-09-14T09:08:19.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:19.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.307992+0000", 2024-09-14T09:08:19.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1681999999999999e-05 2024-09-14T09:08:19.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:19.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.307998+0000", 2024-09-14T09:08:19.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6520000000000003e-06 2024-09-14T09:08:19.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:19.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.308039+0000", 2024-09-14T09:08:19.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0611999999999997e-05 2024-09-14T09:08:19.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:19.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.308130+0000", 2024-09-14T09:08:19.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0896999999999994e-05 2024-09-14T09:08:19.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:19.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.308394+0000", 2024-09-14T09:08:19.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00026417600000000003 2024-09-14T09:08:19.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:19.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.312043+0000", 2024-09-14T09:08:19.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00364921 2024-09-14T09:08:19.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:19.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.313829+0000", 2024-09-14T09:08:19.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001785738 2024-09-14T09:08:19.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:19.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.313862+0000", 2024-09-14T09:08:19.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3096000000000003e-05 2024-09-14T09:08:19.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:19.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.313886+0000", 2024-09-14T09:08:19.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4695999999999999e-05 2024-09-14T09:08:19.252 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.252 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:19.253 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.253 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:1813 3.0 3:06c97bdf:::rbd_data.111232b23a18.00000000000000ef:head [set-alloc-hint object_size 524288 write_size 524288,write 217088~6144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:19.253 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.141739+0000", 2024-09-14T09:08:19.253 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0045764699999999, 2024-09-14T09:08:19.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067936769999999997, 2024-09-14T09:08:19.253 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:19.253 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:19.253 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:19.253 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:19.253 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:19.253 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:19.254 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1813 2024-09-14T09:08:19.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.254 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:19.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:19.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.141739+0000", 2024-09-14T09:08:19.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:19.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.141739+0000", 2024-09-14T09:08:19.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:19.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:19.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.141740+0000", 2024-09-14T09:08:19.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2799999999999995e-07 2024-09-14T09:08:19.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:19.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.141748+0000", 2024-09-14T09:08:19.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8569999999999995e-06 2024-09-14T09:08:19.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:19.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.141759+0000", 2024-09-14T09:08:19.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1014e-05 2024-09-14T09:08:19.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:19.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.141766+0000", 2024-09-14T09:08:19.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8789999999999997e-06 2024-09-14T09:08:19.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:19.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.141882+0000", 2024-09-14T09:08:19.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116832 2024-09-14T09:08:19.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:19.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.142016+0000", 2024-09-14T09:08:19.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000133456 2024-09-14T09:08:19.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:19.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.142156+0000", 2024-09-14T09:08:19.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014061100000000001 2024-09-14T09:08:19.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:19.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.143212+0000", 2024-09-14T09:08:19.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010552039999999999 2024-09-14T09:08:19.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:19.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.148423+0000", 2024-09-14T09:08:19.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052108409999999999 2024-09-14T09:08:19.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:19.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.148481+0000", 2024-09-14T09:08:19.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699000000000002e-05 2024-09-14T09:08:19.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:19.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:19.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:19.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.148533+0000", 2024-09-14T09:08:19.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1456000000000003e-05 2024-09-14T09:08:19.258 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.258 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:19.258 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.258 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:19.258 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:19.258 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:19.260 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:19.260 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:19.261 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:08:19.261 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:08:19.262 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:08:19.263 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:19.263 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:19.264 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:19.265 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:19.265 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:19.266 INFO:teuthology.orchestra.run.smithi148.stdout:2643 write 0xe78dc00 thru 0xe78ff95 (0x2396 bytes) 2024-09-14T09:08:19.266 INFO:teuthology.orchestra.run.smithi148.stdout:2644 read 0xda56800 thru 0xda58712 (0x1f13 bytes) 2024-09-14T09:08:19.266 INFO:teuthology.orchestra.run.smithi148.stdout:2645 read 0x7d7c000 thru 0x7d841a7 (0x81a8 bytes) 2024-09-14T09:08:19.266 INFO:teuthology.orchestra.run.smithi148.stdout:2653 trunc from 0xe790000 to 0x956fa00 2024-09-14T09:08:19.267 INFO:teuthology.orchestra.run.smithi148.stdout:2654 punch from 0xd9a000 to 0xd9c200, (0x2200 bytes) 2024-09-14T09:08:19.267 INFO:teuthology.orchestra.run.smithi148.stdout:2658 write 0x7afe400 thru 0x7b00505 (0x2106 bytes) 2024-09-14T09:08:19.267 INFO:teuthology.orchestra.run.smithi148.stdout:2659 read 0x7ff5c00 thru 0x7ff7eff (0x2300 bytes) 2024-09-14T09:08:19.267 INFO:teuthology.orchestra.run.smithi148.stdout:2660 read 0x520d200 thru 0x521d08a (0xfe8b bytes) 2024-09-14T09:08:19.267 INFO:teuthology.orchestra.run.smithi148.stdout:2661 read 0x4d26800 thru 0x4d30cd2 (0xa4d3 bytes) 2024-09-14T09:08:19.267 INFO:teuthology.orchestra.run.smithi148.stdout:2662 read 0x7f0d600 thru 0x7f1469f (0x70a0 bytes) 2024-09-14T09:08:19.267 INFO:teuthology.orchestra.run.smithi148.stdout:2664 punch from 0x21c5e00 to 0x21ce600, (0x8800 bytes) 2024-09-14T09:08:19.267 INFO:teuthology.orchestra.run.smithi148.stdout:2666 read 0x6462a00 thru 0x6463e42 (0x1443 bytes) 2024-09-14T09:08:19.267 INFO:teuthology.orchestra.run.smithi148.stdout:2667 read 0x82ad600 thru 0x82b5bdd (0x85de bytes) 2024-09-14T09:08:19.267 INFO:teuthology.orchestra.run.smithi148.stdout:2670 trunc from 0x956fa00 to 0x65a1e00 2024-09-14T09:08:19.267 INFO:teuthology.orchestra.run.smithi148.stdout:2671 read 0x1164600 thru 0x116bcaf (0x76b0 bytes) 2024-09-14T09:08:19.267 INFO:teuthology.orchestra.run.smithi148.stdout:2672 write 0x276f600 thru 0x2779ce6 (0xa6e7 bytes) 2024-09-14T09:08:19.267 INFO:teuthology.orchestra.run.smithi148.stdout:2673 write 0x55ebe00 thru 0x55f4675 (0x8876 bytes) 2024-09-14T09:08:19.267 INFO:teuthology.orchestra.run.smithi148.stdout:2674 trunc from 0x65a1e00 to 0xd772200 2024-09-14T09:08:19.268 INFO:teuthology.orchestra.run.smithi148.stdout:2676 punch from 0xb740200 to 0xb748400, (0x8200 bytes) 2024-09-14T09:08:19.268 INFO:teuthology.orchestra.run.smithi148.stdout:2679 read 0xc87e200 thru 0xc87fd02 (0x1b03 bytes) 2024-09-14T09:08:19.268 INFO:teuthology.orchestra.run.smithi148.stdout:2680 read 0xcbc1a00 thru 0xcbca4d8 (0x8ad9 bytes) 2024-09-14T09:08:19.268 INFO:teuthology.orchestra.run.smithi148.stdout:2681 write 0x5fb9a00 thru 0x5fc5962 (0xbf63 bytes) 2024-09-14T09:08:19.268 INFO:teuthology.orchestra.run.smithi148.stdout:2683 write 0xa7d4600 thru 0xa7dc410 (0x7e11 bytes) 2024-09-14T09:08:19.268 INFO:teuthology.orchestra.run.smithi148.stdout:2684 trunc from 0xd772200 to 0x2f3ac00 2024-09-14T09:08:19.268 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:19.269 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:19.261+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:19.306 INFO:teuthology.orchestra.run.smithi148.stdout:2688 read 0x2703000 thru 0x270ca1a (0x9a1b bytes) 2024-09-14T09:08:19.308 INFO:teuthology.orchestra.run.smithi148.stdout:2689 read 0x14eea00 thru 0x14ef009 (0x60a bytes) 2024-09-14T09:08:19.321 INFO:teuthology.orchestra.run.smithi148.stdout:2690 write 0x676e400 thru 0x6772fd1 (0x4bd2 bytes) 2024-09-14T09:08:19.322 INFO:teuthology.orchestra.run.smithi148.stdout:2691 punch from 0x2974000 to 0x2978e00, (0x4e00 bytes) 2024-09-14T09:08:19.323 INFO:teuthology.orchestra.run.smithi148.stdout:2692 trunc from 0x6773000 to 0x71f0200 2024-09-14T09:08:19.360 INFO:teuthology.orchestra.run.smithi148.stdout:2693 write 0xe355e00 thru 0xe364a86 (0xec87 bytes) 2024-09-14T09:08:19.360 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:19.362+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:19.361 INFO:teuthology.orchestra.run.smithi148.stdout:2695 write 0x6a38e00 thru 0x6a4410b (0xb30c bytes) 2024-09-14T09:08:19.361 INFO:teuthology.orchestra.run.smithi148.stdout:2697 write 0xf84600 thru 0xf8cc54 (0x8655 bytes) 2024-09-14T09:08:19.361 INFO:teuthology.orchestra.run.smithi148.stdout:2698 punch from 0x82e3400 to 0x82f0c00, (0xd800 bytes) 2024-09-14T09:08:19.362 INFO:teuthology.orchestra.run.smithi148.stdout:2699 punch from 0xb3d2400 to 0xb3df200, (0xce00 bytes) 2024-09-14T09:08:19.362 INFO:teuthology.orchestra.run.smithi148.stdout:2700 write 0x3954000 thru 0x395c616 (0x8617 bytes) 2024-09-14T09:08:19.362 INFO:teuthology.orchestra.run.smithi148.stdout:2701 write 0x476dc00 thru 0x477985c (0xbc5d bytes) 2024-09-14T09:08:19.362 INFO:teuthology.orchestra.run.smithi148.stdout:2702 punch from 0x7ce4c00 to 0x7cf4200, (0xf600 bytes) 2024-09-14T09:08:19.363 INFO:teuthology.orchestra.run.smithi148.stdout:2703 read 0x7c74600 thru 0x7c80681 (0xc082 bytes) 2024-09-14T09:08:19.363 INFO:teuthology.orchestra.run.smithi148.stdout:2704 punch from 0x77ee800 to 0x77f6c00, (0x8400 bytes) 2024-09-14T09:08:19.373 INFO:teuthology.orchestra.run.smithi148.stdout:2705 trunc from 0xe364c00 to 0x54d9a00 2024-09-14T09:08:19.435 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:19.435 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:19.448 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:08:19.461 INFO:teuthology.orchestra.run.smithi148.stdout:2712 trunc from 0x54d9a00 to 0x7ace200 2024-09-14T09:08:19.475 INFO:teuthology.orchestra.run.smithi148.stdout:truncating to largest ever: 0xee05400 2024-09-14T09:08:19.483 INFO:teuthology.orchestra.run.smithi148.stdout:2713 trunc from 0x7ace200 to 0xee05400 2024-09-14T09:08:19.489 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:19.491+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:19.493 INFO:teuthology.orchestra.run.smithi148.stdout:2714 read 0x85f9c00 thru 0x8605b09 (0xbf0a bytes) 2024-09-14T09:08:19.494 INFO:teuthology.orchestra.run.smithi148.stdout:2715 punch from 0x1619600 to 0x161aa00, (0x1400 bytes) 2024-09-14T09:08:19.498 INFO:teuthology.orchestra.run.smithi148.stdout:2718 trunc from 0xee05400 to 0xbf9b400 2024-09-14T09:08:19.530 INFO:teuthology.orchestra.run.smithi148.stdout:2719 write 0xe99d600 thru 0xe9ace57 (0xf858 bytes) 2024-09-14T09:08:19.531 INFO:teuthology.orchestra.run.smithi148.stdout:2721 punch from 0x50eba00 to 0x50ed200, (0x1800 bytes) 2024-09-14T09:08:19.532 INFO:teuthology.orchestra.run.smithi148.stdout:2722 clone 17 order 23 su 524288 sc 12 2024-09-14T09:08:19.562 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:19.564+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:19.599 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:19.599 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:19.607 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:08:19.663 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:19.665+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:19.710 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:19.710 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:19.719 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:08:19.764 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:19.765+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:19.821 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:19.821 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:19.830 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:08:19.871 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:19.873+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:19.874 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is set 2024-09-14T09:08:19.949 INFO:teuthology.orchestra.run.smithi148.stdout:flattening image image_client.0-clone16 2024-09-14T09:08:19.966 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:19.967+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:19.983 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:19.983 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:19.992 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:08:20.067 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:20.069+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:20.098 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:20.098 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:20.107 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:08:20.168 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:20.169+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:20.212 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:20.213 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:20.221 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:08:20.269 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:20.271+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:20.330 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:20.330 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:20.339 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:08:20.370 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:20.372+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:20.376 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #15, image image_client.0-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent16 2024-09-14T09:08:20.445 INFO:teuthology.orchestra.run.smithi148.stdout:2726 trunc from 0xe9ad000 to 0x6d6b400 2024-09-14T09:08:20.471 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:20.473+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:20.483 INFO:teuthology.orchestra.run.smithi148.stdout:2728 trunc from 0x6d6b400 to 0x7484000 2024-09-14T09:08:20.487 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:20.488 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:20.497 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:08:20.498 INFO:teuthology.orchestra.run.smithi148.stdout:2730 write 0x4bc6a00 thru 0x4bc796b (0xf6c bytes) 2024-09-14T09:08:20.503 INFO:teuthology.orchestra.run.smithi148.stdout:2731 read 0x18cb400 thru 0x18d1fbf (0x6bc0 bytes) 2024-09-14T09:08:20.504 INFO:teuthology.orchestra.run.smithi148.stdout:2734 punch from 0x1e7e600 to 0x1e84200, (0x5c00 bytes) 2024-09-14T09:08:20.512 INFO:teuthology.orchestra.run.smithi148.stdout:2737 trunc from 0x7484000 to 0x2bf0400 2024-09-14T09:08:20.572 INFO:teuthology.orchestra.run.smithi148.stdout:2738 trunc from 0x2bf0400 to 0xbced400 2024-09-14T09:08:20.572 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:20.573+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:20.586 INFO:teuthology.orchestra.run.smithi148.stdout:2740 read 0x2f6a600 thru 0x2f6d486 (0x2e87 bytes) 2024-09-14T09:08:20.596 INFO:teuthology.orchestra.run.smithi148.stdout:2741 trunc from 0xbced400 to 0x412f400 2024-09-14T09:08:20.612 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T09:08:20.612 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:08:20.613 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T09:08:20.614 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:20.614 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:20.619 INFO:teuthology.orchestra.run.smithi148.stdout:2742 trunc from 0x412f400 to 0xdda1a00 2024-09-14T09:08:20.623 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:08:20.627 INFO:teuthology.orchestra.run.smithi148.stdout:2743 write 0x5202200 thru 0x520e58c (0xc38d bytes) 2024-09-14T09:08:20.629 INFO:teuthology.orchestra.run.smithi148.stdout:2744 write 0x2b4d400 thru 0x2b5998c (0xc58d bytes) 2024-09-14T09:08:20.631 INFO:teuthology.orchestra.run.smithi148.stdout:2746 trunc from 0xdda1a00 to 0xe9e1800 2024-09-14T09:08:20.653 INFO:teuthology.orchestra.run.smithi148.stdout:2747 trunc from 0xe9e1800 to 0x585f400 2024-09-14T09:08:20.666 INFO:teuthology.orchestra.run.smithi148.stdout:2748 read 0x2a43e00 thru 0x2a534ea (0xf6eb bytes) 2024-09-14T09:08:20.671 INFO:teuthology.orchestra.run.smithi148.stdout:2749 punch from 0x4381800 to 0x438fa00, (0xe200 bytes) 2024-09-14T09:08:20.671 INFO:teuthology.orchestra.run.smithi148.stdout:2750 write 0x3850400 thru 0x385e3cb (0xdfcc bytes) 2024-09-14T09:08:20.672 INFO:teuthology.orchestra.run.smithi148.stdout:2751 read 0x4837200 thru 0x483f5b2 (0x83b3 bytes) 2024-09-14T09:08:20.672 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:20.674+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:20.673 INFO:teuthology.orchestra.run.smithi148.stdout:2752 punch from 0x2b2ae00 to 0x2b30e00, (0x6000 bytes) 2024-09-14T09:08:20.673 INFO:teuthology.orchestra.run.smithi148.stdout:2755 punch from 0x56afa00 to 0x56ba800, (0xae00 bytes) 2024-09-14T09:08:20.682 INFO:teuthology.orchestra.run.smithi148.stdout:2757 trunc from 0x585f400 to 0xdac2400 2024-09-14T09:08:20.692 INFO:teuthology.orchestra.run.smithi148.stdout:2758 read 0x80a3600 thru 0x80aba57 (0x8458 bytes) 2024-09-14T09:08:20.693 INFO:teuthology.orchestra.run.smithi148.stdout:2759 write 0x7203200 thru 0x720c53f (0x9340 bytes) 2024-09-14T09:08:20.693 INFO:teuthology.orchestra.run.smithi148.stdout:2761 punch from 0x2e31e00 to 0x2e41600, (0xf800 bytes) 2024-09-14T09:08:20.697 INFO:teuthology.orchestra.run.smithi148.stdout:2763 write 0x542a600 thru 0x5430f1d (0x691e bytes) 2024-09-14T09:08:20.698 INFO:teuthology.orchestra.run.smithi148.stdout:2765 write 0xaa6a400 thru 0xaa79294 (0xee95 bytes) 2024-09-14T09:08:20.698 INFO:teuthology.orchestra.run.smithi148.stdout:2766 read 0x1329c00 thru 0x13324c8 (0x88c9 bytes) 2024-09-14T09:08:20.699 INFO:teuthology.orchestra.run.smithi148.stdout:2768 read 0x4214600 thru 0x421680c (0x220d bytes) 2024-09-14T09:08:20.699 INFO:teuthology.orchestra.run.smithi148.stdout:2769 write 0x4d18a00 thru 0x4d1c1d8 (0x37d9 bytes) 2024-09-14T09:08:20.699 INFO:teuthology.orchestra.run.smithi148.stdout:2770 read 0x14fd000 thru 0x14fe1cd (0x11ce bytes) 2024-09-14T09:08:20.705 INFO:teuthology.orchestra.run.smithi148.stdout:2771 trunc from 0xdac2400 to 0x99a1200 2024-09-14T09:08:20.721 INFO:teuthology.orchestra.run.smithi148.stdout:2773 trunc from 0x99a1200 to 0x812d600 2024-09-14T09:08:20.733 INFO:teuthology.orchestra.run.smithi148.stdout:2775 read 0x1414a00 thru 0x1416125 (0x1726 bytes) 2024-09-14T09:08:20.734 INFO:teuthology.orchestra.run.smithi148.stdout:2776 read 0x7975600 thru 0x79768c2 (0x12c3 bytes) 2024-09-14T09:08:20.754 INFO:teuthology.orchestra.run.smithi148.stdout:2779 write 0xdcea600 thru 0xdced9a6 (0x33a7 bytes) 2024-09-14T09:08:20.754 INFO:teuthology.orchestra.run.smithi148.stdout:2780 write 0x6e25000 thru 0x6e26315 (0x1316 bytes) 2024-09-14T09:08:20.754 INFO:teuthology.orchestra.run.smithi148.stdout:2783 write 0x93b0000 thru 0x93be024 (0xe025 bytes) 2024-09-14T09:08:20.754 INFO:teuthology.orchestra.run.smithi148.stdout:2784 write 0xd28000 thru 0xd2fbdf (0x7be0 bytes) 2024-09-14T09:08:20.754 INFO:teuthology.orchestra.run.smithi148.stdout:2785 read 0x6270400 thru 0x627b113 (0xad14 bytes) 2024-09-14T09:08:20.754 INFO:teuthology.orchestra.run.smithi148.stdout:2787 read 0xc34f000 thru 0xc3524d4 (0x34d5 bytes) 2024-09-14T09:08:20.755 INFO:teuthology.orchestra.run.smithi148.stdout:2789 write 0x7a64800 thru 0x7a69f2c (0x572d bytes) 2024-09-14T09:08:20.755 INFO:teuthology.orchestra.run.smithi148.stdout:2790 read 0x3528000 thru 0x3532431 (0xa432 bytes) 2024-09-14T09:08:20.755 INFO:teuthology.orchestra.run.smithi148.stdout:2793 read 0x78c800 thru 0x79a3bc (0xdbbd bytes) 2024-09-14T09:08:20.755 INFO:teuthology.orchestra.run.smithi148.stdout:2794 read 0xc97c400 thru 0xc97fbe9 (0x37ea bytes) 2024-09-14T09:08:20.756 INFO:teuthology.orchestra.run.smithi148.stdout:2803 punch from 0x22e1800 to 0x22e8a00, (0x7200 bytes) 2024-09-14T09:08:20.756 INFO:teuthology.orchestra.run.smithi148.stdout:2804 write 0x5a29600 thru 0x5a2aa7a (0x147b bytes) 2024-09-14T09:08:20.757 INFO:teuthology.orchestra.run.smithi148.stdout:2807 write 0x7a98800 thru 0x7a99326 (0xb27 bytes) 2024-09-14T09:08:20.757 INFO:teuthology.orchestra.run.smithi148.stdout:2808 write 0x5af1600 thru 0x5afea4f (0xd450 bytes) 2024-09-14T09:08:20.758 INFO:teuthology.orchestra.run.smithi148.stdout:2809 write 0x683c000 thru 0x6849c0e (0xdc0f bytes) 2024-09-14T09:08:20.759 INFO:teuthology.orchestra.run.smithi148.stdout:2810 punch from 0x4ecf000 to 0x4ed2e00, (0x3e00 bytes) 2024-09-14T09:08:20.760 INFO:teuthology.orchestra.run.smithi148.stdout:2812 write 0xc9cb800 thru 0xc9d5c8e (0xa48f bytes) 2024-09-14T09:08:20.760 INFO:teuthology.orchestra.run.smithi148.stdout:2813 write 0xc3ee800 thru 0xc3fc230 (0xda31 bytes) 2024-09-14T09:08:20.760 INFO:teuthology.orchestra.run.smithi148.stdout:2814 punch from 0x1485800 to 0x1486a00, (0x1200 bytes) 2024-09-14T09:08:20.760 INFO:teuthology.orchestra.run.smithi148.stdout:2817 write 0xac66a00 thru 0xac69f30 (0x3531 bytes) 2024-09-14T09:08:20.760 INFO:teuthology.orchestra.run.smithi148.stdout:2818 write 0x34b9800 thru 0x34bdaad (0x42ae bytes) 2024-09-14T09:08:20.761 INFO:teuthology.orchestra.run.smithi148.stdout:2819 read 0x4a26200 thru 0x4a33313 (0xd114 bytes) 2024-09-14T09:08:20.773 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:20.775+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:20.774 INFO:teuthology.orchestra.run.smithi148.stdout:2821 write 0xeb73600 thru 0xeb7fd1f (0xc720 bytes) 2024-09-14T09:08:20.774 INFO:teuthology.orchestra.run.smithi148.stdout:2822 punch from 0x4be1800 to 0x4beec00, (0xd400 bytes) 2024-09-14T09:08:20.775 INFO:teuthology.orchestra.run.smithi148.stdout:2825 write 0xc17b000 thru 0xc183d63 (0x8d64 bytes) 2024-09-14T09:08:20.775 INFO:teuthology.orchestra.run.smithi148.stdout:2826 write 0xd9e1600 thru 0xd9eb4c0 (0x9ec1 bytes) 2024-09-14T09:08:20.776 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:20.777 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:20.784 INFO:teuthology.orchestra.run.smithi148.stdout:2828 trunc from 0xeb7fe00 to 0x72f1000 2024-09-14T09:08:20.787 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:08:20.830 INFO:teuthology.orchestra.run.smithi148.stdout:2829 write 0x8035c00 thru 0x8038c40 (0x3041 bytes) 2024-09-14T09:08:20.830 INFO:teuthology.orchestra.run.smithi148.stdout:2830 flatten 2024-09-14T09:08:20.857 INFO:teuthology.orchestra.run.smithi148.stdout:2831 write 0xe5edc00 thru 0xe5f7bee (0x9fef bytes) 2024-09-14T09:08:20.859 INFO:teuthology.orchestra.run.smithi148.stdout:2832 punch from 0x5bac000 to 0x5bb6c00, (0xac00 bytes) 2024-09-14T09:08:20.859 INFO:teuthology.orchestra.run.smithi148.stdout:2833 read 0x8dbaa00 thru 0x8dc5566 (0xab67 bytes) 2024-09-14T09:08:20.859 INFO:teuthology.orchestra.run.smithi148.stdout:2834 punch from 0xcfbca00 to 0xcfc7a00, (0xb000 bytes) 2024-09-14T09:08:20.865 INFO:teuthology.orchestra.run.smithi148.stdout:2837 trunc from 0xe5f7c00 to 0x97a0a00 2024-09-14T09:08:20.874 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:20.876+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:20.884 INFO:teuthology.orchestra.run.smithi148.stdout:2840 read 0x1593400 thru 0x159b206 (0x7e07 bytes) 2024-09-14T09:08:20.885 INFO:teuthology.orchestra.run.smithi148.stdout:2841 write 0x6f36600 thru 0x6f3ddec (0x77ed bytes) 2024-09-14T09:08:20.885 INFO:teuthology.orchestra.run.smithi148.stdout:2842 write 0x7479800 thru 0x7488a1f (0xf220 bytes) 2024-09-14T09:08:20.886 INFO:teuthology.orchestra.run.smithi148.stdout:2845 write 0x62c000 thru 0x62d067 (0x1068 bytes) 2024-09-14T09:08:20.886 INFO:teuthology.orchestra.run.smithi148.stdout:2848 write 0x50ae600 thru 0x50b5a25 (0x7426 bytes) 2024-09-14T09:08:20.887 INFO:teuthology.orchestra.run.smithi148.stdout:2851 write 0x8194000 thru 0x819807c (0x407d bytes) 2024-09-14T09:08:20.888 INFO:teuthology.orchestra.run.smithi148.stdout:2853 write 0x1af7800 thru 0x1afc2ee (0x4aef bytes) 2024-09-14T09:08:20.888 INFO:teuthology.orchestra.run.smithi148.stdout:2854 write 0x7547c00 thru 0x7552152 (0xa553 bytes) 2024-09-14T09:08:20.890 INFO:teuthology.orchestra.run.smithi148.stdout:2855 trunc from 0x97a0a00 to 0xb14a600 2024-09-14T09:08:20.903 INFO:teuthology.orchestra.run.smithi148.stdout:2856 read 0x908200 thru 0x909ec5 (0x1cc6 bytes) 2024-09-14T09:08:20.903 INFO:teuthology.orchestra.run.smithi148.stdout:2857 read 0x41ffe00 thru 0x4204b1f (0x4d20 bytes) 2024-09-14T09:08:20.910 INFO:teuthology.orchestra.run.smithi148.stdout:2861 trunc from 0xb14a600 to 0x61a9a00 2024-09-14T09:08:20.936 INFO:teuthology.orchestra.run.smithi148.stdout:2863 trunc from 0x61a9a00 to 0x2c06200 2024-09-14T09:08:20.940 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:20.940 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:20.954 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:08:20.955 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T09:08:20.955 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:08:20.957 INFO:teuthology.orchestra.run.smithi148.stdout:2865 write 0x5fd400 thru 0x609d01 (0xc902 bytes) 2024-09-14T09:08:20.959 INFO:teuthology.orchestra.run.smithi148.stdout:2866 trunc from 0x2c06200 to 0x4869e00 2024-09-14T09:08:20.964 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-14T09:08:19.875582+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":553155526,"num_objects":538,"num_object_clones":140,"num_object_copies":1076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":538,"num_whiteouts":119,"num_read":78907,"num_read_kb":359548,"num_write":7400,"num_write_kb":108799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6542,"ondisk_log_size":6542,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":295396,"kb_used_data":83304,"kb_used_omap":9,"kb_used_meta":211958,"kb_avail":565935644,"statfs":{"total":579820584960,"available":579518099456,"internally_reserved":0,"allocated":85303296,"data_stored":99884894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":217045664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":101992593,"num_objects":109,"num_object_clones":22,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":13,"num_read":24695,"num_read_kb":104297,"num_write":2696,"num_write_kb":35162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.020359"},"pg_stats":[{"pgid":"3.1f","version":"46'60","reported_seq":912,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:18.169771+0000","last_change":"2024-09-14T09:07:47.303301+0000","last_active":"2024-09-14T09:08:18.169771+0000","last_peered":"2024-09-14T09:08:18.169771+0000","last_clean":"2024-09-14T09:08:18.169771+0000","last_became_active":"2024-09-14T09:07:45.296596+0000","last_became_peered":"2024-09-14T09:07:45.296596+0000","last_unstale":"2024-09-14T09:08:18.169771+0000","last_undegraded":"2024-09-14T09:08:18.169771+0000","last_fullsized":"2024-09-14T09:08:18.169771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:35.218240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039985999999999998,"stat_sum":{"num_bytes":9242640,"num_objects":14,"num_object_clones":4,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":1,"num_read":796,"num_read_kb":5354,"num_write":60,"num_write_kb":1719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"46'149","reported_seq":2978,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:19.166415+0000","last_change":"2024-09-14T09:07:47.298224+0000","last_active":"2024-09-14T09:08:19.166415+0000","last_peered":"2024-09-14T09:08:19.166415+0000","last_clean":"2024-09-14T09:08:19.166415+0000","last_became_active":"2024-09-14T09:07:45.293343+0000","last_became_peered":"2024-09-14T09:07:45.293343+0000","last_unstale":"2024-09-14T09:08:19.166415+0000","last_undegraded":"2024-09-14T09:08:19.166415+0000","last_fullsized":"2024-09-14T09:08:19.166415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:12.037681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000584799,"stat_sum":{"num_bytes":12836880,"num_objects":16,"num_object_clones":4,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":2,"num_read":3352,"num_read_kb":14345,"num_write":130,"num_write_kb":1955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"46'163","reported_seq":3772,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:19.082987+0000","last_change":"2024-09-14T09:07:47.297691+0000","last_active":"2024-09-14T09:08:19.082987+0000","last_peered":"2024-09-14T09:08:19.082987+0000","last_clean":"2024-09-14T09:08:19.082987+0000","last_became_active":"2024-09-14T09:07:45.294968+0000","last_became_peered":"2024-09-14T09:07:45.294968+0000","last_unstale":"2024-09-14T09:08:19.082987+0000","last_undegraded":"2024-09-14T09:08:19.082987+0000","last_fullsized":"2024-09-14T09:08:19.082987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:24.523831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048996200000000004,"stat_sum":{"num_bytes":41666560,"num_objects":19,"num_object_clones":5,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":4,"num_read":4217,"num_read_kb":51345,"num_write":219,"num_write_kb":17084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"46'336","reported_seq":2602,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:18.947860+0000","last_change":"2024-09-14T09:07:47.301207+0000","last_active":"2024-09-14T09:08:18.947860+0000","last_peered":"2024-09-14T09:08:18.947860+0000","last_clean":"2024-09-14T09:08:18.947860+0000","last_became_active":"2024-09-14T09:07:45.293048+0000","last_became_peered":"2024-09-14T09:07:45.293048+0000","last_unstale":"2024-09-14T09:08:18.947860+0000","last_undegraded":"2024-09-14T09:08:18.947860+0000","last_fullsized":"2024-09-14T09:08:18.947860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:15.520778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050521400000000003,"stat_sum":{"num_bytes":3253660,"num_objects":16,"num_object_clones":2,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":4,"num_read":4839,"num_read_kb":4542,"num_write":314,"num_write_kb":816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"46'124","reported_seq":1691,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:18.200701+0000","last_change":"2024-09-14T09:07:47.321236+0000","last_active":"2024-09-14T09:08:18.200701+0000","last_peered":"2024-09-14T09:08:18.200701+0000","last_clean":"2024-09-14T09:08:18.200701+0000","last_became_active":"2024-09-14T09:07:45.291086+0000","last_became_peered":"2024-09-14T09:07:45.291086+0000","last_unstale":"2024-09-14T09:08:18.200701+0000","last_undegraded":"2024-09-14T09:08:18.200701+0000","last_fullsized":"2024-09-14T09:08:18.200701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:24.178836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046265,"stat_sum":{"num_bytes":25863680,"num_objects":21,"num_object_clones":6,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":6,"num_read":2171,"num_read_kb":12094,"num_write":110,"num_write_kb":2781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"46'281","reported_seq":5043,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:19.184457+0000","last_change":"2024-09-14T09:07:47.301821+0000","last_active":"2024-09-14T09:08:19.184457+0000","last_peered":"2024-09-14T09:08:19.184457+0000","last_clean":"2024-09-14T09:08:19.184457+0000","last_became_active":"2024-09-14T09:07:45.296486+0000","last_became_peered":"2024-09-14T09:07:45.296486+0000","last_unstale":"2024-09-14T09:08:19.184457+0000","last_undegraded":"2024-09-14T09:08:19.184457+0000","last_fullsized":"2024-09-14T09:08:19.184457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:05.558086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010144069999999999,"stat_sum":{"num_bytes":16817227,"num_objects":13,"num_object_clones":1,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":6427,"num_read_kb":17354,"num_write":213,"num_write_kb":6577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"46'81","reported_seq":1299,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:18.194205+0000","last_change":"2024-09-14T09:07:47.295943+0000","last_active":"2024-09-14T09:08:18.194205+0000","last_peered":"2024-09-14T09:08:18.194205+0000","last_clean":"2024-09-14T09:08:18.194205+0000","last_became_active":"2024-09-14T09:07:45.291261+0000","last_became_peered":"2024-09-14T09:07:45.291261+0000","last_unstale":"2024-09-14T09:08:18.194205+0000","last_undegraded":"2024-09-14T09:08:18.194205+0000","last_fullsized":"2024-09-14T09:08:18.194205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:57:26.813196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076281999999999999,"stat_sum":{"num_bytes":17034510,"num_objects":18,"num_object_clones":5,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":3,"num_read":1200,"num_read_kb":11059,"num_write":90,"num_write_kb":3606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"46'75","reported_seq":834,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:18.194601+0000","last_change":"2024-09-14T09:07:47.295872+0000","last_active":"2024-09-14T09:08:18.194601+0000","last_peered":"2024-09-14T09:08:18.194601+0000","last_clean":"2024-09-14T09:08:18.194601+0000","last_became_active":"2024-09-14T09:07:45.290340+0000","last_became_peered":"2024-09-14T09:07:45.290340+0000","last_unstale":"2024-09-14T09:08:18.194601+0000","last_undegraded":"2024-09-14T09:08:18.194601+0000","last_fullsized":"2024-09-14T09:08:18.194601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:21.955361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074901799999999995,"stat_sum":{"num_bytes":3983360,"num_objects":11,"num_object_clones":2,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":2,"num_read":697,"num_read_kb":2791,"num_write":71,"num_write_kb":970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"46'135","reported_seq":936,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:18.178133+0000","last_change":"2024-09-14T09:07:47.303452+0000","last_active":"2024-09-14T09:08:18.178133+0000","last_peered":"2024-09-14T09:08:18.178133+0000","last_clean":"2024-09-14T09:08:18.178133+0000","last_became_active":"2024-09-14T09:07:45.293845+0000","last_became_peered":"2024-09-14T09:07:45.293845+0000","last_unstale":"2024-09-14T09:08:18.178133+0000","last_undegraded":"2024-09-14T09:08:18.178133+0000","last_fullsized":"2024-09-14T09:08:18.178133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:21.553507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051411100000000004,"stat_sum":{"num_bytes":25359902,"num_objects":14,"num_object_clones":3,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":2,"num_read":931,"num_read_kb":11514,"num_write":168,"num_write_kb":2878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"46'138","reported_seq":1097,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:18.793680+0000","last_change":"2024-09-14T09:07:47.298438+0000","last_active":"2024-09-14T09:08:18.793680+0000","last_peered":"2024-09-14T09:08:18.793680+0000","last_clean":"2024-09-14T09:08:18.793680+0000","last_became_active":"2024-09-14T09:07:45.290208+0000","last_became_peered":"2024-09-14T09:07:45.290208+0000","last_unstale":"2024-09-14T09:08:18.793680+0000","last_undegraded":"2024-09-14T09:08:18.793680+0000","last_fullsized":"2024-09-14T09:08:18.793680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:20.810685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059324300000000003,"stat_sum":{"num_bytes":17318912,"num_objects":15,"num_object_clones":6,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":5,"num_read":933,"num_read_kb":11482,"num_write":149,"num_write_kb":5583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"46'412","reported_seq":4364,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:17.173044+0000","last_change":"2024-09-14T09:07:47.313834+0000","last_active":"2024-09-14T09:08:17.173044+0000","last_peered":"2024-09-14T09:08:17.173044+0000","last_clean":"2024-09-14T09:08:17.173044+0000","last_became_active":"2024-09-14T09:07:45.293650+0000","last_became_peered":"2024-09-14T09:07:45.293650+0000","last_unstale":"2024-09-14T09:08:17.173044+0000","last_undegraded":"2024-09-14T09:08:17.173044+0000","last_fullsized":"2024-09-14T09:08:17.173044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:50.028915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069631000000000001,"stat_sum":{"num_bytes":6799445,"num_objects":16,"num_object_clones":4,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":4,"num_read":6520,"num_read_kb":5748,"num_write":353,"num_write_kb":890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"46'135","reported_seq":1283,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:19.198408+0000","last_change":"2024-09-14T09:07:47.301479+0000","last_active":"2024-09-14T09:08:19.198408+0000","last_peered":"2024-09-14T09:08:19.198408+0000","last_clean":"2024-09-14T09:08:19.198408+0000","last_became_active":"2024-09-14T09:07:45.290479+0000","last_became_peered":"2024-09-14T09:07:45.290479+0000","last_unstale":"2024-09-14T09:08:19.198408+0000","last_undegraded":"2024-09-14T09:08:19.198408+0000","last_fullsized":"2024-09-14T09:08:19.198408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:53.914237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074908899999999998,"stat_sum":{"num_bytes":13450256,"num_objects":14,"num_object_clones":3,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":3,"num_read":1632,"num_read_kb":3465,"num_write":115,"num_write_kb":1286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":72,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:16.878186+0000","last_change":"2024-09-14T09:07:37.257097+0000","last_active":"2024-09-14T09:08:16.878186+0000","last_peered":"2024-09-14T09:08:16.878186+0000","last_clean":"2024-09-14T09:08:16.878186+0000","last_became_active":"2024-09-14T09:07:35.253071+0000","last_became_peered":"2024-09-14T09:07:35.253071+0000","last_unstale":"2024-09-14T09:08:16.878186+0000","last_undegraded":"2024-09-14T09:08:16.878186+0000","last_fullsized":"2024-09-14T09:08:16.878186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:27.094847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061552199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"46'168","reported_seq":2213,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:18.157190+0000","last_change":"2024-09-14T09:07:47.296341+0000","last_active":"2024-09-14T09:08:18.157190+0000","last_peered":"2024-09-14T09:08:18.157190+0000","last_clean":"2024-09-14T09:08:18.157190+0000","last_became_active":"2024-09-14T09:07:45.290675+0000","last_became_peered":"2024-09-14T09:07:45.290675+0000","last_unstale":"2024-09-14T09:08:18.157190+0000","last_undegraded":"2024-09-14T09:08:18.157190+0000","last_fullsized":"2024-09-14T09:08:18.157190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:02.005194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075299600000000003,"stat_sum":{"num_bytes":7447589,"num_objects":15,"num_object_clones":4,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":3,"num_read":3546,"num_read_kb":4024,"num_write":112,"num_write_kb":926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:16.864111+0000","last_change":"2024-09-14T09:07:37.256104+0000","last_active":"2024-09-14T09:08:16.864111+0000","last_peered":"2024-09-14T09:08:16.864111+0000","last_clean":"2024-09-14T09:08:16.864111+0000","last_became_active":"2024-09-14T09:07:35.253725+0000","last_became_peered":"2024-09-14T09:07:35.253725+0000","last_unstale":"2024-09-14T09:08:16.864111+0000","last_undegraded":"2024-09-14T09:08:16.864111+0000","last_fullsized":"2024-09-14T09:08:16.864111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:42.441599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042190199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"46'328","reported_seq":2683,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:18.171513+0000","last_change":"2024-09-14T09:07:47.296096+0000","last_active":"2024-09-14T09:08:18.171513+0000","last_peered":"2024-09-14T09:08:18.171513+0000","last_clean":"2024-09-14T09:08:18.171513+0000","last_became_active":"2024-09-14T09:07:45.290313+0000","last_became_peered":"2024-09-14T09:07:45.290313+0000","last_unstale":"2024-09-14T09:08:18.171513+0000","last_undegraded":"2024-09-14T09:08:18.171513+0000","last_fullsized":"2024-09-14T09:08:18.171513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:13.886878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076155400000000001,"stat_sum":{"num_bytes":9152596,"num_objects":16,"num_object_clones":3,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":5,"num_read":3320,"num_read_kb":15447,"num_write":456,"num_write_kb":1074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":72,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:16.878454+0000","last_change":"2024-09-14T09:07:37.257178+0000","last_active":"2024-09-14T09:08:16.878454+0000","last_peered":"2024-09-14T09:08:16.878454+0000","last_clean":"2024-09-14T09:08:16.878454+0000","last_became_active":"2024-09-14T09:07:35.254147+0000","last_became_peered":"2024-09-14T09:07:35.254147+0000","last_unstale":"2024-09-14T09:08:16.878454+0000","last_undegraded":"2024-09-14T09:08:16.878454+0000","last_fullsized":"2024-09-14T09:08:16.878454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:39:27.498363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067899400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"46'209","reported_seq":667,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:18.194103+0000","last_change":"2024-09-14T09:07:47.296361+0000","last_active":"2024-09-14T09:08:18.194103+0000","last_peered":"2024-09-14T09:08:18.194103+0000","last_clean":"2024-09-14T09:08:18.194103+0000","last_became_active":"2024-09-14T09:07:45.294376+0000","last_became_peered":"2024-09-14T09:07:45.294376+0000","last_unstale":"2024-09-14T09:08:18.194103+0000","last_undegraded":"2024-09-14T09:08:18.194103+0000","last_fullsized":"2024-09-14T09:08:18.194103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:41.236045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091285100000000001,"stat_sum":{"num_bytes":3383947,"num_objects":16,"num_object_clones":6,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":3,"num_read":1001,"num_read_kb":4844,"num_write":296,"num_write_kb":1655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":72,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:16.912030+0000","last_change":"2024-09-14T09:07:37.992319+0000","last_active":"2024-09-14T09:08:16.912030+0000","last_peered":"2024-09-14T09:08:16.912030+0000","last_clean":"2024-09-14T09:08:16.912030+0000","last_became_active":"2024-09-14T09:07:35.254014+0000","last_became_peered":"2024-09-14T09:07:35.254014+0000","last_unstale":"2024-09-14T09:08:16.912030+0000","last_undegraded":"2024-09-14T09:08:16.912030+0000","last_fullsized":"2024-09-14T09:08:16.912030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:17:16.263680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047858699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"46'341","reported_seq":4637,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:18.907572+0000","last_change":"2024-09-14T09:07:47.297773+0000","last_active":"2024-09-14T09:08:18.907572+0000","last_peered":"2024-09-14T09:08:18.907572+0000","last_clean":"2024-09-14T09:08:18.907572+0000","last_became_active":"2024-09-14T09:07:45.294404+0000","last_became_peered":"2024-09-14T09:07:45.294404+0000","last_unstale":"2024-09-14T09:08:18.907572+0000","last_undegraded":"2024-09-14T09:08:18.907572+0000","last_fullsized":"2024-09-14T09:08:18.907572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:20.006235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036070699999999999,"stat_sum":{"num_bytes":22270140,"num_objects":23,"num_object_clones":5,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":4,"num_read":6020,"num_read_kb":25278,"num_write":346,"num_write_kb":4234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"45'704","reported_seq":1024,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:17.187084+0000","last_change":"2024-09-14T09:07:47.313637+0000","last_active":"2024-09-14T09:08:17.187084+0000","last_peered":"2024-09-14T09:08:17.187084+0000","last_clean":"2024-09-14T09:08:17.187084+0000","last_became_active":"2024-09-14T09:07:45.290878+0000","last_became_peered":"2024-09-14T09:07:45.290878+0000","last_unstale":"2024-09-14T09:08:17.187084+0000","last_undegraded":"2024-09-14T09:08:17.187084+0000","last_fullsized":"2024-09-14T09:08:17.187084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:07.761957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062768899999999996,"stat_sum":{"num_bytes":6053603,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":2,"num_read":3600,"num_read_kb":3562,"num_write":1190,"num_write_kb":2745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":74,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:16.864342+0000","last_change":"2024-09-14T09:07:37.260986+0000","last_active":"2024-09-14T09:08:16.864342+0000","last_peered":"2024-09-14T09:08:16.864342+0000","last_clean":"2024-09-14T09:08:16.864342+0000","last_became_active":"2024-09-14T09:07:35.254256+0000","last_became_peered":"2024-09-14T09:07:35.254256+0000","last_unstale":"2024-09-14T09:08:16.864342+0000","last_undegraded":"2024-09-14T09:08:16.864342+0000","last_fullsized":"2024-09-14T09:08:16.864342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:07.063058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096898500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"46'115","reported_seq":1308,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:18.173026+0000","last_change":"2024-09-14T09:07:47.303512+0000","last_active":"2024-09-14T09:08:18.173026+0000","last_peered":"2024-09-14T09:08:18.173026+0000","last_clean":"2024-09-14T09:08:18.173026+0000","last_became_active":"2024-09-14T09:07:45.295656+0000","last_became_peered":"2024-09-14T09:07:45.295656+0000","last_unstale":"2024-09-14T09:08:18.173026+0000","last_undegraded":"2024-09-14T09:08:18.173026+0000","last_fullsized":"2024-09-14T09:08:18.173026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:26.415863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049108300000000001,"stat_sum":{"num_bytes":12461126,"num_objects":20,"num_object_clones":6,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":3,"num_read":1445,"num_read_kb":7637,"num_write":154,"num_write_kb":1445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":58,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:16.911965+0000","last_change":"2024-09-14T09:07:45.293998+0000","last_active":"2024-09-14T09:08:16.911965+0000","last_peered":"2024-09-14T09:08:16.911965+0000","last_clean":"2024-09-14T09:08:16.911965+0000","last_became_active":"2024-09-14T09:07:45.293722+0000","last_became_peered":"2024-09-14T09:07:45.293722+0000","last_unstale":"2024-09-14T09:08:16.911965+0000","last_undegraded":"2024-09-14T09:08:16.911965+0000","last_fullsized":"2024-09-14T09:08:16.911965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:49.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"46'235","reported_seq":1093,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:18.103556+0000","last_change":"2024-09-14T09:07:47.296145+0000","last_active":"2024-09-14T09:08:18.103556+0000","last_peered":"2024-09-14T09:08:18.103556+0000","last_clean":"2024-09-14T09:08:18.103556+0000","last_became_active":"2024-09-14T09:07:45.290168+0000","last_became_peered":"2024-09-14T09:07:45.290168+0000","last_unstale":"2024-09-14T09:08:18.103556+0000","last_undegraded":"2024-09-14T09:08:18.103556+0000","last_fullsized":"2024-09-14T09:08:18.103556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:05.782007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072743999999999999,"stat_sum":{"num_bytes":35841060,"num_objects":17,"num_object_clones":4,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":4,"num_read":1473,"num_read_kb":4116,"num_write":329,"num_write_kb":1127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":72,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:16.873827+0000","last_change":"2024-09-14T09:07:37.369655+0000","last_active":"2024-09-14T09:08:16.873827+0000","last_peered":"2024-09-14T09:08:16.873827+0000","last_clean":"2024-09-14T09:08:16.873827+0000","last_became_active":"2024-09-14T09:07:35.254080+0000","last_became_peered":"2024-09-14T09:07:35.254080+0000","last_unstale":"2024-09-14T09:08:16.873827+0000","last_undegraded":"2024-09-14T09:08:16.873827+0000","last_fullsized":"2024-09-14T09:08:16.873827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:06.212888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000375058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"46'127","reported_seq":1077,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:19.079667+0000","last_change":"2024-09-14T09:07:47.297413+0000","last_active":"2024-09-14T09:08:19.079667+0000","last_peered":"2024-09-14T09:08:19.079667+0000","last_clean":"2024-09-14T09:08:19.079667+0000","last_became_active":"2024-09-14T09:07:45.294205+0000","last_became_peered":"2024-09-14T09:07:45.294205+0000","last_unstale":"2024-09-14T09:08:19.079667+0000","last_undegraded":"2024-09-14T09:08:19.079667+0000","last_fullsized":"2024-09-14T09:08:19.079667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:33.571487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046587499999999998,"stat_sum":{"num_bytes":34266144,"num_objects":20,"num_object_clones":7,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":6,"num_read":971,"num_read_kb":10663,"num_write":121,"num_write_kb":6472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":73,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:16.878149+0000","last_change":"2024-09-14T09:07:37.257430+0000","last_active":"2024-09-14T09:08:16.878149+0000","last_peered":"2024-09-14T09:08:16.878149+0000","last_clean":"2024-09-14T09:08:16.878149+0000","last_became_active":"2024-09-14T09:07:35.253253+0000","last_became_peered":"2024-09-14T09:07:35.253253+0000","last_unstale":"2024-09-14T09:08:16.878149+0000","last_undegraded":"2024-09-14T09:08:16.878149+0000","last_fullsized":"2024-09-14T09:08:16.878149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:33.799033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094749299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":163,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:16.878009+0000","last_change":"2024-09-14T09:07:30.953383+0000","last_active":"2024-09-14T09:08:16.878009+0000","last_peered":"2024-09-14T09:08:16.878009+0000","last_clean":"2024-09-14T09:08:16.878009+0000","last_became_active":"2024-09-14T09:07:30.952238+0000","last_became_peered":"2024-09-14T09:07:30.952238+0000","last_unstale":"2024-09-14T09:08:16.878009+0000","last_undegraded":"2024-09-14T09:08:16.878009+0000","last_fullsized":"2024-09-14T09:08:16.878009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_clean_scrub_stamp":"2024-09-14T09:07:29.211432+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:30.453453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"46'340","reported_seq":5821,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:18.064251+0000","last_change":"2024-09-14T09:07:47.295661+0000","last_active":"2024-09-14T09:08:18.064251+0000","last_peered":"2024-09-14T09:08:18.064251+0000","last_clean":"2024-09-14T09:08:18.064251+0000","last_became_active":"2024-09-14T09:07:45.291352+0000","last_became_peered":"2024-09-14T09:07:45.291352+0000","last_unstale":"2024-09-14T09:08:18.064251+0000","last_undegraded":"2024-09-14T09:08:18.064251+0000","last_fullsized":"2024-09-14T09:08:18.064251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:09.495858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052540499999999995,"stat_sum":{"num_bytes":27896373,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":7770,"num_read_kb":29017,"num_write":233,"num_write_kb":5849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"45'187","reported_seq":2340,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:16.944632+0000","last_change":"2024-09-14T09:07:47.313274+0000","last_active":"2024-09-14T09:08:16.944632+0000","last_peered":"2024-09-14T09:08:16.944632+0000","last_clean":"2024-09-14T09:08:16.944632+0000","last_became_active":"2024-09-14T09:07:45.291074+0000","last_became_peered":"2024-09-14T09:07:45.291074+0000","last_unstale":"2024-09-14T09:08:16.944632+0000","last_undegraded":"2024-09-14T09:08:16.944632+0000","last_fullsized":"2024-09-14T09:08:16.944632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:58.317841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043522999999999999,"stat_sum":{"num_bytes":44904960,"num_objects":21,"num_object_clones":7,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":5,"num_read":2167,"num_read_kb":25624,"num_write":193,"num_write_kb":12688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"46'316","reported_seq":1294,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:16.864283+0000","last_change":"2024-09-14T09:07:47.313422+0000","last_active":"2024-09-14T09:08:16.864283+0000","last_peered":"2024-09-14T09:08:16.864283+0000","last_clean":"2024-09-14T09:08:16.864283+0000","last_became_active":"2024-09-14T09:07:45.290440+0000","last_became_peered":"2024-09-14T09:07:45.290440+0000","last_unstale":"2024-09-14T09:08:16.864283+0000","last_undegraded":"2024-09-14T09:08:16.864283+0000","last_fullsized":"2024-09-14T09:08:16.864283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:35.979988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052656399999999998,"stat_sum":{"num_bytes":17536170,"num_objects":17,"num_object_clones":3,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":3,"num_read":1973,"num_read_kb":14105,"num_write":469,"num_write_kb":1845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"46'105","reported_seq":495,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:17.112433+0000","last_change":"2024-09-14T09:07:47.313539+0000","last_active":"2024-09-14T09:08:17.112433+0000","last_peered":"2024-09-14T09:08:17.112433+0000","last_clean":"2024-09-14T09:08:17.112433+0000","last_became_active":"2024-09-14T09:07:45.294217+0000","last_became_peered":"2024-09-14T09:07:45.294217+0000","last_unstale":"2024-09-14T09:08:17.112433+0000","last_undegraded":"2024-09-14T09:08:17.112433+0000","last_fullsized":"2024-09-14T09:08:17.112433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:51:04.659215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056919399999999997,"stat_sum":{"num_bytes":7484576,"num_objects":18,"num_object_clones":4,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":3,"num_read":467,"num_read_kb":1392,"num_write":109,"num_write_kb":994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"46'77","reported_seq":873,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:17.101909+0000","last_change":"2024-09-14T09:07:47.313756+0000","last_active":"2024-09-14T09:08:17.101909+0000","last_peered":"2024-09-14T09:08:17.101909+0000","last_clean":"2024-09-14T09:08:17.101909+0000","last_became_active":"2024-09-14T09:07:45.293637+0000","last_became_peered":"2024-09-14T09:07:45.293637+0000","last_unstale":"2024-09-14T09:08:17.101909+0000","last_undegraded":"2024-09-14T09:08:17.101909+0000","last_fullsized":"2024-09-14T09:08:17.101909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:07.524826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069275800000000002,"stat_sum":{"num_bytes":19673600,"num_objects":15,"num_object_clones":5,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":5,"num_read":807,"num_read_kb":3166,"num_write":67,"num_write_kb":945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"46'172","reported_seq":2895,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:19.193728+0000","last_change":"2024-09-14T09:07:47.301414+0000","last_active":"2024-09-14T09:08:19.193728+0000","last_peered":"2024-09-14T09:08:19.193728+0000","last_clean":"2024-09-14T09:08:19.193728+0000","last_became_active":"2024-09-14T09:07:45.294493+0000","last_became_peered":"2024-09-14T09:07:45.294493+0000","last_unstale":"2024-09-14T09:08:19.193728+0000","last_undegraded":"2024-09-14T09:08:19.193728+0000","last_fullsized":"2024-09-14T09:08:19.193728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:35.940974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070405200000000004,"stat_sum":{"num_bytes":33669120,"num_objects":15,"num_object_clones":2,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":3,"num_read":2753,"num_read_kb":20727,"num_write":185,"num_write_kb":4733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"46'117","reported_seq":1003,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:19.167645+0000","last_change":"2024-09-14T09:07:47.298464+0000","last_active":"2024-09-14T09:08:19.167645+0000","last_peered":"2024-09-14T09:08:19.167645+0000","last_clean":"2024-09-14T09:08:19.167645+0000","last_became_active":"2024-09-14T09:07:45.289650+0000","last_became_peered":"2024-09-14T09:07:45.289650+0000","last_unstale":"2024-09-14T09:08:19.167645+0000","last_undegraded":"2024-09-14T09:08:19.167645+0000","last_fullsized":"2024-09-14T09:08:19.167645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:43.539110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042107499999999998,"stat_sum":{"num_bytes":14459904,"num_objects":26,"num_object_clones":10,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":7,"num_read":846,"num_read_kb":7358,"num_write":112,"num_write_kb":2213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"46'76","reported_seq":375,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:17.115026+0000","last_change":"2024-09-14T09:07:47.313995+0000","last_active":"2024-09-14T09:08:17.115026+0000","last_peered":"2024-09-14T09:08:17.115026+0000","last_clean":"2024-09-14T09:08:17.115026+0000","last_became_active":"2024-09-14T09:07:45.290029+0000","last_became_peered":"2024-09-14T09:07:45.290029+0000","last_unstale":"2024-09-14T09:08:17.115026+0000","last_undegraded":"2024-09-14T09:08:17.115026+0000","last_fullsized":"2024-09-14T09:08:17.115026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:37:24.503595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069832800000000001,"stat_sum":{"num_bytes":1433651,"num_objects":17,"num_object_clones":6,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":7,"num_read":281,"num_read_kb":1169,"num_write":72,"num_write_kb":1102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"46'265","reported_seq":621,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:19.165584+0000","last_change":"2024-09-14T09:07:47.301899+0000","last_active":"2024-09-14T09:08:19.165584+0000","last_peered":"2024-09-14T09:08:19.165584+0000","last_clean":"2024-09-14T09:08:19.165584+0000","last_became_active":"2024-09-14T09:07:45.297274+0000","last_became_peered":"2024-09-14T09:07:45.297274+0000","last_unstale":"2024-09-14T09:08:19.165584+0000","last_undegraded":"2024-09-14T09:08:19.165584+0000","last_fullsized":"2024-09-14T09:08:19.165584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:36.603701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098573200000000001,"stat_sum":{"num_bytes":1425450,"num_objects":15,"num_object_clones":4,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":7,"num_read":1356,"num_read_kb":4723,"num_write":422,"num_write_kb":1428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"46'235","reported_seq":3076,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:19.197922+0000","last_change":"2024-09-14T09:07:47.297380+0000","last_active":"2024-09-14T09:08:19.197922+0000","last_peered":"2024-09-14T09:08:19.197922+0000","last_clean":"2024-09-14T09:08:19.197922+0000","last_became_active":"2024-09-14T09:07:45.292235+0000","last_became_peered":"2024-09-14T09:07:45.292235+0000","last_unstale":"2024-09-14T09:08:19.197922+0000","last_undegraded":"2024-09-14T09:08:19.197922+0000","last_fullsized":"2024-09-14T09:08:19.197922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:26.523089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046904100000000001,"stat_sum":{"num_bytes":21371106,"num_objects":21,"num_object_clones":6,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":5,"num_read":3431,"num_read_kb":14542,"num_write":213,"num_write_kb":1478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"46'125","reported_seq":814,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:18.067362+0000","last_change":"2024-09-14T09:07:47.303282+0000","last_active":"2024-09-14T09:08:18.067362+0000","last_peered":"2024-09-14T09:08:18.067362+0000","last_clean":"2024-09-14T09:08:18.067362+0000","last_became_active":"2024-09-14T09:07:45.295433+0000","last_became_peered":"2024-09-14T09:07:45.295433+0000","last_unstale":"2024-09-14T09:08:18.067362+0000","last_undegraded":"2024-09-14T09:08:18.067362+0000","last_fullsized":"2024-09-14T09:08:18.067362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:44.143769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037123100000000002,"stat_sum":{"num_bytes":23954432,"num_objects":10,"num_object_clones":3,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":3,"num_read":662,"num_read_kb":6962,"num_write":117,"num_write_kb":1807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"46'136","reported_seq":846,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T09:08:18.592349+0000","last_change":"2024-09-14T09:07:47.301223+0000","last_active":"2024-09-14T09:08:18.592349+0000","last_peered":"2024-09-14T09:08:18.592349+0000","last_clean":"2024-09-14T09:08:18.592349+0000","last_became_active":"2024-09-14T09:07:45.293054+0000","last_became_peered":"2024-09-14T09:07:45.293054+0000","last_unstale":"2024-09-14T09:08:18.592349+0000","last_undegraded":"2024-09-14T09:08:18.592349+0000","last_fullsized":"2024-09-14T09:08:18.592349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:48.735899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000546114,"stat_sum":{"num_bytes":14252560,"num_objects":15,"num_object_clones":5,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":3,"num_read":1237,"num_read_kb":4044,"num_write":109,"num_write_kb":6264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":552565139,"num_objects":534,"num_object_clones":140,"num_object_copies":1068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":534,"num_whiteouts":119,"num_read":78841,"num_read_kb":359493,"num_write":7297,"num_write_kb":107169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84037632,"data_stored":100834086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6467,"ondisk_log_size":6467,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59952,"kb_used_data":20440,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94311888,"statfs":{"total":96636764160,"available":96575373312,"internally_reserved":0,"allocated":20930560,"data_stored":22792583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44468,"kb_used_data":9124,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327372,"statfs":{"total":96636764160,"available":96591228928,"internally_reserved":0,"allocated":9342976,"data_stored":10363975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607565,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40584,"kb_used_data":9400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331256,"statfs":{"total":96636764160,"available":96595206144,"internally_reserved":0,"allocated":9625600,"data_stored":11510635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607567,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37404,"kb_used_data":6220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334436,"statfs":{"total":96636764160,"available":96598462464,"internally_reserved":0,"allocated":6369280,"data_stored":7825524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607565,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49684,"kb_used_data":14336,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322156,"statfs":{"total":96636764160,"available":96585887744,"internally_reserved":0,"allocated":14680064,"data_stored":19323791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640269,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63304,"kb_used_data":23784,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94308536,"statfs":{"total":96636764160,"available":96571940864,"internally_reserved":0,"allocated":24354816,"data_stored":28068386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24821760,"data_stored":29243519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9211904,"data_stored":10524160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21340160,"data_stored":23508320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14249984,"data_stored":19183976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5857280,"data_stored":7625323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8556544,"data_stored":10748788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T09:08:20.968 INFO:teuthology.orchestra.run.smithi148.stdout:2870 read 0x44a2000 thru 0x44a7222 (0x5223 bytes) 2024-09-14T09:08:20.969 INFO:teuthology.orchestra.run.smithi148.stdout:2872 write 0x4697000 thru 0x46a48b6 (0xd8b7 bytes) 2024-09-14T09:08:20.973 INFO:teuthology.orchestra.run.smithi148.stdout:2874 trunc from 0x4869e00 to 0x696ec00 2024-09-14T09:08:20.982 INFO:teuthology.orchestra.run.smithi148.stdout:2875 read 0x1d13800 thru 0x1d19c2f (0x6430 bytes) 2024-09-14T09:08:21.002 INFO:teuthology.orchestra.run.smithi148.stdout:2876 write 0x863d400 thru 0x863e7c2 (0x13c3 bytes) 2024-09-14T09:08:21.002 INFO:teuthology.orchestra.run.smithi148.stdout:2878 write 0x1a2fe00 thru 0x1a37fd5 (0x81d6 bytes) 2024-09-14T09:08:21.002 INFO:teuthology.orchestra.run.smithi148.stdout:2879 punch from 0x71cb800 to 0x71d8e00, (0xd600 bytes) 2024-09-14T09:08:21.003 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:21.003+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:21.004 INFO:teuthology.orchestra.run.smithi148.stdout:2880 read 0x518e200 thru 0x51976dd (0x94de bytes) 2024-09-14T09:08:21.004 INFO:teuthology.orchestra.run.smithi148.stdout:2882 read 0x84c3200 thru 0x84d23a3 (0xf1a4 bytes) 2024-09-14T09:08:21.005 INFO:teuthology.orchestra.run.smithi148.stdout:2883 trunc from 0x863e800 to 0xa366200 2024-09-14T09:08:21.020 INFO:teuthology.orchestra.run.smithi148.stdout:2884 trunc from 0xa366200 to 0x560ae00 2024-09-14T09:08:21.051 INFO:teuthology.orchestra.run.smithi148.stdout:2886 write 0x9a18600 thru 0x9a274d2 (0xeed3 bytes) 2024-09-14T09:08:21.052 INFO:teuthology.orchestra.run.smithi148.stdout:2888 read 0x86ce000 thru 0x86ce882 (0x883 bytes) 2024-09-14T09:08:21.052 INFO:teuthology.orchestra.run.smithi148.stdout:2890 read 0x633200 thru 0x642921 (0xf722 bytes) 2024-09-14T09:08:21.069 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:21.070 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:21.071 INFO:teuthology.orchestra.run.smithi148.stdout:2892 write 0xe815a00 thru 0xe82119f (0xb7a0 bytes) 2024-09-14T09:08:21.075 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:21.077+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:21.079 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:08:21.084 INFO:teuthology.orchestra.run.smithi148.stdout:2893 write 0xeab3a00 thru 0xeab6e51 (0x3452 bytes) 2024-09-14T09:08:21.103 INFO:teuthology.orchestra.run.smithi148.stdout:2896 trunc from 0xeab7000 to 0xb34800 2024-09-14T09:08:21.128 INFO:teuthology.orchestra.run.smithi148.stdout:2897 read 0x6fdc00 thru 0x70d185 (0xf586 bytes) 2024-09-14T09:08:21.129 INFO:teuthology.orchestra.run.smithi148.stdout:2900 punch from 0xfd400 to 0xffa00, (0x2600 bytes) 2024-09-14T09:08:21.129 INFO:teuthology.orchestra.run.smithi148.stdout:2901 punch from 0x7e7000 to 0x7ece00, (0x5e00 bytes) 2024-09-14T09:08:21.152 INFO:teuthology.orchestra.run.smithi148.stdout:2905 write 0xbe81000 thru 0xbe8684c (0x584d bytes) 2024-09-14T09:08:21.152 INFO:teuthology.orchestra.run.smithi148.stdout:2907 punch from 0x3f7ac00 to 0x3f89a00, (0xee00 bytes) 2024-09-14T09:08:21.153 INFO:teuthology.orchestra.run.smithi148.stdout:2908 read 0x2d0f800 thru 0x2d1350c (0x3d0d bytes) 2024-09-14T09:08:21.156 INFO:teuthology.orchestra.run.smithi148.stdout:2910 read 0xb037200 thru 0xb04280d (0xb60e bytes) 2024-09-14T09:08:21.156 INFO:teuthology.orchestra.run.smithi148.stdout:2915 read 0xa91ec00 thru 0xa926688 (0x7a89 bytes) 2024-09-14T09:08:21.156 INFO:teuthology.orchestra.run.smithi148.stdout:2918 read 0x1ca2e00 thru 0x1cab92f (0x8b30 bytes) 2024-09-14T09:08:21.157 INFO:teuthology.orchestra.run.smithi148.stdout:2919 trunc from 0xbe86a00 to 0xc28b800 2024-09-14T09:08:21.166 INFO:teuthology.orchestra.run.smithi148.stdout:2920 write 0xd12800 thru 0xd1d482 (0xac83 bytes) 2024-09-14T09:08:21.167 INFO:teuthology.orchestra.run.smithi148.stdout:2924 write 0xb489200 thru 0xb4960ab (0xceac bytes) 2024-09-14T09:08:21.167 INFO:teuthology.orchestra.run.smithi148.stdout:2926 write 0xb1b800 thru 0xb2053c (0x4d3d bytes) 2024-09-14T09:08:21.170 INFO:teuthology.orchestra.run.smithi148.stdout:2928 trunc from 0xc28b800 to 0xdf53000 2024-09-14T09:08:21.176 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:21.178+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:21.182 INFO:teuthology.orchestra.run.smithi148.stdout:2929 punch from 0x9a2c200 to 0x9a30c00, (0x4a00 bytes) 2024-09-14T09:08:21.188 INFO:teuthology.orchestra.run.smithi148.stdout:2933 trunc from 0xdf53000 to 0x9944a00 2024-09-14T09:08:21.204 INFO:teuthology.orchestra.run.smithi148.stdout:2934 write 0x2837a00 thru 0x28419fc (0x9ffd bytes) 2024-09-14T09:08:21.205 INFO:teuthology.orchestra.run.smithi148.stdout:2939 read 0x2da1a00 thru 0x2da82c9 (0x68ca bytes) 2024-09-14T09:08:21.206 INFO:teuthology.orchestra.run.smithi148.stdout:2941 read 0x9637000 thru 0x963ba11 (0x4a12 bytes) 2024-09-14T09:08:21.206 INFO:teuthology.orchestra.run.smithi148.stdout:2944 punch from 0x66bbe00 to 0x66cb600, (0xf800 bytes) 2024-09-14T09:08:21.215 INFO:teuthology.orchestra.run.smithi148.stdout:2946 trunc from 0x9944a00 to 0x1d0de00 2024-09-14T09:08:21.233 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:21.233 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:21.238 INFO:teuthology.orchestra.run.smithi148.stdout:2948 read 0xa43800 thru 0xa505e4 (0xcde5 bytes) 2024-09-14T09:08:21.242 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:08:21.261 INFO:teuthology.orchestra.run.smithi148.stdout:2951 write 0x812a800 thru 0x812c044 (0x1845 bytes) 2024-09-14T09:08:21.269 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:08:21.270 INFO:teuthology.orchestra.run.smithi148.stdout:2953 trunc from 0x812c200 to 0x1748800 2024-09-14T09:08:21.303 INFO:teuthology.orchestra.run.smithi148.stdout:2955 read 0x146ac00 thru 0x146f562 (0x4963 bytes) 2024-09-14T09:08:21.303 INFO:teuthology.orchestra.run.smithi148.stdout:2957 clone 18 order 18 su 16384 sc 10 2024-09-14T09:08:21.314 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:21.316+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:21.349 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:21.349 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:21.360 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:08:21.390 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:21.390 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:21.406 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:21.407+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:21.406 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:21.407 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:21.422 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:08:21.422 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:08:21.439 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:21.439 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:21.457 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:21.457 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:21.467 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:21.467 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:21.474 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:21.474 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:21.476 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:08:21.478 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:21.480+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:21.579 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:21.582+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:21.618 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:21.618 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:21.618 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:21.619 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:21.619 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:21.627 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:08:21.680 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:21.682+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:21.731 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:21.731 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:21.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:21.731 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:21.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.731 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:41 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'19)", 2024-09-14T09:08:21.731 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.154530+0000", 2024-09-14T09:08:21.731 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.577665869, 2024-09-14T09:08:21.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097193060000000005, 2024-09-14T09:08:21.732 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:21.732 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:21.732 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:21.732 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:21.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:21.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154530+0000", 2024-09-14T09:08:21.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:21.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154530+0000", 2024-09-14T09:08:21.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:21.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154531+0000", 2024-09-14T09:08:21.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6199999999999997e-07 2024-09-14T09:08:21.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:21.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154567+0000", 2024-09-14T09:08:21.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5988000000000002e-05 2024-09-14T09:08:21.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:21.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154577+0000", 2024-09-14T09:08:21.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0366999999999999e-05 2024-09-14T09:08:21.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:21.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154583+0000", 2024-09-14T09:08:21.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3929999999999996e-06 2024-09-14T09:08:21.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:21.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154630+0000", 2024-09-14T09:08:21.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6980000000000001e-05 2024-09-14T09:08:21.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:21.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154650+0000", 2024-09-14T09:08:21.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9817999999999999e-05 2024-09-14T09:08:21.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:21.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164200+0000", 2024-09-14T09:08:21.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0095500770000000006 2024-09-14T09:08:21.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:21.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164249+0000", 2024-09-14T09:08:21.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9020999999999997e-05 2024-09-14T09:08:21.737 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.737 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:21.737 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.737 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:42 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'24, mlcod=15'19)", 2024-09-14T09:08:21.737 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:08:21.737 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.577090446, 2024-09-14T09:08:21.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0091673220000000003, 2024-09-14T09:08:21.737 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:21.738 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:21.738 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:21.738 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:21.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:21.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:08:21.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:21.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:08:21.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:21.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:08:21.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5000000000000001e-07 2024-09-14T09:08:21.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:21.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155113+0000", 2024-09-14T09:08:21.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8719999999999996e-06 2024-09-14T09:08:21.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:21.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155126+0000", 2024-09-14T09:08:21.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2951e-05 2024-09-14T09:08:21.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:21.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155132+0000", 2024-09-14T09:08:21.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9270000000000002e-06 2024-09-14T09:08:21.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:21.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158468+0000", 2024-09-14T09:08:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033357980000000001 2024-09-14T09:08:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158510+0000", 2024-09-14T09:08:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2138999999999998e-05 2024-09-14T09:08:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164251+0000", 2024-09-14T09:08:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0057413209999999998 2024-09-14T09:08:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:21.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164273+0000", 2024-09-14T09:08:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1364000000000001e-05 2024-09-14T09:08:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:43 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'25, mlcod=15'19)", 2024-09-14T09:08:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.155476+0000", 2024-09-14T09:08:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.576719758000003, 2024-09-14T09:08:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0092500399999999993, 2024-09-14T09:08:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:21.742 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155476+0000", 2024-09-14T09:08:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155476+0000", 2024-09-14T09:08:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:21.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155477+0000", 2024-09-14T09:08:21.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5300000000000002e-07 2024-09-14T09:08:21.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:21.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155486+0000", 2024-09-14T09:08:21.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2024-09-14T09:08:21.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:21.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155498+0000", 2024-09-14T09:08:21.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2911999999999999e-05 2024-09-14T09:08:21.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:21.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155506+0000", 2024-09-14T09:08:21.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3390000000000004e-06 2024-09-14T09:08:21.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:21.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158814+0000", 2024-09-14T09:08:21.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033078309999999998 2024-09-14T09:08:21.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:21.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158849+0000", 2024-09-14T09:08:21.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5330000000000002e-05 2024-09-14T09:08:21.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:21.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164691+0000", 2024-09-14T09:08:21.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005842346 2024-09-14T09:08:21.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:21.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164726+0000", 2024-09-14T09:08:21.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4978999999999998e-05 2024-09-14T09:08:21.747 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.747 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:21.747 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.748 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:44 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'26, mlcod=15'19)", 2024-09-14T09:08:21.748 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.155917+0000", 2024-09-14T09:08:21.748 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.576279241000002, 2024-09-14T09:08:21.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0088430230000000002, 2024-09-14T09:08:21.748 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:21.748 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:21.748 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:21.748 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:21.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:21.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155917+0000", 2024-09-14T09:08:21.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:21.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155917+0000", 2024-09-14T09:08:21.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:21.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155918+0000", 2024-09-14T09:08:21.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0359999999999999e-06 2024-09-14T09:08:21.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:21.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155951+0000", 2024-09-14T09:08:21.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3256999999999997e-05 2024-09-14T09:08:21.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:21.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155965+0000", 2024-09-14T09:08:21.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3692e-05 2024-09-14T09:08:21.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:21.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155971+0000", 2024-09-14T09:08:21.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0510000000000002e-06 2024-09-14T09:08:21.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:21.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159107+0000", 2024-09-14T09:08:21.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031363430000000002 2024-09-14T09:08:21.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:21.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159127+0000", 2024-09-14T09:08:21.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0268999999999999e-05 2024-09-14T09:08:21.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:21.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164728+0000", 2024-09-14T09:08:21.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056003629999999997 2024-09-14T09:08:21.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:21.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164760+0000", 2024-09-14T09:08:21.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2011999999999998e-05 2024-09-14T09:08:21.752 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.752 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:21.752 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.752 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:45 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'27, mlcod=15'19)", 2024-09-14T09:08:21.752 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.156503+0000", 2024-09-14T09:08:21.752 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.575692553000003, 2024-09-14T09:08:21.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082756970000000003, 2024-09-14T09:08:21.753 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:21.753 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:21.753 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:21.753 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:21.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:21.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156503+0000", 2024-09-14T09:08:21.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:21.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156503+0000", 2024-09-14T09:08:21.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:21.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156505+0000", 2024-09-14T09:08:21.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8139999999999999e-06 2024-09-14T09:08:21.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:21.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156516+0000", 2024-09-14T09:08:21.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1019000000000001e-05 2024-09-14T09:08:21.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:21.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156543+0000", 2024-09-14T09:08:21.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.692e-05 2024-09-14T09:08:21.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:21.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156556+0000", 2024-09-14T09:08:21.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3063e-05 2024-09-14T09:08:21.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:21.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159573+0000", 2024-09-14T09:08:21.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003016712 2024-09-14T09:08:21.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:21.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159589+0000", 2024-09-14T09:08:21.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6494000000000002e-05 2024-09-14T09:08:21.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:21.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164762+0000", 2024-09-14T09:08:21.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051722519999999996 2024-09-14T09:08:21.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:21.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164779+0000", 2024-09-14T09:08:21.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7422999999999999e-05 2024-09-14T09:08:21.758 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.758 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:21.758 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.759 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:46 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'28, mlcod=15'19)", 2024-09-14T09:08:21.759 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.156804+0000", 2024-09-14T09:08:21.759 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.575391463999999, 2024-09-14T09:08:21.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079926879999999995, 2024-09-14T09:08:21.759 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:21.759 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:21.759 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:21.759 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:21.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:21.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156804+0000", 2024-09-14T09:08:21.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:21.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156804+0000", 2024-09-14T09:08:21.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:21.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156805+0000", 2024-09-14T09:08:21.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3099999999999998e-07 2024-09-14T09:08:21.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:21.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156809+0000", 2024-09-14T09:08:21.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8299999999999998e-06 2024-09-14T09:08:21.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:21.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156817+0000", 2024-09-14T09:08:21.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7579999999999992e-06 2024-09-14T09:08:21.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:21.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156831+0000", 2024-09-14T09:08:21.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4256999999999999e-05 2024-09-14T09:08:21.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:21.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159903+0000", 2024-09-14T09:08:21.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030721590000000001 2024-09-14T09:08:21.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:21.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159922+0000", 2024-09-14T09:08:21.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8994000000000001e-05 2024-09-14T09:08:21.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:21.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164780+0000", 2024-09-14T09:08:21.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048582879999999997 2024-09-14T09:08:21.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:21.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164797+0000", 2024-09-14T09:08:21.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6971000000000001e-05 2024-09-14T09:08:21.763 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.763 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:21.763 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.763 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:47 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'29, mlcod=15'19)", 2024-09-14T09:08:21.764 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.157344+0000", 2024-09-14T09:08:21.764 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.574852256, 2024-09-14T09:08:21.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074729030000000004, 2024-09-14T09:08:21.764 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:21.764 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:21.764 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:21.764 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:21.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:21.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157344+0000", 2024-09-14T09:08:21.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:21.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157344+0000", 2024-09-14T09:08:21.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:21.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157346+0000", 2024-09-14T09:08:21.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.81e-06 2024-09-14T09:08:21.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:21.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157406+0000", 2024-09-14T09:08:21.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0523000000000003e-05 2024-09-14T09:08:21.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:21.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157434+0000", 2024-09-14T09:08:21.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8059999999999999e-05 2024-09-14T09:08:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157447+0000", 2024-09-14T09:08:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2666e-05 2024-09-14T09:08:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160183+0000", 2024-09-14T09:08:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002736413 2024-09-14T09:08:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160203+0000", 2024-09-14T09:08:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9545e-05 2024-09-14T09:08:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164798+0000", 2024-09-14T09:08:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045953890000000001 2024-09-14T09:08:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164817+0000", 2024-09-14T09:08:21.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8496999999999999e-05 2024-09-14T09:08:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:48 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'30, mlcod=15'19)", 2024-09-14T09:08:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.157693+0000", 2024-09-14T09:08:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.574502991000003, 2024-09-14T09:08:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0071445789999999999, 2024-09-14T09:08:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:21.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157693+0000", 2024-09-14T09:08:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157693+0000", 2024-09-14T09:08:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157694+0000", 2024-09-14T09:08:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2024-09-14T09:08:21.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157701+0000", 2024-09-14T09:08:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0230000000000004e-06 2024-09-14T09:08:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157709+0000", 2024-09-14T09:08:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7819999999999999e-06 2024-09-14T09:08:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.157714+0000", 2024-09-14T09:08:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2440000000000004e-06 2024-09-14T09:08:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160598+0000", 2024-09-14T09:08:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028844280000000001 2024-09-14T09:08:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160618+0000", 2024-09-14T09:08:21.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0435e-05 2024-09-14T09:08:21.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:21.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164818+0000", 2024-09-14T09:08:21.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042000329999999997 2024-09-14T09:08:21.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164838+0000", 2024-09-14T09:08:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9054000000000001e-05 2024-09-14T09:08:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:49 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'31, mlcod=15'19)", 2024-09-14T09:08:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.158173+0000", 2024-09-14T09:08:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.574023328000003, 2024-09-14T09:08:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0066833700000000001, 2024-09-14T09:08:21.776 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158173+0000", 2024-09-14T09:08:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158173+0000", 2024-09-14T09:08:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158175+0000", 2024-09-14T09:08:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8840000000000001e-06 2024-09-14T09:08:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158188+0000", 2024-09-14T09:08:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3842999999999999e-05 2024-09-14T09:08:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158225+0000", 2024-09-14T09:08:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7039000000000002e-05 2024-09-14T09:08:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158243+0000", 2024-09-14T09:08:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7932999999999999e-05 2024-09-14T09:08:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160875+0000", 2024-09-14T09:08:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002632045 2024-09-14T09:08:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.160887+0000", 2024-09-14T09:08:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2084e-05 2024-09-14T09:08:21.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164839+0000", 2024-09-14T09:08:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039511390000000002 2024-09-14T09:08:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164856+0000", 2024-09-14T09:08:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7402999999999999e-05 2024-09-14T09:08:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.781 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:66 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'44, mlcod=15'40)", 2024-09-14T09:08:21.781 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.430075+0000", 2024-09-14T09:08:21.781 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.302121141999997, 2024-09-14T09:08:21.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070127770000000004, 2024-09-14T09:08:21.781 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:21.782 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:21.782 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:21.782 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:21.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:21.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430075+0000", 2024-09-14T09:08:21.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430075+0000", 2024-09-14T09:08:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430076+0000", 2024-09-14T09:08:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4200000000000005e-07 2024-09-14T09:08:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:21.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430131+0000", 2024-09-14T09:08:21.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099000000000002e-05 2024-09-14T09:08:21.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:21.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430141+0000", 2024-09-14T09:08:21.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.978e-06 2024-09-14T09:08:21.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:21.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430145+0000", 2024-09-14T09:08:21.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4519999999999999e-06 2024-09-14T09:08:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430189+0000", 2024-09-14T09:08:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3924000000000002e-05 2024-09-14T09:08:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.430202+0000", 2024-09-14T09:08:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3319000000000001e-05 2024-09-14T09:08:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:21.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437052+0000", 2024-09-14T09:08:21.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0068491389999999997 2024-09-14T09:08:21.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:21.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.437088+0000", 2024-09-14T09:08:21.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6023999999999999e-05 2024-09-14T09:08:21.787 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.787 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:21.787 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.787 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1024 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T09:08:21.788 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:55.966579+0000", 2024-09-14T09:08:21.788 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.765616575999999, 2024-09-14T09:08:21.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069169419999999997, 2024-09-14T09:08:21.788 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:21.788 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:21.788 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:21.788 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:21.788 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:21.788 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:21.788 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1024 2024-09-14T09:08:21.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.788 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:21.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:21.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966579+0000", 2024-09-14T09:08:21.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:21.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966579+0000", 2024-09-14T09:08:21.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:21.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966580+0000", 2024-09-14T09:08:21.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000002e-07 2024-09-14T09:08:21.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:21.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966582+0000", 2024-09-14T09:08:21.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0040000000000002e-06 2024-09-14T09:08:21.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:21.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966588+0000", 2024-09-14T09:08:21.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6959999999999999e-06 2024-09-14T09:08:21.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:21.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.966592+0000", 2024-09-14T09:08:21.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2370000000000001e-06 2024-09-14T09:08:21.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:21.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.967468+0000", 2024-09-14T09:08:21.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00087601900000000002 2024-09-14T09:08:21.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:21.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.967562+0000", 2024-09-14T09:08:21.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4543000000000006e-05 2024-09-14T09:08:21.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:21.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.967905+0000", 2024-09-14T09:08:21.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00034289100000000001 2024-09-14T09:08:21.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:21.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.968973+0000", 2024-09-14T09:08:21.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010677530000000001 2024-09-14T09:08:21.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:21.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.973420+0000", 2024-09-14T09:08:21.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044470810000000003 2024-09-14T09:08:21.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:21.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.973455+0000", 2024-09-14T09:08:21.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5018000000000003e-05 2024-09-14T09:08:21.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:21.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:55.973496+0000", 2024-09-14T09:08:21.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1303000000000001e-05 2024-09-14T09:08:21.793 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.793 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:21.793 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.794 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1206 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:21.794 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417812+0000", 2024-09-14T09:08:21.794 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.314384052000001, 2024-09-14T09:08:21.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082937259999999995, 2024-09-14T09:08:21.794 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:21.794 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:21.794 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:21.794 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:21.794 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:21.794 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:21.794 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1206 2024-09-14T09:08:21.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.794 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:21.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:21.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417812+0000", 2024-09-14T09:08:21.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:21.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417812+0000", 2024-09-14T09:08:21.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:21.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417812+0000", 2024-09-14T09:08:21.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1e-07 2024-09-14T09:08:21.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:21.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417813+0000", 2024-09-14T09:08:21.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2470000000000001e-06 2024-09-14T09:08:21.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:21.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417817+0000", 2024-09-14T09:08:21.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3720000000000001e-06 2024-09-14T09:08:21.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:21.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417819+0000", 2024-09-14T09:08:21.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3980000000000002e-06 2024-09-14T09:08:21.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:21.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.422429+0000", 2024-09-14T09:08:21.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046098040000000003 2024-09-14T09:08:21.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:21.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.422477+0000", 2024-09-14T09:08:21.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8000999999999997e-05 2024-09-14T09:08:21.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:21.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.422680+0000", 2024-09-14T09:08:21.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000202986 2024-09-14T09:08:21.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:21.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425417+0000", 2024-09-14T09:08:21.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00273742 2024-09-14T09:08:21.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:21.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426055+0000", 2024-09-14T09:08:21.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00063756800000000003 2024-09-14T09:08:21.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:21.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426083+0000", 2024-09-14T09:08:21.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7616000000000001e-05 2024-09-14T09:08:21.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:21.801 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426106+0000", 2024-09-14T09:08:21.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3104000000000001e-05 2024-09-14T09:08:21.801 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.801 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:21.801 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.801 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1207 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:21.801 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417822+0000", 2024-09-14T09:08:21.801 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.314373957000001, 2024-09-14T09:08:21.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.009748909, 2024-09-14T09:08:21.802 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:21.802 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:21.802 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:21.802 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:21.802 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:21.802 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:21.802 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1207 2024-09-14T09:08:21.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.802 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:21.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:21.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417822+0000", 2024-09-14T09:08:21.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:21.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417822+0000", 2024-09-14T09:08:21.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:21.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417822+0000", 2024-09-14T09:08:21.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.36e-07 2024-09-14T09:08:21.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:21.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417824+0000", 2024-09-14T09:08:21.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4410000000000001e-06 2024-09-14T09:08:21.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:21.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417827+0000", 2024-09-14T09:08:21.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8600000000000001e-06 2024-09-14T09:08:21.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:21.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417829+0000", 2024-09-14T09:08:21.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4200000000000001e-06 2024-09-14T09:08:21.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:21.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.423665+0000", 2024-09-14T09:08:21.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058360590000000002 2024-09-14T09:08:21.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:21.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.423755+0000", 2024-09-14T09:08:21.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9999000000000003e-05 2024-09-14T09:08:21.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:21.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424113+0000", 2024-09-14T09:08:21.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00035816599999999999 2024-09-14T09:08:21.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:21.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426112+0000", 2024-09-14T09:08:21.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019984209999999998 2024-09-14T09:08:21.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:21.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427498+0000", 2024-09-14T09:08:21.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013862049999999999 2024-09-14T09:08:21.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:21.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427534+0000", 2024-09-14T09:08:21.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6609999999999997e-05 2024-09-14T09:08:21.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:21.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427571+0000", 2024-09-14T09:08:21.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6492000000000002e-05 2024-09-14T09:08:21.807 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.807 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:21.807 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.807 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1208 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:21.807 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417832+0000", 2024-09-14T09:08:21.807 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.314364180999998, 2024-09-14T09:08:21.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0098905280000000009, 2024-09-14T09:08:21.807 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:21.807 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:21.808 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:21.808 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:21.808 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:21.808 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:21.808 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1208 2024-09-14T09:08:21.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.808 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:21.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:21.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417832+0000", 2024-09-14T09:08:21.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:21.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417832+0000", 2024-09-14T09:08:21.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:21.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417832+0000", 2024-09-14T09:08:21.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2399999999999999e-07 2024-09-14T09:08:21.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:21.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417833+0000", 2024-09-14T09:08:21.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0950000000000001e-06 2024-09-14T09:08:21.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:21.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417842+0000", 2024-09-14T09:08:21.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3959999999999995e-06 2024-09-14T09:08:21.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:21.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417846+0000", 2024-09-14T09:08:21.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4649999999999999e-06 2024-09-14T09:08:21.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:21.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424607+0000", 2024-09-14T09:08:21.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067611750000000003 2024-09-14T09:08:21.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:21.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424690+0000", 2024-09-14T09:08:21.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2890000000000001e-05 2024-09-14T09:08:21.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:21.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425029+0000", 2024-09-14T09:08:21.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033934900000000002 2024-09-14T09:08:21.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:21.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427460+0000", 2024-09-14T09:08:21.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024307619999999999 2024-09-14T09:08:21.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:21.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427624+0000", 2024-09-14T09:08:21.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000163404 2024-09-14T09:08:21.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:21.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427681+0000", 2024-09-14T09:08:21.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7748999999999999e-05 2024-09-14T09:08:21.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:21.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427722+0000", 2024-09-14T09:08:21.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1019000000000001e-05 2024-09-14T09:08:21.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.813 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:21.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.813 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1209 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:21.813 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417851+0000", 2024-09-14T09:08:21.814 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.314344675000001, 2024-09-14T09:08:21.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010012681000000001, 2024-09-14T09:08:21.814 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:21.814 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:21.814 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:21.814 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:21.814 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:21.814 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:21.814 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1209 2024-09-14T09:08:21.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.814 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:21.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:21.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417851+0000", 2024-09-14T09:08:21.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:21.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417851+0000", 2024-09-14T09:08:21.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:21.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417852+0000", 2024-09-14T09:08:21.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.84e-07 2024-09-14T09:08:21.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:21.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417853+0000", 2024-09-14T09:08:21.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6589999999999999e-06 2024-09-14T09:08:21.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:21.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417857+0000", 2024-09-14T09:08:21.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7050000000000001e-06 2024-09-14T09:08:21.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:21.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417860+0000", 2024-09-14T09:08:21.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.242e-06 2024-09-14T09:08:21.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:21.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425469+0000", 2024-09-14T09:08:21.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076089 2024-09-14T09:08:21.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:21.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425553+0000", 2024-09-14T09:08:21.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3657000000000002e-05 2024-09-14T09:08:21.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:21.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425782+0000", 2024-09-14T09:08:21.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000229519 2024-09-14T09:08:21.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:21.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427775+0000", 2024-09-14T09:08:21.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019930289999999999 2024-09-14T09:08:21.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:21.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427794+0000", 2024-09-14T09:08:21.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8238999999999999e-05 2024-09-14T09:08:21.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:21.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427827+0000", 2024-09-14T09:08:21.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3045e-05 2024-09-14T09:08:21.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:21.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427864+0000", 2024-09-14T09:08:21.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7401999999999999e-05 2024-09-14T09:08:21.819 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.819 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:21.819 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.819 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1210 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:21.819 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417864+0000", 2024-09-14T09:08:21.820 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.314331601999999, 2024-09-14T09:08:21.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011675377000000001, 2024-09-14T09:08:21.820 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:21.820 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:21.820 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:21.820 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:21.820 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:21.820 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:21.820 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1210 2024-09-14T09:08:21.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.820 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:21.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:21.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417864+0000", 2024-09-14T09:08:21.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:21.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417864+0000", 2024-09-14T09:08:21.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:21.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417865+0000", 2024-09-14T09:08:21.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.34e-07 2024-09-14T09:08:21.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:21.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417866+0000", 2024-09-14T09:08:21.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.384e-06 2024-09-14T09:08:21.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:21.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417869+0000", 2024-09-14T09:08:21.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.971e-06 2024-09-14T09:08:21.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:21.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417872+0000", 2024-09-14T09:08:21.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5979999999999999e-06 2024-09-14T09:08:21.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:21.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426155+0000", 2024-09-14T09:08:21.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082832389999999995 2024-09-14T09:08:21.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:21.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426236+0000", 2024-09-14T09:08:21.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1241000000000004e-05 2024-09-14T09:08:21.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:21.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426477+0000", 2024-09-14T09:08:21.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024123999999999999 2024-09-14T09:08:21.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:21.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427872+0000", 2024-09-14T09:08:21.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001394714 2024-09-14T09:08:21.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:21.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.429483+0000", 2024-09-14T09:08:21.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001611124 2024-09-14T09:08:21.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:21.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.429515+0000", 2024-09-14T09:08:21.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2243000000000003e-05 2024-09-14T09:08:21.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:21.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.429540+0000", 2024-09-14T09:08:21.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4389e-05 2024-09-14T09:08:21.827 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.827 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:21.827 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.827 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1218 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:21.827 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.425295+0000", 2024-09-14T09:08:21.827 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.306901205999999, 2024-09-14T09:08:21.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0068691480000000003, 2024-09-14T09:08:21.827 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:21.827 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:21.827 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:21.828 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:21.828 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:21.828 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:21.828 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1218 2024-09-14T09:08:21.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.828 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:21.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:21.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425295+0000", 2024-09-14T09:08:21.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:21.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425295+0000", 2024-09-14T09:08:21.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:21.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425296+0000", 2024-09-14T09:08:21.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3489999999999999e-06 2024-09-14T09:08:21.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:21.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425302+0000", 2024-09-14T09:08:21.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4709999999999998e-06 2024-09-14T09:08:21.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:21.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425317+0000", 2024-09-14T09:08:21.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5438999999999999e-05 2024-09-14T09:08:21.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:21.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425325+0000", 2024-09-14T09:08:21.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5229999999999998e-06 2024-09-14T09:08:21.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:21.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426759+0000", 2024-09-14T09:08:21.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001434399 2024-09-14T09:08:21.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:21.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426846+0000", 2024-09-14T09:08:21.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7529999999999997e-05 2024-09-14T09:08:21.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:21.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427211+0000", 2024-09-14T09:08:21.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00036427200000000001 2024-09-14T09:08:21.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:21.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428665+0000", 2024-09-14T09:08:21.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014539659999999999 2024-09-14T09:08:21.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:21.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432108+0000", 2024-09-14T09:08:21.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034428229999999998 2024-09-14T09:08:21.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:21.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432139+0000", 2024-09-14T09:08:21.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1319000000000003e-05 2024-09-14T09:08:21.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:21.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432164+0000", 2024-09-14T09:08:21.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5057000000000001e-05 2024-09-14T09:08:21.834 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.834 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:21.834 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.835 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1219 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:21.835 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.425715+0000", 2024-09-14T09:08:21.835 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.306480877999999, 2024-09-14T09:08:21.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065717709999999997, 2024-09-14T09:08:21.835 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:21.835 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:21.835 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:21.835 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:21.835 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:21.835 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:21.835 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1219 2024-09-14T09:08:21.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.835 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:21.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:21.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425715+0000", 2024-09-14T09:08:21.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:21.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425715+0000", 2024-09-14T09:08:21.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:21.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425716+0000", 2024-09-14T09:08:21.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0599999999999999e-07 2024-09-14T09:08:21.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:21.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425726+0000", 2024-09-14T09:08:21.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0122999999999999e-05 2024-09-14T09:08:21.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:21.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425743+0000", 2024-09-14T09:08:21.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7110000000000001e-05 2024-09-14T09:08:21.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:21.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425749+0000", 2024-09-14T09:08:21.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2099999999999998e-06 2024-09-14T09:08:21.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:21.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427903+0000", 2024-09-14T09:08:21.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021539969999999999 2024-09-14T09:08:21.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:21.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427985+0000", 2024-09-14T09:08:21.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1458999999999994e-05 2024-09-14T09:08:21.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:21.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.428277+0000", 2024-09-14T09:08:21.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029251100000000002 2024-09-14T09:08:21.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:21.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.430127+0000", 2024-09-14T09:08:21.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018491950000000001 2024-09-14T09:08:21.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:21.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432234+0000", 2024-09-14T09:08:21.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002107458 2024-09-14T09:08:21.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:21.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432267+0000", 2024-09-14T09:08:21.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3291999999999999e-05 2024-09-14T09:08:21.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:21.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.432287+0000", 2024-09-14T09:08:21.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9510000000000001e-05 2024-09-14T09:08:21.840 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.840 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:21.840 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.841 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4782.0:193 3.17 3:e98abfa9:::rbd_data.11127a12d636.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write 3887104~20480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-14T09:08:21.841 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:09.305741+0000", 2024-09-14T09:08:21.841 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.426454721000001, 2024-09-14T09:08:21.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0081452360000000001, 2024-09-14T09:08:21.841 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:21.841 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:21.841 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:21.841 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:21.841 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4782", 2024-09-14T09:08:21.841 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/353415140", 2024-09-14T09:08:21.841 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 193 2024-09-14T09:08:21.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.842 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:21.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:21.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.305741+0000", 2024-09-14T09:08:21.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:21.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.305741+0000", 2024-09-14T09:08:21.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:21.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.305742+0000", 2024-09-14T09:08:21.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5700000000000002e-07 2024-09-14T09:08:21.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:21.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.307981+0000", 2024-09-14T09:08:21.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022389200000000001 2024-09-14T09:08:21.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:21.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.307992+0000", 2024-09-14T09:08:21.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1681999999999999e-05 2024-09-14T09:08:21.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:21.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.307998+0000", 2024-09-14T09:08:21.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6520000000000003e-06 2024-09-14T09:08:21.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:21.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.308039+0000", 2024-09-14T09:08:21.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0611999999999997e-05 2024-09-14T09:08:21.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:21.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.308130+0000", 2024-09-14T09:08:21.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0896999999999994e-05 2024-09-14T09:08:21.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:21.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.308394+0000", 2024-09-14T09:08:21.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00026417600000000003 2024-09-14T09:08:21.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:21.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.312043+0000", 2024-09-14T09:08:21.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00364921 2024-09-14T09:08:21.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:21.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.313829+0000", 2024-09-14T09:08:21.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001785738 2024-09-14T09:08:21.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:21.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.313862+0000", 2024-09-14T09:08:21.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3096000000000003e-05 2024-09-14T09:08:21.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:21.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.313886+0000", 2024-09-14T09:08:21.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4695999999999999e-05 2024-09-14T09:08:21.847 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.847 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:21.847 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.847 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:1813 3.0 3:06c97bdf:::rbd_data.111232b23a18.00000000000000ef:head [set-alloc-hint object_size 524288 write_size 524288,write 217088~6144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:21.847 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.141739+0000", 2024-09-14T09:08:21.847 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.59045697, 2024-09-14T09:08:21.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067936769999999997, 2024-09-14T09:08:21.848 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:21.848 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:21.848 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:21.848 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:21.848 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:21.848 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:21.848 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1813 2024-09-14T09:08:21.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.848 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:21.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:21.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.141739+0000", 2024-09-14T09:08:21.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:21.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.141739+0000", 2024-09-14T09:08:21.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:21.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:21.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.141740+0000", 2024-09-14T09:08:21.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2799999999999995e-07 2024-09-14T09:08:21.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:21.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.141748+0000", 2024-09-14T09:08:21.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8569999999999995e-06 2024-09-14T09:08:21.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:21.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.141759+0000", 2024-09-14T09:08:21.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1014e-05 2024-09-14T09:08:21.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:21.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.141766+0000", 2024-09-14T09:08:21.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8789999999999997e-06 2024-09-14T09:08:21.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:21.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.141882+0000", 2024-09-14T09:08:21.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116832 2024-09-14T09:08:21.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:21.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.142016+0000", 2024-09-14T09:08:21.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000133456 2024-09-14T09:08:21.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:21.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.142156+0000", 2024-09-14T09:08:21.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014061100000000001 2024-09-14T09:08:21.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:21.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.143212+0000", 2024-09-14T09:08:21.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010552039999999999 2024-09-14T09:08:21.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:21.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.148423+0000", 2024-09-14T09:08:21.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052108409999999999 2024-09-14T09:08:21.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:21.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.148481+0000", 2024-09-14T09:08:21.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699000000000002e-05 2024-09-14T09:08:21.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:21.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:21.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:21.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.148533+0000", 2024-09-14T09:08:21.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1456000000000003e-05 2024-09-14T09:08:21.853 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.853 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:21.853 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.853 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:21.853 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:21.853 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:21.854 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:21.856+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:21.855 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:08:21.891 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T09:08:21.955 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:21.957+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:21.969 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:21.969 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:21.969 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:08:21.969 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:21.979 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:08:22.055 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:22.057+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:22.100 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:22.100 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:22.100 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:22.100 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:22.101 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:22.110 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:08:22.175 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #16, image image_client.0-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent17 2024-09-14T09:08:22.195 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:22.197+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:22.257 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:22.259+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:22.276 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:22.276 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:22.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:22.276 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:22.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.276 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7729 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 110592~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:22.276 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030100+0000", 2024-09-14T09:08:22.276 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.2470686799999999, 2024-09-14T09:08:22.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.063698092999999997, 2024-09-14T09:08:22.276 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.276 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.277 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.277 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.277 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:22.277 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:22.277 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7729 2024-09-14T09:08:22.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.277 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030100+0000", 2024-09-14T09:08:22.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030100+0000", 2024-09-14T09:08:22.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030100+0000", 2024-09-14T09:08:22.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:08:22.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030102+0000", 2024-09-14T09:08:22.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7680000000000001e-06 2024-09-14T09:08:22.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030108+0000", 2024-09-14T09:08:22.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3779999999999998e-06 2024-09-14T09:08:22.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030113+0000", 2024-09-14T09:08:22.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1220000000000003e-06 2024-09-14T09:08:22.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.093499+0000", 2024-09-14T09:08:22.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.063385996 2024-09-14T09:08:22.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.093586+0000", 2024-09-14T09:08:22.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6998999999999998e-05 2024-09-14T09:08:22.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.093798+0000", 2024-09-14T09:08:22.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021145499999999999 2024-09-14T09:08:22.280 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.280 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.280 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.280 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7730 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 120832~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:22.280 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030120+0000", 2024-09-14T09:08:22.280 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.2470486859999999, 2024-09-14T09:08:22.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064066104999999998, 2024-09-14T09:08:22.281 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.281 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.281 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.281 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.281 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:22.281 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:22.281 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7730 2024-09-14T09:08:22.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.281 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030120+0000", 2024-09-14T09:08:22.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030120+0000", 2024-09-14T09:08:22.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030120+0000", 2024-09-14T09:08:22.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9200000000000002e-07 2024-09-14T09:08:22.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030122+0000", 2024-09-14T09:08:22.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.798e-06 2024-09-14T09:08:22.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030130+0000", 2024-09-14T09:08:22.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7510000000000008e-06 2024-09-14T09:08:22.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030135+0000", 2024-09-14T09:08:22.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1769999999999997e-06 2024-09-14T09:08:22.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.093839+0000", 2024-09-14T09:08:22.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.063704574 2024-09-14T09:08:22.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.093932+0000", 2024-09-14T09:08:22.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2119000000000004e-05 2024-09-14T09:08:22.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094186+0000", 2024-09-14T09:08:22.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025429400000000002 2024-09-14T09:08:22.284 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.284 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.284 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.285 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7731 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 147456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:22.285 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030142+0000", 2024-09-14T09:08:22.285 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.2470268390000001, 2024-09-14T09:08:22.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064431020000000006, 2024-09-14T09:08:22.285 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.285 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.285 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.285 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.285 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:22.285 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:22.285 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7731 2024-09-14T09:08:22.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.285 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030142+0000", 2024-09-14T09:08:22.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030142+0000", 2024-09-14T09:08:22.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030142+0000", 2024-09-14T09:08:22.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2300000000000002e-07 2024-09-14T09:08:22.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030144+0000", 2024-09-14T09:08:22.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9e-06 2024-09-14T09:08:22.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030151+0000", 2024-09-14T09:08:22.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6000000000000003e-06 2024-09-14T09:08:22.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030156+0000", 2024-09-14T09:08:22.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9960000000000001e-06 2024-09-14T09:08:22.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094250+0000", 2024-09-14T09:08:22.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064094715999999996 2024-09-14T09:08:22.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094329+0000", 2024-09-14T09:08:22.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8812000000000004e-05 2024-09-14T09:08:22.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094573+0000", 2024-09-14T09:08:22.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024357299999999999 2024-09-14T09:08:22.288 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.288 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.289 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.289 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7732 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 157696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:22.289 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030162+0000", 2024-09-14T09:08:22.289 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.2470065890000002, 2024-09-14T09:08:22.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064786951999999995, 2024-09-14T09:08:22.289 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.289 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.289 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.289 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.289 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:22.289 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:22.289 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7732 2024-09-14T09:08:22.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.290 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030162+0000", 2024-09-14T09:08:22.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030162+0000", 2024-09-14T09:08:22.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030162+0000", 2024-09-14T09:08:22.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.03e-07 2024-09-14T09:08:22.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030164+0000", 2024-09-14T09:08:22.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7e-06 2024-09-14T09:08:22.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030170+0000", 2024-09-14T09:08:22.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1369999999999999e-06 2024-09-14T09:08:22.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030182+0000", 2024-09-14T09:08:22.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1989e-05 2024-09-14T09:08:22.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094614+0000", 2024-09-14T09:08:22.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064431863000000006 2024-09-14T09:08:22.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094703+0000", 2024-09-14T09:08:22.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9021e-05 2024-09-14T09:08:22.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094949+0000", 2024-09-14T09:08:22.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024583899999999998 2024-09-14T09:08:22.293 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.293 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.293 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.293 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7733 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 167936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:22.293 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030194+0000", 2024-09-14T09:08:22.293 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.2469743119999999, 2024-09-14T09:08:22.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065137113999999996, 2024-09-14T09:08:22.293 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.293 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.293 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.294 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.294 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:22.294 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:22.294 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7733 2024-09-14T09:08:22.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.294 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030194+0000", 2024-09-14T09:08:22.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030194+0000", 2024-09-14T09:08:22.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030195+0000", 2024-09-14T09:08:22.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:08:22.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030207+0000", 2024-09-14T09:08:22.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2452999999999999e-05 2024-09-14T09:08:22.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030218+0000", 2024-09-14T09:08:22.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1035e-05 2024-09-14T09:08:22.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030224+0000", 2024-09-14T09:08:22.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7100000000000004e-06 2024-09-14T09:08:22.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094993+0000", 2024-09-14T09:08:22.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064769312999999995 2024-09-14T09:08:22.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.095089+0000", 2024-09-14T09:08:22.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5768999999999997e-05 2024-09-14T09:08:22.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.095331+0000", 2024-09-14T09:08:22.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000242372 2024-09-14T09:08:22.297 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.297 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.297 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.297 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7734 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:22.298 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030232+0000", 2024-09-14T09:08:22.298 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.2469359999999998, 2024-09-14T09:08:22.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065430487999999995, 2024-09-14T09:08:22.298 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.298 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.298 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.298 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.298 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:22.298 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:22.298 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7734 2024-09-14T09:08:22.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.298 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030232+0000", 2024-09-14T09:08:22.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030232+0000", 2024-09-14T09:08:22.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030233+0000", 2024-09-14T09:08:22.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0200000000000002e-07 2024-09-14T09:08:22.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030235+0000", 2024-09-14T09:08:22.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0669999999999999e-06 2024-09-14T09:08:22.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030242+0000", 2024-09-14T09:08:22.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6229999999999999e-06 2024-09-14T09:08:22.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030247+0000", 2024-09-14T09:08:22.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0969999999999996e-06 2024-09-14T09:08:22.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.095374+0000", 2024-09-14T09:08:22.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065127510999999999 2024-09-14T09:08:22.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.095464+0000", 2024-09-14T09:08:22.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0214000000000001e-05 2024-09-14T09:08:22.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.095663+0000", 2024-09-14T09:08:22.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000198474 2024-09-14T09:08:22.301 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.301 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.301 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.302 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7735 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 204800~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:22.302 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030253+0000", 2024-09-14T09:08:22.302 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.2469151589999998, 2024-09-14T09:08:22.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065785715999999994, 2024-09-14T09:08:22.302 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.302 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.302 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.302 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.302 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:22.302 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:22.302 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7735 2024-09-14T09:08:22.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.302 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030253+0000", 2024-09-14T09:08:22.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030253+0000", 2024-09-14T09:08:22.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030637+0000", 2024-09-14T09:08:22.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038390100000000002 2024-09-14T09:08:22.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030641+0000", 2024-09-14T09:08:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5300000000000001e-06 2024-09-14T09:08:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030657+0000", 2024-09-14T09:08:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6390000000000001e-05 2024-09-14T09:08:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030665+0000", 2024-09-14T09:08:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5129999999999999e-06 2024-09-14T09:08:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.095704+0000", 2024-09-14T09:08:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065039447 2024-09-14T09:08:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.095791+0000", 2024-09-14T09:08:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6835000000000005e-05 2024-09-14T09:08:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096039+0000", 2024-09-14T09:08:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024810000000000001 2024-09-14T09:08:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7736 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030685+0000", 2024-09-14T09:08:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.2464839319999999, 2024-09-14T09:08:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065670936999999999, 2024-09-14T09:08:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7736 2024-09-14T09:08:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030685+0000", 2024-09-14T09:08:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030685+0000", 2024-09-14T09:08:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030685+0000", 2024-09-14T09:08:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4799999999999998e-07 2024-09-14T09:08:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030688+0000", 2024-09-14T09:08:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6400000000000001e-06 2024-09-14T09:08:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030695+0000", 2024-09-14T09:08:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6350000000000006e-06 2024-09-14T09:08:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030736+0000", 2024-09-14T09:08:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0932e-05 2024-09-14T09:08:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096080+0000", 2024-09-14T09:08:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065344019000000003 2024-09-14T09:08:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096169+0000", 2024-09-14T09:08:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9031999999999997e-05 2024-09-14T09:08:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096355+0000", 2024-09-14T09:08:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186131 2024-09-14T09:08:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7737 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 225280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030748+0000", 2024-09-14T09:08:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.2464207950000001, 2024-09-14T09:08:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065915538999999995, 2024-09-14T09:08:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7737 2024-09-14T09:08:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030748+0000", 2024-09-14T09:08:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030748+0000", 2024-09-14T09:08:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030748+0000", 2024-09-14T09:08:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9100000000000004e-07 2024-09-14T09:08:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030751+0000", 2024-09-14T09:08:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.661e-06 2024-09-14T09:08:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030759+0000", 2024-09-14T09:08:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9270000000000005e-06 2024-09-14T09:08:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030765+0000", 2024-09-14T09:08:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.75e-06 2024-09-14T09:08:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096389+0000", 2024-09-14T09:08:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065624403999999997 2024-09-14T09:08:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096476+0000", 2024-09-14T09:08:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6625999999999994e-05 2024-09-14T09:08:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096663+0000", 2024-09-14T09:08:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018757999999999999 2024-09-14T09:08:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7738 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 235520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030772+0000", 2024-09-14T09:08:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.2463964280000002, 2024-09-14T09:08:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.066203479999999995, 2024-09-14T09:08:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7738 2024-09-14T09:08:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030772+0000", 2024-09-14T09:08:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030772+0000", 2024-09-14T09:08:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030772+0000", 2024-09-14T09:08:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3000000000000001e-07 2024-09-14T09:08:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030775+0000", 2024-09-14T09:08:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0930000000000001e-06 2024-09-14T09:08:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030782+0000", 2024-09-14T09:08:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9600000000000003e-06 2024-09-14T09:08:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030787+0000", 2024-09-14T09:08:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4670000000000003e-06 2024-09-14T09:08:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096696+0000", 2024-09-14T09:08:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065909258999999998 2024-09-14T09:08:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096785+0000", 2024-09-14T09:08:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8931000000000006e-05 2024-09-14T09:08:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096976+0000", 2024-09-14T09:08:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019034 2024-09-14T09:08:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7913 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 139264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041493+0000", 2024-09-14T09:08:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.2356757859999998, 2024-09-14T09:08:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.063885727000000003, 2024-09-14T09:08:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7913 2024-09-14T09:08:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041493+0000", 2024-09-14T09:08:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041493+0000", 2024-09-14T09:08:22.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041493+0000", 2024-09-14T09:08:22.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9299999999999999e-07 2024-09-14T09:08:22.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041494+0000", 2024-09-14T09:08:22.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0279999999999999e-06 2024-09-14T09:08:22.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041497+0000", 2024-09-14T09:08:22.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.039e-06 2024-09-14T09:08:22.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041500+0000", 2024-09-14T09:08:22.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8059999999999999e-06 2024-09-14T09:08:22.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105044+0000", 2024-09-14T09:08:22.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.063544426000000001 2024-09-14T09:08:22.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105126+0000", 2024-09-14T09:08:22.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1565999999999998e-05 2024-09-14T09:08:22.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105378+0000", 2024-09-14T09:08:22.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025256900000000001 2024-09-14T09:08:22.327 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.327 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.327 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.327 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7914 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 149504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:22.327 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041505+0000", 2024-09-14T09:08:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.2356638740000001, 2024-09-14T09:08:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064171309999999995, 2024-09-14T09:08:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.329 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:22.329 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:22.329 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7914 2024-09-14T09:08:22.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.329 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041505+0000", 2024-09-14T09:08:22.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041505+0000", 2024-09-14T09:08:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041505+0000", 2024-09-14T09:08:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8500000000000002e-07 2024-09-14T09:08:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041507+0000", 2024-09-14T09:08:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.654e-06 2024-09-14T09:08:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041512+0000", 2024-09-14T09:08:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4709999999999998e-06 2024-09-14T09:08:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041516+0000", 2024-09-14T09:08:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1339999999999997e-06 2024-09-14T09:08:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105410+0000", 2024-09-14T09:08:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.063894216000000004 2024-09-14T09:08:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105489+0000", 2024-09-14T09:08:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9152000000000004e-05 2024-09-14T09:08:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105676+0000", 2024-09-14T09:08:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186398 2024-09-14T09:08:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7915 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041522+0000", 2024-09-14T09:08:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.2356465210000001, 2024-09-14T09:08:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064491719000000003, 2024-09-14T09:08:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7915 2024-09-14T09:08:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041522+0000", 2024-09-14T09:08:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041522+0000", 2024-09-14T09:08:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041522+0000", 2024-09-14T09:08:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1600000000000002e-07 2024-09-14T09:08:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041524+0000", 2024-09-14T09:08:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.812e-06 2024-09-14T09:08:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041530+0000", 2024-09-14T09:08:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8579999999999996e-06 2024-09-14T09:08:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041534+0000", 2024-09-14T09:08:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5430000000000004e-06 2024-09-14T09:08:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105723+0000", 2024-09-14T09:08:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064188532000000006 2024-09-14T09:08:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105809+0000", 2024-09-14T09:08:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6098000000000001e-05 2024-09-14T09:08:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.106014+0000", 2024-09-14T09:08:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020456000000000001 2024-09-14T09:08:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7916 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 169984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041540+0000", 2024-09-14T09:08:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.2356280719999999, 2024-09-14T09:08:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064847347999999999, 2024-09-14T09:08:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7916 2024-09-14T09:08:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041540+0000", 2024-09-14T09:08:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041540+0000", 2024-09-14T09:08:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041541+0000", 2024-09-14T09:08:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.58e-07 2024-09-14T09:08:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041543+0000", 2024-09-14T09:08:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.902e-06 2024-09-14T09:08:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041549+0000", 2024-09-14T09:08:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6889999999999998e-06 2024-09-14T09:08:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041554+0000", 2024-09-14T09:08:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5709999999999999e-06 2024-09-14T09:08:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.106058+0000", 2024-09-14T09:08:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064504051000000007 2024-09-14T09:08:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.106141+0000", 2024-09-14T09:08:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3294000000000006e-05 2024-09-14T09:08:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.106388+0000", 2024-09-14T09:08:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024648299999999998 2024-09-14T09:08:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7917 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 196608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041560+0000", 2024-09-14T09:08:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.2356089269999999, 2024-09-14T09:08:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065539221999999994, 2024-09-14T09:08:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7917 2024-09-14T09:08:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041560+0000", 2024-09-14T09:08:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041560+0000", 2024-09-14T09:08:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041560+0000", 2024-09-14T09:08:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2399999999999999e-07 2024-09-14T09:08:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041562+0000", 2024-09-14T09:08:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8309999999999999e-06 2024-09-14T09:08:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041567+0000", 2024-09-14T09:08:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7699999999999998e-06 2024-09-14T09:08:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041572+0000", 2024-09-14T09:08:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4870000000000004e-06 2024-09-14T09:08:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.106431+0000", 2024-09-14T09:08:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064858964000000005 2024-09-14T09:08:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.106513+0000", 2024-09-14T09:08:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1848000000000006e-05 2024-09-14T09:08:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107099+0000", 2024-09-14T09:08:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058599800000000001 2024-09-14T09:08:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7918 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 206848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041577+0000", 2024-09-14T09:08:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.235591281, 2024-09-14T09:08:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065838946999999995, 2024-09-14T09:08:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7918 2024-09-14T09:08:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041577+0000", 2024-09-14T09:08:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041577+0000", 2024-09-14T09:08:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041578+0000", 2024-09-14T09:08:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-07 2024-09-14T09:08:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041579+0000", 2024-09-14T09:08:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7230000000000001e-06 2024-09-14T09:08:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041585+0000", 2024-09-14T09:08:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.767e-06 2024-09-14T09:08:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041589+0000", 2024-09-14T09:08:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.25e-06 2024-09-14T09:08:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107152+0000", 2024-09-14T09:08:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065563064000000004 2024-09-14T09:08:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107232+0000", 2024-09-14T09:08:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0019999999999996e-05 2024-09-14T09:08:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107416+0000", 2024-09-14T09:08:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018376800000000001 2024-09-14T09:08:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7919 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041595+0000", 2024-09-14T09:08:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.2355738920000001, 2024-09-14T09:08:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.066135688999999998, 2024-09-14T09:08:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7919 2024-09-14T09:08:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041595+0000", 2024-09-14T09:08:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041595+0000", 2024-09-14T09:08:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041595+0000", 2024-09-14T09:08:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7799999999999997e-07 2024-09-14T09:08:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041597+0000", 2024-09-14T09:08:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.832e-06 2024-09-14T09:08:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041602+0000", 2024-09-14T09:08:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2480000000000004e-06 2024-09-14T09:08:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041606+0000", 2024-09-14T09:08:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1330000000000001e-06 2024-09-14T09:08:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107455+0000", 2024-09-14T09:08:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065849380999999998 2024-09-14T09:08:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107541+0000", 2024-09-14T09:08:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5648000000000004e-05 2024-09-14T09:08:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107730+0000", 2024-09-14T09:08:22.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018916899999999999 2024-09-14T09:08:22.357 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.357 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.357 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.357 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7920 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:22.357 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041612+0000", 2024-09-14T09:08:22.357 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.2355565259999999, 2024-09-14T09:08:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.066948489999999999, 2024-09-14T09:08:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7920 2024-09-14T09:08:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041612+0000", 2024-09-14T09:08:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041612+0000", 2024-09-14T09:08:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041612+0000", 2024-09-14T09:08:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6100000000000002e-07 2024-09-14T09:08:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041614+0000", 2024-09-14T09:08:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0470000000000001e-06 2024-09-14T09:08:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041620+0000", 2024-09-14T09:08:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8359999999999997e-06 2024-09-14T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041634+0000", 2024-09-14T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3767e-05 2024-09-14T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107761+0000", 2024-09-14T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.066126943999999993 2024-09-14T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107840+0000", 2024-09-14T09:08:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9042999999999995e-05 2024-09-14T09:08:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.108560+0000", 2024-09-14T09:08:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00072049199999999999 2024-09-14T09:08:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7921 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 253952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041641+0000", 2024-09-14T09:08:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.2355270059999999, 2024-09-14T09:08:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.067314309000000003, 2024-09-14T09:08:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7921 2024-09-14T09:08:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041641+0000", 2024-09-14T09:08:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041641+0000", 2024-09-14T09:08:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041642+0000", 2024-09-14T09:08:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8299999999999998e-07 2024-09-14T09:08:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041644+0000", 2024-09-14T09:08:22.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1059999999999998e-06 2024-09-14T09:08:22.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041652+0000", 2024-09-14T09:08:22.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6229999999999997e-06 2024-09-14T09:08:22.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041656+0000", 2024-09-14T09:08:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8319999999999996e-06 2024-09-14T09:08:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.108597+0000", 2024-09-14T09:08:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.066941055999999999 2024-09-14T09:08:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.108682+0000", 2024-09-14T09:08:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4305e-05 2024-09-14T09:08:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.108956+0000", 2024-09-14T09:08:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000274004 2024-09-14T09:08:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:8013 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.042062+0000", 2024-09-14T09:08:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.235106327, 2024-09-14T09:08:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.067149147000000006, 2024-09-14T09:08:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 8013 2024-09-14T09:08:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.042062+0000", 2024-09-14T09:08:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.042062+0000", 2024-09-14T09:08:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.048211+0000", 2024-09-14T09:08:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061491269999999999 2024-09-14T09:08:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.048217+0000", 2024-09-14T09:08:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3600000000000004e-06 2024-09-14T09:08:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.048226+0000", 2024-09-14T09:08:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6670000000000008e-06 2024-09-14T09:08:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.048234+0000", 2024-09-14T09:08:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4749999999999996e-06 2024-09-14T09:08:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.109018+0000", 2024-09-14T09:08:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.060784670999999998 2024-09-14T09:08:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.109108+0000", 2024-09-14T09:08:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9222999999999996e-05 2024-09-14T09:08:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.109211+0000", 2024-09-14T09:08:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000103624 2024-09-14T09:08:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.371 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:22.373 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:08:22.373 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:22.374+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:22.474 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:22.476+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:22.558 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4826.0:7333 3.d 3.a444f46d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-14T09:08:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:22.560266+0000", 2024-09-14T09:08:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.9802000000000001e-05, 2024-09-14T09:08:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8691999999999998e-05, 2024-09-14T09:08:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:08:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4826", 2024-09-14T09:08:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2422417443", 2024-09-14T09:08:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7333 2024-09-14T09:08:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:22.560266+0000", 2024-09-14T09:08:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:22.560266+0000", 2024-09-14T09:08:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:22.560267+0000", 2024-09-14T09:08:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.54e-07 2024-09-14T09:08:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:22.560270+0000", 2024-09-14T09:08:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.749e-06 2024-09-14T09:08:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:22.560283+0000", 2024-09-14T09:08:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2238e-05 2024-09-14T09:08:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:22.560289+0000", 2024-09-14T09:08:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7739999999999999e-06 2024-09-14T09:08:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:22.560335+0000", 2024-09-14T09:08:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5945000000000001e-05 2024-09-14T09:08:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4826.0:7340 3.d 3.a444f46d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-14T09:08:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:22.560373+0000", 2024-09-14T09:08:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9999528, 2024-09-14T09:08:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1921e-05, 2024-09-14T09:08:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4826", 2024-09-14T09:08:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2422417443", 2024-09-14T09:08:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7340 2024-09-14T09:08:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:22.560373+0000", 2024-09-14T09:08:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:22.560373+0000", 2024-09-14T09:08:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:22.560374+0000", 2024-09-14T09:08:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6600000000000005e-07 2024-09-14T09:08:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:22.560378+0000", 2024-09-14T09:08:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5029999999999999e-06 2024-09-14T09:08:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:22.560390+0000", 2024-09-14T09:08:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1535000000000001e-05 2024-09-14T09:08:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:22.560397+0000", 2024-09-14T09:08:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3259999999999998e-06 2024-09-14T09:08:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:08:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 2 2024-09-14T09:08:22.566 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:22.569 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:08:22.610 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:22.612+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:22.675 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:22.677+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:22.755 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:22.755 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:22.755 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:22.755 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:22.755 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:22.767 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:08:22.810 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:22.811+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:22.878 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:22.879+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:22.891 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is set 2024-09-14T09:08:22.918 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:22.918 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:22.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:22.918 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:22.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.918 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:08:22.918 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:22.918 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 52.686178648000002, 2024-09-14T09:08:22.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72111598600000004, 2024-09-14T09:08:22.919 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.919 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.919 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:22.919 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.919 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:08:22.919 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:08:22.919 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1 2024-09-14T09:08:22.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.919 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.919 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.919 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:22.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.920 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:22.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.920 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233065+0000", 2024-09-14T09:08:22.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1909999999999999e-06 2024-09-14T09:08:22.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.920 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233071+0000", 2024-09-14T09:08:22.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5300000000000002e-06 2024-09-14T09:08:22.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.921 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.921 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233081+0000", 2024-09-14T09:08:22.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0339e-05 2024-09-14T09:08:22.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.921 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233093+0000", 2024-09-14T09:08:22.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1252e-05 2024-09-14T09:08:22.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233162+0000", 2024-09-14T09:08:22.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9678999999999995e-05 2024-09-14T09:08:22.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:08:22.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233171+0000", 2024-09-14T09:08:22.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.132e-06 2024-09-14T09:08:22.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952480+0000", 2024-09-14T09:08:22.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.71930839899999999 2024-09-14T09:08:22.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952655+0000", 2024-09-14T09:08:22.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017552 2024-09-14T09:08:22.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:22.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952835+0000", 2024-09-14T09:08:22.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001797 2024-09-14T09:08:22.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:22.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.953648+0000", 2024-09-14T09:08:22.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00081291700000000002 2024-09-14T09:08:22.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:22.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954108+0000", 2024-09-14T09:08:22.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045992800000000002 2024-09-14T09:08:22.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:22.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954149+0000", 2024-09-14T09:08:22.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1214999999999998e-05 2024-09-14T09:08:22.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.926 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.926 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954178+0000", 2024-09-14T09:08:22.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9184e-05 2024-09-14T09:08:22.926 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.926 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.926 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.926 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1493 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1196032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:22.926 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:22.926 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.010479457999999, 2024-09-14T09:08:22.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012302112, 2024-09-14T09:08:22.926 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.927 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.927 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.927 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.927 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:22.927 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:22.927 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1493 2024-09-14T09:08:22.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.928 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:22.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:22.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:22.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.65e-07 2024-09-14T09:08:22.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908764+0000", 2024-09-14T09:08:22.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8589999999999999e-06 2024-09-14T09:08:22.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908770+0000", 2024-09-14T09:08:22.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.728e-06 2024-09-14T09:08:22.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.931 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.931 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908774+0000", 2024-09-14T09:08:22.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7609999999999998e-06 2024-09-14T09:08:22.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.931 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.931 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.920899+0000", 2024-09-14T09:08:22.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012125004999999999 2024-09-14T09:08:22.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.931 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.920977+0000", 2024-09-14T09:08:22.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7564000000000005e-05 2024-09-14T09:08:22.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.921064+0000", 2024-09-14T09:08:22.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6829999999999994e-05 2024-09-14T09:08:22.932 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.932 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.932 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.933 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1510 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 983040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:22.933 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:22.933 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.009495267999998, 2024-09-14T09:08:22.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012360968999999999, 2024-09-14T09:08:22.933 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.933 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.933 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.933 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.933 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:22.934 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:22.934 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1510 2024-09-14T09:08:22.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.934 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:22.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:22.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:22.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8799999999999998e-07 2024-09-14T09:08:22.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909748+0000", 2024-09-14T09:08:22.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9810000000000002e-06 2024-09-14T09:08:22.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909754+0000", 2024-09-14T09:08:22.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3609999999999997e-06 2024-09-14T09:08:22.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909760+0000", 2024-09-14T09:08:22.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1850000000000003e-06 2024-09-14T09:08:22.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.921974+0000", 2024-09-14T09:08:22.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012214426 2024-09-14T09:08:22.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922015+0000", 2024-09-14T09:08:22.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0407000000000001e-05 2024-09-14T09:08:22.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922107+0000", 2024-09-14T09:08:22.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2220999999999997e-05 2024-09-14T09:08:22.938 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.938 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.938 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.938 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1511 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1212416~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:22.938 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.909766+0000", 2024-09-14T09:08:22.939 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.009474861000001, 2024-09-14T09:08:22.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012473141, 2024-09-14T09:08:22.939 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.939 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.939 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.939 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.939 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:22.939 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:22.939 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1511 2024-09-14T09:08:22.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.939 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909766+0000", 2024-09-14T09:08:22.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909766+0000", 2024-09-14T09:08:22.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909767+0000", 2024-09-14T09:08:22.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-07 2024-09-14T09:08:22.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909768+0000", 2024-09-14T09:08:22.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8050000000000001e-06 2024-09-14T09:08:22.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909775+0000", 2024-09-14T09:08:22.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8210000000000004e-06 2024-09-14T09:08:22.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909780+0000", 2024-09-14T09:08:22.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3120000000000001e-06 2024-09-14T09:08:22.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922138+0000", 2024-09-14T09:08:22.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012358012 2024-09-14T09:08:22.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922181+0000", 2024-09-14T09:08:22.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2876000000000001e-05 2024-09-14T09:08:22.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922239+0000", 2024-09-14T09:08:22.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7960000000000001e-05 2024-09-14T09:08:22.943 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.943 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.943 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.943 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1517 3.d 3:b36f6c76:::rbd_data.1112f61fa773.0000000000000002:8 [read 966656~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:22.943 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910035+0000", 2024-09-14T09:08:22.943 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.009206343999999, 2024-09-14T09:08:22.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012318664999999999, 2024-09-14T09:08:22.943 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.944 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.944 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.944 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.944 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:22.944 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:22.944 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1517 2024-09-14T09:08:22.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.944 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910035+0000", 2024-09-14T09:08:22.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910035+0000", 2024-09-14T09:08:22.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910036+0000", 2024-09-14T09:08:22.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7000000000000003e-07 2024-09-14T09:08:22.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910040+0000", 2024-09-14T09:08:22.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3220000000000003e-06 2024-09-14T09:08:22.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910051+0000", 2024-09-14T09:08:22.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1476e-05 2024-09-14T09:08:22.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910059+0000", 2024-09-14T09:08:22.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:08:22.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922268+0000", 2024-09-14T09:08:22.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012208910999999999 2024-09-14T09:08:22.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922305+0000", 2024-09-14T09:08:22.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7069e-05 2024-09-14T09:08:22.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922353+0000", 2024-09-14T09:08:22.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7976999999999998e-05 2024-09-14T09:08:22.948 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.948 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.948 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.948 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1518 3.d 3:b36f6c76:::rbd_data.1112f61fa773.0000000000000002:8 [read 1196032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:22.948 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910078+0000", 2024-09-14T09:08:22.949 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.009162655000001, 2024-09-14T09:08:22.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012415053000000001, 2024-09-14T09:08:22.949 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.949 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.949 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.949 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.949 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:22.949 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:22.949 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1518 2024-09-14T09:08:22.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.950 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910078+0000", 2024-09-14T09:08:22.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910078+0000", 2024-09-14T09:08:22.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910079+0000", 2024-09-14T09:08:22.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0999999999999998e-07 2024-09-14T09:08:22.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910082+0000", 2024-09-14T09:08:22.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7779999999999999e-06 2024-09-14T09:08:22.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910089+0000", 2024-09-14T09:08:22.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4599999999999997e-06 2024-09-14T09:08:22.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910095+0000", 2024-09-14T09:08:22.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.66e-06 2024-09-14T09:08:22.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922380+0000", 2024-09-14T09:08:22.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012285275 2024-09-14T09:08:22.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922434+0000", 2024-09-14T09:08:22.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3925000000000003e-05 2024-09-14T09:08:22.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922493+0000", 2024-09-14T09:08:22.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9345000000000002e-05 2024-09-14T09:08:22.953 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.953 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.953 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.954 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1519 3.d 3:b36f6c76:::rbd_data.1112f61fa773.0000000000000002:8 [read 1425408~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:22.954 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910131+0000", 2024-09-14T09:08:22.954 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.009109882000001, 2024-09-14T09:08:22.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012535421999999999, 2024-09-14T09:08:22.954 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.954 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.954 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.954 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.954 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:22.954 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:22.954 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1519 2024-09-14T09:08:22.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.955 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910131+0000", 2024-09-14T09:08:22.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910131+0000", 2024-09-14T09:08:22.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910132+0000", 2024-09-14T09:08:22.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1399999999999997e-07 2024-09-14T09:08:22.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910134+0000", 2024-09-14T09:08:22.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6340000000000001e-06 2024-09-14T09:08:22.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910142+0000", 2024-09-14T09:08:22.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8809999999999996e-06 2024-09-14T09:08:22.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910148+0000", 2024-09-14T09:08:22.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1750000000000002e-06 2024-09-14T09:08:22.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922521+0000", 2024-09-14T09:08:22.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012372726000000001 2024-09-14T09:08:22.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922585+0000", 2024-09-14T09:08:22.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4169000000000002e-05 2024-09-14T09:08:22.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922667+0000", 2024-09-14T09:08:22.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1322999999999994e-05 2024-09-14T09:08:22.958 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.958 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.958 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.959 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1524 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 1032192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:22.959 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:22.959 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.009081112000001, 2024-09-14T09:08:22.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012717483, 2024-09-14T09:08:22.959 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.959 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.959 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.959 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.959 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:22.959 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:22.960 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1524 2024-09-14T09:08:22.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.960 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:22.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:22.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:22.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5499999999999998e-07 2024-09-14T09:08:22.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910163+0000", 2024-09-14T09:08:22.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3180000000000001e-06 2024-09-14T09:08:22.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910169+0000", 2024-09-14T09:08:22.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5139999999999998e-06 2024-09-14T09:08:22.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910176+0000", 2024-09-14T09:08:22.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5169999999999996e-06 2024-09-14T09:08:22.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922695+0000", 2024-09-14T09:08:22.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012519007 2024-09-14T09:08:22.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922775+0000", 2024-09-14T09:08:22.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9958999999999998e-05 2024-09-14T09:08:22.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922877+0000", 2024-09-14T09:08:22.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000102613 2024-09-14T09:08:22.964 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.964 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.964 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.964 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1525 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 1261568~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:22.964 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910183+0000", 2024-09-14T09:08:22.964 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.009057781999999, 2024-09-14T09:08:22.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012942067999999999, 2024-09-14T09:08:22.964 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.964 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.964 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.965 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.965 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:22.965 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:22.965 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1525 2024-09-14T09:08:22.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.965 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910183+0000", 2024-09-14T09:08:22.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910183+0000", 2024-09-14T09:08:22.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910184+0000", 2024-09-14T09:08:22.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9999999999999998e-07 2024-09-14T09:08:22.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910186+0000", 2024-09-14T09:08:22.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.165e-06 2024-09-14T09:08:22.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910192+0000", 2024-09-14T09:08:22.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3080000000000004e-06 2024-09-14T09:08:22.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910203+0000", 2024-09-14T09:08:22.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0586e-05 2024-09-14T09:08:22.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922932+0000", 2024-09-14T09:08:22.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012728882 2024-09-14T09:08:22.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923028+0000", 2024-09-14T09:08:22.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6531000000000001e-05 2024-09-14T09:08:22.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923125+0000", 2024-09-14T09:08:22.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7195999999999996e-05 2024-09-14T09:08:22.968 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.968 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.969 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.969 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1527 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 999424~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:22.969 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910210+0000", 2024-09-14T09:08:22.969 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.009030875000001, 2024-09-14T09:08:22.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013037887999999999, 2024-09-14T09:08:22.969 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.970 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.970 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.970 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.970 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:22.970 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:22.970 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1527 2024-09-14T09:08:22.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.970 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910210+0000", 2024-09-14T09:08:22.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910210+0000", 2024-09-14T09:08:22.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910211+0000", 2024-09-14T09:08:22.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8800000000000003e-07 2024-09-14T09:08:22.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910213+0000", 2024-09-14T09:08:22.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0820000000000001e-06 2024-09-14T09:08:22.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910219+0000", 2024-09-14T09:08:22.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0789999999999997e-06 2024-09-14T09:08:22.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910224+0000", 2024-09-14T09:08:22.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7299999999999996e-06 2024-09-14T09:08:22.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923158+0000", 2024-09-14T09:08:22.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012934200999999999 2024-09-14T09:08:22.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923197+0000", 2024-09-14T09:08:22.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9020999999999998e-05 2024-09-14T09:08:22.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923248+0000", 2024-09-14T09:08:22.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1286999999999999e-05 2024-09-14T09:08:22.974 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.974 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.974 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.974 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1528 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1228800~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:22.974 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:22.974 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.009011027, 2024-09-14T09:08:22.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013235419, 2024-09-14T09:08:22.974 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.974 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.975 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.975 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.975 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:22.975 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:22.975 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1528 2024-09-14T09:08:22.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.975 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:22.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:22.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:22.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.01e-07 2024-09-14T09:08:22.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910232+0000", 2024-09-14T09:08:22.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9589999999999998e-06 2024-09-14T09:08:22.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910238+0000", 2024-09-14T09:08:22.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8200000000000002e-06 2024-09-14T09:08:22.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910243+0000", 2024-09-14T09:08:22.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8369999999999996e-06 2024-09-14T09:08:22.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923281+0000", 2024-09-14T09:08:22.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013037613 2024-09-14T09:08:22.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923360+0000", 2024-09-14T09:08:22.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9717999999999998e-05 2024-09-14T09:08:22.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923465+0000", 2024-09-14T09:08:22.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000105071 2024-09-14T09:08:22.979 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.979 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.979 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.979 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1544 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 1277952~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:22.979 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:22.979 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.007452043000001, 2024-09-14T09:08:22.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012301747, 2024-09-14T09:08:22.979 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.979 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.980 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.980 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.980 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:22.980 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:22.980 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1544 2024-09-14T09:08:22.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.980 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:22.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:22.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:22.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1500000000000005e-07 2024-09-14T09:08:22.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911793+0000", 2024-09-14T09:08:22.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6689999999999999e-06 2024-09-14T09:08:22.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911802+0000", 2024-09-14T09:08:22.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4710000000000007e-06 2024-09-14T09:08:22.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911807+0000", 2024-09-14T09:08:22.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5799999999999999e-06 2024-09-14T09:08:22.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923930+0000", 2024-09-14T09:08:22.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012123083 2024-09-14T09:08:22.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924013+0000", 2024-09-14T09:08:22.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2560999999999998e-05 2024-09-14T09:08:22.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924091+0000", 2024-09-14T09:08:22.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7867999999999994e-05 2024-09-14T09:08:22.984 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.984 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.984 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.984 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1547 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:22.984 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.911814+0000", 2024-09-14T09:08:22.984 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.007426938999998, 2024-09-14T09:08:22.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012405057000000001, 2024-09-14T09:08:22.984 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.984 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.984 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.985 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.985 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:22.985 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:22.985 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1547 2024-09-14T09:08:22.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.985 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911814+0000", 2024-09-14T09:08:22.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911814+0000", 2024-09-14T09:08:22.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911815+0000", 2024-09-14T09:08:22.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3000000000000001e-07 2024-09-14T09:08:22.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911816+0000", 2024-09-14T09:08:22.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.75e-06 2024-09-14T09:08:22.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911823+0000", 2024-09-14T09:08:22.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6189999999999996e-06 2024-09-14T09:08:22.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911828+0000", 2024-09-14T09:08:22.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5539999999999997e-06 2024-09-14T09:08:22.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924119+0000", 2024-09-14T09:08:22.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012290967 2024-09-14T09:08:22.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924162+0000", 2024-09-14T09:08:22.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2422999999999997e-05 2024-09-14T09:08:22.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924219+0000", 2024-09-14T09:08:22.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7314e-05 2024-09-14T09:08:22.989 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.989 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.989 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.989 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1548 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1245184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:22.989 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.911850+0000", 2024-09-14T09:08:22.989 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.007390983000001, 2024-09-14T09:08:22.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012607343, 2024-09-14T09:08:22.989 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.989 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.989 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.989 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.990 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:22.990 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:22.990 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1548 2024-09-14T09:08:22.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.990 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911850+0000", 2024-09-14T09:08:22.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911850+0000", 2024-09-14T09:08:22.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911851+0000", 2024-09-14T09:08:22.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4199999999999996e-07 2024-09-14T09:08:22.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911853+0000", 2024-09-14T09:08:22.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.283e-06 2024-09-14T09:08:22.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911860+0000", 2024-09-14T09:08:22.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2069999999999998e-06 2024-09-14T09:08:22.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911866+0000", 2024-09-14T09:08:22.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.161e-06 2024-09-14T09:08:22.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924276+0000", 2024-09-14T09:08:22.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012409531 2024-09-14T09:08:22.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:22.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924371+0000", 2024-09-14T09:08:22.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4826000000000003e-05 2024-09-14T09:08:22.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:22.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924457+0000", 2024-09-14T09:08:22.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6792999999999994e-05 2024-09-14T09:08:22.994 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.994 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:22.994 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:22.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.995 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1566 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1032192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:22.995 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.913266+0000", 2024-09-14T09:08:22.995 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.005974932000001, 2024-09-14T09:08:22.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012340884999999999, 2024-09-14T09:08:22.995 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:22.995 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:22.995 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:22.995 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:22.996 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:22.996 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:22.996 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1566 2024-09-14T09:08:22.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.996 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:22.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:22.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913266+0000", 2024-09-14T09:08:22.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:22.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913266+0000", 2024-09-14T09:08:22.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:22.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:22.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913267+0000", 2024-09-14T09:08:22.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6899999999999998e-07 2024-09-14T09:08:22.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:22.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913269+0000", 2024-09-14T09:08:22.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9589999999999998e-06 2024-09-14T09:08:22.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:22.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913275+0000", 2024-09-14T09:08:22.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4969999999999998e-06 2024-09-14T09:08:22.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:22.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913280+0000", 2024-09-14T09:08:22.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2039999999999996e-06 2024-09-14T09:08:22.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:22.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:22.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:22.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925517+0000", 2024-09-14T09:08:23.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012236784000000001 2024-09-14T09:08:23.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925556+0000", 2024-09-14T09:08:23.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9121e-05 2024-09-14T09:08:23.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925607+0000", 2024-09-14T09:08:23.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0850999999999998e-05 2024-09-14T09:08:23.001 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.001 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.001 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.001 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1567 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1261568~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:23.001 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:23.002 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.005954339999999, 2024-09-14T09:08:23.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012537243, 2024-09-14T09:08:23.002 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.002 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.002 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.002 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.002 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:23.002 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:23.002 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1567 2024-09-14T09:08:23.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.002 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:23.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:23.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:23.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8099999999999998e-07 2024-09-14T09:08:23.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913289+0000", 2024-09-14T09:08:23.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9350000000000001e-06 2024-09-14T09:08:23.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913295+0000", 2024-09-14T09:08:23.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4540000000000004e-06 2024-09-14T09:08:23.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913300+0000", 2024-09-14T09:08:23.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9189999999999998e-06 2024-09-14T09:08:23.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925641+0000", 2024-09-14T09:08:23.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012340378000000001 2024-09-14T09:08:23.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925726+0000", 2024-09-14T09:08:23.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5504e-05 2024-09-14T09:08:23.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925824+0000", 2024-09-14T09:08:23.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7671999999999996e-05 2024-09-14T09:08:23.006 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.006 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.006 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.006 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3470 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 4374528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:23.007 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039718+0000", 2024-09-14T09:08:23.007 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.879522685000001, 2024-09-14T09:08:23.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012430363, 2024-09-14T09:08:23.007 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.007 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.007 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.007 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.007 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:23.007 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:23.007 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3470 2024-09-14T09:08:23.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.008 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039718+0000", 2024-09-14T09:08:23.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039718+0000", 2024-09-14T09:08:23.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039719+0000", 2024-09-14T09:08:23.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0200000000000003e-07 2024-09-14T09:08:23.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039721+0000", 2024-09-14T09:08:23.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4380000000000002e-06 2024-09-14T09:08:23.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039727+0000", 2024-09-14T09:08:23.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2620000000000004e-06 2024-09-14T09:08:23.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039733+0000", 2024-09-14T09:08:23.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1730000000000003e-06 2024-09-14T09:08:23.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.051980+0000", 2024-09-14T09:08:23.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012247872999999999 2024-09-14T09:08:23.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052056+0000", 2024-09-14T09:08:23.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5766999999999995e-05 2024-09-14T09:08:23.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052149+0000", 2024-09-14T09:08:23.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2448000000000007e-05 2024-09-14T09:08:23.012 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.012 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.012 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.012 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3473 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 4112384~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:23.012 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039746+0000", 2024-09-14T09:08:23.013 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.879494923999999, 2024-09-14T09:08:23.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012654228999999999, 2024-09-14T09:08:23.013 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.013 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.013 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.013 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.013 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:23.013 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:23.013 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3473 2024-09-14T09:08:23.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.013 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039746+0000", 2024-09-14T09:08:23.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039746+0000", 2024-09-14T09:08:23.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039747+0000", 2024-09-14T09:08:23.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5499999999999998e-07 2024-09-14T09:08:23.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039749+0000", 2024-09-14T09:08:23.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4380000000000002e-06 2024-09-14T09:08:23.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039759+0000", 2024-09-14T09:08:23.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7110000000000007e-06 2024-09-14T09:08:23.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039764+0000", 2024-09-14T09:08:23.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3680000000000001e-06 2024-09-14T09:08:23.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052199+0000", 2024-09-14T09:08:23.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012434726 2024-09-14T09:08:23.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052283+0000", 2024-09-14T09:08:23.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4091000000000005e-05 2024-09-14T09:08:23.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052400+0000", 2024-09-14T09:08:23.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011744 2024-09-14T09:08:23.018 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.018 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.018 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.019 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3474 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 4341760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:23.019 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039772+0000", 2024-09-14T09:08:23.019 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.879468692, 2024-09-14T09:08:23.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012822623999999999, 2024-09-14T09:08:23.019 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.019 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.019 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.019 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.019 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:23.020 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:23.020 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3474 2024-09-14T09:08:23.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.020 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039772+0000", 2024-09-14T09:08:23.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039772+0000", 2024-09-14T09:08:23.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039773+0000", 2024-09-14T09:08:23.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1199999999999998e-07 2024-09-14T09:08:23.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039775+0000", 2024-09-14T09:08:23.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9709999999999998e-06 2024-09-14T09:08:23.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039781+0000", 2024-09-14T09:08:23.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5150000000000003e-06 2024-09-14T09:08:23.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039786+0000", 2024-09-14T09:08:23.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9710000000000003e-06 2024-09-14T09:08:23.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052437+0000", 2024-09-14T09:08:23.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012650539000000001 2024-09-14T09:08:23.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052508+0000", 2024-09-14T09:08:23.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1038999999999995e-05 2024-09-14T09:08:23.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052595+0000", 2024-09-14T09:08:23.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7176999999999996e-05 2024-09-14T09:08:23.024 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.024 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.024 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.024 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3475 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 4571136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:23.025 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:23.025 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.879448378999999, 2024-09-14T09:08:23.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013000444999999999, 2024-09-14T09:08:23.025 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.025 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.025 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.025 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.025 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:23.025 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:23.025 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3475 2024-09-14T09:08:23.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.025 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:23.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:23.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:23.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.46e-07 2024-09-14T09:08:23.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039795+0000", 2024-09-14T09:08:23.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.863e-06 2024-09-14T09:08:23.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039802+0000", 2024-09-14T09:08:23.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3780000000000003e-06 2024-09-14T09:08:23.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039807+0000", 2024-09-14T09:08:23.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2170000000000002e-06 2024-09-14T09:08:23.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052636+0000", 2024-09-14T09:08:23.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012828278 2024-09-14T09:08:23.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052714+0000", 2024-09-14T09:08:23.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7824999999999994e-05 2024-09-14T09:08:23.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052793+0000", 2024-09-14T09:08:23.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9537999999999996e-05 2024-09-14T09:08:23.029 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.029 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.029 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.029 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.029 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.029 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:23.030 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:23.031+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:23.031 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:08:23.044 INFO:teuthology.orchestra.run.smithi148.stdout:2958 write 0xb5ca200 thru 0xb5d740c (0xd20d bytes) 2024-09-14T09:08:23.051 INFO:teuthology.orchestra.run.smithi148.stdout:2960 read 0x8e34200 thru 0x8e34bb9 (0x9ba bytes) 2024-09-14T09:08:23.051 INFO:teuthology.orchestra.run.smithi148.stdout:2962 read 0x1d31800 thru 0x1d40bdf (0xf3e0 bytes) 2024-09-14T09:08:23.051 INFO:teuthology.orchestra.run.smithi148.stdout:2963 write 0x3295800 thru 0x32a1fcd (0xc7ce bytes) 2024-09-14T09:08:23.051 INFO:teuthology.orchestra.run.smithi148.stdout:2964 trunc from 0xb5d7600 to 0xb66c200 2024-09-14T09:08:23.070 INFO:teuthology.orchestra.run.smithi148.stdout:2966 write 0x699f800 thru 0x69aacb5 (0xb4b6 bytes) 2024-09-14T09:08:23.075 INFO:teuthology.orchestra.run.smithi148.stdout:2967 punch from 0x9014600 to 0x901f600, (0xb000 bytes) 2024-09-14T09:08:23.081 INFO:teuthology.orchestra.run.smithi148.stdout:2968 trunc from 0xb66c200 to 0x79a3000 2024-09-14T09:08:23.102 INFO:teuthology.orchestra.run.smithi148.stdout:2972 read 0x83d600 thru 0x844a9c (0x749d bytes) 2024-09-14T09:08:23.108 INFO:teuthology.orchestra.run.smithi148.stdout:2973 punch from 0x6f76000 to 0x6f83600, (0xd600 bytes) 2024-09-14T09:08:23.108 INFO:teuthology.orchestra.run.smithi148.stdout:2975 punch from 0x26f1200 to 0x2700e00, (0xfc00 bytes) 2024-09-14T09:08:23.129 INFO:teuthology.orchestra.run.smithi148.stdout:2977 write 0xe1fa400 thru 0xe206d19 (0xc91a bytes) 2024-09-14T09:08:23.131 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:23.132+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:23.144 INFO:teuthology.orchestra.run.smithi148.stdout:2978 trunc from 0xe206e00 to 0x596d000 2024-09-14T09:08:23.175 INFO:teuthology.orchestra.run.smithi148.stdout:2979 trunc from 0x596d000 to 0xe74e00 2024-09-14T09:08:23.200 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:23.200 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:23.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.200 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4959.0:830 3.2 3:42b690fc:::rbd_data.1112dcec84c0.000000000000003b:head [call rbd.sparse_copyup in=196648b,set-alloc-hint object_size 262144 write_size 262144,truncate 196608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-14T09:08:23.200 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:23.201516+0000", 2024-09-14T09:08:23.200 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00039282999999999999, 2024-09-14T09:08:23.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00041110000000000002, 2024-09-14T09:08:23.200 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.201 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.201 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:08:23.201 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.201 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4959", 2024-09-14T09:08:23.201 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/824983630", 2024-09-14T09:08:23.201 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 830 2024-09-14T09:08:23.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.201 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:23.201516+0000", 2024-09-14T09:08:23.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:23.201516+0000", 2024-09-14T09:08:23.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:23.201517+0000", 2024-09-14T09:08:23.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7000000000000003e-07 2024-09-14T09:08:23.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:23.201808+0000", 2024-09-14T09:08:23.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00029105500000000002 2024-09-14T09:08:23.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:23.201819+0000", 2024-09-14T09:08:23.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0957e-05 2024-09-14T09:08:23.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:23.201824+0000", 2024-09-14T09:08:23.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.31e-06 2024-09-14T09:08:23.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:23.201879+0000", 2024-09-14T09:08:23.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4923999999999998e-05 2024-09-14T09:08:23.203 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.203 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.203 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.204 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.204 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:08:23.204 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 1 2024-09-14T09:08:23.204 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:23.209 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:08:23.212 INFO:teuthology.orchestra.run.smithi148.stdout:2981 punch from 0x63dc00 to 0x640400, (0x2800 bytes) 2024-09-14T09:08:23.214 INFO:teuthology.orchestra.run.smithi148.stdout:2982 read 0x250000 thru 0x25c2bd (0xc2be bytes) 2024-09-14T09:08:23.215 INFO:teuthology.orchestra.run.smithi148.stdout:2983 read 0x383a00 thru 0x38dc3f (0xa240 bytes) 2024-09-14T09:08:23.244 INFO:teuthology.orchestra.run.smithi148.stdout:2985 write 0xb5d3800 thru 0xb5e2247 (0xea48 bytes) 2024-09-14T09:08:23.245 INFO:teuthology.orchestra.run.smithi148.stdout:2986 write 0x37c5200 thru 0x37c716c (0x1f6d bytes) 2024-09-14T09:08:23.245 INFO:teuthology.orchestra.run.smithi148.stdout:2989 read 0x961f600 thru 0x9620e64 (0x1865 bytes) 2024-09-14T09:08:23.246 INFO:teuthology.orchestra.run.smithi148.stdout:2991 trunc from 0xb5e2400 to 0xa632000 2024-09-14T09:08:23.254 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:23.256+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:23.276 INFO:teuthology.orchestra.run.smithi148.stdout:2993 read 0x2f4de00 thru 0x2f57f2e (0xa12f bytes) 2024-09-14T09:08:23.280 INFO:teuthology.orchestra.run.smithi148.stdout:2995 trunc from 0xa632000 to 0xd3e9e00 2024-09-14T09:08:23.295 INFO:teuthology.orchestra.run.smithi148.stdout:2997 read 0xc010e00 thru 0xc01f290 (0xe491 bytes) 2024-09-14T09:08:23.296 INFO:teuthology.orchestra.run.smithi148.stdout:2998 write 0xb137a00 thru 0xb13955e (0x1b5f bytes) 2024-09-14T09:08:23.305 INFO:teuthology.orchestra.run.smithi148.stdout:3000 trunc from 0xd3e9e00 to 0x5e30000 2024-09-14T09:08:23.328 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:23.328 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:23.328 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:23.328 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:23.329 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:23.330 INFO:teuthology.orchestra.run.smithi148.stdout:3003 read 0x3debc00 thru 0x3df4241 (0x8642 bytes) 2024-09-14T09:08:23.332 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:23.334+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:23.337 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:08:23.354 INFO:teuthology.orchestra.run.smithi148.stdout:3005 write 0xe8f1a00 thru 0xe8fb014 (0x9615 bytes) 2024-09-14T09:08:23.355 INFO:teuthology.orchestra.run.smithi148.stdout:3008 punch from 0x63bbe00 to 0x63bf000, (0x3200 bytes) 2024-09-14T09:08:23.356 INFO:teuthology.orchestra.run.smithi148.stdout:3013 read 0xc099000 thru 0xc0a60b5 (0xd0b6 bytes) 2024-09-14T09:08:23.356 INFO:teuthology.orchestra.run.smithi148.stdout:3014 clone 19 order 22 su 32768 sc 10 2024-09-14T09:08:23.433 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:23.435+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:23.481 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:23.481 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:23.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:23.481 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:23.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.481 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4604.0:364 3.1d 3:bb0fb96d:::rbd_data.1112609a9334.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 28633088~35328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-14T09:08:23.481 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:04.667444+0000", 2024-09-14T09:08:23.481 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.814741787999999, 2024-09-14T09:08:23.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052308081999999999, 2024-09-14T09:08:23.482 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.482 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.482 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:23.482 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.482 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4604", 2024-09-14T09:08:23.482 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/335524879", 2024-09-14T09:08:23.482 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 364 2024-09-14T09:08:23.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.482 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.667444+0000", 2024-09-14T09:08:23.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.667444+0000", 2024-09-14T09:08:23.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.667445+0000", 2024-09-14T09:08:23.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1999999999999998e-07 2024-09-14T09:08:23.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681087+0000", 2024-09-14T09:08:23.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013641863000000001 2024-09-14T09:08:23.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681113+0000", 2024-09-14T09:08:23.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6310000000000001e-05 2024-09-14T09:08:23.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681123+0000", 2024-09-14T09:08:23.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7289999999999995e-06 2024-09-14T09:08:23.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681203+0000", 2024-09-14T09:08:23.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0628000000000001e-05 2024-09-14T09:08:23.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681323+0000", 2024-09-14T09:08:23.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000119722 2024-09-14T09:08:23.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:23.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.682203+0000", 2024-09-14T09:08:23.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00087938299999999997 2024-09-14T09:08:23.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:23.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719043+0000", 2024-09-14T09:08:23.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036840218000000001 2024-09-14T09:08:23.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719654+0000", 2024-09-14T09:08:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00061077199999999999 2024-09-14T09:08:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719698+0000", 2024-09-14T09:08:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4177000000000001e-05 2024-09-14T09:08:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719752+0000", 2024-09-14T09:08:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4459999999999997e-05 2024-09-14T09:08:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7885 3.1e 3:79089f6b:::rbd_data.11123620c885.0000000000000002:12 [read 256000~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075571+0000", 2024-09-14T09:08:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.4066148270000003, 2024-09-14T09:08:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036029795000000003, 2024-09-14T09:08:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.828 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7885 2024-09-14T09:08:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075571+0000", 2024-09-14T09:08:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075571+0000", 2024-09-14T09:08:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075571+0000", 2024-09-14T09:08:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.01e-07 2024-09-14T09:08:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075573+0000", 2024-09-14T09:08:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6789999999999999e-06 2024-09-14T09:08:23.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075579+0000", 2024-09-14T09:08:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6489999999999996e-06 2024-09-14T09:08:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075584+0000", 2024-09-14T09:08:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7530000000000001e-06 2024-09-14T09:08:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111315+0000", 2024-09-14T09:08:23.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035731375000000003 2024-09-14T09:08:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111421+0000", 2024-09-14T09:08:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106124 2024-09-14T09:08:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111601+0000", 2024-09-14T09:08:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017981400000000001 2024-09-14T09:08:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.832 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7958 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 4096~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075911+0000", 2024-09-14T09:08:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.4062747619999998, 2024-09-14T09:08:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035748988000000002, 2024-09-14T09:08:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:23.833 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7958 2024-09-14T09:08:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075911+0000", 2024-09-14T09:08:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075911+0000", 2024-09-14T09:08:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075911+0000", 2024-09-14T09:08:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0800000000000001e-07 2024-09-14T09:08:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075917+0000", 2024-09-14T09:08:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0800000000000002e-06 2024-09-14T09:08:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075921+0000", 2024-09-14T09:08:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7610000000000001e-06 2024-09-14T09:08:23.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075924+0000", 2024-09-14T09:08:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5349999999999999e-06 2024-09-14T09:08:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111099+0000", 2024-09-14T09:08:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035175728000000003 2024-09-14T09:08:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111185+0000", 2024-09-14T09:08:23.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5185000000000005e-05 2024-09-14T09:08:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111660+0000", 2024-09-14T09:08:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00047549099999999998 2024-09-14T09:08:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7959 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 14336~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075927+0000", 2024-09-14T09:08:23.837 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.4062586699999997, 2024-09-14T09:08:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036277579999999997, 2024-09-14T09:08:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7959 2024-09-14T09:08:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.838 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075927+0000", 2024-09-14T09:08:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075927+0000", 2024-09-14T09:08:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075927+0000", 2024-09-14T09:08:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4200000000000002e-07 2024-09-14T09:08:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075929+0000", 2024-09-14T09:08:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0750000000000001e-06 2024-09-14T09:08:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075931+0000", 2024-09-14T09:08:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8289999999999999e-06 2024-09-14T09:08:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075934+0000", 2024-09-14T09:08:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.525e-06 2024-09-14T09:08:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111692+0000", 2024-09-14T09:08:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035757780000000003 2024-09-14T09:08:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111772+0000", 2024-09-14T09:08:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0173999999999995e-05 2024-09-14T09:08:23.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112205+0000", 2024-09-14T09:08:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000432955 2024-09-14T09:08:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7960 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 40960~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075937+0000", 2024-09-14T09:08:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.4062488430000002, 2024-09-14T09:08:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036668890000000003, 2024-09-14T09:08:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.842 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7960 2024-09-14T09:08:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075937+0000", 2024-09-14T09:08:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075937+0000", 2024-09-14T09:08:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075937+0000", 2024-09-14T09:08:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:08:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075938+0000", 2024-09-14T09:08:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4900000000000004e-07 2024-09-14T09:08:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075941+0000", 2024-09-14T09:08:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7199999999999998e-06 2024-09-14T09:08:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075944+0000", 2024-09-14T09:08:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6850000000000001e-06 2024-09-14T09:08:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112243+0000", 2024-09-14T09:08:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036299512999999999 2024-09-14T09:08:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112343+0000", 2024-09-14T09:08:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9722000000000005e-05 2024-09-14T09:08:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112606+0000", 2024-09-14T09:08:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026292600000000002 2024-09-14T09:08:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7961 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 51200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075947+0000", 2024-09-14T09:08:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.4062392599999995, 2024-09-14T09:08:23.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037048949999999997, 2024-09-14T09:08:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7961 2024-09-14T09:08:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075947+0000", 2024-09-14T09:08:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075947+0000", 2024-09-14T09:08:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075947+0000", 2024-09-14T09:08:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.05e-07 2024-09-14T09:08:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075948+0000", 2024-09-14T09:08:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.28e-06 2024-09-14T09:08:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075951+0000", 2024-09-14T09:08:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7829999999999999e-06 2024-09-14T09:08:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075953+0000", 2024-09-14T09:08:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5239999999999999e-06 2024-09-14T09:08:23.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112642+0000", 2024-09-14T09:08:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036688193000000001 2024-09-14T09:08:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112741+0000", 2024-09-14T09:08:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9816999999999997e-05 2024-09-14T09:08:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112996+0000", 2024-09-14T09:08:23.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025414799999999999 2024-09-14T09:08:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7962 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 61440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075956+0000", 2024-09-14T09:08:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.4062296439999997, 2024-09-14T09:08:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037427290000000002, 2024-09-14T09:08:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.851 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7962 2024-09-14T09:08:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075956+0000", 2024-09-14T09:08:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075956+0000", 2024-09-14T09:08:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075956+0000", 2024-09-14T09:08:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:08:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075958+0000", 2024-09-14T09:08:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.102e-06 2024-09-14T09:08:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075968+0000", 2024-09-14T09:08:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0774000000000001e-05 2024-09-14T09:08:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075973+0000", 2024-09-14T09:08:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6809999999999997e-06 2024-09-14T09:08:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113030+0000", 2024-09-14T09:08:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037057198999999999 2024-09-14T09:08:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113127+0000", 2024-09-14T09:08:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7094000000000002e-05 2024-09-14T09:08:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113384+0000", 2024-09-14T09:08:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025623099999999999 2024-09-14T09:08:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7963 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 71680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075980+0000", 2024-09-14T09:08:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.4062056580000002, 2024-09-14T09:08:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037742675000000003, 2024-09-14T09:08:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7963 2024-09-14T09:08:23.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075980+0000", 2024-09-14T09:08:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075980+0000", 2024-09-14T09:08:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075981+0000", 2024-09-14T09:08:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0299999999999999e-07 2024-09-14T09:08:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075983+0000", 2024-09-14T09:08:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.886e-06 2024-09-14T09:08:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075989+0000", 2024-09-14T09:08:23.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9499999999999998e-06 2024-09-14T09:08:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075993+0000", 2024-09-14T09:08:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2740000000000001e-06 2024-09-14T09:08:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113413+0000", 2024-09-14T09:08:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037420417999999997 2024-09-14T09:08:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113508+0000", 2024-09-14T09:08:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4636999999999995e-05 2024-09-14T09:08:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113723+0000", 2024-09-14T09:08:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000215007 2024-09-14T09:08:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7964 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 98304~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:23.860 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075999+0000", 2024-09-14T09:08:23.861 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.4061873780000003, 2024-09-14T09:08:23.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038103415000000002, 2024-09-14T09:08:23.861 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.861 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.861 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.861 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.861 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7964 2024-09-14T09:08:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075999+0000", 2024-09-14T09:08:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075999+0000", 2024-09-14T09:08:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075999+0000", 2024-09-14T09:08:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6399999999999998e-07 2024-09-14T09:08:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076001+0000", 2024-09-14T09:08:23.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7999999999999999e-06 2024-09-14T09:08:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076005+0000", 2024-09-14T09:08:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3309999999999997e-06 2024-09-14T09:08:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076008+0000", 2024-09-14T09:08:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-06 2024-09-14T09:08:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113768+0000", 2024-09-14T09:08:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037760295999999999 2024-09-14T09:08:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113854+0000", 2024-09-14T09:08:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6030000000000001e-05 2024-09-14T09:08:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114102+0000", 2024-09-14T09:08:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024789000000000001 2024-09-14T09:08:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.865 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7965 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 108544~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076011+0000", 2024-09-14T09:08:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.4061749089999998, 2024-09-14T09:08:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038452854000000002, 2024-09-14T09:08:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:23.866 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7965 2024-09-14T09:08:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076011+0000", 2024-09-14T09:08:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076011+0000", 2024-09-14T09:08:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076011+0000", 2024-09-14T09:08:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1899999999999999e-07 2024-09-14T09:08:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076012+0000", 2024-09-14T09:08:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0610000000000001e-06 2024-09-14T09:08:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076015+0000", 2024-09-14T09:08:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8380000000000002e-06 2024-09-14T09:08:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076018+0000", 2024-09-14T09:08:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.458e-06 2024-09-14T09:08:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114136+0000", 2024-09-14T09:08:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038118217000000003 2024-09-14T09:08:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114218+0000", 2024-09-14T09:08:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2496000000000004e-05 2024-09-14T09:08:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114464+0000", 2024-09-14T09:08:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000245565 2024-09-14T09:08:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7966 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 118784~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:23.870 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076020+0000", 2024-09-14T09:08:23.871 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.4061656339999997, 2024-09-14T09:08:23.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038813976, 2024-09-14T09:08:23.871 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.871 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.871 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.871 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.871 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:23.871 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7966 2024-09-14T09:08:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076020+0000", 2024-09-14T09:08:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076020+0000", 2024-09-14T09:08:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076020+0000", 2024-09-14T09:08:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1199999999999999e-07 2024-09-14T09:08:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076022+0000", 2024-09-14T09:08:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0610000000000001e-06 2024-09-14T09:08:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076025+0000", 2024-09-14T09:08:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4189999999999998e-06 2024-09-14T09:08:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076028+0000", 2024-09-14T09:08:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9909999999999998e-06 2024-09-14T09:08:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114497+0000", 2024-09-14T09:08:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038469376999999999 2024-09-14T09:08:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114596+0000", 2024-09-14T09:08:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8978e-05 2024-09-14T09:08:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114834+0000", 2024-09-14T09:08:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023793800000000001 2024-09-14T09:08:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.875 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7967 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 129024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076031+0000", 2024-09-14T09:08:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.4061551210000003, 2024-09-14T09:08:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039142059, 2024-09-14T09:08:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7967 2024-09-14T09:08:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076031+0000", 2024-09-14T09:08:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076031+0000", 2024-09-14T09:08:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076031+0000", 2024-09-14T09:08:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.11e-07 2024-09-14T09:08:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076032+0000", 2024-09-14T09:08:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.037e-06 2024-09-14T09:08:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076035+0000", 2024-09-14T09:08:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7389999999999999e-06 2024-09-14T09:08:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076038+0000", 2024-09-14T09:08:23.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3780000000000001e-06 2024-09-14T09:08:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114868+0000", 2024-09-14T09:08:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038829977000000002 2024-09-14T09:08:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114972+0000", 2024-09-14T09:08:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010364100000000001 2024-09-14T09:08:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115173+0000", 2024-09-14T09:08:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020107600000000001 2024-09-14T09:08:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7968 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 155648~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076041+0000", 2024-09-14T09:08:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.4061448199999997, 2024-09-14T09:08:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039346991999999997, 2024-09-14T09:08:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.880 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7968 2024-09-14T09:08:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076041+0000", 2024-09-14T09:08:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076041+0000", 2024-09-14T09:08:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076041+0000", 2024-09-14T09:08:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0100000000000001e-07 2024-09-14T09:08:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076042+0000", 2024-09-14T09:08:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0380000000000001e-06 2024-09-14T09:08:23.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076045+0000", 2024-09-14T09:08:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7250000000000002e-06 2024-09-14T09:08:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076047+0000", 2024-09-14T09:08:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4600000000000002e-06 2024-09-14T09:08:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115220+0000", 2024-09-14T09:08:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039172430000000001 2024-09-14T09:08:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115316+0000", 2024-09-14T09:08:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5712999999999997e-05 2024-09-14T09:08:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115388+0000", 2024-09-14T09:08:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2424999999999999e-05 2024-09-14T09:08:23.884 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7969 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 165888~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076050+0000", 2024-09-14T09:08:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.4061355960000004, 2024-09-14T09:08:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039616993000000003, 2024-09-14T09:08:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.885 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7969 2024-09-14T09:08:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076050+0000", 2024-09-14T09:08:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076050+0000", 2024-09-14T09:08:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076050+0000", 2024-09-14T09:08:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0699999999999999e-07 2024-09-14T09:08:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076051+0000", 2024-09-14T09:08:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0049999999999999e-06 2024-09-14T09:08:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076054+0000", 2024-09-14T09:08:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7800000000000001e-06 2024-09-14T09:08:23.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076057+0000", 2024-09-14T09:08:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5450000000000002e-06 2024-09-14T09:08:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115430+0000", 2024-09-14T09:08:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039373506000000003 2024-09-14T09:08:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115509+0000", 2024-09-14T09:08:23.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8276999999999996e-05 2024-09-14T09:08:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115667+0000", 2024-09-14T09:08:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015867299999999999 2024-09-14T09:08:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.889 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7970 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 176128~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076060+0000", 2024-09-14T09:08:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.4061263339999996, 2024-09-14T09:08:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039793765000000002, 2024-09-14T09:08:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7970 2024-09-14T09:08:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076060+0000", 2024-09-14T09:08:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076060+0000", 2024-09-14T09:08:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076060+0000", 2024-09-14T09:08:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:08:23.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076064+0000", 2024-09-14T09:08:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3930000000000001e-06 2024-09-14T09:08:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076067+0000", 2024-09-14T09:08:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9809999999999999e-06 2024-09-14T09:08:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076070+0000", 2024-09-14T09:08:23.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6010000000000002e-06 2024-09-14T09:08:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115699+0000", 2024-09-14T09:08:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039629659999999997 2024-09-14T09:08:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115785+0000", 2024-09-14T09:08:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5109000000000001e-05 2024-09-14T09:08:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115853+0000", 2024-09-14T09:08:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8812000000000005e-05 2024-09-14T09:08:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7971 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 186368~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076073+0000", 2024-09-14T09:08:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.4061132609999998, 2024-09-14T09:08:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039977828, 2024-09-14T09:08:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.894 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7971 2024-09-14T09:08:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076073+0000", 2024-09-14T09:08:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076073+0000", 2024-09-14T09:08:23.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076073+0000", 2024-09-14T09:08:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1500000000000001e-07 2024-09-14T09:08:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076074+0000", 2024-09-14T09:08:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4499999999999995e-07 2024-09-14T09:08:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076077+0000", 2024-09-14T09:08:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.785e-06 2024-09-14T09:08:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076079+0000", 2024-09-14T09:08:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6129999999999998e-06 2024-09-14T09:08:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115884+0000", 2024-09-14T09:08:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039805261000000002 2024-09-14T09:08:23.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115973+0000", 2024-09-14T09:08:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8381999999999995e-05 2024-09-14T09:08:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116050+0000", 2024-09-14T09:08:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7626999999999994e-05 2024-09-14T09:08:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7972 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 212992~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076082+0000", 2024-09-14T09:08:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.4061038410000002, 2024-09-14T09:08:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040162654999999998, 2024-09-14T09:08:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7972 2024-09-14T09:08:23.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076082+0000", 2024-09-14T09:08:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076082+0000", 2024-09-14T09:08:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076082+0000", 2024-09-14T09:08:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3099999999999999e-07 2024-09-14T09:08:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076083+0000", 2024-09-14T09:08:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.64e-07 2024-09-14T09:08:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076086+0000", 2024-09-14T09:08:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7539999999999998e-06 2024-09-14T09:08:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076089+0000", 2024-09-14T09:08:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5409999999999999e-06 2024-09-14T09:08:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116091+0000", 2024-09-14T09:08:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040002204 2024-09-14T09:08:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116172+0000", 2024-09-14T09:08:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0833000000000003e-05 2024-09-14T09:08:23.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116245+0000", 2024-09-14T09:08:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3127999999999995e-05 2024-09-14T09:08:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7973 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 223232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076091+0000", 2024-09-14T09:08:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.4060944749999997, 2024-09-14T09:08:23.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040345740999999997, 2024-09-14T09:08:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7973 2024-09-14T09:08:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076091+0000", 2024-09-14T09:08:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076091+0000", 2024-09-14T09:08:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076092+0000", 2024-09-14T09:08:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7300000000000002e-07 2024-09-14T09:08:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076093+0000", 2024-09-14T09:08:23.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0300000000000001e-06 2024-09-14T09:08:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076096+0000", 2024-09-14T09:08:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6049999999999998e-06 2024-09-14T09:08:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076099+0000", 2024-09-14T09:08:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8569999999999999e-06 2024-09-14T09:08:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116287+0000", 2024-09-14T09:08:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040187753 2024-09-14T09:08:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116370+0000", 2024-09-14T09:08:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2509000000000006e-05 2024-09-14T09:08:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116437+0000", 2024-09-14T09:08:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7613999999999993e-05 2024-09-14T09:08:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7974 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 233472~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076102+0000", 2024-09-14T09:08:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.4060837260000003, 2024-09-14T09:08:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040515104000000003, 2024-09-14T09:08:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7974 2024-09-14T09:08:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.909 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076102+0000", 2024-09-14T09:08:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076102+0000", 2024-09-14T09:08:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076102+0000", 2024-09-14T09:08:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.04e-07 2024-09-14T09:08:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076103+0000", 2024-09-14T09:08:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.02e-06 2024-09-14T09:08:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076106+0000", 2024-09-14T09:08:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7499999999999999e-06 2024-09-14T09:08:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076109+0000", 2024-09-14T09:08:23.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3510000000000002e-06 2024-09-14T09:08:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116469+0000", 2024-09-14T09:08:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040359095999999997 2024-09-14T09:08:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116547+0000", 2024-09-14T09:08:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8509000000000003e-05 2024-09-14T09:08:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116617+0000", 2024-09-14T09:08:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0173999999999996e-05 2024-09-14T09:08:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7975 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 243712~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076113+0000", 2024-09-14T09:08:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.4060732649999999, 2024-09-14T09:08:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040678662999999997, 2024-09-14T09:08:23.913 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7975 2024-09-14T09:08:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076113+0000", 2024-09-14T09:08:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076113+0000", 2024-09-14T09:08:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076113+0000", 2024-09-14T09:08:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.34e-07 2024-09-14T09:08:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076114+0000", 2024-09-14T09:08:23.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0410000000000001e-06 2024-09-14T09:08:23.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:23.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076117+0000", 2024-09-14T09:08:23.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7870000000000002e-06 2024-09-14T09:08:23.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:23.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076121+0000", 2024-09-14T09:08:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1489999999999996e-06 2024-09-14T09:08:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116645+0000", 2024-09-14T09:08:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040523851999999999 2024-09-14T09:08:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116725+0000", 2024-09-14T09:08:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9985000000000001e-05 2024-09-14T09:08:23.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:23.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:23.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:23.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116791+0000", 2024-09-14T09:08:23.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6614999999999998e-05 2024-09-14T09:08:23.918 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.918 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.918 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.918 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:23.918 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:23.918 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:23.919 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:08:23.921 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:08:23.921 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:23.922+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:23.955 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone18 from 0xe8fb200 (overlap 0xe74e00) to 0xb90a00 2024-09-14T09:08:24.021 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:24.022+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:24.037 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:24.037 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:24.037 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:24.037 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:24.046 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:08:24.089 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:24.090 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:24.106 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:24.106 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:24.124 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:08:24.124 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:08:24.130 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:24.132+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:24.141 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:24.141 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:24.158 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:24.159 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:24.177 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:24.177 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:24.195 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:24.195 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:24.204 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:08:24.228 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #17, image image_client.0-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent18 2024-09-14T09:08:24.245 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:24.246+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:24.326 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:24.327+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:24.351 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:24.351 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:24.354 INFO:teuthology.orchestra.run.smithi148.stdout:3015 trunc from 0xe8fb200 to 0x51cfa00 2024-09-14T09:08:24.359 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:08:24.385 INFO:teuthology.orchestra.run.smithi148.stdout:3016 punch from 0x2ac5600 to 0x2acf200, (0x9c00 bytes) 2024-09-14T09:08:24.397 INFO:teuthology.orchestra.run.smithi148.stdout:3017 trunc from 0x51cfa00 to 0xcf3a200 2024-09-14T09:08:24.405 INFO:teuthology.orchestra.run.smithi148.stdout:3020 write 0xab10000 thru 0xab11509 (0x150a bytes) 2024-09-14T09:08:24.412 INFO:teuthology.orchestra.run.smithi148.stdout:3022 punch from 0x31b1c00 to 0x31b6a00, (0x4e00 bytes) 2024-09-14T09:08:24.415 INFO:teuthology.orchestra.run.smithi148.stdout:3023 punch from 0xb15400 to 0xb20e00, (0xba00 bytes) 2024-09-14T09:08:24.417 INFO:teuthology.orchestra.run.smithi148.stdout:3024 write 0x5127e00 thru 0x51290c0 (0x12c1 bytes) 2024-09-14T09:08:24.427 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:24.429+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:24.431 INFO:teuthology.orchestra.run.smithi148.stdout:3026 trunc from 0xcf3a200 to 0xa03e600 2024-09-14T09:08:24.447 INFO:teuthology.orchestra.run.smithi148.stdout:3029 trunc from 0xa03e600 to 0x8b50a00 2024-09-14T09:08:24.468 INFO:teuthology.orchestra.run.smithi148.stdout:3031 read 0x3ac000 thru 0x3b42e2 (0x82e3 bytes) 2024-09-14T09:08:24.469 INFO:teuthology.orchestra.run.smithi148.stdout:3032 punch from 0x5be200 to 0x5c1800, (0x3600 bytes) 2024-09-14T09:08:24.474 INFO:teuthology.orchestra.run.smithi148.stdout:3036 punch from 0x5e3200 to 0x5e3e00, (0xc00 bytes) 2024-09-14T09:08:24.475 INFO:teuthology.orchestra.run.smithi148.stdout:3037 write 0x16de200 thru 0x16e0156 (0x1f57 bytes) 2024-09-14T09:08:24.475 INFO:teuthology.orchestra.run.smithi148.stdout:3039 read 0x2422800 thru 0x242639e (0x3b9f bytes) 2024-09-14T09:08:24.476 INFO:teuthology.orchestra.run.smithi148.stdout:3040 write 0x426e800 thru 0x42710ad (0x28ae bytes) 2024-09-14T09:08:24.508 INFO:teuthology.orchestra.run.smithi148.stdout:3041 write 0xa07be00 thru 0xa087cfe (0xbeff bytes) 2024-09-14T09:08:24.509 INFO:teuthology.orchestra.run.smithi148.stdout:3042 write 0x26b7800 thru 0x26c0686 (0x8e87 bytes) 2024-09-14T09:08:24.509 INFO:teuthology.orchestra.run.smithi148.stdout:3043 write 0x6aab200 thru 0x6ab122d (0x602e bytes) 2024-09-14T09:08:24.509 INFO:teuthology.orchestra.run.smithi148.stdout:3045 write 0x5944a00 thru 0x594ba68 (0x7069 bytes) 2024-09-14T09:08:24.510 INFO:teuthology.orchestra.run.smithi148.stdout:3046 punch from 0x27fa600 to 0x27fba00, (0x1400 bytes) 2024-09-14T09:08:24.512 INFO:teuthology.orchestra.run.smithi148.stdout:3049 write 0x80cda00 thru 0x80cf7f7 (0x1df8 bytes) 2024-09-14T09:08:24.512 INFO:teuthology.orchestra.run.smithi148.stdout:3051 trunc from 0xa087e00 to 0x9d56c00 2024-09-14T09:08:24.524 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:24.525 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:24.528 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:24.529+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:24.534 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:08:24.541 INFO:teuthology.orchestra.run.smithi148.stdout:3055 write 0x1d90800 thru 0x1d95950 (0x5151 bytes) 2024-09-14T09:08:24.549 INFO:teuthology.orchestra.run.smithi148.stdout:3056 trunc from 0x9d56c00 to 0xaaf6800 2024-09-14T09:08:24.566 INFO:teuthology.orchestra.run.smithi148.stdout:3061 trunc from 0xaaf6800 to 0x9a37000 2024-09-14T09:08:24.581 INFO:teuthology.orchestra.run.smithi148.stdout:3062 write 0x869e800 thru 0x86adbf0 (0xf3f1 bytes) 2024-09-14T09:08:24.581 INFO:teuthology.orchestra.run.smithi148.stdout:3064 punch from 0xe2ca00 to 0xe2d000, (0x600 bytes) 2024-09-14T09:08:24.593 INFO:teuthology.orchestra.run.smithi148.stdout:3065 write 0xafd8000 thru 0xafdb57d (0x357e bytes) 2024-09-14T09:08:24.594 INFO:teuthology.orchestra.run.smithi148.stdout:3067 punch from 0x2ab2200 to 0x2abb800, (0x9600 bytes) 2024-09-14T09:08:24.598 INFO:teuthology.orchestra.run.smithi148.stdout:3070 read 0x1aeb400 thru 0x1aed875 (0x2476 bytes) 2024-09-14T09:08:24.609 INFO:teuthology.orchestra.run.smithi148.stdout:3071 write 0xe24d000 thru 0xe253b77 (0x6b78 bytes) 2024-09-14T09:08:24.610 INFO:teuthology.orchestra.run.smithi148.stdout:3073 write 0xc1a5800 thru 0xc1b0af4 (0xb2f5 bytes) 2024-09-14T09:08:24.610 INFO:teuthology.orchestra.run.smithi148.stdout:3074 write 0x816cc00 thru 0x817bd38 (0xf139 bytes) 2024-09-14T09:08:24.615 INFO:teuthology.orchestra.run.smithi148.stdout:3075 read 0xb8d2800 thru 0xb8d4ee5 (0x26e6 bytes) 2024-09-14T09:08:24.615 INFO:teuthology.orchestra.run.smithi148.stdout:3076 read 0x1133c00 thru 0x1138c47 (0x5048 bytes) 2024-09-14T09:08:24.615 INFO:teuthology.orchestra.run.smithi148.stdout:3078 read 0xb87c800 thru 0xb87ecc6 (0x24c7 bytes) 2024-09-14T09:08:24.615 INFO:teuthology.orchestra.run.smithi148.stdout:3079 read 0x72ce400 thru 0x72d6799 (0x839a bytes) 2024-09-14T09:08:24.615 INFO:teuthology.orchestra.run.smithi148.stdout:3081 punch from 0x4ff9e00 to 0x4ffb400, (0x1600 bytes) 2024-09-14T09:08:24.615 INFO:teuthology.orchestra.run.smithi148.stdout:3082 read 0x6b0f400 thru 0x6b19096 (0x9c97 bytes) 2024-09-14T09:08:24.615 INFO:teuthology.orchestra.run.smithi148.stdout:3083 write 0x88f5c00 thru 0x88f8e74 (0x3275 bytes) 2024-09-14T09:08:24.615 INFO:teuthology.orchestra.run.smithi148.stdout:3084 write 0x306a00 thru 0x31082d (0x9e2e bytes) 2024-09-14T09:08:24.615 INFO:teuthology.orchestra.run.smithi148.stdout:3085 punch from 0x4456e00 to 0x445a400, (0x3600 bytes) 2024-09-14T09:08:24.616 INFO:teuthology.orchestra.run.smithi148.stdout:3088 read 0x73ab400 thru 0x73b7b82 (0xc783 bytes) 2024-09-14T09:08:24.617 INFO:teuthology.orchestra.run.smithi148.stdout:3091 read 0x8318600 thru 0x83202cf (0x7cd0 bytes) 2024-09-14T09:08:24.617 INFO:teuthology.orchestra.run.smithi148.stdout:3094 write 0x83c5c00 thru 0x83d2eb5 (0xd2b6 bytes) 2024-09-14T09:08:24.618 INFO:teuthology.orchestra.run.smithi148.stdout:3095 write 0x19f2400 thru 0x19f597a (0x357b bytes) 2024-09-14T09:08:24.619 INFO:teuthology.orchestra.run.smithi148.stdout:3099 punch from 0x282c200 to 0x282cc00, (0xa00 bytes) 2024-09-14T09:08:24.619 INFO:teuthology.orchestra.run.smithi148.stdout:3103 punch from 0x838c800 to 0x8394400, (0x7c00 bytes) 2024-09-14T09:08:24.620 INFO:teuthology.orchestra.run.smithi148.stdout:3106 read 0x68d4e00 thru 0x68e4026 (0xf227 bytes) 2024-09-14T09:08:24.620 INFO:teuthology.orchestra.run.smithi148.stdout:3107 write 0x8eebe00 thru 0x8ef2555 (0x6756 bytes) 2024-09-14T09:08:24.620 INFO:teuthology.orchestra.run.smithi148.stdout:3110 punch from 0x32af000 to 0x32b5c00, (0x6c00 bytes) 2024-09-14T09:08:24.622 INFO:teuthology.orchestra.run.smithi148.stdout:3111 read 0xb2bf400 thru 0xb2c8d2e (0x992f bytes) 2024-09-14T09:08:24.622 INFO:teuthology.orchestra.run.smithi148.stdout:3112 write 0x3854600 thru 0x385a2ea (0x5ceb bytes) 2024-09-14T09:08:24.629 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:24.631+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:24.635 INFO:teuthology.orchestra.run.smithi148.stdout:3113 trunc from 0xe253c00 to 0x3199800 2024-09-14T09:08:24.663 INFO:teuthology.orchestra.run.smithi148.stdout:3117 read 0x1a6b000 thru 0x1a715ff (0x6600 bytes) 2024-09-14T09:08:24.668 INFO:teuthology.orchestra.run.smithi148.stdout:3119 read 0x18a0400 thru 0x18aa028 (0x9c29 bytes) 2024-09-14T09:08:24.668 INFO:teuthology.orchestra.run.smithi148.stdout:3120 read 0x1dc8e00 thru 0x1dd66c2 (0xd8c3 bytes) 2024-09-14T09:08:24.669 INFO:teuthology.orchestra.run.smithi148.stdout:3123 punch from 0x1403a00 to 0x1406800, (0x2e00 bytes) 2024-09-14T09:08:24.682 INFO:teuthology.orchestra.run.smithi148.stdout:3126 write 0x71f6a00 thru 0x71f90b8 (0x26b9 bytes) 2024-09-14T09:08:24.688 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:24.688 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:24.698 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:08:24.701 INFO:teuthology.orchestra.run.smithi148.stdout:3127 write 0xc45b800 thru 0xc465d6b (0xa56c bytes) 2024-09-14T09:08:24.703 INFO:teuthology.orchestra.run.smithi148.stdout:3128 punch from 0xb486600 to 0xb48a800, (0x4200 bytes) 2024-09-14T09:08:24.703 INFO:teuthology.orchestra.run.smithi148.stdout:3129 punch from 0x4fa3800 to 0x4fb2000, (0xe800 bytes) 2024-09-14T09:08:24.705 INFO:teuthology.orchestra.run.smithi148.stdout:3132 punch from 0x23e4000 to 0x23f3600, (0xf600 bytes) 2024-09-14T09:08:24.707 INFO:teuthology.orchestra.run.smithi148.stdout:3134 trunc from 0xc465e00 to 0x94a5400 2024-09-14T09:08:24.722 INFO:teuthology.orchestra.run.smithi148.stdout:3135 read 0xe41000 thru 0xe508e1 (0xf8e2 bytes) 2024-09-14T09:08:24.730 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:24.732+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:24.737 INFO:teuthology.orchestra.run.smithi148.stdout:3138 trunc from 0x94a5400 to 0x9ab600 2024-09-14T09:08:24.781 INFO:teuthology.orchestra.run.smithi148.stdout:3139 write 0x326c400 thru 0x327356e (0x716f bytes) 2024-09-14T09:08:24.782 INFO:teuthology.orchestra.run.smithi148.stdout:3141 write 0x314800 thru 0x31920d (0x4a0e bytes) 2024-09-14T09:08:24.808 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:24.808 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:24.817 INFO:teuthology.orchestra.run.smithi148.stdout:3144 write 0xedb6000 thru 0xedb6f30 (0xf31 bytes) 2024-09-14T09:08:24.817 INFO:teuthology.orchestra.run.smithi148.stdout:3149 punch from 0x662b200 to 0x662e600, (0x3400 bytes) 2024-09-14T09:08:24.817 INFO:teuthology.orchestra.run.smithi148.stdout:3153 write 0x8519400 thru 0x8522526 (0x9127 bytes) 2024-09-14T09:08:24.817 INFO:teuthology.orchestra.run.smithi148.stdout:3154 write 0x7666c00 thru 0x766f149 (0x854a bytes) 2024-09-14T09:08:24.817 INFO:teuthology.orchestra.run.smithi148.stdout:3155 read 0xa62c00 thru 0xa645a4 (0x19a5 bytes) 2024-09-14T09:08:24.817 INFO:teuthology.orchestra.run.smithi148.stdout:3156 punch from 0x379a000 to 0x379f800, (0x5800 bytes) 2024-09-14T09:08:24.818 INFO:teuthology.orchestra.run.smithi148.stdout:3157 read 0x505b600 thru 0x505c68b (0x108c bytes) 2024-09-14T09:08:24.818 INFO:teuthology.orchestra.run.smithi148.stdout:3158 write 0xdd2ec00 thru 0xdd38dcb (0xa1cc bytes) 2024-09-14T09:08:24.818 INFO:teuthology.orchestra.run.smithi148.stdout:3159 trunc from 0xedb7000 to 0xe7e8000 2024-09-14T09:08:24.819 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:08:24.830 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:24.832+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:24.842 INFO:teuthology.orchestra.run.smithi148.stdout:3160 punch from 0xae7dc00 to 0xae81e00, (0x4200 bytes) 2024-09-14T09:08:24.842 INFO:teuthology.orchestra.run.smithi148.stdout:3162 read 0xc79400 thru 0xc7f4c5 (0x60c6 bytes) 2024-09-14T09:08:24.842 INFO:teuthology.orchestra.run.smithi148.stdout:3163 read 0xc46e400 thru 0xc471d2a (0x392b bytes) 2024-09-14T09:08:24.846 INFO:teuthology.orchestra.run.smithi148.stdout:3164 trunc from 0xe7e8000 to 0xaaf7200 2024-09-14T09:08:24.861 INFO:teuthology.orchestra.run.smithi148.stdout:3166 read 0x3a3c400 thru 0x3a49021 (0xcc22 bytes) 2024-09-14T09:08:24.862 INFO:teuthology.orchestra.run.smithi148.stdout:3169 write 0x66fe400 thru 0x670d806 (0xf407 bytes) 2024-09-14T09:08:24.862 INFO:teuthology.orchestra.run.smithi148.stdout:3170 read 0x1d96000 thru 0x1d9c5c2 (0x65c3 bytes) 2024-09-14T09:08:24.866 INFO:teuthology.orchestra.run.smithi148.stdout:3171 punch from 0x4708000 to 0x4717e00, (0xfe00 bytes) 2024-09-14T09:08:24.866 INFO:teuthology.orchestra.run.smithi148.stdout:3172 read 0x5aeb000 thru 0x5af64ba (0xb4bb bytes) 2024-09-14T09:08:24.866 INFO:teuthology.orchestra.run.smithi148.stdout:3173 read 0x71c3c00 thru 0x71ca1fe (0x65ff bytes) 2024-09-14T09:08:24.868 INFO:teuthology.orchestra.run.smithi148.stdout:3175 trunc from 0xaaf7200 to 0xdcc4e00 2024-09-14T09:08:24.882 INFO:teuthology.orchestra.run.smithi148.stdout:3176 write 0x1933e00 thru 0x193b545 (0x7746 bytes) 2024-09-14T09:08:24.882 INFO:teuthology.orchestra.run.smithi148.stdout:3180 punch from 0x7468400 to 0x7476600, (0xe200 bytes) 2024-09-14T09:08:24.883 INFO:teuthology.orchestra.run.smithi148.stdout:3181 write 0x15e2800 thru 0x15edd36 (0xb537 bytes) 2024-09-14T09:08:24.883 INFO:teuthology.orchestra.run.smithi148.stdout:3186 punch from 0xc70dc00 to 0xc71a000, (0xc400 bytes) 2024-09-14T09:08:24.884 INFO:teuthology.orchestra.run.smithi148.stdout:3187 write 0xd1d3600 thru 0xd1d6966 (0x3367 bytes) 2024-09-14T09:08:24.884 INFO:teuthology.orchestra.run.smithi148.stdout:3188 write 0x2675e00 thru 0x26785c9 (0x27ca bytes) 2024-09-14T09:08:24.885 INFO:teuthology.orchestra.run.smithi148.stdout:3190 punch from 0x45dbe00 to 0x45e1400, (0x5600 bytes) 2024-09-14T09:08:24.886 INFO:teuthology.orchestra.run.smithi148.stdout:3191 punch from 0x1a28400 to 0x1a2ca00, (0x4600 bytes) 2024-09-14T09:08:24.886 INFO:teuthology.orchestra.run.smithi148.stdout:3192 punch from 0xd0d1a00 to 0xd0dc400, (0xaa00 bytes) 2024-09-14T09:08:24.886 INFO:teuthology.orchestra.run.smithi148.stdout:3193 read 0x8c39c00 thru 0x8c43a8a (0x9e8b bytes) 2024-09-14T09:08:24.886 INFO:teuthology.orchestra.run.smithi148.stdout:3194 read 0xb78f200 thru 0xb794797 (0x5598 bytes) 2024-09-14T09:08:24.887 INFO:teuthology.orchestra.run.smithi148.stdout:3197 read 0x2cb7600 thru 0x2cc574e (0xe14f bytes) 2024-09-14T09:08:24.887 INFO:teuthology.orchestra.run.smithi148.stdout:3198 write 0xc18b400 thru 0xc18effb (0x3bfc bytes) 2024-09-14T09:08:24.887 INFO:teuthology.orchestra.run.smithi148.stdout:3199 read 0x182a000 thru 0x1833b39 (0x9b3a bytes) 2024-09-14T09:08:24.888 INFO:teuthology.orchestra.run.smithi148.stdout:3200 punch from 0x7c30000 to 0x7c35a00, (0x5a00 bytes) 2024-09-14T09:08:24.889 INFO:teuthology.orchestra.run.smithi148.stdout:3205 punch from 0x178f800 to 0x179e200, (0xea00 bytes) 2024-09-14T09:08:24.889 INFO:teuthology.orchestra.run.smithi148.stdout:3208 read 0xa0da600 thru 0xa0ea122 (0xfb23 bytes) 2024-09-14T09:08:24.889 INFO:teuthology.orchestra.run.smithi148.stdout:3212 read 0xb3c8000 thru 0xb3cb6f3 (0x36f4 bytes) 2024-09-14T09:08:24.893 INFO:teuthology.orchestra.run.smithi148.stdout:3213 write 0x100ce00 thru 0x100db93 (0xd94 bytes) 2024-09-14T09:08:24.894 INFO:teuthology.orchestra.run.smithi148.stdout:3216 punch from 0x4cdaa00 to 0x4ce5400, (0xaa00 bytes) 2024-09-14T09:08:24.894 INFO:teuthology.orchestra.run.smithi148.stdout:3217 punch from 0x271c600 to 0x272bc00, (0xf600 bytes) 2024-09-14T09:08:24.894 INFO:teuthology.orchestra.run.smithi148.stdout:3219 write 0xaf1b200 thru 0xaf1cfdf (0x1de0 bytes) 2024-09-14T09:08:24.895 INFO:teuthology.orchestra.run.smithi148.stdout:3220 trunc from 0xdcc4e00 to 0xe790e00 2024-09-14T09:08:24.904 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T09:08:24.922 INFO:teuthology.orchestra.run.smithi148.stdout:3221 trunc from 0xe790e00 to 0x7853600 2024-09-14T09:08:24.934 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:24.935 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:24.944 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:08:24.945 INFO:teuthology.orchestra.run.smithi148.stdout:3222 write 0x2e91200 thru 0x2e945d0 (0x33d1 bytes) 2024-09-14T09:08:24.946 INFO:teuthology.orchestra.run.smithi148.stdout:3223 read 0x1ff1c00 thru 0x2001bfb (0xfffc bytes) 2024-09-14T09:08:24.947 INFO:teuthology.orchestra.run.smithi148.stdout:3224 write 0x3e6dc00 thru 0x3e7ccb8 (0xf0b9 bytes) 2024-09-14T09:08:24.947 INFO:teuthology.orchestra.run.smithi148.stdout:3225 read 0x4d93000 thru 0x4d969de (0x39df bytes) 2024-09-14T09:08:24.947 INFO:teuthology.orchestra.run.smithi148.stdout:3227 write 0x22e6a00 thru 0x22ee5d5 (0x7bd6 bytes) 2024-09-14T09:08:24.948 INFO:teuthology.orchestra.run.smithi148.stdout:3228 punch from 0x110b000 to 0x110c800, (0x1800 bytes) 2024-09-14T09:08:24.948 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:24.950+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:24.948 INFO:teuthology.orchestra.run.smithi148.stdout:3232 punch from 0x2c43400 to 0x2c4dc00, (0xa800 bytes) 2024-09-14T09:08:24.955 INFO:teuthology.orchestra.run.smithi148.stdout:3234 trunc from 0x7853600 to 0xdb18400 2024-09-14T09:08:24.976 INFO:teuthology.orchestra.run.smithi148.stdout:3236 read 0x8e09200 thru 0x8e0fa97 (0x6898 bytes) 2024-09-14T09:08:24.976 INFO:teuthology.orchestra.run.smithi148.stdout:3240 read 0x40aa200 thru 0x40ad6dc (0x34dd bytes) 2024-09-14T09:08:24.977 INFO:teuthology.orchestra.run.smithi148.stdout:3241 read 0x5624200 thru 0x562aa95 (0x6896 bytes) 2024-09-14T09:08:24.977 INFO:teuthology.orchestra.run.smithi148.stdout:3243 read 0x2816600 thru 0x2822105 (0xbb06 bytes) 2024-09-14T09:08:24.977 INFO:teuthology.orchestra.run.smithi148.stdout:3246 read 0x6a1a200 thru 0x6a208e1 (0x66e2 bytes) 2024-09-14T09:08:24.978 INFO:teuthology.orchestra.run.smithi148.stdout:3247 read 0xaac7200 thru 0xaad12b0 (0xa0b1 bytes) 2024-09-14T09:08:24.978 INFO:teuthology.orchestra.run.smithi148.stdout:3248 read 0x799e00 thru 0x79b678 (0x1879 bytes) 2024-09-14T09:08:24.981 INFO:teuthology.orchestra.run.smithi148.stdout:3249 trunc from 0xdb18400 to 0xc06ec00 2024-09-14T09:08:24.997 INFO:teuthology.orchestra.run.smithi148.stdout:3250 write 0x5d5fc00 thru 0x5d671f0 (0x75f1 bytes) 2024-09-14T09:08:24.998 INFO:teuthology.orchestra.run.smithi148.stdout:3254 punch from 0x48ef800 to 0x48f4a00, (0x5200 bytes) 2024-09-14T09:08:24.998 INFO:teuthology.orchestra.run.smithi148.stdout:3255 read 0x9ea8800 thru 0x9ea9fe7 (0x17e8 bytes) 2024-09-14T09:08:24.998 INFO:teuthology.orchestra.run.smithi148.stdout:3257 read 0x2d4000 thru 0x2e3df4 (0xfdf5 bytes) 2024-09-14T09:08:24.999 INFO:teuthology.orchestra.run.smithi148.stdout:3258 write 0x6fa8400 thru 0x6fb57a7 (0xd3a8 bytes) 2024-09-14T09:08:24.999 INFO:teuthology.orchestra.run.smithi148.stdout:3259 read 0x9596c00 thru 0x959c0e4 (0x54e5 bytes) 2024-09-14T09:08:24.999 INFO:teuthology.orchestra.run.smithi148.stdout:3262 write 0xbc5800 thru 0xbc95ae (0x3daf bytes) 2024-09-14T09:08:25.000 INFO:teuthology.orchestra.run.smithi148.stdout:3263 write 0x74ad400 thru 0x74b0440 (0x3041 bytes) 2024-09-14T09:08:25.000 INFO:teuthology.orchestra.run.smithi148.stdout:3264 write 0x5289e00 thru 0x528babb (0x1cbc bytes) 2024-09-14T09:08:25.000 INFO:teuthology.orchestra.run.smithi148.stdout:3265 write 0x28d7000 thru 0x28d87c0 (0x17c1 bytes) 2024-09-14T09:08:25.000 INFO:teuthology.orchestra.run.smithi148.stdout:3267 read 0x279e600 thru 0x27ada93 (0xf494 bytes) 2024-09-14T09:08:25.001 INFO:teuthology.orchestra.run.smithi148.stdout:3268 read 0xafec00 thru 0xb0bffe (0xd3ff bytes) 2024-09-14T09:08:25.001 INFO:teuthology.orchestra.run.smithi148.stdout:3269 write 0x1e25600 thru 0x1e34ff5 (0xf9f6 bytes) 2024-09-14T09:08:25.002 INFO:teuthology.orchestra.run.smithi148.stdout:3270 read 0xacc0c00 thru 0xacc10bb (0x4bc bytes) 2024-09-14T09:08:25.026 INFO:teuthology.orchestra.run.smithi148.stdout:3271 write 0xebe5e00 thru 0xebe9f88 (0x4189 bytes) 2024-09-14T09:08:25.027 INFO:teuthology.orchestra.run.smithi148.stdout:3272 read 0xa8eb800 thru 0xa8f6ea0 (0xb6a1 bytes) 2024-09-14T09:08:25.028 INFO:teuthology.orchestra.run.smithi148.stdout:3275 write 0x177cc00 thru 0x17852bb (0x86bc bytes) 2024-09-14T09:08:25.029 INFO:teuthology.orchestra.run.smithi148.stdout:3276 read 0x832bc00 thru 0x833ba37 (0xfe38 bytes) 2024-09-14T09:08:25.029 INFO:teuthology.orchestra.run.smithi148.stdout:3277 read 0x241d000 thru 0x242c55d (0xf55e bytes) 2024-09-14T09:08:25.030 INFO:teuthology.orchestra.run.smithi148.stdout:3279 write 0x871f600 thru 0x872aebe (0xb8bf bytes) 2024-09-14T09:08:25.030 INFO:teuthology.orchestra.run.smithi148.stdout:3280 write 0xc361800 thru 0xc3659ec (0x41ed bytes) 2024-09-14T09:08:25.030 INFO:teuthology.orchestra.run.smithi148.stdout:3282 write 0x51e1c00 thru 0x51f0bd2 (0xefd3 bytes) 2024-09-14T09:08:25.030 INFO:teuthology.orchestra.run.smithi148.stdout:3283 write 0x166c600 thru 0x166f93e (0x333f bytes) 2024-09-14T09:08:25.031 INFO:teuthology.orchestra.run.smithi148.stdout:3284 write 0xe461c00 thru 0xe464ac1 (0x2ec2 bytes) 2024-09-14T09:08:25.031 INFO:teuthology.orchestra.run.smithi148.stdout:3285 punch from 0xbe98400 to 0xbea3800, (0xb400 bytes) 2024-09-14T09:08:25.032 INFO:teuthology.orchestra.run.smithi148.stdout:3286 write 0x18d1800 thru 0x18ddf1b (0xc71c bytes) 2024-09-14T09:08:25.032 INFO:teuthology.orchestra.run.smithi148.stdout:3288 write 0x9ac7e00 thru 0x9ad04fe (0x86ff bytes) 2024-09-14T09:08:25.032 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:25.034+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:25.034 INFO:teuthology.orchestra.run.smithi148.stdout:3289 read 0xcf9800 thru 0xd0859c (0xed9d bytes) 2024-09-14T09:08:25.034 INFO:teuthology.orchestra.run.smithi148.stdout:3291 write 0x2050800 thru 0x2053a99 (0x329a bytes) 2024-09-14T09:08:25.051 INFO:teuthology.orchestra.run.smithi148.stdout:3292 trunc from 0xebea000 to 0x173ac00 2024-09-14T09:08:25.055 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:25.055 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:25.066 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:08:25.089 INFO:teuthology.orchestra.run.smithi148.stdout:3293 read 0x1518a00 thru 0x151df97 (0x5598 bytes) 2024-09-14T09:08:25.102 INFO:teuthology.orchestra.run.smithi148.stdout:3296 trunc from 0x173ac00 to 0xccd2e00 2024-09-14T09:08:25.117 INFO:teuthology.orchestra.run.smithi148.stdout:3297 write 0x23cea00 thru 0x23d55b6 (0x6bb7 bytes) 2024-09-14T09:08:25.117 INFO:teuthology.orchestra.run.smithi148.stdout:3298 write 0xcc27200 thru 0xcc2f9b1 (0x87b2 bytes) 2024-09-14T09:08:25.118 INFO:teuthology.orchestra.run.smithi148.stdout:3300 write 0x9437c00 thru 0x9440f2c (0x932d bytes) 2024-09-14T09:08:25.129 INFO:teuthology.orchestra.run.smithi148.stdout:3302 trunc from 0xccd2e00 to 0x393c800 2024-09-14T09:08:25.133 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:25.135+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:25.165 INFO:teuthology.orchestra.run.smithi148.stdout:3303 trunc from 0x393c800 to 0x7d05a00 2024-09-14T09:08:25.174 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:25.174 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:25.175 INFO:teuthology.orchestra.run.smithi148.stdout:3305 read 0x3ac6200 thru 0x3ac9ba3 (0x39a4 bytes) 2024-09-14T09:08:25.184 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:08:25.188 INFO:teuthology.orchestra.run.smithi148.stdout:3308 write 0x8353a00 thru 0x8359951 (0x5f52 bytes) 2024-09-14T09:08:25.200 INFO:teuthology.orchestra.run.smithi148.stdout:3309 trunc from 0x8359a00 to 0x28bee00 2024-09-14T09:08:25.234 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:25.235+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:25.245 INFO:teuthology.orchestra.run.smithi148.stdout:3310 write 0x71d6000 thru 0x71e0cce (0xaccf bytes) 2024-09-14T09:08:25.245 INFO:teuthology.orchestra.run.smithi148.stdout:3315 punch from 0x2ac2c00 to 0x2acda00, (0xae00 bytes) 2024-09-14T09:08:25.246 INFO:teuthology.orchestra.run.smithi148.stdout:3316 punch from 0x3a74800 to 0x3a7f800, (0xb000 bytes) 2024-09-14T09:08:25.246 INFO:teuthology.orchestra.run.smithi148.stdout:3317 read 0x387800 thru 0x393494 (0xbc95 bytes) 2024-09-14T09:08:25.247 INFO:teuthology.orchestra.run.smithi148.stdout:3318 punch from 0x66e8000 to 0x66f4200, (0xc200 bytes) 2024-09-14T09:08:25.250 INFO:teuthology.orchestra.run.smithi148.stdout:3320 trunc from 0x71e0e00 to 0x4a76c00 2024-09-14T09:08:25.300 INFO:teuthology.orchestra.run.smithi148.stdout:3322 write 0xd726000 thru 0xd72c901 (0x6902 bytes) 2024-09-14T09:08:25.305 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:25.305 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:25.305 INFO:teuthology.orchestra.run.smithi148.stdout:3323 write 0x6360800 thru 0x6364449 (0x3c4a bytes) 2024-09-14T09:08:25.306 INFO:teuthology.orchestra.run.smithi148.stdout:3326 read 0x6212a00 thru 0x621a9bc (0x7fbd bytes) 2024-09-14T09:08:25.309 INFO:teuthology.orchestra.run.smithi148.stdout:3328 trunc from 0xd72ca00 to 0xae6ce00 2024-09-14T09:08:25.315 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:08:25.325 INFO:teuthology.orchestra.run.smithi148.stdout:3331 write 0x38c8e00 thru 0x38d6388 (0xd589 bytes) 2024-09-14T09:08:25.327 INFO:teuthology.orchestra.run.smithi148.stdout:3333 read 0x45a7800 thru 0x45abc7d (0x447e bytes) 2024-09-14T09:08:25.327 INFO:teuthology.orchestra.run.smithi148.stdout:3338 write 0x8ded200 thru 0x8df7e02 (0xac03 bytes) 2024-09-14T09:08:25.328 INFO:teuthology.orchestra.run.smithi148.stdout:3339 punch from 0x20f7400 to 0x2106e00, (0xfa00 bytes) 2024-09-14T09:08:25.328 INFO:teuthology.orchestra.run.smithi148.stdout:3340 clone 20 order 24 su 65536 sc 14 2024-09-14T09:08:25.356 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:25.358+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:25.435 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:25.437+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:25.458 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:25.458 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:25.466 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:08:25.536 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:25.537+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:25.610 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:25.610 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:25.619 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:08:25.637 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:25.638+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:25.722 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:25.722 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:25.730 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:08:25.774 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:25.776+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:25.833 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:25.833 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:25.838 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:25.839+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:25.841 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:08:25.904 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is unset 2024-09-14T09:08:25.939 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:25.941+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:25.967 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T09:08:25.967 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:08:25.968 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-14T09:08:25.968 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 3.0 2024-09-14T09:08:25.979 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone19 from 0xae6ce00 (overlap 0x9ab600) to 0x5cd200 2024-09-14T09:08:26.008 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:26.008 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:26.019 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:08:26.061 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:26.063+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:26.141 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:26.143+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:26.168 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:26.169 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:26.178 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:08:26.188 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:08:26.265 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:26.267+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:26.287 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:26.287 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:26.297 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:08:26.333 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #18, image image_client.0-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent19 2024-09-14T09:08:26.342 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:26.344+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:26.351 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:26.352 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:26.377 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:26.378 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:26.398 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:08:26.398 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:08:26.420 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:26.420 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:26.444 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:26.445+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:26.452 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:26.452 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:26.485 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:26.485 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:26.486 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:26.486 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:26.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:26.486 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:26.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.486 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4604.0:364 3.1d 3:bb0fb96d:::rbd_data.1112609a9334.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 28633088~35328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-14T09:08:26.486 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:04.667444+0000", 2024-09-14T09:08:26.486 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.819332640999999, 2024-09-14T09:08:26.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052308081999999999, 2024-09-14T09:08:26.487 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:26.487 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:26.487 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:26.487 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:26.487 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4604", 2024-09-14T09:08:26.487 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/335524879", 2024-09-14T09:08:26.487 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 364 2024-09-14T09:08:26.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.487 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:26.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:26.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.667444+0000", 2024-09-14T09:08:26.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:26.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.667444+0000", 2024-09-14T09:08:26.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:26.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.667445+0000", 2024-09-14T09:08:26.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1999999999999998e-07 2024-09-14T09:08:26.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:26.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681087+0000", 2024-09-14T09:08:26.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013641863000000001 2024-09-14T09:08:26.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:26.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681113+0000", 2024-09-14T09:08:26.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6310000000000001e-05 2024-09-14T09:08:26.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681123+0000", 2024-09-14T09:08:26.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7289999999999995e-06 2024-09-14T09:08:26.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:26.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681203+0000", 2024-09-14T09:08:26.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0628000000000001e-05 2024-09-14T09:08:26.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:26.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681323+0000", 2024-09-14T09:08:26.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000119722 2024-09-14T09:08:26.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:26.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.682203+0000", 2024-09-14T09:08:26.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00087938299999999997 2024-09-14T09:08:26.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:26.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719043+0000", 2024-09-14T09:08:26.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036840218000000001 2024-09-14T09:08:26.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:26.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719654+0000", 2024-09-14T09:08:26.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00061077199999999999 2024-09-14T09:08:26.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:26.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719698+0000", 2024-09-14T09:08:26.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4177000000000001e-05 2024-09-14T09:08:26.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:26.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719752+0000", 2024-09-14T09:08:26.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4459999999999997e-05 2024-09-14T09:08:26.492 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.492 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:26.493 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.493 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7885 3.1e 3:79089f6b:::rbd_data.11123620c885.0000000000000002:12 [read 256000~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:26.493 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075571+0000", 2024-09-14T09:08:26.493 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.4112056800000001, 2024-09-14T09:08:26.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036029795000000003, 2024-09-14T09:08:26.493 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:26.493 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:26.493 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:26.493 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:26.493 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:26.494 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:26.494 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7885 2024-09-14T09:08:26.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.494 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:26.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:26.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075571+0000", 2024-09-14T09:08:26.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:26.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075571+0000", 2024-09-14T09:08:26.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:26.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075571+0000", 2024-09-14T09:08:26.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.01e-07 2024-09-14T09:08:26.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:26.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075573+0000", 2024-09-14T09:08:26.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6789999999999999e-06 2024-09-14T09:08:26.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:26.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075579+0000", 2024-09-14T09:08:26.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6489999999999996e-06 2024-09-14T09:08:26.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075584+0000", 2024-09-14T09:08:26.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7530000000000001e-06 2024-09-14T09:08:26.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:26.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111315+0000", 2024-09-14T09:08:26.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035731375000000003 2024-09-14T09:08:26.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:26.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111421+0000", 2024-09-14T09:08:26.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106124 2024-09-14T09:08:26.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:26.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111601+0000", 2024-09-14T09:08:26.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017981400000000001 2024-09-14T09:08:26.497 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.497 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:26.497 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.498 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7958 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 4096~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:26.498 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075911+0000", 2024-09-14T09:08:26.498 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.4108656149999996, 2024-09-14T09:08:26.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035748988000000002, 2024-09-14T09:08:26.498 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:26.498 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:26.498 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:26.498 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:26.498 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:26.498 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:26.498 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7958 2024-09-14T09:08:26.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.498 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:26.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:26.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075911+0000", 2024-09-14T09:08:26.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:26.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075911+0000", 2024-09-14T09:08:26.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:26.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075911+0000", 2024-09-14T09:08:26.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0800000000000001e-07 2024-09-14T09:08:26.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:26.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075917+0000", 2024-09-14T09:08:26.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0800000000000002e-06 2024-09-14T09:08:26.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:26.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075921+0000", 2024-09-14T09:08:26.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7610000000000001e-06 2024-09-14T09:08:26.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075924+0000", 2024-09-14T09:08:26.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5349999999999999e-06 2024-09-14T09:08:26.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:26.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111099+0000", 2024-09-14T09:08:26.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035175728000000003 2024-09-14T09:08:26.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:26.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111185+0000", 2024-09-14T09:08:26.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5185000000000005e-05 2024-09-14T09:08:26.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:26.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111660+0000", 2024-09-14T09:08:26.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00047549099999999998 2024-09-14T09:08:26.502 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.502 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:26.502 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.502 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7959 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 14336~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:26.502 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075927+0000", 2024-09-14T09:08:26.502 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.4108495229999996, 2024-09-14T09:08:26.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036277579999999997, 2024-09-14T09:08:26.503 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:26.503 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:26.503 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:26.503 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:26.503 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:26.503 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:26.503 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7959 2024-09-14T09:08:26.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.503 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:26.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:26.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075927+0000", 2024-09-14T09:08:26.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:26.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075927+0000", 2024-09-14T09:08:26.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:26.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075927+0000", 2024-09-14T09:08:26.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4200000000000002e-07 2024-09-14T09:08:26.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:26.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075929+0000", 2024-09-14T09:08:26.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0750000000000001e-06 2024-09-14T09:08:26.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:26.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075931+0000", 2024-09-14T09:08:26.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8289999999999999e-06 2024-09-14T09:08:26.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075934+0000", 2024-09-14T09:08:26.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.525e-06 2024-09-14T09:08:26.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:26.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111692+0000", 2024-09-14T09:08:26.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035757780000000003 2024-09-14T09:08:26.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:26.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111772+0000", 2024-09-14T09:08:26.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0173999999999995e-05 2024-09-14T09:08:26.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:26.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112205+0000", 2024-09-14T09:08:26.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000432955 2024-09-14T09:08:26.506 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.506 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:26.506 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.507 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7960 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 40960~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:26.507 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075937+0000", 2024-09-14T09:08:26.507 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.410839696, 2024-09-14T09:08:26.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036668890000000003, 2024-09-14T09:08:26.507 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:26.507 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:26.507 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:26.507 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:26.507 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:26.507 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:26.508 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7960 2024-09-14T09:08:26.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.508 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:26.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:26.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075937+0000", 2024-09-14T09:08:26.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:26.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075937+0000", 2024-09-14T09:08:26.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:26.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075937+0000", 2024-09-14T09:08:26.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:08:26.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:26.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075938+0000", 2024-09-14T09:08:26.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4900000000000004e-07 2024-09-14T09:08:26.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:26.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075941+0000", 2024-09-14T09:08:26.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7199999999999998e-06 2024-09-14T09:08:26.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075944+0000", 2024-09-14T09:08:26.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6850000000000001e-06 2024-09-14T09:08:26.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:26.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112243+0000", 2024-09-14T09:08:26.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036299512999999999 2024-09-14T09:08:26.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:26.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112343+0000", 2024-09-14T09:08:26.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9722000000000005e-05 2024-09-14T09:08:26.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:26.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112606+0000", 2024-09-14T09:08:26.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026292600000000002 2024-09-14T09:08:26.511 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.511 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:26.511 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.511 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7961 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 51200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:26.512 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075947+0000", 2024-09-14T09:08:26.512 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.4108301130000003, 2024-09-14T09:08:26.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037048949999999997, 2024-09-14T09:08:26.512 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:26.512 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:26.512 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:26.512 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:26.512 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:26.512 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:26.512 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7961 2024-09-14T09:08:26.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.512 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:26.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:26.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075947+0000", 2024-09-14T09:08:26.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:26.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075947+0000", 2024-09-14T09:08:26.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:26.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075947+0000", 2024-09-14T09:08:26.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.05e-07 2024-09-14T09:08:26.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:26.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075948+0000", 2024-09-14T09:08:26.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.28e-06 2024-09-14T09:08:26.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:26.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075951+0000", 2024-09-14T09:08:26.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7829999999999999e-06 2024-09-14T09:08:26.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075953+0000", 2024-09-14T09:08:26.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5239999999999999e-06 2024-09-14T09:08:26.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:26.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112642+0000", 2024-09-14T09:08:26.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036688193000000001 2024-09-14T09:08:26.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:26.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112741+0000", 2024-09-14T09:08:26.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9816999999999997e-05 2024-09-14T09:08:26.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:26.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112996+0000", 2024-09-14T09:08:26.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025414799999999999 2024-09-14T09:08:26.516 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.516 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:26.516 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.516 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7962 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 61440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:26.516 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075956+0000", 2024-09-14T09:08:26.516 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.4108204969999996, 2024-09-14T09:08:26.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037427290000000002, 2024-09-14T09:08:26.516 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:26.516 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:26.516 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:26.517 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:26.517 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:26.517 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:26.517 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7962 2024-09-14T09:08:26.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.517 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:26.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:26.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075956+0000", 2024-09-14T09:08:26.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:26.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075956+0000", 2024-09-14T09:08:26.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:26.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075956+0000", 2024-09-14T09:08:26.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:08:26.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:26.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075958+0000", 2024-09-14T09:08:26.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.102e-06 2024-09-14T09:08:26.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:26.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075968+0000", 2024-09-14T09:08:26.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0774000000000001e-05 2024-09-14T09:08:26.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075973+0000", 2024-09-14T09:08:26.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6809999999999997e-06 2024-09-14T09:08:26.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:26.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113030+0000", 2024-09-14T09:08:26.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037057198999999999 2024-09-14T09:08:26.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:26.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113127+0000", 2024-09-14T09:08:26.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7094000000000002e-05 2024-09-14T09:08:26.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:26.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113384+0000", 2024-09-14T09:08:26.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025623099999999999 2024-09-14T09:08:26.520 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.521 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:26.521 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.521 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7963 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 71680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:26.521 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075980+0000", 2024-09-14T09:08:26.521 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.410796511, 2024-09-14T09:08:26.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037742675000000003, 2024-09-14T09:08:26.521 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:26.521 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:26.521 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:26.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:26.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:26.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:26.521 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7963 2024-09-14T09:08:26.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.522 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:26.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:26.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075980+0000", 2024-09-14T09:08:26.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:26.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075980+0000", 2024-09-14T09:08:26.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:26.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075981+0000", 2024-09-14T09:08:26.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0299999999999999e-07 2024-09-14T09:08:26.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:26.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075983+0000", 2024-09-14T09:08:26.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.886e-06 2024-09-14T09:08:26.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:26.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075989+0000", 2024-09-14T09:08:26.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9499999999999998e-06 2024-09-14T09:08:26.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075993+0000", 2024-09-14T09:08:26.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2740000000000001e-06 2024-09-14T09:08:26.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:26.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113413+0000", 2024-09-14T09:08:26.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037420417999999997 2024-09-14T09:08:26.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:26.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113508+0000", 2024-09-14T09:08:26.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4636999999999995e-05 2024-09-14T09:08:26.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:26.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113723+0000", 2024-09-14T09:08:26.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000215007 2024-09-14T09:08:26.525 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.525 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:26.525 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.525 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7964 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 98304~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:26.525 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075999+0000", 2024-09-14T09:08:26.525 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.4107782310000001, 2024-09-14T09:08:26.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038103415000000002, 2024-09-14T09:08:26.525 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:26.525 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:26.526 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:26.526 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:26.526 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:26.526 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:26.526 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7964 2024-09-14T09:08:26.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.526 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:26.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:26.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075999+0000", 2024-09-14T09:08:26.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:26.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075999+0000", 2024-09-14T09:08:26.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:26.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075999+0000", 2024-09-14T09:08:26.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6399999999999998e-07 2024-09-14T09:08:26.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:26.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076001+0000", 2024-09-14T09:08:26.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7999999999999999e-06 2024-09-14T09:08:26.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:26.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076005+0000", 2024-09-14T09:08:26.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3309999999999997e-06 2024-09-14T09:08:26.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076008+0000", 2024-09-14T09:08:26.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-06 2024-09-14T09:08:26.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:26.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113768+0000", 2024-09-14T09:08:26.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037760295999999999 2024-09-14T09:08:26.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:26.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113854+0000", 2024-09-14T09:08:26.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6030000000000001e-05 2024-09-14T09:08:26.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:26.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114102+0000", 2024-09-14T09:08:26.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024789000000000001 2024-09-14T09:08:26.529 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.529 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:26.529 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.529 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7965 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 108544~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:26.530 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076011+0000", 2024-09-14T09:08:26.530 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.4107657619999996, 2024-09-14T09:08:26.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038452854000000002, 2024-09-14T09:08:26.530 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:26.530 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:26.530 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:26.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:26.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:26.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:26.530 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7965 2024-09-14T09:08:26.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.530 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:26.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:26.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076011+0000", 2024-09-14T09:08:26.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:26.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076011+0000", 2024-09-14T09:08:26.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:26.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076011+0000", 2024-09-14T09:08:26.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1899999999999999e-07 2024-09-14T09:08:26.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:26.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076012+0000", 2024-09-14T09:08:26.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0610000000000001e-06 2024-09-14T09:08:26.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:26.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076015+0000", 2024-09-14T09:08:26.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8380000000000002e-06 2024-09-14T09:08:26.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076018+0000", 2024-09-14T09:08:26.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.458e-06 2024-09-14T09:08:26.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:26.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114136+0000", 2024-09-14T09:08:26.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038118217000000003 2024-09-14T09:08:26.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:26.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114218+0000", 2024-09-14T09:08:26.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2496000000000004e-05 2024-09-14T09:08:26.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:26.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114464+0000", 2024-09-14T09:08:26.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000245565 2024-09-14T09:08:26.534 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.534 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:26.534 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.534 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7966 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 118784~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:26.534 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076020+0000", 2024-09-14T09:08:26.534 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.4107564870000004, 2024-09-14T09:08:26.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038813976, 2024-09-14T09:08:26.534 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:26.534 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:26.534 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:26.535 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:26.535 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:26.535 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:26.535 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7966 2024-09-14T09:08:26.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.535 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:26.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:26.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076020+0000", 2024-09-14T09:08:26.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:26.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076020+0000", 2024-09-14T09:08:26.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:26.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076020+0000", 2024-09-14T09:08:26.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1199999999999999e-07 2024-09-14T09:08:26.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:26.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076022+0000", 2024-09-14T09:08:26.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0610000000000001e-06 2024-09-14T09:08:26.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:26.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076025+0000", 2024-09-14T09:08:26.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4189999999999998e-06 2024-09-14T09:08:26.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076028+0000", 2024-09-14T09:08:26.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9909999999999998e-06 2024-09-14T09:08:26.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:26.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114497+0000", 2024-09-14T09:08:26.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038469376999999999 2024-09-14T09:08:26.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:26.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114596+0000", 2024-09-14T09:08:26.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8978e-05 2024-09-14T09:08:26.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:26.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114834+0000", 2024-09-14T09:08:26.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023793800000000001 2024-09-14T09:08:26.538 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.539 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:26.539 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.539 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7967 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 129024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:26.539 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076031+0000", 2024-09-14T09:08:26.539 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.4107459740000001, 2024-09-14T09:08:26.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039142059, 2024-09-14T09:08:26.539 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:26.539 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:26.539 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:26.539 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:26.539 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:26.540 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:26.540 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7967 2024-09-14T09:08:26.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.540 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:26.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:26.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076031+0000", 2024-09-14T09:08:26.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:26.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076031+0000", 2024-09-14T09:08:26.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:26.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076031+0000", 2024-09-14T09:08:26.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.11e-07 2024-09-14T09:08:26.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:26.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076032+0000", 2024-09-14T09:08:26.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.037e-06 2024-09-14T09:08:26.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:26.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076035+0000", 2024-09-14T09:08:26.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7389999999999999e-06 2024-09-14T09:08:26.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076038+0000", 2024-09-14T09:08:26.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3780000000000001e-06 2024-09-14T09:08:26.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:26.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114868+0000", 2024-09-14T09:08:26.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038829977000000002 2024-09-14T09:08:26.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:26.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114972+0000", 2024-09-14T09:08:26.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010364100000000001 2024-09-14T09:08:26.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:26.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115173+0000", 2024-09-14T09:08:26.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020107600000000001 2024-09-14T09:08:26.543 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.543 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:26.543 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.544 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7968 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 155648~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:26.544 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076041+0000", 2024-09-14T09:08:26.544 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.4107356729999996, 2024-09-14T09:08:26.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039346991999999997, 2024-09-14T09:08:26.544 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:26.544 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:26.544 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:26.544 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:26.544 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:26.544 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:26.544 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7968 2024-09-14T09:08:26.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.545 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:26.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:26.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076041+0000", 2024-09-14T09:08:26.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:26.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076041+0000", 2024-09-14T09:08:26.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:26.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076041+0000", 2024-09-14T09:08:26.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0100000000000001e-07 2024-09-14T09:08:26.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:26.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076042+0000", 2024-09-14T09:08:26.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0380000000000001e-06 2024-09-14T09:08:26.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:26.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076045+0000", 2024-09-14T09:08:26.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7250000000000002e-06 2024-09-14T09:08:26.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076047+0000", 2024-09-14T09:08:26.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4600000000000002e-06 2024-09-14T09:08:26.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:26.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115220+0000", 2024-09-14T09:08:26.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039172430000000001 2024-09-14T09:08:26.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:26.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115316+0000", 2024-09-14T09:08:26.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5712999999999997e-05 2024-09-14T09:08:26.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:26.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115388+0000", 2024-09-14T09:08:26.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2424999999999999e-05 2024-09-14T09:08:26.548 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.548 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:26.549 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.549 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7969 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 165888~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:26.549 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076050+0000", 2024-09-14T09:08:26.549 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.4107264490000002, 2024-09-14T09:08:26.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039616993000000003, 2024-09-14T09:08:26.549 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:26.549 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:26.549 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:26.549 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:26.549 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:26.550 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:26.550 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7969 2024-09-14T09:08:26.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.550 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:26.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:26.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076050+0000", 2024-09-14T09:08:26.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:26.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076050+0000", 2024-09-14T09:08:26.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:26.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076050+0000", 2024-09-14T09:08:26.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0699999999999999e-07 2024-09-14T09:08:26.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:26.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076051+0000", 2024-09-14T09:08:26.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0049999999999999e-06 2024-09-14T09:08:26.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:26.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076054+0000", 2024-09-14T09:08:26.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7800000000000001e-06 2024-09-14T09:08:26.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076057+0000", 2024-09-14T09:08:26.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5450000000000002e-06 2024-09-14T09:08:26.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:26.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115430+0000", 2024-09-14T09:08:26.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039373506000000003 2024-09-14T09:08:26.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:26.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115509+0000", 2024-09-14T09:08:26.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8276999999999996e-05 2024-09-14T09:08:26.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:26.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115667+0000", 2024-09-14T09:08:26.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015867299999999999 2024-09-14T09:08:26.553 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.553 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:26.553 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.553 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7970 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 176128~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:26.553 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076060+0000", 2024-09-14T09:08:26.553 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.4107171870000004, 2024-09-14T09:08:26.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039793765000000002, 2024-09-14T09:08:26.554 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:26.554 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:26.554 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:26.554 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:26.554 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:26.554 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:26.554 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7970 2024-09-14T09:08:26.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.554 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:26.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:26.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076060+0000", 2024-09-14T09:08:26.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:26.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076060+0000", 2024-09-14T09:08:26.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:26.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076060+0000", 2024-09-14T09:08:26.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:08:26.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:26.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076064+0000", 2024-09-14T09:08:26.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3930000000000001e-06 2024-09-14T09:08:26.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:26.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076067+0000", 2024-09-14T09:08:26.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9809999999999999e-06 2024-09-14T09:08:26.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076070+0000", 2024-09-14T09:08:26.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6010000000000002e-06 2024-09-14T09:08:26.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:26.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115699+0000", 2024-09-14T09:08:26.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039629659999999997 2024-09-14T09:08:26.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:26.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115785+0000", 2024-09-14T09:08:26.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5109000000000001e-05 2024-09-14T09:08:26.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:26.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115853+0000", 2024-09-14T09:08:26.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8812000000000005e-05 2024-09-14T09:08:26.557 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.557 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:26.557 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.558 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7971 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 186368~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:26.558 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076073+0000", 2024-09-14T09:08:26.558 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.4107041139999996, 2024-09-14T09:08:26.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039977828, 2024-09-14T09:08:26.558 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:26.558 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:26.558 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:26.558 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:26.558 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:26.558 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:26.558 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7971 2024-09-14T09:08:26.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.558 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:26.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:26.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076073+0000", 2024-09-14T09:08:26.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:26.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076073+0000", 2024-09-14T09:08:26.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:26.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076073+0000", 2024-09-14T09:08:26.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1500000000000001e-07 2024-09-14T09:08:26.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:26.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076074+0000", 2024-09-14T09:08:26.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4499999999999995e-07 2024-09-14T09:08:26.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:26.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076077+0000", 2024-09-14T09:08:26.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.785e-06 2024-09-14T09:08:26.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076079+0000", 2024-09-14T09:08:26.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6129999999999998e-06 2024-09-14T09:08:26.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:26.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115884+0000", 2024-09-14T09:08:26.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039805261000000002 2024-09-14T09:08:26.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:26.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115973+0000", 2024-09-14T09:08:26.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8381999999999995e-05 2024-09-14T09:08:26.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:26.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116050+0000", 2024-09-14T09:08:26.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7626999999999994e-05 2024-09-14T09:08:26.562 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.562 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:26.562 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.562 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7972 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 212992~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:26.562 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076082+0000", 2024-09-14T09:08:26.563 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.410694694, 2024-09-14T09:08:26.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040162654999999998, 2024-09-14T09:08:26.563 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:26.563 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:26.563 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:26.563 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:26.563 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:26.563 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:26.563 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7972 2024-09-14T09:08:26.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.563 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:26.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:26.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076082+0000", 2024-09-14T09:08:26.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:26.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076082+0000", 2024-09-14T09:08:26.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:26.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076082+0000", 2024-09-14T09:08:26.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3099999999999999e-07 2024-09-14T09:08:26.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:26.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076083+0000", 2024-09-14T09:08:26.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.64e-07 2024-09-14T09:08:26.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:26.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076086+0000", 2024-09-14T09:08:26.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7539999999999998e-06 2024-09-14T09:08:26.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076089+0000", 2024-09-14T09:08:26.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5409999999999999e-06 2024-09-14T09:08:26.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:26.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116091+0000", 2024-09-14T09:08:26.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040002204 2024-09-14T09:08:26.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:26.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116172+0000", 2024-09-14T09:08:26.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0833000000000003e-05 2024-09-14T09:08:26.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:26.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116245+0000", 2024-09-14T09:08:26.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3127999999999995e-05 2024-09-14T09:08:26.567 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.567 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:26.567 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.567 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7973 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 223232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:26.567 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076091+0000", 2024-09-14T09:08:26.567 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.4106853279999996, 2024-09-14T09:08:26.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040345740999999997, 2024-09-14T09:08:26.567 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:26.568 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:26.568 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:26.568 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:26.568 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:26.568 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:26.568 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7973 2024-09-14T09:08:26.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.568 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:26.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:26.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076091+0000", 2024-09-14T09:08:26.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:26.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076091+0000", 2024-09-14T09:08:26.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:26.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076092+0000", 2024-09-14T09:08:26.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7300000000000002e-07 2024-09-14T09:08:26.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:26.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076093+0000", 2024-09-14T09:08:26.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0300000000000001e-06 2024-09-14T09:08:26.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:26.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076096+0000", 2024-09-14T09:08:26.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6049999999999998e-06 2024-09-14T09:08:26.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076099+0000", 2024-09-14T09:08:26.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8569999999999999e-06 2024-09-14T09:08:26.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:26.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116287+0000", 2024-09-14T09:08:26.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040187753 2024-09-14T09:08:26.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:26.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116370+0000", 2024-09-14T09:08:26.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2509000000000006e-05 2024-09-14T09:08:26.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:26.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116437+0000", 2024-09-14T09:08:26.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7613999999999993e-05 2024-09-14T09:08:26.572 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.572 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:26.572 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.572 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7974 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 233472~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:26.572 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076102+0000", 2024-09-14T09:08:26.572 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.4106745790000002, 2024-09-14T09:08:26.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040515104000000003, 2024-09-14T09:08:26.573 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:26.573 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:26.573 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:26.573 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:26.573 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:26.573 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:26.573 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7974 2024-09-14T09:08:26.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.573 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:26.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:26.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076102+0000", 2024-09-14T09:08:26.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:26.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076102+0000", 2024-09-14T09:08:26.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:26.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076102+0000", 2024-09-14T09:08:26.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.04e-07 2024-09-14T09:08:26.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:26.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076103+0000", 2024-09-14T09:08:26.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.02e-06 2024-09-14T09:08:26.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:26.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076106+0000", 2024-09-14T09:08:26.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7499999999999999e-06 2024-09-14T09:08:26.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076109+0000", 2024-09-14T09:08:26.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3510000000000002e-06 2024-09-14T09:08:26.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:26.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116469+0000", 2024-09-14T09:08:26.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040359095999999997 2024-09-14T09:08:26.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:26.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116547+0000", 2024-09-14T09:08:26.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8509000000000003e-05 2024-09-14T09:08:26.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:26.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116617+0000", 2024-09-14T09:08:26.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0173999999999996e-05 2024-09-14T09:08:26.580 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.580 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:26.580 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.580 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7975 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 243712~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:26.581 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076113+0000", 2024-09-14T09:08:26.581 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.4106641179999997, 2024-09-14T09:08:26.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040678662999999997, 2024-09-14T09:08:26.581 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:26.581 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:26.582 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:26.582 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:26.582 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:26.582 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:26.582 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7975 2024-09-14T09:08:26.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.583 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:26.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:26.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076113+0000", 2024-09-14T09:08:26.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:26.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076113+0000", 2024-09-14T09:08:26.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:26.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:26.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076113+0000", 2024-09-14T09:08:26.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.34e-07 2024-09-14T09:08:26.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:26.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076114+0000", 2024-09-14T09:08:26.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0410000000000001e-06 2024-09-14T09:08:26.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:26.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076117+0000", 2024-09-14T09:08:26.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7870000000000002e-06 2024-09-14T09:08:26.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076121+0000", 2024-09-14T09:08:26.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1489999999999996e-06 2024-09-14T09:08:26.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:26.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116645+0000", 2024-09-14T09:08:26.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040523851999999999 2024-09-14T09:08:26.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:26.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116725+0000", 2024-09-14T09:08:26.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9985000000000001e-05 2024-09-14T09:08:26.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:26.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:26.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:26.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116791+0000", 2024-09-14T09:08:26.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6614999999999998e-05 2024-09-14T09:08:26.588 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.588 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:26.588 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.588 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:26.588 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:26.588 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:26.589 INFO:teuthology.orchestra.run.smithi148.stdout:3342 clone 21 order 24 su 4194304 sc 11 2024-09-14T09:08:26.590 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:08:26.591 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:26.592+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:26.690 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:26.692+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:26.694 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:26.694 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:26.695 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:26.695 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:26.703 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:08:26.791 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:26.794+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:26.805 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:26.805 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:26.805 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:26.805 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:26.805 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:26.814 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:08:26.892 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:26.894+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:26.908 INFO:teuthology.orchestra.run.smithi116.stdout:moved 7 / 82 (8.53659%) 2024-09-14T09:08:26.908 INFO:teuthology.orchestra.run.smithi116.stdout:avg 13.6667 2024-09-14T09:08:26.908 INFO:teuthology.orchestra.run.smithi116.stdout:stddev 2.62467 -> 1.49071 (expected baseline 3.37474) 2024-09-14T09:08:26.909 INFO:teuthology.orchestra.run.smithi116.stdout:min osd.4 with 10 -> 12 pgs (0.731707 -> 0.878049 * mean) 2024-09-14T09:08:26.909 INFO:teuthology.orchestra.run.smithi116.stdout:max osd.0 with 18 -> 12 pgs (1.31707 -> 0.878049 * mean) 2024-09-14T09:08:26.909 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:08:26.909 INFO:teuthology.orchestra.run.smithi116.stdout:oload 110 2024-09-14T09:08:26.909 INFO:teuthology.orchestra.run.smithi116.stdout:max_change 3 2024-09-14T09:08:26.909 INFO:teuthology.orchestra.run.smithi116.stdout:max_change_osds 4 2024-09-14T09:08:26.909 INFO:teuthology.orchestra.run.smithi116.stdout:average_utilization 0.0006 2024-09-14T09:08:26.909 INFO:teuthology.orchestra.run.smithi116.stdout:overload_utilization 0.0006 2024-09-14T09:08:26.909 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0 weight 1.0000 -> 0.7755 2024-09-14T09:08:26.909 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2 weight 1.0000 -> 0.8648 2024-09-14T09:08:26.921 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:26.922 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:26.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:26.922 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:26.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.922 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4671.0:2457 3.15 e36/22 3:ab68b81a:::rbd_data.1112ca7492e7.000000000000006c:head v 36'61, mlcod=35'58)", 2024-09-14T09:08:26.922 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.895311+0000", 2024-09-14T09:08:26.922 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.027428115999999, 2024-09-14T09:08:26.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063523160000000002, 2024-09-14T09:08:26.922 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:26.922 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:26.922 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:26.923 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:26.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:26.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895311+0000", 2024-09-14T09:08:26.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:26.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895311+0000", 2024-09-14T09:08:26.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:26.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895311+0000", 2024-09-14T09:08:26.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5100000000000001e-07 2024-09-14T09:08:26.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:26.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895317+0000", 2024-09-14T09:08:26.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.533e-06 2024-09-14T09:08:26.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:26.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895324+0000", 2024-09-14T09:08:26.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6039999999999998e-06 2024-09-14T09:08:26.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895329+0000", 2024-09-14T09:08:26.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6489999999999999e-06 2024-09-14T09:08:26.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:26.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895431+0000", 2024-09-14T09:08:26.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102632 2024-09-14T09:08:26.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:26.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895450+0000", 2024-09-14T09:08:26.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8929000000000001e-05 2024-09-14T09:08:26.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:26.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901619+0000", 2024-09-14T09:08:26.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061693399999999997 2024-09-14T09:08:26.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:26.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901663+0000", 2024-09-14T09:08:26.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3377999999999997e-05 2024-09-14T09:08:26.926 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.926 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:26.926 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.927 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4671.0:2459 3.2 e36/22 3:477686f7:::rbd_data.1112ca7492e7.000000000000006d:head v 36'16, mlcod=35'11)", 2024-09-14T09:08:26.927 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.895770+0000", 2024-09-14T09:08:26.927 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.026968278999998, 2024-09-14T09:08:26.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058664190000000003, 2024-09-14T09:08:26.927 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:26.927 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:26.927 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:26.927 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:26.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:26.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895770+0000", 2024-09-14T09:08:26.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:26.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895770+0000", 2024-09-14T09:08:26.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:26.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895771+0000", 2024-09-14T09:08:26.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8500000000000001e-07 2024-09-14T09:08:26.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:26.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895776+0000", 2024-09-14T09:08:26.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3449999999999996e-06 2024-09-14T09:08:26.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:26.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895785+0000", 2024-09-14T09:08:26.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9930000000000001e-06 2024-09-14T09:08:26.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895792+0000", 2024-09-14T09:08:26.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3269999999999997e-06 2024-09-14T09:08:26.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:26.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895836+0000", 2024-09-14T09:08:26.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4474999999999997e-05 2024-09-14T09:08:26.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:26.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895855+0000", 2024-09-14T09:08:26.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8709999999999999e-05 2024-09-14T09:08:26.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:26.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901599+0000", 2024-09-14T09:08:26.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0057440019999999998 2024-09-14T09:08:26.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:26.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901637+0000", 2024-09-14T09:08:26.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7882000000000001e-05 2024-09-14T09:08:26.931 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.931 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:26.931 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.931 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4671.0:2452 3.5 e36/22 3:a0dd09af:::rbd_data.1112ca7492e7.0000000000000069:head v 36'120, mlcod=35'115)", 2024-09-14T09:08:26.931 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.896937+0000", 2024-09-14T09:08:26.931 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.025801936000001, 2024-09-14T09:08:26.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050325939999999996, 2024-09-14T09:08:26.931 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:26.931 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:26.931 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:26.931 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:26.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:26.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896937+0000", 2024-09-14T09:08:26.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:26.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896937+0000", 2024-09-14T09:08:26.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:26.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896937+0000", 2024-09-14T09:08:26.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6799999999999999e-07 2024-09-14T09:08:26.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:26.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896946+0000", 2024-09-14T09:08:26.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.799e-06 2024-09-14T09:08:26.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:26.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896959+0000", 2024-09-14T09:08:26.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.308e-05 2024-09-14T09:08:26.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896967+0000", 2024-09-14T09:08:26.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1679999999999998e-06 2024-09-14T09:08:26.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:26.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.897028+0000", 2024-09-14T09:08:26.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1958000000000005e-05 2024-09-14T09:08:26.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:26.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.897049+0000", 2024-09-14T09:08:26.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0468000000000001e-05 2024-09-14T09:08:26.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:26.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901929+0000", 2024-09-14T09:08:26.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048796610000000004 2024-09-14T09:08:26.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:26.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901969+0000", 2024-09-14T09:08:26.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0692000000000003e-05 2024-09-14T09:08:26.935 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.935 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:26.935 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.936 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4782.0:403 3.1b 3:db2c1e17:::rbd_data.11127a12d636.0000000000000013:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,truncate 3920384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-14T09:08:26.936 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:09.334287+0000", 2024-09-14T09:08:26.936 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.588451926000001, 2024-09-14T09:08:26.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004490529, 2024-09-14T09:08:26.936 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:26.936 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:26.936 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:26.936 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:26.936 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4782", 2024-09-14T09:08:26.936 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/353415140", 2024-09-14T09:08:26.936 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 403 2024-09-14T09:08:26.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.936 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:26.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:26.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334287+0000", 2024-09-14T09:08:26.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:26.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334287+0000", 2024-09-14T09:08:26.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:26.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334288+0000", 2024-09-14T09:08:26.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2860000000000001e-06 2024-09-14T09:08:26.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:26.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334294+0000", 2024-09-14T09:08:26.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8119999999999996e-06 2024-09-14T09:08:26.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:26.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334305+0000", 2024-09-14T09:08:26.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0710000000000001e-05 2024-09-14T09:08:26.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334310+0000", 2024-09-14T09:08:26.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1309999999999997e-06 2024-09-14T09:08:26.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:26.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334355+0000", 2024-09-14T09:08:26.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5002e-05 2024-09-14T09:08:26.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:26.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334441+0000", 2024-09-14T09:08:26.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6632999999999995e-05 2024-09-14T09:08:26.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:26.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334550+0000", 2024-09-14T09:08:26.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010870999999999999 2024-09-14T09:08:26.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:26.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334949+0000", 2024-09-14T09:08:26.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00039932800000000001 2024-09-14T09:08:26.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:26.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.338702+0000", 2024-09-14T09:08:26.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037526529999999999 2024-09-14T09:08:26.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:26.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.338749+0000", 2024-09-14T09:08:26.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6579999999999998e-05 2024-09-14T09:08:26.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:26.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.338777+0000", 2024-09-14T09:08:26.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8683999999999998e-05 2024-09-14T09:08:26.941 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.941 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:26.941 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.941 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4782.0:881 3.1b 3:d82d5c58:::rbd_data.11127a12d636.000000000000000b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,truncate 4063232] snapc f=[f] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T09:08:26.941 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:09.937996+0000", 2024-09-14T09:08:26.941 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.984743075000001, 2024-09-14T09:08:26.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0081376629999999998, 2024-09-14T09:08:26.942 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:26.942 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:26.942 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:26.942 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:26.942 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4782", 2024-09-14T09:08:26.942 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/353415140", 2024-09-14T09:08:26.942 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 881 2024-09-14T09:08:26.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.942 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:26.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:26.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.937996+0000", 2024-09-14T09:08:26.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:26.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.937996+0000", 2024-09-14T09:08:26.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:26.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.937997+0000", 2024-09-14T09:08:26.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2419999999999999e-06 2024-09-14T09:08:26.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:26.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938002+0000", 2024-09-14T09:08:26.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3870000000000003e-06 2024-09-14T09:08:26.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:26.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938014+0000", 2024-09-14T09:08:26.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.22e-05 2024-09-14T09:08:26.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938020+0000", 2024-09-14T09:08:26.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9619999999999998e-06 2024-09-14T09:08:26.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:26.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938062+0000", 2024-09-14T09:08:26.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2150000000000001e-05 2024-09-14T09:08:26.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:26.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938156+0000", 2024-09-14T09:08:26.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3344999999999995e-05 2024-09-14T09:08:26.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:26.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938275+0000", 2024-09-14T09:08:26.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000118983 2024-09-14T09:08:26.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:26.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941256+0000", 2024-09-14T09:08:26.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002981151 2024-09-14T09:08:26.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:26.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.946065+0000", 2024-09-14T09:08:26.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048087190000000004 2024-09-14T09:08:26.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:26.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.946104+0000", 2024-09-14T09:08:26.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9363000000000002e-05 2024-09-14T09:08:26.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:26.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.946133+0000", 2024-09-14T09:08:26.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9161000000000001e-05 2024-09-14T09:08:26.947 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.947 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:26.947 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.947 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4782.0:883 3.1b 3:de177a91:::rbd_data.11127a12d636.000000000000000d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T09:08:26.947 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:09.940054+0000", 2024-09-14T09:08:26.947 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.982684205999998, 2024-09-14T09:08:26.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080861400000000003, 2024-09-14T09:08:26.947 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:26.948 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:26.948 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:26.948 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:26.948 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4782", 2024-09-14T09:08:26.948 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/353415140", 2024-09-14T09:08:26.948 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 883 2024-09-14T09:08:26.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.948 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:26.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:26.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.940054+0000", 2024-09-14T09:08:26.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:26.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.940054+0000", 2024-09-14T09:08:26.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:26.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.940055+0000", 2024-09-14T09:08:26.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5899999999999995e-07 2024-09-14T09:08:26.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:26.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941937+0000", 2024-09-14T09:08:26.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018813230000000001 2024-09-14T09:08:26.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:26.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941948+0000", 2024-09-14T09:08:26.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1542999999999999e-05 2024-09-14T09:08:26.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941954+0000", 2024-09-14T09:08:26.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1109999999999996e-06 2024-09-14T09:08:26.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:26.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.942005+0000", 2024-09-14T09:08:26.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1286000000000003e-05 2024-09-14T09:08:26.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:26.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.942126+0000", 2024-09-14T09:08:26.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012029800000000001 2024-09-14T09:08:26.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:26.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.942401+0000", 2024-09-14T09:08:26.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00027493500000000002 2024-09-14T09:08:26.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:26.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.946143+0000", 2024-09-14T09:08:26.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037426130000000001 2024-09-14T09:08:26.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:26.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.948084+0000", 2024-09-14T09:08:26.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001940862 2024-09-14T09:08:26.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:26.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.948117+0000", 2024-09-14T09:08:26.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3309999999999998e-05 2024-09-14T09:08:26.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:26.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.948141+0000", 2024-09-14T09:08:26.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3099999999999999e-05 2024-09-14T09:08:26.953 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.953 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:26.953 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.953 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4782.0:884 3.1b 3:de177a91:::rbd_data.11127a12d636.000000000000000d:head [truncate 4063232] snapc f=[f] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T09:08:26.953 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:09.941969+0000", 2024-09-14T09:08:26.953 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 16.980769936000002, 2024-09-14T09:08:26.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065065640000000003, 2024-09-14T09:08:26.953 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:26.954 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:26.954 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:26.954 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:26.954 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4782", 2024-09-14T09:08:26.954 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/353415140", 2024-09-14T09:08:26.954 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 884 2024-09-14T09:08:26.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.954 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:26.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:26.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941969+0000", 2024-09-14T09:08:26.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:26.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941969+0000", 2024-09-14T09:08:26.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:26.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941969+0000", 2024-09-14T09:08:26.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6700000000000003e-07 2024-09-14T09:08:26.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:26.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941971+0000", 2024-09-14T09:08:26.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.748e-06 2024-09-14T09:08:26.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:26.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941980+0000", 2024-09-14T09:08:26.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7120000000000006e-06 2024-09-14T09:08:26.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941983+0000", 2024-09-14T09:08:26.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5549999999999998e-06 2024-09-14T09:08:26.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:26.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.944525+0000", 2024-09-14T09:08:26.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025416029999999999 2024-09-14T09:08:26.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:26.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.944592+0000", 2024-09-14T09:08:26.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6871000000000004e-05 2024-09-14T09:08:26.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:26.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.944720+0000", 2024-09-14T09:08:26.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012863600000000001 2024-09-14T09:08:26.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:26.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.946292+0000", 2024-09-14T09:08:26.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015713470000000001 2024-09-14T09:08:26.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:26.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.948426+0000", 2024-09-14T09:08:26.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021343669999999999 2024-09-14T09:08:26.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:26.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.948453+0000", 2024-09-14T09:08:26.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6574999999999999e-05 2024-09-14T09:08:26.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:26.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.948475+0000", 2024-09-14T09:08:26.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2483000000000001e-05 2024-09-14T09:08:26.959 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.959 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:26.959 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.959 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4819.0:4705 3.1b 3:da69c123:::rbd_data.111258e7abd2.0000000000000051:head [set-alloc-hint object_size 524288 write_size 524288,write 453632~5120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-14T09:08:26.959 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:14.120590+0000", 2024-09-14T09:08:26.959 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.802148626999999, 2024-09-14T09:08:26.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043509020000000002, 2024-09-14T09:08:26.960 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:26.960 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:26.960 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:26.960 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:26.960 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4819", 2024-09-14T09:08:26.960 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:26.960 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4705 2024-09-14T09:08:26.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.960 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:26.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:26.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120590+0000", 2024-09-14T09:08:26.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:26.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120590+0000", 2024-09-14T09:08:26.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:26.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120591+0000", 2024-09-14T09:08:26.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6000000000000003e-07 2024-09-14T09:08:26.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:26.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120599+0000", 2024-09-14T09:08:26.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1070000000000005e-06 2024-09-14T09:08:26.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:26.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120609+0000", 2024-09-14T09:08:26.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0227000000000001e-05 2024-09-14T09:08:26.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120632+0000", 2024-09-14T09:08:26.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2833e-05 2024-09-14T09:08:26.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:26.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120678+0000", 2024-09-14T09:08:26.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6439e-05 2024-09-14T09:08:26.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:26.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120769+0000", 2024-09-14T09:08:26.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0919000000000001e-05 2024-09-14T09:08:26.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:26.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120846+0000", 2024-09-14T09:08:26.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6470999999999993e-05 2024-09-14T09:08:26.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:26.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.121356+0000", 2024-09-14T09:08:26.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00051052900000000002 2024-09-14T09:08:26.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:26.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.124889+0000", 2024-09-14T09:08:26.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035324879999999999 2024-09-14T09:08:26.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:26.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.124919+0000", 2024-09-14T09:08:26.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9768999999999999e-05 2024-09-14T09:08:26.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:26.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.124941+0000", 2024-09-14T09:08:26.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2359999999999999e-05 2024-09-14T09:08:26.965 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.965 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:26.965 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.965 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4819.0:5071 3.1b 3:dfbbb139:::rbd_data.111258e7abd2.000000000000016e:head [set-alloc-hint object_size 524288 write_size 524288,write 491520~32768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-14T09:08:26.965 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:14.249142+0000", 2024-09-14T09:08:26.965 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.673596313999999, 2024-09-14T09:08:26.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051714309999999998, 2024-09-14T09:08:26.965 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:26.965 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:26.966 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:26.966 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:26.966 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4819", 2024-09-14T09:08:26.966 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:26.966 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5071 2024-09-14T09:08:26.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.966 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:26.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:26.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249142+0000", 2024-09-14T09:08:26.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:26.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249142+0000", 2024-09-14T09:08:26.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:26.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249143+0000", 2024-09-14T09:08:26.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7400000000000002e-07 2024-09-14T09:08:26.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:26.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249170+0000", 2024-09-14T09:08:26.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7246e-05 2024-09-14T09:08:26.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:26.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249180+0000", 2024-09-14T09:08:26.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9890000000000004e-06 2024-09-14T09:08:26.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249185+0000", 2024-09-14T09:08:26.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0849999999999996e-06 2024-09-14T09:08:26.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:26.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249224+0000", 2024-09-14T09:08:26.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8828000000000002e-05 2024-09-14T09:08:26.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:26.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249296+0000", 2024-09-14T09:08:26.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1831999999999999e-05 2024-09-14T09:08:26.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:26.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249375+0000", 2024-09-14T09:08:26.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9177000000000004e-05 2024-09-14T09:08:26.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:26.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249839+0000", 2024-09-14T09:08:26.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00046331399999999999 2024-09-14T09:08:26.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:26.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.254263+0000", 2024-09-14T09:08:26.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044240089999999996 2024-09-14T09:08:26.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:26.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.254293+0000", 2024-09-14T09:08:26.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0018e-05 2024-09-14T09:08:26.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:26.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.254314+0000", 2024-09-14T09:08:26.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1158999999999999e-05 2024-09-14T09:08:26.971 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.971 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:26.971 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.971 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4819.0:5479 3.1b 3:de753bd2:::rbd_data.111258e7abd2.0000000000000173:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-14T09:08:26.971 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:14.369980+0000", 2024-09-14T09:08:26.971 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.552759081, 2024-09-14T09:08:26.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051695830000000002, 2024-09-14T09:08:26.971 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:26.971 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:26.971 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:26.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:26.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4819", 2024-09-14T09:08:26.972 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:26.972 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5479 2024-09-14T09:08:26.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.972 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:26.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:26.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.369980+0000", 2024-09-14T09:08:26.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:26.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.369980+0000", 2024-09-14T09:08:26.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:26.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.369981+0000", 2024-09-14T09:08:26.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9130000000000001e-06 2024-09-14T09:08:26.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:26.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.369990+0000", 2024-09-14T09:08:26.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7329999999999992e-06 2024-09-14T09:08:26.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:26.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.370018+0000", 2024-09-14T09:08:26.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7710000000000001e-05 2024-09-14T09:08:26.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.370037+0000", 2024-09-14T09:08:26.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9196000000000001e-05 2024-09-14T09:08:26.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:26.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.370152+0000", 2024-09-14T09:08:26.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011479799999999999 2024-09-14T09:08:26.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:26.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.370236+0000", 2024-09-14T09:08:26.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3628999999999995e-05 2024-09-14T09:08:26.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:26.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.370348+0000", 2024-09-14T09:08:26.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112884 2024-09-14T09:08:26.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:26.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.371164+0000", 2024-09-14T09:08:26.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00081568199999999997 2024-09-14T09:08:26.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:26.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.375085+0000", 2024-09-14T09:08:26.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039209900000000001 2024-09-14T09:08:26.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:26.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.375114+0000", 2024-09-14T09:08:26.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9141000000000001e-05 2024-09-14T09:08:26.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:26.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.375149+0000", 2024-09-14T09:08:26.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4907000000000003e-05 2024-09-14T09:08:26.976 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.976 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:26.976 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.977 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4819.0:5648 3.1b 3:ddac6bbf:::rbd_data.111258e7abd2.000000000000002a:head [set-alloc-hint object_size 524288 write_size 524288,write 211456~17920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-14T09:08:26.977 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:14.428139+0000", 2024-09-14T09:08:26.977 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.494599893, 2024-09-14T09:08:26.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043123170000000004, 2024-09-14T09:08:26.977 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:26.977 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:26.977 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:26.977 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:26.977 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4819", 2024-09-14T09:08:26.977 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:26.977 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5648 2024-09-14T09:08:26.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.977 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:26.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:26.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428139+0000", 2024-09-14T09:08:26.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:26.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428139+0000", 2024-09-14T09:08:26.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:26.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428139+0000", 2024-09-14T09:08:26.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.99e-07 2024-09-14T09:08:26.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:26.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428157+0000", 2024-09-14T09:08:26.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7706999999999998e-05 2024-09-14T09:08:26.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:26.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428168+0000", 2024-09-14T09:08:26.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1088e-05 2024-09-14T09:08:26.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428174+0000", 2024-09-14T09:08:26.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.942e-06 2024-09-14T09:08:26.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:26.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428211+0000", 2024-09-14T09:08:26.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6968000000000002e-05 2024-09-14T09:08:26.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:26.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428256+0000", 2024-09-14T09:08:26.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5207999999999998e-05 2024-09-14T09:08:26.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:26.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428371+0000", 2024-09-14T09:08:26.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114215 2024-09-14T09:08:26.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:26.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428917+0000", 2024-09-14T09:08:26.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00054596099999999997 2024-09-14T09:08:26.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:26.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.432364+0000", 2024-09-14T09:08:26.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003447327 2024-09-14T09:08:26.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:26.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.432415+0000", 2024-09-14T09:08:26.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0692000000000002e-05 2024-09-14T09:08:26.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:26.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.432451+0000", 2024-09-14T09:08:26.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6510000000000001e-05 2024-09-14T09:08:26.982 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.982 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:26.982 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.982 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4819.0:5992 3.1b 3:d863f74f:::rbd_data.111258e7abd2.0000000000000096:head [set-alloc-hint object_size 524288 write_size 524288,write 275456~19456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-14T09:08:26.983 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:14.561771+0000", 2024-09-14T09:08:26.983 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.360967753000001, 2024-09-14T09:08:26.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044464300000000003, 2024-09-14T09:08:26.983 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:26.983 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:26.983 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:26.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:26.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4819", 2024-09-14T09:08:26.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:26.983 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5992 2024-09-14T09:08:26.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.983 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:26.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:26.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561771+0000", 2024-09-14T09:08:26.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:26.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561771+0000", 2024-09-14T09:08:26.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:26.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561772+0000", 2024-09-14T09:08:26.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1999999999999998e-07 2024-09-14T09:08:26.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:26.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561792+0000", 2024-09-14T09:08:26.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0615000000000002e-05 2024-09-14T09:08:26.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:26.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561803+0000", 2024-09-14T09:08:26.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0997e-05 2024-09-14T09:08:26.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561810+0000", 2024-09-14T09:08:26.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.353e-06 2024-09-14T09:08:26.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:26.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561853+0000", 2024-09-14T09:08:26.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2855999999999998e-05 2024-09-14T09:08:26.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:26.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561897+0000", 2024-09-14T09:08:26.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4978000000000002e-05 2024-09-14T09:08:26.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:26.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561976+0000", 2024-09-14T09:08:26.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8857999999999996e-05 2024-09-14T09:08:26.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:26.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.562543+0000", 2024-09-14T09:08:26.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056632500000000001 2024-09-14T09:08:26.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:26.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.566166+0000", 2024-09-14T09:08:26.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003623214 2024-09-14T09:08:26.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:26.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.566195+0000", 2024-09-14T09:08:26.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9349999999999999e-05 2024-09-14T09:08:26.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:26.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.566217+0000", 2024-09-14T09:08:26.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2064000000000001e-05 2024-09-14T09:08:26.988 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.988 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:26.989 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.989 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4766.0:1257 3.15 e46/22 3:ae2b37e3:::rbd_data.111232b23a18.000000000000010f:head v 46'419, mlcod=46'417)", 2024-09-14T09:08:26.989 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.056608+0000", 2024-09-14T09:08:26.989 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.8661302440000007, 2024-09-14T09:08:26.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043291629999999996, 2024-09-14T09:08:26.989 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:26.989 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:26.989 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:26.989 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:26.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:26.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056608+0000", 2024-09-14T09:08:26.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:26.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056608+0000", 2024-09-14T09:08:26.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:26.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056609+0000", 2024-09-14T09:08:26.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-07 2024-09-14T09:08:26.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:26.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056620+0000", 2024-09-14T09:08:26.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0701e-05 2024-09-14T09:08:26.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:26.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056630+0000", 2024-09-14T09:08:26.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0225e-05 2024-09-14T09:08:26.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056637+0000", 2024-09-14T09:08:26.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5830000000000003e-06 2024-09-14T09:08:26.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:26.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056694+0000", 2024-09-14T09:08:26.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6774999999999998e-05 2024-09-14T09:08:26.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:26.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056716+0000", 2024-09-14T09:08:26.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2184999999999999e-05 2024-09-14T09:08:26.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:26.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.060892+0000", 2024-09-14T09:08:26.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0041758430000000003 2024-09-14T09:08:26.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:26.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.060938+0000", 2024-09-14T09:08:26.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6e-05 2024-09-14T09:08:26.993 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.993 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:26.993 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.993 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4766.0:1812 3.9 e46/22 3:974b410d:::rbd_data.111232b23a18.00000000000000ee:head v 46'191, mlcod=46'188)", 2024-09-14T09:08:26.994 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.142532+0000", 2024-09-14T09:08:26.994 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.7802068799999997, 2024-09-14T09:08:26.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058848579999999998, 2024-09-14T09:08:26.994 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:26.994 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:26.994 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:26.994 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:26.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:26.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.142532+0000", 2024-09-14T09:08:26.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:26.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.142532+0000", 2024-09-14T09:08:26.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:26.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.142532+0000", 2024-09-14T09:08:26.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1099999999999995e-07 2024-09-14T09:08:26.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:26.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.142544+0000", 2024-09-14T09:08:26.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1224e-05 2024-09-14T09:08:26.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:26.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.142556+0000", 2024-09-14T09:08:26.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2238e-05 2024-09-14T09:08:26.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:26.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.142563+0000", 2024-09-14T09:08:26.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.781e-06 2024-09-14T09:08:26.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:26.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.142601+0000", 2024-09-14T09:08:26.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8299e-05 2024-09-14T09:08:26.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:26.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.142620+0000", 2024-09-14T09:08:26.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8686e-05 2024-09-14T09:08:26.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:26.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.148364+0000", 2024-09-14T09:08:26.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0057439910000000004 2024-09-14T09:08:26.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:26.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.148417+0000", 2024-09-14T09:08:26.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3028000000000001e-05 2024-09-14T09:08:26.998 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.998 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:26.998 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:26.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.998 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4766.0:1814 3.7 e46/22 3:e2906054:::rbd_data.111232b23a18.00000000000000f0:head v 46'327, mlcod=46'325)", 2024-09-14T09:08:26.998 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.143985+0000", 2024-09-14T09:08:26.998 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.7787532000000006, 2024-09-14T09:08:26.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004573985, 2024-09-14T09:08:26.998 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:26.998 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:26.998 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:26.998 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:26.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:26.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.143985+0000", 2024-09-14T09:08:26.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:26.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.143985+0000", 2024-09-14T09:08:26.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:26.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:26.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:26.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:26.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.143986+0000", 2024-09-14T09:08:26.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1500000000000003e-07 2024-09-14T09:08:26.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.143997+0000", 2024-09-14T09:08:27.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.049e-05 2024-09-14T09:08:27.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.144007+0000", 2024-09-14T09:08:27.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0339e-05 2024-09-14T09:08:27.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.144012+0000", 2024-09-14T09:08:27.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4090000000000002e-06 2024-09-14T09:08:27.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.144061+0000", 2024-09-14T09:08:27.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8219e-05 2024-09-14T09:08:27.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.144081+0000", 2024-09-14T09:08:27.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0557e-05 2024-09-14T09:08:27.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.148517+0000", 2024-09-14T09:08:27.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044355089999999998 2024-09-14T09:08:27.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.148559+0000", 2024-09-14T09:08:27.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2647e-05 2024-09-14T09:08:27.002 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.002 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.002 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.002 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4766.0:2349 3.1e e46/22 3:7a637f1d:::rbd_data.111232b23a18.0000000000000098:head v 46'146, mlcod=46'144)", 2024-09-14T09:08:27.003 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.205112+0000", 2024-09-14T09:08:27.003 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.7176271290000003, 2024-09-14T09:08:27.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042264310000000001, 2024-09-14T09:08:27.003 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.003 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.003 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.003 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205112+0000", 2024-09-14T09:08:27.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205112+0000", 2024-09-14T09:08:27.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205112+0000", 2024-09-14T09:08:27.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5700000000000001e-07 2024-09-14T09:08:27.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205123+0000", 2024-09-14T09:08:27.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0494e-05 2024-09-14T09:08:27.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205133+0000", 2024-09-14T09:08:27.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0030000000000001e-05 2024-09-14T09:08:27.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205138+0000", 2024-09-14T09:08:27.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9030000000000003e-06 2024-09-14T09:08:27.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205182+0000", 2024-09-14T09:08:27.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4088999999999997e-05 2024-09-14T09:08:27.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205194+0000", 2024-09-14T09:08:27.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868999999999999e-05 2024-09-14T09:08:27.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209297+0000", 2024-09-14T09:08:27.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0041032000000000004 2024-09-14T09:08:27.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209338+0000", 2024-09-14T09:08:27.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0988999999999997e-05 2024-09-14T09:08:27.007 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.007 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.007 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.007 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4766.0:2351 3.15 e46/22 3:aa5230da:::rbd_data.111232b23a18.000000000000009a:head v 46'425, mlcod=46'422)", 2024-09-14T09:08:27.007 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.206258+0000", 2024-09-14T09:08:27.007 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.7164807440000001, 2024-09-14T09:08:27.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059542889999999998, 2024-09-14T09:08:27.007 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.007 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.008 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.008 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206258+0000", 2024-09-14T09:08:27.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206258+0000", 2024-09-14T09:08:27.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206259+0000", 2024-09-14T09:08:27.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9999999999999997e-07 2024-09-14T09:08:27.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206267+0000", 2024-09-14T09:08:27.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2199999999999992e-06 2024-09-14T09:08:27.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206279+0000", 2024-09-14T09:08:27.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2002e-05 2024-09-14T09:08:27.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206286+0000", 2024-09-14T09:08:27.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7510000000000002e-06 2024-09-14T09:08:27.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206330+0000", 2024-09-14T09:08:27.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4776e-05 2024-09-14T09:08:27.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206348+0000", 2024-09-14T09:08:27.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7659000000000002e-05 2024-09-14T09:08:27.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212172+0000", 2024-09-14T09:08:27.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058235650000000002 2024-09-14T09:08:27.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212212+0000", 2024-09-14T09:08:27.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0615999999999999e-05 2024-09-14T09:08:27.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.011 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.012 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4766.0:2370 3.2 e46/22 3:43b2ee4a:::rbd_data.111232b23a18.000000000000009d:head v 46'118, mlcod=46'116)", 2024-09-14T09:08:27.012 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.209956+0000", 2024-09-14T09:08:27.012 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.7127825370000007, 2024-09-14T09:08:27.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052104539999999998, 2024-09-14T09:08:27.012 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.012 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.012 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.012 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209956+0000", 2024-09-14T09:08:27.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209956+0000", 2024-09-14T09:08:27.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209957+0000", 2024-09-14T09:08:27.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9100000000000003e-07 2024-09-14T09:08:27.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209964+0000", 2024-09-14T09:08:27.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3980000000000002e-06 2024-09-14T09:08:27.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209974+0000", 2024-09-14T09:08:27.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3409999999999992e-06 2024-09-14T09:08:27.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209978+0000", 2024-09-14T09:08:27.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7219999999999999e-06 2024-09-14T09:08:27.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.210028+0000", 2024-09-14T09:08:27.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9577999999999999e-05 2024-09-14T09:08:27.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.210049+0000", 2024-09-14T09:08:27.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0866999999999999e-05 2024-09-14T09:08:27.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.215117+0000", 2024-09-14T09:08:27.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050677880000000002 2024-09-14T09:08:27.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.215167+0000", 2024-09-14T09:08:27.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9969000000000002e-05 2024-09-14T09:08:27.016 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.016 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.016 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.016 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4766.0:5795 3.15 e46/22 3:aa5fe193:::rbd_data.111232b23a18.00000000000001a2:head v 46'436, mlcod=46'434)", 2024-09-14T09:08:27.016 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.855169+0000", 2024-09-14T09:08:27.016 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.0675693630000005, 2024-09-14T09:08:27.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0041731800000000003, 2024-09-14T09:08:27.017 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.017 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.017 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.017 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.855169+0000", 2024-09-14T09:08:27.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.855169+0000", 2024-09-14T09:08:27.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.855170+0000", 2024-09-14T09:08:27.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3699999999999999e-07 2024-09-14T09:08:27.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.855185+0000", 2024-09-14T09:08:27.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4483e-05 2024-09-14T09:08:27.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.855197+0000", 2024-09-14T09:08:27.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2522e-05 2024-09-14T09:08:27.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.855205+0000", 2024-09-14T09:08:27.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6190000000000002e-06 2024-09-14T09:08:27.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.855264+0000", 2024-09-14T09:08:27.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9500999999999998e-05 2024-09-14T09:08:27.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.855289+0000", 2024-09-14T09:08:27.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4247999999999999e-05 2024-09-14T09:08:27.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.859302+0000", 2024-09-14T09:08:27.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040135450000000003 2024-09-14T09:08:27.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.859342+0000", 2024-09-14T09:08:27.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0324999999999998e-05 2024-09-14T09:08:27.020 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.020 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.021 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.021 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4959.0:1643 3.18 e50/22 3:1b5c3206:::rbd_data.1112dcec84c0.000000000000002c:head v 50'102, mlcod=50'99)", 2024-09-14T09:08:27.021 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:23.984266+0000", 2024-09-14T09:08:27.021 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 2.9384730929999998, 2024-09-14T09:08:27.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046490840000000004, 2024-09-14T09:08:27.021 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.021 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.021 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.021 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.984266+0000", 2024-09-14T09:08:27.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.984266+0000", 2024-09-14T09:08:27.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.984266+0000", 2024-09-14T09:08:27.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4900000000000004e-07 2024-09-14T09:08:27.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.984281+0000", 2024-09-14T09:08:27.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4059e-05 2024-09-14T09:08:27.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.984299+0000", 2024-09-14T09:08:27.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8082999999999999e-05 2024-09-14T09:08:27.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.984307+0000", 2024-09-14T09:08:27.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9680000000000006e-06 2024-09-14T09:08:27.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.984391+0000", 2024-09-14T09:08:27.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4293000000000001e-05 2024-09-14T09:08:27.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.984409+0000", 2024-09-14T09:08:27.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8525999999999998e-05 2024-09-14T09:08:27.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.988857+0000", 2024-09-14T09:08:27.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044473330000000004 2024-09-14T09:08:27.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.988915+0000", 2024-09-14T09:08:27.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7873e-05 2024-09-14T09:08:27.025 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.025 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.025 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.025 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.025 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.025 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:27.027 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-14T09:08:27.027 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 1.0 2024-09-14T09:08:27.028 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:27.029+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:27.028 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:08:27.128 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:27.129+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:27.131 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:27.131 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:27.131 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:27.131 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:27.139 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:08:27.228 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:27.230+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:27.282 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:27.283 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:27.283 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:27.283 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:27.283 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:27.291 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:08:27.335 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:27.337+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:27.398 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:1137 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.043863+0000", 2024-09-14T09:08:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.3546043450000003, 2024-09-14T09:08:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018224061, 2024-09-14T09:08:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1137 2024-09-14T09:08:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043863+0000", 2024-09-14T09:08:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043863+0000", 2024-09-14T09:08:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043863+0000", 2024-09-14T09:08:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3099999999999998e-07 2024-09-14T09:08:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043866+0000", 2024-09-14T09:08:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5620000000000002e-06 2024-09-14T09:08:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043872+0000", 2024-09-14T09:08:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5579999999999997e-06 2024-09-14T09:08:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043877+0000", 2024-09-14T09:08:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7299999999999996e-06 2024-09-14T09:08:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056308+0000", 2024-09-14T09:08:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012430925000000001 2024-09-14T09:08:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056382+0000", 2024-09-14T09:08:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3870999999999998e-05 2024-09-14T09:08:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056753+0000", 2024-09-14T09:08:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000371343 2024-09-14T09:08:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.061992+0000", 2024-09-14T09:08:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005238688 2024-09-14T09:08:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.062028+0000", 2024-09-14T09:08:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6040000000000001e-05 2024-09-14T09:08:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.062054+0000", 2024-09-14T09:08:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5856000000000001e-05 2024-09-14T09:08:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.062087+0000", 2024-09-14T09:08:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2957000000000003e-05 2024-09-14T09:08:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:1139 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.044918+0000", 2024-09-14T09:08:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.3535494910000008, 2024-09-14T09:08:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019100876999999999, 2024-09-14T09:08:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1139 2024-09-14T09:08:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044918+0000", 2024-09-14T09:08:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044918+0000", 2024-09-14T09:08:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044918+0000", 2024-09-14T09:08:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2500000000000004e-07 2024-09-14T09:08:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044924+0000", 2024-09-14T09:08:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2050000000000001e-06 2024-09-14T09:08:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044935+0000", 2024-09-14T09:08:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1321000000000001e-05 2024-09-14T09:08:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044942+0000", 2024-09-14T09:08:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.277e-06 2024-09-14T09:08:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.057831+0000", 2024-09-14T09:08:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012888692 2024-09-14T09:08:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.057912+0000", 2024-09-14T09:08:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0875000000000001e-05 2024-09-14T09:08:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.058249+0000", 2024-09-14T09:08:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033680100000000002 2024-09-14T09:08:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.063666+0000", 2024-09-14T09:08:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054178189999999999 2024-09-14T09:08:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.063922+0000", 2024-09-14T09:08:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00025591699999999998 2024-09-14T09:08:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.063978+0000", 2024-09-14T09:08:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5603000000000003e-05 2024-09-14T09:08:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064018+0000", 2024-09-14T09:08:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0441999999999997e-05 2024-09-14T09:08:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:1140 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.045510+0000", 2024-09-14T09:08:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.352957001, 2024-09-14T09:08:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018615145, 2024-09-14T09:08:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1140 2024-09-14T09:08:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045510+0000", 2024-09-14T09:08:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045510+0000", 2024-09-14T09:08:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045511+0000", 2024-09-14T09:08:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8899999999999998e-07 2024-09-14T09:08:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045516+0000", 2024-09-14T09:08:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9749999999999998e-06 2024-09-14T09:08:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045530+0000", 2024-09-14T09:08:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4542000000000001e-05 2024-09-14T09:08:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045542+0000", 2024-09-14T09:08:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1984000000000001e-05 2024-09-14T09:08:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.058561+0000", 2024-09-14T09:08:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01301828 2024-09-14T09:08:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.058628+0000", 2024-09-14T09:08:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7049000000000001e-05 2024-09-14T09:08:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.058827+0000", 2024-09-14T09:08:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019901200000000001 2024-09-14T09:08:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.063672+0000", 2024-09-14T09:08:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048450339999999998 2024-09-14T09:08:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064068+0000", 2024-09-14T09:08:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00039579200000000001 2024-09-14T09:08:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064098+0000", 2024-09-14T09:08:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9940000000000001e-05 2024-09-14T09:08:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064125+0000", 2024-09-14T09:08:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7648e-05 2024-09-14T09:08:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2066 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.183929+0000", 2024-09-14T09:08:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.2145384410000002, 2024-09-14T09:08:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020663781999999999, 2024-09-14T09:08:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2066 2024-09-14T09:08:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183929+0000", 2024-09-14T09:08:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183929+0000", 2024-09-14T09:08:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183929+0000", 2024-09-14T09:08:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2500000000000001e-07 2024-09-14T09:08:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183932+0000", 2024-09-14T09:08:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.683e-06 2024-09-14T09:08:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183938+0000", 2024-09-14T09:08:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6220000000000003e-06 2024-09-14T09:08:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183943+0000", 2024-09-14T09:08:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0340000000000004e-06 2024-09-14T09:08:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.198098+0000", 2024-09-14T09:08:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014154645 2024-09-14T09:08:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.198170+0000", 2024-09-14T09:08:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2464000000000003e-05 2024-09-14T09:08:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.198494+0000", 2024-09-14T09:08:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00032338499999999998 2024-09-14T09:08:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.202395+0000", 2024-09-14T09:08:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003900714 2024-09-14T09:08:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204488+0000", 2024-09-14T09:08:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020932860000000002 2024-09-14T09:08:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204556+0000", 2024-09-14T09:08:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8021999999999993e-05 2024-09-14T09:08:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204592+0000", 2024-09-14T09:08:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6501999999999997e-05 2024-09-14T09:08:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2067 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.183952+0000", 2024-09-14T09:08:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.2145155059999997, 2024-09-14T09:08:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020733690999999999, 2024-09-14T09:08:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2067 2024-09-14T09:08:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183952+0000", 2024-09-14T09:08:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183952+0000", 2024-09-14T09:08:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183952+0000", 2024-09-14T09:08:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4499999999999998e-07 2024-09-14T09:08:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183953+0000", 2024-09-14T09:08:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5659999999999999e-06 2024-09-14T09:08:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183961+0000", 2024-09-14T09:08:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8979999999999996e-06 2024-09-14T09:08:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183965+0000", 2024-09-14T09:08:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3440000000000001e-06 2024-09-14T09:08:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.199110+0000", 2024-09-14T09:08:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015145257000000001 2024-09-14T09:08:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.199183+0000", 2024-09-14T09:08:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3075000000000001e-05 2024-09-14T09:08:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.199495+0000", 2024-09-14T09:08:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00031204200000000001 2024-09-14T09:08:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204475+0000", 2024-09-14T09:08:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049796809999999997 2024-09-14T09:08:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204601+0000", 2024-09-14T09:08:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000126713 2024-09-14T09:08:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204644+0000", 2024-09-14T09:08:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2500999999999998e-05 2024-09-14T09:08:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204685+0000", 2024-09-14T09:08:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1369000000000003e-05 2024-09-14T09:08:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2068 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185491+0000", 2024-09-14T09:08:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.212976437, 2024-09-14T09:08:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019345701, 2024-09-14T09:08:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2068 2024-09-14T09:08:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185491+0000", 2024-09-14T09:08:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185491+0000", 2024-09-14T09:08:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185491+0000", 2024-09-14T09:08:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8100000000000002e-07 2024-09-14T09:08:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185495+0000", 2024-09-14T09:08:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7100000000000001e-06 2024-09-14T09:08:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185504+0000", 2024-09-14T09:08:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7069999999999998e-06 2024-09-14T09:08:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185508+0000", 2024-09-14T09:08:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6750000000000001e-06 2024-09-14T09:08:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.199874+0000", 2024-09-14T09:08:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014365833999999999 2024-09-14T09:08:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.199947+0000", 2024-09-14T09:08:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3010999999999996e-05 2024-09-14T09:08:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.200280+0000", 2024-09-14T09:08:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033280499999999998 2024-09-14T09:08:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204698+0000", 2024-09-14T09:08:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044175400000000002 2024-09-14T09:08:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204746+0000", 2024-09-14T09:08:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8340999999999997e-05 2024-09-14T09:08:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204799+0000", 2024-09-14T09:08:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2871999999999998e-05 2024-09-14T09:08:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204836+0000", 2024-09-14T09:08:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7524999999999997e-05 2024-09-14T09:08:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2069 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185519+0000", 2024-09-14T09:08:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.2129480709999996, 2024-09-14T09:08:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019424951999999999, 2024-09-14T09:08:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2069 2024-09-14T09:08:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185519+0000", 2024-09-14T09:08:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185519+0000", 2024-09-14T09:08:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185519+0000", 2024-09-14T09:08:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8200000000000001e-07 2024-09-14T09:08:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185521+0000", 2024-09-14T09:08:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.655e-06 2024-09-14T09:08:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185525+0000", 2024-09-14T09:08:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8870000000000002e-06 2024-09-14T09:08:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185528+0000", 2024-09-14T09:08:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6689999999999999e-06 2024-09-14T09:08:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.200838+0000", 2024-09-14T09:08:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015309779000000001 2024-09-14T09:08:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.200913+0000", 2024-09-14T09:08:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4612999999999999e-05 2024-09-14T09:08:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.201269+0000", 2024-09-14T09:08:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00035585800000000002 2024-09-14T09:08:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204704+0000", 2024-09-14T09:08:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034355879999999998 2024-09-14T09:08:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204883+0000", 2024-09-14T09:08:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017857499999999999 2024-09-14T09:08:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204911+0000", 2024-09-14T09:08:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8007000000000001e-05 2024-09-14T09:08:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204944+0000", 2024-09-14T09:08:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3039e-05 2024-09-14T09:08:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2070 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185533+0000", 2024-09-14T09:08:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.2129344950000007, 2024-09-14T09:08:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019500197, 2024-09-14T09:08:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2070 2024-09-14T09:08:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185533+0000", 2024-09-14T09:08:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185533+0000", 2024-09-14T09:08:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185533+0000", 2024-09-14T09:08:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1500000000000001e-07 2024-09-14T09:08:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185534+0000", 2024-09-14T09:08:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.449e-06 2024-09-14T09:08:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185537+0000", 2024-09-14T09:08:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-09-14T09:08:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185541+0000", 2024-09-14T09:08:27.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2140000000000001e-06 2024-09-14T09:08:27.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.201762+0000", 2024-09-14T09:08:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016221197 2024-09-14T09:08:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.201815+0000", 2024-09-14T09:08:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2787000000000001e-05 2024-09-14T09:08:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.202011+0000", 2024-09-14T09:08:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019608200000000001 2024-09-14T09:08:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204709+0000", 2024-09-14T09:08:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026987109999999999 2024-09-14T09:08:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204987+0000", 2024-09-14T09:08:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000277636 2024-09-14T09:08:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205015+0000", 2024-09-14T09:08:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7710000000000001e-05 2024-09-14T09:08:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205033+0000", 2024-09-14T09:08:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7946000000000001e-05 2024-09-14T09:08:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2071 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185545+0000", 2024-09-14T09:08:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.212922185, 2024-09-14T09:08:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021874615, 2024-09-14T09:08:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2071 2024-09-14T09:08:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185545+0000", 2024-09-14T09:08:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185545+0000", 2024-09-14T09:08:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185545+0000", 2024-09-14T09:08:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1799999999999999e-07 2024-09-14T09:08:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185546+0000", 2024-09-14T09:08:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.392e-06 2024-09-14T09:08:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185550+0000", 2024-09-14T09:08:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2179999999999999e-06 2024-09-14T09:08:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185552+0000", 2024-09-14T09:08:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6419999999999999e-06 2024-09-14T09:08:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.202430+0000", 2024-09-14T09:08:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016877728000000002 2024-09-14T09:08:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.202499+0000", 2024-09-14T09:08:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9259999999999998e-05 2024-09-14T09:08:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.203297+0000", 2024-09-14T09:08:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00079781399999999999 2024-09-14T09:08:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.207321+0000", 2024-09-14T09:08:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040234420000000003 2024-09-14T09:08:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.207349+0000", 2024-09-14T09:08:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8736000000000001e-05 2024-09-14T09:08:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.207381+0000", 2024-09-14T09:08:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1315000000000001e-05 2024-09-14T09:08:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.207419+0000", 2024-09-14T09:08:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8850000000000002e-05 2024-09-14T09:08:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2072 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185556+0000", 2024-09-14T09:08:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.2129113779999994, 2024-09-14T09:08:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023970933999999999, 2024-09-14T09:08:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2072 2024-09-14T09:08:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185556+0000", 2024-09-14T09:08:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185556+0000", 2024-09-14T09:08:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185556+0000", 2024-09-14T09:08:27.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.17e-07 2024-09-14T09:08:27.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185557+0000", 2024-09-14T09:08:27.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2860000000000001e-06 2024-09-14T09:08:27.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185560+0000", 2024-09-14T09:08:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0130000000000002e-06 2024-09-14T09:08:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185563+0000", 2024-09-14T09:08:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:08:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.203700+0000", 2024-09-14T09:08:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018137646 2024-09-14T09:08:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.203782+0000", 2024-09-14T09:08:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2082000000000005e-05 2024-09-14T09:08:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204106+0000", 2024-09-14T09:08:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000323345 2024-09-14T09:08:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209284+0000", 2024-09-14T09:08:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051778739999999998 2024-09-14T09:08:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209477+0000", 2024-09-14T09:08:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019348400000000001 2024-09-14T09:08:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209505+0000", 2024-09-14T09:08:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7358000000000001e-05 2024-09-14T09:08:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209527+0000", 2024-09-14T09:08:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2082999999999998e-05 2024-09-14T09:08:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2073 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185566+0000", 2024-09-14T09:08:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.2129006380000007, 2024-09-14T09:08:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024050449000000002, 2024-09-14T09:08:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2073 2024-09-14T09:08:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185566+0000", 2024-09-14T09:08:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185566+0000", 2024-09-14T09:08:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185567+0000", 2024-09-14T09:08:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2024-09-14T09:08:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185568+0000", 2024-09-14T09:08:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3e-06 2024-09-14T09:08:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185571+0000", 2024-09-14T09:08:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0460000000000001e-06 2024-09-14T09:08:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185574+0000", 2024-09-14T09:08:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5399999999999998e-06 2024-09-14T09:08:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205068+0000", 2024-09-14T09:08:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019494002999999999 2024-09-14T09:08:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205135+0000", 2024-09-14T09:08:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7056000000000003e-05 2024-09-14T09:08:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205421+0000", 2024-09-14T09:08:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00028621899999999999 2024-09-14T09:08:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209290+0000", 2024-09-14T09:08:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038688059999999998 2024-09-14T09:08:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209553+0000", 2024-09-14T09:08:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00026326600000000001 2024-09-14T09:08:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209587+0000", 2024-09-14T09:08:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4359000000000001e-05 2024-09-14T09:08:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209617+0000", 2024-09-14T09:08:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9643000000000001e-05 2024-09-14T09:08:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2074 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185577+0000", 2024-09-14T09:08:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.2128905089999993, 2024-09-14T09:08:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026839190999999998, 2024-09-14T09:08:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2074 2024-09-14T09:08:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185577+0000", 2024-09-14T09:08:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185577+0000", 2024-09-14T09:08:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185577+0000", 2024-09-14T09:08:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0800000000000001e-07 2024-09-14T09:08:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185578+0000", 2024-09-14T09:08:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3790000000000001e-06 2024-09-14T09:08:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185581+0000", 2024-09-14T09:08:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9639999999999999e-06 2024-09-14T09:08:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185584+0000", 2024-09-14T09:08:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.543e-06 2024-09-14T09:08:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205773+0000", 2024-09-14T09:08:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020189592999999999 2024-09-14T09:08:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205852+0000", 2024-09-14T09:08:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8825999999999994e-05 2024-09-14T09:08:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206078+0000", 2024-09-14T09:08:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022563999999999999 2024-09-14T09:08:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212216+0000", 2024-09-14T09:08:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061383940000000001 2024-09-14T09:08:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212346+0000", 2024-09-14T09:08:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000130195 2024-09-14T09:08:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212382+0000", 2024-09-14T09:08:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6009e-05 2024-09-14T09:08:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212416+0000", 2024-09-14T09:08:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3439999999999998e-05 2024-09-14T09:08:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2075 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185587+0000", 2024-09-14T09:08:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.2128803599999998, 2024-09-14T09:08:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026913308, 2024-09-14T09:08:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2075 2024-09-14T09:08:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185587+0000", 2024-09-14T09:08:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185587+0000", 2024-09-14T09:08:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185587+0000", 2024-09-14T09:08:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1e-07 2024-09-14T09:08:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185588+0000", 2024-09-14T09:08:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.308e-06 2024-09-14T09:08:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185592+0000", 2024-09-14T09:08:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5999999999999998e-06 2024-09-14T09:08:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185594+0000", 2024-09-14T09:08:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5799999999999999e-06 2024-09-14T09:08:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206511+0000", 2024-09-14T09:08:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020916338999999999 2024-09-14T09:08:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206591+0000", 2024-09-14T09:08:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0495999999999996e-05 2024-09-14T09:08:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206963+0000", 2024-09-14T09:08:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00037151300000000002 2024-09-14T09:08:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212222+0000", 2024-09-14T09:08:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052591469999999996 2024-09-14T09:08:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212449+0000", 2024-09-14T09:08:27.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022715699999999999 2024-09-14T09:08:27.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212478+0000", 2024-09-14T09:08:27.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8818000000000001e-05 2024-09-14T09:08:27.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212500+0000", 2024-09-14T09:08:27.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2140000000000001e-05 2024-09-14T09:08:27.486 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.487 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.487 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:3094 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:27.487 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.520938+0000", 2024-09-14T09:08:27.487 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.8775293570000002, 2024-09-14T09:08:27.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019285107999999999, 2024-09-14T09:08:27.487 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.487 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.487 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.487 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.487 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:27.487 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:27.488 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3094 2024-09-14T09:08:27.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.488 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520938+0000", 2024-09-14T09:08:27.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520938+0000", 2024-09-14T09:08:27.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520938+0000", 2024-09-14T09:08:27.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7099999999999998e-07 2024-09-14T09:08:27.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520939+0000", 2024-09-14T09:08:27.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.468e-06 2024-09-14T09:08:27.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520943+0000", 2024-09-14T09:08:27.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2459999999999999e-06 2024-09-14T09:08:27.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520945+0000", 2024-09-14T09:08:27.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7800000000000001e-06 2024-09-14T09:08:27.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.533959+0000", 2024-09-14T09:08:27.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013013927999999999 2024-09-14T09:08:27.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.534043+0000", 2024-09-14T09:08:27.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3628999999999995e-05 2024-09-14T09:08:27.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:27.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.534423+0000", 2024-09-14T09:08:27.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00037996699999999999 2024-09-14T09:08:27.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.537297+0000", 2024-09-14T09:08:27.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028744650000000001 2024-09-14T09:08:27.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.540132+0000", 2024-09-14T09:08:27.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002834072 2024-09-14T09:08:27.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.540184+0000", 2024-09-14T09:08:27.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2457000000000003e-05 2024-09-14T09:08:27.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.540223+0000", 2024-09-14T09:08:27.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8825000000000002e-05 2024-09-14T09:08:27.492 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.492 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.493 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.493 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:3095 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:27.493 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.520949+0000", 2024-09-14T09:08:27.493 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.8775183969999993, 2024-09-14T09:08:27.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019423973000000001, 2024-09-14T09:08:27.493 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.493 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.493 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.493 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.493 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:27.493 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:27.493 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3095 2024-09-14T09:08:27.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.494 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520949+0000", 2024-09-14T09:08:27.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520949+0000", 2024-09-14T09:08:27.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520949+0000", 2024-09-14T09:08:27.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6e-07 2024-09-14T09:08:27.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520950+0000", 2024-09-14T09:08:27.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5600000000000001e-06 2024-09-14T09:08:27.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520953+0000", 2024-09-14T09:08:27.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9660000000000001e-06 2024-09-14T09:08:27.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520956+0000", 2024-09-14T09:08:27.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6019999999999998e-06 2024-09-14T09:08:27.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.535013+0000", 2024-09-14T09:08:27.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014056663 2024-09-14T09:08:27.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.535091+0000", 2024-09-14T09:08:27.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8745000000000006e-05 2024-09-14T09:08:27.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:27.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.535323+0000", 2024-09-14T09:08:27.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000231685 2024-09-14T09:08:27.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.540275+0000", 2024-09-14T09:08:27.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049515130000000003 2024-09-14T09:08:27.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.540287+0000", 2024-09-14T09:08:27.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2649999999999999e-05 2024-09-14T09:08:27.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.540334+0000", 2024-09-14T09:08:27.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7083999999999998e-05 2024-09-14T09:08:27.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.540373+0000", 2024-09-14T09:08:27.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8244999999999997e-05 2024-09-14T09:08:27.498 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.498 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.498 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.500 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:3096 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:27.500 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.520959+0000", 2024-09-14T09:08:27.500 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.8775079479999999, 2024-09-14T09:08:27.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021266274000000002, 2024-09-14T09:08:27.500 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.500 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.500 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:27.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:27.500 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3096 2024-09-14T09:08:27.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.501 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520959+0000", 2024-09-14T09:08:27.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520959+0000", 2024-09-14T09:08:27.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520959+0000", 2024-09-14T09:08:27.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.17e-07 2024-09-14T09:08:27.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520961+0000", 2024-09-14T09:08:27.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3200000000000001e-06 2024-09-14T09:08:27.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520964+0000", 2024-09-14T09:08:27.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8700000000000001e-06 2024-09-14T09:08:27.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520966+0000", 2024-09-14T09:08:27.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4880000000000001e-06 2024-09-14T09:08:27.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.535679+0000", 2024-09-14T09:08:27.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014713118000000001 2024-09-14T09:08:27.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.535765+0000", 2024-09-14T09:08:27.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5464999999999996e-05 2024-09-14T09:08:27.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:27.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.536136+0000", 2024-09-14T09:08:27.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00037173399999999998 2024-09-14T09:08:27.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.542094+0000", 2024-09-14T09:08:27.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059577639999999999 2024-09-14T09:08:27.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.542147+0000", 2024-09-14T09:08:27.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2444999999999997e-05 2024-09-14T09:08:27.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.542188+0000", 2024-09-14T09:08:27.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1465999999999999e-05 2024-09-14T09:08:27.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.542225+0000", 2024-09-14T09:08:27.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7387e-05 2024-09-14T09:08:27.505 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.505 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.505 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.505 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:3097 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:27.505 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.520973+0000", 2024-09-14T09:08:27.505 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.8774943390000001, 2024-09-14T09:08:27.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022189861000000002, 2024-09-14T09:08:27.505 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.505 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.506 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.506 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.506 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:27.506 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:27.506 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3097 2024-09-14T09:08:27.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.506 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520973+0000", 2024-09-14T09:08:27.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520973+0000", 2024-09-14T09:08:27.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520973+0000", 2024-09-14T09:08:27.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.53e-07 2024-09-14T09:08:27.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520975+0000", 2024-09-14T09:08:27.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5600000000000001e-06 2024-09-14T09:08:27.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520978+0000", 2024-09-14T09:08:27.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1990000000000002e-06 2024-09-14T09:08:27.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520980+0000", 2024-09-14T09:08:27.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5579999999999999e-06 2024-09-14T09:08:27.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.536537+0000", 2024-09-14T09:08:27.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015556285 2024-09-14T09:08:27.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.536612+0000", 2024-09-14T09:08:27.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5704000000000006e-05 2024-09-14T09:08:27.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:27.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.536946+0000", 2024-09-14T09:08:27.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033328299999999997 2024-09-14T09:08:27.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.542236+0000", 2024-09-14T09:08:27.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052906680000000001 2024-09-14T09:08:27.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.542395+0000", 2024-09-14T09:08:27.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015884499999999999 2024-09-14T09:08:27.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543126+0000", 2024-09-14T09:08:27.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000731125 2024-09-14T09:08:27.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543163+0000", 2024-09-14T09:08:27.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6381000000000003e-05 2024-09-14T09:08:27.510 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.510 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.510 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.511 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:3098 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:27.511 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.520984+0000", 2024-09-14T09:08:27.511 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.8774834919999996, 2024-09-14T09:08:27.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022279624000000001, 2024-09-14T09:08:27.511 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.511 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.511 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:27.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:27.511 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3098 2024-09-14T09:08:27.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.511 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520984+0000", 2024-09-14T09:08:27.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520984+0000", 2024-09-14T09:08:27.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520984+0000", 2024-09-14T09:08:27.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2100000000000001e-07 2024-09-14T09:08:27.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520985+0000", 2024-09-14T09:08:27.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.305e-06 2024-09-14T09:08:27.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520988+0000", 2024-09-14T09:08:27.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9459999999999998e-06 2024-09-14T09:08:27.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520991+0000", 2024-09-14T09:08:27.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5220000000000002e-06 2024-09-14T09:08:27.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.537336+0000", 2024-09-14T09:08:27.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016345563 2024-09-14T09:08:27.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.537416+0000", 2024-09-14T09:08:27.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0091000000000003e-05 2024-09-14T09:08:27.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:27.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.537632+0000", 2024-09-14T09:08:27.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00021544899999999999 2024-09-14T09:08:27.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543210+0000", 2024-09-14T09:08:27.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055779189999999998 2024-09-14T09:08:27.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543217+0000", 2024-09-14T09:08:27.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5599999999999996e-06 2024-09-14T09:08:27.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543241+0000", 2024-09-14T09:08:27.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4365000000000001e-05 2024-09-14T09:08:27.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543263+0000", 2024-09-14T09:08:27.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1682999999999999e-05 2024-09-14T09:08:27.516 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.516 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.516 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.516 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:3099 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:27.516 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.520994+0000", 2024-09-14T09:08:27.516 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.8774735200000006, 2024-09-14T09:08:27.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022403849, 2024-09-14T09:08:27.516 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.517 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.517 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.517 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.517 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:27.517 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:27.517 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3099 2024-09-14T09:08:27.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.517 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520994+0000", 2024-09-14T09:08:27.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520994+0000", 2024-09-14T09:08:27.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520994+0000", 2024-09-14T09:08:27.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.23e-07 2024-09-14T09:08:27.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520995+0000", 2024-09-14T09:08:27.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.285e-06 2024-09-14T09:08:27.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520998+0000", 2024-09-14T09:08:27.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9129999999999999e-06 2024-09-14T09:08:27.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.521000+0000", 2024-09-14T09:08:27.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4569999999999999e-06 2024-09-14T09:08:27.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.537995+0000", 2024-09-14T09:08:27.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016994619999999998 2024-09-14T09:08:27.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.538039+0000", 2024-09-14T09:08:27.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3557999999999999e-05 2024-09-14T09:08:27.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:27.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.538249+0000", 2024-09-14T09:08:27.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000210237 2024-09-14T09:08:27.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543270+0000", 2024-09-14T09:08:27.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050210769999999997 2024-09-14T09:08:27.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543314+0000", 2024-09-14T09:08:27.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3829000000000003e-05 2024-09-14T09:08:27.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543364+0000", 2024-09-14T09:08:27.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0460000000000001e-05 2024-09-14T09:08:27.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543397+0000", 2024-09-14T09:08:27.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3189999999999999e-05 2024-09-14T09:08:27.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.522 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.522 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:3100 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.521003+0000", 2024-09-14T09:08:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.877463723, 2024-09-14T09:08:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023619213, 2024-09-14T09:08:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3100 2024-09-14T09:08:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.521003+0000", 2024-09-14T09:08:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.521003+0000", 2024-09-14T09:08:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.521004+0000", 2024-09-14T09:08:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2100000000000001e-07 2024-09-14T09:08:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.521005+0000", 2024-09-14T09:08:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5910000000000001e-06 2024-09-14T09:08:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.521008+0000", 2024-09-14T09:08:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.818e-06 2024-09-14T09:08:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.521012+0000", 2024-09-14T09:08:27.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6030000000000001e-06 2024-09-14T09:08:27.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.538577+0000", 2024-09-14T09:08:27.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017565386999999998 2024-09-14T09:08:27.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.538619+0000", 2024-09-14T09:08:27.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2379999999999997e-05 2024-09-14T09:08:27.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:27.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.538918+0000", 2024-09-14T09:08:27.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029888000000000001 2024-09-14T09:08:27.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543448+0000", 2024-09-14T09:08:27.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045295969999999998 2024-09-14T09:08:27.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.544536+0000", 2024-09-14T09:08:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001088554 2024-09-14T09:08:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.544585+0000", 2024-09-14T09:08:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8359999999999998e-05 2024-09-14T09:08:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.544623+0000", 2024-09-14T09:08:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7821999999999998e-05 2024-09-14T09:08:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.529 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.529 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.529 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.529 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.529 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:27.531 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:08:27.531 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:27.532+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:27.632 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:27.634+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:27.673 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:27.673 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:27.673 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:27.673 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:27.681 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:08:27.732 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:27.735+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:27.783 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:27.783 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:27.784 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:27.784 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:27.784 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:27.792 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:08:27.836 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:27.837+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:27.896 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:41 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'19)", 2024-09-14T09:08:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.154530+0000", 2024-09-14T09:08:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.742561873, 2024-09-14T09:08:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097193060000000005, 2024-09-14T09:08:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154530+0000", 2024-09-14T09:08:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154530+0000", 2024-09-14T09:08:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154531+0000", 2024-09-14T09:08:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6199999999999997e-07 2024-09-14T09:08:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154567+0000", 2024-09-14T09:08:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5988000000000002e-05 2024-09-14T09:08:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154577+0000", 2024-09-14T09:08:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0366999999999999e-05 2024-09-14T09:08:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154583+0000", 2024-09-14T09:08:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3929999999999996e-06 2024-09-14T09:08:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154630+0000", 2024-09-14T09:08:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6980000000000001e-05 2024-09-14T09:08:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.154650+0000", 2024-09-14T09:08:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9817999999999999e-05 2024-09-14T09:08:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164200+0000", 2024-09-14T09:08:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0095500770000000006 2024-09-14T09:08:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164249+0000", 2024-09-14T09:08:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9020999999999997e-05 2024-09-14T09:08:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:42 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'24, mlcod=15'19)", 2024-09-14T09:08:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:08:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.741986449999999, 2024-09-14T09:08:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0091673220000000003, 2024-09-14T09:08:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:08:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:08:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155106+0000", 2024-09-14T09:08:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5000000000000001e-07 2024-09-14T09:08:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155113+0000", 2024-09-14T09:08:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8719999999999996e-06 2024-09-14T09:08:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155126+0000", 2024-09-14T09:08:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2951e-05 2024-09-14T09:08:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155132+0000", 2024-09-14T09:08:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9270000000000002e-06 2024-09-14T09:08:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158468+0000", 2024-09-14T09:08:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033357980000000001 2024-09-14T09:08:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158510+0000", 2024-09-14T09:08:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2138999999999998e-05 2024-09-14T09:08:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164251+0000", 2024-09-14T09:08:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0057413209999999998 2024-09-14T09:08:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164273+0000", 2024-09-14T09:08:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1364000000000001e-05 2024-09-14T09:08:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:43 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'25, mlcod=15'19)", 2024-09-14T09:08:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.155476+0000", 2024-09-14T09:08:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.741615762000002, 2024-09-14T09:08:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0092500399999999993, 2024-09-14T09:08:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155476+0000", 2024-09-14T09:08:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155476+0000", 2024-09-14T09:08:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155477+0000", 2024-09-14T09:08:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5300000000000002e-07 2024-09-14T09:08:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155486+0000", 2024-09-14T09:08:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2024-09-14T09:08:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155498+0000", 2024-09-14T09:08:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2911999999999999e-05 2024-09-14T09:08:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155506+0000", 2024-09-14T09:08:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3390000000000004e-06 2024-09-14T09:08:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158814+0000", 2024-09-14T09:08:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033078309999999998 2024-09-14T09:08:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.158849+0000", 2024-09-14T09:08:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5330000000000002e-05 2024-09-14T09:08:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164691+0000", 2024-09-14T09:08:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005842346 2024-09-14T09:08:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164726+0000", 2024-09-14T09:08:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4978999999999998e-05 2024-09-14T09:08:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:44 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'26, mlcod=15'19)", 2024-09-14T09:08:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.155917+0000", 2024-09-14T09:08:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.741175245000001, 2024-09-14T09:08:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0088430230000000002, 2024-09-14T09:08:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155917+0000", 2024-09-14T09:08:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155917+0000", 2024-09-14T09:08:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155918+0000", 2024-09-14T09:08:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0359999999999999e-06 2024-09-14T09:08:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155951+0000", 2024-09-14T09:08:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3256999999999997e-05 2024-09-14T09:08:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155965+0000", 2024-09-14T09:08:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3692e-05 2024-09-14T09:08:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.155971+0000", 2024-09-14T09:08:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0510000000000002e-06 2024-09-14T09:08:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159107+0000", 2024-09-14T09:08:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031363430000000002 2024-09-14T09:08:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159127+0000", 2024-09-14T09:08:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0268999999999999e-05 2024-09-14T09:08:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164728+0000", 2024-09-14T09:08:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056003629999999997 2024-09-14T09:08:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164760+0000", 2024-09-14T09:08:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2011999999999998e-05 2024-09-14T09:08:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4171.0:45 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'27, mlcod=15'19)", 2024-09-14T09:08:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:31.156503+0000", 2024-09-14T09:08:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.740588557000002, 2024-09-14T09:08:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082756970000000003, 2024-09-14T09:08:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156503+0000", 2024-09-14T09:08:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156503+0000", 2024-09-14T09:08:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156505+0000", 2024-09-14T09:08:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8139999999999999e-06 2024-09-14T09:08:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156516+0000", 2024-09-14T09:08:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1019000000000001e-05 2024-09-14T09:08:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156543+0000", 2024-09-14T09:08:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.692e-05 2024-09-14T09:08:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.156556+0000", 2024-09-14T09:08:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3063e-05 2024-09-14T09:08:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159573+0000", 2024-09-14T09:08:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003016712 2024-09-14T09:08:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.159589+0000", 2024-09-14T09:08:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6494000000000002e-05 2024-09-14T09:08:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164762+0000", 2024-09-14T09:08:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051722519999999996 2024-09-14T09:08:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:31.164779+0000", 2024-09-14T09:08:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7422999999999999e-05 2024-09-14T09:08:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1206 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417812+0000", 2024-09-14T09:08:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.479280056, 2024-09-14T09:08:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082937259999999995, 2024-09-14T09:08:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1206 2024-09-14T09:08:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417812+0000", 2024-09-14T09:08:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417812+0000", 2024-09-14T09:08:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417812+0000", 2024-09-14T09:08:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1e-07 2024-09-14T09:08:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417813+0000", 2024-09-14T09:08:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2470000000000001e-06 2024-09-14T09:08:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417817+0000", 2024-09-14T09:08:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3720000000000001e-06 2024-09-14T09:08:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417819+0000", 2024-09-14T09:08:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3980000000000002e-06 2024-09-14T09:08:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.422429+0000", 2024-09-14T09:08:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046098040000000003 2024-09-14T09:08:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.422477+0000", 2024-09-14T09:08:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8000999999999997e-05 2024-09-14T09:08:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.422680+0000", 2024-09-14T09:08:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000202986 2024-09-14T09:08:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425417+0000", 2024-09-14T09:08:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00273742 2024-09-14T09:08:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426055+0000", 2024-09-14T09:08:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00063756800000000003 2024-09-14T09:08:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426083+0000", 2024-09-14T09:08:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7616000000000001e-05 2024-09-14T09:08:27.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426106+0000", 2024-09-14T09:08:27.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3104000000000001e-05 2024-09-14T09:08:27.923 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.923 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.923 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.923 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1207 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:27.923 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417822+0000", 2024-09-14T09:08:27.923 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.479269961, 2024-09-14T09:08:27.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.009748909, 2024-09-14T09:08:27.924 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.924 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.924 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.924 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.924 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:27.924 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:27.924 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1207 2024-09-14T09:08:27.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.924 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417822+0000", 2024-09-14T09:08:27.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417822+0000", 2024-09-14T09:08:27.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417822+0000", 2024-09-14T09:08:27.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.36e-07 2024-09-14T09:08:27.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417824+0000", 2024-09-14T09:08:27.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4410000000000001e-06 2024-09-14T09:08:27.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417827+0000", 2024-09-14T09:08:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8600000000000001e-06 2024-09-14T09:08:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417829+0000", 2024-09-14T09:08:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4200000000000001e-06 2024-09-14T09:08:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.423665+0000", 2024-09-14T09:08:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058360590000000002 2024-09-14T09:08:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.423755+0000", 2024-09-14T09:08:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9999000000000003e-05 2024-09-14T09:08:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424113+0000", 2024-09-14T09:08:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00035816599999999999 2024-09-14T09:08:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426112+0000", 2024-09-14T09:08:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019984209999999998 2024-09-14T09:08:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427498+0000", 2024-09-14T09:08:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013862049999999999 2024-09-14T09:08:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427534+0000", 2024-09-14T09:08:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6609999999999997e-05 2024-09-14T09:08:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427571+0000", 2024-09-14T09:08:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6492000000000002e-05 2024-09-14T09:08:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1208 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417832+0000", 2024-09-14T09:08:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.479260185000001, 2024-09-14T09:08:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0098905280000000009, 2024-09-14T09:08:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1208 2024-09-14T09:08:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417832+0000", 2024-09-14T09:08:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417832+0000", 2024-09-14T09:08:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417832+0000", 2024-09-14T09:08:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2399999999999999e-07 2024-09-14T09:08:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417833+0000", 2024-09-14T09:08:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0950000000000001e-06 2024-09-14T09:08:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417842+0000", 2024-09-14T09:08:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3959999999999995e-06 2024-09-14T09:08:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417846+0000", 2024-09-14T09:08:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4649999999999999e-06 2024-09-14T09:08:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424607+0000", 2024-09-14T09:08:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067611750000000003 2024-09-14T09:08:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.424690+0000", 2024-09-14T09:08:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2890000000000001e-05 2024-09-14T09:08:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425029+0000", 2024-09-14T09:08:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033934900000000002 2024-09-14T09:08:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427460+0000", 2024-09-14T09:08:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024307619999999999 2024-09-14T09:08:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427624+0000", 2024-09-14T09:08:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000163404 2024-09-14T09:08:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427681+0000", 2024-09-14T09:08:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7748999999999999e-05 2024-09-14T09:08:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427722+0000", 2024-09-14T09:08:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1019000000000001e-05 2024-09-14T09:08:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1209 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417851+0000", 2024-09-14T09:08:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.479240679, 2024-09-14T09:08:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010012681000000001, 2024-09-14T09:08:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1209 2024-09-14T09:08:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417851+0000", 2024-09-14T09:08:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417851+0000", 2024-09-14T09:08:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417852+0000", 2024-09-14T09:08:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.84e-07 2024-09-14T09:08:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417853+0000", 2024-09-14T09:08:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6589999999999999e-06 2024-09-14T09:08:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417857+0000", 2024-09-14T09:08:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7050000000000001e-06 2024-09-14T09:08:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417860+0000", 2024-09-14T09:08:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.242e-06 2024-09-14T09:08:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425469+0000", 2024-09-14T09:08:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076089 2024-09-14T09:08:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425553+0000", 2024-09-14T09:08:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3657000000000002e-05 2024-09-14T09:08:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425782+0000", 2024-09-14T09:08:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000229519 2024-09-14T09:08:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427775+0000", 2024-09-14T09:08:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019930289999999999 2024-09-14T09:08:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427794+0000", 2024-09-14T09:08:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8238999999999999e-05 2024-09-14T09:08:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427827+0000", 2024-09-14T09:08:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3045e-05 2024-09-14T09:08:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427864+0000", 2024-09-14T09:08:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7401999999999999e-05 2024-09-14T09:08:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1210 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417864+0000", 2024-09-14T09:08:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.479227605999998, 2024-09-14T09:08:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011675377000000001, 2024-09-14T09:08:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1210 2024-09-14T09:08:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417864+0000", 2024-09-14T09:08:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417864+0000", 2024-09-14T09:08:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417865+0000", 2024-09-14T09:08:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.34e-07 2024-09-14T09:08:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417866+0000", 2024-09-14T09:08:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.384e-06 2024-09-14T09:08:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417869+0000", 2024-09-14T09:08:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.971e-06 2024-09-14T09:08:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417872+0000", 2024-09-14T09:08:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5979999999999999e-06 2024-09-14T09:08:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426155+0000", 2024-09-14T09:08:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082832389999999995 2024-09-14T09:08:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426236+0000", 2024-09-14T09:08:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1241000000000004e-05 2024-09-14T09:08:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426477+0000", 2024-09-14T09:08:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024123999999999999 2024-09-14T09:08:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427872+0000", 2024-09-14T09:08:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001394714 2024-09-14T09:08:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.429483+0000", 2024-09-14T09:08:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001611124 2024-09-14T09:08:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.429515+0000", 2024-09-14T09:08:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2243000000000003e-05 2024-09-14T09:08:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.429540+0000", 2024-09-14T09:08:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4389e-05 2024-09-14T09:08:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4782.0:193 3.17 3:e98abfa9:::rbd_data.11127a12d636.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write 3887104~20480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-14T09:08:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:09.305741+0000", 2024-09-14T09:08:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.591350725000002, 2024-09-14T09:08:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0081452360000000001, 2024-09-14T09:08:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4782", 2024-09-14T09:08:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/353415140", 2024-09-14T09:08:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 193 2024-09-14T09:08:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.305741+0000", 2024-09-14T09:08:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.305741+0000", 2024-09-14T09:08:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.305742+0000", 2024-09-14T09:08:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5700000000000002e-07 2024-09-14T09:08:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.307981+0000", 2024-09-14T09:08:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022389200000000001 2024-09-14T09:08:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.307992+0000", 2024-09-14T09:08:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1681999999999999e-05 2024-09-14T09:08:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.307998+0000", 2024-09-14T09:08:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6520000000000003e-06 2024-09-14T09:08:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.308039+0000", 2024-09-14T09:08:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0611999999999997e-05 2024-09-14T09:08:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.308130+0000", 2024-09-14T09:08:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0896999999999994e-05 2024-09-14T09:08:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.308394+0000", 2024-09-14T09:08:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00026417600000000003 2024-09-14T09:08:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.312043+0000", 2024-09-14T09:08:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00364921 2024-09-14T09:08:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.313829+0000", 2024-09-14T09:08:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001785738 2024-09-14T09:08:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.313862+0000", 2024-09-14T09:08:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3096000000000003e-05 2024-09-14T09:08:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.313886+0000", 2024-09-14T09:08:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4695999999999999e-05 2024-09-14T09:08:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4959.0:1607 3.1f 3:fa2aaa39:::rbd_data.1112aacd2bc3.000000000000000b:14 [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T09:08:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:23.973917+0000", 2024-09-14T09:08:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.9231753940000003, 2024-09-14T09:08:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0081639690000000001, 2024-09-14T09:08:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4959", 2024-09-14T09:08:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/824983630", 2024-09-14T09:08:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1607 2024-09-14T09:08:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.973917+0000", 2024-09-14T09:08:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.973917+0000", 2024-09-14T09:08:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.973917+0000", 2024-09-14T09:08:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6199999999999999e-07 2024-09-14T09:08:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.973919+0000", 2024-09-14T09:08:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.756e-06 2024-09-14T09:08:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.973925+0000", 2024-09-14T09:08:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2720000000000003e-06 2024-09-14T09:08:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.973930+0000", 2024-09-14T09:08:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.865e-06 2024-09-14T09:08:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.981908+0000", 2024-09-14T09:08:27.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079786609999999997 2024-09-14T09:08:27.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.981975+0000", 2024-09-14T09:08:27.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6173000000000005e-05 2024-09-14T09:08:27.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.982081+0000", 2024-09-14T09:08:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010588 2024-09-14T09:08:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4959.0:1608 3.1f 3:fa2aaa39:::rbd_data.1112aacd2bc3.000000000000000b:14 [read 720896~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T09:08:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:23.973936+0000", 2024-09-14T09:08:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.9231561560000001, 2024-09-14T09:08:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0083644259999999995, 2024-09-14T09:08:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:27.958 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.958 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4959", 2024-09-14T09:08:27.958 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/824983630", 2024-09-14T09:08:27.958 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1608 2024-09-14T09:08:27.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.958 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.973936+0000", 2024-09-14T09:08:27.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.973936+0000", 2024-09-14T09:08:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.973936+0000", 2024-09-14T09:08:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7399999999999999e-07 2024-09-14T09:08:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.973938+0000", 2024-09-14T09:08:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6360000000000001e-06 2024-09-14T09:08:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.973944+0000", 2024-09-14T09:08:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8030000000000002e-06 2024-09-14T09:08:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.973948+0000", 2024-09-14T09:08:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7199999999999997e-06 2024-09-14T09:08:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.982120+0000", 2024-09-14T09:08:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0081719919999999995 2024-09-14T09:08:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.982195+0000", 2024-09-14T09:08:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4704999999999997e-05 2024-09-14T09:08:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.982300+0000", 2024-09-14T09:08:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105196 2024-09-14T09:08:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4959.0:1609 3.1f 3:fa2aaa39:::rbd_data.1112aacd2bc3.000000000000000b:14 [read 884736~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T09:08:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:23.973971+0000", 2024-09-14T09:08:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.9231213780000003, 2024-09-14T09:08:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0085125240000000005, 2024-09-14T09:08:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4959", 2024-09-14T09:08:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/824983630", 2024-09-14T09:08:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1609 2024-09-14T09:08:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.973971+0000", 2024-09-14T09:08:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.973971+0000", 2024-09-14T09:08:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.973971+0000", 2024-09-14T09:08:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.09e-07 2024-09-14T09:08:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.973976+0000", 2024-09-14T09:08:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1330000000000001e-06 2024-09-14T09:08:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.973986+0000", 2024-09-14T09:08:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0379e-05 2024-09-14T09:08:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.973993+0000", 2024-09-14T09:08:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1080000000000004e-06 2024-09-14T09:08:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.982325+0000", 2024-09-14T09:08:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0083324620000000005 2024-09-14T09:08:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.982388+0000", 2024-09-14T09:08:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2756999999999996e-05 2024-09-14T09:08:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.982483+0000", 2024-09-14T09:08:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4876000000000004e-05 2024-09-14T09:08:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4959.0:1617 3.1f 3:f8e6e645:::rbd_data.1112aacd2bc3.0000000000000009:14 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T09:08:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:23.974006+0000", 2024-09-14T09:08:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.9230864570000001, 2024-09-14T09:08:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0086785109999999999, 2024-09-14T09:08:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4959", 2024-09-14T09:08:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/824983630", 2024-09-14T09:08:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1617 2024-09-14T09:08:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974006+0000", 2024-09-14T09:08:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974006+0000", 2024-09-14T09:08:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974006+0000", 2024-09-14T09:08:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.44e-07 2024-09-14T09:08:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974015+0000", 2024-09-14T09:08:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6989999999999992e-06 2024-09-14T09:08:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974031+0000", 2024-09-14T09:08:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6745999999999999e-05 2024-09-14T09:08:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974042+0000", 2024-09-14T09:08:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0763e-05 2024-09-14T09:08:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.982512+0000", 2024-09-14T09:08:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084700299999999999 2024-09-14T09:08:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.982586+0000", 2024-09-14T09:08:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3632000000000002e-05 2024-09-14T09:08:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.982684+0000", 2024-09-14T09:08:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8097000000000006e-05 2024-09-14T09:08:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4959.0:1618 3.1f 3:f8e6e645:::rbd_data.1112aacd2bc3.0000000000000009:14 [read 802816~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T09:08:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:23.974052+0000", 2024-09-14T09:08:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.9230402140000002, 2024-09-14T09:08:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0088812630000000004, 2024-09-14T09:08:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4959", 2024-09-14T09:08:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/824983630", 2024-09-14T09:08:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1618 2024-09-14T09:08:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974052+0000", 2024-09-14T09:08:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974052+0000", 2024-09-14T09:08:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974052+0000", 2024-09-14T09:08:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.58e-07 2024-09-14T09:08:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974054+0000", 2024-09-14T09:08:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.815e-06 2024-09-14T09:08:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974058+0000", 2024-09-14T09:08:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.031e-06 2024-09-14T09:08:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974061+0000", 2024-09-14T09:08:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8420000000000001e-06 2024-09-14T09:08:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.982718+0000", 2024-09-14T09:08:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0086575439999999997 2024-09-14T09:08:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.982797+0000", 2024-09-14T09:08:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8975999999999997e-05 2024-09-14T09:08:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.982933+0000", 2024-09-14T09:08:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-09-14T09:08:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4959.0:1619 3.1f 3:f8e6e645:::rbd_data.1112aacd2bc3.0000000000000009:14 [read 966656~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T09:08:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:23.974065+0000", 2024-09-14T09:08:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.9230272500000001, 2024-09-14T09:08:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0090678779999999997, 2024-09-14T09:08:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4959", 2024-09-14T09:08:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/824983630", 2024-09-14T09:08:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1619 2024-09-14T09:08:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974065+0000", 2024-09-14T09:08:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974065+0000", 2024-09-14T09:08:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974065+0000", 2024-09-14T09:08:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5499999999999999e-07 2024-09-14T09:08:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974066+0000", 2024-09-14T09:08:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1680000000000001e-06 2024-09-14T09:08:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974070+0000", 2024-09-14T09:08:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3499999999999999e-06 2024-09-14T09:08:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974075+0000", 2024-09-14T09:08:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1860000000000002e-06 2024-09-14T09:08:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.982961+0000", 2024-09-14T09:08:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0088867789999999992 2024-09-14T09:08:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.983035+0000", 2024-09-14T09:08:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3899999999999994e-05 2024-09-14T09:08:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.983133+0000", 2024-09-14T09:08:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7239999999999997e-05 2024-09-14T09:08:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4959.0:1623 3.1f 3:fa2aaa39:::rbd_data.1112aacd2bc3.000000000000000b:14 [read 573440~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T09:08:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:23.974133+0000", 2024-09-14T09:08:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.9229589379999998, 2024-09-14T09:08:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0092269659999999996, 2024-09-14T09:08:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4959", 2024-09-14T09:08:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/824983630", 2024-09-14T09:08:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1623 2024-09-14T09:08:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974133+0000", 2024-09-14T09:08:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974133+0000", 2024-09-14T09:08:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974133+0000", 2024-09-14T09:08:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3799999999999999e-07 2024-09-14T09:08:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974134+0000", 2024-09-14T09:08:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0729999999999999e-06 2024-09-14T09:08:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974137+0000", 2024-09-14T09:08:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.106e-06 2024-09-14T09:08:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974140+0000", 2024-09-14T09:08:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4329999999999998e-06 2024-09-14T09:08:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.983164+0000", 2024-09-14T09:08:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0090242340000000008 2024-09-14T09:08:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.983231+0000", 2024-09-14T09:08:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.648e-05 2024-09-14T09:08:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.983360+0000", 2024-09-14T09:08:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012940200000000001 2024-09-14T09:08:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4959.0:1624 3.1f 3:fa2aaa39:::rbd_data.1112aacd2bc3.000000000000000b:14 [read 737280~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T09:08:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:23.974143+0000", 2024-09-14T09:08:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.9229490060000001, 2024-09-14T09:08:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0094009609999999993, 2024-09-14T09:08:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4959", 2024-09-14T09:08:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/824983630", 2024-09-14T09:08:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1624 2024-09-14T09:08:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974143+0000", 2024-09-14T09:08:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974143+0000", 2024-09-14T09:08:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974143+0000", 2024-09-14T09:08:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3900000000000001e-07 2024-09-14T09:08:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974144+0000", 2024-09-14T09:08:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0979999999999999e-06 2024-09-14T09:08:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974150+0000", 2024-09-14T09:08:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9410000000000004e-06 2024-09-14T09:08:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974155+0000", 2024-09-14T09:08:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2930000000000002e-06 2024-09-14T09:08:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.983392+0000", 2024-09-14T09:08:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0092371220000000004 2024-09-14T09:08:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.983450+0000", 2024-09-14T09:08:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8035000000000003e-05 2024-09-14T09:08:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.983544+0000", 2024-09-14T09:08:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4233000000000004e-05 2024-09-14T09:08:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4959.0:1625 3.1f 3:fa2aaa39:::rbd_data.1112aacd2bc3.000000000000000b:14 [read 901120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T09:08:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:23.974159+0000", 2024-09-14T09:08:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.922933285, 2024-09-14T09:08:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0095672150000000004, 2024-09-14T09:08:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4959", 2024-09-14T09:08:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/824983630", 2024-09-14T09:08:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1625 2024-09-14T09:08:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974159+0000", 2024-09-14T09:08:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974159+0000", 2024-09-14T09:08:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974159+0000", 2024-09-14T09:08:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3799999999999997e-07 2024-09-14T09:08:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974161+0000", 2024-09-14T09:08:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6419999999999999e-06 2024-09-14T09:08:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974166+0000", 2024-09-14T09:08:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4029999999999998e-06 2024-09-14T09:08:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.974171+0000", 2024-09-14T09:08:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4560000000000002e-06 2024-09-14T09:08:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.983581+0000", 2024-09-14T09:08:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0094100499999999997 2024-09-14T09:08:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.983655+0000", 2024-09-14T09:08:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4259999999999997e-05 2024-09-14T09:08:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.983726+0000", 2024-09-14T09:08:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0865999999999995e-05 2024-09-14T09:08:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.993 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:27.993 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:27.993 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:27.993 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T09:08:27.995 INFO:teuthology.orchestra.run.smithi116.stdout:moved 4 / 82 (4.87805%) 2024-09-14T09:08:27.995 INFO:teuthology.orchestra.run.smithi116.stdout:avg 13.6667 2024-09-14T09:08:27.995 INFO:teuthology.orchestra.run.smithi116.stdout:stddev 1.49071 -> 3.03681 (expected baseline 3.37474) 2024-09-14T09:08:27.995 INFO:teuthology.orchestra.run.smithi116.stdout:min osd.0 with 12 -> 9 pgs (0.878049 -> 0.658537 * mean) 2024-09-14T09:08:27.995 INFO:teuthology.orchestra.run.smithi116.stdout:max osd.3 with 16 -> 19 pgs (1.17073 -> 1.39024 * mean) 2024-09-14T09:08:27.995 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:08:27.996 INFO:teuthology.orchestra.run.smithi116.stdout:oload 110 2024-09-14T09:08:27.996 INFO:teuthology.orchestra.run.smithi116.stdout:max_change 1 2024-09-14T09:08:27.996 INFO:teuthology.orchestra.run.smithi116.stdout:max_change_osds 4 2024-09-14T09:08:27.996 INFO:teuthology.orchestra.run.smithi116.stdout:average_utilization 0.0006 2024-09-14T09:08:27.996 INFO:teuthology.orchestra.run.smithi116.stdout:overload_utilization 0.0006 2024-09-14T09:08:27.996 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0 weight 0.7755 -> 0.6014 2024-09-14T09:08:27.996 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2 weight 0.8648 -> 0.7479 2024-09-14T09:08:27.996 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-14T09:08:27.997 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 0.05 2024-09-14T09:08:27.997 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:27.996+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:27.997 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:08:28.095 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:28.097+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:28.144 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:28.144 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:28.144 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:08:28.144 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:28.157 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:08:28.196 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:28.198+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:28.261 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:28.262 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:28.262 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:28.262 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:28.262 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:28.270 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:08:28.297 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:28.299+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:28.345 INFO:teuthology.orchestra.run.smithi116.stdout:moved 0 / 82 (0%) 2024-09-14T09:08:28.345 INFO:teuthology.orchestra.run.smithi116.stdout:avg 13.6667 2024-09-14T09:08:28.345 INFO:teuthology.orchestra.run.smithi116.stdout:stddev 3.03681 -> 3.03681 (expected baseline 3.37474) 2024-09-14T09:08:28.345 INFO:teuthology.orchestra.run.smithi116.stdout:min osd.0 with 9 -> 9 pgs (0.658537 -> 0.658537 * mean) 2024-09-14T09:08:28.345 INFO:teuthology.orchestra.run.smithi116.stdout:max osd.3 with 19 -> 19 pgs (1.39024 -> 1.39024 * mean) 2024-09-14T09:08:28.345 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:08:28.346 INFO:teuthology.orchestra.run.smithi116.stdout:oload 1000 2024-09-14T09:08:28.346 INFO:teuthology.orchestra.run.smithi116.stdout:max_change 0.05 2024-09-14T09:08:28.346 INFO:teuthology.orchestra.run.smithi116.stdout:max_change_osds 4 2024-09-14T09:08:28.346 INFO:teuthology.orchestra.run.smithi116.stdout:average_utilization 0.0006 2024-09-14T09:08:28.346 INFO:teuthology.orchestra.run.smithi116.stdout:overload_utilization 0.0058 2024-09-14T09:08:28.346 INFO:teuthology.orchestra.run.smithi116.stderr:no change 2024-09-14T09:08:28.358 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-14T09:08:28.358 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 1.0 2024-09-14T09:08:28.379 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:28.379 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:28.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:28.379 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:28.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.379 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7729 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 110592~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:28.379 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030100+0000", 2024-09-14T09:08:28.380 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3504133770000006, 2024-09-14T09:08:28.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.063698092999999997, 2024-09-14T09:08:28.380 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:28.380 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:28.380 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:28.380 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:28.380 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:28.380 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:28.380 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7729 2024-09-14T09:08:28.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.380 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:28.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:28.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030100+0000", 2024-09-14T09:08:28.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:28.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030100+0000", 2024-09-14T09:08:28.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:28.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030100+0000", 2024-09-14T09:08:28.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:08:28.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:28.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030102+0000", 2024-09-14T09:08:28.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7680000000000001e-06 2024-09-14T09:08:28.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:28.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030108+0000", 2024-09-14T09:08:28.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3779999999999998e-06 2024-09-14T09:08:28.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:28.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030113+0000", 2024-09-14T09:08:28.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1220000000000003e-06 2024-09-14T09:08:28.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:28.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.093499+0000", 2024-09-14T09:08:28.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.063385996 2024-09-14T09:08:28.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:28.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.093586+0000", 2024-09-14T09:08:28.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6998999999999998e-05 2024-09-14T09:08:28.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:28.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.093798+0000", 2024-09-14T09:08:28.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021145499999999999 2024-09-14T09:08:28.384 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.384 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:28.384 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.384 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7730 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 120832~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:28.384 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030120+0000", 2024-09-14T09:08:28.384 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3503933830000001, 2024-09-14T09:08:28.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064066104999999998, 2024-09-14T09:08:28.385 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:28.385 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:28.385 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:28.385 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:28.385 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:28.385 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:28.385 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7730 2024-09-14T09:08:28.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.385 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:28.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:28.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030120+0000", 2024-09-14T09:08:28.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:28.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030120+0000", 2024-09-14T09:08:28.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:28.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030120+0000", 2024-09-14T09:08:28.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9200000000000002e-07 2024-09-14T09:08:28.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:28.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030122+0000", 2024-09-14T09:08:28.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.798e-06 2024-09-14T09:08:28.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:28.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030130+0000", 2024-09-14T09:08:28.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7510000000000008e-06 2024-09-14T09:08:28.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:28.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030135+0000", 2024-09-14T09:08:28.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1769999999999997e-06 2024-09-14T09:08:28.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:28.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.093839+0000", 2024-09-14T09:08:28.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.063704574 2024-09-14T09:08:28.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:28.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.093932+0000", 2024-09-14T09:08:28.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2119000000000004e-05 2024-09-14T09:08:28.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:28.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094186+0000", 2024-09-14T09:08:28.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025429400000000002 2024-09-14T09:08:28.389 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.389 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:28.389 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.389 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7731 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 147456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:28.390 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030142+0000", 2024-09-14T09:08:28.390 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3503715360000008, 2024-09-14T09:08:28.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064431020000000006, 2024-09-14T09:08:28.390 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:28.390 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:28.390 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:28.390 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:28.390 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:28.390 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:28.390 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7731 2024-09-14T09:08:28.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.390 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:28.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:28.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030142+0000", 2024-09-14T09:08:28.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:28.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030142+0000", 2024-09-14T09:08:28.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:28.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030142+0000", 2024-09-14T09:08:28.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2300000000000002e-07 2024-09-14T09:08:28.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:28.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030144+0000", 2024-09-14T09:08:28.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9e-06 2024-09-14T09:08:28.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:28.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030151+0000", 2024-09-14T09:08:28.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6000000000000003e-06 2024-09-14T09:08:28.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:28.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030156+0000", 2024-09-14T09:08:28.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9960000000000001e-06 2024-09-14T09:08:28.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:28.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094250+0000", 2024-09-14T09:08:28.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064094715999999996 2024-09-14T09:08:28.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:28.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094329+0000", 2024-09-14T09:08:28.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8812000000000004e-05 2024-09-14T09:08:28.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:28.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094573+0000", 2024-09-14T09:08:28.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024357299999999999 2024-09-14T09:08:28.394 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.394 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:28.394 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.394 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7732 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 157696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:28.394 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030162+0000", 2024-09-14T09:08:28.394 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3503512860000004, 2024-09-14T09:08:28.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064786951999999995, 2024-09-14T09:08:28.394 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:28.394 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:28.395 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:28.395 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:28.395 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:28.395 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:28.395 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7732 2024-09-14T09:08:28.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.395 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:28.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:28.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030162+0000", 2024-09-14T09:08:28.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:28.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030162+0000", 2024-09-14T09:08:28.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:28.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030162+0000", 2024-09-14T09:08:28.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.03e-07 2024-09-14T09:08:28.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:28.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030164+0000", 2024-09-14T09:08:28.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7e-06 2024-09-14T09:08:28.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:28.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030170+0000", 2024-09-14T09:08:28.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1369999999999999e-06 2024-09-14T09:08:28.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:28.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030182+0000", 2024-09-14T09:08:28.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1989e-05 2024-09-14T09:08:28.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:28.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094614+0000", 2024-09-14T09:08:28.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064431863000000006 2024-09-14T09:08:28.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:28.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094703+0000", 2024-09-14T09:08:28.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9021e-05 2024-09-14T09:08:28.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:28.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094949+0000", 2024-09-14T09:08:28.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024583899999999998 2024-09-14T09:08:28.398 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.399 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:28.399 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.399 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7733 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 167936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:28.399 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030194+0000", 2024-09-14T09:08:28.399 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3503190089999997, 2024-09-14T09:08:28.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065137113999999996, 2024-09-14T09:08:28.399 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:28.399 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:28.399 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:28.399 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:28.399 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:28.399 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:28.400 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7733 2024-09-14T09:08:28.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.400 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:28.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:28.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030194+0000", 2024-09-14T09:08:28.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:28.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030194+0000", 2024-09-14T09:08:28.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:28.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030195+0000", 2024-09-14T09:08:28.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:08:28.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:28.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030207+0000", 2024-09-14T09:08:28.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2452999999999999e-05 2024-09-14T09:08:28.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:28.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030218+0000", 2024-09-14T09:08:28.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1035e-05 2024-09-14T09:08:28.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:28.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030224+0000", 2024-09-14T09:08:28.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7100000000000004e-06 2024-09-14T09:08:28.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:28.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094993+0000", 2024-09-14T09:08:28.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064769312999999995 2024-09-14T09:08:28.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:28.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.095089+0000", 2024-09-14T09:08:28.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5768999999999997e-05 2024-09-14T09:08:28.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:28.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.095331+0000", 2024-09-14T09:08:28.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000242372 2024-09-14T09:08:28.403 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.403 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:28.403 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.403 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7734 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:28.403 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030232+0000", 2024-09-14T09:08:28.403 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3502806970000005, 2024-09-14T09:08:28.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065430487999999995, 2024-09-14T09:08:28.403 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:28.403 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:28.404 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:28.404 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:28.404 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:28.404 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:28.404 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7734 2024-09-14T09:08:28.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.404 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:28.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:28.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030232+0000", 2024-09-14T09:08:28.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:28.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030232+0000", 2024-09-14T09:08:28.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:28.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030233+0000", 2024-09-14T09:08:28.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0200000000000002e-07 2024-09-14T09:08:28.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:28.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030235+0000", 2024-09-14T09:08:28.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0669999999999999e-06 2024-09-14T09:08:28.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:28.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030242+0000", 2024-09-14T09:08:28.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6229999999999999e-06 2024-09-14T09:08:28.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:28.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030247+0000", 2024-09-14T09:08:28.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0969999999999996e-06 2024-09-14T09:08:28.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:28.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.095374+0000", 2024-09-14T09:08:28.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065127510999999999 2024-09-14T09:08:28.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:28.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.095464+0000", 2024-09-14T09:08:28.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0214000000000001e-05 2024-09-14T09:08:28.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:28.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.095663+0000", 2024-09-14T09:08:28.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000198474 2024-09-14T09:08:28.407 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.407 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:28.407 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.407 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7735 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 204800~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:28.407 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030253+0000", 2024-09-14T09:08:28.408 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3502598559999992, 2024-09-14T09:08:28.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065785715999999994, 2024-09-14T09:08:28.408 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:28.408 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:28.408 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:28.408 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:28.408 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:28.408 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:28.408 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7735 2024-09-14T09:08:28.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.408 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:28.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:28.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030253+0000", 2024-09-14T09:08:28.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:28.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030253+0000", 2024-09-14T09:08:28.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:28.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030637+0000", 2024-09-14T09:08:28.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038390100000000002 2024-09-14T09:08:28.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:28.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030641+0000", 2024-09-14T09:08:28.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5300000000000001e-06 2024-09-14T09:08:28.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:28.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030657+0000", 2024-09-14T09:08:28.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6390000000000001e-05 2024-09-14T09:08:28.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:28.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030665+0000", 2024-09-14T09:08:28.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5129999999999999e-06 2024-09-14T09:08:28.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:28.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.095704+0000", 2024-09-14T09:08:28.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065039447 2024-09-14T09:08:28.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:28.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.095791+0000", 2024-09-14T09:08:28.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6835000000000005e-05 2024-09-14T09:08:28.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:28.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096039+0000", 2024-09-14T09:08:28.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024810000000000001 2024-09-14T09:08:28.411 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.411 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:28.411 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.412 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7736 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:28.412 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030685+0000", 2024-09-14T09:08:28.412 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3498286289999992, 2024-09-14T09:08:28.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065670936999999999, 2024-09-14T09:08:28.412 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:28.412 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:28.412 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:28.412 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:28.412 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:28.412 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:28.412 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7736 2024-09-14T09:08:28.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.412 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:28.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:28.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030685+0000", 2024-09-14T09:08:28.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:28.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030685+0000", 2024-09-14T09:08:28.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:28.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030685+0000", 2024-09-14T09:08:28.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4799999999999998e-07 2024-09-14T09:08:28.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:28.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030688+0000", 2024-09-14T09:08:28.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6400000000000001e-06 2024-09-14T09:08:28.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:28.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030695+0000", 2024-09-14T09:08:28.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6350000000000006e-06 2024-09-14T09:08:28.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:28.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030736+0000", 2024-09-14T09:08:28.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0932e-05 2024-09-14T09:08:28.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:28.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096080+0000", 2024-09-14T09:08:28.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065344019000000003 2024-09-14T09:08:28.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:28.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096169+0000", 2024-09-14T09:08:28.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9031999999999997e-05 2024-09-14T09:08:28.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:28.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096355+0000", 2024-09-14T09:08:28.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186131 2024-09-14T09:08:28.416 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.416 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:28.416 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.416 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7737 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 225280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:28.416 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030748+0000", 2024-09-14T09:08:28.416 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3497654919999995, 2024-09-14T09:08:28.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065915538999999995, 2024-09-14T09:08:28.416 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:28.416 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:28.416 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:28.416 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:28.417 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:28.417 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:28.417 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7737 2024-09-14T09:08:28.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.417 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:28.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:28.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030748+0000", 2024-09-14T09:08:28.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:28.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030748+0000", 2024-09-14T09:08:28.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:28.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030748+0000", 2024-09-14T09:08:28.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9100000000000004e-07 2024-09-14T09:08:28.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:28.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030751+0000", 2024-09-14T09:08:28.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.661e-06 2024-09-14T09:08:28.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:28.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030759+0000", 2024-09-14T09:08:28.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9270000000000005e-06 2024-09-14T09:08:28.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:28.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030765+0000", 2024-09-14T09:08:28.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.75e-06 2024-09-14T09:08:28.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:28.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096389+0000", 2024-09-14T09:08:28.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065624403999999997 2024-09-14T09:08:28.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:28.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096476+0000", 2024-09-14T09:08:28.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6625999999999994e-05 2024-09-14T09:08:28.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:28.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096663+0000", 2024-09-14T09:08:28.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018757999999999999 2024-09-14T09:08:28.420 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.420 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:28.420 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.420 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7738 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 235520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:28.421 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030772+0000", 2024-09-14T09:08:28.421 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3497411249999995, 2024-09-14T09:08:28.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.066203479999999995, 2024-09-14T09:08:28.421 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:28.421 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:28.421 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:28.421 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:28.421 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:28.421 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:28.421 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7738 2024-09-14T09:08:28.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.421 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:28.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:28.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030772+0000", 2024-09-14T09:08:28.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:28.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030772+0000", 2024-09-14T09:08:28.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:28.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030772+0000", 2024-09-14T09:08:28.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3000000000000001e-07 2024-09-14T09:08:28.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:28.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030775+0000", 2024-09-14T09:08:28.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0930000000000001e-06 2024-09-14T09:08:28.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:28.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030782+0000", 2024-09-14T09:08:28.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9600000000000003e-06 2024-09-14T09:08:28.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:28.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030787+0000", 2024-09-14T09:08:28.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4670000000000003e-06 2024-09-14T09:08:28.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:28.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096696+0000", 2024-09-14T09:08:28.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065909258999999998 2024-09-14T09:08:28.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:28.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096785+0000", 2024-09-14T09:08:28.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8931000000000006e-05 2024-09-14T09:08:28.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:28.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096976+0000", 2024-09-14T09:08:28.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019034 2024-09-14T09:08:28.425 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.425 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:28.425 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.425 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7913 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 139264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:28.425 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041493+0000", 2024-09-14T09:08:28.425 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3390204830000005, 2024-09-14T09:08:28.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.063885727000000003, 2024-09-14T09:08:28.425 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:28.425 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:28.425 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:28.425 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:28.425 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:28.426 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:28.426 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7913 2024-09-14T09:08:28.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.426 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:28.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:28.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041493+0000", 2024-09-14T09:08:28.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:28.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041493+0000", 2024-09-14T09:08:28.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:28.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041493+0000", 2024-09-14T09:08:28.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9299999999999999e-07 2024-09-14T09:08:28.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:28.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041494+0000", 2024-09-14T09:08:28.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0279999999999999e-06 2024-09-14T09:08:28.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:28.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041497+0000", 2024-09-14T09:08:28.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.039e-06 2024-09-14T09:08:28.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:28.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041500+0000", 2024-09-14T09:08:28.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8059999999999999e-06 2024-09-14T09:08:28.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:28.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105044+0000", 2024-09-14T09:08:28.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.063544426000000001 2024-09-14T09:08:28.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:28.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105126+0000", 2024-09-14T09:08:28.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1565999999999998e-05 2024-09-14T09:08:28.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:28.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105378+0000", 2024-09-14T09:08:28.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025256900000000001 2024-09-14T09:08:28.429 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.429 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:28.429 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.429 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7914 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 149504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:28.429 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041505+0000", 2024-09-14T09:08:28.429 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3390085710000008, 2024-09-14T09:08:28.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064171309999999995, 2024-09-14T09:08:28.430 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:28.430 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:28.430 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:28.430 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:28.430 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:28.430 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:28.430 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7914 2024-09-14T09:08:28.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.430 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:28.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:28.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041505+0000", 2024-09-14T09:08:28.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:28.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041505+0000", 2024-09-14T09:08:28.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:28.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041505+0000", 2024-09-14T09:08:28.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8500000000000002e-07 2024-09-14T09:08:28.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:28.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041507+0000", 2024-09-14T09:08:28.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.654e-06 2024-09-14T09:08:28.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:28.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041512+0000", 2024-09-14T09:08:28.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4709999999999998e-06 2024-09-14T09:08:28.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:28.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041516+0000", 2024-09-14T09:08:28.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1339999999999997e-06 2024-09-14T09:08:28.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:28.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105410+0000", 2024-09-14T09:08:28.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.063894216000000004 2024-09-14T09:08:28.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:28.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105489+0000", 2024-09-14T09:08:28.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9152000000000004e-05 2024-09-14T09:08:28.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:28.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105676+0000", 2024-09-14T09:08:28.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186398 2024-09-14T09:08:28.433 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.433 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:28.433 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.434 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7915 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:28.434 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041522+0000", 2024-09-14T09:08:28.434 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3389912180000003, 2024-09-14T09:08:28.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064491719000000003, 2024-09-14T09:08:28.434 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:28.434 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:28.434 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:28.434 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:28.434 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:28.434 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:28.434 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7915 2024-09-14T09:08:28.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.434 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:28.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:28.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041522+0000", 2024-09-14T09:08:28.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:28.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041522+0000", 2024-09-14T09:08:28.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:28.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041522+0000", 2024-09-14T09:08:28.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1600000000000002e-07 2024-09-14T09:08:28.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:28.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041524+0000", 2024-09-14T09:08:28.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.812e-06 2024-09-14T09:08:28.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:28.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041530+0000", 2024-09-14T09:08:28.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8579999999999996e-06 2024-09-14T09:08:28.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:28.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041534+0000", 2024-09-14T09:08:28.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5430000000000004e-06 2024-09-14T09:08:28.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:28.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105723+0000", 2024-09-14T09:08:28.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064188532000000006 2024-09-14T09:08:28.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:28.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105809+0000", 2024-09-14T09:08:28.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6098000000000001e-05 2024-09-14T09:08:28.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:28.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.106014+0000", 2024-09-14T09:08:28.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020456000000000001 2024-09-14T09:08:28.437 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.437 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:28.437 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.438 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7916 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 169984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:28.438 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041540+0000", 2024-09-14T09:08:28.438 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3389727689999997, 2024-09-14T09:08:28.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064847347999999999, 2024-09-14T09:08:28.438 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:28.438 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:28.438 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:28.438 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:28.438 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:28.438 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:28.438 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7916 2024-09-14T09:08:28.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.439 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:28.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:28.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041540+0000", 2024-09-14T09:08:28.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:28.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041540+0000", 2024-09-14T09:08:28.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:28.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041541+0000", 2024-09-14T09:08:28.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.58e-07 2024-09-14T09:08:28.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:28.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041543+0000", 2024-09-14T09:08:28.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.902e-06 2024-09-14T09:08:28.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:28.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041549+0000", 2024-09-14T09:08:28.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6889999999999998e-06 2024-09-14T09:08:28.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:28.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041554+0000", 2024-09-14T09:08:28.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5709999999999999e-06 2024-09-14T09:08:28.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:28.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.106058+0000", 2024-09-14T09:08:28.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064504051000000007 2024-09-14T09:08:28.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:28.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.106141+0000", 2024-09-14T09:08:28.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3294000000000006e-05 2024-09-14T09:08:28.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:28.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.106388+0000", 2024-09-14T09:08:28.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024648299999999998 2024-09-14T09:08:28.442 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.442 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:28.442 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.442 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7917 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 196608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:28.442 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041560+0000", 2024-09-14T09:08:28.442 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3389536240000002, 2024-09-14T09:08:28.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065539221999999994, 2024-09-14T09:08:28.442 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:28.442 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:28.442 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:28.442 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:28.443 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:28.443 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:28.443 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7917 2024-09-14T09:08:28.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.443 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:28.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:28.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041560+0000", 2024-09-14T09:08:28.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:28.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041560+0000", 2024-09-14T09:08:28.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:28.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041560+0000", 2024-09-14T09:08:28.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2399999999999999e-07 2024-09-14T09:08:28.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:28.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041562+0000", 2024-09-14T09:08:28.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8309999999999999e-06 2024-09-14T09:08:28.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:28.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041567+0000", 2024-09-14T09:08:28.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7699999999999998e-06 2024-09-14T09:08:28.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:28.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041572+0000", 2024-09-14T09:08:28.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4870000000000004e-06 2024-09-14T09:08:28.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:28.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.106431+0000", 2024-09-14T09:08:28.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064858964000000005 2024-09-14T09:08:28.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:28.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.106513+0000", 2024-09-14T09:08:28.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1848000000000006e-05 2024-09-14T09:08:28.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:28.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107099+0000", 2024-09-14T09:08:28.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058599800000000001 2024-09-14T09:08:28.446 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.446 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:28.446 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.446 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7918 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 206848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:28.446 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041577+0000", 2024-09-14T09:08:28.447 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3389359780000003, 2024-09-14T09:08:28.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065838946999999995, 2024-09-14T09:08:28.447 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:28.447 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:28.447 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:28.447 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:28.447 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:28.447 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:28.447 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7918 2024-09-14T09:08:28.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.447 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:28.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:28.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041577+0000", 2024-09-14T09:08:28.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:28.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041577+0000", 2024-09-14T09:08:28.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:28.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041578+0000", 2024-09-14T09:08:28.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-07 2024-09-14T09:08:28.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:28.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041579+0000", 2024-09-14T09:08:28.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7230000000000001e-06 2024-09-14T09:08:28.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:28.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041585+0000", 2024-09-14T09:08:28.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.767e-06 2024-09-14T09:08:28.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:28.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041589+0000", 2024-09-14T09:08:28.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.25e-06 2024-09-14T09:08:28.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:28.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107152+0000", 2024-09-14T09:08:28.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065563064000000004 2024-09-14T09:08:28.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:28.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107232+0000", 2024-09-14T09:08:28.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0019999999999996e-05 2024-09-14T09:08:28.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:28.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107416+0000", 2024-09-14T09:08:28.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018376800000000001 2024-09-14T09:08:28.450 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.451 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:28.451 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.451 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7919 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:28.451 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041595+0000", 2024-09-14T09:08:28.451 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3389185890000004, 2024-09-14T09:08:28.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.066135688999999998, 2024-09-14T09:08:28.451 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:28.451 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:28.451 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:28.451 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:28.451 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:28.451 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:28.452 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7919 2024-09-14T09:08:28.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.452 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:28.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:28.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041595+0000", 2024-09-14T09:08:28.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:28.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041595+0000", 2024-09-14T09:08:28.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:28.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041595+0000", 2024-09-14T09:08:28.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7799999999999997e-07 2024-09-14T09:08:28.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:28.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041597+0000", 2024-09-14T09:08:28.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.832e-06 2024-09-14T09:08:28.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:28.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041602+0000", 2024-09-14T09:08:28.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2480000000000004e-06 2024-09-14T09:08:28.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:28.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041606+0000", 2024-09-14T09:08:28.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1330000000000001e-06 2024-09-14T09:08:28.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:28.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107455+0000", 2024-09-14T09:08:28.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065849380999999998 2024-09-14T09:08:28.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:28.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107541+0000", 2024-09-14T09:08:28.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5648000000000004e-05 2024-09-14T09:08:28.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:28.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107730+0000", 2024-09-14T09:08:28.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018916899999999999 2024-09-14T09:08:28.455 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.455 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:28.455 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.456 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7920 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:28.456 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041612+0000", 2024-09-14T09:08:28.456 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3389012230000006, 2024-09-14T09:08:28.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.066948489999999999, 2024-09-14T09:08:28.456 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:28.456 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:28.456 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:28.456 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:28.456 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:28.456 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:28.456 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7920 2024-09-14T09:08:28.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.456 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:28.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:28.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041612+0000", 2024-09-14T09:08:28.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:28.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041612+0000", 2024-09-14T09:08:28.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:28.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041612+0000", 2024-09-14T09:08:28.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6100000000000002e-07 2024-09-14T09:08:28.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:28.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041614+0000", 2024-09-14T09:08:28.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0470000000000001e-06 2024-09-14T09:08:28.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:28.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041620+0000", 2024-09-14T09:08:28.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8359999999999997e-06 2024-09-14T09:08:28.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:28.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041634+0000", 2024-09-14T09:08:28.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3767e-05 2024-09-14T09:08:28.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:28.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107761+0000", 2024-09-14T09:08:28.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.066126943999999993 2024-09-14T09:08:28.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:28.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107840+0000", 2024-09-14T09:08:28.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9042999999999995e-05 2024-09-14T09:08:28.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:28.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.108560+0000", 2024-09-14T09:08:28.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00072049199999999999 2024-09-14T09:08:28.460 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.460 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:28.460 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.461 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7921 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 253952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:28.461 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041641+0000", 2024-09-14T09:08:28.461 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3388717030000006, 2024-09-14T09:08:28.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.067314309000000003, 2024-09-14T09:08:28.461 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:28.461 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:28.461 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:28.461 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:28.461 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:28.461 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:28.461 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7921 2024-09-14T09:08:28.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.461 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:28.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:28.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041641+0000", 2024-09-14T09:08:28.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:28.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041641+0000", 2024-09-14T09:08:28.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:28.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041642+0000", 2024-09-14T09:08:28.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8299999999999998e-07 2024-09-14T09:08:28.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:28.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041644+0000", 2024-09-14T09:08:28.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1059999999999998e-06 2024-09-14T09:08:28.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:28.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041652+0000", 2024-09-14T09:08:28.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6229999999999997e-06 2024-09-14T09:08:28.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:28.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041656+0000", 2024-09-14T09:08:28.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8319999999999996e-06 2024-09-14T09:08:28.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:28.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.108597+0000", 2024-09-14T09:08:28.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.066941055999999999 2024-09-14T09:08:28.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:28.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.108682+0000", 2024-09-14T09:08:28.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4305e-05 2024-09-14T09:08:28.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:28.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.108956+0000", 2024-09-14T09:08:28.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000274004 2024-09-14T09:08:28.465 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.465 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:28.465 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.465 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:8013 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:28.465 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.042062+0000", 2024-09-14T09:08:28.465 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.3384510239999994, 2024-09-14T09:08:28.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.067149147000000006, 2024-09-14T09:08:28.465 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:28.465 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:28.465 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:28.465 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:28.466 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:28.466 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:28.466 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 8013 2024-09-14T09:08:28.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.466 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:28.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:28.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.042062+0000", 2024-09-14T09:08:28.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:28.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.042062+0000", 2024-09-14T09:08:28.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:28.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.048211+0000", 2024-09-14T09:08:28.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061491269999999999 2024-09-14T09:08:28.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:28.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.048217+0000", 2024-09-14T09:08:28.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3600000000000004e-06 2024-09-14T09:08:28.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:28.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.048226+0000", 2024-09-14T09:08:28.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6670000000000008e-06 2024-09-14T09:08:28.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:28.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.048234+0000", 2024-09-14T09:08:28.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4749999999999996e-06 2024-09-14T09:08:28.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:28.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.109018+0000", 2024-09-14T09:08:28.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.060784670999999998 2024-09-14T09:08:28.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:28.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.109108+0000", 2024-09-14T09:08:28.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9222999999999996e-05 2024-09-14T09:08:28.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:28.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.109211+0000", 2024-09-14T09:08:28.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000103624 2024-09-14T09:08:28.469 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.469 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:28.469 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.469 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.469 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:28.469 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:28.471 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:08:28.471 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:28.472+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:28.572 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:28.574+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:28.591 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:08:28.617 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:28.617 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:28.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.617 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:11279 3.1c 3.30a98c1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-14T09:08:28.617 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:26.930542+0000", 2024-09-14T09:08:28.617 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.6892515399999999, 2024-09-14T09:08:28.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6892742840000001, 2024-09-14T09:08:28.617 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:08:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:08:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11279 2024-09-14T09:08:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:26.930542+0000", 2024-09-14T09:08:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:28.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:26.930542+0000", 2024-09-14T09:08:28.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:28.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:28.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:26.930543+0000", 2024-09-14T09:08:28.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1900000000000003e-07 2024-09-14T09:08:28.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:26.930546+0000", 2024-09-14T09:08:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2289999999999999e-06 2024-09-14T09:08:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:26.930553+0000", 2024-09-14T09:08:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9970000000000001e-06 2024-09-14T09:08:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:26.930557+0000", 2024-09-14T09:08:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.912e-06 2024-09-14T09:08:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:26.930613+0000", 2024-09-14T09:08:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5957e-05 2024-09-14T09:08:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:08:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:26.930625+0000", 2024-09-14T09:08:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2031999999999999e-05 2024-09-14T09:08:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:27.920393+0000", 2024-09-14T09:08:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.989768168 2024-09-14T09:08:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:08:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:27.920407+0000", 2024-09-14T09:08:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4161999999999999e-05 2024-09-14T09:08:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:08:28.622 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 1 2024-09-14T09:08:28.622 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:28.626 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:08:28.673 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:28.675+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:28.711 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:28.712 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:28.729 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:28.729 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:28.745 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:08:28.745 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:08:28.762 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:28.762 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:28.772 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:28.772 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:28.773 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:28.776+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:28.779 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:28.779 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:28.781 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:08:28.796 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:28.797 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:28.875 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:28.877+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:28.885 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:28.886 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:28.894 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:08:28.914 INFO:teuthology.orchestra.run.smithi116.stdout:moved 5 / 82 (6.09756%) 2024-09-14T09:08:28.914 INFO:teuthology.orchestra.run.smithi116.stdout:avg 13.6667 2024-09-14T09:08:28.914 INFO:teuthology.orchestra.run.smithi116.stdout:stddev 3.03681 -> 4.38432 (expected baseline 3.37474) 2024-09-14T09:08:28.914 INFO:teuthology.orchestra.run.smithi116.stdout:min osd.0 with 9 -> 5 pgs (0.658537 -> 0.365854 * mean) 2024-09-14T09:08:28.915 INFO:teuthology.orchestra.run.smithi116.stdout:max osd.3 with 19 -> 19 pgs (1.39024 -> 1.39024 * mean) 2024-09-14T09:08:28.915 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:08:28.915 INFO:teuthology.orchestra.run.smithi116.stdout:oload 110 2024-09-14T09:08:28.915 INFO:teuthology.orchestra.run.smithi116.stdout:max_change 1 2024-09-14T09:08:28.915 INFO:teuthology.orchestra.run.smithi116.stdout:max_change_osds 4 2024-09-14T09:08:28.915 INFO:teuthology.orchestra.run.smithi116.stdout:average_utilization 0.0006 2024-09-14T09:08:28.915 INFO:teuthology.orchestra.run.smithi116.stdout:overload_utilization 0.0006 2024-09-14T09:08:28.915 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0 weight 0.6014 -> 0.4335 2024-09-14T09:08:28.915 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2 weight 0.7479 -> 0.6604 2024-09-14T09:08:28.918 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is unset 2024-09-14T09:08:28.943 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-14T09:08:28.943 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 1.0 2024-09-14T09:08:28.976 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:28.978+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:29.051 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:29.051 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:29.061 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:08:29.106 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:29.108+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:29.171 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:29.171 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:29.177 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:29.179+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:29.179 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:08:29.278 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:29.280+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:29.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T09:08:29.316+0000 7f6bbbfff640 0 --2- 172.21.15.116:0/4095377878 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6bbc133c20 0x7f6bbc130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T09:08:29.323 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:29.323 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:29.333 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:08:29.378 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:29.380+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:29.437 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:29.438 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:29.446 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:08:29.490 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:29.492+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:29.552 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:29.552 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:29.558 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:08:29.581 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:29.583+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:29.681 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:29.684+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:29.700 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:29.700 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:29.708 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:08:29.782 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:29.784+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:29.811 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:29.811 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:29.820 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:08:29.882 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:29.885+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:29.915 INFO:teuthology.orchestra.run.smithi116.stdout:moved 4 / 82 (4.87805%) 2024-09-14T09:08:29.915 INFO:teuthology.orchestra.run.smithi116.stdout:avg 13.6667 2024-09-14T09:08:29.915 INFO:teuthology.orchestra.run.smithi116.stdout:stddev 4.38432 -> 5.61743 (expected baseline 3.37474) 2024-09-14T09:08:29.916 INFO:teuthology.orchestra.run.smithi116.stdout:min osd.0 with 5 -> 4 pgs (0.365854 -> 0.292683 * mean) 2024-09-14T09:08:29.916 INFO:teuthology.orchestra.run.smithi116.stdout:max osd.3 with 19 -> 21 pgs (1.39024 -> 1.53659 * mean) 2024-09-14T09:08:29.916 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:08:29.916 INFO:teuthology.orchestra.run.smithi116.stdout:oload 110 2024-09-14T09:08:29.916 INFO:teuthology.orchestra.run.smithi116.stdout:max_change 1 2024-09-14T09:08:29.916 INFO:teuthology.orchestra.run.smithi116.stdout:max_change_osds 4 2024-09-14T09:08:29.916 INFO:teuthology.orchestra.run.smithi116.stdout:average_utilization 0.0006 2024-09-14T09:08:29.916 INFO:teuthology.orchestra.run.smithi116.stdout:overload_utilization 0.0007 2024-09-14T09:08:29.916 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0 weight 0.4335 -> 0.3199 2024-09-14T09:08:29.916 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2 weight 0.6604 -> 0.5971 2024-09-14T09:08:29.928 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:29.928 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:29.938 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:08:29.984 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:29.986+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:30.052 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:30.052 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:30.061 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:08:30.084 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:30.086+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:30.184 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:30.187+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:30.205 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:30.205 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:30.214 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:08:30.298 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:30.300+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:30.357 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:30.358 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:30.366 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:08:30.408 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:30.410+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:30.487 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:30.490+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:30.510 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:30.510 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:30.518 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:08:30.588 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:30.590+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:30.634 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:30.634 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:30.643 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:08:30.727 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:30.729+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:30.788 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:30.788 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:30.789 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:30.791+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:30.794 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:08:30.809 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:08:30.890 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:30.892+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:30.946 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T09:08:30.956 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:30.957 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:30.968 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:08:30.969 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone20 from 0xae6ce00 (overlap 0xae6ce00) to 0x0 2024-09-14T09:08:30.978 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:30.979 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:31.000 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:31.000 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:31.000 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:31.002+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:31.019 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:08:31.019 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:08:31.039 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:31.039 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:31.059 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:31.060 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:31.081 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:31.081 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:31.092 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:31.094+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:31.120 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:31.120 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:31.121 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:08:31.121 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:31.133 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:08:31.194 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:31.196+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:31.277 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:31.277 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:31.277 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:31.277 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:31.277 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:31.285 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:08:31.329 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:31.331+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:31.389 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:31.389 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:31.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:31.389 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:31.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.389 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:08:31.390 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:31.390 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 61.157071766999998, 2024-09-14T09:08:31.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72111598600000004, 2024-09-14T09:08:31.390 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.390 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.390 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:31.390 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.390 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:08:31.390 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:08:31.390 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1 2024-09-14T09:08:31.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.390 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:31.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:31.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233065+0000", 2024-09-14T09:08:31.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1909999999999999e-06 2024-09-14T09:08:31.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233071+0000", 2024-09-14T09:08:31.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5300000000000002e-06 2024-09-14T09:08:31.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233081+0000", 2024-09-14T09:08:31.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0339e-05 2024-09-14T09:08:31.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233093+0000", 2024-09-14T09:08:31.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1252e-05 2024-09-14T09:08:31.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233162+0000", 2024-09-14T09:08:31.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9678999999999995e-05 2024-09-14T09:08:31.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:08:31.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233171+0000", 2024-09-14T09:08:31.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.132e-06 2024-09-14T09:08:31.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952480+0000", 2024-09-14T09:08:31.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.71930839899999999 2024-09-14T09:08:31.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952655+0000", 2024-09-14T09:08:31.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017552 2024-09-14T09:08:31.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:31.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952835+0000", 2024-09-14T09:08:31.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001797 2024-09-14T09:08:31.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:31.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.953648+0000", 2024-09-14T09:08:31.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00081291700000000002 2024-09-14T09:08:31.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:31.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954108+0000", 2024-09-14T09:08:31.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045992800000000002 2024-09-14T09:08:31.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:31.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954149+0000", 2024-09-14T09:08:31.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1214999999999998e-05 2024-09-14T09:08:31.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954178+0000", 2024-09-14T09:08:31.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9184e-05 2024-09-14T09:08:31.396 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.396 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.396 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.396 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1493 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1196032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:31.396 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:31.397 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.481372576999998, 2024-09-14T09:08:31.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012302112, 2024-09-14T09:08:31.397 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.397 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.397 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.397 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.397 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:31.397 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:31.397 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1493 2024-09-14T09:08:31.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.397 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:31.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:31.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908762+0000", 2024-09-14T09:08:31.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.65e-07 2024-09-14T09:08:31.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908764+0000", 2024-09-14T09:08:31.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8589999999999999e-06 2024-09-14T09:08:31.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908770+0000", 2024-09-14T09:08:31.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.728e-06 2024-09-14T09:08:31.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.908774+0000", 2024-09-14T09:08:31.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7609999999999998e-06 2024-09-14T09:08:31.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.920899+0000", 2024-09-14T09:08:31.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012125004999999999 2024-09-14T09:08:31.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.920977+0000", 2024-09-14T09:08:31.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7564000000000005e-05 2024-09-14T09:08:31.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.921064+0000", 2024-09-14T09:08:31.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6829999999999994e-05 2024-09-14T09:08:31.400 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.401 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.401 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.401 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1510 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 983040~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:31.401 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:31.401 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.480388387000001, 2024-09-14T09:08:31.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012360968999999999, 2024-09-14T09:08:31.401 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.401 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.401 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.402 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.402 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:31.402 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:31.402 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1510 2024-09-14T09:08:31.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.402 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:31.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:31.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909746+0000", 2024-09-14T09:08:31.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8799999999999998e-07 2024-09-14T09:08:31.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909748+0000", 2024-09-14T09:08:31.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9810000000000002e-06 2024-09-14T09:08:31.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909754+0000", 2024-09-14T09:08:31.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3609999999999997e-06 2024-09-14T09:08:31.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909760+0000", 2024-09-14T09:08:31.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1850000000000003e-06 2024-09-14T09:08:31.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.921974+0000", 2024-09-14T09:08:31.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012214426 2024-09-14T09:08:31.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922015+0000", 2024-09-14T09:08:31.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0407000000000001e-05 2024-09-14T09:08:31.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922107+0000", 2024-09-14T09:08:31.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2220999999999997e-05 2024-09-14T09:08:31.405 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.405 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.405 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.406 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1511 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1212416~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:31.406 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.909766+0000", 2024-09-14T09:08:31.406 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.48036798, 2024-09-14T09:08:31.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012473141, 2024-09-14T09:08:31.406 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.406 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.406 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.406 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.406 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:31.408 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:31.408 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1511 2024-09-14T09:08:31.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.408 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909766+0000", 2024-09-14T09:08:31.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909766+0000", 2024-09-14T09:08:31.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909767+0000", 2024-09-14T09:08:31.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-07 2024-09-14T09:08:31.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909768+0000", 2024-09-14T09:08:31.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8050000000000001e-06 2024-09-14T09:08:31.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909775+0000", 2024-09-14T09:08:31.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8210000000000004e-06 2024-09-14T09:08:31.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.909780+0000", 2024-09-14T09:08:31.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3120000000000001e-06 2024-09-14T09:08:31.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922138+0000", 2024-09-14T09:08:31.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012358012 2024-09-14T09:08:31.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922181+0000", 2024-09-14T09:08:31.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2876000000000001e-05 2024-09-14T09:08:31.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922239+0000", 2024-09-14T09:08:31.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7960000000000001e-05 2024-09-14T09:08:31.412 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.412 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.412 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.412 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1517 3.d 3:b36f6c76:::rbd_data.1112f61fa773.0000000000000002:8 [read 966656~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:31.412 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910035+0000", 2024-09-14T09:08:31.412 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.480099462999998, 2024-09-14T09:08:31.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012318664999999999, 2024-09-14T09:08:31.412 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.412 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.412 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.412 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.412 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:31.412 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:31.413 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1517 2024-09-14T09:08:31.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.413 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910035+0000", 2024-09-14T09:08:31.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910035+0000", 2024-09-14T09:08:31.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910036+0000", 2024-09-14T09:08:31.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7000000000000003e-07 2024-09-14T09:08:31.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910040+0000", 2024-09-14T09:08:31.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3220000000000003e-06 2024-09-14T09:08:31.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910051+0000", 2024-09-14T09:08:31.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1476e-05 2024-09-14T09:08:31.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910059+0000", 2024-09-14T09:08:31.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:08:31.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922268+0000", 2024-09-14T09:08:31.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012208910999999999 2024-09-14T09:08:31.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922305+0000", 2024-09-14T09:08:31.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7069e-05 2024-09-14T09:08:31.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922353+0000", 2024-09-14T09:08:31.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7976999999999998e-05 2024-09-14T09:08:31.416 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.416 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.416 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.416 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1518 3.d 3:b36f6c76:::rbd_data.1112f61fa773.0000000000000002:8 [read 1196032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:31.416 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910078+0000", 2024-09-14T09:08:31.416 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.480055774, 2024-09-14T09:08:31.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012415053000000001, 2024-09-14T09:08:31.416 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.416 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.416 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.416 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.416 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:31.416 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:31.416 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1518 2024-09-14T09:08:31.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.417 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910078+0000", 2024-09-14T09:08:31.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910078+0000", 2024-09-14T09:08:31.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910079+0000", 2024-09-14T09:08:31.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0999999999999998e-07 2024-09-14T09:08:31.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910082+0000", 2024-09-14T09:08:31.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7779999999999999e-06 2024-09-14T09:08:31.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910089+0000", 2024-09-14T09:08:31.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4599999999999997e-06 2024-09-14T09:08:31.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910095+0000", 2024-09-14T09:08:31.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.66e-06 2024-09-14T09:08:31.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922380+0000", 2024-09-14T09:08:31.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012285275 2024-09-14T09:08:31.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922434+0000", 2024-09-14T09:08:31.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3925000000000003e-05 2024-09-14T09:08:31.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922493+0000", 2024-09-14T09:08:31.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9345000000000002e-05 2024-09-14T09:08:31.420 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.420 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.420 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.420 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1519 3.d 3:b36f6c76:::rbd_data.1112f61fa773.0000000000000002:8 [read 1425408~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:31.420 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910131+0000", 2024-09-14T09:08:31.420 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.480003001, 2024-09-14T09:08:31.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012535421999999999, 2024-09-14T09:08:31.420 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.420 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.421 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.421 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.421 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:31.421 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:31.421 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1519 2024-09-14T09:08:31.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.421 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910131+0000", 2024-09-14T09:08:31.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910131+0000", 2024-09-14T09:08:31.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910132+0000", 2024-09-14T09:08:31.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1399999999999997e-07 2024-09-14T09:08:31.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910134+0000", 2024-09-14T09:08:31.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6340000000000001e-06 2024-09-14T09:08:31.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910142+0000", 2024-09-14T09:08:31.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8809999999999996e-06 2024-09-14T09:08:31.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910148+0000", 2024-09-14T09:08:31.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1750000000000002e-06 2024-09-14T09:08:31.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922521+0000", 2024-09-14T09:08:31.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012372726000000001 2024-09-14T09:08:31.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922585+0000", 2024-09-14T09:08:31.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4169000000000002e-05 2024-09-14T09:08:31.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922667+0000", 2024-09-14T09:08:31.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1322999999999994e-05 2024-09-14T09:08:31.424 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.424 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.424 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.425 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1524 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 1032192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:31.425 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:31.425 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.479974231, 2024-09-14T09:08:31.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012717483, 2024-09-14T09:08:31.425 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.425 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.425 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.425 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.425 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:31.425 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:31.425 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1524 2024-09-14T09:08:31.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.425 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:31.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:31.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910160+0000", 2024-09-14T09:08:31.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5499999999999998e-07 2024-09-14T09:08:31.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910163+0000", 2024-09-14T09:08:31.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3180000000000001e-06 2024-09-14T09:08:31.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910169+0000", 2024-09-14T09:08:31.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5139999999999998e-06 2024-09-14T09:08:31.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910176+0000", 2024-09-14T09:08:31.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5169999999999996e-06 2024-09-14T09:08:31.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922695+0000", 2024-09-14T09:08:31.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012519007 2024-09-14T09:08:31.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922775+0000", 2024-09-14T09:08:31.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9958999999999998e-05 2024-09-14T09:08:31.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922877+0000", 2024-09-14T09:08:31.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000102613 2024-09-14T09:08:31.429 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.429 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.429 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.430 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1525 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 1261568~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:31.430 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910183+0000", 2024-09-14T09:08:31.430 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.479950900999999, 2024-09-14T09:08:31.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012942067999999999, 2024-09-14T09:08:31.430 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.430 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.430 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.430 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.430 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:31.430 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:31.430 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1525 2024-09-14T09:08:31.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.430 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910183+0000", 2024-09-14T09:08:31.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910183+0000", 2024-09-14T09:08:31.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910184+0000", 2024-09-14T09:08:31.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9999999999999998e-07 2024-09-14T09:08:31.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910186+0000", 2024-09-14T09:08:31.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.165e-06 2024-09-14T09:08:31.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910192+0000", 2024-09-14T09:08:31.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3080000000000004e-06 2024-09-14T09:08:31.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910203+0000", 2024-09-14T09:08:31.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0586e-05 2024-09-14T09:08:31.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.922932+0000", 2024-09-14T09:08:31.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012728882 2024-09-14T09:08:31.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923028+0000", 2024-09-14T09:08:31.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6531000000000001e-05 2024-09-14T09:08:31.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923125+0000", 2024-09-14T09:08:31.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7195999999999996e-05 2024-09-14T09:08:31.434 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.434 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.434 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.434 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1527 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 999424~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:31.434 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910210+0000", 2024-09-14T09:08:31.434 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.479923994, 2024-09-14T09:08:31.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013037887999999999, 2024-09-14T09:08:31.435 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.435 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.435 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.435 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.435 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:31.435 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:31.435 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1527 2024-09-14T09:08:31.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.435 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910210+0000", 2024-09-14T09:08:31.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910210+0000", 2024-09-14T09:08:31.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910211+0000", 2024-09-14T09:08:31.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8800000000000003e-07 2024-09-14T09:08:31.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910213+0000", 2024-09-14T09:08:31.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0820000000000001e-06 2024-09-14T09:08:31.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910219+0000", 2024-09-14T09:08:31.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0789999999999997e-06 2024-09-14T09:08:31.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910224+0000", 2024-09-14T09:08:31.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7299999999999996e-06 2024-09-14T09:08:31.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923158+0000", 2024-09-14T09:08:31.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012934200999999999 2024-09-14T09:08:31.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923197+0000", 2024-09-14T09:08:31.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9020999999999998e-05 2024-09-14T09:08:31.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923248+0000", 2024-09-14T09:08:31.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1286999999999999e-05 2024-09-14T09:08:31.439 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.439 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.439 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.439 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1528 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1228800~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:31.439 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:31.439 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.479904145999999, 2024-09-14T09:08:31.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013235419, 2024-09-14T09:08:31.439 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.439 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.439 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.439 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.439 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:31.440 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:31.440 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1528 2024-09-14T09:08:31.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.440 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:31.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:31.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910230+0000", 2024-09-14T09:08:31.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.01e-07 2024-09-14T09:08:31.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910232+0000", 2024-09-14T09:08:31.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9589999999999998e-06 2024-09-14T09:08:31.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910238+0000", 2024-09-14T09:08:31.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8200000000000002e-06 2024-09-14T09:08:31.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.910243+0000", 2024-09-14T09:08:31.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8369999999999996e-06 2024-09-14T09:08:31.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923281+0000", 2024-09-14T09:08:31.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013037613 2024-09-14T09:08:31.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923360+0000", 2024-09-14T09:08:31.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9717999999999998e-05 2024-09-14T09:08:31.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923465+0000", 2024-09-14T09:08:31.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000105071 2024-09-14T09:08:31.443 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.443 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.443 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.444 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1544 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 1277952~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:31.444 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:31.444 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.478345162, 2024-09-14T09:08:31.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012301747, 2024-09-14T09:08:31.444 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.444 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.444 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.444 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.444 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:31.444 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:31.444 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1544 2024-09-14T09:08:31.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.444 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:31.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:31.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911789+0000", 2024-09-14T09:08:31.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1500000000000005e-07 2024-09-14T09:08:31.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911793+0000", 2024-09-14T09:08:31.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6689999999999999e-06 2024-09-14T09:08:31.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911802+0000", 2024-09-14T09:08:31.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4710000000000007e-06 2024-09-14T09:08:31.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911807+0000", 2024-09-14T09:08:31.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5799999999999999e-06 2024-09-14T09:08:31.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.923930+0000", 2024-09-14T09:08:31.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012123083 2024-09-14T09:08:31.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924013+0000", 2024-09-14T09:08:31.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2560999999999998e-05 2024-09-14T09:08:31.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924091+0000", 2024-09-14T09:08:31.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7867999999999994e-05 2024-09-14T09:08:31.447 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.447 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.447 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.448 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1547 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1015808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:31.448 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.911814+0000", 2024-09-14T09:08:31.448 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.478320058000001, 2024-09-14T09:08:31.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012405057000000001, 2024-09-14T09:08:31.448 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.448 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.448 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.448 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.448 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:31.448 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:31.448 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1547 2024-09-14T09:08:31.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.449 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911814+0000", 2024-09-14T09:08:31.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911814+0000", 2024-09-14T09:08:31.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911815+0000", 2024-09-14T09:08:31.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3000000000000001e-07 2024-09-14T09:08:31.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911816+0000", 2024-09-14T09:08:31.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.75e-06 2024-09-14T09:08:31.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911823+0000", 2024-09-14T09:08:31.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6189999999999996e-06 2024-09-14T09:08:31.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911828+0000", 2024-09-14T09:08:31.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5539999999999997e-06 2024-09-14T09:08:31.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924119+0000", 2024-09-14T09:08:31.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012290967 2024-09-14T09:08:31.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924162+0000", 2024-09-14T09:08:31.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2422999999999997e-05 2024-09-14T09:08:31.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924219+0000", 2024-09-14T09:08:31.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7314e-05 2024-09-14T09:08:31.452 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.452 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.452 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.452 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1548 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1245184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:31.452 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.911850+0000", 2024-09-14T09:08:31.452 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.478284102, 2024-09-14T09:08:31.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012607343, 2024-09-14T09:08:31.452 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.452 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.452 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.452 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.452 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:31.453 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:31.453 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1548 2024-09-14T09:08:31.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.453 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911850+0000", 2024-09-14T09:08:31.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911850+0000", 2024-09-14T09:08:31.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911851+0000", 2024-09-14T09:08:31.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4199999999999996e-07 2024-09-14T09:08:31.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911853+0000", 2024-09-14T09:08:31.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.283e-06 2024-09-14T09:08:31.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911860+0000", 2024-09-14T09:08:31.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2069999999999998e-06 2024-09-14T09:08:31.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.911866+0000", 2024-09-14T09:08:31.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.161e-06 2024-09-14T09:08:31.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924276+0000", 2024-09-14T09:08:31.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012409531 2024-09-14T09:08:31.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924371+0000", 2024-09-14T09:08:31.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4826000000000003e-05 2024-09-14T09:08:31.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.924457+0000", 2024-09-14T09:08:31.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6792999999999994e-05 2024-09-14T09:08:31.456 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.456 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.456 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.456 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1566 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1032192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:31.456 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.913266+0000", 2024-09-14T09:08:31.456 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.476868051, 2024-09-14T09:08:31.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012340884999999999, 2024-09-14T09:08:31.457 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.457 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.457 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.457 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.457 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:31.457 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:31.457 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1566 2024-09-14T09:08:31.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.457 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913266+0000", 2024-09-14T09:08:31.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913266+0000", 2024-09-14T09:08:31.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913267+0000", 2024-09-14T09:08:31.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6899999999999998e-07 2024-09-14T09:08:31.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913269+0000", 2024-09-14T09:08:31.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9589999999999998e-06 2024-09-14T09:08:31.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913275+0000", 2024-09-14T09:08:31.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4969999999999998e-06 2024-09-14T09:08:31.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913280+0000", 2024-09-14T09:08:31.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2039999999999996e-06 2024-09-14T09:08:31.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925517+0000", 2024-09-14T09:08:31.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012236784000000001 2024-09-14T09:08:31.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925556+0000", 2024-09-14T09:08:31.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9121e-05 2024-09-14T09:08:31.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925607+0000", 2024-09-14T09:08:31.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0850999999999998e-05 2024-09-14T09:08:31.460 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.460 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.461 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.461 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:1567 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 1261568~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:31.461 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:31.461 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.476847458999998, 2024-09-14T09:08:31.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012537243, 2024-09-14T09:08:31.461 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.461 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.461 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.461 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.461 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:31.461 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:31.461 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1567 2024-09-14T09:08:31.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.462 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:31.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:31.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913287+0000", 2024-09-14T09:08:31.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8099999999999998e-07 2024-09-14T09:08:31.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913289+0000", 2024-09-14T09:08:31.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9350000000000001e-06 2024-09-14T09:08:31.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913295+0000", 2024-09-14T09:08:31.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4540000000000004e-06 2024-09-14T09:08:31.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.913300+0000", 2024-09-14T09:08:31.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9189999999999998e-06 2024-09-14T09:08:31.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925641+0000", 2024-09-14T09:08:31.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012340378000000001 2024-09-14T09:08:31.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925726+0000", 2024-09-14T09:08:31.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5504e-05 2024-09-14T09:08:31.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:59.925824+0000", 2024-09-14T09:08:31.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7671999999999996e-05 2024-09-14T09:08:31.465 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.465 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.465 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.465 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3470 3.d 3:b44cc306:::rbd_data.1112f61fa773.0000000000000005:8 [read 4374528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:31.465 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039718+0000", 2024-09-14T09:08:31.465 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.350415804000001, 2024-09-14T09:08:31.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012430363, 2024-09-14T09:08:31.465 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.465 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.466 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.466 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.466 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:31.466 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:31.466 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3470 2024-09-14T09:08:31.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.466 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039718+0000", 2024-09-14T09:08:31.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039718+0000", 2024-09-14T09:08:31.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039719+0000", 2024-09-14T09:08:31.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0200000000000003e-07 2024-09-14T09:08:31.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039721+0000", 2024-09-14T09:08:31.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4380000000000002e-06 2024-09-14T09:08:31.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039727+0000", 2024-09-14T09:08:31.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2620000000000004e-06 2024-09-14T09:08:31.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039733+0000", 2024-09-14T09:08:31.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1730000000000003e-06 2024-09-14T09:08:31.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.051980+0000", 2024-09-14T09:08:31.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012247872999999999 2024-09-14T09:08:31.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052056+0000", 2024-09-14T09:08:31.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5766999999999995e-05 2024-09-14T09:08:31.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052149+0000", 2024-09-14T09:08:31.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2448000000000007e-05 2024-09-14T09:08:31.469 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.469 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.469 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.469 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3473 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 4112384~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:31.469 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039746+0000", 2024-09-14T09:08:31.470 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.350388042999999, 2024-09-14T09:08:31.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012654228999999999, 2024-09-14T09:08:31.470 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.470 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.470 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.470 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.470 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:31.470 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:31.470 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3473 2024-09-14T09:08:31.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.470 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039746+0000", 2024-09-14T09:08:31.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039746+0000", 2024-09-14T09:08:31.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039747+0000", 2024-09-14T09:08:31.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5499999999999998e-07 2024-09-14T09:08:31.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039749+0000", 2024-09-14T09:08:31.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4380000000000002e-06 2024-09-14T09:08:31.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039759+0000", 2024-09-14T09:08:31.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7110000000000007e-06 2024-09-14T09:08:31.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039764+0000", 2024-09-14T09:08:31.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3680000000000001e-06 2024-09-14T09:08:31.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052199+0000", 2024-09-14T09:08:31.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012434726 2024-09-14T09:08:31.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052283+0000", 2024-09-14T09:08:31.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4091000000000005e-05 2024-09-14T09:08:31.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052400+0000", 2024-09-14T09:08:31.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011744 2024-09-14T09:08:31.473 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.474 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.474 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.474 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3474 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 4341760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:31.474 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039772+0000", 2024-09-14T09:08:31.474 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.350361810999999, 2024-09-14T09:08:31.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012822623999999999, 2024-09-14T09:08:31.474 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.474 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.474 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.474 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.474 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:31.474 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:31.475 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3474 2024-09-14T09:08:31.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.475 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039772+0000", 2024-09-14T09:08:31.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039772+0000", 2024-09-14T09:08:31.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039773+0000", 2024-09-14T09:08:31.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1199999999999998e-07 2024-09-14T09:08:31.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039775+0000", 2024-09-14T09:08:31.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9709999999999998e-06 2024-09-14T09:08:31.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039781+0000", 2024-09-14T09:08:31.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5150000000000003e-06 2024-09-14T09:08:31.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039786+0000", 2024-09-14T09:08:31.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9710000000000003e-06 2024-09-14T09:08:31.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052437+0000", 2024-09-14T09:08:31.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012650539000000001 2024-09-14T09:08:31.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052508+0000", 2024-09-14T09:08:31.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1038999999999995e-05 2024-09-14T09:08:31.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052595+0000", 2024-09-14T09:08:31.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7176999999999996e-05 2024-09-14T09:08:31.478 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.478 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.478 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.478 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4617.0:3475 3.d 3:b6f35f23:::rbd_data.1112f61fa773.0000000000000007:8 [read 4571136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T09:08:31.478 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:31.478 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.350341497999999, 2024-09-14T09:08:31.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013000444999999999, 2024-09-14T09:08:31.478 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.478 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.478 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.478 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.478 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4617", 2024-09-14T09:08:31.478 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/3661010859", 2024-09-14T09:08:31.479 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 3475 2024-09-14T09:08:31.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.479 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:31.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:31.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039793+0000", 2024-09-14T09:08:31.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.46e-07 2024-09-14T09:08:31.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039795+0000", 2024-09-14T09:08:31.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.863e-06 2024-09-14T09:08:31.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039802+0000", 2024-09-14T09:08:31.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3780000000000003e-06 2024-09-14T09:08:31.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.039807+0000", 2024-09-14T09:08:31.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2170000000000002e-06 2024-09-14T09:08:31.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052636+0000", 2024-09-14T09:08:31.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012828278 2024-09-14T09:08:31.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052714+0000", 2024-09-14T09:08:31.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7824999999999994e-05 2024-09-14T09:08:31.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:00.052793+0000", 2024-09-14T09:08:31.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9537999999999996e-05 2024-09-14T09:08:31.482 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.482 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.482 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.482 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.482 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.482 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:31.484 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:08:31.484 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:31.486+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:31.584 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:31.586+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:31.627 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:31.627 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:31.627 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:08:31.627 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:31.636 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:08:31.684 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:31.686+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:31.738 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:31.738 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:31.738 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:31.738 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:31.738 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:31.746 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:08:31.776 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is set 2024-09-14T09:08:31.784 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:31.787+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:31.886 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:31.888+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:31.894 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:31.895 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:31.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:31.895 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:31.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.895 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4604.0:364 3.1d 3:bb0fb96d:::rbd_data.1112609a9334.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 28633088~35328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-14T09:08:31.895 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:04.667444+0000", 2024-09-14T09:08:31.895 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.228693817, 2024-09-14T09:08:31.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052308081999999999, 2024-09-14T09:08:31.895 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.895 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.895 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:31.895 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.895 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4604", 2024-09-14T09:08:31.896 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/335524879", 2024-09-14T09:08:31.896 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 364 2024-09-14T09:08:31.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.896 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.667444+0000", 2024-09-14T09:08:31.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.667444+0000", 2024-09-14T09:08:31.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.667445+0000", 2024-09-14T09:08:31.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1999999999999998e-07 2024-09-14T09:08:31.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681087+0000", 2024-09-14T09:08:31.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013641863000000001 2024-09-14T09:08:31.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681113+0000", 2024-09-14T09:08:31.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6310000000000001e-05 2024-09-14T09:08:31.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681123+0000", 2024-09-14T09:08:31.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7289999999999995e-06 2024-09-14T09:08:31.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681203+0000", 2024-09-14T09:08:31.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0628000000000001e-05 2024-09-14T09:08:31.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681323+0000", 2024-09-14T09:08:31.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000119722 2024-09-14T09:08:31.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:31.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.682203+0000", 2024-09-14T09:08:31.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00087938299999999997 2024-09-14T09:08:31.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:31.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719043+0000", 2024-09-14T09:08:31.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036840218000000001 2024-09-14T09:08:31.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:31.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719654+0000", 2024-09-14T09:08:31.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00061077199999999999 2024-09-14T09:08:31.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:31.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719698+0000", 2024-09-14T09:08:31.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4177000000000001e-05 2024-09-14T09:08:31.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719752+0000", 2024-09-14T09:08:31.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4459999999999997e-05 2024-09-14T09:08:31.900 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.900 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.901 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.901 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7885 3.1e 3:79089f6b:::rbd_data.11123620c885.0000000000000002:12 [read 256000~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:31.901 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075571+0000", 2024-09-14T09:08:31.901 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.820566855999999, 2024-09-14T09:08:31.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036029795000000003, 2024-09-14T09:08:31.901 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.901 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.901 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.901 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.901 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:31.901 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:31.901 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7885 2024-09-14T09:08:31.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.901 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075571+0000", 2024-09-14T09:08:31.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075571+0000", 2024-09-14T09:08:31.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075571+0000", 2024-09-14T09:08:31.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.01e-07 2024-09-14T09:08:31.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075573+0000", 2024-09-14T09:08:31.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6789999999999999e-06 2024-09-14T09:08:31.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075579+0000", 2024-09-14T09:08:31.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6489999999999996e-06 2024-09-14T09:08:31.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075584+0000", 2024-09-14T09:08:31.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7530000000000001e-06 2024-09-14T09:08:31.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111315+0000", 2024-09-14T09:08:31.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035731375000000003 2024-09-14T09:08:31.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111421+0000", 2024-09-14T09:08:31.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106124 2024-09-14T09:08:31.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111601+0000", 2024-09-14T09:08:31.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017981400000000001 2024-09-14T09:08:31.905 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.905 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.905 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.905 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7958 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 4096~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:31.905 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075911+0000", 2024-09-14T09:08:31.905 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.820226791, 2024-09-14T09:08:31.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035748988000000002, 2024-09-14T09:08:31.905 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.905 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.905 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.905 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.905 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:31.905 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:31.906 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7958 2024-09-14T09:08:31.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.906 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075911+0000", 2024-09-14T09:08:31.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075911+0000", 2024-09-14T09:08:31.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075911+0000", 2024-09-14T09:08:31.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0800000000000001e-07 2024-09-14T09:08:31.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075917+0000", 2024-09-14T09:08:31.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0800000000000002e-06 2024-09-14T09:08:31.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075921+0000", 2024-09-14T09:08:31.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7610000000000001e-06 2024-09-14T09:08:31.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075924+0000", 2024-09-14T09:08:31.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5349999999999999e-06 2024-09-14T09:08:31.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111099+0000", 2024-09-14T09:08:31.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035175728000000003 2024-09-14T09:08:31.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111185+0000", 2024-09-14T09:08:31.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5185000000000005e-05 2024-09-14T09:08:31.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111660+0000", 2024-09-14T09:08:31.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00047549099999999998 2024-09-14T09:08:31.909 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.909 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.909 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.909 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.909 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.909 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7959 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 14336~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:31.909 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075927+0000", 2024-09-14T09:08:31.909 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.820210699, 2024-09-14T09:08:31.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036277579999999997, 2024-09-14T09:08:31.909 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.909 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.909 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.909 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.909 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:31.909 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:31.909 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7959 2024-09-14T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075927+0000", 2024-09-14T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075927+0000", 2024-09-14T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075927+0000", 2024-09-14T09:08:31.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4200000000000002e-07 2024-09-14T09:08:31.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075929+0000", 2024-09-14T09:08:31.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0750000000000001e-06 2024-09-14T09:08:31.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075931+0000", 2024-09-14T09:08:31.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8289999999999999e-06 2024-09-14T09:08:31.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075934+0000", 2024-09-14T09:08:31.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.525e-06 2024-09-14T09:08:31.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111692+0000", 2024-09-14T09:08:31.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035757780000000003 2024-09-14T09:08:31.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111772+0000", 2024-09-14T09:08:31.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0173999999999995e-05 2024-09-14T09:08:31.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112205+0000", 2024-09-14T09:08:31.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000432955 2024-09-14T09:08:31.912 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.913 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.913 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.913 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7960 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 40960~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:31.913 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075937+0000", 2024-09-14T09:08:31.913 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.820200872000001, 2024-09-14T09:08:31.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036668890000000003, 2024-09-14T09:08:31.913 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.913 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.913 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.913 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.913 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:31.913 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:31.913 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7960 2024-09-14T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075937+0000", 2024-09-14T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075937+0000", 2024-09-14T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075937+0000", 2024-09-14T09:08:31.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:08:31.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075938+0000", 2024-09-14T09:08:31.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4900000000000004e-07 2024-09-14T09:08:31.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075941+0000", 2024-09-14T09:08:31.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7199999999999998e-06 2024-09-14T09:08:31.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075944+0000", 2024-09-14T09:08:31.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6850000000000001e-06 2024-09-14T09:08:31.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112243+0000", 2024-09-14T09:08:31.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036299512999999999 2024-09-14T09:08:31.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112343+0000", 2024-09-14T09:08:31.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9722000000000005e-05 2024-09-14T09:08:31.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112606+0000", 2024-09-14T09:08:31.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026292600000000002 2024-09-14T09:08:31.917 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.917 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.917 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.917 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7961 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 51200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:31.917 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075947+0000", 2024-09-14T09:08:31.917 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.820191289, 2024-09-14T09:08:31.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037048949999999997, 2024-09-14T09:08:31.917 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.917 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.917 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.918 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.918 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:31.918 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:31.918 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7961 2024-09-14T09:08:31.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.918 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075947+0000", 2024-09-14T09:08:31.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075947+0000", 2024-09-14T09:08:31.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.919 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.919 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075947+0000", 2024-09-14T09:08:31.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.05e-07 2024-09-14T09:08:31.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.919 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.919 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075948+0000", 2024-09-14T09:08:31.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.28e-06 2024-09-14T09:08:31.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.919 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.919 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075951+0000", 2024-09-14T09:08:31.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7829999999999999e-06 2024-09-14T09:08:31.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.920 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075953+0000", 2024-09-14T09:08:31.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5239999999999999e-06 2024-09-14T09:08:31.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.920 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112642+0000", 2024-09-14T09:08:31.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036688193000000001 2024-09-14T09:08:31.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.920 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.921 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112741+0000", 2024-09-14T09:08:31.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9816999999999997e-05 2024-09-14T09:08:31.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.921 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.921 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112996+0000", 2024-09-14T09:08:31.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025414799999999999 2024-09-14T09:08:31.921 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.921 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.921 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.921 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7962 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 61440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:31.921 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075956+0000", 2024-09-14T09:08:31.921 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.820181673, 2024-09-14T09:08:31.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037427290000000002, 2024-09-14T09:08:31.922 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.922 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.922 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.922 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.922 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:31.922 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:31.922 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7962 2024-09-14T09:08:31.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.922 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075956+0000", 2024-09-14T09:08:31.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075956+0000", 2024-09-14T09:08:31.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075956+0000", 2024-09-14T09:08:31.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:08:31.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075958+0000", 2024-09-14T09:08:31.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.102e-06 2024-09-14T09:08:31.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075968+0000", 2024-09-14T09:08:31.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0774000000000001e-05 2024-09-14T09:08:31.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075973+0000", 2024-09-14T09:08:31.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6809999999999997e-06 2024-09-14T09:08:31.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113030+0000", 2024-09-14T09:08:31.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037057198999999999 2024-09-14T09:08:31.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113127+0000", 2024-09-14T09:08:31.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7094000000000002e-05 2024-09-14T09:08:31.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113384+0000", 2024-09-14T09:08:31.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025623099999999999 2024-09-14T09:08:31.925 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.925 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.925 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.925 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7963 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 71680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:31.926 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075980+0000", 2024-09-14T09:08:31.926 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.820157687, 2024-09-14T09:08:31.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037742675000000003, 2024-09-14T09:08:31.926 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.926 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.926 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.926 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.926 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:31.926 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:31.926 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7963 2024-09-14T09:08:31.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.926 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.926 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.926 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075980+0000", 2024-09-14T09:08:31.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.927 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.927 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075980+0000", 2024-09-14T09:08:31.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.927 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.927 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075981+0000", 2024-09-14T09:08:31.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0299999999999999e-07 2024-09-14T09:08:31.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.927 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.927 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075983+0000", 2024-09-14T09:08:31.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.886e-06 2024-09-14T09:08:31.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075989+0000", 2024-09-14T09:08:31.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9499999999999998e-06 2024-09-14T09:08:31.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075993+0000", 2024-09-14T09:08:31.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2740000000000001e-06 2024-09-14T09:08:31.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113413+0000", 2024-09-14T09:08:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037420417999999997 2024-09-14T09:08:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113508+0000", 2024-09-14T09:08:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4636999999999995e-05 2024-09-14T09:08:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113723+0000", 2024-09-14T09:08:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000215007 2024-09-14T09:08:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7964 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 98304~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075999+0000", 2024-09-14T09:08:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.820139406999999, 2024-09-14T09:08:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038103415000000002, 2024-09-14T09:08:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7964 2024-09-14T09:08:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.931 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.931 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075999+0000", 2024-09-14T09:08:31.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.931 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.931 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075999+0000", 2024-09-14T09:08:31.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.931 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.931 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075999+0000", 2024-09-14T09:08:31.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6399999999999998e-07 2024-09-14T09:08:31.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076001+0000", 2024-09-14T09:08:31.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7999999999999999e-06 2024-09-14T09:08:31.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076005+0000", 2024-09-14T09:08:31.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3309999999999997e-06 2024-09-14T09:08:31.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076008+0000", 2024-09-14T09:08:31.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-06 2024-09-14T09:08:31.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113768+0000", 2024-09-14T09:08:31.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037760295999999999 2024-09-14T09:08:31.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113854+0000", 2024-09-14T09:08:31.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6030000000000001e-05 2024-09-14T09:08:31.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114102+0000", 2024-09-14T09:08:31.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024789000000000001 2024-09-14T09:08:31.934 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.934 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.934 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.934 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7965 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 108544~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:31.934 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076011+0000", 2024-09-14T09:08:31.934 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.820126938, 2024-09-14T09:08:31.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038452854000000002, 2024-09-14T09:08:31.934 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.934 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.935 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.935 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.935 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:31.935 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:31.935 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7965 2024-09-14T09:08:31.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.935 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076011+0000", 2024-09-14T09:08:31.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076011+0000", 2024-09-14T09:08:31.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076011+0000", 2024-09-14T09:08:31.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1899999999999999e-07 2024-09-14T09:08:31.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076012+0000", 2024-09-14T09:08:31.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0610000000000001e-06 2024-09-14T09:08:31.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076015+0000", 2024-09-14T09:08:31.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8380000000000002e-06 2024-09-14T09:08:31.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076018+0000", 2024-09-14T09:08:31.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.458e-06 2024-09-14T09:08:31.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114136+0000", 2024-09-14T09:08:31.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038118217000000003 2024-09-14T09:08:31.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114218+0000", 2024-09-14T09:08:31.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2496000000000004e-05 2024-09-14T09:08:31.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114464+0000", 2024-09-14T09:08:31.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000245565 2024-09-14T09:08:31.938 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.938 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.938 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.938 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7966 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 118784~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:31.939 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076020+0000", 2024-09-14T09:08:31.939 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.820117663, 2024-09-14T09:08:31.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038813976, 2024-09-14T09:08:31.939 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.939 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.939 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.939 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.939 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:31.939 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:31.939 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7966 2024-09-14T09:08:31.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.939 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076020+0000", 2024-09-14T09:08:31.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076020+0000", 2024-09-14T09:08:31.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076020+0000", 2024-09-14T09:08:31.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1199999999999999e-07 2024-09-14T09:08:31.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076022+0000", 2024-09-14T09:08:31.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0610000000000001e-06 2024-09-14T09:08:31.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076025+0000", 2024-09-14T09:08:31.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4189999999999998e-06 2024-09-14T09:08:31.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076028+0000", 2024-09-14T09:08:31.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9909999999999998e-06 2024-09-14T09:08:31.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114497+0000", 2024-09-14T09:08:31.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038469376999999999 2024-09-14T09:08:31.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114596+0000", 2024-09-14T09:08:31.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8978e-05 2024-09-14T09:08:31.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114834+0000", 2024-09-14T09:08:31.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023793800000000001 2024-09-14T09:08:31.942 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.942 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.942 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.943 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7967 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 129024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:31.943 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076031+0000", 2024-09-14T09:08:31.943 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.82010715, 2024-09-14T09:08:31.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039142059, 2024-09-14T09:08:31.943 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.943 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.943 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.943 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.943 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:31.943 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:31.943 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7967 2024-09-14T09:08:31.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.943 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076031+0000", 2024-09-14T09:08:31.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076031+0000", 2024-09-14T09:08:31.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076031+0000", 2024-09-14T09:08:31.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.11e-07 2024-09-14T09:08:31.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076032+0000", 2024-09-14T09:08:31.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.037e-06 2024-09-14T09:08:31.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076035+0000", 2024-09-14T09:08:31.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7389999999999999e-06 2024-09-14T09:08:31.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076038+0000", 2024-09-14T09:08:31.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3780000000000001e-06 2024-09-14T09:08:31.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114868+0000", 2024-09-14T09:08:31.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038829977000000002 2024-09-14T09:08:31.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114972+0000", 2024-09-14T09:08:31.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010364100000000001 2024-09-14T09:08:31.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115173+0000", 2024-09-14T09:08:31.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020107600000000001 2024-09-14T09:08:31.947 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.947 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.947 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.947 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7968 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 155648~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:31.947 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076041+0000", 2024-09-14T09:08:31.947 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.820096849, 2024-09-14T09:08:31.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039346991999999997, 2024-09-14T09:08:31.947 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.947 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.947 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.947 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.947 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:31.947 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:31.948 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7968 2024-09-14T09:08:31.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.948 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076041+0000", 2024-09-14T09:08:31.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076041+0000", 2024-09-14T09:08:31.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076041+0000", 2024-09-14T09:08:31.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0100000000000001e-07 2024-09-14T09:08:31.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076042+0000", 2024-09-14T09:08:31.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0380000000000001e-06 2024-09-14T09:08:31.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076045+0000", 2024-09-14T09:08:31.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7250000000000002e-06 2024-09-14T09:08:31.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076047+0000", 2024-09-14T09:08:31.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4600000000000002e-06 2024-09-14T09:08:31.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115220+0000", 2024-09-14T09:08:31.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039172430000000001 2024-09-14T09:08:31.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115316+0000", 2024-09-14T09:08:31.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5712999999999997e-05 2024-09-14T09:08:31.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115388+0000", 2024-09-14T09:08:31.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2424999999999999e-05 2024-09-14T09:08:31.951 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.951 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.951 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.951 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7969 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 165888~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:31.951 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076050+0000", 2024-09-14T09:08:31.951 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.820087624999999, 2024-09-14T09:08:31.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039616993000000003, 2024-09-14T09:08:31.951 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.951 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.951 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.951 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.951 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:31.952 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:31.952 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7969 2024-09-14T09:08:31.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.952 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076050+0000", 2024-09-14T09:08:31.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076050+0000", 2024-09-14T09:08:31.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076050+0000", 2024-09-14T09:08:31.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0699999999999999e-07 2024-09-14T09:08:31.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076051+0000", 2024-09-14T09:08:31.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0049999999999999e-06 2024-09-14T09:08:31.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076054+0000", 2024-09-14T09:08:31.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7800000000000001e-06 2024-09-14T09:08:31.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076057+0000", 2024-09-14T09:08:31.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5450000000000002e-06 2024-09-14T09:08:31.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115430+0000", 2024-09-14T09:08:31.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039373506000000003 2024-09-14T09:08:31.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115509+0000", 2024-09-14T09:08:31.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8276999999999996e-05 2024-09-14T09:08:31.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115667+0000", 2024-09-14T09:08:31.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015867299999999999 2024-09-14T09:08:31.955 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.955 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.955 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.955 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7970 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 176128~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:31.955 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076060+0000", 2024-09-14T09:08:31.955 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.820078363, 2024-09-14T09:08:31.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039793765000000002, 2024-09-14T09:08:31.955 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.955 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.956 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.956 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.956 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:31.956 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:31.956 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7970 2024-09-14T09:08:31.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.956 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076060+0000", 2024-09-14T09:08:31.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076060+0000", 2024-09-14T09:08:31.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076060+0000", 2024-09-14T09:08:31.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:08:31.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076064+0000", 2024-09-14T09:08:31.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3930000000000001e-06 2024-09-14T09:08:31.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076067+0000", 2024-09-14T09:08:31.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9809999999999999e-06 2024-09-14T09:08:31.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076070+0000", 2024-09-14T09:08:31.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6010000000000002e-06 2024-09-14T09:08:31.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115699+0000", 2024-09-14T09:08:31.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039629659999999997 2024-09-14T09:08:31.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115785+0000", 2024-09-14T09:08:31.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5109000000000001e-05 2024-09-14T09:08:31.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115853+0000", 2024-09-14T09:08:31.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8812000000000005e-05 2024-09-14T09:08:31.959 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.959 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.959 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.959 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7971 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 186368~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:31.959 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076073+0000", 2024-09-14T09:08:31.959 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.820065290000001, 2024-09-14T09:08:31.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039977828, 2024-09-14T09:08:31.959 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.959 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.959 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.959 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.960 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:31.960 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:31.960 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7971 2024-09-14T09:08:31.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.960 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076073+0000", 2024-09-14T09:08:31.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076073+0000", 2024-09-14T09:08:31.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076073+0000", 2024-09-14T09:08:31.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1500000000000001e-07 2024-09-14T09:08:31.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076074+0000", 2024-09-14T09:08:31.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4499999999999995e-07 2024-09-14T09:08:31.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076077+0000", 2024-09-14T09:08:31.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.785e-06 2024-09-14T09:08:31.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076079+0000", 2024-09-14T09:08:31.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6129999999999998e-06 2024-09-14T09:08:31.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115884+0000", 2024-09-14T09:08:31.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039805261000000002 2024-09-14T09:08:31.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115973+0000", 2024-09-14T09:08:31.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8381999999999995e-05 2024-09-14T09:08:31.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116050+0000", 2024-09-14T09:08:31.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7626999999999994e-05 2024-09-14T09:08:31.963 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.963 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.963 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.963 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7972 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 212992~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:31.963 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076082+0000", 2024-09-14T09:08:31.963 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.820055870000001, 2024-09-14T09:08:31.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040162654999999998, 2024-09-14T09:08:31.964 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.964 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.964 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.964 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.964 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:31.964 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:31.964 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7972 2024-09-14T09:08:31.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.964 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076082+0000", 2024-09-14T09:08:31.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076082+0000", 2024-09-14T09:08:31.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076082+0000", 2024-09-14T09:08:31.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3099999999999999e-07 2024-09-14T09:08:31.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076083+0000", 2024-09-14T09:08:31.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.64e-07 2024-09-14T09:08:31.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076086+0000", 2024-09-14T09:08:31.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7539999999999998e-06 2024-09-14T09:08:31.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076089+0000", 2024-09-14T09:08:31.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5409999999999999e-06 2024-09-14T09:08:31.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116091+0000", 2024-09-14T09:08:31.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040002204 2024-09-14T09:08:31.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116172+0000", 2024-09-14T09:08:31.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0833000000000003e-05 2024-09-14T09:08:31.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116245+0000", 2024-09-14T09:08:31.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3127999999999995e-05 2024-09-14T09:08:31.967 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.967 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.967 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.968 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7973 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 223232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:31.968 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076091+0000", 2024-09-14T09:08:31.968 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.820046504, 2024-09-14T09:08:31.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040345740999999997, 2024-09-14T09:08:31.968 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.968 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.968 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.968 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.968 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:31.968 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:31.968 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7973 2024-09-14T09:08:31.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.968 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076091+0000", 2024-09-14T09:08:31.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076091+0000", 2024-09-14T09:08:31.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076092+0000", 2024-09-14T09:08:31.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7300000000000002e-07 2024-09-14T09:08:31.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076093+0000", 2024-09-14T09:08:31.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0300000000000001e-06 2024-09-14T09:08:31.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076096+0000", 2024-09-14T09:08:31.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6049999999999998e-06 2024-09-14T09:08:31.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076099+0000", 2024-09-14T09:08:31.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8569999999999999e-06 2024-09-14T09:08:31.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116287+0000", 2024-09-14T09:08:31.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040187753 2024-09-14T09:08:31.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116370+0000", 2024-09-14T09:08:31.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2509000000000006e-05 2024-09-14T09:08:31.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116437+0000", 2024-09-14T09:08:31.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7613999999999993e-05 2024-09-14T09:08:31.972 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.972 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.972 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.972 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7974 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 233472~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:31.972 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076102+0000", 2024-09-14T09:08:31.972 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.820035754999999, 2024-09-14T09:08:31.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040515104000000003, 2024-09-14T09:08:31.972 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.972 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.972 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.972 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.972 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:31.973 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:31.973 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7974 2024-09-14T09:08:31.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.973 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076102+0000", 2024-09-14T09:08:31.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076102+0000", 2024-09-14T09:08:31.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076102+0000", 2024-09-14T09:08:31.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.04e-07 2024-09-14T09:08:31.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076103+0000", 2024-09-14T09:08:31.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.02e-06 2024-09-14T09:08:31.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076106+0000", 2024-09-14T09:08:31.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7499999999999999e-06 2024-09-14T09:08:31.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076109+0000", 2024-09-14T09:08:31.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3510000000000002e-06 2024-09-14T09:08:31.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116469+0000", 2024-09-14T09:08:31.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040359095999999997 2024-09-14T09:08:31.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116547+0000", 2024-09-14T09:08:31.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8509000000000003e-05 2024-09-14T09:08:31.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116617+0000", 2024-09-14T09:08:31.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0173999999999996e-05 2024-09-14T09:08:31.976 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.976 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.976 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.976 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7975 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 243712~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:31.976 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076113+0000", 2024-09-14T09:08:31.976 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.820025294000001, 2024-09-14T09:08:31.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040678662999999997, 2024-09-14T09:08:31.976 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:31.976 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:31.977 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:31.977 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:31.977 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:31.977 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:31.977 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7975 2024-09-14T09:08:31.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.977 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:31.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:31.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076113+0000", 2024-09-14T09:08:31.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:31.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076113+0000", 2024-09-14T09:08:31.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:31.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:31.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076113+0000", 2024-09-14T09:08:31.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.34e-07 2024-09-14T09:08:31.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:31.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076114+0000", 2024-09-14T09:08:31.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0410000000000001e-06 2024-09-14T09:08:31.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:31.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076117+0000", 2024-09-14T09:08:31.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7870000000000002e-06 2024-09-14T09:08:31.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:31.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076121+0000", 2024-09-14T09:08:31.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1489999999999996e-06 2024-09-14T09:08:31.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:31.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116645+0000", 2024-09-14T09:08:31.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040523851999999999 2024-09-14T09:08:31.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:31.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116725+0000", 2024-09-14T09:08:31.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9985000000000001e-05 2024-09-14T09:08:31.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:31.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:31.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:31.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116791+0000", 2024-09-14T09:08:31.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6614999999999998e-05 2024-09-14T09:08:31.980 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.980 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.980 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.981 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:31.981 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:31.981 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:31.982 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:08:32.026 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:32.028+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:32.087 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:251 3.16 3.cced8f96 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29243329099999998, 2024-09-14T09:08:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29245010199999999, 2024-09-14T09:08:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 251 2024-09-14T09:08:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000005e-07 2024-09-14T09:08:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796922+0000", 2024-09-14T09:08:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.875e-06 2024-09-14T09:08:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796929+0000", 2024-09-14T09:08:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0260000000000002e-06 2024-09-14T09:08:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796935+0000", 2024-09-14T09:08:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7030000000000003e-06 2024-09-14T09:08:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796963+0000", 2024-09-14T09:08:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8368999999999999e-05 2024-09-14T09:08:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796966+0000", 2024-09-14T09:08:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4130000000000002e-06 2024-09-14T09:08:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:252 3.16 3.cced8f96 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:08:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.292407837, 2024-09-14T09:08:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29245955299999998, 2024-09-14T09:08:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 252 2024-09-14T09:08:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:08:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:08:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796945+0000", 2024-09-14T09:08:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2900000000000003e-07 2024-09-14T09:08:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796947+0000", 2024-09-14T09:08:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4279999999999999e-06 2024-09-14T09:08:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796954+0000", 2024-09-14T09:08:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5479999999999998e-06 2024-09-14T09:08:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796959+0000", 2024-09-14T09:08:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.22e-06 2024-09-14T09:08:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796988+0000", 2024-09-14T09:08:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9473000000000001e-05 2024-09-14T09:08:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:08:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:08:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:253 3.16 3.cced8f96 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29238395700000003, 2024-09-14T09:08:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.292463686, 2024-09-14T09:08:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 253 2024-09-14T09:08:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:08:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:08:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:08:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796977+0000", 2024-09-14T09:08:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5030000000000002e-06 2024-09-14T09:08:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796982+0000", 2024-09-14T09:08:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2024-09-14T09:08:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797013+0000", 2024-09-14T09:08:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0451e-05 2024-09-14T09:08:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:08:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1690000000000001e-06 2024-09-14T09:08:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:254 3.16 3.cced8f96 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:08:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29235239899999999, 2024-09-14T09:08:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29245897500000001, 2024-09-14T09:08:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 254 2024-09-14T09:08:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:08:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:08:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797000+0000", 2024-09-14T09:08:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:08:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797003+0000", 2024-09-14T09:08:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7659999999999999e-06 2024-09-14T09:08:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797010+0000", 2024-09-14T09:08:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.029e-06 2024-09-14T09:08:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:08:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2024-09-14T09:08:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797044+0000", 2024-09-14T09:08:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9213e-05 2024-09-14T09:08:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797048+0000", 2024-09-14T09:08:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3400000000000002e-06 2024-09-14T09:08:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:264 3.16 3.8e5ece76 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29232604099999998, 2024-09-14T09:08:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29245970500000001, 2024-09-14T09:08:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 264 2024-09-14T09:08:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2024-09-14T09:08:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:08:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2800000000000002e-06 2024-09-14T09:08:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:08:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0979999999999999e-06 2024-09-14T09:08:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797040+0000", 2024-09-14T09:08:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:08:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797068+0000", 2024-09-14T09:08:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7302999999999999e-05 2024-09-14T09:08:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797071+0000", 2024-09-14T09:08:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3610000000000001e-06 2024-09-14T09:08:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:265 3.16 3.8e5ece76 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:08:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29230268199999998, 2024-09-14T09:08:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29246234399999999, 2024-09-14T09:08:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 265 2024-09-14T09:08:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:08:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:08:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:08:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.39e-07 2024-09-14T09:08:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797052+0000", 2024-09-14T09:08:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.345e-06 2024-09-14T09:08:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797058+0000", 2024-09-14T09:08:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5429999999999999e-06 2024-09-14T09:08:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797064+0000", 2024-09-14T09:08:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2000000000000002e-06 2024-09-14T09:08:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797091+0000", 2024-09-14T09:08:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7804e-05 2024-09-14T09:08:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797095+0000", 2024-09-14T09:08:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2024-09-14T09:08:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:266 3.16 3.8e5ece76 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29227985099999998, 2024-09-14T09:08:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29246533400000002, 2024-09-14T09:08:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 266 2024-09-14T09:08:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:08:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797075+0000", 2024-09-14T09:08:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2570000000000002e-06 2024-09-14T09:08:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797082+0000", 2024-09-14T09:08:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8029999999999997e-06 2024-09-14T09:08:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797088+0000", 2024-09-14T09:08:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.468e-06 2024-09-14T09:08:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797116+0000", 2024-09-14T09:08:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7752000000000001e-05 2024-09-14T09:08:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797121+0000", 2024-09-14T09:08:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5960000000000003e-06 2024-09-14T09:08:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:267 3.16 3.8e5ece76 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29225504400000002, 2024-09-14T09:08:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29246724899999998, 2024-09-14T09:08:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 267 2024-09-14T09:08:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2399999999999999e-07 2024-09-14T09:08:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797099+0000", 2024-09-14T09:08:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.091e-06 2024-09-14T09:08:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797105+0000", 2024-09-14T09:08:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-09-14T09:08:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797111+0000", 2024-09-14T09:08:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5130000000000004e-06 2024-09-14T09:08:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797140+0000", 2024-09-14T09:08:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9513999999999999e-05 2024-09-14T09:08:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797145+0000", 2024-09-14T09:08:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:08:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:268 3.16 3.8e5ece76 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29223180500000001, 2024-09-14T09:08:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29247005799999998, 2024-09-14T09:08:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 268 2024-09-14T09:08:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:08:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797123+0000", 2024-09-14T09:08:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2740000000000002e-06 2024-09-14T09:08:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797129+0000", 2024-09-14T09:08:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-06 2024-09-14T09:08:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797134+0000", 2024-09-14T09:08:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9099999999999996e-06 2024-09-14T09:08:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797163+0000", 2024-09-14T09:08:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9709999999999998e-05 2024-09-14T09:08:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8709999999999999e-06 2024-09-14T09:08:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:269 3.16 3.8e5ece76 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29220829599999998, 2024-09-14T09:08:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29247261299999999, 2024-09-14T09:08:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 269 2024-09-14T09:08:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:08:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797146+0000", 2024-09-14T09:08:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5289999999999998e-06 2024-09-14T09:08:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797153+0000", 2024-09-14T09:08:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1920000000000002e-06 2024-09-14T09:08:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797158+0000", 2024-09-14T09:08:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099999999999998e-06 2024-09-14T09:08:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797188+0000", 2024-09-14T09:08:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0128e-05 2024-09-14T09:08:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797194+0000", 2024-09-14T09:08:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6250000000000004e-06 2024-09-14T09:08:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:270 3.16 3.8e5ece76 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29218447400000003, 2024-09-14T09:08:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29247461299999999, 2024-09-14T09:08:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 270 2024-09-14T09:08:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797168+0000", 2024-09-14T09:08:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2024-09-14T09:08:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797170+0000", 2024-09-14T09:08:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3120000000000001e-06 2024-09-14T09:08:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797177+0000", 2024-09-14T09:08:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0960000000000003e-06 2024-09-14T09:08:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797183+0000", 2024-09-14T09:08:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1669999999999998e-06 2024-09-14T09:08:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797213+0000", 2024-09-14T09:08:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0494e-05 2024-09-14T09:08:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:08:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:08:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:271 3.16 3.8e5ece76 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29215927600000002, 2024-09-14T09:08:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29247499100000002, 2024-09-14T09:08:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 271 2024-09-14T09:08:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:08:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797195+0000", 2024-09-14T09:08:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1639999999999999e-06 2024-09-14T09:08:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797201+0000", 2024-09-14T09:08:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1290000000000001e-06 2024-09-14T09:08:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797206+0000", 2024-09-14T09:08:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9300000000000002e-06 2024-09-14T09:08:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797237+0000", 2024-09-14T09:08:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1285000000000003e-05 2024-09-14T09:08:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797242+0000", 2024-09-14T09:08:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6e-06 2024-09-14T09:08:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:272 3.16 3.8e5ece76 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29213588200000001, 2024-09-14T09:08:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29247736299999999, 2024-09-14T09:08:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 272 2024-09-14T09:08:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:08:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:08:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5129999999999999e-06 2024-09-14T09:08:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797226+0000", 2024-09-14T09:08:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4529999999999996e-06 2024-09-14T09:08:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797232+0000", 2024-09-14T09:08:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1839999999999998e-06 2024-09-14T09:08:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797264+0000", 2024-09-14T09:08:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2691999999999998e-05 2024-09-14T09:08:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797270+0000", 2024-09-14T09:08:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-06 2024-09-14T09:08:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:246 3.16 3.cced8f96 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:08:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29260386599999999, 2024-09-14T09:08:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.292971747, 2024-09-14T09:08:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 246 2024-09-14T09:08:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:08:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:08:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796750+0000", 2024-09-14T09:08:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5519999999999999e-06 2024-09-14T09:08:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796754+0000", 2024-09-14T09:08:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2640000000000002e-06 2024-09-14T09:08:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796767+0000", 2024-09-14T09:08:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3517e-05 2024-09-14T09:08:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796775+0000", 2024-09-14T09:08:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8790000000000003e-06 2024-09-14T09:08:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796830+0000", 2024-09-14T09:08:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4829e-05 2024-09-14T09:08:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796843+0000", 2024-09-14T09:08:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.33e-05 2024-09-14T09:08:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:247 3.16 3.cced8f96 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29254908000000002, 2024-09-14T09:08:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29297912199999998, 2024-09-14T09:08:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 247 2024-09-14T09:08:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7299999999999995e-07 2024-09-14T09:08:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796807+0000", 2024-09-14T09:08:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.106e-06 2024-09-14T09:08:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796815+0000", 2024-09-14T09:08:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4740000000000005e-06 2024-09-14T09:08:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796821+0000", 2024-09-14T09:08:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0469999999999999e-06 2024-09-14T09:08:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796872+0000", 2024-09-14T09:08:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0834000000000002e-05 2024-09-14T09:08:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796878+0000", 2024-09-14T09:08:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2990000000000002e-06 2024-09-14T09:08:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:248 3.16 3.cced8f96 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:08:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29251856100000001, 2024-09-14T09:08:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29297716299999998, 2024-09-14T09:08:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 248 2024-09-14T09:08:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:08:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:08:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796834+0000", 2024-09-14T09:08:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4099999999999999e-07 2024-09-14T09:08:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796837+0000", 2024-09-14T09:08:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8459999999999999e-06 2024-09-14T09:08:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796844+0000", 2024-09-14T09:08:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1350000000000003e-06 2024-09-14T09:08:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796850+0000", 2024-09-14T09:08:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7139999999999998e-06 2024-09-14T09:08:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3909999999999998e-05 2024-09-14T09:08:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796899+0000", 2024-09-14T09:08:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7649999999999999e-06 2024-09-14T09:08:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:249 3.16 3.cced8f96 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:08:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29248479199999999, 2024-09-14T09:08:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29297057999999998, 2024-09-14T09:08:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 249 2024-09-14T09:08:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:08:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:08:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796868+0000", 2024-09-14T09:08:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2024-09-14T09:08:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796870+0000", 2024-09-14T09:08:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7889999999999999e-06 2024-09-14T09:08:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796877+0000", 2024-09-14T09:08:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8549999999999996e-06 2024-09-14T09:08:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796883+0000", 2024-09-14T09:08:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.665e-06 2024-09-14T09:08:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796915+0000", 2024-09-14T09:08:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2215999999999998e-05 2024-09-14T09:08:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796920+0000", 2024-09-14T09:08:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.527e-06 2024-09-14T09:08:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:250 3.16 3.cced8f96 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.292458726, 2024-09-14T09:08:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29297158499999998, 2024-09-14T09:08:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 250 2024-09-14T09:08:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796894+0000", 2024-09-14T09:08:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2024-09-14T09:08:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796896+0000", 2024-09-14T09:08:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5600000000000001e-06 2024-09-14T09:08:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796902+0000", 2024-09-14T09:08:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3090000000000001e-06 2024-09-14T09:08:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796909+0000", 2024-09-14T09:08:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:08:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796942+0000", 2024-09-14T09:08:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-05 2024-09-14T09:08:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796948+0000", 2024-09-14T09:08:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5910000000000001e-06 2024-09-14T09:08:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-14T09:08:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 18 2024-09-14T09:08:32.156 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:32.157 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:32.090+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:32.158 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:08:32.199 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:32.201+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:32.289 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:32.291+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:32.300 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:32.301 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:32.301 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:32.301 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:32.301 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:32.309 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:08:32.390 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:32.392+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:32.455 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4671.0:2457 3.15 e36/22 3:ab68b81a:::rbd_data.1112ca7492e7.000000000000006c:head v 36'61, mlcod=35'58)", 2024-09-14T09:08:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.895311+0000", 2024-09-14T09:08:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.560738052000001, 2024-09-14T09:08:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063523160000000002, 2024-09-14T09:08:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895311+0000", 2024-09-14T09:08:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895311+0000", 2024-09-14T09:08:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895311+0000", 2024-09-14T09:08:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5100000000000001e-07 2024-09-14T09:08:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895317+0000", 2024-09-14T09:08:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.533e-06 2024-09-14T09:08:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895324+0000", 2024-09-14T09:08:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6039999999999998e-06 2024-09-14T09:08:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895329+0000", 2024-09-14T09:08:32.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6489999999999999e-06 2024-09-14T09:08:32.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895431+0000", 2024-09-14T09:08:32.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102632 2024-09-14T09:08:32.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895450+0000", 2024-09-14T09:08:32.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8929000000000001e-05 2024-09-14T09:08:32.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901619+0000", 2024-09-14T09:08:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061693399999999997 2024-09-14T09:08:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901663+0000", 2024-09-14T09:08:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3377999999999997e-05 2024-09-14T09:08:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4671.0:2459 3.2 e36/22 3:477686f7:::rbd_data.1112ca7492e7.000000000000006d:head v 36'16, mlcod=35'11)", 2024-09-14T09:08:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.895770+0000", 2024-09-14T09:08:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.560278215, 2024-09-14T09:08:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058664190000000003, 2024-09-14T09:08:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895770+0000", 2024-09-14T09:08:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895770+0000", 2024-09-14T09:08:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895771+0000", 2024-09-14T09:08:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8500000000000001e-07 2024-09-14T09:08:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895776+0000", 2024-09-14T09:08:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3449999999999996e-06 2024-09-14T09:08:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895785+0000", 2024-09-14T09:08:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9930000000000001e-06 2024-09-14T09:08:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895792+0000", 2024-09-14T09:08:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3269999999999997e-06 2024-09-14T09:08:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895836+0000", 2024-09-14T09:08:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4474999999999997e-05 2024-09-14T09:08:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.895855+0000", 2024-09-14T09:08:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8709999999999999e-05 2024-09-14T09:08:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901599+0000", 2024-09-14T09:08:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0057440019999999998 2024-09-14T09:08:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901637+0000", 2024-09-14T09:08:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7882000000000001e-05 2024-09-14T09:08:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4671.0:2452 3.5 e36/22 3:a0dd09af:::rbd_data.1112ca7492e7.0000000000000069:head v 36'120, mlcod=35'115)", 2024-09-14T09:08:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:03.896937+0000", 2024-09-14T09:08:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.559111871999999, 2024-09-14T09:08:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050325939999999996, 2024-09-14T09:08:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896937+0000", 2024-09-14T09:08:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896937+0000", 2024-09-14T09:08:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896937+0000", 2024-09-14T09:08:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6799999999999999e-07 2024-09-14T09:08:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896946+0000", 2024-09-14T09:08:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.799e-06 2024-09-14T09:08:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896959+0000", 2024-09-14T09:08:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.308e-05 2024-09-14T09:08:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.896967+0000", 2024-09-14T09:08:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1679999999999998e-06 2024-09-14T09:08:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.897028+0000", 2024-09-14T09:08:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1958000000000005e-05 2024-09-14T09:08:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.897049+0000", 2024-09-14T09:08:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0468000000000001e-05 2024-09-14T09:08:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901929+0000", 2024-09-14T09:08:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048796610000000004 2024-09-14T09:08:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:03.901969+0000", 2024-09-14T09:08:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0692000000000003e-05 2024-09-14T09:08:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4782.0:403 3.1b 3:db2c1e17:::rbd_data.11127a12d636.0000000000000013:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,truncate 3920384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-14T09:08:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:09.334287+0000", 2024-09-14T09:08:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.121761862, 2024-09-14T09:08:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004490529, 2024-09-14T09:08:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4782", 2024-09-14T09:08:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/353415140", 2024-09-14T09:08:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 403 2024-09-14T09:08:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334287+0000", 2024-09-14T09:08:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334287+0000", 2024-09-14T09:08:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334288+0000", 2024-09-14T09:08:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2860000000000001e-06 2024-09-14T09:08:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334294+0000", 2024-09-14T09:08:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8119999999999996e-06 2024-09-14T09:08:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334305+0000", 2024-09-14T09:08:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0710000000000001e-05 2024-09-14T09:08:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334310+0000", 2024-09-14T09:08:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1309999999999997e-06 2024-09-14T09:08:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334355+0000", 2024-09-14T09:08:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5002e-05 2024-09-14T09:08:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334441+0000", 2024-09-14T09:08:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6632999999999995e-05 2024-09-14T09:08:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334550+0000", 2024-09-14T09:08:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010870999999999999 2024-09-14T09:08:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.334949+0000", 2024-09-14T09:08:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00039932800000000001 2024-09-14T09:08:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:32.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.338702+0000", 2024-09-14T09:08:32.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037526529999999999 2024-09-14T09:08:32.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.338749+0000", 2024-09-14T09:08:32.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6579999999999998e-05 2024-09-14T09:08:32.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.338777+0000", 2024-09-14T09:08:32.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8683999999999998e-05 2024-09-14T09:08:32.476 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.476 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.476 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.477 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4782.0:881 3.1b 3:d82d5c58:::rbd_data.11127a12d636.000000000000000b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,truncate 4063232] snapc f=[f] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T09:08:32.477 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:09.937996+0000", 2024-09-14T09:08:32.477 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.518053010999999, 2024-09-14T09:08:32.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0081376629999999998, 2024-09-14T09:08:32.477 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.477 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.477 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.477 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.477 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4782", 2024-09-14T09:08:32.477 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/353415140", 2024-09-14T09:08:32.477 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 881 2024-09-14T09:08:32.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.478 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.937996+0000", 2024-09-14T09:08:32.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.937996+0000", 2024-09-14T09:08:32.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.937997+0000", 2024-09-14T09:08:32.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2419999999999999e-06 2024-09-14T09:08:32.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938002+0000", 2024-09-14T09:08:32.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3870000000000003e-06 2024-09-14T09:08:32.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938014+0000", 2024-09-14T09:08:32.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.22e-05 2024-09-14T09:08:32.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938020+0000", 2024-09-14T09:08:32.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9619999999999998e-06 2024-09-14T09:08:32.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938062+0000", 2024-09-14T09:08:32.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2150000000000001e-05 2024-09-14T09:08:32.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938156+0000", 2024-09-14T09:08:32.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3344999999999995e-05 2024-09-14T09:08:32.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:32.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938275+0000", 2024-09-14T09:08:32.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000118983 2024-09-14T09:08:32.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:32.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941256+0000", 2024-09-14T09:08:32.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002981151 2024-09-14T09:08:32.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:32.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.946065+0000", 2024-09-14T09:08:32.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048087190000000004 2024-09-14T09:08:32.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.946104+0000", 2024-09-14T09:08:32.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9363000000000002e-05 2024-09-14T09:08:32.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.946133+0000", 2024-09-14T09:08:32.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9161000000000001e-05 2024-09-14T09:08:32.483 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.483 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.483 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.483 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4782.0:883 3.1b 3:de177a91:::rbd_data.11127a12d636.000000000000000d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T09:08:32.483 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:09.940054+0000", 2024-09-14T09:08:32.483 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.515994142, 2024-09-14T09:08:32.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080861400000000003, 2024-09-14T09:08:32.483 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.483 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.483 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.483 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.483 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4782", 2024-09-14T09:08:32.483 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/353415140", 2024-09-14T09:08:32.483 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 883 2024-09-14T09:08:32.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.484 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.940054+0000", 2024-09-14T09:08:32.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.940054+0000", 2024-09-14T09:08:32.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.940055+0000", 2024-09-14T09:08:32.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5899999999999995e-07 2024-09-14T09:08:32.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941937+0000", 2024-09-14T09:08:32.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018813230000000001 2024-09-14T09:08:32.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941948+0000", 2024-09-14T09:08:32.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1542999999999999e-05 2024-09-14T09:08:32.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941954+0000", 2024-09-14T09:08:32.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1109999999999996e-06 2024-09-14T09:08:32.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.942005+0000", 2024-09-14T09:08:32.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1286000000000003e-05 2024-09-14T09:08:32.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.942126+0000", 2024-09-14T09:08:32.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012029800000000001 2024-09-14T09:08:32.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:32.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.942401+0000", 2024-09-14T09:08:32.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00027493500000000002 2024-09-14T09:08:32.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:32.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.946143+0000", 2024-09-14T09:08:32.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037426130000000001 2024-09-14T09:08:32.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:32.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.948084+0000", 2024-09-14T09:08:32.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001940862 2024-09-14T09:08:32.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.948117+0000", 2024-09-14T09:08:32.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3309999999999998e-05 2024-09-14T09:08:32.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.948141+0000", 2024-09-14T09:08:32.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3099999999999999e-05 2024-09-14T09:08:32.489 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.490 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.490 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.490 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4782.0:884 3.1b 3:de177a91:::rbd_data.11127a12d636.000000000000000d:head [truncate 4063232] snapc f=[f] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T09:08:32.490 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:09.941969+0000", 2024-09-14T09:08:32.490 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.514079872, 2024-09-14T09:08:32.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065065640000000003, 2024-09-14T09:08:32.490 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.490 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.491 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.491 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.491 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4782", 2024-09-14T09:08:32.491 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/353415140", 2024-09-14T09:08:32.491 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 884 2024-09-14T09:08:32.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.491 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941969+0000", 2024-09-14T09:08:32.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941969+0000", 2024-09-14T09:08:32.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941969+0000", 2024-09-14T09:08:32.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6700000000000003e-07 2024-09-14T09:08:32.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941971+0000", 2024-09-14T09:08:32.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.748e-06 2024-09-14T09:08:32.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941980+0000", 2024-09-14T09:08:32.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7120000000000006e-06 2024-09-14T09:08:32.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941983+0000", 2024-09-14T09:08:32.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5549999999999998e-06 2024-09-14T09:08:32.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.944525+0000", 2024-09-14T09:08:32.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025416029999999999 2024-09-14T09:08:32.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.944592+0000", 2024-09-14T09:08:32.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6871000000000004e-05 2024-09-14T09:08:32.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:32.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.944720+0000", 2024-09-14T09:08:32.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012863600000000001 2024-09-14T09:08:32.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:32.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.946292+0000", 2024-09-14T09:08:32.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015713470000000001 2024-09-14T09:08:32.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:32.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.948426+0000", 2024-09-14T09:08:32.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021343669999999999 2024-09-14T09:08:32.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.948453+0000", 2024-09-14T09:08:32.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6574999999999999e-05 2024-09-14T09:08:32.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.948475+0000", 2024-09-14T09:08:32.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2483000000000001e-05 2024-09-14T09:08:32.496 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.496 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.496 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.496 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4819.0:4705 3.1b 3:da69c123:::rbd_data.111258e7abd2.0000000000000051:head [set-alloc-hint object_size 524288 write_size 524288,write 453632~5120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-14T09:08:32.497 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:14.120590+0000", 2024-09-14T09:08:32.497 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.335458563, 2024-09-14T09:08:32.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043509020000000002, 2024-09-14T09:08:32.497 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.497 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.497 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.497 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.497 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4819", 2024-09-14T09:08:32.497 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:32.497 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4705 2024-09-14T09:08:32.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.497 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120590+0000", 2024-09-14T09:08:32.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120590+0000", 2024-09-14T09:08:32.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120591+0000", 2024-09-14T09:08:32.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6000000000000003e-07 2024-09-14T09:08:32.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120599+0000", 2024-09-14T09:08:32.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1070000000000005e-06 2024-09-14T09:08:32.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120609+0000", 2024-09-14T09:08:32.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0227000000000001e-05 2024-09-14T09:08:32.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120632+0000", 2024-09-14T09:08:32.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2833e-05 2024-09-14T09:08:32.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120678+0000", 2024-09-14T09:08:32.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6439e-05 2024-09-14T09:08:32.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120769+0000", 2024-09-14T09:08:32.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0919000000000001e-05 2024-09-14T09:08:32.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:32.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.120846+0000", 2024-09-14T09:08:32.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6470999999999993e-05 2024-09-14T09:08:32.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:32.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.121356+0000", 2024-09-14T09:08:32.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00051052900000000002 2024-09-14T09:08:32.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:32.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.124889+0000", 2024-09-14T09:08:32.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035324879999999999 2024-09-14T09:08:32.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.124919+0000", 2024-09-14T09:08:32.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9768999999999999e-05 2024-09-14T09:08:32.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.124941+0000", 2024-09-14T09:08:32.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2359999999999999e-05 2024-09-14T09:08:32.502 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.502 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.502 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.503 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4819.0:5071 3.1b 3:dfbbb139:::rbd_data.111258e7abd2.000000000000016e:head [set-alloc-hint object_size 524288 write_size 524288,write 491520~32768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-14T09:08:32.503 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:14.249142+0000", 2024-09-14T09:08:32.503 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.206906249999999, 2024-09-14T09:08:32.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051714309999999998, 2024-09-14T09:08:32.503 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.503 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.503 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.503 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.503 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4819", 2024-09-14T09:08:32.503 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:32.503 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5071 2024-09-14T09:08:32.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.503 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249142+0000", 2024-09-14T09:08:32.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249142+0000", 2024-09-14T09:08:32.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249143+0000", 2024-09-14T09:08:32.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7400000000000002e-07 2024-09-14T09:08:32.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249170+0000", 2024-09-14T09:08:32.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7246e-05 2024-09-14T09:08:32.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249180+0000", 2024-09-14T09:08:32.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9890000000000004e-06 2024-09-14T09:08:32.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249185+0000", 2024-09-14T09:08:32.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0849999999999996e-06 2024-09-14T09:08:32.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249224+0000", 2024-09-14T09:08:32.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8828000000000002e-05 2024-09-14T09:08:32.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249296+0000", 2024-09-14T09:08:32.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1831999999999999e-05 2024-09-14T09:08:32.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:32.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249375+0000", 2024-09-14T09:08:32.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9177000000000004e-05 2024-09-14T09:08:32.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:32.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.249839+0000", 2024-09-14T09:08:32.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00046331399999999999 2024-09-14T09:08:32.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:32.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.254263+0000", 2024-09-14T09:08:32.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044240089999999996 2024-09-14T09:08:32.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.254293+0000", 2024-09-14T09:08:32.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0018e-05 2024-09-14T09:08:32.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.254314+0000", 2024-09-14T09:08:32.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1158999999999999e-05 2024-09-14T09:08:32.508 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.508 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.508 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.509 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4819.0:5479 3.1b 3:de753bd2:::rbd_data.111258e7abd2.0000000000000173:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-14T09:08:32.509 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:14.369980+0000", 2024-09-14T09:08:32.509 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.086069017, 2024-09-14T09:08:32.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051695830000000002, 2024-09-14T09:08:32.509 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.509 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.509 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.509 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.509 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4819", 2024-09-14T09:08:32.509 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:32.510 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5479 2024-09-14T09:08:32.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.510 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.369980+0000", 2024-09-14T09:08:32.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.369980+0000", 2024-09-14T09:08:32.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.369981+0000", 2024-09-14T09:08:32.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9130000000000001e-06 2024-09-14T09:08:32.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.369990+0000", 2024-09-14T09:08:32.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7329999999999992e-06 2024-09-14T09:08:32.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.370018+0000", 2024-09-14T09:08:32.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7710000000000001e-05 2024-09-14T09:08:32.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.370037+0000", 2024-09-14T09:08:32.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9196000000000001e-05 2024-09-14T09:08:32.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.370152+0000", 2024-09-14T09:08:32.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011479799999999999 2024-09-14T09:08:32.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.370236+0000", 2024-09-14T09:08:32.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3628999999999995e-05 2024-09-14T09:08:32.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:32.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.370348+0000", 2024-09-14T09:08:32.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112884 2024-09-14T09:08:32.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:32.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.371164+0000", 2024-09-14T09:08:32.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00081568199999999997 2024-09-14T09:08:32.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:32.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.375085+0000", 2024-09-14T09:08:32.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039209900000000001 2024-09-14T09:08:32.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.375114+0000", 2024-09-14T09:08:32.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9141000000000001e-05 2024-09-14T09:08:32.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.375149+0000", 2024-09-14T09:08:32.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4907000000000003e-05 2024-09-14T09:08:32.515 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.515 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.515 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.515 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4819.0:5648 3.1b 3:ddac6bbf:::rbd_data.111258e7abd2.000000000000002a:head [set-alloc-hint object_size 524288 write_size 524288,write 211456~17920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-14T09:08:32.515 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:14.428139+0000", 2024-09-14T09:08:32.515 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.027909828999999, 2024-09-14T09:08:32.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043123170000000004, 2024-09-14T09:08:32.515 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.515 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.515 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.515 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.515 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4819", 2024-09-14T09:08:32.516 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:32.516 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5648 2024-09-14T09:08:32.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.516 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428139+0000", 2024-09-14T09:08:32.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428139+0000", 2024-09-14T09:08:32.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428139+0000", 2024-09-14T09:08:32.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.99e-07 2024-09-14T09:08:32.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428157+0000", 2024-09-14T09:08:32.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7706999999999998e-05 2024-09-14T09:08:32.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428168+0000", 2024-09-14T09:08:32.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1088e-05 2024-09-14T09:08:32.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428174+0000", 2024-09-14T09:08:32.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.942e-06 2024-09-14T09:08:32.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428211+0000", 2024-09-14T09:08:32.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6968000000000002e-05 2024-09-14T09:08:32.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428256+0000", 2024-09-14T09:08:32.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5207999999999998e-05 2024-09-14T09:08:32.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:32.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428371+0000", 2024-09-14T09:08:32.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114215 2024-09-14T09:08:32.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:32.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.428917+0000", 2024-09-14T09:08:32.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00054596099999999997 2024-09-14T09:08:32.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:32.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.432364+0000", 2024-09-14T09:08:32.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003447327 2024-09-14T09:08:32.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.432415+0000", 2024-09-14T09:08:32.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0692000000000002e-05 2024-09-14T09:08:32.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.432451+0000", 2024-09-14T09:08:32.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6510000000000001e-05 2024-09-14T09:08:32.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.522 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.522 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4819.0:5992 3.1b 3:d863f74f:::rbd_data.111258e7abd2.0000000000000096:head [set-alloc-hint object_size 524288 write_size 524288,write 275456~19456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-14T09:08:32.522 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:14.561771+0000", 2024-09-14T09:08:32.522 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.894277688999999, 2024-09-14T09:08:32.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044464300000000003, 2024-09-14T09:08:32.522 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.522 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.522 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.523 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.523 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4819", 2024-09-14T09:08:32.523 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/740327606", 2024-09-14T09:08:32.523 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5992 2024-09-14T09:08:32.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.523 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561771+0000", 2024-09-14T09:08:32.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561771+0000", 2024-09-14T09:08:32.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561772+0000", 2024-09-14T09:08:32.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1999999999999998e-07 2024-09-14T09:08:32.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561792+0000", 2024-09-14T09:08:32.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0615000000000002e-05 2024-09-14T09:08:32.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561803+0000", 2024-09-14T09:08:32.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0997e-05 2024-09-14T09:08:32.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561810+0000", 2024-09-14T09:08:32.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.353e-06 2024-09-14T09:08:32.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561853+0000", 2024-09-14T09:08:32.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2855999999999998e-05 2024-09-14T09:08:32.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561897+0000", 2024-09-14T09:08:32.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4978000000000002e-05 2024-09-14T09:08:32.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:32.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.561976+0000", 2024-09-14T09:08:32.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8857999999999996e-05 2024-09-14T09:08:32.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:32.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.562543+0000", 2024-09-14T09:08:32.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056632500000000001 2024-09-14T09:08:32.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:32.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.566166+0000", 2024-09-14T09:08:32.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003623214 2024-09-14T09:08:32.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.566195+0000", 2024-09-14T09:08:32.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9349999999999999e-05 2024-09-14T09:08:32.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:14.566217+0000", 2024-09-14T09:08:32.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2064000000000001e-05 2024-09-14T09:08:32.528 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.528 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.528 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.528 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4766.0:1257 3.15 e46/22 3:ae2b37e3:::rbd_data.111232b23a18.000000000000010f:head v 46'419, mlcod=46'417)", 2024-09-14T09:08:32.528 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.056608+0000", 2024-09-14T09:08:32.528 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.399440179999999, 2024-09-14T09:08:32.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043291629999999996, 2024-09-14T09:08:32.528 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.528 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.529 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.529 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056608+0000", 2024-09-14T09:08:32.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056608+0000", 2024-09-14T09:08:32.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056609+0000", 2024-09-14T09:08:32.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-07 2024-09-14T09:08:32.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056620+0000", 2024-09-14T09:08:32.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0701e-05 2024-09-14T09:08:32.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056630+0000", 2024-09-14T09:08:32.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0225e-05 2024-09-14T09:08:32.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056637+0000", 2024-09-14T09:08:32.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5830000000000003e-06 2024-09-14T09:08:32.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056694+0000", 2024-09-14T09:08:32.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6774999999999998e-05 2024-09-14T09:08:32.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056716+0000", 2024-09-14T09:08:32.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2184999999999999e-05 2024-09-14T09:08:32.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.060892+0000", 2024-09-14T09:08:32.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0041758430000000003 2024-09-14T09:08:32.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.060938+0000", 2024-09-14T09:08:32.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6e-05 2024-09-14T09:08:32.532 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.532 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.532 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.533 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4766.0:1812 3.9 e46/22 3:974b410d:::rbd_data.111232b23a18.00000000000000ee:head v 46'191, mlcod=46'188)", 2024-09-14T09:08:32.533 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.142532+0000", 2024-09-14T09:08:32.533 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.313516816, 2024-09-14T09:08:32.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058848579999999998, 2024-09-14T09:08:32.533 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.533 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.533 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.534 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.142532+0000", 2024-09-14T09:08:32.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.142532+0000", 2024-09-14T09:08:32.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.142532+0000", 2024-09-14T09:08:32.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1099999999999995e-07 2024-09-14T09:08:32.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.142544+0000", 2024-09-14T09:08:32.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1224e-05 2024-09-14T09:08:32.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.142556+0000", 2024-09-14T09:08:32.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2238e-05 2024-09-14T09:08:32.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.142563+0000", 2024-09-14T09:08:32.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.781e-06 2024-09-14T09:08:32.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.142601+0000", 2024-09-14T09:08:32.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8299e-05 2024-09-14T09:08:32.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.142620+0000", 2024-09-14T09:08:32.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8686e-05 2024-09-14T09:08:32.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.148364+0000", 2024-09-14T09:08:32.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0057439910000000004 2024-09-14T09:08:32.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.148417+0000", 2024-09-14T09:08:32.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3028000000000001e-05 2024-09-14T09:08:32.539 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.539 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.539 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.539 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4766.0:1814 3.7 e46/22 3:e2906054:::rbd_data.111232b23a18.00000000000000f0:head v 46'327, mlcod=46'325)", 2024-09-14T09:08:32.539 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.143985+0000", 2024-09-14T09:08:32.540 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.312063136000001, 2024-09-14T09:08:32.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004573985, 2024-09-14T09:08:32.540 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.540 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.540 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.540 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.143985+0000", 2024-09-14T09:08:32.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.143985+0000", 2024-09-14T09:08:32.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.143986+0000", 2024-09-14T09:08:32.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1500000000000003e-07 2024-09-14T09:08:32.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.143997+0000", 2024-09-14T09:08:32.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.049e-05 2024-09-14T09:08:32.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.144007+0000", 2024-09-14T09:08:32.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0339e-05 2024-09-14T09:08:32.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.144012+0000", 2024-09-14T09:08:32.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4090000000000002e-06 2024-09-14T09:08:32.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.144061+0000", 2024-09-14T09:08:32.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8219e-05 2024-09-14T09:08:32.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.144081+0000", 2024-09-14T09:08:32.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0557e-05 2024-09-14T09:08:32.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.148517+0000", 2024-09-14T09:08:32.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044355089999999998 2024-09-14T09:08:32.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.148559+0000", 2024-09-14T09:08:32.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2647e-05 2024-09-14T09:08:32.544 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.544 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.545 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.545 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4766.0:2349 3.1e e46/22 3:7a637f1d:::rbd_data.111232b23a18.0000000000000098:head v 46'146, mlcod=46'144)", 2024-09-14T09:08:32.545 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.205112+0000", 2024-09-14T09:08:32.545 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.250937065, 2024-09-14T09:08:32.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042264310000000001, 2024-09-14T09:08:32.545 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.545 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.545 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.545 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205112+0000", 2024-09-14T09:08:32.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205112+0000", 2024-09-14T09:08:32.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205112+0000", 2024-09-14T09:08:32.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5700000000000001e-07 2024-09-14T09:08:32.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205123+0000", 2024-09-14T09:08:32.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0494e-05 2024-09-14T09:08:32.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205133+0000", 2024-09-14T09:08:32.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0030000000000001e-05 2024-09-14T09:08:32.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205138+0000", 2024-09-14T09:08:32.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9030000000000003e-06 2024-09-14T09:08:32.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205182+0000", 2024-09-14T09:08:32.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4088999999999997e-05 2024-09-14T09:08:32.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205194+0000", 2024-09-14T09:08:32.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868999999999999e-05 2024-09-14T09:08:32.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209297+0000", 2024-09-14T09:08:32.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0041032000000000004 2024-09-14T09:08:32.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209338+0000", 2024-09-14T09:08:32.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0988999999999997e-05 2024-09-14T09:08:32.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.549 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.549 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4766.0:2351 3.15 e46/22 3:aa5230da:::rbd_data.111232b23a18.000000000000009a:head v 46'425, mlcod=46'422)", 2024-09-14T09:08:32.549 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.206258+0000", 2024-09-14T09:08:32.549 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.24979068, 2024-09-14T09:08:32.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059542889999999998, 2024-09-14T09:08:32.549 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.549 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.549 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.549 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206258+0000", 2024-09-14T09:08:32.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206258+0000", 2024-09-14T09:08:32.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206259+0000", 2024-09-14T09:08:32.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9999999999999997e-07 2024-09-14T09:08:32.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206267+0000", 2024-09-14T09:08:32.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2199999999999992e-06 2024-09-14T09:08:32.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206279+0000", 2024-09-14T09:08:32.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2002e-05 2024-09-14T09:08:32.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206286+0000", 2024-09-14T09:08:32.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7510000000000002e-06 2024-09-14T09:08:32.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206330+0000", 2024-09-14T09:08:32.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4776e-05 2024-09-14T09:08:32.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206348+0000", 2024-09-14T09:08:32.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7659000000000002e-05 2024-09-14T09:08:32.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212172+0000", 2024-09-14T09:08:32.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058235650000000002 2024-09-14T09:08:32.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212212+0000", 2024-09-14T09:08:32.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0615999999999999e-05 2024-09-14T09:08:32.553 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.553 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.553 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.554 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4766.0:2370 3.2 e46/22 3:43b2ee4a:::rbd_data.111232b23a18.000000000000009d:head v 46'118, mlcod=46'116)", 2024-09-14T09:08:32.554 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.209956+0000", 2024-09-14T09:08:32.554 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.246092472999999, 2024-09-14T09:08:32.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052104539999999998, 2024-09-14T09:08:32.554 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.554 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.554 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.554 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209956+0000", 2024-09-14T09:08:32.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209956+0000", 2024-09-14T09:08:32.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209957+0000", 2024-09-14T09:08:32.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9100000000000003e-07 2024-09-14T09:08:32.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209964+0000", 2024-09-14T09:08:32.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3980000000000002e-06 2024-09-14T09:08:32.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209974+0000", 2024-09-14T09:08:32.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3409999999999992e-06 2024-09-14T09:08:32.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209978+0000", 2024-09-14T09:08:32.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7219999999999999e-06 2024-09-14T09:08:32.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.210028+0000", 2024-09-14T09:08:32.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9577999999999999e-05 2024-09-14T09:08:32.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.210049+0000", 2024-09-14T09:08:32.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0866999999999999e-05 2024-09-14T09:08:32.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.215117+0000", 2024-09-14T09:08:32.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050677880000000002 2024-09-14T09:08:32.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.215167+0000", 2024-09-14T09:08:32.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9969000000000002e-05 2024-09-14T09:08:32.558 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.558 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.558 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.559 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4766.0:5795 3.15 e46/22 3:aa5fe193:::rbd_data.111232b23a18.00000000000001a2:head v 46'436, mlcod=46'434)", 2024-09-14T09:08:32.559 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.855169+0000", 2024-09-14T09:08:32.559 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.600879299000001, 2024-09-14T09:08:32.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0041731800000000003, 2024-09-14T09:08:32.559 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.559 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.559 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.559 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.855169+0000", 2024-09-14T09:08:32.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.855169+0000", 2024-09-14T09:08:32.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.855170+0000", 2024-09-14T09:08:32.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3699999999999999e-07 2024-09-14T09:08:32.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.855185+0000", 2024-09-14T09:08:32.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4483e-05 2024-09-14T09:08:32.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.855197+0000", 2024-09-14T09:08:32.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2522e-05 2024-09-14T09:08:32.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.855205+0000", 2024-09-14T09:08:32.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6190000000000002e-06 2024-09-14T09:08:32.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.855264+0000", 2024-09-14T09:08:32.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9500999999999998e-05 2024-09-14T09:08:32.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.855289+0000", 2024-09-14T09:08:32.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4247999999999999e-05 2024-09-14T09:08:32.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.859302+0000", 2024-09-14T09:08:32.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040135450000000003 2024-09-14T09:08:32.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.859342+0000", 2024-09-14T09:08:32.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0324999999999998e-05 2024-09-14T09:08:32.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.562 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.563 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4959.0:1643 3.18 e50/22 3:1b5c3206:::rbd_data.1112dcec84c0.000000000000002c:head v 50'102, mlcod=50'99)", 2024-09-14T09:08:32.563 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:23.984266+0000", 2024-09-14T09:08:32.563 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.4717830290000009, 2024-09-14T09:08:32.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046490840000000004, 2024-09-14T09:08:32.563 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.563 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.563 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.563 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.984266+0000", 2024-09-14T09:08:32.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.984266+0000", 2024-09-14T09:08:32.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.984266+0000", 2024-09-14T09:08:32.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4900000000000004e-07 2024-09-14T09:08:32.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.984281+0000", 2024-09-14T09:08:32.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4059e-05 2024-09-14T09:08:32.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.984299+0000", 2024-09-14T09:08:32.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8082999999999999e-05 2024-09-14T09:08:32.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.984307+0000", 2024-09-14T09:08:32.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9680000000000006e-06 2024-09-14T09:08:32.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.984391+0000", 2024-09-14T09:08:32.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4293000000000001e-05 2024-09-14T09:08:32.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.984409+0000", 2024-09-14T09:08:32.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8525999999999998e-05 2024-09-14T09:08:32.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.988857+0000", 2024-09-14T09:08:32.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044473330000000004 2024-09-14T09:08:32.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:23.988915+0000", 2024-09-14T09:08:32.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7873e-05 2024-09-14T09:08:32.568 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.568 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.568 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.568 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.568 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.568 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:32.570 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:08:32.570 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:32.572+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:32.671 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:32.673+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:32.673 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:32.673 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:32.673 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:32.673 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:32.683 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:08:32.772 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:32.774+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:32.832 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:32.832 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:32.832 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:32.832 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:32.832 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:32.841 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:08:32.873 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:32.875+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:32.946 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:32.946 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:32.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:32.946 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:32.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:1137 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.043863+0000", 2024-09-14T09:08:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.902930203, 2024-09-14T09:08:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018224061, 2024-09-14T09:08:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:32.947 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1137 2024-09-14T09:08:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043863+0000", 2024-09-14T09:08:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043863+0000", 2024-09-14T09:08:32.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043863+0000", 2024-09-14T09:08:32.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3099999999999998e-07 2024-09-14T09:08:32.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043866+0000", 2024-09-14T09:08:32.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5620000000000002e-06 2024-09-14T09:08:32.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043872+0000", 2024-09-14T09:08:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5579999999999997e-06 2024-09-14T09:08:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043877+0000", 2024-09-14T09:08:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7299999999999996e-06 2024-09-14T09:08:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056308+0000", 2024-09-14T09:08:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012430925000000001 2024-09-14T09:08:32.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056382+0000", 2024-09-14T09:08:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3870999999999998e-05 2024-09-14T09:08:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056753+0000", 2024-09-14T09:08:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000371343 2024-09-14T09:08:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:32.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.061992+0000", 2024-09-14T09:08:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005238688 2024-09-14T09:08:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.062028+0000", 2024-09-14T09:08:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6040000000000001e-05 2024-09-14T09:08:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.062054+0000", 2024-09-14T09:08:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5856000000000001e-05 2024-09-14T09:08:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.062087+0000", 2024-09-14T09:08:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2957000000000003e-05 2024-09-14T09:08:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:1139 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.044918+0000", 2024-09-14T09:08:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.901875349000001, 2024-09-14T09:08:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019100876999999999, 2024-09-14T09:08:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1139 2024-09-14T09:08:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044918+0000", 2024-09-14T09:08:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044918+0000", 2024-09-14T09:08:32.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044918+0000", 2024-09-14T09:08:32.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2500000000000004e-07 2024-09-14T09:08:32.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044924+0000", 2024-09-14T09:08:32.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2050000000000001e-06 2024-09-14T09:08:32.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044935+0000", 2024-09-14T09:08:32.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1321000000000001e-05 2024-09-14T09:08:32.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044942+0000", 2024-09-14T09:08:32.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.277e-06 2024-09-14T09:08:32.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.057831+0000", 2024-09-14T09:08:32.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012888692 2024-09-14T09:08:32.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.057912+0000", 2024-09-14T09:08:32.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0875000000000001e-05 2024-09-14T09:08:32.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:32.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.058249+0000", 2024-09-14T09:08:32.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033680100000000002 2024-09-14T09:08:32.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:32.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.063666+0000", 2024-09-14T09:08:32.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054178189999999999 2024-09-14T09:08:32.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:32.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.063922+0000", 2024-09-14T09:08:32.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00025591699999999998 2024-09-14T09:08:32.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.063978+0000", 2024-09-14T09:08:32.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5603000000000003e-05 2024-09-14T09:08:32.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064018+0000", 2024-09-14T09:08:32.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0441999999999997e-05 2024-09-14T09:08:32.960 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.960 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.960 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.960 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:1140 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:32.960 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.045510+0000", 2024-09-14T09:08:32.960 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.901282859, 2024-09-14T09:08:32.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018615145, 2024-09-14T09:08:32.961 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.961 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.961 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.961 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.961 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:32.961 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:32.961 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1140 2024-09-14T09:08:32.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.962 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045510+0000", 2024-09-14T09:08:32.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045510+0000", 2024-09-14T09:08:32.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045511+0000", 2024-09-14T09:08:32.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8899999999999998e-07 2024-09-14T09:08:32.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045516+0000", 2024-09-14T09:08:32.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9749999999999998e-06 2024-09-14T09:08:32.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045530+0000", 2024-09-14T09:08:32.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4542000000000001e-05 2024-09-14T09:08:32.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045542+0000", 2024-09-14T09:08:32.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1984000000000001e-05 2024-09-14T09:08:32.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.058561+0000", 2024-09-14T09:08:32.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01301828 2024-09-14T09:08:32.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.058628+0000", 2024-09-14T09:08:32.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7049000000000001e-05 2024-09-14T09:08:32.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:32.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.058827+0000", 2024-09-14T09:08:32.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019901200000000001 2024-09-14T09:08:32.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:32.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.063672+0000", 2024-09-14T09:08:32.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048450339999999998 2024-09-14T09:08:32.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:32.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064068+0000", 2024-09-14T09:08:32.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00039579200000000001 2024-09-14T09:08:32.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064098+0000", 2024-09-14T09:08:32.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9940000000000001e-05 2024-09-14T09:08:32.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064125+0000", 2024-09-14T09:08:32.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7648e-05 2024-09-14T09:08:32.966 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.966 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.966 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.966 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2066 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:32.967 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.183929+0000", 2024-09-14T09:08:32.967 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.762864299, 2024-09-14T09:08:32.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020663781999999999, 2024-09-14T09:08:32.967 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.967 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.967 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.967 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.967 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:32.967 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:32.967 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2066 2024-09-14T09:08:32.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.967 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183929+0000", 2024-09-14T09:08:32.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183929+0000", 2024-09-14T09:08:32.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183929+0000", 2024-09-14T09:08:32.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2500000000000001e-07 2024-09-14T09:08:32.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183932+0000", 2024-09-14T09:08:32.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.683e-06 2024-09-14T09:08:32.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183938+0000", 2024-09-14T09:08:32.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6220000000000003e-06 2024-09-14T09:08:32.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183943+0000", 2024-09-14T09:08:32.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0340000000000004e-06 2024-09-14T09:08:32.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.198098+0000", 2024-09-14T09:08:32.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014154645 2024-09-14T09:08:32.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.198170+0000", 2024-09-14T09:08:32.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2464000000000003e-05 2024-09-14T09:08:32.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:32.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.198494+0000", 2024-09-14T09:08:32.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00032338499999999998 2024-09-14T09:08:32.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:32.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.202395+0000", 2024-09-14T09:08:32.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003900714 2024-09-14T09:08:32.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:32.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204488+0000", 2024-09-14T09:08:32.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020932860000000002 2024-09-14T09:08:32.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204556+0000", 2024-09-14T09:08:32.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8021999999999993e-05 2024-09-14T09:08:32.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204592+0000", 2024-09-14T09:08:32.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6501999999999997e-05 2024-09-14T09:08:32.973 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.973 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.974 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.974 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2067 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:32.974 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.183952+0000", 2024-09-14T09:08:32.974 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.762841364, 2024-09-14T09:08:32.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020733690999999999, 2024-09-14T09:08:32.974 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.974 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.974 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.974 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.974 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:32.974 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:32.974 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2067 2024-09-14T09:08:32.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.975 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183952+0000", 2024-09-14T09:08:32.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183952+0000", 2024-09-14T09:08:32.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183952+0000", 2024-09-14T09:08:32.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4499999999999998e-07 2024-09-14T09:08:32.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183953+0000", 2024-09-14T09:08:32.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5659999999999999e-06 2024-09-14T09:08:32.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183961+0000", 2024-09-14T09:08:32.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8979999999999996e-06 2024-09-14T09:08:32.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183965+0000", 2024-09-14T09:08:32.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3440000000000001e-06 2024-09-14T09:08:32.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.199110+0000", 2024-09-14T09:08:32.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015145257000000001 2024-09-14T09:08:32.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.199183+0000", 2024-09-14T09:08:32.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3075000000000001e-05 2024-09-14T09:08:32.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:32.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.199495+0000", 2024-09-14T09:08:32.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00031204200000000001 2024-09-14T09:08:32.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:32.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204475+0000", 2024-09-14T09:08:32.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049796809999999997 2024-09-14T09:08:32.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:32.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204601+0000", 2024-09-14T09:08:32.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000126713 2024-09-14T09:08:32.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204644+0000", 2024-09-14T09:08:32.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2500999999999998e-05 2024-09-14T09:08:32.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204685+0000", 2024-09-14T09:08:32.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1369000000000003e-05 2024-09-14T09:08:32.979 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.979 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.979 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.979 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2068 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:32.979 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185491+0000", 2024-09-14T09:08:32.979 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.761302295, 2024-09-14T09:08:32.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019345701, 2024-09-14T09:08:32.979 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.980 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.980 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.980 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.980 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:32.980 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:32.980 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2068 2024-09-14T09:08:32.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.980 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185491+0000", 2024-09-14T09:08:32.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185491+0000", 2024-09-14T09:08:32.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185491+0000", 2024-09-14T09:08:32.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8100000000000002e-07 2024-09-14T09:08:32.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185495+0000", 2024-09-14T09:08:32.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7100000000000001e-06 2024-09-14T09:08:32.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185504+0000", 2024-09-14T09:08:32.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7069999999999998e-06 2024-09-14T09:08:32.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185508+0000", 2024-09-14T09:08:32.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6750000000000001e-06 2024-09-14T09:08:32.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.199874+0000", 2024-09-14T09:08:32.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014365833999999999 2024-09-14T09:08:32.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.199947+0000", 2024-09-14T09:08:32.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3010999999999996e-05 2024-09-14T09:08:32.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:32.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.200280+0000", 2024-09-14T09:08:32.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033280499999999998 2024-09-14T09:08:32.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:32.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204698+0000", 2024-09-14T09:08:32.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044175400000000002 2024-09-14T09:08:32.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:32.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204746+0000", 2024-09-14T09:08:32.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8340999999999997e-05 2024-09-14T09:08:32.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204799+0000", 2024-09-14T09:08:32.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2871999999999998e-05 2024-09-14T09:08:32.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204836+0000", 2024-09-14T09:08:32.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7524999999999997e-05 2024-09-14T09:08:32.986 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.986 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.986 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.986 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2069 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:32.986 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185519+0000", 2024-09-14T09:08:32.986 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.761273929, 2024-09-14T09:08:32.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019424951999999999, 2024-09-14T09:08:32.987 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.987 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.987 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.987 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.987 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:32.987 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:32.987 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2069 2024-09-14T09:08:32.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.987 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185519+0000", 2024-09-14T09:08:32.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185519+0000", 2024-09-14T09:08:32.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185519+0000", 2024-09-14T09:08:32.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8200000000000001e-07 2024-09-14T09:08:32.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185521+0000", 2024-09-14T09:08:32.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.655e-06 2024-09-14T09:08:32.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185525+0000", 2024-09-14T09:08:32.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8870000000000002e-06 2024-09-14T09:08:32.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185528+0000", 2024-09-14T09:08:32.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6689999999999999e-06 2024-09-14T09:08:32.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.200838+0000", 2024-09-14T09:08:32.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015309779000000001 2024-09-14T09:08:32.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.200913+0000", 2024-09-14T09:08:32.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4612999999999999e-05 2024-09-14T09:08:32.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:32.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.201269+0000", 2024-09-14T09:08:32.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00035585800000000002 2024-09-14T09:08:32.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:32.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204704+0000", 2024-09-14T09:08:32.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034355879999999998 2024-09-14T09:08:32.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:32.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204883+0000", 2024-09-14T09:08:32.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017857499999999999 2024-09-14T09:08:32.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204911+0000", 2024-09-14T09:08:32.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8007000000000001e-05 2024-09-14T09:08:32.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204944+0000", 2024-09-14T09:08:32.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3039e-05 2024-09-14T09:08:32.993 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.993 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.993 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.993 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2070 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:32.993 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185533+0000", 2024-09-14T09:08:32.993 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.761260353000001, 2024-09-14T09:08:32.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019500197, 2024-09-14T09:08:32.994 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:32.994 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:32.994 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:32.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:32.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:32.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:32.994 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2070 2024-09-14T09:08:32.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.994 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:32.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:32.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185533+0000", 2024-09-14T09:08:32.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:32.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185533+0000", 2024-09-14T09:08:32.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:32.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:32.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185533+0000", 2024-09-14T09:08:32.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1500000000000001e-07 2024-09-14T09:08:32.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:32.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185534+0000", 2024-09-14T09:08:32.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.449e-06 2024-09-14T09:08:32.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:32.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185537+0000", 2024-09-14T09:08:32.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-09-14T09:08:32.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:32.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185541+0000", 2024-09-14T09:08:32.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2140000000000001e-06 2024-09-14T09:08:32.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:32.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.201762+0000", 2024-09-14T09:08:32.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016221197 2024-09-14T09:08:32.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:32.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.201815+0000", 2024-09-14T09:08:32.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2787000000000001e-05 2024-09-14T09:08:32.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:32.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.202011+0000", 2024-09-14T09:08:32.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019608200000000001 2024-09-14T09:08:32.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:32.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204709+0000", 2024-09-14T09:08:32.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026987109999999999 2024-09-14T09:08:32.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:32.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204987+0000", 2024-09-14T09:08:32.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000277636 2024-09-14T09:08:32.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:32.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205015+0000", 2024-09-14T09:08:32.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7710000000000001e-05 2024-09-14T09:08:32.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:32.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:32.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:32.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205033+0000", 2024-09-14T09:08:32.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7946000000000001e-05 2024-09-14T09:08:32.999 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.999 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:32.999 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:32.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.000 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2071 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:33.000 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185545+0000", 2024-09-14T09:08:33.000 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.761248043, 2024-09-14T09:08:33.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021874615, 2024-09-14T09:08:33.000 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:33.000 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:33.000 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:33.000 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:33.000 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:33.000 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:33.000 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2071 2024-09-14T09:08:33.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.000 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:33.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:33.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185545+0000", 2024-09-14T09:08:33.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:33.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185545+0000", 2024-09-14T09:08:33.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:33.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185545+0000", 2024-09-14T09:08:33.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1799999999999999e-07 2024-09-14T09:08:33.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:33.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185546+0000", 2024-09-14T09:08:33.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.392e-06 2024-09-14T09:08:33.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:33.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185550+0000", 2024-09-14T09:08:33.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2179999999999999e-06 2024-09-14T09:08:33.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:33.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185552+0000", 2024-09-14T09:08:33.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6419999999999999e-06 2024-09-14T09:08:33.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:33.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.202430+0000", 2024-09-14T09:08:33.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016877728000000002 2024-09-14T09:08:33.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:33.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.202499+0000", 2024-09-14T09:08:33.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9259999999999998e-05 2024-09-14T09:08:33.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:33.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.203297+0000", 2024-09-14T09:08:33.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00079781399999999999 2024-09-14T09:08:33.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:33.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.207321+0000", 2024-09-14T09:08:33.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040234420000000003 2024-09-14T09:08:33.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:33.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.207349+0000", 2024-09-14T09:08:33.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8736000000000001e-05 2024-09-14T09:08:33.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:33.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.207381+0000", 2024-09-14T09:08:33.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1315000000000001e-05 2024-09-14T09:08:33.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:33.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.207419+0000", 2024-09-14T09:08:33.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8850000000000002e-05 2024-09-14T09:08:33.005 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.005 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:33.005 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.006 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2072 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:33.006 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185556+0000", 2024-09-14T09:08:33.006 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.761237235999999, 2024-09-14T09:08:33.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023970933999999999, 2024-09-14T09:08:33.006 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:33.006 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:33.006 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:33.006 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:33.006 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:33.006 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:33.006 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2072 2024-09-14T09:08:33.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.006 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:33.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:33.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185556+0000", 2024-09-14T09:08:33.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:33.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185556+0000", 2024-09-14T09:08:33.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:33.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185556+0000", 2024-09-14T09:08:33.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.17e-07 2024-09-14T09:08:33.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:33.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185557+0000", 2024-09-14T09:08:33.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2860000000000001e-06 2024-09-14T09:08:33.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:33.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185560+0000", 2024-09-14T09:08:33.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0130000000000002e-06 2024-09-14T09:08:33.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:33.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185563+0000", 2024-09-14T09:08:33.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:08:33.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:33.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.203700+0000", 2024-09-14T09:08:33.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018137646 2024-09-14T09:08:33.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:33.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.203782+0000", 2024-09-14T09:08:33.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2082000000000005e-05 2024-09-14T09:08:33.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:33.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204106+0000", 2024-09-14T09:08:33.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000323345 2024-09-14T09:08:33.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:33.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209284+0000", 2024-09-14T09:08:33.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051778739999999998 2024-09-14T09:08:33.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:33.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209477+0000", 2024-09-14T09:08:33.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019348400000000001 2024-09-14T09:08:33.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:33.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209505+0000", 2024-09-14T09:08:33.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7358000000000001e-05 2024-09-14T09:08:33.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:33.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209527+0000", 2024-09-14T09:08:33.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2082999999999998e-05 2024-09-14T09:08:33.012 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.012 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:33.012 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.012 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2073 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:33.012 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185566+0000", 2024-09-14T09:08:33.012 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.761226496000001, 2024-09-14T09:08:33.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024050449000000002, 2024-09-14T09:08:33.012 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:33.012 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:33.013 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:33.013 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:33.013 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:33.013 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:33.013 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2073 2024-09-14T09:08:33.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.013 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:33.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:33.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185566+0000", 2024-09-14T09:08:33.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:33.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185566+0000", 2024-09-14T09:08:33.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:33.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185567+0000", 2024-09-14T09:08:33.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2024-09-14T09:08:33.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:33.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185568+0000", 2024-09-14T09:08:33.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3e-06 2024-09-14T09:08:33.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:33.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185571+0000", 2024-09-14T09:08:33.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0460000000000001e-06 2024-09-14T09:08:33.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:33.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185574+0000", 2024-09-14T09:08:33.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5399999999999998e-06 2024-09-14T09:08:33.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:33.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205068+0000", 2024-09-14T09:08:33.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019494002999999999 2024-09-14T09:08:33.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:33.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205135+0000", 2024-09-14T09:08:33.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7056000000000003e-05 2024-09-14T09:08:33.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:33.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205421+0000", 2024-09-14T09:08:33.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00028621899999999999 2024-09-14T09:08:33.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:33.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209290+0000", 2024-09-14T09:08:33.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038688059999999998 2024-09-14T09:08:33.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:33.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209553+0000", 2024-09-14T09:08:33.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00026326600000000001 2024-09-14T09:08:33.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:33.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209587+0000", 2024-09-14T09:08:33.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4359000000000001e-05 2024-09-14T09:08:33.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:33.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209617+0000", 2024-09-14T09:08:33.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9643000000000001e-05 2024-09-14T09:08:33.019 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.019 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:33.019 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.019 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2074 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:33.020 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185577+0000", 2024-09-14T09:08:33.020 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.761216366999999, 2024-09-14T09:08:33.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026839190999999998, 2024-09-14T09:08:33.020 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:33.020 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:33.020 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:33.020 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:33.020 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:33.020 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:33.020 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2074 2024-09-14T09:08:33.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.020 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:33.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:33.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185577+0000", 2024-09-14T09:08:33.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:33.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185577+0000", 2024-09-14T09:08:33.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:33.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185577+0000", 2024-09-14T09:08:33.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0800000000000001e-07 2024-09-14T09:08:33.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:33.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185578+0000", 2024-09-14T09:08:33.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3790000000000001e-06 2024-09-14T09:08:33.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:33.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185581+0000", 2024-09-14T09:08:33.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9639999999999999e-06 2024-09-14T09:08:33.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:33.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185584+0000", 2024-09-14T09:08:33.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.543e-06 2024-09-14T09:08:33.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:33.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205773+0000", 2024-09-14T09:08:33.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020189592999999999 2024-09-14T09:08:33.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:33.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205852+0000", 2024-09-14T09:08:33.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8825999999999994e-05 2024-09-14T09:08:33.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:33.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206078+0000", 2024-09-14T09:08:33.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022563999999999999 2024-09-14T09:08:33.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:33.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212216+0000", 2024-09-14T09:08:33.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061383940000000001 2024-09-14T09:08:33.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:33.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212346+0000", 2024-09-14T09:08:33.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000130195 2024-09-14T09:08:33.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:33.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212382+0000", 2024-09-14T09:08:33.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6009e-05 2024-09-14T09:08:33.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:33.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212416+0000", 2024-09-14T09:08:33.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3439999999999998e-05 2024-09-14T09:08:33.026 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.026 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:33.026 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.027 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2075 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:33.027 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185587+0000", 2024-09-14T09:08:33.027 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.761206218, 2024-09-14T09:08:33.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026913308, 2024-09-14T09:08:33.027 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:33.027 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:33.027 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:33.027 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:33.027 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:33.027 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:33.027 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2075 2024-09-14T09:08:33.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.028 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:33.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:33.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185587+0000", 2024-09-14T09:08:33.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:33.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185587+0000", 2024-09-14T09:08:33.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:33.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185587+0000", 2024-09-14T09:08:33.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1e-07 2024-09-14T09:08:33.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:33.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185588+0000", 2024-09-14T09:08:33.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.308e-06 2024-09-14T09:08:33.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:33.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185592+0000", 2024-09-14T09:08:33.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5999999999999998e-06 2024-09-14T09:08:33.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:33.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185594+0000", 2024-09-14T09:08:33.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5799999999999999e-06 2024-09-14T09:08:33.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:33.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206511+0000", 2024-09-14T09:08:33.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020916338999999999 2024-09-14T09:08:33.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:33.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206591+0000", 2024-09-14T09:08:33.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0495999999999996e-05 2024-09-14T09:08:33.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:33.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206963+0000", 2024-09-14T09:08:33.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00037151300000000002 2024-09-14T09:08:33.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:33.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212222+0000", 2024-09-14T09:08:33.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052591469999999996 2024-09-14T09:08:33.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:33.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212449+0000", 2024-09-14T09:08:33.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022715699999999999 2024-09-14T09:08:33.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:33.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212478+0000", 2024-09-14T09:08:33.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8818000000000001e-05 2024-09-14T09:08:33.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:33.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212500+0000", 2024-09-14T09:08:33.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2140000000000001e-05 2024-09-14T09:08:33.033 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.034 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:33.034 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.034 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:3094 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:33.034 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.520938+0000", 2024-09-14T09:08:33.034 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.425855215, 2024-09-14T09:08:33.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019285107999999999, 2024-09-14T09:08:33.034 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:33.034 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:33.034 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:33.034 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:33.035 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:33.035 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:33.035 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3094 2024-09-14T09:08:33.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.035 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:33.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:33.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520938+0000", 2024-09-14T09:08:33.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:33.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520938+0000", 2024-09-14T09:08:33.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:33.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520938+0000", 2024-09-14T09:08:33.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7099999999999998e-07 2024-09-14T09:08:33.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:33.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520939+0000", 2024-09-14T09:08:33.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.468e-06 2024-09-14T09:08:33.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:33.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520943+0000", 2024-09-14T09:08:33.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2459999999999999e-06 2024-09-14T09:08:33.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:33.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520945+0000", 2024-09-14T09:08:33.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7800000000000001e-06 2024-09-14T09:08:33.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:33.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.533959+0000", 2024-09-14T09:08:33.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013013927999999999 2024-09-14T09:08:33.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:33.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.534043+0000", 2024-09-14T09:08:33.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3628999999999995e-05 2024-09-14T09:08:33.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:33.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.534423+0000", 2024-09-14T09:08:33.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00037996699999999999 2024-09-14T09:08:33.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:33.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.537297+0000", 2024-09-14T09:08:33.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028744650000000001 2024-09-14T09:08:33.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:33.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.540132+0000", 2024-09-14T09:08:33.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002834072 2024-09-14T09:08:33.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:33.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.540184+0000", 2024-09-14T09:08:33.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2457000000000003e-05 2024-09-14T09:08:33.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:33.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.540223+0000", 2024-09-14T09:08:33.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8825000000000002e-05 2024-09-14T09:08:33.039 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.039 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:33.039 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.040 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:3095 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:33.040 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.520949+0000", 2024-09-14T09:08:33.040 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.425844254999999, 2024-09-14T09:08:33.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019423973000000001, 2024-09-14T09:08:33.040 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:33.040 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:33.040 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:33.040 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:33.040 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:33.041 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:33.041 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3095 2024-09-14T09:08:33.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.041 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:33.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:33.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520949+0000", 2024-09-14T09:08:33.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:33.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520949+0000", 2024-09-14T09:08:33.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:33.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520949+0000", 2024-09-14T09:08:33.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6e-07 2024-09-14T09:08:33.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:33.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520950+0000", 2024-09-14T09:08:33.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5600000000000001e-06 2024-09-14T09:08:33.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:33.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520953+0000", 2024-09-14T09:08:33.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9660000000000001e-06 2024-09-14T09:08:33.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:33.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520956+0000", 2024-09-14T09:08:33.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6019999999999998e-06 2024-09-14T09:08:33.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:33.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.535013+0000", 2024-09-14T09:08:33.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014056663 2024-09-14T09:08:33.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:33.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.535091+0000", 2024-09-14T09:08:33.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8745000000000006e-05 2024-09-14T09:08:33.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:33.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.535323+0000", 2024-09-14T09:08:33.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000231685 2024-09-14T09:08:33.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:33.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.540275+0000", 2024-09-14T09:08:33.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049515130000000003 2024-09-14T09:08:33.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:33.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.540287+0000", 2024-09-14T09:08:33.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2649999999999999e-05 2024-09-14T09:08:33.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:33.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.540334+0000", 2024-09-14T09:08:33.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7083999999999998e-05 2024-09-14T09:08:33.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:33.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.540373+0000", 2024-09-14T09:08:33.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8244999999999997e-05 2024-09-14T09:08:33.046 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.046 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:33.046 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.047 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:3096 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:33.047 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.520959+0000", 2024-09-14T09:08:33.047 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.425833806, 2024-09-14T09:08:33.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021266274000000002, 2024-09-14T09:08:33.047 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:33.047 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:33.047 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:33.047 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:33.047 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:33.047 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:33.047 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3096 2024-09-14T09:08:33.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.047 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:33.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:33.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520959+0000", 2024-09-14T09:08:33.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:33.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520959+0000", 2024-09-14T09:08:33.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:33.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520959+0000", 2024-09-14T09:08:33.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.17e-07 2024-09-14T09:08:33.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:33.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520961+0000", 2024-09-14T09:08:33.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3200000000000001e-06 2024-09-14T09:08:33.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:33.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520964+0000", 2024-09-14T09:08:33.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8700000000000001e-06 2024-09-14T09:08:33.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:33.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520966+0000", 2024-09-14T09:08:33.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4880000000000001e-06 2024-09-14T09:08:33.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:33.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.535679+0000", 2024-09-14T09:08:33.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014713118000000001 2024-09-14T09:08:33.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:33.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.535765+0000", 2024-09-14T09:08:33.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5464999999999996e-05 2024-09-14T09:08:33.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:33.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.536136+0000", 2024-09-14T09:08:33.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00037173399999999998 2024-09-14T09:08:33.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:33.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.542094+0000", 2024-09-14T09:08:33.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059577639999999999 2024-09-14T09:08:33.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:33.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.542147+0000", 2024-09-14T09:08:33.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2444999999999997e-05 2024-09-14T09:08:33.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:33.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.542188+0000", 2024-09-14T09:08:33.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1465999999999999e-05 2024-09-14T09:08:33.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:33.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.542225+0000", 2024-09-14T09:08:33.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7387e-05 2024-09-14T09:08:33.052 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.052 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:33.052 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.053 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:3097 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:33.053 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.520973+0000", 2024-09-14T09:08:33.053 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.425820197, 2024-09-14T09:08:33.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022189861000000002, 2024-09-14T09:08:33.053 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:33.053 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:33.053 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:33.053 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:33.053 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:33.053 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:33.053 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3097 2024-09-14T09:08:33.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.054 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:33.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:33.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520973+0000", 2024-09-14T09:08:33.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:33.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520973+0000", 2024-09-14T09:08:33.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:33.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520973+0000", 2024-09-14T09:08:33.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.53e-07 2024-09-14T09:08:33.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:33.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520975+0000", 2024-09-14T09:08:33.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5600000000000001e-06 2024-09-14T09:08:33.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:33.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520978+0000", 2024-09-14T09:08:33.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1990000000000002e-06 2024-09-14T09:08:33.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:33.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520980+0000", 2024-09-14T09:08:33.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5579999999999999e-06 2024-09-14T09:08:33.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:33.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.536537+0000", 2024-09-14T09:08:33.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015556285 2024-09-14T09:08:33.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:33.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.536612+0000", 2024-09-14T09:08:33.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5704000000000006e-05 2024-09-14T09:08:33.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:33.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.536946+0000", 2024-09-14T09:08:33.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033328299999999997 2024-09-14T09:08:33.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:33.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.542236+0000", 2024-09-14T09:08:33.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052906680000000001 2024-09-14T09:08:33.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:33.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.542395+0000", 2024-09-14T09:08:33.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015884499999999999 2024-09-14T09:08:33.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:33.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543126+0000", 2024-09-14T09:08:33.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000731125 2024-09-14T09:08:33.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:33.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543163+0000", 2024-09-14T09:08:33.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6381000000000003e-05 2024-09-14T09:08:33.058 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.058 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:33.059 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.059 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:3098 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:33.059 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.520984+0000", 2024-09-14T09:08:33.059 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.42580935, 2024-09-14T09:08:33.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022279624000000001, 2024-09-14T09:08:33.060 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:33.060 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:33.060 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:33.060 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:33.060 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:33.060 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:33.060 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3098 2024-09-14T09:08:33.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.060 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:33.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:33.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520984+0000", 2024-09-14T09:08:33.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:33.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520984+0000", 2024-09-14T09:08:33.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:33.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520984+0000", 2024-09-14T09:08:33.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2100000000000001e-07 2024-09-14T09:08:33.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:33.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520985+0000", 2024-09-14T09:08:33.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.305e-06 2024-09-14T09:08:33.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:33.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520988+0000", 2024-09-14T09:08:33.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9459999999999998e-06 2024-09-14T09:08:33.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:33.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520991+0000", 2024-09-14T09:08:33.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5220000000000002e-06 2024-09-14T09:08:33.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:33.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.537336+0000", 2024-09-14T09:08:33.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016345563 2024-09-14T09:08:33.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:33.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.537416+0000", 2024-09-14T09:08:33.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0091000000000003e-05 2024-09-14T09:08:33.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:33.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.537632+0000", 2024-09-14T09:08:33.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00021544899999999999 2024-09-14T09:08:33.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:33.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543210+0000", 2024-09-14T09:08:33.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055779189999999998 2024-09-14T09:08:33.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:33.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543217+0000", 2024-09-14T09:08:33.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5599999999999996e-06 2024-09-14T09:08:33.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:33.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543241+0000", 2024-09-14T09:08:33.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4365000000000001e-05 2024-09-14T09:08:33.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:33.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543263+0000", 2024-09-14T09:08:33.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1682999999999999e-05 2024-09-14T09:08:33.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.065 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:33.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.066 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:3099 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:33.066 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.520994+0000", 2024-09-14T09:08:33.066 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.425799378000001, 2024-09-14T09:08:33.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022403849, 2024-09-14T09:08:33.066 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:33.066 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:33.066 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:33.066 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:33.066 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:33.067 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:33.067 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3099 2024-09-14T09:08:33.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.067 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:33.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:33.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520994+0000", 2024-09-14T09:08:33.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:33.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520994+0000", 2024-09-14T09:08:33.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:33.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520994+0000", 2024-09-14T09:08:33.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.23e-07 2024-09-14T09:08:33.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:33.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520995+0000", 2024-09-14T09:08:33.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.285e-06 2024-09-14T09:08:33.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:33.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520998+0000", 2024-09-14T09:08:33.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9129999999999999e-06 2024-09-14T09:08:33.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:33.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.521000+0000", 2024-09-14T09:08:33.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4569999999999999e-06 2024-09-14T09:08:33.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:33.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.537995+0000", 2024-09-14T09:08:33.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016994619999999998 2024-09-14T09:08:33.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:33.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.538039+0000", 2024-09-14T09:08:33.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3557999999999999e-05 2024-09-14T09:08:33.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:33.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.538249+0000", 2024-09-14T09:08:33.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000210237 2024-09-14T09:08:33.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:33.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543270+0000", 2024-09-14T09:08:33.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050210769999999997 2024-09-14T09:08:33.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:33.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543314+0000", 2024-09-14T09:08:33.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3829000000000003e-05 2024-09-14T09:08:33.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:33.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543364+0000", 2024-09-14T09:08:33.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0460000000000001e-05 2024-09-14T09:08:33.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:33.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543397+0000", 2024-09-14T09:08:33.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3189999999999999e-05 2024-09-14T09:08:33.072 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.072 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:33.072 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.073 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:3100 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:33.073 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.521003+0000", 2024-09-14T09:08:33.073 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.425789581, 2024-09-14T09:08:33.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023619213, 2024-09-14T09:08:33.073 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:33.073 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:33.073 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:33.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:33.074 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:33.074 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:33.074 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3100 2024-09-14T09:08:33.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.074 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:33.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:33.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.521003+0000", 2024-09-14T09:08:33.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:33.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.521003+0000", 2024-09-14T09:08:33.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:33.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:33.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.521004+0000", 2024-09-14T09:08:33.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2100000000000001e-07 2024-09-14T09:08:33.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:33.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.521005+0000", 2024-09-14T09:08:33.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5910000000000001e-06 2024-09-14T09:08:33.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:33.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.521008+0000", 2024-09-14T09:08:33.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.818e-06 2024-09-14T09:08:33.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:33.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.521012+0000", 2024-09-14T09:08:33.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6030000000000001e-06 2024-09-14T09:08:33.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:33.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.538577+0000", 2024-09-14T09:08:33.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017565386999999998 2024-09-14T09:08:33.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:33.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.538619+0000", 2024-09-14T09:08:33.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2379999999999997e-05 2024-09-14T09:08:33.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:33.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.538918+0000", 2024-09-14T09:08:33.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029888000000000001 2024-09-14T09:08:33.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:33.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543448+0000", 2024-09-14T09:08:33.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045295969999999998 2024-09-14T09:08:33.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:33.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.544536+0000", 2024-09-14T09:08:33.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001088554 2024-09-14T09:08:33.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:33.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.544585+0000", 2024-09-14T09:08:33.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8359999999999998e-05 2024-09-14T09:08:33.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:33.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:33.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:33.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.544623+0000", 2024-09-14T09:08:33.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7821999999999998e-05 2024-09-14T09:08:33.081 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.082 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:33.082 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.082 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:33.082 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:33.082 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:33.084 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:08:33.085 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:33.086+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:33.094 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:08:33.185 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:33.186+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:33.223 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:33.223 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:33.229 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:33.229 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:33.229 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:33.229 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:33.237 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:08:33.240 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:33.240 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:33.256 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:08:33.256 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:08:33.272 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:33.272 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:33.285 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:33.287+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:33.288 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:33.288 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:33.304 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:33.305 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:33.342 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:33.342 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:33.350 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:08:33.386 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:33.388+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:33.454 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:33.454 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:33.462 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:08:33.487 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:33.489+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:33.566 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:33.566 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:33.575 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:08:33.588 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:33.590+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:33.677 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:33.677 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:33.685 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:08:33.729 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:33.731+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:33.789 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:33.791+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:33.792 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:33.792 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:33.800 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T09:08:33.803 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:08:33.891 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:33.893+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:33.976 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:33.976 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:33.988 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:08:33.991 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:33.993+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:34.092 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:34.094+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:34.109 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:34.110 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:34.118 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:08:34.202 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:34.204+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:34.264 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:34.264 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:34.273 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:08:34.314 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:34.316+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:34.385 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #19, image image_client.0-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent20 2024-09-14T09:08:34.394 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:34.396+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:34.426 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:34.426 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:34.434 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:08:34.479 INFO:teuthology.orchestra.run.smithi148.stdout:3344 write 0xecca000 thru 0xecd705e (0xd05f bytes) 2024-09-14T09:08:34.480 INFO:teuthology.orchestra.run.smithi148.stdout:3345 read 0xa6c7200 thru 0xa6ce3f3 (0x71f4 bytes) 2024-09-14T09:08:34.480 INFO:teuthology.orchestra.run.smithi148.stdout:3348 write 0x6879000 thru 0x6886578 (0xd579 bytes) 2024-09-14T09:08:34.481 INFO:teuthology.orchestra.run.smithi148.stdout:3349 read 0x9dbc000 thru 0x9dbd159 (0x115a bytes) 2024-09-14T09:08:34.481 INFO:teuthology.orchestra.run.smithi148.stdout:3350 punch from 0x3d4fe00 to 0x3d57200, (0x7400 bytes) 2024-09-14T09:08:34.482 INFO:teuthology.orchestra.run.smithi148.stdout:3351 read 0x91ee000 thru 0x91fba1b (0xda1c bytes) 2024-09-14T09:08:34.486 INFO:teuthology.orchestra.run.smithi148.stdout:3352 write 0xb9db600 thru 0xb9dda33 (0x2434 bytes) 2024-09-14T09:08:34.486 INFO:teuthology.orchestra.run.smithi148.stdout:3354 read 0x96ebc00 thru 0x96f5c8a (0xa08b bytes) 2024-09-14T09:08:34.488 INFO:teuthology.orchestra.run.smithi148.stdout:3355 write 0xdd79000 thru 0xdd88971 (0xf972 bytes) 2024-09-14T09:08:34.488 INFO:teuthology.orchestra.run.smithi148.stdout:3356 punch from 0xa5d200 to 0xa65c00, (0x8a00 bytes) 2024-09-14T09:08:34.489 INFO:teuthology.orchestra.run.smithi148.stdout:3358 read 0xd6da400 thru 0xd6e0301 (0x5f02 bytes) 2024-09-14T09:08:34.489 INFO:teuthology.orchestra.run.smithi148.stdout:3361 read 0xcb24800 thru 0xcb2b1a1 (0x69a2 bytes) 2024-09-14T09:08:34.489 INFO:teuthology.orchestra.run.smithi148.stdout:3362 punch from 0x9209e00 to 0x9219a00, (0xfc00 bytes) 2024-09-14T09:08:34.490 INFO:teuthology.orchestra.run.smithi148.stdout:3364 write 0x8d68800 thru 0x8d7867b (0xfe7c bytes) 2024-09-14T09:08:34.495 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:34.497+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:34.496 INFO:teuthology.orchestra.run.smithi148.stdout:3365 write 0x30d6200 thru 0x30dea73 (0x8874 bytes) 2024-09-14T09:08:34.501 INFO:teuthology.orchestra.run.smithi148.stdout:3366 write 0xbebee00 thru 0xbebf348 (0x549 bytes) 2024-09-14T09:08:34.501 INFO:teuthology.orchestra.run.smithi148.stdout:3367 write 0xcb92a00 thru 0xcba1668 (0xec69 bytes) 2024-09-14T09:08:34.501 INFO:teuthology.orchestra.run.smithi148.stdout:3368 punch from 0xe514000 to 0xe520600, (0xc600 bytes) 2024-09-14T09:08:34.502 INFO:teuthology.orchestra.run.smithi148.stdout:3369 write 0x70cc800 thru 0x70d9bac (0xd3ad bytes) 2024-09-14T09:08:34.510 INFO:teuthology.orchestra.run.smithi148.stdout:3373 trunc from 0xecd7200 to 0xdab8000 2024-09-14T09:08:34.584 INFO:teuthology.orchestra.run.smithi148.stdout:3376 write 0x3cad200 thru 0x3cb58d0 (0x86d1 bytes) 2024-09-14T09:08:34.586 INFO:teuthology.orchestra.run.smithi148.stdout:3378 read 0xa3d8600 thru 0xa3da4d9 (0x1eda bytes) 2024-09-14T09:08:34.591 INFO:teuthology.orchestra.run.smithi148.stdout:3379 trunc from 0xdab8000 to 0x9518000 2024-09-14T09:08:34.596 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:34.598+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:34.614 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:34.614 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:34.623 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:08:34.662 INFO:teuthology.orchestra.run.smithi148.stdout:3381 read 0x74b8000 thru 0x74c1d41 (0x9d42 bytes) 2024-09-14T09:08:34.667 INFO:teuthology.orchestra.run.smithi148.stdout:3384 read 0x8b8600 thru 0x8ba82b (0x222c bytes) 2024-09-14T09:08:34.668 INFO:teuthology.orchestra.run.smithi148.stdout:3385 punch from 0xac0e00 to 0xac2c00, (0x1e00 bytes) 2024-09-14T09:08:34.668 INFO:teuthology.orchestra.run.smithi148.stdout:3387 punch from 0x2c8b600 to 0x2c93400, (0x7e00 bytes) 2024-09-14T09:08:34.669 INFO:teuthology.orchestra.run.smithi148.stdout:3389 punch from 0x169da00 to 0x169e200, (0x800 bytes) 2024-09-14T09:08:34.670 INFO:teuthology.orchestra.run.smithi148.stdout:3390 trunc from 0x9518000 to 0xaa73200 2024-09-14T09:08:34.697 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:34.698+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:34.732 INFO:teuthology.orchestra.run.smithi148.stdout:3391 read 0xaccc00 thru 0xad9979 (0xcd7a bytes) 2024-09-14T09:08:34.735 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:34.735 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:34.738 INFO:teuthology.orchestra.run.smithi148.stdout:3395 read 0x8fc2a00 thru 0x8fc352a (0xb2b bytes) 2024-09-14T09:08:34.744 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:08:34.745 INFO:teuthology.orchestra.run.smithi148.stdout:3398 trunc from 0xaa73200 to 0x6354c00 2024-09-14T09:08:34.761 INFO:teuthology.orchestra.run.smithi148.stdout:3399 write 0x609da00 thru 0x60a349a (0x5a9b bytes) 2024-09-14T09:08:34.767 INFO:teuthology.orchestra.run.smithi148.stdout:3407 punch from 0x3cc4600 to 0x3ccc600, (0x8000 bytes) 2024-09-14T09:08:34.769 INFO:teuthology.orchestra.run.smithi148.stdout:3410 read 0x15df400 thru 0x15edd34 (0xe935 bytes) 2024-09-14T09:08:34.770 INFO:teuthology.orchestra.run.smithi148.stdout:3411 write 0x3b30a00 thru 0x3b3a9a5 (0x9fa6 bytes) 2024-09-14T09:08:34.770 INFO:teuthology.orchestra.run.smithi148.stdout:3415 read 0x17f2200 thru 0x17f52a5 (0x30a6 bytes) 2024-09-14T09:08:34.771 INFO:teuthology.orchestra.run.smithi148.stdout:3418 read 0x3082400 thru 0x3091dae (0xf9af bytes) 2024-09-14T09:08:34.771 INFO:teuthology.orchestra.run.smithi148.stdout:3419 write 0x6276600 thru 0x6280d51 (0xa752 bytes) 2024-09-14T09:08:34.771 INFO:teuthology.orchestra.run.smithi148.stdout:3421 punch from 0x6061200 to 0x6062c00, (0x1a00 bytes) 2024-09-14T09:08:34.782 INFO:teuthology.orchestra.run.smithi148.stdout:3426 trunc from 0x6354c00 to 0xe9eee00 2024-09-14T09:08:34.791 INFO:teuthology.orchestra.run.smithi148.stdout:3427 read 0x3b2c800 thru 0x3b2efb9 (0x27ba bytes) 2024-09-14T09:08:34.792 INFO:teuthology.orchestra.run.smithi148.stdout:3432 read 0x7a0c000 thru 0x7a0eeb0 (0x2eb1 bytes) 2024-09-14T09:08:34.793 INFO:teuthology.orchestra.run.smithi148.stdout:3435 read 0xd3e1e00 thru 0xd3eeb0f (0xcd10 bytes) 2024-09-14T09:08:34.793 INFO:teuthology.orchestra.run.smithi148.stdout:3436 read 0x85b1200 thru 0x85beb2a (0xd92b bytes) 2024-09-14T09:08:34.793 INFO:teuthology.orchestra.run.smithi148.stdout:3438 read 0x722a00 thru 0x72a2db (0x78dc bytes) 2024-09-14T09:08:34.794 INFO:teuthology.orchestra.run.smithi148.stdout:3440 write 0xc63d600 thru 0xc642b70 (0x5571 bytes) 2024-09-14T09:08:34.797 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:34.799+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:34.800 INFO:teuthology.orchestra.run.smithi148.stdout:3442 trunc from 0xe9eee00 to 0x9ced400 2024-09-14T09:08:34.816 INFO:teuthology.orchestra.run.smithi148.stdout:3445 write 0x2184400 thru 0x218e868 (0xa469 bytes) 2024-09-14T09:08:34.828 INFO:teuthology.orchestra.run.smithi148.stdout:3446 trunc from 0x9ced400 to 0xb0f400 2024-09-14T09:08:34.860 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:34.860 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:34.870 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:08:34.905 INFO:teuthology.orchestra.run.smithi148.stdout:3447 write 0xd9d5200 thru 0xd9e2906 (0xd707 bytes) 2024-09-14T09:08:34.910 INFO:teuthology.orchestra.run.smithi148.stdout:3448 punch from 0x2e37a00 to 0x2e44000, (0xc600 bytes) 2024-09-14T09:08:34.911 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:34.913+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:34.913 INFO:teuthology.orchestra.run.smithi148.stdout:3449 read 0x9eb2400 thru 0x9eb2d98 (0x999 bytes) 2024-09-14T09:08:34.913 INFO:teuthology.orchestra.run.smithi148.stdout:3450 write 0x8a5a000 thru 0x8a64ab5 (0xaab6 bytes) 2024-09-14T09:08:34.913 INFO:teuthology.orchestra.run.smithi148.stdout:3452 read 0x22d0e00 thru 0x22d87fa (0x79fb bytes) 2024-09-14T09:08:34.918 INFO:teuthology.orchestra.run.smithi148.stdout:3454 trunc from 0xd9e2a00 to 0x9af9a00 2024-09-14T09:08:34.931 INFO:teuthology.orchestra.run.smithi148.stdout:3455 punch from 0x786ec00 to 0x7874800, (0x5c00 bytes) 2024-09-14T09:08:34.940 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T09:08:34.940 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:08:34.940 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-14T09:08:34.940 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T09:08:34.941 INFO:teuthology.orchestra.run.smithi148.stdout:3458 punch from 0x5500800 to 0x5508e00, (0x8600 bytes) 2024-09-14T09:08:34.941 INFO:teuthology.orchestra.run.smithi148.stdout:3463 read 0x782b000 thru 0x782d3c1 (0x23c2 bytes) 2024-09-14T09:08:34.941 INFO:teuthology.orchestra.run.smithi148.stdout:3464 write 0x1a0d800 thru 0x1a0dd84 (0x585 bytes) 2024-09-14T09:08:34.941 INFO:teuthology.orchestra.run.smithi148.stdout:3467 read 0xe0a200 thru 0xe0d274 (0x3075 bytes) 2024-09-14T09:08:34.949 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is set 2024-09-14T09:08:34.964 INFO:teuthology.orchestra.run.smithi148.stdout:3468 write 0xb2e5400 thru 0xb2f1144 (0xbd45 bytes) 2024-09-14T09:08:34.972 INFO:teuthology.orchestra.run.smithi148.stdout:3470 trunc from 0xb2f1200 to 0x989a200 2024-09-14T09:08:34.992 INFO:teuthology.orchestra.run.smithi148.stdout:3472 write 0x9223600 thru 0x92241ec (0xbed bytes) 2024-09-14T09:08:34.997 INFO:teuthology.orchestra.run.smithi148.stdout:3476 punch from 0x2a47600 to 0x2a55800, (0xe200 bytes) 2024-09-14T09:08:34.999 INFO:teuthology.orchestra.run.smithi148.stdout:3478 punch from 0x2d37600 to 0x2d3c400, (0x4e00 bytes) 2024-09-14T09:08:34.999 INFO:teuthology.orchestra.run.smithi148.stdout:3479 read 0x5a3000 thru 0x5a338f (0x390 bytes) 2024-09-14T09:08:35.003 INFO:teuthology.orchestra.run.smithi148.stdout:3480 trunc from 0x989a200 to 0x6baa000 2024-09-14T09:08:35.006 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:35.008+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:35.024 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:35.025 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:35.034 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:08:35.034 INFO:teuthology.orchestra.run.smithi148.stdout:3481 write 0xe684400 thru 0xe692ac4 (0xe6c5 bytes) 2024-09-14T09:08:35.036 INFO:teuthology.orchestra.run.smithi148.stdout:3482 punch from 0xc959c00 to 0xc963600, (0x9a00 bytes) 2024-09-14T09:08:35.038 INFO:teuthology.orchestra.run.smithi148.stdout:3485 read 0x4d0d200 thru 0x4d1b4b8 (0xe2b9 bytes) 2024-09-14T09:08:35.052 INFO:teuthology.orchestra.run.smithi148.stdout:3488 write 0xecd5000 thru 0xecd62dd (0x12de bytes) 2024-09-14T09:08:35.053 INFO:teuthology.orchestra.run.smithi148.stdout:3490 punch from 0xdbd600 to 0xdc1600, (0x4000 bytes) 2024-09-14T09:08:35.055 INFO:teuthology.orchestra.run.smithi148.stdout:3493 write 0x44fba00 thru 0x4500c1f (0x5220 bytes) 2024-09-14T09:08:35.055 INFO:teuthology.orchestra.run.smithi148.stdout:3494 clone 22 order 19 su 4096 sc 15 2024-09-14T09:08:35.100 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:35.102+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:35.140 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:35.141 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:35.149 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:08:35.200 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:35.202+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:35.236 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:08:35.237 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:35.237 INFO:teuthology.orchestra.run.smithi116.stdout: "epoch": 60, 2024-09-14T09:08:35.237 INFO:teuthology.orchestra.run.smithi116.stdout: "fsid": "c991ac1c-978d-48b3-a540-4d3d4755e125", 2024-09-14T09:08:35.237 INFO:teuthology.orchestra.run.smithi116.stdout: "created": "2024-09-14T09:07:16.982473+0000", 2024-09-14T09:08:35.237 INFO:teuthology.orchestra.run.smithi116.stdout: "modified": "2024-09-14T09:08:34.950653+0000", 2024-09-14T09:08:35.237 INFO:teuthology.orchestra.run.smithi116.stdout: "last_up_change": "2024-09-14T09:07:28.201361+0000", 2024-09-14T09:08:35.237 INFO:teuthology.orchestra.run.smithi116.stdout: "last_in_change": "2024-09-14T09:07:18.560664+0000", 2024-09-14T09:08:35.237 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T09:08:35.237 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_num": 5806080, 2024-09-14T09:08:35.237 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_set": [ 2024-09-14T09:08:35.237 INFO:teuthology.orchestra.run.smithi116.stdout: "nodeep-scrub", 2024-09-14T09:08:35.237 INFO:teuthology.orchestra.run.smithi116.stdout: "noscrub", 2024-09-14T09:08:35.237 INFO:teuthology.orchestra.run.smithi116.stdout: "pglog_hardlimit", 2024-09-14T09:08:35.238 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snapdirs", 2024-09-14T09:08:35.238 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_deletes", 2024-09-14T09:08:35.238 INFO:teuthology.orchestra.run.smithi116.stdout: "sortbitwise" 2024-09-14T09:08:35.238 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:08:35.238 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_version": 5, 2024-09-14T09:08:35.238 INFO:teuthology.orchestra.run.smithi116.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T09:08:35.238 INFO:teuthology.orchestra.run.smithi116.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T09:08:35.238 INFO:teuthology.orchestra.run.smithi116.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T09:08:35.238 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_snapshot": "", 2024-09-14T09:08:35.238 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_max": 3, 2024-09-14T09:08:35.238 INFO:teuthology.orchestra.run.smithi116.stdout: "max_osd": 6, 2024-09-14T09:08:35.238 INFO:teuthology.orchestra.run.smithi116.stdout: "require_min_compat_client": "luminous", 2024-09-14T09:08:35.239 INFO:teuthology.orchestra.run.smithi116.stdout: "min_compat_client": "jewel", 2024-09-14T09:08:35.239 INFO:teuthology.orchestra.run.smithi116.stdout: "require_osd_release": "squid", 2024-09-14T09:08:35.239 INFO:teuthology.orchestra.run.smithi116.stdout: "allow_crimson": false, 2024-09-14T09:08:35.239 INFO:teuthology.orchestra.run.smithi116.stdout: "pools": [ 2024-09-14T09:08:35.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.239 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 1, 2024-09-14T09:08:35.239 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": ".mgr", 2024-09-14T09:08:35.239 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:29.194849+0000", 2024-09-14T09:08:35.239 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 1, 2024-09-14T09:08:35.239 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool", 2024-09-14T09:08:35.239 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:08:35.239 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:08:35.239 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:08:35.240 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:08:35.240 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:08:35.240 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:08:35.240 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:08:35.240 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:08:35.240 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:08:35.240 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:08:35.240 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:08:35.240 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 1, 2024-09-14T09:08:35.240 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 1, 2024-09-14T09:08:35.240 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 1, 2024-09-14T09:08:35.240 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 1, 2024-09-14T09:08:35.240 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 1, 2024-09-14T09:08:35.241 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:08:35.241 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:08:35.241 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:08:35.241 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:08:35.241 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:08:35.241 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:08:35.241 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:08:35.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.241 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "16", 2024-09-14T09:08:35.241 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:08:35.241 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:08:35.241 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:08:35.241 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:08:35.241 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:08:35.241 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 0, 2024-09-14T09:08:35.242 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 0, 2024-09-14T09:08:35.242 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:08:35.242 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:08:35.242 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:08:35.242 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:08:35.242 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:08:35.242 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:08:35.242 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:08:35.242 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:08:35.242 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:08:35.242 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:08:35.242 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:08:35.242 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:08:35.242 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:08:35.243 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:08:35.243 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:08:35.243 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:08:35.243 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:08:35.243 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:08:35.243 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:08:35.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.243 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:08:35.243 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:08:35.243 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:08:35.243 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:08:35.243 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:08:35.243 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:08:35.244 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:08:35.244 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:08:35.244 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:08:35.244 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:08:35.244 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:08:35.244 INFO:teuthology.orchestra.run.smithi116.stdout: "options": { 2024-09-14T09:08:35.244 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_max": 32, 2024-09-14T09:08:35.244 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_min": 1 2024-09-14T09:08:35.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.244 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:08:35.244 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": {} 2024-09-14T09:08:35.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.244 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:08:35.244 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:08:35.245 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 6.059999942779541, 2024-09-14T09:08:35.245 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 6.059999942779541, 2024-09-14T09:08:35.245 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 0.33000001311302185, 2024-09-14T09:08:35.245 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 2, 2024-09-14T09:08:35.245 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 2, 2024-09-14T09:08:35.245 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:08:35.245 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:08:35.245 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:08:35.245 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.245 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 2, 2024-09-14T09:08:35.245 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": "rbd", 2024-09-14T09:08:35.245 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:33.684592+0000", 2024-09-14T09:08:35.245 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 8193, 2024-09-14T09:08:35.246 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T09:08:35.246 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:08:35.246 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:08:35.246 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:08:35.246 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:08:35.246 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:08:35.246 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:08:35.246 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:08:35.246 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:08:35.246 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:08:35.246 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:08:35.246 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:08:35.246 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 8, 2024-09-14T09:08:35.246 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 8, 2024-09-14T09:08:35.246 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 8, 2024-09-14T09:08:35.247 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 8, 2024-09-14T09:08:35.247 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 8, 2024-09-14T09:08:35.247 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:08:35.247 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:08:35.247 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:08:35.247 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:08:35.247 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:08:35.247 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:08:35.247 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:08:35.247 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.247 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "20", 2024-09-14T09:08:35.247 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:08:35.247 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:08:35.247 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:08:35.247 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:08:35.248 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:08:35.248 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 2, 2024-09-14T09:08:35.248 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 20, 2024-09-14T09:08:35.248 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:08:35.248 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:08:35.248 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:08:35.248 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:08:35.248 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:08:35.248 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:08:35.248 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:08:35.248 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:08:35.248 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:08:35.248 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:08:35.249 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:08:35.249 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:08:35.249 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:08:35.249 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:08:35.249 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:08:35.249 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:08:35.249 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:08:35.249 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:08:35.249 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:08:35.249 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.249 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:08:35.249 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:08:35.249 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:08:35.249 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:08:35.249 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:08:35.250 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:08:35.250 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:08:35.250 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:08:35.250 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:08:35.250 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:08:35.250 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:08:35.250 INFO:teuthology.orchestra.run.smithi116.stdout: "options": {}, 2024-09-14T09:08:35.250 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:08:35.250 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd": {} 2024-09-14T09:08:35.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.250 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:08:35.250 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:08:35.250 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 2.25, 2024-09-14T09:08:35.250 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 2.25, 2024-09-14T09:08:35.250 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 1, 2024-09-14T09:08:35.250 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 2.25, 2024-09-14T09:08:35.251 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 2.25, 2024-09-14T09:08:35.251 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:08:35.251 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:08:35.251 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:08:35.251 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.251 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 3, 2024-09-14T09:08:35.251 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": "pool_client.0", 2024-09-14T09:08:35.251 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:43.363542+0000", 2024-09-14T09:08:35.251 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 8193, 2024-09-14T09:08:35.251 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T09:08:35.251 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:08:35.251 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:08:35.251 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:08:35.252 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:08:35.252 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:08:35.252 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:08:35.252 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:08:35.252 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:08:35.252 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:08:35.252 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:08:35.252 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:08:35.252 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 32, 2024-09-14T09:08:35.252 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 32, 2024-09-14T09:08:35.252 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 32, 2024-09-14T09:08:35.252 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 32, 2024-09-14T09:08:35.252 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 32, 2024-09-14T09:08:35.252 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:08:35.253 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:08:35.253 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:08:35.253 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:08:35.253 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:08:35.253 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:08:35.253 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:08:35.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.253 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "52", 2024-09-14T09:08:35.253 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:08:35.253 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:08:35.253 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:08:35.253 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:08:35.254 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:08:35.254 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 23, 2024-09-14T09:08:35.254 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 52, 2024-09-14T09:08:35.254 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:08:35.254 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:08:35.254 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:08:35.254 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:08:35.254 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:08:35.254 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:08:35.254 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:08:35.254 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:08:35.254 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:08:35.254 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:08:35.254 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:08:35.255 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:08:35.255 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:08:35.255 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:08:35.255 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:08:35.255 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:08:35.255 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:08:35.255 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:08:35.255 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:08:35.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.255 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:08:35.255 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:08:35.255 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:08:35.255 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:08:35.255 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:08:35.255 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:08:35.256 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:08:35.256 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:08:35.256 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:08:35.256 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:08:35.256 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:08:35.256 INFO:teuthology.orchestra.run.smithi116.stdout: "options": {}, 2024-09-14T09:08:35.256 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:08:35.256 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd": {} 2024-09-14T09:08:35.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.256 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:08:35.256 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:08:35.256 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 1.8799999952316284, 2024-09-14T09:08:35.256 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 1.8799999952316284, 2024-09-14T09:08:35.257 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 1, 2024-09-14T09:08:35.257 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 1.8799999952316284, 2024-09-14T09:08:35.257 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 1.8799999952316284, 2024-09-14T09:08:35.257 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:08:35.257 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:08:35.257 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:08:35.257 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.257 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.257 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:08:35.257 INFO:teuthology.orchestra.run.smithi116.stdout: "osds": [ 2024-09-14T09:08:35.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.257 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 0, 2024-09-14T09:08:35.257 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "b3c13086-1183-454b-8e62-3aec9b69cdf5", 2024-09-14T09:08:35.258 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:08:35.258 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:08:35.258 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 0.3199462890625, 2024-09-14T09:08:35.258 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:08:35.258 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:08:35.258 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:08:35.258 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 11, 2024-09-14T09:08:35.258 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 57, 2024-09-14T09:08:35.258 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:08:35.258 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:08:35.258 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:08:35.258 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.258 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.258 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6816", 2024-09-14T09:08:35.259 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:08:35.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.259 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.259 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6817", 2024-09-14T09:08:35.259 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:08:35.259 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.259 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.259 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:08:35.259 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.259 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.260 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6818", 2024-09-14T09:08:35.260 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:08:35.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.260 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.260 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6819", 2024-09-14T09:08:35.260 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:08:35.260 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.260 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.260 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:08:35.260 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.260 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.261 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6822", 2024-09-14T09:08:35.261 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:08:35.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.261 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.261 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6823", 2024-09-14T09:08:35.261 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:08:35.261 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.261 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.261 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:08:35.261 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.262 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.262 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6820", 2024-09-14T09:08:35.262 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:08:35.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.262 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.262 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6821", 2024-09-14T09:08:35.262 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:08:35.262 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.262 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.262 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6817/1856142608", 2024-09-14T09:08:35.262 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6819/1856142608", 2024-09-14T09:08:35.263 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6823/1856142608", 2024-09-14T09:08:35.263 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6821/1856142608", 2024-09-14T09:08:35.263 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:08:35.263 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:08:35.263 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:08:35.263 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.263 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.263 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 1, 2024-09-14T09:08:35.263 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "8ee6a373-9d0d-4cd2-96f4-9673de96f546", 2024-09-14T09:08:35.263 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:08:35.263 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:08:35.263 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:08:35.264 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:08:35.264 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:08:35.264 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:08:35.264 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 13, 2024-09-14T09:08:35.264 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 58, 2024-09-14T09:08:35.264 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:08:35.264 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:08:35.264 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:08:35.264 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.264 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.264 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6800", 2024-09-14T09:08:35.264 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:08:35.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.265 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.265 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6801", 2024-09-14T09:08:35.265 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:08:35.265 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.265 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.265 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:08:35.265 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.265 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.265 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6802", 2024-09-14T09:08:35.266 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:08:35.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.266 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.266 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6803", 2024-09-14T09:08:35.266 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:08:35.266 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.266 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.266 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:08:35.266 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.266 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.267 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6806", 2024-09-14T09:08:35.267 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:08:35.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.267 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.267 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6807", 2024-09-14T09:08:35.267 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:08:35.267 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.267 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.267 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:08:35.267 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.267 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.267 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6804", 2024-09-14T09:08:35.268 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:08:35.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.268 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.268 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6805", 2024-09-14T09:08:35.268 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:08:35.268 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.268 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.268 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6801/3469105275", 2024-09-14T09:08:35.268 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6803/3469105275", 2024-09-14T09:08:35.268 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6807/3469105275", 2024-09-14T09:08:35.268 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6805/3469105275", 2024-09-14T09:08:35.268 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:08:35.269 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:08:35.269 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:08:35.269 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.269 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 2, 2024-09-14T09:08:35.269 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "958a9363-d751-49c3-9ec7-7330d377ee53", 2024-09-14T09:08:35.269 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:08:35.269 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:08:35.269 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 0.59710693359375, 2024-09-14T09:08:35.269 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:08:35.269 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:08:35.269 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:08:35.269 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 13, 2024-09-14T09:08:35.270 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 57, 2024-09-14T09:08:35.270 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:08:35.270 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:08:35.270 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:08:35.270 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.270 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.270 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6808", 2024-09-14T09:08:35.270 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:08:35.270 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.270 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.270 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6809", 2024-09-14T09:08:35.270 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:08:35.270 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.270 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.271 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:08:35.271 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.271 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.271 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6810", 2024-09-14T09:08:35.271 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:08:35.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.271 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.271 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6811", 2024-09-14T09:08:35.271 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:08:35.271 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.271 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.272 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:08:35.272 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.272 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.272 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6814", 2024-09-14T09:08:35.272 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:08:35.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.272 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.272 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6815", 2024-09-14T09:08:35.272 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:08:35.272 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.273 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.273 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:08:35.273 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.273 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.273 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6812", 2024-09-14T09:08:35.273 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:08:35.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.273 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.273 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6813", 2024-09-14T09:08:35.273 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2660214336 2024-09-14T09:08:35.273 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.274 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.274 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6809/2660214336", 2024-09-14T09:08:35.274 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6811/2660214336", 2024-09-14T09:08:35.274 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6815/2660214336", 2024-09-14T09:08:35.274 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6813/2660214336", 2024-09-14T09:08:35.274 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:08:35.274 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:08:35.274 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:08:35.274 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.274 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 3, 2024-09-14T09:08:35.275 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "7fafd519-b2e9-498c-a409-f55cfe45a51a", 2024-09-14T09:08:35.275 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:08:35.275 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:08:35.275 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:08:35.275 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 0.2435760498046875, 2024-09-14T09:08:35.275 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:08:35.275 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:08:35.275 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:08:35.275 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 57, 2024-09-14T09:08:35.275 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:08:35.275 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:08:35.275 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:08:35.275 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.276 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.276 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6816", 2024-09-14T09:08:35.276 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:08:35.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.276 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.276 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6817", 2024-09-14T09:08:35.276 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:08:35.276 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.276 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.276 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:08:35.276 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.277 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.277 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6818", 2024-09-14T09:08:35.277 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:08:35.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.277 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.277 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6819", 2024-09-14T09:08:35.277 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:08:35.277 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.277 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.278 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:08:35.278 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.278 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.278 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6822", 2024-09-14T09:08:35.278 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:08:35.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.278 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.278 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6823", 2024-09-14T09:08:35.278 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:08:35.278 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.278 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.279 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:08:35.279 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.279 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.279 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6820", 2024-09-14T09:08:35.279 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:08:35.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.279 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.279 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6821", 2024-09-14T09:08:35.279 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:08:35.279 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.279 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.280 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6817/2855061278", 2024-09-14T09:08:35.280 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6819/2855061278", 2024-09-14T09:08:35.280 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6823/2855061278", 2024-09-14T09:08:35.280 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6821/2855061278", 2024-09-14T09:08:35.280 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:08:35.280 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:08:35.280 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:08:35.280 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.280 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 4, 2024-09-14T09:08:35.280 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "63d99552-5fea-4367-bf86-0addc8cceb98", 2024-09-14T09:08:35.280 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:08:35.281 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:08:35.281 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:08:35.281 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:08:35.281 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:08:35.281 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:08:35.281 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:08:35.281 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 58, 2024-09-14T09:08:35.281 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:08:35.281 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:08:35.281 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:08:35.281 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.282 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.282 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6808", 2024-09-14T09:08:35.282 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:08:35.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.282 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.282 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6809", 2024-09-14T09:08:35.282 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:08:35.282 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.282 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.282 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:08:35.282 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.283 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.283 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6810", 2024-09-14T09:08:35.283 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:08:35.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.283 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.283 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6811", 2024-09-14T09:08:35.283 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:08:35.283 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.283 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.283 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:08:35.284 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.284 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.284 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6814", 2024-09-14T09:08:35.284 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:08:35.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.284 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.284 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6815", 2024-09-14T09:08:35.284 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:08:35.284 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.284 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.284 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:08:35.285 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.285 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.285 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6812", 2024-09-14T09:08:35.285 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:08:35.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.285 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.285 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6813", 2024-09-14T09:08:35.285 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:08:35.285 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.285 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.285 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6809/369903047", 2024-09-14T09:08:35.285 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6811/369903047", 2024-09-14T09:08:35.286 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6815/369903047", 2024-09-14T09:08:35.286 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6813/369903047", 2024-09-14T09:08:35.286 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:08:35.286 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:08:35.286 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:08:35.286 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.286 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 5, 2024-09-14T09:08:35.286 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "e4bcb224-662f-4530-b477-c0dd9c4ddbf4", 2024-09-14T09:08:35.286 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:08:35.286 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:08:35.286 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:08:35.286 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:08:35.286 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:08:35.287 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:08:35.287 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:08:35.287 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 57, 2024-09-14T09:08:35.287 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:08:35.287 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:08:35.287 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:08:35.287 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.287 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.287 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6800", 2024-09-14T09:08:35.287 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:08:35.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.287 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.287 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6801", 2024-09-14T09:08:35.288 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:08:35.288 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.288 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.288 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:08:35.288 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.288 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.288 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6802", 2024-09-14T09:08:35.288 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:08:35.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.288 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.288 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6803", 2024-09-14T09:08:35.289 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:08:35.289 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.289 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.289 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:08:35.289 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.289 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.289 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6806", 2024-09-14T09:08:35.289 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:08:35.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.289 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.289 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6807", 2024-09-14T09:08:35.290 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:08:35.290 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.290 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.290 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:08:35.290 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:08:35.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.290 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:08:35.290 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6804", 2024-09-14T09:08:35.290 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:08:35.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.290 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:08:35.291 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6805", 2024-09-14T09:08:35.291 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:08:35.291 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.291 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.291 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6801/2878111293", 2024-09-14T09:08:35.291 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6803/2878111293", 2024-09-14T09:08:35.291 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6807/2878111293", 2024-09-14T09:08:35.291 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6805/2878111293", 2024-09-14T09:08:35.291 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:08:35.291 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:08:35.292 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:08:35.292 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:35.292 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.292 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:08:35.292 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_xinfo": [ 2024-09-14T09:08:35.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.292 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 0, 2024-09-14T09:08:35.292 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:08:35.292 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:08:35.292 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:08:35.292 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:08:35.292 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:08:35.292 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:24.757990+0000", 2024-09-14T09:08:35.292 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:08:35.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.293 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 1, 2024-09-14T09:08:35.293 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:08:35.293 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:08:35.293 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:08:35.293 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:08:35.293 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:08:35.293 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.277795+0000", 2024-09-14T09:08:35.293 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:08:35.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.294 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 2, 2024-09-14T09:08:35.294 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:08:35.294 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:08:35.294 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:08:35.294 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:08:35.294 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:08:35.294 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.290172+0000", 2024-09-14T09:08:35.294 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:08:35.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.294 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 3, 2024-09-14T09:08:35.294 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:08:35.295 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:08:35.295 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:08:35.295 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:08:35.295 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:08:35.295 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.324594+0000", 2024-09-14T09:08:35.295 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:08:35.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.295 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 4, 2024-09-14T09:08:35.295 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:08:35.295 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:08:35.295 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:08:35.295 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:08:35.296 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:08:35.296 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:24.865136+0000", 2024-09-14T09:08:35.296 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:08:35.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:35.296 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 5, 2024-09-14T09:08:35.296 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:08:35.296 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:08:35.296 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:08:35.296 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:08:35.296 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:08:35.296 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.020572+0000", 2024-09-14T09:08:35.296 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:08:35.297 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.297 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:08:35.297 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap": [], 2024-09-14T09:08:35.297 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap_items": [], 2024-09-14T09:08:35.297 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap_primaries": [], 2024-09-14T09:08:35.297 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_temp": [], 2024-09-14T09:08:35.297 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_temp": [], 2024-09-14T09:08:35.297 INFO:teuthology.orchestra.run.smithi116.stdout: "blocklist": {}, 2024-09-14T09:08:35.297 INFO:teuthology.orchestra.run.smithi116.stdout: "range_blocklist": {}, 2024-09-14T09:08:35.297 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profiles": { 2024-09-14T09:08:35.297 INFO:teuthology.orchestra.run.smithi116.stdout: "default": { 2024-09-14T09:08:35.297 INFO:teuthology.orchestra.run.smithi116.stdout: "crush-failure-domain": "osd", 2024-09-14T09:08:35.297 INFO:teuthology.orchestra.run.smithi116.stdout: "k": "2", 2024-09-14T09:08:35.298 INFO:teuthology.orchestra.run.smithi116.stdout: "m": "1", 2024-09-14T09:08:35.298 INFO:teuthology.orchestra.run.smithi116.stdout: "plugin": "jerasure", 2024-09-14T09:08:35.298 INFO:teuthology.orchestra.run.smithi116.stdout: "technique": "reed_sol_van" 2024-09-14T09:08:35.298 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:35.298 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps_queue": [], 2024-09-14T09:08:35.298 INFO:teuthology.orchestra.run.smithi116.stdout: "new_removed_snaps": [], 2024-09-14T09:08:35.298 INFO:teuthology.orchestra.run.smithi116.stdout: "new_purged_snaps": [], 2024-09-14T09:08:35.298 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_node_flags": {}, 2024-09-14T09:08:35.298 INFO:teuthology.orchestra.run.smithi116.stdout: "device_class_flags": {}, 2024-09-14T09:08:35.298 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode": { 2024-09-14T09:08:35.298 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode_enabled": false, 2024-09-14T09:08:35.298 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_bucket_count": 0, 2024-09-14T09:08:35.298 INFO:teuthology.orchestra.run.smithi116.stdout: "degraded_stretch_mode": 0, 2024-09-14T09:08:35.299 INFO:teuthology.orchestra.run.smithi116.stdout: "recovering_stretch_mode": 0, 2024-09-14T09:08:35.299 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode_bucket": 0 2024-09-14T09:08:35.299 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:35.299 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:35.300 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:35.300 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:35.305 INFO:tasks.thrashosds.thrasher:j is {'epoch': 60, 'fsid': 'c991ac1c-978d-48b3-a540-4d3d4755e125', 'created': '2024-09-14T09:07:16.982473+0000', 'modified': '2024-09-14T09:08:34.950653+0000', 'last_up_change': '2024-09-14T09:07:28.201361+0000', 'last_in_change': '2024-09-14T09:07:18.560664+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T09:07:29.194849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T09:07:33.684592+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-14T09:07:43.363542+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 23, 'snap_epoch': 52, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}], 'osds': [{'osd': 0, 'uuid': 'b3c13086-1183-454b-8e62-3aec9b69cdf5', 'up': 1, 'in': 1, 'weight': 0.3199462890625, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 57, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6816', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6817', 'nonce': 1856142608}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6818', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6819', 'nonce': 1856142608}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6822', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6823', 'nonce': 1856142608}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6820', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6821', 'nonce': 1856142608}]}, 'public_addr': '172.21.15.116:6817/1856142608', 'cluster_addr': '172.21.15.116:6819/1856142608', 'heartbeat_back_addr': '172.21.15.116:6823/1856142608', 'heartbeat_front_addr': '172.21.15.116:6821/1856142608', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '8ee6a373-9d0d-4cd2-96f4-9673de96f546', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 58, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6800', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6801', 'nonce': 3469105275}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6802', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6803', 'nonce': 3469105275}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6806', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6807', 'nonce': 3469105275}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6804', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6805', 'nonce': 3469105275}]}, 'public_addr': '172.21.15.116:6801/3469105275', 'cluster_addr': '172.21.15.116:6803/3469105275', 'heartbeat_back_addr': '172.21.15.116:6807/3469105275', 'heartbeat_front_addr': '172.21.15.116:6805/3469105275', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '958a9363-d751-49c3-9ec7-7330d377ee53', 'up': 1, 'in': 1, 'weight': 0.59710693359375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 57, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6808', 'nonce': 2660214336}, {'type': 'v1', 'addr': '172.21.15.116:6809', 'nonce': 2660214336}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6810', 'nonce': 2660214336}, {'type': 'v1', 'addr': '172.21.15.116:6811', 'nonce': 2660214336}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6814', 'nonce': 2660214336}, {'type': 'v1', 'addr': '172.21.15.116:6815', 'nonce': 2660214336}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6812', 'nonce': 2660214336}, {'type': 'v1', 'addr': '172.21.15.116:6813', 'nonce': 2660214336}]}, 'public_addr': '172.21.15.116:6809/2660214336', 'cluster_addr': '172.21.15.116:6811/2660214336', 'heartbeat_back_addr': '172.21.15.116:6815/2660214336', 'heartbeat_front_addr': '172.21.15.116:6813/2660214336', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '7fafd519-b2e9-498c-a409-f55cfe45a51a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.2435760498046875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 57, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6816', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6817', 'nonce': 2855061278}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6818', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6819', 'nonce': 2855061278}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6822', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6823', 'nonce': 2855061278}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6820', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6821', 'nonce': 2855061278}]}, 'public_addr': '172.21.15.144:6817/2855061278', 'cluster_addr': '172.21.15.144:6819/2855061278', 'heartbeat_back_addr': '172.21.15.144:6823/2855061278', 'heartbeat_front_addr': '172.21.15.144:6821/2855061278', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '63d99552-5fea-4367-bf86-0addc8cceb98', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 58, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6808', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6809', 'nonce': 369903047}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6810', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6811', 'nonce': 369903047}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6814', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6815', 'nonce': 369903047}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6812', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6813', 'nonce': 369903047}]}, 'public_addr': '172.21.15.144:6809/369903047', 'cluster_addr': '172.21.15.144:6811/369903047', 'heartbeat_back_addr': '172.21.15.144:6815/369903047', 'heartbeat_front_addr': '172.21.15.144:6813/369903047', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e4bcb224-662f-4530-b477-c0dd9c4ddbf4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 57, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6800', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6801', 'nonce': 2878111293}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6802', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6803', 'nonce': 2878111293}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6806', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6807', 'nonce': 2878111293}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6804', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6805', 'nonce': 2878111293}]}, 'public_addr': '172.21.15.144:6801/2878111293', 'cluster_addr': '172.21.15.144:6803/2878111293', 'heartbeat_back_addr': '172.21.15.144:6807/2878111293', 'heartbeat_front_addr': '172.21.15.144:6805/2878111293', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:24.757990+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.277795+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.290172+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.324594+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:24.865136+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.020572+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T09:08:35.305 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-14T09:08:35.305 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:08:35.306 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:35.309+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:35.316 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:08:35.408 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:35.408 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:35.408 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:35.410+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:35.416 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:08:35.457 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:35.458 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:35.474 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:35.475 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:35.490 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:08:35.490 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:08:35.507 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:35.508 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:35.508 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:35.510+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:35.524 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:35.525 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:35.542 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:35.542 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:35.563 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:1137 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.043863+0000", 2024-09-14T09:08:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.520808151000001, 2024-09-14T09:08:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018224061, 2024-09-14T09:08:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1137 2024-09-14T09:08:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043863+0000", 2024-09-14T09:08:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043863+0000", 2024-09-14T09:08:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043863+0000", 2024-09-14T09:08:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3099999999999998e-07 2024-09-14T09:08:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043866+0000", 2024-09-14T09:08:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5620000000000002e-06 2024-09-14T09:08:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043872+0000", 2024-09-14T09:08:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5579999999999997e-06 2024-09-14T09:08:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.043877+0000", 2024-09-14T09:08:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7299999999999996e-06 2024-09-14T09:08:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056308+0000", 2024-09-14T09:08:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012430925000000001 2024-09-14T09:08:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056382+0000", 2024-09-14T09:08:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3870999999999998e-05 2024-09-14T09:08:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.056753+0000", 2024-09-14T09:08:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000371343 2024-09-14T09:08:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.061992+0000", 2024-09-14T09:08:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005238688 2024-09-14T09:08:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.062028+0000", 2024-09-14T09:08:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6040000000000001e-05 2024-09-14T09:08:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.062054+0000", 2024-09-14T09:08:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5856000000000001e-05 2024-09-14T09:08:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.062087+0000", 2024-09-14T09:08:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2957000000000003e-05 2024-09-14T09:08:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:1139 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.044918+0000", 2024-09-14T09:08:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.519753297000001, 2024-09-14T09:08:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019100876999999999, 2024-09-14T09:08:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1139 2024-09-14T09:08:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044918+0000", 2024-09-14T09:08:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044918+0000", 2024-09-14T09:08:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044918+0000", 2024-09-14T09:08:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2500000000000004e-07 2024-09-14T09:08:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044924+0000", 2024-09-14T09:08:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2050000000000001e-06 2024-09-14T09:08:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044935+0000", 2024-09-14T09:08:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1321000000000001e-05 2024-09-14T09:08:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.044942+0000", 2024-09-14T09:08:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.277e-06 2024-09-14T09:08:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.057831+0000", 2024-09-14T09:08:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012888692 2024-09-14T09:08:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.057912+0000", 2024-09-14T09:08:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0875000000000001e-05 2024-09-14T09:08:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.058249+0000", 2024-09-14T09:08:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033680100000000002 2024-09-14T09:08:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.063666+0000", 2024-09-14T09:08:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054178189999999999 2024-09-14T09:08:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.063922+0000", 2024-09-14T09:08:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00025591699999999998 2024-09-14T09:08:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.063978+0000", 2024-09-14T09:08:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5603000000000003e-05 2024-09-14T09:08:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064018+0000", 2024-09-14T09:08:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0441999999999997e-05 2024-09-14T09:08:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:1140 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.045510+0000", 2024-09-14T09:08:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.519160806999999, 2024-09-14T09:08:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018615145, 2024-09-14T09:08:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1140 2024-09-14T09:08:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045510+0000", 2024-09-14T09:08:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045510+0000", 2024-09-14T09:08:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045511+0000", 2024-09-14T09:08:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8899999999999998e-07 2024-09-14T09:08:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045516+0000", 2024-09-14T09:08:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9749999999999998e-06 2024-09-14T09:08:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045530+0000", 2024-09-14T09:08:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4542000000000001e-05 2024-09-14T09:08:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.045542+0000", 2024-09-14T09:08:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1984000000000001e-05 2024-09-14T09:08:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.058561+0000", 2024-09-14T09:08:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01301828 2024-09-14T09:08:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.058628+0000", 2024-09-14T09:08:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7049000000000001e-05 2024-09-14T09:08:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.058827+0000", 2024-09-14T09:08:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019901200000000001 2024-09-14T09:08:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.063672+0000", 2024-09-14T09:08:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048450339999999998 2024-09-14T09:08:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064068+0000", 2024-09-14T09:08:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00039579200000000001 2024-09-14T09:08:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064098+0000", 2024-09-14T09:08:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9940000000000001e-05 2024-09-14T09:08:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.064125+0000", 2024-09-14T09:08:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7648e-05 2024-09-14T09:08:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2066 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.183929+0000", 2024-09-14T09:08:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.380742247000001, 2024-09-14T09:08:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020663781999999999, 2024-09-14T09:08:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2066 2024-09-14T09:08:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183929+0000", 2024-09-14T09:08:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183929+0000", 2024-09-14T09:08:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183929+0000", 2024-09-14T09:08:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2500000000000001e-07 2024-09-14T09:08:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183932+0000", 2024-09-14T09:08:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.683e-06 2024-09-14T09:08:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183938+0000", 2024-09-14T09:08:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6220000000000003e-06 2024-09-14T09:08:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183943+0000", 2024-09-14T09:08:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0340000000000004e-06 2024-09-14T09:08:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.198098+0000", 2024-09-14T09:08:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014154645 2024-09-14T09:08:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.198170+0000", 2024-09-14T09:08:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2464000000000003e-05 2024-09-14T09:08:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.198494+0000", 2024-09-14T09:08:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00032338499999999998 2024-09-14T09:08:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.202395+0000", 2024-09-14T09:08:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003900714 2024-09-14T09:08:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204488+0000", 2024-09-14T09:08:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020932860000000002 2024-09-14T09:08:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204556+0000", 2024-09-14T09:08:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8021999999999993e-05 2024-09-14T09:08:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204592+0000", 2024-09-14T09:08:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6501999999999997e-05 2024-09-14T09:08:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2067 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.183952+0000", 2024-09-14T09:08:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.380719312, 2024-09-14T09:08:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020733690999999999, 2024-09-14T09:08:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2067 2024-09-14T09:08:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183952+0000", 2024-09-14T09:08:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183952+0000", 2024-09-14T09:08:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183952+0000", 2024-09-14T09:08:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4499999999999998e-07 2024-09-14T09:08:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183953+0000", 2024-09-14T09:08:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5659999999999999e-06 2024-09-14T09:08:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183961+0000", 2024-09-14T09:08:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8979999999999996e-06 2024-09-14T09:08:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.183965+0000", 2024-09-14T09:08:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3440000000000001e-06 2024-09-14T09:08:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.199110+0000", 2024-09-14T09:08:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015145257000000001 2024-09-14T09:08:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.199183+0000", 2024-09-14T09:08:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3075000000000001e-05 2024-09-14T09:08:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.199495+0000", 2024-09-14T09:08:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00031204200000000001 2024-09-14T09:08:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204475+0000", 2024-09-14T09:08:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049796809999999997 2024-09-14T09:08:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204601+0000", 2024-09-14T09:08:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000126713 2024-09-14T09:08:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204644+0000", 2024-09-14T09:08:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2500999999999998e-05 2024-09-14T09:08:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204685+0000", 2024-09-14T09:08:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1369000000000003e-05 2024-09-14T09:08:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2068 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185491+0000", 2024-09-14T09:08:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.379180243, 2024-09-14T09:08:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019345701, 2024-09-14T09:08:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2068 2024-09-14T09:08:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185491+0000", 2024-09-14T09:08:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185491+0000", 2024-09-14T09:08:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185491+0000", 2024-09-14T09:08:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8100000000000002e-07 2024-09-14T09:08:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185495+0000", 2024-09-14T09:08:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7100000000000001e-06 2024-09-14T09:08:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185504+0000", 2024-09-14T09:08:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7069999999999998e-06 2024-09-14T09:08:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185508+0000", 2024-09-14T09:08:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6750000000000001e-06 2024-09-14T09:08:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.199874+0000", 2024-09-14T09:08:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014365833999999999 2024-09-14T09:08:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.199947+0000", 2024-09-14T09:08:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3010999999999996e-05 2024-09-14T09:08:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.200280+0000", 2024-09-14T09:08:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033280499999999998 2024-09-14T09:08:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204698+0000", 2024-09-14T09:08:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044175400000000002 2024-09-14T09:08:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204746+0000", 2024-09-14T09:08:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8340999999999997e-05 2024-09-14T09:08:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204799+0000", 2024-09-14T09:08:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2871999999999998e-05 2024-09-14T09:08:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204836+0000", 2024-09-14T09:08:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7524999999999997e-05 2024-09-14T09:08:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2069 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185519+0000", 2024-09-14T09:08:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.379151877000002, 2024-09-14T09:08:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019424951999999999, 2024-09-14T09:08:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2069 2024-09-14T09:08:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185519+0000", 2024-09-14T09:08:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185519+0000", 2024-09-14T09:08:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185519+0000", 2024-09-14T09:08:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8200000000000001e-07 2024-09-14T09:08:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185521+0000", 2024-09-14T09:08:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.655e-06 2024-09-14T09:08:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185525+0000", 2024-09-14T09:08:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8870000000000002e-06 2024-09-14T09:08:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185528+0000", 2024-09-14T09:08:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6689999999999999e-06 2024-09-14T09:08:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.200838+0000", 2024-09-14T09:08:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015309779000000001 2024-09-14T09:08:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.200913+0000", 2024-09-14T09:08:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4612999999999999e-05 2024-09-14T09:08:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.201269+0000", 2024-09-14T09:08:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00035585800000000002 2024-09-14T09:08:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204704+0000", 2024-09-14T09:08:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034355879999999998 2024-09-14T09:08:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204883+0000", 2024-09-14T09:08:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017857499999999999 2024-09-14T09:08:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204911+0000", 2024-09-14T09:08:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8007000000000001e-05 2024-09-14T09:08:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204944+0000", 2024-09-14T09:08:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3039e-05 2024-09-14T09:08:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2070 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185533+0000", 2024-09-14T09:08:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.379138301000001, 2024-09-14T09:08:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019500197, 2024-09-14T09:08:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2070 2024-09-14T09:08:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185533+0000", 2024-09-14T09:08:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185533+0000", 2024-09-14T09:08:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185533+0000", 2024-09-14T09:08:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1500000000000001e-07 2024-09-14T09:08:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185534+0000", 2024-09-14T09:08:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.449e-06 2024-09-14T09:08:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185537+0000", 2024-09-14T09:08:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-09-14T09:08:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185541+0000", 2024-09-14T09:08:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2140000000000001e-06 2024-09-14T09:08:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.201762+0000", 2024-09-14T09:08:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016221197 2024-09-14T09:08:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.201815+0000", 2024-09-14T09:08:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2787000000000001e-05 2024-09-14T09:08:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.202011+0000", 2024-09-14T09:08:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019608200000000001 2024-09-14T09:08:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204709+0000", 2024-09-14T09:08:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026987109999999999 2024-09-14T09:08:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204987+0000", 2024-09-14T09:08:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000277636 2024-09-14T09:08:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205015+0000", 2024-09-14T09:08:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7710000000000001e-05 2024-09-14T09:08:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205033+0000", 2024-09-14T09:08:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7946000000000001e-05 2024-09-14T09:08:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2071 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185545+0000", 2024-09-14T09:08:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.379125990999999, 2024-09-14T09:08:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021874615, 2024-09-14T09:08:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2071 2024-09-14T09:08:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185545+0000", 2024-09-14T09:08:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185545+0000", 2024-09-14T09:08:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185545+0000", 2024-09-14T09:08:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1799999999999999e-07 2024-09-14T09:08:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185546+0000", 2024-09-14T09:08:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.392e-06 2024-09-14T09:08:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185550+0000", 2024-09-14T09:08:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2179999999999999e-06 2024-09-14T09:08:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185552+0000", 2024-09-14T09:08:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6419999999999999e-06 2024-09-14T09:08:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.202430+0000", 2024-09-14T09:08:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016877728000000002 2024-09-14T09:08:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.202499+0000", 2024-09-14T09:08:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9259999999999998e-05 2024-09-14T09:08:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.203297+0000", 2024-09-14T09:08:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00079781399999999999 2024-09-14T09:08:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.207321+0000", 2024-09-14T09:08:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040234420000000003 2024-09-14T09:08:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.207349+0000", 2024-09-14T09:08:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8736000000000001e-05 2024-09-14T09:08:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.207381+0000", 2024-09-14T09:08:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1315000000000001e-05 2024-09-14T09:08:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.207419+0000", 2024-09-14T09:08:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8850000000000002e-05 2024-09-14T09:08:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2072 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185556+0000", 2024-09-14T09:08:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.379115184, 2024-09-14T09:08:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023970933999999999, 2024-09-14T09:08:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2072 2024-09-14T09:08:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185556+0000", 2024-09-14T09:08:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185556+0000", 2024-09-14T09:08:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185556+0000", 2024-09-14T09:08:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.17e-07 2024-09-14T09:08:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185557+0000", 2024-09-14T09:08:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2860000000000001e-06 2024-09-14T09:08:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185560+0000", 2024-09-14T09:08:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0130000000000002e-06 2024-09-14T09:08:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185563+0000", 2024-09-14T09:08:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:08:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.203700+0000", 2024-09-14T09:08:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018137646 2024-09-14T09:08:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.203782+0000", 2024-09-14T09:08:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2082000000000005e-05 2024-09-14T09:08:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.204106+0000", 2024-09-14T09:08:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000323345 2024-09-14T09:08:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209284+0000", 2024-09-14T09:08:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051778739999999998 2024-09-14T09:08:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209477+0000", 2024-09-14T09:08:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019348400000000001 2024-09-14T09:08:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209505+0000", 2024-09-14T09:08:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7358000000000001e-05 2024-09-14T09:08:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209527+0000", 2024-09-14T09:08:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2082999999999998e-05 2024-09-14T09:08:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2073 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185566+0000", 2024-09-14T09:08:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.379104443999999, 2024-09-14T09:08:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024050449000000002, 2024-09-14T09:08:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2073 2024-09-14T09:08:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185566+0000", 2024-09-14T09:08:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185566+0000", 2024-09-14T09:08:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185567+0000", 2024-09-14T09:08:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2024-09-14T09:08:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185568+0000", 2024-09-14T09:08:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3e-06 2024-09-14T09:08:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185571+0000", 2024-09-14T09:08:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0460000000000001e-06 2024-09-14T09:08:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185574+0000", 2024-09-14T09:08:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5399999999999998e-06 2024-09-14T09:08:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205068+0000", 2024-09-14T09:08:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019494002999999999 2024-09-14T09:08:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205135+0000", 2024-09-14T09:08:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7056000000000003e-05 2024-09-14T09:08:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205421+0000", 2024-09-14T09:08:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00028621899999999999 2024-09-14T09:08:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209290+0000", 2024-09-14T09:08:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038688059999999998 2024-09-14T09:08:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209553+0000", 2024-09-14T09:08:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00026326600000000001 2024-09-14T09:08:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209587+0000", 2024-09-14T09:08:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4359000000000001e-05 2024-09-14T09:08:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.209617+0000", 2024-09-14T09:08:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9643000000000001e-05 2024-09-14T09:08:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2074 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185577+0000", 2024-09-14T09:08:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.379094315, 2024-09-14T09:08:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026839190999999998, 2024-09-14T09:08:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2074 2024-09-14T09:08:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185577+0000", 2024-09-14T09:08:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185577+0000", 2024-09-14T09:08:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185577+0000", 2024-09-14T09:08:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0800000000000001e-07 2024-09-14T09:08:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185578+0000", 2024-09-14T09:08:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3790000000000001e-06 2024-09-14T09:08:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185581+0000", 2024-09-14T09:08:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9639999999999999e-06 2024-09-14T09:08:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185584+0000", 2024-09-14T09:08:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.543e-06 2024-09-14T09:08:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205773+0000", 2024-09-14T09:08:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020189592999999999 2024-09-14T09:08:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.205852+0000", 2024-09-14T09:08:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8825999999999994e-05 2024-09-14T09:08:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206078+0000", 2024-09-14T09:08:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022563999999999999 2024-09-14T09:08:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212216+0000", 2024-09-14T09:08:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061383940000000001 2024-09-14T09:08:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212346+0000", 2024-09-14T09:08:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000130195 2024-09-14T09:08:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212382+0000", 2024-09-14T09:08:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6009e-05 2024-09-14T09:08:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212416+0000", 2024-09-14T09:08:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3439999999999998e-05 2024-09-14T09:08:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:2075 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.185587+0000", 2024-09-14T09:08:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.379084165999998, 2024-09-14T09:08:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026913308, 2024-09-14T09:08:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2075 2024-09-14T09:08:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185587+0000", 2024-09-14T09:08:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185587+0000", 2024-09-14T09:08:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185587+0000", 2024-09-14T09:08:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1e-07 2024-09-14T09:08:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185588+0000", 2024-09-14T09:08:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.308e-06 2024-09-14T09:08:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185592+0000", 2024-09-14T09:08:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5999999999999998e-06 2024-09-14T09:08:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.185594+0000", 2024-09-14T09:08:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5799999999999999e-06 2024-09-14T09:08:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206511+0000", 2024-09-14T09:08:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020916338999999999 2024-09-14T09:08:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206591+0000", 2024-09-14T09:08:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0495999999999996e-05 2024-09-14T09:08:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.206963+0000", 2024-09-14T09:08:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00037151300000000002 2024-09-14T09:08:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212222+0000", 2024-09-14T09:08:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052591469999999996 2024-09-14T09:08:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212449+0000", 2024-09-14T09:08:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022715699999999999 2024-09-14T09:08:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212478+0000", 2024-09-14T09:08:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8818000000000001e-05 2024-09-14T09:08:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.212500+0000", 2024-09-14T09:08:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2140000000000001e-05 2024-09-14T09:08:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:3094 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.520938+0000", 2024-09-14T09:08:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.043733162999999, 2024-09-14T09:08:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019285107999999999, 2024-09-14T09:08:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3094 2024-09-14T09:08:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520938+0000", 2024-09-14T09:08:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520938+0000", 2024-09-14T09:08:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520938+0000", 2024-09-14T09:08:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7099999999999998e-07 2024-09-14T09:08:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520939+0000", 2024-09-14T09:08:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.468e-06 2024-09-14T09:08:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520943+0000", 2024-09-14T09:08:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2459999999999999e-06 2024-09-14T09:08:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520945+0000", 2024-09-14T09:08:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7800000000000001e-06 2024-09-14T09:08:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.533959+0000", 2024-09-14T09:08:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013013927999999999 2024-09-14T09:08:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.534043+0000", 2024-09-14T09:08:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3628999999999995e-05 2024-09-14T09:08:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.534423+0000", 2024-09-14T09:08:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00037996699999999999 2024-09-14T09:08:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.537297+0000", 2024-09-14T09:08:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028744650000000001 2024-09-14T09:08:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.540132+0000", 2024-09-14T09:08:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002834072 2024-09-14T09:08:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.540184+0000", 2024-09-14T09:08:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2457000000000003e-05 2024-09-14T09:08:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.540223+0000", 2024-09-14T09:08:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8825000000000002e-05 2024-09-14T09:08:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:3095 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.520949+0000", 2024-09-14T09:08:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.043722203000002, 2024-09-14T09:08:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019423973000000001, 2024-09-14T09:08:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3095 2024-09-14T09:08:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520949+0000", 2024-09-14T09:08:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520949+0000", 2024-09-14T09:08:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520949+0000", 2024-09-14T09:08:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6e-07 2024-09-14T09:08:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520950+0000", 2024-09-14T09:08:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5600000000000001e-06 2024-09-14T09:08:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520953+0000", 2024-09-14T09:08:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9660000000000001e-06 2024-09-14T09:08:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520956+0000", 2024-09-14T09:08:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6019999999999998e-06 2024-09-14T09:08:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.535013+0000", 2024-09-14T09:08:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014056663 2024-09-14T09:08:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.535091+0000", 2024-09-14T09:08:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8745000000000006e-05 2024-09-14T09:08:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.535323+0000", 2024-09-14T09:08:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000231685 2024-09-14T09:08:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.540275+0000", 2024-09-14T09:08:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049515130000000003 2024-09-14T09:08:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.540287+0000", 2024-09-14T09:08:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2649999999999999e-05 2024-09-14T09:08:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.540334+0000", 2024-09-14T09:08:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7083999999999998e-05 2024-09-14T09:08:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.540373+0000", 2024-09-14T09:08:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8244999999999997e-05 2024-09-14T09:08:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:3096 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.520959+0000", 2024-09-14T09:08:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.043711754, 2024-09-14T09:08:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021266274000000002, 2024-09-14T09:08:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3096 2024-09-14T09:08:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:35.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520959+0000", 2024-09-14T09:08:35.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:35.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520959+0000", 2024-09-14T09:08:35.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:35.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520959+0000", 2024-09-14T09:08:35.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.17e-07 2024-09-14T09:08:35.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:35.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520961+0000", 2024-09-14T09:08:35.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3200000000000001e-06 2024-09-14T09:08:35.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:35.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520964+0000", 2024-09-14T09:08:35.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8700000000000001e-06 2024-09-14T09:08:35.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:35.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520966+0000", 2024-09-14T09:08:35.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4880000000000001e-06 2024-09-14T09:08:35.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:35.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.535679+0000", 2024-09-14T09:08:35.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014713118000000001 2024-09-14T09:08:35.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:35.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.535765+0000", 2024-09-14T09:08:35.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5464999999999996e-05 2024-09-14T09:08:35.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:35.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.536136+0000", 2024-09-14T09:08:35.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00037173399999999998 2024-09-14T09:08:35.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:35.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.542094+0000", 2024-09-14T09:08:35.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059577639999999999 2024-09-14T09:08:35.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:35.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.542147+0000", 2024-09-14T09:08:35.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2444999999999997e-05 2024-09-14T09:08:35.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:35.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.542188+0000", 2024-09-14T09:08:35.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1465999999999999e-05 2024-09-14T09:08:35.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:35.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.542225+0000", 2024-09-14T09:08:35.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7387e-05 2024-09-14T09:08:35.664 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.664 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:35.664 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.664 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:3097 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:35.664 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.520973+0000", 2024-09-14T09:08:35.664 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.043698145, 2024-09-14T09:08:35.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022189861000000002, 2024-09-14T09:08:35.664 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:35.664 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:35.665 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:35.665 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:35.665 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:35.665 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:35.665 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3097 2024-09-14T09:08:35.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.665 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:35.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:35.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520973+0000", 2024-09-14T09:08:35.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:35.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520973+0000", 2024-09-14T09:08:35.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:35.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520973+0000", 2024-09-14T09:08:35.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.53e-07 2024-09-14T09:08:35.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:35.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520975+0000", 2024-09-14T09:08:35.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5600000000000001e-06 2024-09-14T09:08:35.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:35.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520978+0000", 2024-09-14T09:08:35.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1990000000000002e-06 2024-09-14T09:08:35.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:35.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520980+0000", 2024-09-14T09:08:35.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5579999999999999e-06 2024-09-14T09:08:35.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:35.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.536537+0000", 2024-09-14T09:08:35.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015556285 2024-09-14T09:08:35.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:35.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.536612+0000", 2024-09-14T09:08:35.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5704000000000006e-05 2024-09-14T09:08:35.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:35.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.536946+0000", 2024-09-14T09:08:35.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033328299999999997 2024-09-14T09:08:35.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:35.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.542236+0000", 2024-09-14T09:08:35.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052906680000000001 2024-09-14T09:08:35.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:35.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.542395+0000", 2024-09-14T09:08:35.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015884499999999999 2024-09-14T09:08:35.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:35.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543126+0000", 2024-09-14T09:08:35.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000731125 2024-09-14T09:08:35.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:35.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543163+0000", 2024-09-14T09:08:35.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6381000000000003e-05 2024-09-14T09:08:35.669 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.669 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:35.670 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.670 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:3098 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:35.670 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.520984+0000", 2024-09-14T09:08:35.670 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.043687297999998, 2024-09-14T09:08:35.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022279624000000001, 2024-09-14T09:08:35.670 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:35.670 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:35.670 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:35.670 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:35.670 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:35.670 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:35.670 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3098 2024-09-14T09:08:35.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.671 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:35.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:35.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520984+0000", 2024-09-14T09:08:35.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:35.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520984+0000", 2024-09-14T09:08:35.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:35.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520984+0000", 2024-09-14T09:08:35.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2100000000000001e-07 2024-09-14T09:08:35.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:35.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520985+0000", 2024-09-14T09:08:35.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.305e-06 2024-09-14T09:08:35.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:35.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520988+0000", 2024-09-14T09:08:35.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9459999999999998e-06 2024-09-14T09:08:35.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:35.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520991+0000", 2024-09-14T09:08:35.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5220000000000002e-06 2024-09-14T09:08:35.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:35.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.537336+0000", 2024-09-14T09:08:35.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016345563 2024-09-14T09:08:35.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:35.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.537416+0000", 2024-09-14T09:08:35.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0091000000000003e-05 2024-09-14T09:08:35.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:35.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.537632+0000", 2024-09-14T09:08:35.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00021544899999999999 2024-09-14T09:08:35.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:35.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543210+0000", 2024-09-14T09:08:35.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055779189999999998 2024-09-14T09:08:35.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:35.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543217+0000", 2024-09-14T09:08:35.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5599999999999996e-06 2024-09-14T09:08:35.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:35.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543241+0000", 2024-09-14T09:08:35.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4365000000000001e-05 2024-09-14T09:08:35.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:35.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543263+0000", 2024-09-14T09:08:35.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1682999999999999e-05 2024-09-14T09:08:35.676 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.676 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:35.676 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.676 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:3099 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:35.676 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.520994+0000", 2024-09-14T09:08:35.676 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.043677326000001, 2024-09-14T09:08:35.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022403849, 2024-09-14T09:08:35.676 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:35.676 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:35.676 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:35.676 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:35.677 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:35.677 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:35.677 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3099 2024-09-14T09:08:35.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.677 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:35.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:35.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520994+0000", 2024-09-14T09:08:35.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:35.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520994+0000", 2024-09-14T09:08:35.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:35.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520994+0000", 2024-09-14T09:08:35.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.23e-07 2024-09-14T09:08:35.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:35.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520995+0000", 2024-09-14T09:08:35.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.285e-06 2024-09-14T09:08:35.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:35.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.520998+0000", 2024-09-14T09:08:35.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9129999999999999e-06 2024-09-14T09:08:35.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:35.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.521000+0000", 2024-09-14T09:08:35.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4569999999999999e-06 2024-09-14T09:08:35.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:35.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.537995+0000", 2024-09-14T09:08:35.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016994619999999998 2024-09-14T09:08:35.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:35.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.538039+0000", 2024-09-14T09:08:35.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3557999999999999e-05 2024-09-14T09:08:35.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:35.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.538249+0000", 2024-09-14T09:08:35.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000210237 2024-09-14T09:08:35.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:35.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543270+0000", 2024-09-14T09:08:35.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050210769999999997 2024-09-14T09:08:35.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:35.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543314+0000", 2024-09-14T09:08:35.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3829000000000003e-05 2024-09-14T09:08:35.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:35.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543364+0000", 2024-09-14T09:08:35.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0460000000000001e-05 2024-09-14T09:08:35.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:35.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543397+0000", 2024-09-14T09:08:35.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3189999999999999e-05 2024-09-14T09:08:35.682 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.682 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:35.682 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.682 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4766.0:3100 3.4 3:25d26d04:::rbd_object_map.111232b23a18:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:35.682 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:18.521003+0000", 2024-09-14T09:08:35.682 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.043667529, 2024-09-14T09:08:35.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023619213, 2024-09-14T09:08:35.682 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:35.682 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:35.682 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:35.683 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:35.683 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4766", 2024-09-14T09:08:35.683 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:35.683 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3100 2024-09-14T09:08:35.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.683 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:35.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:35.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.521003+0000", 2024-09-14T09:08:35.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:35.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.521003+0000", 2024-09-14T09:08:35.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:35.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:35.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.521004+0000", 2024-09-14T09:08:35.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2100000000000001e-07 2024-09-14T09:08:35.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:35.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.521005+0000", 2024-09-14T09:08:35.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5910000000000001e-06 2024-09-14T09:08:35.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:35.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.521008+0000", 2024-09-14T09:08:35.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.818e-06 2024-09-14T09:08:35.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:35.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.521012+0000", 2024-09-14T09:08:35.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6030000000000001e-06 2024-09-14T09:08:35.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:35.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.538577+0000", 2024-09-14T09:08:35.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017565386999999998 2024-09-14T09:08:35.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:35.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.538619+0000", 2024-09-14T09:08:35.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2379999999999997e-05 2024-09-14T09:08:35.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:35.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.538918+0000", 2024-09-14T09:08:35.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029888000000000001 2024-09-14T09:08:35.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:35.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.543448+0000", 2024-09-14T09:08:35.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045295969999999998 2024-09-14T09:08:35.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:35.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.544536+0000", 2024-09-14T09:08:35.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001088554 2024-09-14T09:08:35.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:35.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.544585+0000", 2024-09-14T09:08:35.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8359999999999998e-05 2024-09-14T09:08:35.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:35.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:35.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:35.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:18.544623+0000", 2024-09-14T09:08:35.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7821999999999998e-05 2024-09-14T09:08:35.688 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.688 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:35.688 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.688 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:35.688 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:35.689 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:35.690 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:08:35.691 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:35.692+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:35.790 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:35.792+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:35.833 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:35.833 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:35.833 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:35.833 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:35.842 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:08:35.891 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:35.893+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:35.945 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:35.945 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:35.945 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:35.945 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:35.945 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:35.953 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:08:35.991 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:35.992+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:36.064 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone21 from 0xecd6400 (overlap 0xb0f400) to 0x9f4200 2024-09-14T09:08:36.093 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:36.095+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:36.103 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:36.103 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:36.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:36.103 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:36.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.103 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1209 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:36.103 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417851+0000", 2024-09-14T09:08:36.103 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.686321225999997, 2024-09-14T09:08:36.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010012681000000001, 2024-09-14T09:08:36.104 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:36.104 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:36.104 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:36.104 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:36.104 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:36.104 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:36.104 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1209 2024-09-14T09:08:36.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.104 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:36.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:36.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417851+0000", 2024-09-14T09:08:36.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:36.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417851+0000", 2024-09-14T09:08:36.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:36.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417852+0000", 2024-09-14T09:08:36.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.84e-07 2024-09-14T09:08:36.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:36.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417853+0000", 2024-09-14T09:08:36.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6589999999999999e-06 2024-09-14T09:08:36.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:36.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417857+0000", 2024-09-14T09:08:36.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7050000000000001e-06 2024-09-14T09:08:36.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417860+0000", 2024-09-14T09:08:36.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.242e-06 2024-09-14T09:08:36.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425469+0000", 2024-09-14T09:08:36.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076089 2024-09-14T09:08:36.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:36.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425553+0000", 2024-09-14T09:08:36.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3657000000000002e-05 2024-09-14T09:08:36.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:36.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.425782+0000", 2024-09-14T09:08:36.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000229519 2024-09-14T09:08:36.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:36.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427775+0000", 2024-09-14T09:08:36.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019930289999999999 2024-09-14T09:08:36.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:36.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427794+0000", 2024-09-14T09:08:36.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8238999999999999e-05 2024-09-14T09:08:36.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:36.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427827+0000", 2024-09-14T09:08:36.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3045e-05 2024-09-14T09:08:36.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:36.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427864+0000", 2024-09-14T09:08:36.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7401999999999999e-05 2024-09-14T09:08:36.109 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.109 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:36.109 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.109 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4563.0:1210 3.0 3:07c34182:::rbd_object_map.111276489662:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T09:08:36.109 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:07:56.417864+0000", 2024-09-14T09:08:36.109 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.686308152999999, 2024-09-14T09:08:36.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011675377000000001, 2024-09-14T09:08:36.109 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:36.109 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:36.109 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:36.109 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:36.110 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4563", 2024-09-14T09:08:36.110 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/25494905", 2024-09-14T09:08:36.110 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1210 2024-09-14T09:08:36.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.110 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:36.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:36.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417864+0000", 2024-09-14T09:08:36.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:36.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417864+0000", 2024-09-14T09:08:36.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:36.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417865+0000", 2024-09-14T09:08:36.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.34e-07 2024-09-14T09:08:36.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:36.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417866+0000", 2024-09-14T09:08:36.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.384e-06 2024-09-14T09:08:36.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:36.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417869+0000", 2024-09-14T09:08:36.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.971e-06 2024-09-14T09:08:36.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.417872+0000", 2024-09-14T09:08:36.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5979999999999999e-06 2024-09-14T09:08:36.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426155+0000", 2024-09-14T09:08:36.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082832389999999995 2024-09-14T09:08:36.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:36.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426236+0000", 2024-09-14T09:08:36.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1241000000000004e-05 2024-09-14T09:08:36.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 2", 2024-09-14T09:08:36.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.426477+0000", 2024-09-14T09:08:36.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024123999999999999 2024-09-14T09:08:36.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:36.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.427872+0000", 2024-09-14T09:08:36.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001394714 2024-09-14T09:08:36.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:36.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.429483+0000", 2024-09-14T09:08:36.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001611124 2024-09-14T09:08:36.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:36.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.429515+0000", 2024-09-14T09:08:36.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2243000000000003e-05 2024-09-14T09:08:36.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:36.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:07:56.429540+0000", 2024-09-14T09:08:36.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4389e-05 2024-09-14T09:08:36.115 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.115 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:36.115 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.115 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:228 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 360448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:36.115 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:08:36.115 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3072670139999998, 2024-09-14T09:08:36.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99234476999999999, 2024-09-14T09:08:36.115 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:36.115 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:36.115 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:36.116 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:36.116 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:36.116 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:36.116 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 228 2024-09-14T09:08:36.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.116 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:36.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:36.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:08:36.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:36.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:08:36.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:36.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796906+0000", 2024-09-14T09:08:36.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9399999999999995e-07 2024-09-14T09:08:36.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:36.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796917+0000", 2024-09-14T09:08:36.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0801e-05 2024-09-14T09:08:36.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:36.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796924+0000", 2024-09-14T09:08:36.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7750000000000004e-06 2024-09-14T09:08:36.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:08:36.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9972000000000001e-05 2024-09-14T09:08:36.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798671+0000", 2024-09-14T09:08:36.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017271330000000001 2024-09-14T09:08:36.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:36.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798675+0000", 2024-09-14T09:08:36.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.194e-06 2024-09-14T09:08:36.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789003+0000", 2024-09-14T09:08:36.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99032768400000004 2024-09-14T09:08:36.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:36.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789115+0000", 2024-09-14T09:08:36.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112236 2024-09-14T09:08:36.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:36.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789250+0000", 2024-09-14T09:08:36.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013548100000000001 2024-09-14T09:08:36.121 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.121 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:36.121 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.122 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:229 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 819200~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:36.122 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:08:36.122 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3072147909999998, 2024-09-14T09:08:36.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99287024599999996, 2024-09-14T09:08:36.122 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:36.122 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:36.122 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:36.122 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:36.122 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:36.122 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:36.122 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 229 2024-09-14T09:08:36.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.122 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:36.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:36.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:08:36.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:36.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:08:36.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:36.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:08:36.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999999e-07 2024-09-14T09:08:36.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796962+0000", 2024-09-14T09:08:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1479999999999999e-06 2024-09-14T09:08:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796967+0000", 2024-09-14T09:08:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1499999999999998e-06 2024-09-14T09:08:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:08:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-06 2024-09-14T09:08:36.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798688+0000", 2024-09-14T09:08:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017172660000000001 2024-09-14T09:08:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798691+0000", 2024-09-14T09:08:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:08:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789599+0000", 2024-09-14T09:08:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99090839399999997 2024-09-14T09:08:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789716+0000", 2024-09-14T09:08:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116474 2024-09-14T09:08:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789828+0000", 2024-09-14T09:08:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112293 2024-09-14T09:08:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:230 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1277952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:08:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3071941430000003, 2024-09-14T09:08:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99307501600000003, 2024-09-14T09:08:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 230 2024-09-14T09:08:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:08:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:08:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796979+0000", 2024-09-14T09:08:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.34e-07 2024-09-14T09:08:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796980+0000", 2024-09-14T09:08:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.53e-06 2024-09-14T09:08:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796986+0000", 2024-09-14T09:08:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9989999999999997e-06 2024-09-14T09:08:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796989+0000", 2024-09-14T09:08:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0340000000000001e-06 2024-09-14T09:08:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798702+0000", 2024-09-14T09:08:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001712756 2024-09-14T09:08:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798705+0000", 2024-09-14T09:08:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7750000000000001e-06 2024-09-14T09:08:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789870+0000", 2024-09-14T09:08:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991165026 2024-09-14T09:08:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789955+0000", 2024-09-14T09:08:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4839999999999994e-05 2024-09-14T09:08:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790053+0000", 2024-09-14T09:08:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8721999999999994e-05 2024-09-14T09:08:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:231 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:08:36.131 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3071788150000003, 2024-09-14T09:08:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99319130300000003, 2024-09-14T09:08:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 231 2024-09-14T09:08:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:08:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:08:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:08:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2024-09-14T09:08:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796995+0000", 2024-09-14T09:08:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2500000000000001e-06 2024-09-14T09:08:36.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796998+0000", 2024-09-14T09:08:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3230000000000002e-06 2024-09-14T09:08:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797001+0000", 2024-09-14T09:08:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7099999999999999e-06 2024-09-14T09:08:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798718+0000", 2024-09-14T09:08:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017168070000000001 2024-09-14T09:08:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798721+0000", 2024-09-14T09:08:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.853e-06 2024-09-14T09:08:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790077+0000", 2024-09-14T09:08:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991356393 2024-09-14T09:08:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790129+0000", 2024-09-14T09:08:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2240999999999997e-05 2024-09-14T09:08:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790185+0000", 2024-09-14T09:08:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5515e-05 2024-09-14T09:08:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:232 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2195456~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:36.136 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:08:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3071681589999997, 2024-09-14T09:08:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99329117899999997, 2024-09-14T09:08:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 232 2024-09-14T09:08:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:36.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:08:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:08:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797005+0000", 2024-09-14T09:08:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2024-09-14T09:08:36.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:36.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797006+0000", 2024-09-14T09:08:36.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3200000000000001e-06 2024-09-14T09:08:36.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:36.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797009+0000", 2024-09-14T09:08:36.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4680000000000001e-06 2024-09-14T09:08:36.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797012+0000", 2024-09-14T09:08:36.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4770000000000002e-06 2024-09-14T09:08:36.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798743+0000", 2024-09-14T09:08:36.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017312 2024-09-14T09:08:36.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:36.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798747+0000", 2024-09-14T09:08:36.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.484e-06 2024-09-14T09:08:36.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790201+0000", 2024-09-14T09:08:36.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99145419499999998 2024-09-14T09:08:36.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:36.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790241+0000", 2024-09-14T09:08:36.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0587999999999998e-05 2024-09-14T09:08:36.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:36.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790296+0000", 2024-09-14T09:08:36.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4212000000000002e-05 2024-09-14T09:08:36.142 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.142 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:36.142 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.142 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:233 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2654208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:36.142 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:08:36.142 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3071575360000001, 2024-09-14T09:08:36.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99337220100000001, 2024-09-14T09:08:36.142 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:36.142 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:36.143 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:36.143 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:36.143 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:36.143 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:36.143 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 233 2024-09-14T09:08:36.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.143 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:36.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:36.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:08:36.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:36.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:08:36.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:36.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:08:36.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:08:36.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:36.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:08:36.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.269e-06 2024-09-14T09:08:36.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:36.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797019+0000", 2024-09-14T09:08:36.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9519999999999999e-06 2024-09-14T09:08:36.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797022+0000", 2024-09-14T09:08:36.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6079999999999998e-06 2024-09-14T09:08:36.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798759+0000", 2024-09-14T09:08:36.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001737342 2024-09-14T09:08:36.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:36.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798762+0000", 2024-09-14T09:08:36.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:08:36.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790310+0000", 2024-09-14T09:08:36.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99154738799999997 2024-09-14T09:08:36.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:36.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790349+0000", 2024-09-14T09:08:36.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9573000000000002e-05 2024-09-14T09:08:36.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:36.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790387+0000", 2024-09-14T09:08:36.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7985999999999998e-05 2024-09-14T09:08:36.147 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.147 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:36.147 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.147 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:234 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3112960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:36.147 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:08:36.147 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3071474910000003, 2024-09-14T09:08:36.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99345674500000003, 2024-09-14T09:08:36.148 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:36.148 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:36.148 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:36.148 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:36.148 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:36.148 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:36.148 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 234 2024-09-14T09:08:36.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.148 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:36.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:36.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:08:36.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:36.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:08:36.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:36.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:08:36.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0100000000000001e-07 2024-09-14T09:08:36.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:36.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:36.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0699999999999999e-06 2024-09-14T09:08:36.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:36.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:08:36.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.886e-06 2024-09-14T09:08:36.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797032+0000", 2024-09-14T09:08:36.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7149999999999998e-06 2024-09-14T09:08:36.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798778+0000", 2024-09-14T09:08:36.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017460329999999999 2024-09-14T09:08:36.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:36.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798783+0000", 2024-09-14T09:08:36.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0760000000000002e-06 2024-09-14T09:08:36.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790408+0000", 2024-09-14T09:08:36.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99162473299999998 2024-09-14T09:08:36.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:36.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790446+0000", 2024-09-14T09:08:36.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8389000000000001e-05 2024-09-14T09:08:36.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:36.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790482+0000", 2024-09-14T09:08:36.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5642000000000002e-05 2024-09-14T09:08:36.152 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.152 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:36.153 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.153 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:235 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3571712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:36.153 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:08:36.153 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3071375930000002, 2024-09-14T09:08:36.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993539477, 2024-09-14T09:08:36.153 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:36.153 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:36.153 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:36.153 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:36.153 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:36.154 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:36.154 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 235 2024-09-14T09:08:36.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.154 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:36.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:36.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:08:36.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:36.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:08:36.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:36.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:08:36.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9999999999999999e-07 2024-09-14T09:08:36.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:36.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797036+0000", 2024-09-14T09:08:36.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.051e-06 2024-09-14T09:08:36.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:36.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797039+0000", 2024-09-14T09:08:36.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:08:36.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797042+0000", 2024-09-14T09:08:36.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5280000000000002e-06 2024-09-14T09:08:36.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798809+0000", 2024-09-14T09:08:36.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001767394 2024-09-14T09:08:36.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:36.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798815+0000", 2024-09-14T09:08:36.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0859999999999998e-06 2024-09-14T09:08:36.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790502+0000", 2024-09-14T09:08:36.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99168652300000004 2024-09-14T09:08:36.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:36.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790539+0000", 2024-09-14T09:08:36.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7471000000000001e-05 2024-09-14T09:08:36.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:36.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790574+0000", 2024-09-14T09:08:36.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5292e-05 2024-09-14T09:08:36.158 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.158 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:36.158 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.158 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:236 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 4030464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:36.158 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:08:36.158 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.30712736, 2024-09-14T09:08:36.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993619743, 2024-09-14T09:08:36.158 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:36.159 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:36.159 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:36.159 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:36.159 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:36.159 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:36.159 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 236 2024-09-14T09:08:36.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.159 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:36.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:36.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:08:36.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:36.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:08:36.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:36.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:08:36.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1400000000000001e-07 2024-09-14T09:08:36.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:36.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797047+0000", 2024-09-14T09:08:36.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3400000000000001e-06 2024-09-14T09:08:36.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:36.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:08:36.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0699999999999998e-06 2024-09-14T09:08:36.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797053+0000", 2024-09-14T09:08:36.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7310000000000002e-06 2024-09-14T09:08:36.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798839+0000", 2024-09-14T09:08:36.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001786403 2024-09-14T09:08:36.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:36.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798844+0000", 2024-09-14T09:08:36.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3730000000000001e-06 2024-09-14T09:08:36.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790592+0000", 2024-09-14T09:08:36.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99174818099999995 2024-09-14T09:08:36.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:36.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790628+0000", 2024-09-14T09:08:36.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5831000000000003e-05 2024-09-14T09:08:36.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:36.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790665+0000", 2024-09-14T09:08:36.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-05 2024-09-14T09:08:36.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.163 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:36.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.163 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:365 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:36.163 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:08:36.163 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3049403320000001, 2024-09-14T09:08:36.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157278400000004, 2024-09-14T09:08:36.164 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:36.164 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:36.164 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:36.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:36.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:36.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:36.164 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 365 2024-09-14T09:08:36.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.164 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:36.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:36.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:08:36.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:36.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:08:36.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:36.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:08:36.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:08:36.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:36.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799233+0000", 2024-09-14T09:08:36.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.057e-06 2024-09-14T09:08:36.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:36.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799236+0000", 2024-09-14T09:08:36.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0249999999999998e-06 2024-09-14T09:08:36.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799239+0000", 2024-09-14T09:08:36.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.481e-06 2024-09-14T09:08:36.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800963+0000", 2024-09-14T09:08:36.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017240440000000001 2024-09-14T09:08:36.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:36.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800969+0000", 2024-09-14T09:08:36.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1410000000000002e-06 2024-09-14T09:08:36.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790682+0000", 2024-09-14T09:08:36.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98971330300000004 2024-09-14T09:08:36.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:36.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790753+0000", 2024-09-14T09:08:36.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0548000000000003e-05 2024-09-14T09:08:36.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:36.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790805+0000", 2024-09-14T09:08:36.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1981999999999998e-05 2024-09-14T09:08:36.168 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.168 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:36.168 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.168 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:366 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:36.168 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:08:36.169 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3049302389999999, 2024-09-14T09:08:36.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99173757299999998, 2024-09-14T09:08:36.169 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:36.169 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:36.169 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:36.169 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:36.169 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:36.169 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:36.169 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 366 2024-09-14T09:08:36.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.169 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:36.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:36.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:08:36.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:36.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:08:36.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:36.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:08:36.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-07 2024-09-14T09:08:36.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:36.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799244+0000", 2024-09-14T09:08:36.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.359e-06 2024-09-14T09:08:36.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:36.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799247+0000", 2024-09-14T09:08:36.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4929999999999998e-06 2024-09-14T09:08:36.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799250+0000", 2024-09-14T09:08:36.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:08:36.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800991+0000", 2024-09-14T09:08:36.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017412809999999999 2024-09-14T09:08:36.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:36.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800997+0000", 2024-09-14T09:08:36.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:08:36.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790824+0000", 2024-09-14T09:08:36.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98982735399999999 2024-09-14T09:08:36.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:36.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790891+0000", 2024-09-14T09:08:36.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7243999999999995e-05 2024-09-14T09:08:36.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:36.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790980+0000", 2024-09-14T09:08:36.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8608000000000003e-05 2024-09-14T09:08:36.173 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.173 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:36.173 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.173 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:367 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:36.173 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:08:36.173 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3049188669999996, 2024-09-14T09:08:36.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99188259999999995, 2024-09-14T09:08:36.174 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:36.174 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:36.174 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:36.174 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:36.174 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:36.174 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:36.174 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 367 2024-09-14T09:08:36.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.174 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:36.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:36.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:08:36.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:36.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:08:36.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:36.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:08:36.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-07 2024-09-14T09:08:36.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:36.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799255+0000", 2024-09-14T09:08:36.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.111e-06 2024-09-14T09:08:36.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:36.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799259+0000", 2024-09-14T09:08:36.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8650000000000003e-06 2024-09-14T09:08:36.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799262+0000", 2024-09-14T09:08:36.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.128e-06 2024-09-14T09:08:36.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801029+0000", 2024-09-14T09:08:36.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017668460000000001 2024-09-14T09:08:36.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:36.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801032+0000", 2024-09-14T09:08:36.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3179999999999998e-06 2024-09-14T09:08:36.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791011+0000", 2024-09-14T09:08:36.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98997920399999995 2024-09-14T09:08:36.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791077+0000", 2024-09-14T09:08:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5214000000000003e-05 2024-09-14T09:08:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791136+0000", 2024-09-14T09:08:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9710000000000003e-05 2024-09-14T09:08:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:368 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:08:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3049073240000002, 2024-09-14T09:08:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99201753800000003, 2024-09-14T09:08:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 368 2024-09-14T09:08:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:36.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:08:36.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:36.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:08:36.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:36.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:08:36.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4900000000000002e-07 2024-09-14T09:08:36.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:36.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799267+0000", 2024-09-14T09:08:36.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.079e-06 2024-09-14T09:08:36.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:36.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799270+0000", 2024-09-14T09:08:36.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.993e-06 2024-09-14T09:08:36.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799272+0000", 2024-09-14T09:08:36.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.695e-06 2024-09-14T09:08:36.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801043+0000", 2024-09-14T09:08:36.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001771105 2024-09-14T09:08:36.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:36.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801046+0000", 2024-09-14T09:08:36.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7999999999999999e-06 2024-09-14T09:08:36.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791150+0000", 2024-09-14T09:08:36.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99010348699999995 2024-09-14T09:08:36.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:36.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791193+0000", 2024-09-14T09:08:36.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3615999999999997e-05 2024-09-14T09:08:36.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:36.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791283+0000", 2024-09-14T09:08:36.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9513999999999997e-05 2024-09-14T09:08:36.183 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.184 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:36.184 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.184 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:369 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:36.184 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:08:36.184 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3048969860000001, 2024-09-14T09:08:36.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99213433600000001, 2024-09-14T09:08:36.184 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:36.184 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:36.184 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:36.184 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:36.184 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:36.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:36.185 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 369 2024-09-14T09:08:36.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.185 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:36.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:36.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:08:36.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:36.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:08:36.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:36.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:08:36.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:08:36.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:36.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799277+0000", 2024-09-14T09:08:36.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.108e-06 2024-09-14T09:08:36.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:36.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799280+0000", 2024-09-14T09:08:36.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:08:36.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799283+0000", 2024-09-14T09:08:36.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.531e-06 2024-09-14T09:08:36.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801058+0000", 2024-09-14T09:08:36.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001775085 2024-09-14T09:08:36.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:36.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801060+0000", 2024-09-14T09:08:36.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8260000000000001e-06 2024-09-14T09:08:36.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791299+0000", 2024-09-14T09:08:36.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99023856799999999 2024-09-14T09:08:36.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:36.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791352+0000", 2024-09-14T09:08:36.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2528000000000003e-05 2024-09-14T09:08:36.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:36.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791410+0000", 2024-09-14T09:08:36.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8298000000000003e-05 2024-09-14T09:08:36.189 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.189 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:36.189 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.189 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:370 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2457600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:36.189 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:08:36.189 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3048722189999999, 2024-09-14T09:08:36.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99220795399999995, 2024-09-14T09:08:36.190 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:36.190 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:36.190 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:36.190 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:36.190 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:36.190 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:36.190 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 370 2024-09-14T09:08:36.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.190 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:36.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:36.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:08:36.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:36.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:08:36.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:36.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799301+0000", 2024-09-14T09:08:36.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2024-09-14T09:08:36.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:36.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799303+0000", 2024-09-14T09:08:36.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9319999999999999e-06 2024-09-14T09:08:36.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:36.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799310+0000", 2024-09-14T09:08:36.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8680000000000001e-06 2024-09-14T09:08:36.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799315+0000", 2024-09-14T09:08:36.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.921e-06 2024-09-14T09:08:36.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801071+0000", 2024-09-14T09:08:36.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001756678 2024-09-14T09:08:36.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:36.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801080+0000", 2024-09-14T09:08:36.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6060000000000003e-06 2024-09-14T09:08:36.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791429+0000", 2024-09-14T09:08:36.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99034944599999997 2024-09-14T09:08:36.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:36.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791471+0000", 2024-09-14T09:08:36.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1279999999999998e-05 2024-09-14T09:08:36.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:36.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791508+0000", 2024-09-14T09:08:36.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7663999999999997e-05 2024-09-14T09:08:36.194 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.194 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:36.194 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.195 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:371 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2916352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:36.195 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:08:36.195 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3048510469999997, 2024-09-14T09:08:36.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99228692299999999, 2024-09-14T09:08:36.195 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:36.195 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:36.195 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:36.195 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:36.195 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:36.195 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:36.195 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 371 2024-09-14T09:08:36.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.195 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:36.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:36.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:08:36.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:36.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:08:36.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:36.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799322+0000", 2024-09-14T09:08:36.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:08:36.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:36.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799333+0000", 2024-09-14T09:08:36.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1044e-05 2024-09-14T09:08:36.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:36.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799341+0000", 2024-09-14T09:08:36.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8439999999999998e-06 2024-09-14T09:08:36.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799354+0000", 2024-09-14T09:08:36.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3114e-05 2024-09-14T09:08:36.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801093+0000", 2024-09-14T09:08:36.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017385910000000001 2024-09-14T09:08:36.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:36.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801096+0000", 2024-09-14T09:08:36.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0680000000000001e-06 2024-09-14T09:08:36.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791528+0000", 2024-09-14T09:08:36.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99043264200000003 2024-09-14T09:08:36.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:36.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791570+0000", 2024-09-14T09:08:36.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2144999999999997e-05 2024-09-14T09:08:36.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:36.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791608+0000", 2024-09-14T09:08:36.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7966000000000002e-05 2024-09-14T09:08:36.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.199 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:36.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.200 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:372 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3375104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:36.200 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:08:36.200 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3048104990000002, 2024-09-14T09:08:36.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992342897, 2024-09-14T09:08:36.200 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:36.200 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:36.200 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:36.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:36.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:36.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:36.200 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 372 2024-09-14T09:08:36.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.201 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:36.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:36.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:08:36.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:36.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:08:36.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:36.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799363+0000", 2024-09-14T09:08:36.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2024-09-14T09:08:36.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:36.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799365+0000", 2024-09-14T09:08:36.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5500000000000001e-06 2024-09-14T09:08:36.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:36.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799371+0000", 2024-09-14T09:08:36.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2500000000000003e-06 2024-09-14T09:08:36.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799377+0000", 2024-09-14T09:08:36.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7509999999999997e-06 2024-09-14T09:08:36.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801107+0000", 2024-09-14T09:08:36.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017298019999999999 2024-09-14T09:08:36.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:36.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801111+0000", 2024-09-14T09:08:36.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8619999999999996e-06 2024-09-14T09:08:36.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791626+0000", 2024-09-14T09:08:36.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99051563300000001 2024-09-14T09:08:36.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:36.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791668+0000", 2024-09-14T09:08:36.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1424000000000002e-05 2024-09-14T09:08:36.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:36.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791705+0000", 2024-09-14T09:08:36.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7035e-05 2024-09-14T09:08:36.204 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.204 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:36.204 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.205 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:373 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:36.205 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:08:36.205 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3047885539999999, 2024-09-14T09:08:36.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99253589399999997, 2024-09-14T09:08:36.205 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:36.205 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:36.205 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:36.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:36.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:36.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:36.205 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 373 2024-09-14T09:08:36.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.205 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:36.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:36.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:08:36.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:36.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:08:36.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:36.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:36.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:08:36.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2024-09-14T09:08:36.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:36.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799387+0000", 2024-09-14T09:08:36.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1019999999999999e-06 2024-09-14T09:08:36.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:36.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799393+0000", 2024-09-14T09:08:36.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0190000000000003e-06 2024-09-14T09:08:36.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799398+0000", 2024-09-14T09:08:36.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:08:36.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801123+0000", 2024-09-14T09:08:36.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017251949999999999 2024-09-14T09:08:36.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:36.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801126+0000", 2024-09-14T09:08:36.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9280000000000002e-06 2024-09-14T09:08:36.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:36.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791746+0000", 2024-09-14T09:08:36.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99062036899999995 2024-09-14T09:08:36.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:36.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791835+0000", 2024-09-14T09:08:36.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9004000000000004e-05 2024-09-14T09:08:36.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:36.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:36.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:36.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791920+0000", 2024-09-14T09:08:36.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4524000000000006e-05 2024-09-14T09:08:36.209 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.209 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:36.209 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.210 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:36.210 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:36.210 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:36.211 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:36.212+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:36.212 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:08:36.311 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:36.312+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:36.321 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:36.322 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:36.322 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:08:36.322 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:36.330 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:08:36.414 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:36.415+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:36.474 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:36.474 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:36.474 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:36.474 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:36.474 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:36.482 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:08:36.523 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:36.525+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:36.614 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #20, image image_client.0-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent21 2024-09-14T09:08:36.615 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:36.617+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:36.630 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:36.630 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:36.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:36.630 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:36.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.630 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7729 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 110592~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:36.630 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030100+0000", 2024-09-14T09:08:36.630 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.601364631999999, 2024-09-14T09:08:36.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.063698092999999997, 2024-09-14T09:08:36.631 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.631 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.631 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:36.631 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.631 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:36.631 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:36.631 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7729 2024-09-14T09:08:36.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.631 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030100+0000", 2024-09-14T09:08:36.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030100+0000", 2024-09-14T09:08:36.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030100+0000", 2024-09-14T09:08:36.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:08:36.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030102+0000", 2024-09-14T09:08:36.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7680000000000001e-06 2024-09-14T09:08:36.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030108+0000", 2024-09-14T09:08:36.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3779999999999998e-06 2024-09-14T09:08:36.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030113+0000", 2024-09-14T09:08:36.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1220000000000003e-06 2024-09-14T09:08:36.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:36.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.093499+0000", 2024-09-14T09:08:36.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.063385996 2024-09-14T09:08:36.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:36.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.093586+0000", 2024-09-14T09:08:36.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6998999999999998e-05 2024-09-14T09:08:36.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:36.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.093798+0000", 2024-09-14T09:08:36.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021145499999999999 2024-09-14T09:08:36.635 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.635 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.635 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.635 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7730 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 120832~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:36.635 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030120+0000", 2024-09-14T09:08:36.635 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.601344638, 2024-09-14T09:08:36.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064066104999999998, 2024-09-14T09:08:36.635 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.635 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.635 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:36.635 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.635 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:36.636 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:36.636 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7730 2024-09-14T09:08:36.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.636 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030120+0000", 2024-09-14T09:08:36.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030120+0000", 2024-09-14T09:08:36.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030120+0000", 2024-09-14T09:08:36.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9200000000000002e-07 2024-09-14T09:08:36.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030122+0000", 2024-09-14T09:08:36.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.798e-06 2024-09-14T09:08:36.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030130+0000", 2024-09-14T09:08:36.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7510000000000008e-06 2024-09-14T09:08:36.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030135+0000", 2024-09-14T09:08:36.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1769999999999997e-06 2024-09-14T09:08:36.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:36.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.093839+0000", 2024-09-14T09:08:36.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.063704574 2024-09-14T09:08:36.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:36.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.093932+0000", 2024-09-14T09:08:36.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2119000000000004e-05 2024-09-14T09:08:36.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:36.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094186+0000", 2024-09-14T09:08:36.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025429400000000002 2024-09-14T09:08:36.639 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.639 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.639 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.639 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7731 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 147456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:36.639 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030142+0000", 2024-09-14T09:08:36.640 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.601322791000001, 2024-09-14T09:08:36.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064431020000000006, 2024-09-14T09:08:36.640 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.640 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.640 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:36.640 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.640 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:36.640 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:36.640 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7731 2024-09-14T09:08:36.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.640 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030142+0000", 2024-09-14T09:08:36.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030142+0000", 2024-09-14T09:08:36.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030142+0000", 2024-09-14T09:08:36.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2300000000000002e-07 2024-09-14T09:08:36.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030144+0000", 2024-09-14T09:08:36.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9e-06 2024-09-14T09:08:36.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030151+0000", 2024-09-14T09:08:36.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6000000000000003e-06 2024-09-14T09:08:36.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030156+0000", 2024-09-14T09:08:36.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9960000000000001e-06 2024-09-14T09:08:36.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:36.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094250+0000", 2024-09-14T09:08:36.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064094715999999996 2024-09-14T09:08:36.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:36.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094329+0000", 2024-09-14T09:08:36.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8812000000000004e-05 2024-09-14T09:08:36.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:36.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094573+0000", 2024-09-14T09:08:36.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024357299999999999 2024-09-14T09:08:36.644 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.644 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.644 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.644 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7732 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 157696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:36.644 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030162+0000", 2024-09-14T09:08:36.644 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.601302540999999, 2024-09-14T09:08:36.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064786951999999995, 2024-09-14T09:08:36.645 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.645 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.645 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:36.645 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.645 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:36.645 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:36.645 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7732 2024-09-14T09:08:36.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.645 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030162+0000", 2024-09-14T09:08:36.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030162+0000", 2024-09-14T09:08:36.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030162+0000", 2024-09-14T09:08:36.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.03e-07 2024-09-14T09:08:36.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030164+0000", 2024-09-14T09:08:36.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7e-06 2024-09-14T09:08:36.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030170+0000", 2024-09-14T09:08:36.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1369999999999999e-06 2024-09-14T09:08:36.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030182+0000", 2024-09-14T09:08:36.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1989e-05 2024-09-14T09:08:36.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:36.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094614+0000", 2024-09-14T09:08:36.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064431863000000006 2024-09-14T09:08:36.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:36.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094703+0000", 2024-09-14T09:08:36.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9021e-05 2024-09-14T09:08:36.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:36.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094949+0000", 2024-09-14T09:08:36.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024583899999999998 2024-09-14T09:08:36.648 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.648 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.649 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.649 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7733 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 167936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:36.649 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030194+0000", 2024-09-14T09:08:36.649 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.601270264, 2024-09-14T09:08:36.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065137113999999996, 2024-09-14T09:08:36.649 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.649 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.649 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:36.649 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.649 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:36.649 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:36.650 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7733 2024-09-14T09:08:36.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.650 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030194+0000", 2024-09-14T09:08:36.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030194+0000", 2024-09-14T09:08:36.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030195+0000", 2024-09-14T09:08:36.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:08:36.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030207+0000", 2024-09-14T09:08:36.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2452999999999999e-05 2024-09-14T09:08:36.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030218+0000", 2024-09-14T09:08:36.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1035e-05 2024-09-14T09:08:36.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030224+0000", 2024-09-14T09:08:36.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7100000000000004e-06 2024-09-14T09:08:36.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:36.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.094993+0000", 2024-09-14T09:08:36.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064769312999999995 2024-09-14T09:08:36.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:36.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.095089+0000", 2024-09-14T09:08:36.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5768999999999997e-05 2024-09-14T09:08:36.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:36.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.095331+0000", 2024-09-14T09:08:36.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000242372 2024-09-14T09:08:36.653 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.653 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.653 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.653 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7734 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:36.653 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030232+0000", 2024-09-14T09:08:36.653 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.601231951999999, 2024-09-14T09:08:36.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065430487999999995, 2024-09-14T09:08:36.654 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.654 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.654 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:36.654 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.654 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:36.654 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:36.654 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7734 2024-09-14T09:08:36.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.654 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030232+0000", 2024-09-14T09:08:36.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030232+0000", 2024-09-14T09:08:36.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030233+0000", 2024-09-14T09:08:36.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0200000000000002e-07 2024-09-14T09:08:36.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030235+0000", 2024-09-14T09:08:36.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0669999999999999e-06 2024-09-14T09:08:36.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030242+0000", 2024-09-14T09:08:36.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6229999999999999e-06 2024-09-14T09:08:36.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030247+0000", 2024-09-14T09:08:36.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0969999999999996e-06 2024-09-14T09:08:36.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:36.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.095374+0000", 2024-09-14T09:08:36.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065127510999999999 2024-09-14T09:08:36.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:36.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.095464+0000", 2024-09-14T09:08:36.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0214000000000001e-05 2024-09-14T09:08:36.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:36.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.095663+0000", 2024-09-14T09:08:36.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000198474 2024-09-14T09:08:36.657 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.657 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.657 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.658 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7735 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 204800~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:36.658 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030253+0000", 2024-09-14T09:08:36.658 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.601211111000001, 2024-09-14T09:08:36.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065785715999999994, 2024-09-14T09:08:36.658 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.658 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.658 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:36.658 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.658 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:36.658 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:36.658 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7735 2024-09-14T09:08:36.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.658 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030253+0000", 2024-09-14T09:08:36.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030253+0000", 2024-09-14T09:08:36.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030637+0000", 2024-09-14T09:08:36.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038390100000000002 2024-09-14T09:08:36.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030641+0000", 2024-09-14T09:08:36.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5300000000000001e-06 2024-09-14T09:08:36.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030657+0000", 2024-09-14T09:08:36.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6390000000000001e-05 2024-09-14T09:08:36.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030665+0000", 2024-09-14T09:08:36.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5129999999999999e-06 2024-09-14T09:08:36.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:36.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.095704+0000", 2024-09-14T09:08:36.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065039447 2024-09-14T09:08:36.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:36.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.095791+0000", 2024-09-14T09:08:36.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6835000000000005e-05 2024-09-14T09:08:36.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:36.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096039+0000", 2024-09-14T09:08:36.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024810000000000001 2024-09-14T09:08:36.662 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.662 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.662 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.662 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7736 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:36.662 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030685+0000", 2024-09-14T09:08:36.662 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.600779884000001, 2024-09-14T09:08:36.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065670936999999999, 2024-09-14T09:08:36.662 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.662 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.663 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:36.663 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.663 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:36.663 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:36.663 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7736 2024-09-14T09:08:36.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.663 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030685+0000", 2024-09-14T09:08:36.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030685+0000", 2024-09-14T09:08:36.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030685+0000", 2024-09-14T09:08:36.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4799999999999998e-07 2024-09-14T09:08:36.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030688+0000", 2024-09-14T09:08:36.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6400000000000001e-06 2024-09-14T09:08:36.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030695+0000", 2024-09-14T09:08:36.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6350000000000006e-06 2024-09-14T09:08:36.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030736+0000", 2024-09-14T09:08:36.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0932e-05 2024-09-14T09:08:36.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:36.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096080+0000", 2024-09-14T09:08:36.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065344019000000003 2024-09-14T09:08:36.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:36.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096169+0000", 2024-09-14T09:08:36.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9031999999999997e-05 2024-09-14T09:08:36.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:36.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096355+0000", 2024-09-14T09:08:36.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186131 2024-09-14T09:08:36.666 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.666 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.666 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.667 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7737 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 225280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:36.667 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030748+0000", 2024-09-14T09:08:36.667 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.600716747, 2024-09-14T09:08:36.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065915538999999995, 2024-09-14T09:08:36.667 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.667 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.667 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:36.667 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.667 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:36.667 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:36.667 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7737 2024-09-14T09:08:36.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.667 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030748+0000", 2024-09-14T09:08:36.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030748+0000", 2024-09-14T09:08:36.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030748+0000", 2024-09-14T09:08:36.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9100000000000004e-07 2024-09-14T09:08:36.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030751+0000", 2024-09-14T09:08:36.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.661e-06 2024-09-14T09:08:36.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030759+0000", 2024-09-14T09:08:36.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9270000000000005e-06 2024-09-14T09:08:36.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030765+0000", 2024-09-14T09:08:36.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.75e-06 2024-09-14T09:08:36.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:36.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096389+0000", 2024-09-14T09:08:36.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065624403999999997 2024-09-14T09:08:36.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:36.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096476+0000", 2024-09-14T09:08:36.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6625999999999994e-05 2024-09-14T09:08:36.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:36.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096663+0000", 2024-09-14T09:08:36.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018757999999999999 2024-09-14T09:08:36.671 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.671 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.671 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.671 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7738 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 235520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:36.671 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.030772+0000", 2024-09-14T09:08:36.671 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.600692380000002, 2024-09-14T09:08:36.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.066203479999999995, 2024-09-14T09:08:36.671 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.671 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.671 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:36.671 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.671 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:36.672 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:36.672 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7738 2024-09-14T09:08:36.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.672 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030772+0000", 2024-09-14T09:08:36.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030772+0000", 2024-09-14T09:08:36.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030772+0000", 2024-09-14T09:08:36.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3000000000000001e-07 2024-09-14T09:08:36.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030775+0000", 2024-09-14T09:08:36.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0930000000000001e-06 2024-09-14T09:08:36.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030782+0000", 2024-09-14T09:08:36.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9600000000000003e-06 2024-09-14T09:08:36.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.030787+0000", 2024-09-14T09:08:36.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4670000000000003e-06 2024-09-14T09:08:36.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:36.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096696+0000", 2024-09-14T09:08:36.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065909258999999998 2024-09-14T09:08:36.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:36.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096785+0000", 2024-09-14T09:08:36.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8931000000000006e-05 2024-09-14T09:08:36.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:36.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.096976+0000", 2024-09-14T09:08:36.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019034 2024-09-14T09:08:36.675 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.675 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.675 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.675 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7913 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 139264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:36.675 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041493+0000", 2024-09-14T09:08:36.675 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.589971737999999, 2024-09-14T09:08:36.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.063885727000000003, 2024-09-14T09:08:36.676 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.676 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.676 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:36.676 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.676 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:36.676 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:36.676 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7913 2024-09-14T09:08:36.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.676 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041493+0000", 2024-09-14T09:08:36.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041493+0000", 2024-09-14T09:08:36.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041493+0000", 2024-09-14T09:08:36.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9299999999999999e-07 2024-09-14T09:08:36.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041494+0000", 2024-09-14T09:08:36.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0279999999999999e-06 2024-09-14T09:08:36.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041497+0000", 2024-09-14T09:08:36.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.039e-06 2024-09-14T09:08:36.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041500+0000", 2024-09-14T09:08:36.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8059999999999999e-06 2024-09-14T09:08:36.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:36.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105044+0000", 2024-09-14T09:08:36.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.063544426000000001 2024-09-14T09:08:36.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:36.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105126+0000", 2024-09-14T09:08:36.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1565999999999998e-05 2024-09-14T09:08:36.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:36.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105378+0000", 2024-09-14T09:08:36.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025256900000000001 2024-09-14T09:08:36.679 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.679 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.679 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.680 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7914 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 149504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:36.680 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041505+0000", 2024-09-14T09:08:36.680 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.589959826000001, 2024-09-14T09:08:36.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064171309999999995, 2024-09-14T09:08:36.680 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.680 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.680 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:36.680 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.680 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:36.680 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:36.680 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7914 2024-09-14T09:08:36.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.681 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041505+0000", 2024-09-14T09:08:36.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041505+0000", 2024-09-14T09:08:36.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041505+0000", 2024-09-14T09:08:36.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8500000000000002e-07 2024-09-14T09:08:36.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041507+0000", 2024-09-14T09:08:36.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.654e-06 2024-09-14T09:08:36.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041512+0000", 2024-09-14T09:08:36.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4709999999999998e-06 2024-09-14T09:08:36.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041516+0000", 2024-09-14T09:08:36.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1339999999999997e-06 2024-09-14T09:08:36.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:36.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105410+0000", 2024-09-14T09:08:36.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.063894216000000004 2024-09-14T09:08:36.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:36.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105489+0000", 2024-09-14T09:08:36.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9152000000000004e-05 2024-09-14T09:08:36.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:36.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105676+0000", 2024-09-14T09:08:36.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000186398 2024-09-14T09:08:36.684 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.684 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.684 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.684 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7915 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:36.684 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041522+0000", 2024-09-14T09:08:36.684 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.589942473000001, 2024-09-14T09:08:36.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064491719000000003, 2024-09-14T09:08:36.685 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.685 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.685 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:36.685 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.685 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:36.685 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:36.685 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7915 2024-09-14T09:08:36.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.685 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041522+0000", 2024-09-14T09:08:36.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041522+0000", 2024-09-14T09:08:36.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041522+0000", 2024-09-14T09:08:36.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1600000000000002e-07 2024-09-14T09:08:36.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041524+0000", 2024-09-14T09:08:36.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.812e-06 2024-09-14T09:08:36.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041530+0000", 2024-09-14T09:08:36.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8579999999999996e-06 2024-09-14T09:08:36.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041534+0000", 2024-09-14T09:08:36.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5430000000000004e-06 2024-09-14T09:08:36.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:36.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105723+0000", 2024-09-14T09:08:36.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064188532000000006 2024-09-14T09:08:36.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:36.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.105809+0000", 2024-09-14T09:08:36.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6098000000000001e-05 2024-09-14T09:08:36.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:36.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.106014+0000", 2024-09-14T09:08:36.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020456000000000001 2024-09-14T09:08:36.688 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.688 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.688 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.689 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7916 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 169984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:36.689 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041540+0000", 2024-09-14T09:08:36.689 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.589924023999998, 2024-09-14T09:08:36.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064847347999999999, 2024-09-14T09:08:36.689 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.689 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.689 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:36.689 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.689 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:36.689 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:36.689 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7916 2024-09-14T09:08:36.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.690 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041540+0000", 2024-09-14T09:08:36.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041540+0000", 2024-09-14T09:08:36.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041541+0000", 2024-09-14T09:08:36.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.58e-07 2024-09-14T09:08:36.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041543+0000", 2024-09-14T09:08:36.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.902e-06 2024-09-14T09:08:36.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041549+0000", 2024-09-14T09:08:36.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6889999999999998e-06 2024-09-14T09:08:36.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041554+0000", 2024-09-14T09:08:36.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5709999999999999e-06 2024-09-14T09:08:36.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:36.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.106058+0000", 2024-09-14T09:08:36.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064504051000000007 2024-09-14T09:08:36.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:36.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.106141+0000", 2024-09-14T09:08:36.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3294000000000006e-05 2024-09-14T09:08:36.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:36.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.106388+0000", 2024-09-14T09:08:36.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024648299999999998 2024-09-14T09:08:36.693 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.693 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.693 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.693 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7917 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 196608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:36.693 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041560+0000", 2024-09-14T09:08:36.693 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.589904878999999, 2024-09-14T09:08:36.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065539221999999994, 2024-09-14T09:08:36.693 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.693 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.694 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:36.694 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.694 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:36.694 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:36.694 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7917 2024-09-14T09:08:36.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.694 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041560+0000", 2024-09-14T09:08:36.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041560+0000", 2024-09-14T09:08:36.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041560+0000", 2024-09-14T09:08:36.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2399999999999999e-07 2024-09-14T09:08:36.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041562+0000", 2024-09-14T09:08:36.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8309999999999999e-06 2024-09-14T09:08:36.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041567+0000", 2024-09-14T09:08:36.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7699999999999998e-06 2024-09-14T09:08:36.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041572+0000", 2024-09-14T09:08:36.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4870000000000004e-06 2024-09-14T09:08:36.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:36.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.106431+0000", 2024-09-14T09:08:36.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.064858964000000005 2024-09-14T09:08:36.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:36.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.106513+0000", 2024-09-14T09:08:36.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1848000000000006e-05 2024-09-14T09:08:36.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:36.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107099+0000", 2024-09-14T09:08:36.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058599800000000001 2024-09-14T09:08:36.697 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.697 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.697 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.698 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7918 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 206848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:36.698 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041577+0000", 2024-09-14T09:08:36.698 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.589887232999999, 2024-09-14T09:08:36.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065838946999999995, 2024-09-14T09:08:36.698 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.698 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.698 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:36.698 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.698 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:36.698 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:36.698 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7918 2024-09-14T09:08:36.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.698 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041577+0000", 2024-09-14T09:08:36.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041577+0000", 2024-09-14T09:08:36.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041578+0000", 2024-09-14T09:08:36.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-07 2024-09-14T09:08:36.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041579+0000", 2024-09-14T09:08:36.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7230000000000001e-06 2024-09-14T09:08:36.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041585+0000", 2024-09-14T09:08:36.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.767e-06 2024-09-14T09:08:36.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041589+0000", 2024-09-14T09:08:36.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.25e-06 2024-09-14T09:08:36.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:36.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107152+0000", 2024-09-14T09:08:36.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065563064000000004 2024-09-14T09:08:36.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:36.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107232+0000", 2024-09-14T09:08:36.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0019999999999996e-05 2024-09-14T09:08:36.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:36.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107416+0000", 2024-09-14T09:08:36.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018376800000000001 2024-09-14T09:08:36.702 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.702 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.702 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.702 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7919 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:36.702 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041595+0000", 2024-09-14T09:08:36.702 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.589869843999999, 2024-09-14T09:08:36.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.066135688999999998, 2024-09-14T09:08:36.702 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.702 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.702 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:36.702 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.703 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:36.703 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:36.703 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7919 2024-09-14T09:08:36.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.703 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041595+0000", 2024-09-14T09:08:36.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041595+0000", 2024-09-14T09:08:36.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041595+0000", 2024-09-14T09:08:36.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7799999999999997e-07 2024-09-14T09:08:36.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041597+0000", 2024-09-14T09:08:36.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.832e-06 2024-09-14T09:08:36.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041602+0000", 2024-09-14T09:08:36.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2480000000000004e-06 2024-09-14T09:08:36.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041606+0000", 2024-09-14T09:08:36.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1330000000000001e-06 2024-09-14T09:08:36.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:36.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107455+0000", 2024-09-14T09:08:36.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.065849380999999998 2024-09-14T09:08:36.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:36.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107541+0000", 2024-09-14T09:08:36.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5648000000000004e-05 2024-09-14T09:08:36.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:36.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107730+0000", 2024-09-14T09:08:36.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018916899999999999 2024-09-14T09:08:36.706 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.706 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.706 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.706 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7920 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:36.706 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041612+0000", 2024-09-14T09:08:36.707 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.589852478000001, 2024-09-14T09:08:36.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.066948489999999999, 2024-09-14T09:08:36.707 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.707 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.707 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:36.707 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.707 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:36.707 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:36.707 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7920 2024-09-14T09:08:36.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.707 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041612+0000", 2024-09-14T09:08:36.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041612+0000", 2024-09-14T09:08:36.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041612+0000", 2024-09-14T09:08:36.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6100000000000002e-07 2024-09-14T09:08:36.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041614+0000", 2024-09-14T09:08:36.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0470000000000001e-06 2024-09-14T09:08:36.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041620+0000", 2024-09-14T09:08:36.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8359999999999997e-06 2024-09-14T09:08:36.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041634+0000", 2024-09-14T09:08:36.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3767e-05 2024-09-14T09:08:36.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:36.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107761+0000", 2024-09-14T09:08:36.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.066126943999999993 2024-09-14T09:08:36.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:36.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.107840+0000", 2024-09-14T09:08:36.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9042999999999995e-05 2024-09-14T09:08:36.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:36.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.108560+0000", 2024-09-14T09:08:36.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00072049199999999999 2024-09-14T09:08:36.710 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.711 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.711 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.711 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7921 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 253952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:36.711 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.041641+0000", 2024-09-14T09:08:36.711 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.589822957999999, 2024-09-14T09:08:36.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.067314309000000003, 2024-09-14T09:08:36.711 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.711 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.711 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:36.711 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.711 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:36.711 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:36.711 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7921 2024-09-14T09:08:36.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.712 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041641+0000", 2024-09-14T09:08:36.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041641+0000", 2024-09-14T09:08:36.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041642+0000", 2024-09-14T09:08:36.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8299999999999998e-07 2024-09-14T09:08:36.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041644+0000", 2024-09-14T09:08:36.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1059999999999998e-06 2024-09-14T09:08:36.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041652+0000", 2024-09-14T09:08:36.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6229999999999997e-06 2024-09-14T09:08:36.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.041656+0000", 2024-09-14T09:08:36.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8319999999999996e-06 2024-09-14T09:08:36.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:36.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.108597+0000", 2024-09-14T09:08:36.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.066941055999999999 2024-09-14T09:08:36.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:36.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.108682+0000", 2024-09-14T09:08:36.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4305e-05 2024-09-14T09:08:36.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:36.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.108956+0000", 2024-09-14T09:08:36.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000274004 2024-09-14T09:08:36.715 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.715 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.715 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.715 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:8013 3.b 3:d767b4fc:::rbd_data.11123620c885.0000000000000004:12 [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:36.715 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.042062+0000", 2024-09-14T09:08:36.715 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.589402279000002, 2024-09-14T09:08:36.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.067149147000000006, 2024-09-14T09:08:36.715 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.716 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.716 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:36.716 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.716 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:36.716 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:36.716 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 8013 2024-09-14T09:08:36.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.716 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.042062+0000", 2024-09-14T09:08:36.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.042062+0000", 2024-09-14T09:08:36.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.048211+0000", 2024-09-14T09:08:36.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061491269999999999 2024-09-14T09:08:36.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.048217+0000", 2024-09-14T09:08:36.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3600000000000004e-06 2024-09-14T09:08:36.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.048226+0000", 2024-09-14T09:08:36.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6670000000000008e-06 2024-09-14T09:08:36.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.048234+0000", 2024-09-14T09:08:36.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4749999999999996e-06 2024-09-14T09:08:36.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:36.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.109018+0000", 2024-09-14T09:08:36.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.060784670999999998 2024-09-14T09:08:36.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:36.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.109108+0000", 2024-09-14T09:08:36.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9222999999999996e-05 2024-09-14T09:08:36.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:36.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.109211+0000", 2024-09-14T09:08:36.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000103624 2024-09-14T09:08:36.719 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.719 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.719 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.719 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.719 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.719 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:36.721 INFO:teuthology.orchestra.run.smithi148.stdout:3496 write 0x115fa00 thru 0x116d774 (0xdd75 bytes) 2024-09-14T09:08:36.721 INFO:teuthology.orchestra.run.smithi148.stdout:3497 read 0x615a400 thru 0x615fa59 (0x565a bytes) 2024-09-14T09:08:36.721 INFO:teuthology.orchestra.run.smithi148.stdout:3498 trunc from 0xecd6400 to 0xaeae400 2024-09-14T09:08:36.722 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:08:36.722 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:36.721+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:36.821 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:36.822+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:36.851 INFO:teuthology.orchestra.run.smithi148.stdout:3500 write 0xe78e00 thru 0xe7da61 (0x4c62 bytes) 2024-09-14T09:08:36.853 INFO:teuthology.orchestra.run.smithi148.stdout:3501 punch from 0x94f0600 to 0x94fda00, (0xd400 bytes) 2024-09-14T09:08:36.924 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:36.924 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:36.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.924 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2559 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.924 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.868425+0000", 2024-09-14T09:08:36.924 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.039810709999999999, 2024-09-14T09:08:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039831349000000002, 2024-09-14T09:08:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2559 2024-09-14T09:08:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868425+0000", 2024-09-14T09:08:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868425+0000", 2024-09-14T09:08:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868551+0000", 2024-09-14T09:08:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012587300000000001 2024-09-14T09:08:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868556+0000", 2024-09-14T09:08:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8980000000000004e-06 2024-09-14T09:08:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868564+0000", 2024-09-14T09:08:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.49e-06 2024-09-14T09:08:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868571+0000", 2024-09-14T09:08:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.489e-06 2024-09-14T09:08:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2617 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.872370+0000", 2024-09-14T09:08:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.035865593000000001, 2024-09-14T09:08:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035941815000000002, 2024-09-14T09:08:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2617 2024-09-14T09:08:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872370+0000", 2024-09-14T09:08:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872370+0000", 2024-09-14T09:08:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872514+0000", 2024-09-14T09:08:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014403199999999999 2024-09-14T09:08:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872518+0000", 2024-09-14T09:08:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8139999999999998e-06 2024-09-14T09:08:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872527+0000", 2024-09-14T09:08:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2089999999999994e-06 2024-09-14T09:08:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872534+0000", 2024-09-14T09:08:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.443e-06 2024-09-14T09:08:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2649 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.876865+0000", 2024-09-14T09:08:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.031371031000000001, 2024-09-14T09:08:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.031496572, 2024-09-14T09:08:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2649 2024-09-14T09:08:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876865+0000", 2024-09-14T09:08:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876865+0000", 2024-09-14T09:08:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876980+0000", 2024-09-14T09:08:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000115438 2024-09-14T09:08:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876984+0000", 2024-09-14T09:08:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.613e-06 2024-09-14T09:08:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876995+0000", 2024-09-14T09:08:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1224e-05 2024-09-14T09:08:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.877003+0000", 2024-09-14T09:08:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7000000000000008e-06 2024-09-14T09:08:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2707 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.882814+0000", 2024-09-14T09:08:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.025421615000000002, 2024-09-14T09:08:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025594051, 2024-09-14T09:08:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2707 2024-09-14T09:08:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882814+0000", 2024-09-14T09:08:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882814+0000", 2024-09-14T09:08:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883025+0000", 2024-09-14T09:08:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021070600000000001 2024-09-14T09:08:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883029+0000", 2024-09-14T09:08:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5310000000000002e-06 2024-09-14T09:08:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883036+0000", 2024-09-14T09:08:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8860000000000004e-06 2024-09-14T09:08:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883042+0000", 2024-09-14T09:08:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2320000000000001e-06 2024-09-14T09:08:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2739 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.887756+0000", 2024-09-14T09:08:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.020480040000000001, 2024-09-14T09:08:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020699131999999999, 2024-09-14T09:08:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2739 2024-09-14T09:08:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887756+0000", 2024-09-14T09:08:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887756+0000", 2024-09-14T09:08:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890800+0000", 2024-09-14T09:08:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003044284 2024-09-14T09:08:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890805+0000", 2024-09-14T09:08:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.079e-06 2024-09-14T09:08:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890817+0000", 2024-09-14T09:08:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2119999999999999e-05 2024-09-14T09:08:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890831+0000", 2024-09-14T09:08:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3461999999999999e-05 2024-09-14T09:08:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2797 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.893175+0000", 2024-09-14T09:08:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.015061287, 2024-09-14T09:08:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015326726000000001, 2024-09-14T09:08:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2797 2024-09-14T09:08:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893175+0000", 2024-09-14T09:08:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893175+0000", 2024-09-14T09:08:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893277+0000", 2024-09-14T09:08:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000102527 2024-09-14T09:08:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893280+0000", 2024-09-14T09:08:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.599e-06 2024-09-14T09:08:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893285+0000", 2024-09-14T09:08:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0989999999999998e-06 2024-09-14T09:08:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893289+0000", 2024-09-14T09:08:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8550000000000004e-06 2024-09-14T09:08:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2829 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898981+0000", 2024-09-14T09:08:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0092546209999999993, 2024-09-14T09:08:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095646780000000001, 2024-09-14T09:08:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2829 2024-09-14T09:08:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898981+0000", 2024-09-14T09:08:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898981+0000", 2024-09-14T09:08:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898982+0000", 2024-09-14T09:08:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.35e-07 2024-09-14T09:08:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898983+0000", 2024-09-14T09:08:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0920000000000001e-06 2024-09-14T09:08:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898986+0000", 2024-09-14T09:08:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9500000000000001e-06 2024-09-14T09:08:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898988+0000", 2024-09-14T09:08:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4480000000000001e-06 2024-09-14T09:08:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2887 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.903500+0000", 2024-09-14T09:08:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0047358900000000004, 2024-09-14T09:08:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0050924259999999997, 2024-09-14T09:08:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2887 2024-09-14T09:08:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903500+0000", 2024-09-14T09:08:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903500+0000", 2024-09-14T09:08:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903717+0000", 2024-09-14T09:08:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021701000000000001 2024-09-14T09:08:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903722+0000", 2024-09-14T09:08:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5480000000000003e-06 2024-09-14T09:08:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903733+0000", 2024-09-14T09:08:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1216999999999999e-05 2024-09-14T09:08:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903740+0000", 2024-09-14T09:08:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0099999999999998e-06 2024-09-14T09:08:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2560 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.868583+0000", 2024-09-14T09:08:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.039652660999999999, 2024-09-14T09:08:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040056005999999998, 2024-09-14T09:08:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2560 2024-09-14T09:08:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868583+0000", 2024-09-14T09:08:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868583+0000", 2024-09-14T09:08:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868703+0000", 2024-09-14T09:08:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000119987 2024-09-14T09:08:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868706+0000", 2024-09-14T09:08:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.768e-06 2024-09-14T09:08:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868712+0000", 2024-09-14T09:08:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9619999999999998e-06 2024-09-14T09:08:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868716+0000", 2024-09-14T09:08:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1579999999999998e-06 2024-09-14T09:08:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2618 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.872546+0000", 2024-09-14T09:08:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.035690375000000003, 2024-09-14T09:08:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036143252000000001, 2024-09-14T09:08:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2618 2024-09-14T09:08:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872546+0000", 2024-09-14T09:08:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872546+0000", 2024-09-14T09:08:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872631+0000", 2024-09-14T09:08:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5224999999999998e-05 2024-09-14T09:08:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872634+0000", 2024-09-14T09:08:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4929999999999998e-06 2024-09-14T09:08:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872642+0000", 2024-09-14T09:08:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8259999999999993e-06 2024-09-14T09:08:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872648+0000", 2024-09-14T09:08:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.677e-06 2024-09-14T09:08:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2650 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.877014+0000", 2024-09-14T09:08:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.031222031000000001, 2024-09-14T09:08:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.031722594999999999, 2024-09-14T09:08:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2650 2024-09-14T09:08:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.877014+0000", 2024-09-14T09:08:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.877014+0000", 2024-09-14T09:08:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.877112+0000", 2024-09-14T09:08:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7653999999999997e-05 2024-09-14T09:08:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.877115+0000", 2024-09-14T09:08:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4400000000000001e-06 2024-09-14T09:08:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.877124+0000", 2024-09-14T09:08:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2809999999999997e-06 2024-09-14T09:08:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.877134+0000", 2024-09-14T09:08:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5899999999999997e-06 2024-09-14T09:08:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2708 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.883051+0000", 2024-09-14T09:08:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.025184475000000001, 2024-09-14T09:08:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025731211, 2024-09-14T09:08:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2708 2024-09-14T09:08:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883051+0000", 2024-09-14T09:08:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883051+0000", 2024-09-14T09:08:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883152+0000", 2024-09-14T09:08:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000100683 2024-09-14T09:08:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883160+0000", 2024-09-14T09:08:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9170000000000006e-06 2024-09-14T09:08:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883168+0000", 2024-09-14T09:08:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.712e-06 2024-09-14T09:08:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883178+0000", 2024-09-14T09:08:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0533000000000001e-05 2024-09-14T09:08:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2740 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.890845+0000", 2024-09-14T09:08:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017390501999999999, 2024-09-14T09:08:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017983216, 2024-09-14T09:08:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2740 2024-09-14T09:08:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890845+0000", 2024-09-14T09:08:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890845+0000", 2024-09-14T09:08:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890846+0000", 2024-09-14T09:08:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5799999999999999e-07 2024-09-14T09:08:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890849+0000", 2024-09-14T09:08:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6560000000000001e-06 2024-09-14T09:08:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890856+0000", 2024-09-14T09:08:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5560000000000002e-06 2024-09-14T09:08:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890862+0000", 2024-09-14T09:08:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8660000000000002e-06 2024-09-14T09:08:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2798 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.893296+0000", 2024-09-14T09:08:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.014939900000000001, 2024-09-14T09:08:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015577235, 2024-09-14T09:08:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2798 2024-09-14T09:08:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893296+0000", 2024-09-14T09:08:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893296+0000", 2024-09-14T09:08:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893402+0000", 2024-09-14T09:08:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010615000000000001 2024-09-14T09:08:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893406+0000", 2024-09-14T09:08:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.444e-06 2024-09-14T09:08:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893415+0000", 2024-09-14T09:08:36.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4040000000000001e-06 2024-09-14T09:08:36.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893422+0000", 2024-09-14T09:08:36.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6590000000000001e-06 2024-09-14T09:08:36.970 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.970 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2830 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899007+0000", 2024-09-14T09:08:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0092286060000000003, 2024-09-14T09:08:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099108749999999995, 2024-09-14T09:08:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2830 2024-09-14T09:08:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899007+0000", 2024-09-14T09:08:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899007+0000", 2024-09-14T09:08:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899008+0000", 2024-09-14T09:08:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3399999999999998e-07 2024-09-14T09:08:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899019+0000", 2024-09-14T09:08:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0516000000000001e-05 2024-09-14T09:08:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899028+0000", 2024-09-14T09:08:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9279999999999999e-06 2024-09-14T09:08:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899034+0000", 2024-09-14T09:08:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1009999999999997e-06 2024-09-14T09:08:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2888 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.903765+0000", 2024-09-14T09:08:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0044708559999999996, 2024-09-14T09:08:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052055829999999997, 2024-09-14T09:08:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2888 2024-09-14T09:08:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903765+0000", 2024-09-14T09:08:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903765+0000", 2024-09-14T09:08:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903766+0000", 2024-09-14T09:08:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8400000000000004e-07 2024-09-14T09:08:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903768+0000", 2024-09-14T09:08:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.435e-06 2024-09-14T09:08:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903781+0000", 2024-09-14T09:08:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2471e-05 2024-09-14T09:08:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903900+0000", 2024-09-14T09:08:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011919 2024-09-14T09:08:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2561 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.868724+0000", 2024-09-14T09:08:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.039511959999999999, 2024-09-14T09:08:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040294330000000003, 2024-09-14T09:08:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2561 2024-09-14T09:08:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868724+0000", 2024-09-14T09:08:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868724+0000", 2024-09-14T09:08:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868724+0000", 2024-09-14T09:08:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5800000000000001e-07 2024-09-14T09:08:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868729+0000", 2024-09-14T09:08:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9590000000000003e-06 2024-09-14T09:08:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868733+0000", 2024-09-14T09:08:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6090000000000001e-06 2024-09-14T09:08:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868736+0000", 2024-09-14T09:08:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.999e-06 2024-09-14T09:08:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2619 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.872658+0000", 2024-09-14T09:08:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.035577958, 2024-09-14T09:08:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036411248, 2024-09-14T09:08:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2619 2024-09-14T09:08:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872658+0000", 2024-09-14T09:08:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872658+0000", 2024-09-14T09:08:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872658+0000", 2024-09-14T09:08:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9800000000000004e-07 2024-09-14T09:08:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872660+0000", 2024-09-14T09:08:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9120000000000001e-06 2024-09-14T09:08:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872666+0000", 2024-09-14T09:08:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8069999999999996e-06 2024-09-14T09:08:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872671+0000", 2024-09-14T09:08:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0089999999999998e-06 2024-09-14T09:08:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2651 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.877145+0000", 2024-09-14T09:08:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.031091015999999999, 2024-09-14T09:08:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.031972156000000002, 2024-09-14T09:08:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2651 2024-09-14T09:08:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.877145+0000", 2024-09-14T09:08:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.877145+0000", 2024-09-14T09:08:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.877477+0000", 2024-09-14T09:08:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00033218700000000001 2024-09-14T09:08:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.877481+0000", 2024-09-14T09:08:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8079999999999998e-06 2024-09-14T09:08:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.877491+0000", 2024-09-14T09:08:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0237e-05 2024-09-14T09:08:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.877498+0000", 2024-09-14T09:08:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5560000000000004e-06 2024-09-14T09:08:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2709 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.883187+0000", 2024-09-14T09:08:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.025049285000000001, 2024-09-14T09:08:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.02597675, 2024-09-14T09:08:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2709 2024-09-14T09:08:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883187+0000", 2024-09-14T09:08:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883187+0000", 2024-09-14T09:08:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883396+0000", 2024-09-14T09:08:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020968000000000001 2024-09-14T09:08:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883400+0000", 2024-09-14T09:08:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9489999999999998e-06 2024-09-14T09:08:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883412+0000", 2024-09-14T09:08:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2082000000000001e-05 2024-09-14T09:08:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883419+0000", 2024-09-14T09:08:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.579e-06 2024-09-14T09:08:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2741 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.890870+0000", 2024-09-14T09:08:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017366157, 2024-09-14T09:08:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018340255999999999, 2024-09-14T09:08:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2741 2024-09-14T09:08:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890870+0000", 2024-09-14T09:08:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890870+0000", 2024-09-14T09:08:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890870+0000", 2024-09-14T09:08:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8100000000000003e-07 2024-09-14T09:08:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890872+0000", 2024-09-14T09:08:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.029e-06 2024-09-14T09:08:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890878+0000", 2024-09-14T09:08:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1999999999999999e-06 2024-09-14T09:08:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890887+0000", 2024-09-14T09:08:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7679999999999997e-06 2024-09-14T09:08:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2799 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.893432+0000", 2024-09-14T09:08:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.014804141999999999, 2024-09-14T09:08:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015823569999999999, 2024-09-14T09:08:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2799 2024-09-14T09:08:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893432+0000", 2024-09-14T09:08:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893432+0000", 2024-09-14T09:08:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893529+0000", 2024-09-14T09:08:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7034000000000006e-05 2024-09-14T09:08:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893532+0000", 2024-09-14T09:08:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8229999999999999e-06 2024-09-14T09:08:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893538+0000", 2024-09-14T09:08:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8000000000000001e-06 2024-09-14T09:08:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893542+0000", 2024-09-14T09:08:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0219999999999998e-06 2024-09-14T09:08:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2831 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899044+0000", 2024-09-14T09:08:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0091915469999999996, 2024-09-14T09:08:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010255205999999999, 2024-09-14T09:08:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2831 2024-09-14T09:08:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899044+0000", 2024-09-14T09:08:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899044+0000", 2024-09-14T09:08:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899045+0000", 2024-09-14T09:08:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5900000000000002e-07 2024-09-14T09:08:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899047+0000", 2024-09-14T09:08:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.244e-06 2024-09-14T09:08:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899057+0000", 2024-09-14T09:08:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7520000000000008e-06 2024-09-14T09:08:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899062+0000", 2024-09-14T09:08:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3550000000000004e-06 2024-09-14T09:08:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2889 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.903913+0000", 2024-09-14T09:08:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0043228279999999999, 2024-09-14T09:08:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054325629999999996, 2024-09-14T09:08:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2889 2024-09-14T09:08:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903913+0000", 2024-09-14T09:08:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903913+0000", 2024-09-14T09:08:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903914+0000", 2024-09-14T09:08:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8999999999999996e-07 2024-09-14T09:08:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903917+0000", 2024-09-14T09:08:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.433e-06 2024-09-14T09:08:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903927+0000", 2024-09-14T09:08:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4520000000000003e-06 2024-09-14T09:08:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903933+0000", 2024-09-14T09:08:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5200000000000003e-06 2024-09-14T09:08:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2562 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.868740+0000", 2024-09-14T09:08:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.039496081000000002, 2024-09-14T09:08:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040652725000000001, 2024-09-14T09:08:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2562 2024-09-14T09:08:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868740+0000", 2024-09-14T09:08:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868740+0000", 2024-09-14T09:08:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.869080+0000", 2024-09-14T09:08:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034034199999999999 2024-09-14T09:08:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.869085+0000", 2024-09-14T09:08:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4379999999999997e-06 2024-09-14T09:08:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.869094+0000", 2024-09-14T09:08:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3859999999999996e-06 2024-09-14T09:08:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.869102+0000", 2024-09-14T09:08:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2870000000000004e-06 2024-09-14T09:08:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2620 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.872678+0000", 2024-09-14T09:08:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.035558316999999999, 2024-09-14T09:08:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036762613, 2024-09-14T09:08:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2620 2024-09-14T09:08:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872678+0000", 2024-09-14T09:08:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872678+0000", 2024-09-14T09:08:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872829+0000", 2024-09-14T09:08:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015150499999999999 2024-09-14T09:08:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872842+0000", 2024-09-14T09:08:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2856e-05 2024-09-14T09:08:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872850+0000", 2024-09-14T09:08:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5730000000000002e-06 2024-09-14T09:08:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872857+0000", 2024-09-14T09:08:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9700000000000002e-06 2024-09-14T09:08:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2652 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.877509+0000", 2024-09-14T09:08:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.030726659999999999, 2024-09-14T09:08:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.031978490999999998, 2024-09-14T09:08:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2652 2024-09-14T09:08:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.877509+0000", 2024-09-14T09:08:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.877509+0000", 2024-09-14T09:08:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.877510+0000", 2024-09-14T09:08:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5700000000000002e-07 2024-09-14T09:08:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.877512+0000", 2024-09-14T09:08:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2539999999999999e-06 2024-09-14T09:08:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.877518+0000", 2024-09-14T09:08:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3949999999999998e-06 2024-09-14T09:08:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.877523+0000", 2024-09-14T09:08:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9089999999999999e-06 2024-09-14T09:08:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2710 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.883429+0000", 2024-09-14T09:08:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.024806735, 2024-09-14T09:08:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.026103081, 2024-09-14T09:08:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2710 2024-09-14T09:08:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883429+0000", 2024-09-14T09:08:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883429+0000", 2024-09-14T09:08:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883530+0000", 2024-09-14T09:08:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010076700000000001 2024-09-14T09:08:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883533+0000", 2024-09-14T09:08:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.588e-06 2024-09-14T09:08:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883542+0000", 2024-09-14T09:08:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4919999999999999e-06 2024-09-14T09:08:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883548+0000", 2024-09-14T09:08:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2090000000000002e-06 2024-09-14T09:08:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2742 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.890896+0000", 2024-09-14T09:08:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017339546000000001, 2024-09-14T09:08:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018682005000000002, 2024-09-14T09:08:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2742 2024-09-14T09:08:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890896+0000", 2024-09-14T09:08:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890896+0000", 2024-09-14T09:08:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890897+0000", 2024-09-14T09:08:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3099999999999998e-07 2024-09-14T09:08:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890899+0000", 2024-09-14T09:08:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.458e-06 2024-09-14T09:08:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890906+0000", 2024-09-14T09:08:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5479999999999998e-06 2024-09-14T09:08:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890911+0000", 2024-09-14T09:08:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0189999999999997e-06 2024-09-14T09:08:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2800 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.893550+0000", 2024-09-14T09:08:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.014685930999999999, 2024-09-14T09:08:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016076303, 2024-09-14T09:08:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2800 2024-09-14T09:08:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893550+0000", 2024-09-14T09:08:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893550+0000", 2024-09-14T09:08:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893658+0000", 2024-09-14T09:08:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000107525 2024-09-14T09:08:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893661+0000", 2024-09-14T09:08:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2590000000000001e-06 2024-09-14T09:08:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893668+0000", 2024-09-14T09:08:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.058e-06 2024-09-14T09:08:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893673+0000", 2024-09-14T09:08:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3730000000000001e-06 2024-09-14T09:08:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2832 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899070+0000", 2024-09-14T09:08:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0091661220000000005, 2024-09-14T09:08:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010604465, 2024-09-14T09:08:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2832 2024-09-14T09:08:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899070+0000", 2024-09-14T09:08:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899070+0000", 2024-09-14T09:08:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899070+0000", 2024-09-14T09:08:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9500000000000003e-07 2024-09-14T09:08:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899072+0000", 2024-09-14T09:08:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.12e-06 2024-09-14T09:08:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899079+0000", 2024-09-14T09:08:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1979999999999998e-06 2024-09-14T09:08:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899084+0000", 2024-09-14T09:08:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0039999999999999e-06 2024-09-14T09:08:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2890 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.903941+0000", 2024-09-14T09:08:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0042947159999999996, 2024-09-14T09:08:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057801830000000004, 2024-09-14T09:08:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2890 2024-09-14T09:08:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903941+0000", 2024-09-14T09:08:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903941+0000", 2024-09-14T09:08:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904096+0000", 2024-09-14T09:08:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015511 2024-09-14T09:08:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904099+0000", 2024-09-14T09:08:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7199999999999998e-06 2024-09-14T09:08:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904108+0000", 2024-09-14T09:08:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7660000000000004e-06 2024-09-14T09:08:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904114+0000", 2024-09-14T09:08:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0750000000000003e-06 2024-09-14T09:08:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2563 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.869114+0000", 2024-09-14T09:08:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.039121706999999999, 2024-09-14T09:08:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040654049999999997, 2024-09-14T09:08:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2563 2024-09-14T09:08:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.869114+0000", 2024-09-14T09:08:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.869114+0000", 2024-09-14T09:08:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.869115+0000", 2024-09-14T09:08:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8500000000000001e-07 2024-09-14T09:08:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.869117+0000", 2024-09-14T09:08:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3520000000000001e-06 2024-09-14T09:08:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.869123+0000", 2024-09-14T09:08:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3210000000000001e-06 2024-09-14T09:08:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.869128+0000", 2024-09-14T09:08:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8799999999999999e-06 2024-09-14T09:08:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2621 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.872867+0000", 2024-09-14T09:08:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.035368704000000001, 2024-09-14T09:08:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036946483000000002, 2024-09-14T09:08:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2621 2024-09-14T09:08:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872867+0000", 2024-09-14T09:08:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872867+0000", 2024-09-14T09:08:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872868+0000", 2024-09-14T09:08:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8400000000000005e-07 2024-09-14T09:08:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872870+0000", 2024-09-14T09:08:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3989999999999998e-06 2024-09-14T09:08:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872877+0000", 2024-09-14T09:08:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8850000000000001e-06 2024-09-14T09:08:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872882+0000", 2024-09-14T09:08:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9110000000000001e-06 2024-09-14T09:08:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2653 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.877530+0000", 2024-09-14T09:08:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.030705898999999998, 2024-09-14T09:08:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032334178999999998, 2024-09-14T09:08:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2653 2024-09-14T09:08:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.877530+0000", 2024-09-14T09:08:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.877530+0000", 2024-09-14T09:08:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879764+0000", 2024-09-14T09:08:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022339790000000001 2024-09-14T09:08:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879769+0000", 2024-09-14T09:08:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0649999999999998e-06 2024-09-14T09:08:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879779+0000", 2024-09-14T09:08:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9320000000000008e-06 2024-09-14T09:08:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879788+0000", 2024-09-14T09:08:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5369999999999997e-06 2024-09-14T09:08:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2711 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.883558+0000", 2024-09-14T09:08:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.024677452999999999, 2024-09-14T09:08:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.026350757999999998, 2024-09-14T09:08:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2711 2024-09-14T09:08:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883558+0000", 2024-09-14T09:08:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883558+0000", 2024-09-14T09:08:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883779+0000", 2024-09-14T09:08:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000220423 2024-09-14T09:08:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883783+0000", 2024-09-14T09:08:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0609999999999997e-06 2024-09-14T09:08:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883792+0000", 2024-09-14T09:08:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2990000000000002e-06 2024-09-14T09:08:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883803+0000", 2024-09-14T09:08:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.045e-05 2024-09-14T09:08:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2743 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.890927+0000", 2024-09-14T09:08:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017309255999999999, 2024-09-14T09:08:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019028449999999999, 2024-09-14T09:08:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2743 2024-09-14T09:08:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890927+0000", 2024-09-14T09:08:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890927+0000", 2024-09-14T09:08:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890927+0000", 2024-09-14T09:08:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4000000000000002e-07 2024-09-14T09:08:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890929+0000", 2024-09-14T09:08:37.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.198e-06 2024-09-14T09:08:37.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890937+0000", 2024-09-14T09:08:37.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3640000000000001e-06 2024-09-14T09:08:37.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890942+0000", 2024-09-14T09:08:37.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1660000000000002e-06 2024-09-14T09:08:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2801 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.893683+0000", 2024-09-14T09:08:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.014552594, 2024-09-14T09:08:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016323310000000001, 2024-09-14T09:08:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2801 2024-09-14T09:08:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893683+0000", 2024-09-14T09:08:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893683+0000", 2024-09-14T09:08:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893790+0000", 2024-09-14T09:08:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106396 2024-09-14T09:08:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893794+0000", 2024-09-14T09:08:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8770000000000003e-06 2024-09-14T09:08:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893800+0000", 2024-09-14T09:08:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6089999999999997e-06 2024-09-14T09:08:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893804+0000", 2024-09-14T09:08:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.782e-06 2024-09-14T09:08:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2833 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899090+0000", 2024-09-14T09:08:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0091463289999999999, 2024-09-14T09:08:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010961247, 2024-09-14T09:08:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2833 2024-09-14T09:08:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899090+0000", 2024-09-14T09:08:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899090+0000", 2024-09-14T09:08:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899090+0000", 2024-09-14T09:08:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8200000000000001e-07 2024-09-14T09:08:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899092+0000", 2024-09-14T09:08:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.823e-06 2024-09-14T09:08:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899098+0000", 2024-09-14T09:08:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.049e-06 2024-09-14T09:08:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899103+0000", 2024-09-14T09:08:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8289999999999998e-06 2024-09-14T09:08:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2891 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.904124+0000", 2024-09-14T09:08:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0041115889999999997, 2024-09-14T09:08:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059777770000000001, 2024-09-14T09:08:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2891 2024-09-14T09:08:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904124+0000", 2024-09-14T09:08:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904124+0000", 2024-09-14T09:08:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904243+0000", 2024-09-14T09:08:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000118699 2024-09-14T09:08:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904250+0000", 2024-09-14T09:08:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.742e-06 2024-09-14T09:08:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904261+0000", 2024-09-14T09:08:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1406000000000001e-05 2024-09-14T09:08:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904268+0000", 2024-09-14T09:08:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4509999999999997e-06 2024-09-14T09:08:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2622 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.872889+0000", 2024-09-14T09:08:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.035347031000000001, 2024-09-14T09:08:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037261735999999997, 2024-09-14T09:08:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2622 2024-09-14T09:08:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872889+0000", 2024-09-14T09:08:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872889+0000", 2024-09-14T09:08:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872966+0000", 2024-09-14T09:08:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7174000000000003e-05 2024-09-14T09:08:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872970+0000", 2024-09-14T09:08:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9550000000000002e-06 2024-09-14T09:08:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872978+0000", 2024-09-14T09:08:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1790000000000008e-06 2024-09-14T09:08:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872985+0000", 2024-09-14T09:08:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.815e-06 2024-09-14T09:08:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2654 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879800+0000", 2024-09-14T09:08:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.028435453999999999, 2024-09-14T09:08:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030397928000000001, 2024-09-14T09:08:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2654 2024-09-14T09:08:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879800+0000", 2024-09-14T09:08:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879800+0000", 2024-09-14T09:08:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879801+0000", 2024-09-14T09:08:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4600000000000005e-07 2024-09-14T09:08:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879804+0000", 2024-09-14T09:08:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5339999999999998e-06 2024-09-14T09:08:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879811+0000", 2024-09-14T09:08:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9659999999999999e-06 2024-09-14T09:08:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879818+0000", 2024-09-14T09:08:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5469999999999999e-06 2024-09-14T09:08:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2712 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.883814+0000", 2024-09-14T09:08:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.024422035000000002, 2024-09-14T09:08:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.026431118, 2024-09-14T09:08:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2712 2024-09-14T09:08:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883814+0000", 2024-09-14T09:08:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883814+0000", 2024-09-14T09:08:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883905+0000", 2024-09-14T09:08:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0958000000000006e-05 2024-09-14T09:08:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883908+0000", 2024-09-14T09:08:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5389999999999999e-06 2024-09-14T09:08:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883918+0000", 2024-09-14T09:08:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1900000000000001e-06 2024-09-14T09:08:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883923+0000", 2024-09-14T09:08:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5119999999999999e-06 2024-09-14T09:08:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2744 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.890949+0000", 2024-09-14T09:08:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017287174999999998, 2024-09-14T09:08:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019347249, 2024-09-14T09:08:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2744 2024-09-14T09:08:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890949+0000", 2024-09-14T09:08:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890949+0000", 2024-09-14T09:08:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890949+0000", 2024-09-14T09:08:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9000000000000002e-07 2024-09-14T09:08:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890958+0000", 2024-09-14T09:08:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6610000000000006e-06 2024-09-14T09:08:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890969+0000", 2024-09-14T09:08:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1238e-05 2024-09-14T09:08:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890975+0000", 2024-09-14T09:08:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6149999999999996e-06 2024-09-14T09:08:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2802 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.893811+0000", 2024-09-14T09:08:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.01442483, 2024-09-14T09:08:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016533211999999999, 2024-09-14T09:08:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2802 2024-09-14T09:08:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893811+0000", 2024-09-14T09:08:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893811+0000", 2024-09-14T09:08:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893917+0000", 2024-09-14T09:08:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001059 2024-09-14T09:08:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893919+0000", 2024-09-14T09:08:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4889999999999998e-06 2024-09-14T09:08:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893925+0000", 2024-09-14T09:08:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6439999999999997e-06 2024-09-14T09:08:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893929+0000", 2024-09-14T09:08:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4139999999999998e-06 2024-09-14T09:08:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2834 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899108+0000", 2024-09-14T09:08:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0091276550000000001, 2024-09-14T09:08:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011285322, 2024-09-14T09:08:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2834 2024-09-14T09:08:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899108+0000", 2024-09-14T09:08:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899108+0000", 2024-09-14T09:08:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899109+0000", 2024-09-14T09:08:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5600000000000001e-07 2024-09-14T09:08:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899111+0000", 2024-09-14T09:08:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8700000000000001e-06 2024-09-14T09:08:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899116+0000", 2024-09-14T09:08:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.631e-06 2024-09-14T09:08:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899122+0000", 2024-09-14T09:08:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4609999999999999e-06 2024-09-14T09:08:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2892 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.904278+0000", 2024-09-14T09:08:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0039581479999999999, 2024-09-14T09:08:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061608870000000003, 2024-09-14T09:08:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2892 2024-09-14T09:08:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904278+0000", 2024-09-14T09:08:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904278+0000", 2024-09-14T09:08:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904497+0000", 2024-09-14T09:08:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021896700000000001 2024-09-14T09:08:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904501+0000", 2024-09-14T09:08:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0890000000000002e-06 2024-09-14T09:08:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904511+0000", 2024-09-14T09:08:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0635999999999999e-05 2024-09-14T09:08:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904519+0000", 2024-09-14T09:08:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1219999999999997e-06 2024-09-14T09:08:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2623 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.872996+0000", 2024-09-14T09:08:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.035240384999999999, 2024-09-14T09:08:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037490241000000001, 2024-09-14T09:08:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2623 2024-09-14T09:08:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872996+0000", 2024-09-14T09:08:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.872996+0000", 2024-09-14T09:08:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873275+0000", 2024-09-14T09:08:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00027917699999999997 2024-09-14T09:08:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873283+0000", 2024-09-14T09:08:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3659999999999992e-06 2024-09-14T09:08:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873293+0000", 2024-09-14T09:08:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5389999999999996e-06 2024-09-14T09:08:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873299+0000", 2024-09-14T09:08:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4459999999999998e-06 2024-09-14T09:08:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2655 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879829+0000", 2024-09-14T09:08:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.028407241999999999, 2024-09-14T09:08:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.030702448, 2024-09-14T09:08:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2655 2024-09-14T09:08:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879829+0000", 2024-09-14T09:08:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879829+0000", 2024-09-14T09:08:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879829+0000", 2024-09-14T09:08:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8999999999999996e-07 2024-09-14T09:08:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879832+0000", 2024-09-14T09:08:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2450000000000001e-06 2024-09-14T09:08:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879839+0000", 2024-09-14T09:08:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7049999999999999e-06 2024-09-14T09:08:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879844+0000", 2024-09-14T09:08:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1440000000000002e-06 2024-09-14T09:08:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2713 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.883933+0000", 2024-09-14T09:08:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.024302474000000001, 2024-09-14T09:08:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.026647852999999999, 2024-09-14T09:08:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2713 2024-09-14T09:08:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883933+0000", 2024-09-14T09:08:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.883933+0000", 2024-09-14T09:08:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884196+0000", 2024-09-14T09:08:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000262852 2024-09-14T09:08:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884200+0000", 2024-09-14T09:08:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7069999999999998e-06 2024-09-14T09:08:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884206+0000", 2024-09-14T09:08:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1789999999999996e-06 2024-09-14T09:08:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884211+0000", 2024-09-14T09:08:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7180000000000004e-06 2024-09-14T09:08:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2745 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.890982+0000", 2024-09-14T09:08:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017253615999999999, 2024-09-14T09:08:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019645401, 2024-09-14T09:08:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2745 2024-09-14T09:08:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890982+0000", 2024-09-14T09:08:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890982+0000", 2024-09-14T09:08:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890983+0000", 2024-09-14T09:08:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999998e-07 2024-09-14T09:08:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890985+0000", 2024-09-14T09:08:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0509999999999999e-06 2024-09-14T09:08:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890991+0000", 2024-09-14T09:08:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4880000000000004e-06 2024-09-14T09:08:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.890997+0000", 2024-09-14T09:08:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4299999999999997e-06 2024-09-14T09:08:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2803 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.893935+0000", 2024-09-14T09:08:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.014301032999999999, 2024-09-14T09:08:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016740587000000001, 2024-09-14T09:08:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2803 2024-09-14T09:08:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893935+0000", 2024-09-14T09:08:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893935+0000", 2024-09-14T09:08:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894179+0000", 2024-09-14T09:08:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024382200000000001 2024-09-14T09:08:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894181+0000", 2024-09-14T09:08:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6869999999999999e-06 2024-09-14T09:08:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894189+0000", 2024-09-14T09:08:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4919999999999996e-06 2024-09-14T09:08:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894194+0000", 2024-09-14T09:08:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8409999999999999e-06 2024-09-14T09:08:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2835 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899128+0000", 2024-09-14T09:08:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0091084070000000007, 2024-09-14T09:08:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011596726, 2024-09-14T09:08:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2835 2024-09-14T09:08:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899128+0000", 2024-09-14T09:08:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899128+0000", 2024-09-14T09:08:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900004+0000", 2024-09-14T09:08:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00087605799999999998 2024-09-14T09:08:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900008+0000", 2024-09-14T09:08:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7079999999999996e-06 2024-09-14T09:08:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900019+0000", 2024-09-14T09:08:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1134999999999999e-05 2024-09-14T09:08:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900026+0000", 2024-09-14T09:08:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.007e-06 2024-09-14T09:08:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2893 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.904530+0000", 2024-09-14T09:08:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0037060539999999999, 2024-09-14T09:08:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062394299999999998, 2024-09-14T09:08:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2893 2024-09-14T09:08:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904530+0000", 2024-09-14T09:08:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904530+0000", 2024-09-14T09:08:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904583+0000", 2024-09-14T09:08:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2964999999999999e-05 2024-09-14T09:08:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904586+0000", 2024-09-14T09:08:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9569999999999998e-06 2024-09-14T09:08:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904595+0000", 2024-09-14T09:08:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7469999999999994e-06 2024-09-14T09:08:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904603+0000", 2024-09-14T09:08:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3480000000000004e-06 2024-09-14T09:08:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2624 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.873310+0000", 2024-09-14T09:08:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.034925557000000003, 2024-09-14T09:08:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037508109999999997, 2024-09-14T09:08:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2624 2024-09-14T09:08:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873310+0000", 2024-09-14T09:08:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873310+0000", 2024-09-14T09:08:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873311+0000", 2024-09-14T09:08:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6800000000000001e-07 2024-09-14T09:08:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873313+0000", 2024-09-14T09:08:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3489999999999999e-06 2024-09-14T09:08:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873320+0000", 2024-09-14T09:08:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6619999999999999e-06 2024-09-14T09:08:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873325+0000", 2024-09-14T09:08:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6339999999999998e-06 2024-09-14T09:08:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2656 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879852+0000", 2024-09-14T09:08:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.028383441999999998, 2024-09-14T09:08:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.031013012999999999, 2024-09-14T09:08:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2656 2024-09-14T09:08:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879852+0000", 2024-09-14T09:08:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879852+0000", 2024-09-14T09:08:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879853+0000", 2024-09-14T09:08:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-07 2024-09-14T09:08:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879855+0000", 2024-09-14T09:08:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1129999999999999e-06 2024-09-14T09:08:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879861+0000", 2024-09-14T09:08:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0599999999999996e-06 2024-09-14T09:08:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879874+0000", 2024-09-14T09:08:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2629000000000001e-05 2024-09-14T09:08:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2714 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.884220+0000", 2024-09-14T09:08:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.024015871000000001, 2024-09-14T09:08:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.02669709, 2024-09-14T09:08:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2714 2024-09-14T09:08:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884220+0000", 2024-09-14T09:08:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884220+0000", 2024-09-14T09:08:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884418+0000", 2024-09-14T09:08:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019746799999999999 2024-09-14T09:08:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884421+0000", 2024-09-14T09:08:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7510000000000002e-06 2024-09-14T09:08:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884430+0000", 2024-09-14T09:08:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0790000000000007e-06 2024-09-14T09:08:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884437+0000", 2024-09-14T09:08:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1789999999999996e-06 2024-09-14T09:08:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2746 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.891004+0000", 2024-09-14T09:08:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017232134, 2024-09-14T09:08:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019963793000000001, 2024-09-14T09:08:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2746 2024-09-14T09:08:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891004+0000", 2024-09-14T09:08:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891004+0000", 2024-09-14T09:08:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891004+0000", 2024-09-14T09:08:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4299999999999999e-07 2024-09-14T09:08:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891006+0000", 2024-09-14T09:08:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0040000000000002e-06 2024-09-14T09:08:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891012+0000", 2024-09-14T09:08:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2580000000000001e-06 2024-09-14T09:08:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891017+0000", 2024-09-14T09:08:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0379999999999999e-06 2024-09-14T09:08:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2804 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.894205+0000", 2024-09-14T09:08:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.014030641999999999, 2024-09-14T09:08:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016811679999999999, 2024-09-14T09:08:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2804 2024-09-14T09:08:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894205+0000", 2024-09-14T09:08:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894205+0000", 2024-09-14T09:08:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894206+0000", 2024-09-14T09:08:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3799999999999997e-07 2024-09-14T09:08:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894208+0000", 2024-09-14T09:08:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1619999999999998e-06 2024-09-14T09:08:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894214+0000", 2024-09-14T09:08:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.874e-06 2024-09-14T09:08:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894217+0000", 2024-09-14T09:08:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1049999999999999e-06 2024-09-14T09:08:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2836 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.900037+0000", 2024-09-14T09:08:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0081986179999999995, 2024-09-14T09:08:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011023767, 2024-09-14T09:08:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2836 2024-09-14T09:08:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900037+0000", 2024-09-14T09:08:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900037+0000", 2024-09-14T09:08:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900038+0000", 2024-09-14T09:08:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8700000000000002e-07 2024-09-14T09:08:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900039+0000", 2024-09-14T09:08:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.502e-06 2024-09-14T09:08:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900044+0000", 2024-09-14T09:08:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.763e-06 2024-09-14T09:08:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900047+0000", 2024-09-14T09:08:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0340000000000001e-06 2024-09-14T09:08:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2894 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.904613+0000", 2024-09-14T09:08:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0036229669999999999, 2024-09-14T09:08:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064977150000000003, 2024-09-14T09:08:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2894 2024-09-14T09:08:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904613+0000", 2024-09-14T09:08:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904613+0000", 2024-09-14T09:08:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904885+0000", 2024-09-14T09:08:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00027210599999999999 2024-09-14T09:08:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904889+0000", 2024-09-14T09:08:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.25e-06 2024-09-14T09:08:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904901+0000", 2024-09-14T09:08:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1518999999999999e-05 2024-09-14T09:08:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904906+0000", 2024-09-14T09:08:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.899e-06 2024-09-14T09:08:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2625 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.873333+0000", 2024-09-14T09:08:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.034902862, 2024-09-14T09:08:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037826011999999999, 2024-09-14T09:08:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2625 2024-09-14T09:08:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873333+0000", 2024-09-14T09:08:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873333+0000", 2024-09-14T09:08:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873369+0000", 2024-09-14T09:08:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5722000000000001e-05 2024-09-14T09:08:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873372+0000", 2024-09-14T09:08:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0060000000000001e-06 2024-09-14T09:08:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873386+0000", 2024-09-14T09:08:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4005999999999999e-05 2024-09-14T09:08:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873394+0000", 2024-09-14T09:08:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9559999999999997e-06 2024-09-14T09:08:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2657 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879881+0000", 2024-09-14T09:08:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.028355076, 2024-09-14T09:08:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.031327553000000001, 2024-09-14T09:08:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2657 2024-09-14T09:08:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879881+0000", 2024-09-14T09:08:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879881+0000", 2024-09-14T09:08:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879881+0000", 2024-09-14T09:08:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0200000000000002e-07 2024-09-14T09:08:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879884+0000", 2024-09-14T09:08:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2989999999999999e-06 2024-09-14T09:08:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879890+0000", 2024-09-14T09:08:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2720000000000003e-06 2024-09-14T09:08:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879895+0000", 2024-09-14T09:08:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.057e-06 2024-09-14T09:08:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2715 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.884447+0000", 2024-09-14T09:08:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.023789300999999999, 2024-09-14T09:08:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.026808928999999999, 2024-09-14T09:08:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2715 2024-09-14T09:08:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884447+0000", 2024-09-14T09:08:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884447+0000", 2024-09-14T09:08:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884447+0000", 2024-09-14T09:08:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1899999999999998e-07 2024-09-14T09:08:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884449+0000", 2024-09-14T09:08:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0430000000000002e-06 2024-09-14T09:08:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884455+0000", 2024-09-14T09:08:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.964e-06 2024-09-14T09:08:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884461+0000", 2024-09-14T09:08:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.682e-06 2024-09-14T09:08:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2747 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.891025+0000", 2024-09-14T09:08:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017211305999999999, 2024-09-14T09:08:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020279284000000002, 2024-09-14T09:08:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2747 2024-09-14T09:08:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891025+0000", 2024-09-14T09:08:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891025+0000", 2024-09-14T09:08:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891025+0000", 2024-09-14T09:08:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:08:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891034+0000", 2024-09-14T09:08:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5760000000000006e-06 2024-09-14T09:08:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891041+0000", 2024-09-14T09:08:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0659999999999998e-06 2024-09-14T09:08:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891047+0000", 2024-09-14T09:08:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4069999999999998e-06 2024-09-14T09:08:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2805 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.894222+0000", 2024-09-14T09:08:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.014013986000000001, 2024-09-14T09:08:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017127890999999999, 2024-09-14T09:08:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2805 2024-09-14T09:08:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894222+0000", 2024-09-14T09:08:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894222+0000", 2024-09-14T09:08:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894305+0000", 2024-09-14T09:08:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2559999999999996e-05 2024-09-14T09:08:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894308+0000", 2024-09-14T09:08:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8510000000000001e-06 2024-09-14T09:08:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894314+0000", 2024-09-14T09:08:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5799999999999999e-06 2024-09-14T09:08:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894319+0000", 2024-09-14T09:08:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2900000000000002e-06 2024-09-14T09:08:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2837 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.900051+0000", 2024-09-14T09:08:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0081850320000000001, 2024-09-14T09:08:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011345578, 2024-09-14T09:08:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2837 2024-09-14T09:08:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900051+0000", 2024-09-14T09:08:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900051+0000", 2024-09-14T09:08:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900051+0000", 2024-09-14T09:08:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4499999999999998e-07 2024-09-14T09:08:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900052+0000", 2024-09-14T09:08:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1680000000000001e-06 2024-09-14T09:08:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900056+0000", 2024-09-14T09:08:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.252e-06 2024-09-14T09:08:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900059+0000", 2024-09-14T09:08:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5379999999999998e-06 2024-09-14T09:08:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2895 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.904915+0000", 2024-09-14T09:08:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0033208270000000002, 2024-09-14T09:08:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0065284820000000004, 2024-09-14T09:08:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2895 2024-09-14T09:08:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904915+0000", 2024-09-14T09:08:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904915+0000", 2024-09-14T09:08:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904981+0000", 2024-09-14T09:08:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5833000000000005e-05 2024-09-14T09:08:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904984+0000", 2024-09-14T09:08:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5909999999999998e-06 2024-09-14T09:08:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904989+0000", 2024-09-14T09:08:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4750000000000001e-06 2024-09-14T09:08:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904993+0000", 2024-09-14T09:08:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7780000000000001e-06 2024-09-14T09:08:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2626 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.873403+0000", 2024-09-14T09:08:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.034832452, 2024-09-14T09:08:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038085724000000001, 2024-09-14T09:08:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2626 2024-09-14T09:08:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873403+0000", 2024-09-14T09:08:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873403+0000", 2024-09-14T09:08:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873716+0000", 2024-09-14T09:08:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00031201900000000002 2024-09-14T09:08:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873721+0000", 2024-09-14T09:08:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0679999999999996e-06 2024-09-14T09:08:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873737+0000", 2024-09-14T09:08:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6405e-05 2024-09-14T09:08:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873745+0000", 2024-09-14T09:08:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7230000000000004e-06 2024-09-14T09:08:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2658 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879901+0000", 2024-09-14T09:08:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.028334766000000001, 2024-09-14T09:08:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.031703626999999998, 2024-09-14T09:08:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2658 2024-09-14T09:08:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879901+0000", 2024-09-14T09:08:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879901+0000", 2024-09-14T09:08:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879901+0000", 2024-09-14T09:08:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1899999999999998e-07 2024-09-14T09:08:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879903+0000", 2024-09-14T09:08:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9139999999999998e-06 2024-09-14T09:08:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879909+0000", 2024-09-14T09:08:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.998e-06 2024-09-14T09:08:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879914+0000", 2024-09-14T09:08:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.882e-06 2024-09-14T09:08:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2716 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.884467+0000", 2024-09-14T09:08:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.023769274999999999, 2024-09-14T09:08:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027184435999999999, 2024-09-14T09:08:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2716 2024-09-14T09:08:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884467+0000", 2024-09-14T09:08:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884467+0000", 2024-09-14T09:08:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884498+0000", 2024-09-14T09:08:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0849999999999998e-05 2024-09-14T09:08:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884500+0000", 2024-09-14T09:08:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.65e-06 2024-09-14T09:08:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884507+0000", 2024-09-14T09:08:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1799999999999999e-06 2024-09-14T09:08:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884513+0000", 2024-09-14T09:08:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1539999999999999e-06 2024-09-14T09:08:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2748 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.891052+0000", 2024-09-14T09:08:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017183486000000001, 2024-09-14T09:08:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020646247999999999, 2024-09-14T09:08:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2748 2024-09-14T09:08:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891052+0000", 2024-09-14T09:08:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891052+0000", 2024-09-14T09:08:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891053+0000", 2024-09-14T09:08:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9900000000000002e-07 2024-09-14T09:08:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891054+0000", 2024-09-14T09:08:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.438e-06 2024-09-14T09:08:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891058+0000", 2024-09-14T09:08:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.41e-06 2024-09-14T09:08:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891068+0000", 2024-09-14T09:08:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9680000000000001e-06 2024-09-14T09:08:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2806 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.894330+0000", 2024-09-14T09:08:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.013906239000000001, 2024-09-14T09:08:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017416501000000001, 2024-09-14T09:08:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2806 2024-09-14T09:08:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894330+0000", 2024-09-14T09:08:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894330+0000", 2024-09-14T09:08:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894552+0000", 2024-09-14T09:08:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022189900000000001 2024-09-14T09:08:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894559+0000", 2024-09-14T09:08:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.379e-06 2024-09-14T09:08:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894565+0000", 2024-09-14T09:08:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8479999999999997e-06 2024-09-14T09:08:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894569+0000", 2024-09-14T09:08:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-09-14T09:08:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2838 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.900065+0000", 2024-09-14T09:08:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.008171401, 2024-09-14T09:08:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011730839999999999, 2024-09-14T09:08:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2838 2024-09-14T09:08:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900065+0000", 2024-09-14T09:08:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900065+0000", 2024-09-14T09:08:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900065+0000", 2024-09-14T09:08:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6e-07 2024-09-14T09:08:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900066+0000", 2024-09-14T09:08:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2219999999999999e-06 2024-09-14T09:08:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900069+0000", 2024-09-14T09:08:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3289999999999998e-06 2024-09-14T09:08:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900072+0000", 2024-09-14T09:08:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8100000000000002e-06 2024-09-14T09:08:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2896 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.905000+0000", 2024-09-14T09:08:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0032362549999999999, 2024-09-14T09:08:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068416270000000003, 2024-09-14T09:08:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2896 2024-09-14T09:08:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905000+0000", 2024-09-14T09:08:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905000+0000", 2024-09-14T09:08:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905238+0000", 2024-09-14T09:08:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023854200000000001 2024-09-14T09:08:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905243+0000", 2024-09-14T09:08:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3769999999999998e-06 2024-09-14T09:08:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905252+0000", 2024-09-14T09:08:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9840000000000007e-06 2024-09-14T09:08:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905258+0000", 2024-09-14T09:08:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5549999999999999e-06 2024-09-14T09:08:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2627 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.873758+0000", 2024-09-14T09:08:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.034478316000000002, 2024-09-14T09:08:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038133528, 2024-09-14T09:08:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2627 2024-09-14T09:08:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873758+0000", 2024-09-14T09:08:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873758+0000", 2024-09-14T09:08:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873758+0000", 2024-09-14T09:08:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0999999999999998e-07 2024-09-14T09:08:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873761+0000", 2024-09-14T09:08:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.582e-06 2024-09-14T09:08:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873767+0000", 2024-09-14T09:08:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6200000000000001e-06 2024-09-14T09:08:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873773+0000", 2024-09-14T09:08:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.074e-06 2024-09-14T09:08:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2659 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879926+0000", 2024-09-14T09:08:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.028309465999999998, 2024-09-14T09:08:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032010635000000003, 2024-09-14T09:08:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2659 2024-09-14T09:08:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879926+0000", 2024-09-14T09:08:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879926+0000", 2024-09-14T09:08:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879927+0000", 2024-09-14T09:08:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9100000000000004e-07 2024-09-14T09:08:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879929+0000", 2024-09-14T09:08:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3659999999999999e-06 2024-09-14T09:08:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879936+0000", 2024-09-14T09:08:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7259999999999996e-06 2024-09-14T09:08:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879942+0000", 2024-09-14T09:08:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6130000000000003e-06 2024-09-14T09:08:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2717 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.884529+0000", 2024-09-14T09:08:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.023706854999999999, 2024-09-14T09:08:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027461943999999999, 2024-09-14T09:08:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2717 2024-09-14T09:08:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884529+0000", 2024-09-14T09:08:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884529+0000", 2024-09-14T09:08:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884642+0000", 2024-09-14T09:08:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000113053 2024-09-14T09:08:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884645+0000", 2024-09-14T09:08:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8739999999999999e-06 2024-09-14T09:08:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884653+0000", 2024-09-14T09:08:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8089999999999993e-06 2024-09-14T09:08:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884657+0000", 2024-09-14T09:08:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4800000000000003e-06 2024-09-14T09:08:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2749 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.891072+0000", 2024-09-14T09:08:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017164117, 2024-09-14T09:08:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020966245000000001, 2024-09-14T09:08:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2749 2024-09-14T09:08:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891072+0000", 2024-09-14T09:08:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891072+0000", 2024-09-14T09:08:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891072+0000", 2024-09-14T09:08:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6100000000000002e-07 2024-09-14T09:08:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891073+0000", 2024-09-14T09:08:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1880000000000001e-06 2024-09-14T09:08:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891076+0000", 2024-09-14T09:08:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0989999999999999e-06 2024-09-14T09:08:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891079+0000", 2024-09-14T09:08:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7520000000000001e-06 2024-09-14T09:08:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2807 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.894575+0000", 2024-09-14T09:08:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.013660477000000001, 2024-09-14T09:08:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017510700000000001, 2024-09-14T09:08:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2807 2024-09-14T09:08:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894575+0000", 2024-09-14T09:08:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894575+0000", 2024-09-14T09:08:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894812+0000", 2024-09-14T09:08:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000236412 2024-09-14T09:08:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894815+0000", 2024-09-14T09:08:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5590000000000001e-06 2024-09-14T09:08:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894824+0000", 2024-09-14T09:08:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4619999999999996e-06 2024-09-14T09:08:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894831+0000", 2024-09-14T09:08:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7900000000000002e-06 2024-09-14T09:08:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2839 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.900087+0000", 2024-09-14T09:08:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0081494080000000003, 2024-09-14T09:08:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012045389, 2024-09-14T09:08:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2839 2024-09-14T09:08:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900087+0000", 2024-09-14T09:08:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900087+0000", 2024-09-14T09:08:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900087+0000", 2024-09-14T09:08:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5900000000000002e-07 2024-09-14T09:08:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900088+0000", 2024-09-14T09:08:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.469e-06 2024-09-14T09:08:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900092+0000", 2024-09-14T09:08:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6480000000000001e-06 2024-09-14T09:08:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900096+0000", 2024-09-14T09:08:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5920000000000001e-06 2024-09-14T09:08:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2897 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.905270+0000", 2024-09-14T09:08:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.002966074, 2024-09-14T09:08:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069088159999999999, 2024-09-14T09:08:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2897 2024-09-14T09:08:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905270+0000", 2024-09-14T09:08:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905270+0000", 2024-09-14T09:08:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905428+0000", 2024-09-14T09:08:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015784999999999999 2024-09-14T09:08:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905433+0000", 2024-09-14T09:08:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8199999999999996e-06 2024-09-14T09:08:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905450+0000", 2024-09-14T09:08:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7079999999999999e-05 2024-09-14T09:08:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905458+0000", 2024-09-14T09:08:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5450000000000003e-06 2024-09-14T09:08:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2628 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.873780+0000", 2024-09-14T09:08:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.034456148999999998, 2024-09-14T09:08:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038444743000000003, 2024-09-14T09:08:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2628 2024-09-14T09:08:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873780+0000", 2024-09-14T09:08:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873780+0000", 2024-09-14T09:08:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873817+0000", 2024-09-14T09:08:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7503999999999999e-05 2024-09-14T09:08:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873820+0000", 2024-09-14T09:08:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1379999999999999e-06 2024-09-14T09:08:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873831+0000", 2024-09-14T09:08:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0359e-05 2024-09-14T09:08:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873837+0000", 2024-09-14T09:08:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.75e-06 2024-09-14T09:08:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2660 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879952+0000", 2024-09-14T09:08:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.028283578, 2024-09-14T09:08:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032315017000000001, 2024-09-14T09:08:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2660 2024-09-14T09:08:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879952+0000", 2024-09-14T09:08:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879952+0000", 2024-09-14T09:08:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879953+0000", 2024-09-14T09:08:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.51e-07 2024-09-14T09:08:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879955+0000", 2024-09-14T09:08:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.137e-06 2024-09-14T09:08:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879971+0000", 2024-09-14T09:08:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5704000000000001e-05 2024-09-14T09:08:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879976+0000", 2024-09-14T09:08:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6189999999999999e-06 2024-09-14T09:08:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2718 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.884665+0000", 2024-09-14T09:08:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.023571168, 2024-09-14T09:08:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027652539, 2024-09-14T09:08:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2718 2024-09-14T09:08:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884665+0000", 2024-09-14T09:08:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884665+0000", 2024-09-14T09:08:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884760+0000", 2024-09-14T09:08:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5373999999999999e-05 2024-09-14T09:08:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884762+0000", 2024-09-14T09:08:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2859999999999998e-06 2024-09-14T09:08:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884769+0000", 2024-09-14T09:08:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3080000000000004e-06 2024-09-14T09:08:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884772+0000", 2024-09-14T09:08:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7309999999999999e-06 2024-09-14T09:08:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2750 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.891082+0000", 2024-09-14T09:08:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017153911000000001, 2024-09-14T09:08:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021282490000000001, 2024-09-14T09:08:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2750 2024-09-14T09:08:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891082+0000", 2024-09-14T09:08:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891082+0000", 2024-09-14T09:08:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891082+0000", 2024-09-14T09:08:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.11e-07 2024-09-14T09:08:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891083+0000", 2024-09-14T09:08:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.78e-07 2024-09-14T09:08:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891086+0000", 2024-09-14T09:08:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0060000000000001e-06 2024-09-14T09:08:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891089+0000", 2024-09-14T09:08:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.435e-06 2024-09-14T09:08:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2808 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.894863+0000", 2024-09-14T09:08:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.013373064, 2024-09-14T09:08:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017550817999999999, 2024-09-14T09:08:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2808 2024-09-14T09:08:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894863+0000", 2024-09-14T09:08:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894863+0000", 2024-09-14T09:08:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894863+0000", 2024-09-14T09:08:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3799999999999997e-07 2024-09-14T09:08:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894866+0000", 2024-09-14T09:08:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9000000000000002e-06 2024-09-14T09:08:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894875+0000", 2024-09-14T09:08:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3289999999999994e-06 2024-09-14T09:08:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894879+0000", 2024-09-14T09:08:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6160000000000004e-06 2024-09-14T09:08:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2840 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.900099+0000", 2024-09-14T09:08:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.008136562, 2024-09-14T09:08:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012360863999999999, 2024-09-14T09:08:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2840 2024-09-14T09:08:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900099+0000", 2024-09-14T09:08:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900099+0000", 2024-09-14T09:08:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900100+0000", 2024-09-14T09:08:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.15e-07 2024-09-14T09:08:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900101+0000", 2024-09-14T09:08:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.144e-06 2024-09-14T09:08:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900104+0000", 2024-09-14T09:08:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9409999999999999e-06 2024-09-14T09:08:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900106+0000", 2024-09-14T09:08:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6749999999999998e-06 2024-09-14T09:08:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2898 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.905471+0000", 2024-09-14T09:08:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0027645690000000001, 2024-09-14T09:08:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070371870000000003, 2024-09-14T09:08:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2898 2024-09-14T09:08:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905471+0000", 2024-09-14T09:08:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905471+0000", 2024-09-14T09:08:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905519+0000", 2024-09-14T09:08:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.808e-05 2024-09-14T09:08:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905523+0000", 2024-09-14T09:08:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2540000000000001e-06 2024-09-14T09:08:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905531+0000", 2024-09-14T09:08:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.524e-06 2024-09-14T09:08:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905541+0000", 2024-09-14T09:08:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3519999999999996e-06 2024-09-14T09:08:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2629 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.873846+0000", 2024-09-14T09:08:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.034389906999999997, 2024-09-14T09:08:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038708487, 2024-09-14T09:08:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2629 2024-09-14T09:08:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873846+0000", 2024-09-14T09:08:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873846+0000", 2024-09-14T09:08:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873847+0000", 2024-09-14T09:08:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8899999999999999e-07 2024-09-14T09:08:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873849+0000", 2024-09-14T09:08:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.272e-06 2024-09-14T09:08:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873855+0000", 2024-09-14T09:08:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2190000000000001e-06 2024-09-14T09:08:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873860+0000", 2024-09-14T09:08:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.746e-06 2024-09-14T09:08:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2661 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.880010+0000", 2024-09-14T09:08:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.028225921000000001, 2024-09-14T09:08:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032591151999999998, 2024-09-14T09:08:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2661 2024-09-14T09:08:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880010+0000", 2024-09-14T09:08:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880010+0000", 2024-09-14T09:08:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880011+0000", 2024-09-14T09:08:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3600000000000003e-07 2024-09-14T09:08:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880013+0000", 2024-09-14T09:08:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5179999999999999e-06 2024-09-14T09:08:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880021+0000", 2024-09-14T09:08:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:08:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880027+0000", 2024-09-14T09:08:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5130000000000004e-06 2024-09-14T09:08:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2719 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.884779+0000", 2024-09-14T09:08:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.023457364000000001, 2024-09-14T09:08:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027861521, 2024-09-14T09:08:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2719 2024-09-14T09:08:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884779+0000", 2024-09-14T09:08:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884779+0000", 2024-09-14T09:08:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884988+0000", 2024-09-14T09:08:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020956100000000001 2024-09-14T09:08:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884992+0000", 2024-09-14T09:08:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7759999999999999e-06 2024-09-14T09:08:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.884998+0000", 2024-09-14T09:08:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9429999999999997e-06 2024-09-14T09:08:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885002+0000", 2024-09-14T09:08:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2339999999999996e-06 2024-09-14T09:08:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2751 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.891092+0000", 2024-09-14T09:08:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017144375999999999, 2024-09-14T09:08:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021596934000000002, 2024-09-14T09:08:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2751 2024-09-14T09:08:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891092+0000", 2024-09-14T09:08:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891092+0000", 2024-09-14T09:08:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891092+0000", 2024-09-14T09:08:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1e-07 2024-09-14T09:08:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891093+0000", 2024-09-14T09:08:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1170000000000001e-06 2024-09-14T09:08:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891096+0000", 2024-09-14T09:08:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7779999999999999e-06 2024-09-14T09:08:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891098+0000", 2024-09-14T09:08:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.469e-06 2024-09-14T09:08:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2809 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.894887+0000", 2024-09-14T09:08:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.013348654999999999, 2024-09-14T09:08:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017847722, 2024-09-14T09:08:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2809 2024-09-14T09:08:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894887+0000", 2024-09-14T09:08:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.894887+0000", 2024-09-14T09:08:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895068+0000", 2024-09-14T09:08:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000180786 2024-09-14T09:08:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895071+0000", 2024-09-14T09:08:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4290000000000001e-06 2024-09-14T09:08:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895078+0000", 2024-09-14T09:08:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7610000000000002e-06 2024-09-14T09:08:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895084+0000", 2024-09-14T09:08:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0399999999999998e-06 2024-09-14T09:08:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2841 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.900110+0000", 2024-09-14T09:08:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0081264230000000007, 2024-09-14T09:08:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012674128, 2024-09-14T09:08:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2841 2024-09-14T09:08:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900110+0000", 2024-09-14T09:08:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900110+0000", 2024-09-14T09:08:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900237+0000", 2024-09-14T09:08:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012745399999999999 2024-09-14T09:08:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900241+0000", 2024-09-14T09:08:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3239999999999996e-06 2024-09-14T09:08:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900250+0000", 2024-09-14T09:08:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1949999999999992e-06 2024-09-14T09:08:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900257+0000", 2024-09-14T09:08:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1680000000000001e-06 2024-09-14T09:08:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2899 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.905550+0000", 2024-09-14T09:08:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0026856779999999999, 2024-09-14T09:08:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072779610000000003, 2024-09-14T09:08:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2899 2024-09-14T09:08:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905550+0000", 2024-09-14T09:08:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905550+0000", 2024-09-14T09:08:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905721+0000", 2024-09-14T09:08:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017053399999999999 2024-09-14T09:08:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905725+0000", 2024-09-14T09:08:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0810000000000004e-06 2024-09-14T09:08:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905734+0000", 2024-09-14T09:08:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1379999999999996e-06 2024-09-14T09:08:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905740+0000", 2024-09-14T09:08:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3029999999999996e-06 2024-09-14T09:08:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2630 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.873867+0000", 2024-09-14T09:08:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.034369196999999997, 2024-09-14T09:08:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039011982000000001, 2024-09-14T09:08:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2630 2024-09-14T09:08:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873867+0000", 2024-09-14T09:08:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.873867+0000", 2024-09-14T09:08:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874105+0000", 2024-09-14T09:08:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023814300000000001 2024-09-14T09:08:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874110+0000", 2024-09-14T09:08:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8199999999999996e-06 2024-09-14T09:08:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874121+0000", 2024-09-14T09:08:37.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1786e-05 2024-09-14T09:08:37.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874129+0000", 2024-09-14T09:08:37.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4460000000000004e-06 2024-09-14T09:08:37.252 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.252 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.252 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.252 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2662 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.880035+0000", 2024-09-14T09:08:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.028201315000000001, 2024-09-14T09:08:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032890236000000003, 2024-09-14T09:08:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2662 2024-09-14T09:08:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880035+0000", 2024-09-14T09:08:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880035+0000", 2024-09-14T09:08:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880035+0000", 2024-09-14T09:08:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9500000000000003e-07 2024-09-14T09:08:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880037+0000", 2024-09-14T09:08:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2649999999999999e-06 2024-09-14T09:08:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880044+0000", 2024-09-14T09:08:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4180000000000002e-06 2024-09-14T09:08:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880049+0000", 2024-09-14T09:08:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7720000000000002e-06 2024-09-14T09:08:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2720 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.885011+0000", 2024-09-14T09:08:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.023225069000000001, 2024-09-14T09:08:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027961109000000001, 2024-09-14T09:08:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2720 2024-09-14T09:08:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885011+0000", 2024-09-14T09:08:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885011+0000", 2024-09-14T09:08:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885086+0000", 2024-09-14T09:08:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5530000000000004e-05 2024-09-14T09:08:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885093+0000", 2024-09-14T09:08:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2169999999999999e-06 2024-09-14T09:08:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885098+0000", 2024-09-14T09:08:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5500000000000002e-06 2024-09-14T09:08:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885102+0000", 2024-09-14T09:08:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3730000000000001e-06 2024-09-14T09:08:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2752 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.891101+0000", 2024-09-14T09:08:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017134946000000002, 2024-09-14T09:08:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021894839999999999, 2024-09-14T09:08:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2752 2024-09-14T09:08:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891101+0000", 2024-09-14T09:08:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891101+0000", 2024-09-14T09:08:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891101+0000", 2024-09-14T09:08:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1e-07 2024-09-14T09:08:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891102+0000", 2024-09-14T09:08:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.64e-07 2024-09-14T09:08:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891105+0000", 2024-09-14T09:08:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7930000000000002e-06 2024-09-14T09:08:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891107+0000", 2024-09-14T09:08:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4980000000000001e-06 2024-09-14T09:08:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2810 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.895094+0000", 2024-09-14T09:08:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.013141964000000001, 2024-09-14T09:08:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017937109, 2024-09-14T09:08:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2810 2024-09-14T09:08:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895094+0000", 2024-09-14T09:08:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895094+0000", 2024-09-14T09:08:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895465+0000", 2024-09-14T09:08:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00037093800000000002 2024-09-14T09:08:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895469+0000", 2024-09-14T09:08:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4429999999999996e-06 2024-09-14T09:08:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895484+0000", 2024-09-14T09:08:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4177e-05 2024-09-14T09:08:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895491+0000", 2024-09-14T09:08:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8800000000000008e-06 2024-09-14T09:08:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2842 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.900274+0000", 2024-09-14T09:08:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0079623899999999997, 2024-09-14T09:08:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012805298, 2024-09-14T09:08:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2842 2024-09-14T09:08:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900274+0000", 2024-09-14T09:08:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900274+0000", 2024-09-14T09:08:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900503+0000", 2024-09-14T09:08:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000228982 2024-09-14T09:08:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900506+0000", 2024-09-14T09:08:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9140000000000001e-06 2024-09-14T09:08:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900515+0000", 2024-09-14T09:08:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4870000000000002e-06 2024-09-14T09:08:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900522+0000", 2024-09-14T09:08:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8190000000000003e-06 2024-09-14T09:08:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2900 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.905752+0000", 2024-09-14T09:08:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0024835439999999999, 2024-09-14T09:08:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073731550000000002, 2024-09-14T09:08:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2900 2024-09-14T09:08:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905752+0000", 2024-09-14T09:08:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.905752+0000", 2024-09-14T09:08:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906091+0000", 2024-09-14T09:08:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00033906300000000002 2024-09-14T09:08:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906095+0000", 2024-09-14T09:08:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.811e-06 2024-09-14T09:08:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906106+0000", 2024-09-14T09:08:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0763e-05 2024-09-14T09:08:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906113+0000", 2024-09-14T09:08:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.878e-06 2024-09-14T09:08:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2631 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.874142+0000", 2024-09-14T09:08:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.034093861000000003, 2024-09-14T09:08:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039035767999999998, 2024-09-14T09:08:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2631 2024-09-14T09:08:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874142+0000", 2024-09-14T09:08:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874142+0000", 2024-09-14T09:08:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874143+0000", 2024-09-14T09:08:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:08:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874145+0000", 2024-09-14T09:08:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.396e-06 2024-09-14T09:08:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874151+0000", 2024-09-14T09:08:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4930000000000003e-06 2024-09-14T09:08:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874157+0000", 2024-09-14T09:08:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0590000000000002e-06 2024-09-14T09:08:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2663 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.880058+0000", 2024-09-14T09:08:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.028178307, 2024-09-14T09:08:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.033160083, 2024-09-14T09:08:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2663 2024-09-14T09:08:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880058+0000", 2024-09-14T09:08:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880058+0000", 2024-09-14T09:08:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880058+0000", 2024-09-14T09:08:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1800000000000001e-07 2024-09-14T09:08:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880060+0000", 2024-09-14T09:08:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0200000000000001e-06 2024-09-14T09:08:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880068+0000", 2024-09-14T09:08:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4619999999999999e-06 2024-09-14T09:08:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880072+0000", 2024-09-14T09:08:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6809999999999997e-06 2024-09-14T09:08:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2721 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.885108+0000", 2024-09-14T09:08:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.023128202, 2024-09-14T09:08:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.028136561000000001, 2024-09-14T09:08:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2721 2024-09-14T09:08:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885108+0000", 2024-09-14T09:08:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885108+0000", 2024-09-14T09:08:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885207+0000", 2024-09-14T09:08:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9585000000000003e-05 2024-09-14T09:08:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885212+0000", 2024-09-14T09:08:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6229999999999996e-06 2024-09-14T09:08:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885223+0000", 2024-09-14T09:08:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0621e-05 2024-09-14T09:08:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885230+0000", 2024-09-14T09:08:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4970000000000004e-06 2024-09-14T09:08:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2753 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.891111+0000", 2024-09-14T09:08:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017125318, 2024-09-14T09:08:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022156840000000001, 2024-09-14T09:08:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2753 2024-09-14T09:08:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891111+0000", 2024-09-14T09:08:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891111+0000", 2024-09-14T09:08:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891111+0000", 2024-09-14T09:08:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:08:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891112+0000", 2024-09-14T09:08:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0589999999999999e-06 2024-09-14T09:08:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891115+0000", 2024-09-14T09:08:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.937e-06 2024-09-14T09:08:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891118+0000", 2024-09-14T09:08:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9229999999999998e-06 2024-09-14T09:08:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2811 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.895504+0000", 2024-09-14T09:08:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.012731841000000001, 2024-09-14T09:08:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017787549999999999, 2024-09-14T09:08:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2811 2024-09-14T09:08:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895504+0000", 2024-09-14T09:08:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895504+0000", 2024-09-14T09:08:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895505+0000", 2024-09-14T09:08:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5700000000000002e-07 2024-09-14T09:08:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895507+0000", 2024-09-14T09:08:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3800000000000001e-06 2024-09-14T09:08:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895514+0000", 2024-09-14T09:08:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8539999999999999e-06 2024-09-14T09:08:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895522+0000", 2024-09-14T09:08:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9880000000000004e-06 2024-09-14T09:08:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2843 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.900533+0000", 2024-09-14T09:08:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0077033450000000003, 2024-09-14T09:08:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012781595999999999, 2024-09-14T09:08:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2843 2024-09-14T09:08:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900533+0000", 2024-09-14T09:08:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900533+0000", 2024-09-14T09:08:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900533+0000", 2024-09-14T09:08:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9800000000000003e-07 2024-09-14T09:08:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900535+0000", 2024-09-14T09:08:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2120000000000002e-06 2024-09-14T09:08:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900543+0000", 2024-09-14T09:08:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1369999999999996e-06 2024-09-14T09:08:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900548+0000", 2024-09-14T09:08:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.694e-06 2024-09-14T09:08:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2901 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.906125+0000", 2024-09-14T09:08:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0021106570000000002, 2024-09-14T09:08:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072127129999999999, 2024-09-14T09:08:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2901 2024-09-14T09:08:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906125+0000", 2024-09-14T09:08:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906125+0000", 2024-09-14T09:08:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906126+0000", 2024-09-14T09:08:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.68e-07 2024-09-14T09:08:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906128+0000", 2024-09-14T09:08:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4150000000000002e-06 2024-09-14T09:08:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906133+0000", 2024-09-14T09:08:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0669999999999999e-06 2024-09-14T09:08:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906137+0000", 2024-09-14T09:08:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3500000000000001e-06 2024-09-14T09:08:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2632 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.874163+0000", 2024-09-14T09:08:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.034072700999999997, 2024-09-14T09:08:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039198825, 2024-09-14T09:08:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2632 2024-09-14T09:08:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874163+0000", 2024-09-14T09:08:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874163+0000", 2024-09-14T09:08:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874347+0000", 2024-09-14T09:08:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000183745 2024-09-14T09:08:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874351+0000", 2024-09-14T09:08:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.963e-06 2024-09-14T09:08:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874360+0000", 2024-09-14T09:08:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3360000000000001e-06 2024-09-14T09:08:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874368+0000", 2024-09-14T09:08:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5000000000000002e-06 2024-09-14T09:08:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2664 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.880079+0000", 2024-09-14T09:08:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.028156960000000002, 2024-09-14T09:08:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.033308028000000003, 2024-09-14T09:08:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2664 2024-09-14T09:08:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880079+0000", 2024-09-14T09:08:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880079+0000", 2024-09-14T09:08:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880079+0000", 2024-09-14T09:08:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.39e-07 2024-09-14T09:08:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880081+0000", 2024-09-14T09:08:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9910000000000001e-06 2024-09-14T09:08:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880088+0000", 2024-09-14T09:08:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0929999999999997e-06 2024-09-14T09:08:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880096+0000", 2024-09-14T09:08:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6290000000000001e-06 2024-09-14T09:08:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2722 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.885242+0000", 2024-09-14T09:08:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.022993880000000001, 2024-09-14T09:08:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.028171219000000001, 2024-09-14T09:08:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2722 2024-09-14T09:08:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885242+0000", 2024-09-14T09:08:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885242+0000", 2024-09-14T09:08:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885331+0000", 2024-09-14T09:08:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9022000000000002e-05 2024-09-14T09:08:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885334+0000", 2024-09-14T09:08:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9560000000000002e-06 2024-09-14T09:08:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885341+0000", 2024-09-14T09:08:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3479999999999998e-06 2024-09-14T09:08:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885347+0000", 2024-09-14T09:08:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8470000000000001e-06 2024-09-14T09:08:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2754 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.891121+0000", 2024-09-14T09:08:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017115319, 2024-09-14T09:08:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022336007000000001, 2024-09-14T09:08:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2754 2024-09-14T09:08:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891121+0000", 2024-09-14T09:08:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891121+0000", 2024-09-14T09:08:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891121+0000", 2024-09-14T09:08:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1e-07 2024-09-14T09:08:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891122+0000", 2024-09-14T09:08:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0410000000000001e-06 2024-09-14T09:08:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891125+0000", 2024-09-14T09:08:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9019999999999999e-06 2024-09-14T09:08:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891128+0000", 2024-09-14T09:08:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7470000000000001e-06 2024-09-14T09:08:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2812 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.895529+0000", 2024-09-14T09:08:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.012706459999999999, 2024-09-14T09:08:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017973187000000002, 2024-09-14T09:08:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2812 2024-09-14T09:08:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895529+0000", 2024-09-14T09:08:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895529+0000", 2024-09-14T09:08:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895590+0000", 2024-09-14T09:08:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0127999999999998e-05 2024-09-14T09:08:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895595+0000", 2024-09-14T09:08:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1479999999999997e-06 2024-09-14T09:08:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895603+0000", 2024-09-14T09:08:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.687e-06 2024-09-14T09:08:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895609+0000", 2024-09-14T09:08:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1209999999999998e-06 2024-09-14T09:08:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2844 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.900556+0000", 2024-09-14T09:08:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0076803990000000001, 2024-09-14T09:08:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01299261, 2024-09-14T09:08:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2844 2024-09-14T09:08:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900556+0000", 2024-09-14T09:08:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900556+0000", 2024-09-14T09:08:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900759+0000", 2024-09-14T09:08:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020344100000000001 2024-09-14T09:08:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900762+0000", 2024-09-14T09:08:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3550000000000001e-06 2024-09-14T09:08:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900771+0000", 2024-09-14T09:08:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5839999999999995e-06 2024-09-14T09:08:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900776+0000", 2024-09-14T09:08:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7870000000000001e-06 2024-09-14T09:08:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2902 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.906142+0000", 2024-09-14T09:08:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0020935060000000002, 2024-09-14T09:08:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0074550959999999996, 2024-09-14T09:08:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2902 2024-09-14T09:08:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906142+0000", 2024-09-14T09:08:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906142+0000", 2024-09-14T09:08:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906330+0000", 2024-09-14T09:08:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018713599999999999 2024-09-14T09:08:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906333+0000", 2024-09-14T09:08:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.546e-06 2024-09-14T09:08:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906341+0000", 2024-09-14T09:08:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9370000000000004e-06 2024-09-14T09:08:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906347+0000", 2024-09-14T09:08:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1940000000000003e-06 2024-09-14T09:08:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2633 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.874379+0000", 2024-09-14T09:08:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.033857195999999999, 2024-09-14T09:08:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039250175999999998, 2024-09-14T09:08:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2633 2024-09-14T09:08:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874379+0000", 2024-09-14T09:08:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874379+0000", 2024-09-14T09:08:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874437+0000", 2024-09-14T09:08:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8736000000000001e-05 2024-09-14T09:08:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874440+0000", 2024-09-14T09:08:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0120000000000001e-06 2024-09-14T09:08:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874449+0000", 2024-09-14T09:08:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1980000000000001e-06 2024-09-14T09:08:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874455+0000", 2024-09-14T09:08:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2009999999999996e-06 2024-09-14T09:08:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2665 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.880110+0000", 2024-09-14T09:08:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.028125651000000002, 2024-09-14T09:08:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.033544394999999998, 2024-09-14T09:08:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2665 2024-09-14T09:08:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880110+0000", 2024-09-14T09:08:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880110+0000", 2024-09-14T09:08:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880111+0000", 2024-09-14T09:08:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2500000000000001e-07 2024-09-14T09:08:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880113+0000", 2024-09-14T09:08:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.43e-06 2024-09-14T09:08:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880120+0000", 2024-09-14T09:08:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8739999999999997e-06 2024-09-14T09:08:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880125+0000", 2024-09-14T09:08:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3249999999999998e-06 2024-09-14T09:08:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2723 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.885355+0000", 2024-09-14T09:08:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.022881014000000002, 2024-09-14T09:08:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.028322792999999999, 2024-09-14T09:08:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2723 2024-09-14T09:08:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885355+0000", 2024-09-14T09:08:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885355+0000", 2024-09-14T09:08:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885442+0000", 2024-09-14T09:08:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7254000000000002e-05 2024-09-14T09:08:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885444+0000", 2024-09-14T09:08:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2800000000000002e-06 2024-09-14T09:08:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885450+0000", 2024-09-14T09:08:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0560000000000004e-06 2024-09-14T09:08:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885453+0000", 2024-09-14T09:08:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6090000000000001e-06 2024-09-14T09:08:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2755 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.891130+0000", 2024-09-14T09:08:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017105471000000001, 2024-09-14T09:08:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022571503, 2024-09-14T09:08:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2755 2024-09-14T09:08:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891130+0000", 2024-09-14T09:08:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891130+0000", 2024-09-14T09:08:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891131+0000", 2024-09-14T09:08:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0800000000000001e-07 2024-09-14T09:08:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891132+0000", 2024-09-14T09:08:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0100000000000001e-06 2024-09-14T09:08:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891134+0000", 2024-09-14T09:08:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7860000000000001e-06 2024-09-14T09:08:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891137+0000", 2024-09-14T09:08:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4770000000000002e-06 2024-09-14T09:08:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2813 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.895618+0000", 2024-09-14T09:08:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.012617735999999999, 2024-09-14T09:08:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018106819, 2024-09-14T09:08:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2813 2024-09-14T09:08:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895618+0000", 2024-09-14T09:08:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895618+0000", 2024-09-14T09:08:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895721+0000", 2024-09-14T09:08:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000102551 2024-09-14T09:08:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895723+0000", 2024-09-14T09:08:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5119999999999998e-06 2024-09-14T09:08:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895728+0000", 2024-09-14T09:08:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2259999999999996e-06 2024-09-14T09:08:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895732+0000", 2024-09-14T09:08:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5240000000000001e-06 2024-09-14T09:08:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2845 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.900787+0000", 2024-09-14T09:08:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0074487670000000002, 2024-09-14T09:08:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012962214999999999, 2024-09-14T09:08:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2845 2024-09-14T09:08:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900787+0000", 2024-09-14T09:08:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900787+0000", 2024-09-14T09:08:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900922+0000", 2024-09-14T09:08:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000135263 2024-09-14T09:08:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900925+0000", 2024-09-14T09:08:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.125e-06 2024-09-14T09:08:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900929+0000", 2024-09-14T09:08:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8550000000000001e-06 2024-09-14T09:08:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900934+0000", 2024-09-14T09:08:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4719999999999997e-06 2024-09-14T09:08:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2903 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.906358+0000", 2024-09-14T09:08:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.001878362, 2024-09-14T09:08:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0074144700000000003, 2024-09-14T09:08:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2903 2024-09-14T09:08:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906358+0000", 2024-09-14T09:08:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906358+0000", 2024-09-14T09:08:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906439+0000", 2024-09-14T09:08:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1390999999999994e-05 2024-09-14T09:08:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906448+0000", 2024-09-14T09:08:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1679999999999993e-06 2024-09-14T09:08:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906455+0000", 2024-09-14T09:08:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8120000000000002e-06 2024-09-14T09:08:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906459+0000", 2024-09-14T09:08:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8249999999999998e-06 2024-09-14T09:08:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2634 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.874465+0000", 2024-09-14T09:08:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.033771348999999999, 2024-09-14T09:08:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039338527999999998, 2024-09-14T09:08:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2634 2024-09-14T09:08:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874465+0000", 2024-09-14T09:08:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874465+0000", 2024-09-14T09:08:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874465+0000", 2024-09-14T09:08:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4999999999999998e-07 2024-09-14T09:08:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874467+0000", 2024-09-14T09:08:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9640000000000002e-06 2024-09-14T09:08:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874473+0000", 2024-09-14T09:08:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2260000000000002e-06 2024-09-14T09:08:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874478+0000", 2024-09-14T09:08:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9250000000000003e-06 2024-09-14T09:08:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2666 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.880134+0000", 2024-09-14T09:08:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.028102077, 2024-09-14T09:08:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.033714528000000001, 2024-09-14T09:08:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2666 2024-09-14T09:08:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880134+0000", 2024-09-14T09:08:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880134+0000", 2024-09-14T09:08:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880469+0000", 2024-09-14T09:08:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00033474600000000002 2024-09-14T09:08:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880473+0000", 2024-09-14T09:08:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4279999999999998e-06 2024-09-14T09:08:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880486+0000", 2024-09-14T09:08:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3219e-05 2024-09-14T09:08:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880496+0000", 2024-09-14T09:08:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0223e-05 2024-09-14T09:08:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2724 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.885460+0000", 2024-09-14T09:08:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.022776128999999999, 2024-09-14T09:08:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.028437625000000001, 2024-09-14T09:08:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2724 2024-09-14T09:08:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885460+0000", 2024-09-14T09:08:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885460+0000", 2024-09-14T09:08:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885631+0000", 2024-09-14T09:08:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000171521 2024-09-14T09:08:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885636+0000", 2024-09-14T09:08:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.177e-06 2024-09-14T09:08:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885646+0000", 2024-09-14T09:08:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0701e-05 2024-09-14T09:08:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885654+0000", 2024-09-14T09:08:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6299999999999998e-06 2024-09-14T09:08:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2756 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.891140+0000", 2024-09-14T09:08:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017096238999999999, 2024-09-14T09:08:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022804370000000001, 2024-09-14T09:08:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2756 2024-09-14T09:08:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891140+0000", 2024-09-14T09:08:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891140+0000", 2024-09-14T09:08:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891140+0000", 2024-09-14T09:08:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0200000000000001e-07 2024-09-14T09:08:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891144+0000", 2024-09-14T09:08:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5170000000000001e-06 2024-09-14T09:08:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891147+0000", 2024-09-14T09:08:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0189999999999998e-06 2024-09-14T09:08:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891150+0000", 2024-09-14T09:08:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4619999999999999e-06 2024-09-14T09:08:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2814 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.895738+0000", 2024-09-14T09:08:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.012497477, 2024-09-14T09:08:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018257270999999999, 2024-09-14T09:08:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2814 2024-09-14T09:08:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895738+0000", 2024-09-14T09:08:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895738+0000", 2024-09-14T09:08:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895845+0000", 2024-09-14T09:08:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106729 2024-09-14T09:08:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895848+0000", 2024-09-14T09:08:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.157e-06 2024-09-14T09:08:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895857+0000", 2024-09-14T09:08:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5150000000000006e-06 2024-09-14T09:08:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895864+0000", 2024-09-14T09:08:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.486e-06 2024-09-14T09:08:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2846 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.900940+0000", 2024-09-14T09:08:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0072959640000000003, 2024-09-14T09:08:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013080942999999999, 2024-09-14T09:08:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2846 2024-09-14T09:08:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900940+0000", 2024-09-14T09:08:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.900940+0000", 2024-09-14T09:08:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901114+0000", 2024-09-14T09:08:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017452799999999999 2024-09-14T09:08:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901118+0000", 2024-09-14T09:08:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4319999999999999e-06 2024-09-14T09:08:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901127+0000", 2024-09-14T09:08:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.816e-06 2024-09-14T09:08:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901133+0000", 2024-09-14T09:08:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7100000000000001e-06 2024-09-14T09:08:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2904 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.906467+0000", 2024-09-14T09:08:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.001769301, 2024-09-14T09:08:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0075788610000000001, 2024-09-14T09:08:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2904 2024-09-14T09:08:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906467+0000", 2024-09-14T09:08:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906467+0000", 2024-09-14T09:08:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906672+0000", 2024-09-14T09:08:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020567200000000001 2024-09-14T09:08:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906675+0000", 2024-09-14T09:08:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2809999999999998e-06 2024-09-14T09:08:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906681+0000", 2024-09-14T09:08:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1890000000000004e-06 2024-09-14T09:08:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906684+0000", 2024-09-14T09:08:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5130000000000001e-06 2024-09-14T09:08:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2635 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.874484+0000", 2024-09-14T09:08:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.033751799999999998, 2024-09-14T09:08:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039585777000000003, 2024-09-14T09:08:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2635 2024-09-14T09:08:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874484+0000", 2024-09-14T09:08:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874484+0000", 2024-09-14T09:08:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874781+0000", 2024-09-14T09:08:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00029706699999999998 2024-09-14T09:08:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874791+0000", 2024-09-14T09:08:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0084e-05 2024-09-14T09:08:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874803+0000", 2024-09-14T09:08:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1868999999999999e-05 2024-09-14T09:08:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874810+0000", 2024-09-14T09:08:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2069999999999998e-06 2024-09-14T09:08:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2667 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.880510+0000", 2024-09-14T09:08:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.027726194999999999, 2024-09-14T09:08:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.033585393999999998, 2024-09-14T09:08:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2667 2024-09-14T09:08:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880510+0000", 2024-09-14T09:08:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880510+0000", 2024-09-14T09:08:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880510+0000", 2024-09-14T09:08:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9299999999999998e-07 2024-09-14T09:08:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880513+0000", 2024-09-14T09:08:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6740000000000001e-06 2024-09-14T09:08:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880529+0000", 2024-09-14T09:08:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5950000000000001e-05 2024-09-14T09:08:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880539+0000", 2024-09-14T09:08:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0325e-05 2024-09-14T09:08:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2725 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.885666+0000", 2024-09-14T09:08:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.022570171999999999, 2024-09-14T09:08:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.028472448000000001, 2024-09-14T09:08:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2725 2024-09-14T09:08:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885666+0000", 2024-09-14T09:08:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885666+0000", 2024-09-14T09:08:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885666+0000", 2024-09-14T09:08:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2200000000000004e-07 2024-09-14T09:08:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885677+0000", 2024-09-14T09:08:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0387999999999999e-05 2024-09-14T09:08:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885685+0000", 2024-09-14T09:08:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1219999999999995e-06 2024-09-14T09:08:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885691+0000", 2024-09-14T09:08:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.083e-06 2024-09-14T09:08:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2757 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.891155+0000", 2024-09-14T09:08:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017080855999999998, 2024-09-14T09:08:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.023030110999999999, 2024-09-14T09:08:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2757 2024-09-14T09:08:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891155+0000", 2024-09-14T09:08:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891155+0000", 2024-09-14T09:08:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891156+0000", 2024-09-14T09:08:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3000000000000001e-07 2024-09-14T09:08:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891157+0000", 2024-09-14T09:08:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.844e-06 2024-09-14T09:08:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891162+0000", 2024-09-14T09:08:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1500000000000001e-06 2024-09-14T09:08:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891165+0000", 2024-09-14T09:08:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.765e-06 2024-09-14T09:08:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2815 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.895875+0000", 2024-09-14T09:08:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.012361336000000001, 2024-09-14T09:08:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018360527000000001, 2024-09-14T09:08:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2815 2024-09-14T09:08:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895875+0000", 2024-09-14T09:08:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895875+0000", 2024-09-14T09:08:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895984+0000", 2024-09-14T09:08:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000108989 2024-09-14T09:08:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895988+0000", 2024-09-14T09:08:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9890000000000003e-06 2024-09-14T09:08:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.895998+0000", 2024-09-14T09:08:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0129000000000001e-05 2024-09-14T09:08:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896013+0000", 2024-09-14T09:08:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5305e-05 2024-09-14T09:08:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2847 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.901143+0000", 2024-09-14T09:08:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0070926560000000001, 2024-09-14T09:08:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013138820000000001, 2024-09-14T09:08:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2847 2024-09-14T09:08:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901143+0000", 2024-09-14T09:08:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901143+0000", 2024-09-14T09:08:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901334+0000", 2024-09-14T09:08:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019064099999999999 2024-09-14T09:08:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901338+0000", 2024-09-14T09:08:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8940000000000003e-06 2024-09-14T09:08:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901347+0000", 2024-09-14T09:08:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5619999999999993e-06 2024-09-14T09:08:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901354+0000", 2024-09-14T09:08:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1489999999999999e-06 2024-09-14T09:08:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2905 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.906690+0000", 2024-09-14T09:08:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.001545439, 2024-09-14T09:08:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0077378680000000002, 2024-09-14T09:08:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2905 2024-09-14T09:08:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906690+0000", 2024-09-14T09:08:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906690+0000", 2024-09-14T09:08:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906909+0000", 2024-09-14T09:08:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000218462 2024-09-14T09:08:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906912+0000", 2024-09-14T09:08:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9490000000000001e-06 2024-09-14T09:08:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906921+0000", 2024-09-14T09:08:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4860000000000003e-06 2024-09-14T09:08:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906926+0000", 2024-09-14T09:08:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1919999999999998e-06 2024-09-14T09:08:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2636 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.874822+0000", 2024-09-14T09:08:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.033413540999999998, 2024-09-14T09:08:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039633122, 2024-09-14T09:08:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2636 2024-09-14T09:08:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874822+0000", 2024-09-14T09:08:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874822+0000", 2024-09-14T09:08:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874823+0000", 2024-09-14T09:08:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8700000000000005e-07 2024-09-14T09:08:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874826+0000", 2024-09-14T09:08:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4990000000000001e-06 2024-09-14T09:08:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874834+0000", 2024-09-14T09:08:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9219999999999997e-06 2024-09-14T09:08:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874839+0000", 2024-09-14T09:08:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5979999999999996e-06 2024-09-14T09:08:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2668 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.880553+0000", 2024-09-14T09:08:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.027682657999999999, 2024-09-14T09:08:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.033937369000000002, 2024-09-14T09:08:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2668 2024-09-14T09:08:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880553+0000", 2024-09-14T09:08:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880553+0000", 2024-09-14T09:08:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880685+0000", 2024-09-14T09:08:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000131507 2024-09-14T09:08:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880689+0000", 2024-09-14T09:08:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9439999999999998e-06 2024-09-14T09:08:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880699+0000", 2024-09-14T09:08:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.859e-06 2024-09-14T09:08:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880705+0000", 2024-09-14T09:08:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4790000000000001e-06 2024-09-14T09:08:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2726 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.885699+0000", 2024-09-14T09:08:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.022536859999999999, 2024-09-14T09:08:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.028836956, 2024-09-14T09:08:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2726 2024-09-14T09:08:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885699+0000", 2024-09-14T09:08:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885699+0000", 2024-09-14T09:08:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885725+0000", 2024-09-14T09:08:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5978000000000001e-05 2024-09-14T09:08:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885728+0000", 2024-09-14T09:08:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1410000000000001e-06 2024-09-14T09:08:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885737+0000", 2024-09-14T09:08:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3489999999999992e-06 2024-09-14T09:08:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885743+0000", 2024-09-14T09:08:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0789999999999997e-06 2024-09-14T09:08:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2758 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.891181+0000", 2024-09-14T09:08:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017055054, 2024-09-14T09:08:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.023404076999999999, 2024-09-14T09:08:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2758 2024-09-14T09:08:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891181+0000", 2024-09-14T09:08:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891181+0000", 2024-09-14T09:08:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891181+0000", 2024-09-14T09:08:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3300000000000003e-07 2024-09-14T09:08:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891183+0000", 2024-09-14T09:08:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0719999999999998e-06 2024-09-14T09:08:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891189+0000", 2024-09-14T09:08:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5319999999999997e-06 2024-09-14T09:08:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891201+0000", 2024-09-14T09:08:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2149e-05 2024-09-14T09:08:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2816 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.896026+0000", 2024-09-14T09:08:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.012210188, 2024-09-14T09:08:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018605127999999999, 2024-09-14T09:08:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2816 2024-09-14T09:08:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896026+0000", 2024-09-14T09:08:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896026+0000", 2024-09-14T09:08:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896026+0000", 2024-09-14T09:08:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3399999999999999e-07 2024-09-14T09:08:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896029+0000", 2024-09-14T09:08:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4719999999999998e-06 2024-09-14T09:08:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896036+0000", 2024-09-14T09:08:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4320000000000002e-06 2024-09-14T09:08:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896042+0000", 2024-09-14T09:08:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.913e-06 2024-09-14T09:08:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2848 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.901362+0000", 2024-09-14T09:08:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0068742320000000001, 2024-09-14T09:08:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013317271, 2024-09-14T09:08:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2848 2024-09-14T09:08:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901362+0000", 2024-09-14T09:08:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901362+0000", 2024-09-14T09:08:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901362+0000", 2024-09-14T09:08:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5499999999999998e-07 2024-09-14T09:08:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901364+0000", 2024-09-14T09:08:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.621e-06 2024-09-14T09:08:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901372+0000", 2024-09-14T09:08:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2279999999999998e-06 2024-09-14T09:08:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901375+0000", 2024-09-14T09:08:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2710000000000001e-06 2024-09-14T09:08:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2906 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.906935+0000", 2024-09-14T09:08:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0013007489999999999, 2024-09-14T09:08:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0077757190000000004, 2024-09-14T09:08:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2906 2024-09-14T09:08:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906935+0000", 2024-09-14T09:08:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.906935+0000", 2024-09-14T09:08:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.907160+0000", 2024-09-14T09:08:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022452400000000001 2024-09-14T09:08:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.907162+0000", 2024-09-14T09:08:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.615e-06 2024-09-14T09:08:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.907169+0000", 2024-09-14T09:08:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2559999999999999e-06 2024-09-14T09:08:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.907172+0000", 2024-09-14T09:08:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5580000000000001e-06 2024-09-14T09:08:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2637 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.874847+0000", 2024-09-14T09:08:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.033388685000000001, 2024-09-14T09:08:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039890491, 2024-09-14T09:08:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2637 2024-09-14T09:08:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874847+0000", 2024-09-14T09:08:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.874847+0000", 2024-09-14T09:08:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875041+0000", 2024-09-14T09:08:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019397300000000001 2024-09-14T09:08:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875046+0000", 2024-09-14T09:08:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3780000000000003e-06 2024-09-14T09:08:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875059+0000", 2024-09-14T09:08:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3845e-05 2024-09-14T09:08:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875066+0000", 2024-09-14T09:08:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8669999999999996e-06 2024-09-14T09:08:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2695 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.880716+0000", 2024-09-14T09:08:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.027519676999999999, 2024-09-14T09:08:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034045165000000002, 2024-09-14T09:08:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2695 2024-09-14T09:08:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880716+0000", 2024-09-14T09:08:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880716+0000", 2024-09-14T09:08:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880830+0000", 2024-09-14T09:08:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011404 2024-09-14T09:08:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880834+0000", 2024-09-14T09:08:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6710000000000001e-06 2024-09-14T09:08:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880845+0000", 2024-09-14T09:08:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1283e-05 2024-09-14T09:08:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880852+0000", 2024-09-14T09:08:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5200000000000003e-06 2024-09-14T09:08:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2727 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.885751+0000", 2024-09-14T09:08:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.022484443, 2024-09-14T09:08:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029033027999999999, 2024-09-14T09:08:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2727 2024-09-14T09:08:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885751+0000", 2024-09-14T09:08:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885751+0000", 2024-09-14T09:08:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885862+0000", 2024-09-14T09:08:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110443 2024-09-14T09:08:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885866+0000", 2024-09-14T09:08:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6839999999999998e-06 2024-09-14T09:08:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885875+0000", 2024-09-14T09:08:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5759999999999995e-06 2024-09-14T09:08:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885881+0000", 2024-09-14T09:08:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2659999999999998e-06 2024-09-14T09:08:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2759 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.891208+0000", 2024-09-14T09:08:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017027523999999999, 2024-09-14T09:08:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.023600632999999999, 2024-09-14T09:08:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2759 2024-09-14T09:08:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891208+0000", 2024-09-14T09:08:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891208+0000", 2024-09-14T09:08:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891466+0000", 2024-09-14T09:08:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025728099999999999 2024-09-14T09:08:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891469+0000", 2024-09-14T09:08:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3809999999999999e-06 2024-09-14T09:08:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891475+0000", 2024-09-14T09:08:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3999999999999997e-06 2024-09-14T09:08:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891480+0000", 2024-09-14T09:08:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0999999999999997e-06 2024-09-14T09:08:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2817 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.896049+0000", 2024-09-14T09:08:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.012186513, 2024-09-14T09:08:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01878258, 2024-09-14T09:08:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2817 2024-09-14T09:08:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896049+0000", 2024-09-14T09:08:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896049+0000", 2024-09-14T09:08:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896195+0000", 2024-09-14T09:08:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014588200000000001 2024-09-14T09:08:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896198+0000", 2024-09-14T09:08:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.18e-06 2024-09-14T09:08:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896206+0000", 2024-09-14T09:08:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4290000000000004e-06 2024-09-14T09:08:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896210+0000", 2024-09-14T09:08:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2579999999999997e-06 2024-09-14T09:08:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2849 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.901393+0000", 2024-09-14T09:08:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0068428669999999999, 2024-09-14T09:08:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013462834999999999, 2024-09-14T09:08:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2849 2024-09-14T09:08:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901393+0000", 2024-09-14T09:08:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901393+0000", 2024-09-14T09:08:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901583+0000", 2024-09-14T09:08:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000189612 2024-09-14T09:08:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901585+0000", 2024-09-14T09:08:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1730000000000002e-06 2024-09-14T09:08:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901590+0000", 2024-09-14T09:08:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8169999999999998e-06 2024-09-14T09:08:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901593+0000", 2024-09-14T09:08:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4369999999999999e-06 2024-09-14T09:08:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2907 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.907180+0000", 2024-09-14T09:08:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.001055781, 2024-09-14T09:08:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0077066720000000003, 2024-09-14T09:08:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2907 2024-09-14T09:08:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.907180+0000", 2024-09-14T09:08:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.907180+0000", 2024-09-14T09:08:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.907290+0000", 2024-09-14T09:08:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011031000000000001 2024-09-14T09:08:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.907295+0000", 2024-09-14T09:08:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3549999999999998e-06 2024-09-14T09:08:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.907305+0000", 2024-09-14T09:08:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7329999999999998e-06 2024-09-14T09:08:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.907311+0000", 2024-09-14T09:08:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7610000000000002e-06 2024-09-14T09:08:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2638 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.875078+0000", 2024-09-14T09:08:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.033157677000000003, 2024-09-14T09:08:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039857101999999998, 2024-09-14T09:08:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2638 2024-09-14T09:08:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875078+0000", 2024-09-14T09:08:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875078+0000", 2024-09-14T09:08:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875079+0000", 2024-09-14T09:08:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.13e-07 2024-09-14T09:08:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875081+0000", 2024-09-14T09:08:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4619999999999999e-06 2024-09-14T09:08:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875088+0000", 2024-09-14T09:08:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.596e-06 2024-09-14T09:08:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875093+0000", 2024-09-14T09:08:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3380000000000004e-06 2024-09-14T09:08:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2696 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.880865+0000", 2024-09-14T09:08:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.027370947, 2024-09-14T09:08:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034120877000000001, 2024-09-14T09:08:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2696 2024-09-14T09:08:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880865+0000", 2024-09-14T09:08:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.880865+0000", 2024-09-14T09:08:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881065+0000", 2024-09-14T09:08:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000200125 2024-09-14T09:08:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881076+0000", 2024-09-14T09:08:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0611999999999999e-05 2024-09-14T09:08:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881088+0000", 2024-09-14T09:08:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2084e-05 2024-09-14T09:08:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881095+0000", 2024-09-14T09:08:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5349999999999999e-06 2024-09-14T09:08:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2728 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.885892+0000", 2024-09-14T09:08:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.022344012999999999, 2024-09-14T09:08:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029142953999999999, 2024-09-14T09:08:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2728 2024-09-14T09:08:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885892+0000", 2024-09-14T09:08:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885892+0000", 2024-09-14T09:08:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885988+0000", 2024-09-14T09:08:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6440999999999994e-05 2024-09-14T09:08:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.885992+0000", 2024-09-14T09:08:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.506e-06 2024-09-14T09:08:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886002+0000", 2024-09-14T09:08:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6840000000000008e-06 2024-09-14T09:08:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886011+0000", 2024-09-14T09:08:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9949999999999994e-06 2024-09-14T09:08:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2760 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.891487+0000", 2024-09-14T09:08:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.016748580999999998, 2024-09-14T09:08:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.023592723999999999, 2024-09-14T09:08:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2760 2024-09-14T09:08:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891487+0000", 2024-09-14T09:08:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891487+0000", 2024-09-14T09:08:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891598+0000", 2024-09-14T09:08:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011107699999999999 2024-09-14T09:08:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891602+0000", 2024-09-14T09:08:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5990000000000002e-06 2024-09-14T09:08:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891610+0000", 2024-09-14T09:08:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8890000000000002e-06 2024-09-14T09:08:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891616+0000", 2024-09-14T09:08:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9390000000000002e-06 2024-09-14T09:08:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2818 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.896222+0000", 2024-09-14T09:08:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.012013562, 2024-09-14T09:08:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018887210000000001, 2024-09-14T09:08:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2818 2024-09-14T09:08:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896222+0000", 2024-09-14T09:08:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896222+0000", 2024-09-14T09:08:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896292+0000", 2024-09-14T09:08:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9715000000000006e-05 2024-09-14T09:08:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896299+0000", 2024-09-14T09:08:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8730000000000001e-06 2024-09-14T09:08:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896310+0000", 2024-09-14T09:08:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1046999999999999e-05 2024-09-14T09:08:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896316+0000", 2024-09-14T09:08:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8939999999999998e-06 2024-09-14T09:08:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2850 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.901599+0000", 2024-09-14T09:08:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0066366000000000003, 2024-09-14T09:08:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013533228, 2024-09-14T09:08:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2850 2024-09-14T09:08:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901599+0000", 2024-09-14T09:08:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901599+0000", 2024-09-14T09:08:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901839+0000", 2024-09-14T09:08:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023973399999999999 2024-09-14T09:08:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901842+0000", 2024-09-14T09:08:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9670000000000001e-06 2024-09-14T09:08:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901849+0000", 2024-09-14T09:08:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5509999999999996e-06 2024-09-14T09:08:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901854+0000", 2024-09-14T09:08:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0130000000000001e-06 2024-09-14T09:08:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2908 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.907324+0000", 2024-09-14T09:08:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00091212599999999997, 2024-09-14T09:08:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0078332039999999999, 2024-09-14T09:08:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2908 2024-09-14T09:08:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.907324+0000", 2024-09-14T09:08:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.907324+0000", 2024-09-14T09:08:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910277+0000", 2024-09-14T09:08:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0029534689999999998 2024-09-14T09:08:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910282+0000", 2024-09-14T09:08:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3409999999999996e-06 2024-09-14T09:08:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910291+0000", 2024-09-14T09:08:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0990000000000005e-06 2024-09-14T09:08:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910297+0000", 2024-09-14T09:08:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2419999999999997e-06 2024-09-14T09:08:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2639 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.875101+0000", 2024-09-14T09:08:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.033135018000000002, 2024-09-14T09:08:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040079987999999997, 2024-09-14T09:08:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2639 2024-09-14T09:08:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875101+0000", 2024-09-14T09:08:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875101+0000", 2024-09-14T09:08:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875232+0000", 2024-09-14T09:08:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013088299999999999 2024-09-14T09:08:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875236+0000", 2024-09-14T09:08:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3270000000000002e-06 2024-09-14T09:08:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875248+0000", 2024-09-14T09:08:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-09-14T09:08:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875255+0000", 2024-09-14T09:08:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4359999999999996e-06 2024-09-14T09:08:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2697 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.881107+0000", 2024-09-14T09:08:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.027128721000000001, 2024-09-14T09:08:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034102249000000001, 2024-09-14T09:08:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2697 2024-09-14T09:08:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881107+0000", 2024-09-14T09:08:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881107+0000", 2024-09-14T09:08:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881108+0000", 2024-09-14T09:08:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6700000000000003e-07 2024-09-14T09:08:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881110+0000", 2024-09-14T09:08:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5890000000000001e-06 2024-09-14T09:08:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881118+0000", 2024-09-14T09:08:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.255e-06 2024-09-14T09:08:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881123+0000", 2024-09-14T09:08:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7030000000000003e-06 2024-09-14T09:08:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2729 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.886020+0000", 2024-09-14T09:08:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.022215487999999999, 2024-09-14T09:08:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029234766999999998, 2024-09-14T09:08:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2729 2024-09-14T09:08:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886020+0000", 2024-09-14T09:08:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886020+0000", 2024-09-14T09:08:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886134+0000", 2024-09-14T09:08:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000113138 2024-09-14T09:08:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886136+0000", 2024-09-14T09:08:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.057e-06 2024-09-14T09:08:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886141+0000", 2024-09-14T09:08:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8949999999999997e-06 2024-09-14T09:08:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886144+0000", 2024-09-14T09:08:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.371e-06 2024-09-14T09:08:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2761 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.891625+0000", 2024-09-14T09:08:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.016610690000000001, 2024-09-14T09:08:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.023680046, 2024-09-14T09:08:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2761 2024-09-14T09:08:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891625+0000", 2024-09-14T09:08:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891625+0000", 2024-09-14T09:08:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891723+0000", 2024-09-14T09:08:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8249000000000001e-05 2024-09-14T09:08:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891726+0000", 2024-09-14T09:08:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.706e-06 2024-09-14T09:08:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891732+0000", 2024-09-14T09:08:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3249999999999998e-06 2024-09-14T09:08:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891735+0000", 2024-09-14T09:08:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8489999999999999e-06 2024-09-14T09:08:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2819 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.896327+0000", 2024-09-14T09:08:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.011908814, 2024-09-14T09:08:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019024823, 2024-09-14T09:08:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2819 2024-09-14T09:08:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896327+0000", 2024-09-14T09:08:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896327+0000", 2024-09-14T09:08:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896609+0000", 2024-09-14T09:08:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000281744 2024-09-14T09:08:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896613+0000", 2024-09-14T09:08:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4179999999999999e-06 2024-09-14T09:08:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896623+0000", 2024-09-14T09:08:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8190000000000003e-06 2024-09-14T09:08:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896630+0000", 2024-09-14T09:08:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8900000000000001e-06 2024-09-14T09:08:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2851 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.901864+0000", 2024-09-14T09:08:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0063724139999999999, 2024-09-14T09:08:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0135344, 2024-09-14T09:08:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2851 2024-09-14T09:08:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901864+0000", 2024-09-14T09:08:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901864+0000", 2024-09-14T09:08:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901979+0000", 2024-09-14T09:08:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000115754 2024-09-14T09:08:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901982+0000", 2024-09-14T09:08:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0920000000000002e-06 2024-09-14T09:08:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901990+0000", 2024-09-14T09:08:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.204e-06 2024-09-14T09:08:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.901994+0000", 2024-09-14T09:08:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9589999999999997e-06 2024-09-14T09:08:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2909 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.910310+0000", 2024-09-14T09:08:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9979258, 2024-09-14T09:08:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0051370069999999999, 2024-09-14T09:08:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2909 2024-09-14T09:08:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910310+0000", 2024-09-14T09:08:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910310+0000", 2024-09-14T09:08:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910311+0000", 2024-09-14T09:08:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5199999999999997e-07 2024-09-14T09:08:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910313+0000", 2024-09-14T09:08:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2500000000000001e-06 2024-09-14T09:08:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910319+0000", 2024-09-14T09:08:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0759999999999999e-06 2024-09-14T09:08:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910324+0000", 2024-09-14T09:08:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9269999999999996e-06 2024-09-14T09:08:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2640 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.875267+0000", 2024-09-14T09:08:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.032969066999999998, 2024-09-14T09:08:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040207410999999998, 2024-09-14T09:08:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2640 2024-09-14T09:08:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875267+0000", 2024-09-14T09:08:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875267+0000", 2024-09-14T09:08:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875320+0000", 2024-09-14T09:08:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3044999999999998e-05 2024-09-14T09:08:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875324+0000", 2024-09-14T09:08:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6519999999999999e-06 2024-09-14T09:08:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875333+0000", 2024-09-14T09:08:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0569999999999999e-06 2024-09-14T09:08:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875339+0000", 2024-09-14T09:08:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4130000000000003e-06 2024-09-14T09:08:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2698 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.881132+0000", 2024-09-14T09:08:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.027104380000000001, 2024-09-14T09:08:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034369681999999999, 2024-09-14T09:08:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2698 2024-09-14T09:08:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881132+0000", 2024-09-14T09:08:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881132+0000", 2024-09-14T09:08:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881434+0000", 2024-09-14T09:08:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030210399999999998 2024-09-14T09:08:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881438+0000", 2024-09-14T09:08:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1999999999999996e-06 2024-09-14T09:08:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881448+0000", 2024-09-14T09:08:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0020000000000001e-05 2024-09-14T09:08:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881459+0000", 2024-09-14T09:08:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0627e-05 2024-09-14T09:08:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2730 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.886152+0000", 2024-09-14T09:08:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.022083886, 2024-09-14T09:08:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029372795, 2024-09-14T09:08:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2730 2024-09-14T09:08:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886152+0000", 2024-09-14T09:08:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886152+0000", 2024-09-14T09:08:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886530+0000", 2024-09-14T09:08:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00037787399999999999 2024-09-14T09:08:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886534+0000", 2024-09-14T09:08:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9210000000000002e-06 2024-09-14T09:08:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886544+0000", 2024-09-14T09:08:37.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0582e-05 2024-09-14T09:08:37.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886552+0000", 2024-09-14T09:08:37.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9330000000000001e-06 2024-09-14T09:08:37.498 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.498 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.498 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2762 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.891743+0000", 2024-09-14T09:08:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.016493312, 2024-09-14T09:08:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.023806889000000001, 2024-09-14T09:08:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2762 2024-09-14T09:08:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891743+0000", 2024-09-14T09:08:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891743+0000", 2024-09-14T09:08:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891980+0000", 2024-09-14T09:08:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000237839 2024-09-14T09:08:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891984+0000", 2024-09-14T09:08:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6349999999999999e-06 2024-09-14T09:08:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.891996+0000", 2024-09-14T09:08:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2123999999999999e-05 2024-09-14T09:08:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892002+0000", 2024-09-14T09:08:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2149999999999998e-06 2024-09-14T09:08:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2820 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.896650+0000", 2024-09-14T09:08:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0115858, 2024-09-14T09:08:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018922122, 2024-09-14T09:08:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2820 2024-09-14T09:08:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896650+0000", 2024-09-14T09:08:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896650+0000", 2024-09-14T09:08:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896848+0000", 2024-09-14T09:08:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019812700000000001 2024-09-14T09:08:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896852+0000", 2024-09-14T09:08:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.258e-06 2024-09-14T09:08:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896861+0000", 2024-09-14T09:08:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1740000000000006e-06 2024-09-14T09:08:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896867+0000", 2024-09-14T09:08:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4180000000000002e-06 2024-09-14T09:08:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2852 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.902001+0000", 2024-09-14T09:08:37.506 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0062348769999999998, 2024-09-14T09:08:37.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0136005, 2024-09-14T09:08:37.506 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.506 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.506 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.506 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.506 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.506 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.506 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2852 2024-09-14T09:08:37.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.506 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902001+0000", 2024-09-14T09:08:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902001+0000", 2024-09-14T09:08:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902043+0000", 2024-09-14T09:08:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2011999999999997e-05 2024-09-14T09:08:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902045+0000", 2024-09-14T09:08:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0480000000000001e-06 2024-09-14T09:08:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902050+0000", 2024-09-14T09:08:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3720000000000004e-06 2024-09-14T09:08:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902054+0000", 2024-09-14T09:08:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3670000000000001e-06 2024-09-14T09:08:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2910 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.910334+0000", 2024-09-14T09:08:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9979019, 2024-09-14T09:08:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0053101490000000001, 2024-09-14T09:08:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2910 2024-09-14T09:08:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910334+0000", 2024-09-14T09:08:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910334+0000", 2024-09-14T09:08:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910334+0000", 2024-09-14T09:08:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0900000000000002e-07 2024-09-14T09:08:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910336+0000", 2024-09-14T09:08:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9999999999999999e-06 2024-09-14T09:08:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910342+0000", 2024-09-14T09:08:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0390000000000001e-06 2024-09-14T09:08:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910347+0000", 2024-09-14T09:08:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0640000000000001e-06 2024-09-14T09:08:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2641 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.875350+0000", 2024-09-14T09:08:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.032886321000000003, 2024-09-14T09:08:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040347230999999997, 2024-09-14T09:08:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2641 2024-09-14T09:08:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875350+0000", 2024-09-14T09:08:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875350+0000", 2024-09-14T09:08:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875538+0000", 2024-09-14T09:08:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018878800000000001 2024-09-14T09:08:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875543+0000", 2024-09-14T09:08:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2799999999999997e-06 2024-09-14T09:08:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875552+0000", 2024-09-14T09:08:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7839999999999998e-06 2024-09-14T09:08:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875558+0000", 2024-09-14T09:08:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8860000000000001e-06 2024-09-14T09:08:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2699 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.881476+0000", 2024-09-14T09:08:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.026759521000000001, 2024-09-14T09:08:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034269342000000001, 2024-09-14T09:08:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2699 2024-09-14T09:08:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881476+0000", 2024-09-14T09:08:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881476+0000", 2024-09-14T09:08:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881707+0000", 2024-09-14T09:08:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000230645 2024-09-14T09:08:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881710+0000", 2024-09-14T09:08:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0730000000000001e-06 2024-09-14T09:08:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881720+0000", 2024-09-14T09:08:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6239999999999997e-06 2024-09-14T09:08:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881726+0000", 2024-09-14T09:08:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5899999999999996e-06 2024-09-14T09:08:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2731 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.886564+0000", 2024-09-14T09:08:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.021672172999999999, 2024-09-14T09:08:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029232675, 2024-09-14T09:08:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2731 2024-09-14T09:08:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886564+0000", 2024-09-14T09:08:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886564+0000", 2024-09-14T09:08:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886564+0000", 2024-09-14T09:08:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999998e-07 2024-09-14T09:08:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886567+0000", 2024-09-14T09:08:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.373e-06 2024-09-14T09:08:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886583+0000", 2024-09-14T09:08:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6456e-05 2024-09-14T09:08:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886590+0000", 2024-09-14T09:08:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.613e-06 2024-09-14T09:08:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2789 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.892013+0000", 2024-09-14T09:08:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.01622256, 2024-09-14T09:08:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.023822274000000001, 2024-09-14T09:08:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2789 2024-09-14T09:08:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892013+0000", 2024-09-14T09:08:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892013+0000", 2024-09-14T09:08:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892103+0000", 2024-09-14T09:08:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9859999999999997e-05 2024-09-14T09:08:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892106+0000", 2024-09-14T09:08:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5600000000000001e-06 2024-09-14T09:08:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892114+0000", 2024-09-14T09:08:37.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1070000000000005e-06 2024-09-14T09:08:37.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892118+0000", 2024-09-14T09:08:37.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7570000000000002e-06 2024-09-14T09:08:37.525 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.525 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.525 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2821 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.896878+0000", 2024-09-14T09:08:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.011357986, 2024-09-14T09:08:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018985413999999999, 2024-09-14T09:08:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2821 2024-09-14T09:08:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896878+0000", 2024-09-14T09:08:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896878+0000", 2024-09-14T09:08:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896879+0000", 2024-09-14T09:08:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9500000000000002e-07 2024-09-14T09:08:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896881+0000", 2024-09-14T09:08:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5909999999999998e-06 2024-09-14T09:08:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896888+0000", 2024-09-14T09:08:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4860000000000002e-06 2024-09-14T09:08:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896893+0000", 2024-09-14T09:08:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.259e-06 2024-09-14T09:08:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2853 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.902070+0000", 2024-09-14T09:08:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.006166319, 2024-09-14T09:08:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013820226999999999, 2024-09-14T09:08:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2853 2024-09-14T09:08:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902070+0000", 2024-09-14T09:08:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902070+0000", 2024-09-14T09:08:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902191+0000", 2024-09-14T09:08:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000120915 2024-09-14T09:08:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902195+0000", 2024-09-14T09:08:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8119999999999998e-06 2024-09-14T09:08:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902200+0000", 2024-09-14T09:08:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6430000000000003e-06 2024-09-14T09:08:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902203+0000", 2024-09-14T09:08:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3720000000000001e-06 2024-09-14T09:08:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2911 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.910359+0000", 2024-09-14T09:08:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9978776, 2024-09-14T09:08:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055746229999999999, 2024-09-14T09:08:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2911 2024-09-14T09:08:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910359+0000", 2024-09-14T09:08:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910359+0000", 2024-09-14T09:08:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910359+0000", 2024-09-14T09:08:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4700000000000002e-07 2024-09-14T09:08:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910361+0000", 2024-09-14T09:08:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9099999999999999e-06 2024-09-14T09:08:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910367+0000", 2024-09-14T09:08:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9139999999999996e-06 2024-09-14T09:08:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910373+0000", 2024-09-14T09:08:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5690000000000001e-06 2024-09-14T09:08:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.536 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2642 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.536 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.875575+0000", 2024-09-14T09:08:37.536 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.032661192999999998, 2024-09-14T09:08:37.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040416015, 2024-09-14T09:08:37.536 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.536 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.536 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.536 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2642 2024-09-14T09:08:37.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.537 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875575+0000", 2024-09-14T09:08:37.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875575+0000", 2024-09-14T09:08:37.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875738+0000", 2024-09-14T09:08:37.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016366500000000001 2024-09-14T09:08:37.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875741+0000", 2024-09-14T09:08:37.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.083e-06 2024-09-14T09:08:37.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875749+0000", 2024-09-14T09:08:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2180000000000002e-06 2024-09-14T09:08:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875754+0000", 2024-09-14T09:08:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3040000000000004e-06 2024-09-14T09:08:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2700 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.881748+0000", 2024-09-14T09:08:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.026487595999999999, 2024-09-14T09:08:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034289625999999997, 2024-09-14T09:08:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2700 2024-09-14T09:08:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881748+0000", 2024-09-14T09:08:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881748+0000", 2024-09-14T09:08:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881749+0000", 2024-09-14T09:08:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0200000000000002e-07 2024-09-14T09:08:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881752+0000", 2024-09-14T09:08:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5919999999999999e-06 2024-09-14T09:08:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881758+0000", 2024-09-14T09:08:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.122e-06 2024-09-14T09:08:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881763+0000", 2024-09-14T09:08:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0900000000000004e-06 2024-09-14T09:08:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2732 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.886598+0000", 2024-09-14T09:08:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.021637996999999999, 2024-09-14T09:08:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029488587, 2024-09-14T09:08:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2732 2024-09-14T09:08:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886598+0000", 2024-09-14T09:08:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886598+0000", 2024-09-14T09:08:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886845+0000", 2024-09-14T09:08:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024743299999999997 2024-09-14T09:08:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886854+0000", 2024-09-14T09:08:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3149999999999992e-06 2024-09-14T09:08:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886861+0000", 2024-09-14T09:08:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7989999999999994e-06 2024-09-14T09:08:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886866+0000", 2024-09-14T09:08:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5199999999999999e-06 2024-09-14T09:08:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2790 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.892124+0000", 2024-09-14T09:08:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.01611172, 2024-09-14T09:08:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.024002808, 2024-09-14T09:08:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2790 2024-09-14T09:08:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892124+0000", 2024-09-14T09:08:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892124+0000", 2024-09-14T09:08:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892235+0000", 2024-09-14T09:08:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110623 2024-09-14T09:08:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892238+0000", 2024-09-14T09:08:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.678e-06 2024-09-14T09:08:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892244+0000", 2024-09-14T09:08:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3960000000000003e-06 2024-09-14T09:08:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892249+0000", 2024-09-14T09:08:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1549999999999998e-06 2024-09-14T09:08:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2822 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.896909+0000", 2024-09-14T09:08:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.01132654, 2024-09-14T09:08:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019245215, 2024-09-14T09:08:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2822 2024-09-14T09:08:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896909+0000", 2024-09-14T09:08:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.896909+0000", 2024-09-14T09:08:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897015+0000", 2024-09-14T09:08:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000105364 2024-09-14T09:08:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897019+0000", 2024-09-14T09:08:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8689999999999997e-06 2024-09-14T09:08:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897035+0000", 2024-09-14T09:08:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6872e-05 2024-09-14T09:08:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897042+0000", 2024-09-14T09:08:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6170000000000003e-06 2024-09-14T09:08:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2854 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.902214+0000", 2024-09-14T09:08:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0060223239999999999, 2024-09-14T09:08:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013964468000000001, 2024-09-14T09:08:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2854 2024-09-14T09:08:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902214+0000", 2024-09-14T09:08:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902214+0000", 2024-09-14T09:08:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902506+0000", 2024-09-14T09:08:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00029240199999999998 2024-09-14T09:08:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902509+0000", 2024-09-14T09:08:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4060000000000001e-06 2024-09-14T09:08:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902517+0000", 2024-09-14T09:08:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1230000000000002e-06 2024-09-14T09:08:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902521+0000", 2024-09-14T09:08:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5109999999999997e-06 2024-09-14T09:08:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2912 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.910383+0000", 2024-09-14T09:08:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9978523, 2024-09-14T09:08:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058236260000000001, 2024-09-14T09:08:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2912 2024-09-14T09:08:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910383+0000", 2024-09-14T09:08:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910383+0000", 2024-09-14T09:08:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910384+0000", 2024-09-14T09:08:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0200000000000002e-07 2024-09-14T09:08:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910386+0000", 2024-09-14T09:08:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.311e-06 2024-09-14T09:08:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910392+0000", 2024-09-14T09:08:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9680000000000003e-06 2024-09-14T09:08:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910398+0000", 2024-09-14T09:08:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1859999999999997e-06 2024-09-14T09:08:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2643 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.875762+0000", 2024-09-14T09:08:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.032473884000000001, 2024-09-14T09:08:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040491801000000001, 2024-09-14T09:08:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2643 2024-09-14T09:08:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875762+0000", 2024-09-14T09:08:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875762+0000", 2024-09-14T09:08:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875954+0000", 2024-09-14T09:08:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019181499999999999 2024-09-14T09:08:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875958+0000", 2024-09-14T09:08:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9419999999999997e-06 2024-09-14T09:08:37.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875977+0000", 2024-09-14T09:08:37.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9579e-05 2024-09-14T09:08:37.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875984+0000", 2024-09-14T09:08:37.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5289999999999997e-06 2024-09-14T09:08:37.563 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.563 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.563 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2701 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.881770+0000", 2024-09-14T09:08:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.026465546, 2024-09-14T09:08:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034533724000000002, 2024-09-14T09:08:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2701 2024-09-14T09:08:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881770+0000", 2024-09-14T09:08:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881770+0000", 2024-09-14T09:08:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881905+0000", 2024-09-14T09:08:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013488199999999999 2024-09-14T09:08:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881908+0000", 2024-09-14T09:08:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.886e-06 2024-09-14T09:08:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881913+0000", 2024-09-14T09:08:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0350000000000001e-06 2024-09-14T09:08:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881921+0000", 2024-09-14T09:08:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7849999999999992e-06 2024-09-14T09:08:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2733 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.886875+0000", 2024-09-14T09:08:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.021360715999999998, 2024-09-14T09:08:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029475241999999999, 2024-09-14T09:08:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2733 2024-09-14T09:08:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886875+0000", 2024-09-14T09:08:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886875+0000", 2024-09-14T09:08:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886993+0000", 2024-09-14T09:08:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000117796 2024-09-14T09:08:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.886997+0000", 2024-09-14T09:08:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0380000000000001e-06 2024-09-14T09:08:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887006+0000", 2024-09-14T09:08:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0799999999999995e-06 2024-09-14T09:08:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887012+0000", 2024-09-14T09:08:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.913e-06 2024-09-14T09:08:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.571 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2791 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.571 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.892257+0000", 2024-09-14T09:08:37.571 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.015978824999999999, 2024-09-14T09:08:37.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.024141728000000001, 2024-09-14T09:08:37.571 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.571 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.571 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.571 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.571 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.571 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.571 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2791 2024-09-14T09:08:37.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.571 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892257+0000", 2024-09-14T09:08:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892257+0000", 2024-09-14T09:08:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892368+0000", 2024-09-14T09:08:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110979 2024-09-14T09:08:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892372+0000", 2024-09-14T09:08:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0770000000000001e-06 2024-09-14T09:08:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892379+0000", 2024-09-14T09:08:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8020000000000003e-06 2024-09-14T09:08:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892383+0000", 2024-09-14T09:08:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8190000000000002e-06 2024-09-14T09:08:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2823 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897052+0000", 2024-09-14T09:08:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.011183576000000001, 2024-09-14T09:08:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019371629000000001, 2024-09-14T09:08:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2823 2024-09-14T09:08:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897052+0000", 2024-09-14T09:08:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897052+0000", 2024-09-14T09:08:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897149+0000", 2024-09-14T09:08:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6926e-05 2024-09-14T09:08:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897159+0000", 2024-09-14T09:08:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0046e-05 2024-09-14T09:08:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897170+0000", 2024-09-14T09:08:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.08e-05 2024-09-14T09:08:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897176+0000", 2024-09-14T09:08:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.818e-06 2024-09-14T09:08:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2855 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.902553+0000", 2024-09-14T09:08:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0056828970000000001, 2024-09-14T09:08:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013896169, 2024-09-14T09:08:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2855 2024-09-14T09:08:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902553+0000", 2024-09-14T09:08:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902553+0000", 2024-09-14T09:08:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902554+0000", 2024-09-14T09:08:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0200000000000002e-07 2024-09-14T09:08:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902556+0000", 2024-09-14T09:08:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0590000000000001e-06 2024-09-14T09:08:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902561+0000", 2024-09-14T09:08:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9869999999999999e-06 2024-09-14T09:08:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902564+0000", 2024-09-14T09:08:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2820000000000001e-06 2024-09-14T09:08:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2913 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.910405+0000", 2024-09-14T09:08:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9978304, 2024-09-14T09:08:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060674190000000001, 2024-09-14T09:08:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2913 2024-09-14T09:08:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910405+0000", 2024-09-14T09:08:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910405+0000", 2024-09-14T09:08:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910406+0000", 2024-09-14T09:08:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0999999999999999e-07 2024-09-14T09:08:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910408+0000", 2024-09-14T09:08:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.075e-06 2024-09-14T09:08:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910414+0000", 2024-09-14T09:08:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.613e-06 2024-09-14T09:08:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910419+0000", 2024-09-14T09:08:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5279999999999997e-06 2024-09-14T09:08:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2644 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.875996+0000", 2024-09-14T09:08:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.032240286, 2024-09-14T09:08:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040502359000000002, 2024-09-14T09:08:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2644 2024-09-14T09:08:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875996+0000", 2024-09-14T09:08:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.875996+0000", 2024-09-14T09:08:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876061+0000", 2024-09-14T09:08:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5733000000000002e-05 2024-09-14T09:08:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876065+0000", 2024-09-14T09:08:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.32e-06 2024-09-14T09:08:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876075+0000", 2024-09-14T09:08:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0219e-05 2024-09-14T09:08:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876081+0000", 2024-09-14T09:08:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0310000000000004e-06 2024-09-14T09:08:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2702 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.881934+0000", 2024-09-14T09:08:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.026302296999999999, 2024-09-14T09:08:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034587780999999998, 2024-09-14T09:08:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2702 2024-09-14T09:08:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881934+0000", 2024-09-14T09:08:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.881934+0000", 2024-09-14T09:08:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882142+0000", 2024-09-14T09:08:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020859900000000001 2024-09-14T09:08:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882147+0000", 2024-09-14T09:08:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3989999999999997e-06 2024-09-14T09:08:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882155+0000", 2024-09-14T09:08:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8419999999999994e-06 2024-09-14T09:08:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882162+0000", 2024-09-14T09:08:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2260000000000002e-06 2024-09-14T09:08:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2734 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.887023+0000", 2024-09-14T09:08:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.021213401, 2024-09-14T09:08:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029521789, 2024-09-14T09:08:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2734 2024-09-14T09:08:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887023+0000", 2024-09-14T09:08:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887023+0000", 2024-09-14T09:08:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887189+0000", 2024-09-14T09:08:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016619000000000001 2024-09-14T09:08:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887192+0000", 2024-09-14T09:08:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6200000000000001e-06 2024-09-14T09:08:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887201+0000", 2024-09-14T09:08:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3100000000000001e-06 2024-09-14T09:08:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887205+0000", 2024-09-14T09:08:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4660000000000001e-06 2024-09-14T09:08:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2792 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.892390+0000", 2024-09-14T09:08:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.015845643999999999, 2024-09-14T09:08:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.024178293, 2024-09-14T09:08:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2792 2024-09-14T09:08:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892390+0000", 2024-09-14T09:08:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892390+0000", 2024-09-14T09:08:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892620+0000", 2024-09-14T09:08:37.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022928400000000001 2024-09-14T09:08:37.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892623+0000", 2024-09-14T09:08:37.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4460000000000001e-06 2024-09-14T09:08:37.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892630+0000", 2024-09-14T09:08:37.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9140000000000002e-06 2024-09-14T09:08:37.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892636+0000", 2024-09-14T09:08:37.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6910000000000002e-06 2024-09-14T09:08:37.597 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.597 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.597 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.597 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2824 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.597 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897186+0000", 2024-09-14T09:08:37.597 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.011050199, 2024-09-14T09:08:37.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019415348999999998, 2024-09-14T09:08:37.597 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.598 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.598 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.598 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.598 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.598 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.598 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2824 2024-09-14T09:08:37.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.598 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897186+0000", 2024-09-14T09:08:37.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897186+0000", 2024-09-14T09:08:37.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897300+0000", 2024-09-14T09:08:37.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000114523 2024-09-14T09:08:37.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897304+0000", 2024-09-14T09:08:37.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6830000000000001e-06 2024-09-14T09:08:37.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897313+0000", 2024-09-14T09:08:37.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6519999999999995e-06 2024-09-14T09:08:37.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897319+0000", 2024-09-14T09:08:37.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0120000000000002e-06 2024-09-14T09:08:37.600 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.600 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.600 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.601 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2856 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.601 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.902568+0000", 2024-09-14T09:08:37.601 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0056676290000000004, 2024-09-14T09:08:37.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014081000999999999, 2024-09-14T09:08:37.601 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.601 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.601 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.601 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.601 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.601 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.601 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2856 2024-09-14T09:08:37.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.601 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902568+0000", 2024-09-14T09:08:37.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902568+0000", 2024-09-14T09:08:37.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902864+0000", 2024-09-14T09:08:37.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000295536 2024-09-14T09:08:37.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902867+0000", 2024-09-14T09:08:37.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7020000000000001e-06 2024-09-14T09:08:37.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902872+0000", 2024-09-14T09:08:37.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5940000000000001e-06 2024-09-14T09:08:37.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902876+0000", 2024-09-14T09:08:37.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.653e-06 2024-09-14T09:08:37.604 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.604 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.604 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.604 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2914 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.604 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.910427+0000", 2024-09-14T09:08:37.604 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9978094, 2024-09-14T09:08:37.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062700639999999997, 2024-09-14T09:08:37.604 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.604 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.604 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.605 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.605 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.605 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.605 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2914 2024-09-14T09:08:37.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.605 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910427+0000", 2024-09-14T09:08:37.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910427+0000", 2024-09-14T09:08:37.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910427+0000", 2024-09-14T09:08:37.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9000000000000002e-07 2024-09-14T09:08:37.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910429+0000", 2024-09-14T09:08:37.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0480000000000001e-06 2024-09-14T09:08:37.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910436+0000", 2024-09-14T09:08:37.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8210000000000004e-06 2024-09-14T09:08:37.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910440+0000", 2024-09-14T09:08:37.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.639e-06 2024-09-14T09:08:37.607 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.607 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.607 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.607 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2645 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.607 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.876089+0000", 2024-09-14T09:08:37.608 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.032146912999999999, 2024-09-14T09:08:37.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040657801, 2024-09-14T09:08:37.608 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.608 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.608 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.608 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.608 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.608 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.608 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2645 2024-09-14T09:08:37.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.608 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876089+0000", 2024-09-14T09:08:37.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876089+0000", 2024-09-14T09:08:37.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876281+0000", 2024-09-14T09:08:37.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000191492 2024-09-14T09:08:37.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876283+0000", 2024-09-14T09:08:37.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4200000000000001e-06 2024-09-14T09:08:37.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876290+0000", 2024-09-14T09:08:37.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6089999999999997e-06 2024-09-14T09:08:37.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876295+0000", 2024-09-14T09:08:37.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.327e-06 2024-09-14T09:08:37.610 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.610 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2703 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.882173+0000", 2024-09-14T09:08:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.026062440999999999, 2024-09-14T09:08:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034618748999999997, 2024-09-14T09:08:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2703 2024-09-14T09:08:37.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.612 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882173+0000", 2024-09-14T09:08:37.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882173+0000", 2024-09-14T09:08:37.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882450+0000", 2024-09-14T09:08:37.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00027690499999999998 2024-09-14T09:08:37.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882454+0000", 2024-09-14T09:08:37.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2619999999999999e-06 2024-09-14T09:08:37.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882460+0000", 2024-09-14T09:08:37.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1419999999999998e-06 2024-09-14T09:08:37.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882464+0000", 2024-09-14T09:08:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0779999999999997e-06 2024-09-14T09:08:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2735 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.887215+0000", 2024-09-14T09:08:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.021021201999999999, 2024-09-14T09:08:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029625496000000001, 2024-09-14T09:08:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2735 2024-09-14T09:08:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887215+0000", 2024-09-14T09:08:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887215+0000", 2024-09-14T09:08:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887423+0000", 2024-09-14T09:08:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000208517 2024-09-14T09:08:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887427+0000", 2024-09-14T09:08:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4979999999999998e-06 2024-09-14T09:08:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887435+0000", 2024-09-14T09:08:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1710000000000002e-06 2024-09-14T09:08:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887439+0000", 2024-09-14T09:08:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5469999999999998e-06 2024-09-14T09:08:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2793 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.892646+0000", 2024-09-14T09:08:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.01559023, 2024-09-14T09:08:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.024218396, 2024-09-14T09:08:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2793 2024-09-14T09:08:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892646+0000", 2024-09-14T09:08:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892646+0000", 2024-09-14T09:08:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892750+0000", 2024-09-14T09:08:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000104424 2024-09-14T09:08:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892753+0000", 2024-09-14T09:08:37.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7530000000000002e-06 2024-09-14T09:08:37.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892758+0000", 2024-09-14T09:08:37.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2719999999999997e-06 2024-09-14T09:08:37.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892763+0000", 2024-09-14T09:08:37.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9459999999999997e-06 2024-09-14T09:08:37.620 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2825 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897329+0000", 2024-09-14T09:08:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.010906808, 2024-09-14T09:08:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019560520000000001, 2024-09-14T09:08:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2825 2024-09-14T09:08:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897329+0000", 2024-09-14T09:08:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897329+0000", 2024-09-14T09:08:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898904+0000", 2024-09-14T09:08:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0015746460000000001 2024-09-14T09:08:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898907+0000", 2024-09-14T09:08:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6279999999999998e-06 2024-09-14T09:08:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898917+0000", 2024-09-14T09:08:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2909999999999996e-06 2024-09-14T09:08:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898924+0000", 2024-09-14T09:08:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4580000000000004e-06 2024-09-14T09:08:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2883 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.902882+0000", 2024-09-14T09:08:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0053534469999999999, 2024-09-14T09:08:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014032924, 2024-09-14T09:08:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2883 2024-09-14T09:08:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902882+0000", 2024-09-14T09:08:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902882+0000", 2024-09-14T09:08:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902965+0000", 2024-09-14T09:08:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2443999999999999e-05 2024-09-14T09:08:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902967+0000", 2024-09-14T09:08:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8789999999999999e-06 2024-09-14T09:08:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902973+0000", 2024-09-14T09:08:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1920000000000002e-06 2024-09-14T09:08:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902976+0000", 2024-09-14T09:08:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4680000000000001e-06 2024-09-14T09:08:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2915 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.910447+0000", 2024-09-14T09:08:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9977894, 2024-09-14T09:08:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0065176729999999999, 2024-09-14T09:08:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2915 2024-09-14T09:08:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910447+0000", 2024-09-14T09:08:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910447+0000", 2024-09-14T09:08:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910447+0000", 2024-09-14T09:08:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.89e-07 2024-09-14T09:08:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910455+0000", 2024-09-14T09:08:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3620000000000006e-06 2024-09-14T09:08:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910462+0000", 2024-09-14T09:08:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1090000000000003e-06 2024-09-14T09:08:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910469+0000", 2024-09-14T09:08:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8960000000000003e-06 2024-09-14T09:08:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2646 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.876327+0000", 2024-09-14T09:08:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.031908823000000003, 2024-09-14T09:08:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040685792999999998, 2024-09-14T09:08:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2646 2024-09-14T09:08:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876327+0000", 2024-09-14T09:08:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876327+0000", 2024-09-14T09:08:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876639+0000", 2024-09-14T09:08:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00031170599999999997 2024-09-14T09:08:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876644+0000", 2024-09-14T09:08:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8210000000000001e-06 2024-09-14T09:08:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876654+0000", 2024-09-14T09:08:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0766e-05 2024-09-14T09:08:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876662+0000", 2024-09-14T09:08:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3420000000000002e-06 2024-09-14T09:08:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2704 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.882473+0000", 2024-09-14T09:08:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.025762941000000001, 2024-09-14T09:08:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034588820999999999, 2024-09-14T09:08:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2704 2024-09-14T09:08:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882473+0000", 2024-09-14T09:08:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882473+0000", 2024-09-14T09:08:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882677+0000", 2024-09-14T09:08:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020384099999999999 2024-09-14T09:08:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882680+0000", 2024-09-14T09:08:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.835e-06 2024-09-14T09:08:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882689+0000", 2024-09-14T09:08:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5189999999999998e-06 2024-09-14T09:08:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882693+0000", 2024-09-14T09:08:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0099999999999997e-06 2024-09-14T09:08:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2736 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.887450+0000", 2024-09-14T09:08:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.020786243999999999, 2024-09-14T09:08:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029657685999999999, 2024-09-14T09:08:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2736 2024-09-14T09:08:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887450+0000", 2024-09-14T09:08:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887450+0000", 2024-09-14T09:08:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887450+0000", 2024-09-14T09:08:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3099999999999998e-07 2024-09-14T09:08:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887452+0000", 2024-09-14T09:08:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.421e-06 2024-09-14T09:08:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887455+0000", 2024-09-14T09:08:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8190000000000002e-06 2024-09-14T09:08:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887458+0000", 2024-09-14T09:08:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8499999999999998e-06 2024-09-14T09:08:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2794 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.892771+0000", 2024-09-14T09:08:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.01546543, 2024-09-14T09:08:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.024366334999999999, 2024-09-14T09:08:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2794 2024-09-14T09:08:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892771+0000", 2024-09-14T09:08:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892771+0000", 2024-09-14T09:08:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892880+0000", 2024-09-14T09:08:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010985299999999999 2024-09-14T09:08:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892888+0000", 2024-09-14T09:08:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.824e-06 2024-09-14T09:08:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892899+0000", 2024-09-14T09:08:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1219999999999999e-05 2024-09-14T09:08:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892905+0000", 2024-09-14T09:08:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9259999999999997e-06 2024-09-14T09:08:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2826 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898935+0000", 2024-09-14T09:08:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0093008469999999992, 2024-09-14T09:08:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018228600000000001, 2024-09-14T09:08:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2826 2024-09-14T09:08:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898935+0000", 2024-09-14T09:08:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898935+0000", 2024-09-14T09:08:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898935+0000", 2024-09-14T09:08:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.03e-07 2024-09-14T09:08:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898937+0000", 2024-09-14T09:08:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6700000000000001e-06 2024-09-14T09:08:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898941+0000", 2024-09-14T09:08:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.002e-06 2024-09-14T09:08:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898944+0000", 2024-09-14T09:08:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1650000000000002e-06 2024-09-14T09:08:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2884 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.902983+0000", 2024-09-14T09:08:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0052531590000000003, 2024-09-14T09:08:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014203917, 2024-09-14T09:08:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2884 2024-09-14T09:08:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902983+0000", 2024-09-14T09:08:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.902983+0000", 2024-09-14T09:08:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903245+0000", 2024-09-14T09:08:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026257400000000001 2024-09-14T09:08:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903248+0000", 2024-09-14T09:08:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5799999999999999e-06 2024-09-14T09:08:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903255+0000", 2024-09-14T09:08:37.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1760000000000004e-06 2024-09-14T09:08:37.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903259+0000", 2024-09-14T09:08:37.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.155e-06 2024-09-14T09:08:37.651 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.651 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.651 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.651 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2916 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.910478+0000", 2024-09-14T09:08:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9977584, 2024-09-14T09:08:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006734678, 2024-09-14T09:08:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2916 2024-09-14T09:08:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910478+0000", 2024-09-14T09:08:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910478+0000", 2024-09-14T09:08:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910478+0000", 2024-09-14T09:08:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3300000000000003e-07 2024-09-14T09:08:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910480+0000", 2024-09-14T09:08:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0049999999999999e-06 2024-09-14T09:08:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910487+0000", 2024-09-14T09:08:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7739999999999999e-06 2024-09-14T09:08:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910491+0000", 2024-09-14T09:08:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6460000000000001e-06 2024-09-14T09:08:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2647 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.876674+0000", 2024-09-14T09:08:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.031561786000000001, 2024-09-14T09:08:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040562385999999999, 2024-09-14T09:08:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2647 2024-09-14T09:08:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876674+0000", 2024-09-14T09:08:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876674+0000", 2024-09-14T09:08:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876742+0000", 2024-09-14T09:08:37.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8146999999999997e-05 2024-09-14T09:08:37.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876751+0000", 2024-09-14T09:08:37.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3319999999999992e-06 2024-09-14T09:08:37.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876760+0000", 2024-09-14T09:08:37.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3360000000000001e-06 2024-09-14T09:08:37.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876767+0000", 2024-09-14T09:08:37.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.674e-06 2024-09-14T09:08:37.658 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.658 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.658 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.658 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2705 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.658 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.882701+0000", 2024-09-14T09:08:37.658 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.025534925999999999, 2024-09-14T09:08:37.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034560179000000003, 2024-09-14T09:08:37.658 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.659 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.659 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.659 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.659 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.659 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.659 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2705 2024-09-14T09:08:37.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.659 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882701+0000", 2024-09-14T09:08:37.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882701+0000", 2024-09-14T09:08:37.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882701+0000", 2024-09-14T09:08:37.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2300000000000002e-07 2024-09-14T09:08:37.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882703+0000", 2024-09-14T09:08:37.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3349999999999999e-06 2024-09-14T09:08:37.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882706+0000", 2024-09-14T09:08:37.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6399999999999999e-06 2024-09-14T09:08:37.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882709+0000", 2024-09-14T09:08:37.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7010000000000001e-06 2024-09-14T09:08:37.661 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.661 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.661 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.661 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2737 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.662 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.887462+0000", 2024-09-14T09:08:37.662 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.020773678, 2024-09-14T09:08:37.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.029821977999999999, 2024-09-14T09:08:37.662 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.662 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.662 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.662 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.662 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.662 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.662 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2737 2024-09-14T09:08:37.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.662 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887462+0000", 2024-09-14T09:08:37.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887462+0000", 2024-09-14T09:08:37.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887701+0000", 2024-09-14T09:08:37.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023842700000000001 2024-09-14T09:08:37.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887704+0000", 2024-09-14T09:08:37.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0429999999999999e-06 2024-09-14T09:08:37.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887717+0000", 2024-09-14T09:08:37.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3029e-05 2024-09-14T09:08:37.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887723+0000", 2024-09-14T09:08:37.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3860000000000004e-06 2024-09-14T09:08:37.665 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.665 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.665 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.665 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2795 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.665 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.892916+0000", 2024-09-14T09:08:37.665 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.015320014999999999, 2024-09-14T09:08:37.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.024402737000000001, 2024-09-14T09:08:37.665 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.665 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.665 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.665 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2795 2024-09-14T09:08:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892916+0000", 2024-09-14T09:08:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.892916+0000", 2024-09-14T09:08:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893015+0000", 2024-09-14T09:08:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8734999999999996e-05 2024-09-14T09:08:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893018+0000", 2024-09-14T09:08:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2030000000000001e-06 2024-09-14T09:08:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893029+0000", 2024-09-14T09:08:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1411e-05 2024-09-14T09:08:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893034+0000", 2024-09-14T09:08:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2860000000000001e-06 2024-09-14T09:08:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2827 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898948+0000", 2024-09-14T09:08:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0092875649999999994, 2024-09-14T09:08:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018415693, 2024-09-14T09:08:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2827 2024-09-14T09:08:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898948+0000", 2024-09-14T09:08:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898948+0000", 2024-09-14T09:08:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898949+0000", 2024-09-14T09:08:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3200000000000001e-07 2024-09-14T09:08:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898950+0000", 2024-09-14T09:08:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1659999999999999e-06 2024-09-14T09:08:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898953+0000", 2024-09-14T09:08:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.05e-06 2024-09-14T09:08:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898955+0000", 2024-09-14T09:08:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4820000000000001e-06 2024-09-14T09:08:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2885 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.903266+0000", 2024-09-14T09:08:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0049696289999999997, 2024-09-14T09:08:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014147346999999999, 2024-09-14T09:08:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2885 2024-09-14T09:08:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903266+0000", 2024-09-14T09:08:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903266+0000", 2024-09-14T09:08:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903452+0000", 2024-09-14T09:08:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000185744 2024-09-14T09:08:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903455+0000", 2024-09-14T09:08:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0230000000000001e-06 2024-09-14T09:08:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903463+0000", 2024-09-14T09:08:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5399999999999998e-06 2024-09-14T09:08:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903468+0000", 2024-09-14T09:08:37.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8139999999999997e-06 2024-09-14T09:08:37.675 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.675 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.675 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.675 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2917 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.675 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.910517+0000", 2024-09-14T09:08:37.675 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9977193, 2024-09-14T09:08:37.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00694321, 2024-09-14T09:08:37.675 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.675 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.675 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.676 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.676 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.676 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.676 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2917 2024-09-14T09:08:37.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.676 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910517+0000", 2024-09-14T09:08:37.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910517+0000", 2024-09-14T09:08:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910517+0000", 2024-09-14T09:08:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4900000000000001e-07 2024-09-14T09:08:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910519+0000", 2024-09-14T09:08:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8029999999999999e-06 2024-09-14T09:08:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910523+0000", 2024-09-14T09:08:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1649999999999999e-06 2024-09-14T09:08:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910526+0000", 2024-09-14T09:08:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8770000000000002e-06 2024-09-14T09:08:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2648 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.876777+0000", 2024-09-14T09:08:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.031458749000000001, 2024-09-14T09:08:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040725813999999999, 2024-09-14T09:08:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2648 2024-09-14T09:08:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876777+0000", 2024-09-14T09:08:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876777+0000", 2024-09-14T09:08:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876832+0000", 2024-09-14T09:08:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4956e-05 2024-09-14T09:08:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876836+0000", 2024-09-14T09:08:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3629999999999998e-06 2024-09-14T09:08:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876846+0000", 2024-09-14T09:08:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0842000000000001e-05 2024-09-14T09:08:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.876853+0000", 2024-09-14T09:08:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3949999999999998e-06 2024-09-14T09:08:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2706 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.882713+0000", 2024-09-14T09:08:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.025523345999999999, 2024-09-14T09:08:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034814943000000001, 2024-09-14T09:08:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2706 2024-09-14T09:08:37.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.683 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882713+0000", 2024-09-14T09:08:37.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882713+0000", 2024-09-14T09:08:37.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882786+0000", 2024-09-14T09:08:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3498999999999995e-05 2024-09-14T09:08:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882789+0000", 2024-09-14T09:08:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1820000000000002e-06 2024-09-14T09:08:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882798+0000", 2024-09-14T09:08:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9700000000000005e-06 2024-09-14T09:08:37.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.882805+0000", 2024-09-14T09:08:37.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4590000000000003e-06 2024-09-14T09:08:37.685 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.685 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.685 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.685 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2738 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.685 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.887734+0000", 2024-09-14T09:08:37.685 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.020501696999999999, 2024-09-14T09:08:37.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.02981806, 2024-09-14T09:08:37.686 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.686 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.686 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.686 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.686 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.686 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.686 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2738 2024-09-14T09:08:37.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.686 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887734+0000", 2024-09-14T09:08:37.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887734+0000", 2024-09-14T09:08:37.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887735+0000", 2024-09-14T09:08:37.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2600000000000002e-07 2024-09-14T09:08:37.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887737+0000", 2024-09-14T09:08:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3520000000000001e-06 2024-09-14T09:08:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887744+0000", 2024-09-14T09:08:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6019999999999996e-06 2024-09-14T09:08:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.887749+0000", 2024-09-14T09:08:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1760000000000001e-06 2024-09-14T09:08:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.689 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2796 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.689 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.893041+0000", 2024-09-14T09:08:37.689 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.015194829, 2024-09-14T09:08:37.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.024535543, 2024-09-14T09:08:37.689 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.689 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.689 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.689 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.689 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.689 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.689 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2796 2024-09-14T09:08:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893041+0000", 2024-09-14T09:08:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893041+0000", 2024-09-14T09:08:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893147+0000", 2024-09-14T09:08:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000105709 2024-09-14T09:08:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893150+0000", 2024-09-14T09:08:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.269e-06 2024-09-14T09:08:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893157+0000", 2024-09-14T09:08:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.703e-06 2024-09-14T09:08:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.893162+0000", 2024-09-14T09:08:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6010000000000002e-06 2024-09-14T09:08:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2828 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898966+0000", 2024-09-14T09:08:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0092696199999999992, 2024-09-14T09:08:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018634797000000002, 2024-09-14T09:08:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2828 2024-09-14T09:08:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898966+0000", 2024-09-14T09:08:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898966+0000", 2024-09-14T09:08:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898967+0000", 2024-09-14T09:08:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.34e-07 2024-09-14T09:08:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898969+0000", 2024-09-14T09:08:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8190000000000001e-06 2024-09-14T09:08:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898974+0000", 2024-09-14T09:08:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.366e-06 2024-09-14T09:08:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898977+0000", 2024-09-14T09:08:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8250000000000001e-06 2024-09-14T09:08:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2886 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.903479+0000", 2024-09-14T09:08:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0047570299999999998, 2024-09-14T09:08:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014157252, 2024-09-14T09:08:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2886 2024-09-14T09:08:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903479+0000", 2024-09-14T09:08:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903479+0000", 2024-09-14T09:08:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903479+0000", 2024-09-14T09:08:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3900000000000005e-07 2024-09-14T09:08:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903482+0000", 2024-09-14T09:08:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1849999999999998e-06 2024-09-14T09:08:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903488+0000", 2024-09-14T09:08:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4169999999999997e-06 2024-09-14T09:08:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.903493+0000", 2024-09-14T09:08:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2469999999999999e-06 2024-09-14T09:08:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2918 3.10 3.b52e2870 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.910530+0000", 2024-09-14T09:08:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9977059, 2024-09-14T09:08:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071522010000000004, 2024-09-14T09:08:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:08:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2918 2024-09-14T09:08:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910530+0000", 2024-09-14T09:08:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910530+0000", 2024-09-14T09:08:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910530+0000", 2024-09-14T09:08:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0600000000000001e-07 2024-09-14T09:08:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910531+0000", 2024-09-14T09:08:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0610000000000001e-06 2024-09-14T09:08:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910534+0000", 2024-09-14T09:08:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.016e-06 2024-09-14T09:08:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:37.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.910537+0000", 2024-09-14T09:08:37.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5050000000000002e-06 2024-09-14T09:08:37.702 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.702 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:37.702 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.702 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:37.702 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:08:37.702 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 229 2024-09-14T09:08:37.702 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:37.702 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:36.925+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:37.703 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:08:37.704 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T09:08:37.704 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:08:37.708 INFO:teuthology.orchestra.run.smithi148.stdout:3504 write 0xc6d4000 thru 0xc6e0852 (0xc853 bytes) 2024-09-14T09:08:37.708 INFO:teuthology.orchestra.run.smithi148.stdout:3505 trunc from 0xc6e0a00 to 0x4eb3400 2024-09-14T09:08:37.708 INFO:teuthology.orchestra.run.smithi148.stdout:3507 trunc from 0x4eb3400 to 0x42a4c00 2024-09-14T09:08:37.708 INFO:teuthology.orchestra.run.smithi148.stdout:3512 write 0xdd63400 thru 0xdd64ea0 (0x1aa1 bytes) 2024-09-14T09:08:37.708 INFO:teuthology.orchestra.run.smithi148.stdout:3513 read 0x4e87e00 thru 0x4e96885 (0xea86 bytes) 2024-09-14T09:08:37.708 INFO:teuthology.orchestra.run.smithi148.stdout:3514 write 0x6a04a00 thru 0x6a0540a (0xa0b bytes) 2024-09-14T09:08:37.708 INFO:teuthology.orchestra.run.smithi148.stdout:3515 read 0xb957000 thru 0xb963d3d (0xcd3e bytes) 2024-09-14T09:08:37.708 INFO:teuthology.orchestra.run.smithi148.stdout:3517 punch from 0x3fc1200 to 0x3fca600, (0x9400 bytes) 2024-09-14T09:08:37.709 INFO:teuthology.orchestra.run.smithi148.stdout:3518 read 0x3352800 thru 0x335864d (0x5e4e bytes) 2024-09-14T09:08:37.709 INFO:teuthology.orchestra.run.smithi148.stdout:3520 punch from 0xc237400 to 0xc244000, (0xcc00 bytes) 2024-09-14T09:08:37.709 INFO:teuthology.orchestra.run.smithi148.stdout:3523 trunc from 0xdd65000 to 0x724ac00 2024-09-14T09:08:37.709 INFO:teuthology.orchestra.run.smithi148.stdout:3524 trunc from 0x724ac00 to 0xe7e8000 2024-09-14T09:08:37.709 INFO:teuthology.orchestra.run.smithi148.stdout:3528 read 0x301a800 thru 0x30259f4 (0xb1f5 bytes) 2024-09-14T09:08:37.709 INFO:teuthology.orchestra.run.smithi148.stdout:3529 read 0x153ee00 thru 0x154be65 (0xd066 bytes) 2024-09-14T09:08:37.709 INFO:teuthology.orchestra.run.smithi148.stdout:3530 write 0xc74b800 thru 0xc753e9e (0x869f bytes) 2024-09-14T09:08:37.709 INFO:teuthology.orchestra.run.smithi148.stdout:3531 write 0x571bc00 thru 0x57243c4 (0x87c5 bytes) 2024-09-14T09:08:37.709 INFO:teuthology.orchestra.run.smithi148.stdout:3533 read 0x7452a00 thru 0x7452d61 (0x362 bytes) 2024-09-14T09:08:37.709 INFO:teuthology.orchestra.run.smithi148.stdout:3535 write 0x3990000 thru 0x39936d1 (0x36d2 bytes) 2024-09-14T09:08:37.709 INFO:teuthology.orchestra.run.smithi148.stdout:3537 read 0xc926800 thru 0xc928ce8 (0x24e9 bytes) 2024-09-14T09:08:37.709 INFO:teuthology.orchestra.run.smithi148.stdout:3538 write 0x5481600 thru 0x548922b (0x7c2c bytes) 2024-09-14T09:08:37.709 INFO:teuthology.orchestra.run.smithi148.stdout:3539 punch from 0x5076c00 to 0x507b800, (0x4c00 bytes) 2024-09-14T09:08:37.709 INFO:teuthology.orchestra.run.smithi148.stdout:3541 write 0x47c7600 thru 0x47cdef3 (0x68f4 bytes) 2024-09-14T09:08:37.709 INFO:teuthology.orchestra.run.smithi148.stdout:3542 punch from 0x7ca9600 to 0x7ca9800, (0x200 bytes) 2024-09-14T09:08:37.710 INFO:teuthology.orchestra.run.smithi148.stdout:3543 write 0x1703000 thru 0x170556b (0x256c bytes) 2024-09-14T09:08:37.710 INFO:teuthology.orchestra.run.smithi148.stdout:3545 trunc from 0xe7e8000 to 0xa72e600 2024-09-14T09:08:37.710 INFO:teuthology.orchestra.run.smithi148.stdout:3546 trunc from 0xa72e600 to 0x5c6f400 2024-09-14T09:08:37.710 INFO:teuthology.orchestra.run.smithi148.stdout:3547 write 0xe6eea00 thru 0xe6f6711 (0x7d12 bytes) 2024-09-14T09:08:37.710 INFO:teuthology.orchestra.run.smithi148.stdout:3548 write 0x2ae3400 thru 0x2aee649 (0xb24a bytes) 2024-09-14T09:08:37.710 INFO:teuthology.orchestra.run.smithi148.stdout:3549 read 0x5ea6000 thru 0x5eac9ac (0x69ad bytes) 2024-09-14T09:08:37.710 INFO:teuthology.orchestra.run.smithi148.stdout:3550 write 0x2f0cc00 thru 0x2f12126 (0x5527 bytes) 2024-09-14T09:08:37.710 INFO:teuthology.orchestra.run.smithi148.stdout:3552 read 0xbaf2200 thru 0xbb002a5 (0xe0a6 bytes) 2024-09-14T09:08:37.710 INFO:teuthology.orchestra.run.smithi148.stdout:3555 read 0x882a000 thru 0x882e05a (0x405b bytes) 2024-09-14T09:08:37.710 INFO:teuthology.orchestra.run.smithi148.stdout:3556 punch from 0x2757200 to 0x275ea00, (0x7800 bytes) 2024-09-14T09:08:37.710 INFO:teuthology.orchestra.run.smithi148.stdout:3559 trunc from 0xe6f6800 to 0x19aca00 2024-09-14T09:08:37.711 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:37.706+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:37.806 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:37.808+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:37.842 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:37.843 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:37.843 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:37.843 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:37.843 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:37.852 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:08:37.862 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:37.862 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:37.881 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:37.881 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:37.907 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:37.909+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:37.924 INFO:teuthology.orchestra.run.smithi148.stdout:3560 read 0x44f800 thru 0x45970b (0x9f0c bytes) 2024-09-14T09:08:37.928 INFO:teuthology.orchestra.run.smithi148.stdout:3561 read 0x127c200 thru 0x1283c2a (0x7a2b bytes) 2024-09-14T09:08:37.929 INFO:teuthology.orchestra.run.smithi148.stdout:3567 read 0x15adc00 thru 0x15b01f8 (0x25f9 bytes) 2024-09-14T09:08:37.956 INFO:teuthology.orchestra.run.smithi148.stdout:3571 write 0xde3b600 thru 0xde48676 (0xd077 bytes) 2024-09-14T09:08:37.961 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:37.961 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:37.963 INFO:teuthology.orchestra.run.smithi148.stdout:3573 read 0xcecb200 thru 0xcecc316 (0x1117 bytes) 2024-09-14T09:08:37.972 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:08:37.977 INFO:teuthology.orchestra.run.smithi148.stdout:3574 trunc from 0xde48800 to 0x1ccb000 2024-09-14T09:08:38.008 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:38.010+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:38.019 INFO:teuthology.orchestra.run.smithi148.stdout:3575 read 0x98c600 thru 0x995ea9 (0x98aa bytes) 2024-09-14T09:08:38.021 INFO:teuthology.orchestra.run.smithi148.stdout:3577 punch from 0xf1d400 to 0xf1ec00, (0x1800 bytes) 2024-09-14T09:08:38.021 INFO:teuthology.orchestra.run.smithi148.stdout:3580 read 0x10e6200 thru 0x10e88b3 (0x26b4 bytes) 2024-09-14T09:08:38.021 INFO:teuthology.orchestra.run.smithi148.stdout:3581 read 0x6bcc00 thru 0x6be607 (0x1a08 bytes) 2024-09-14T09:08:38.023 INFO:teuthology.orchestra.run.smithi148.stdout:3591 write 0x156ba00 thru 0x157b5c0 (0xfbc1 bytes) 2024-09-14T09:08:38.040 INFO:teuthology.orchestra.run.smithi148.stdout:3592 write 0x4274e00 thru 0x4277554 (0x2755 bytes) 2024-09-14T09:08:38.041 INFO:teuthology.orchestra.run.smithi148.stdout:3594 read 0x21a9400 thru 0x21b45c4 (0xb1c5 bytes) 2024-09-14T09:08:38.041 INFO:teuthology.orchestra.run.smithi148.stdout:3597 punch from 0x14bac00 to 0x14c2400, (0x7800 bytes) 2024-09-14T09:08:38.047 INFO:teuthology.orchestra.run.smithi148.stdout:3598 punch from 0x33bbe00 to 0x33c0600, (0x4800 bytes) 2024-09-14T09:08:38.048 INFO:teuthology.orchestra.run.smithi148.stdout:3599 punch from 0xd27c00 to 0xd33200, (0xb600 bytes) 2024-09-14T09:08:38.055 INFO:teuthology.orchestra.run.smithi148.stdout:3601 read 0x15b9800 thru 0x15c10df (0x78e0 bytes) 2024-09-14T09:08:38.109 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:38.110+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:38.110 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:08:38.110 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:08:38.137 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:38.137 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:38.155 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:38.155 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:38.166 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:08:38.167 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:38.167 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:38.188 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:38.189 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:38.211 INFO:teuthology.orchestra.run.smithi148.stdout:3603 write 0x6262000 thru 0x626c94d (0xa94e bytes) 2024-09-14T09:08:38.212 INFO:teuthology.orchestra.run.smithi148.stdout:3605 punch from 0x43d4e00 to 0x43e1200, (0xc400 bytes) 2024-09-14T09:08:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:3608 write 0x2a98c00 thru 0x2aa3788 (0xab89 bytes) 2024-09-14T09:08:38.285 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:38.285 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:38.293 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:08:38.300 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:38.244+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:38.311 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:38.313+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:38.317 INFO:teuthology.orchestra.run.smithi148.stdout:3610 write 0xa8c2000 thru 0xa8c81f0 (0x61f1 bytes) 2024-09-14T09:08:38.318 INFO:teuthology.orchestra.run.smithi148.stdout:3613 read 0x681c200 thru 0x6828a67 (0xc868 bytes) 2024-09-14T09:08:38.321 INFO:teuthology.orchestra.run.smithi148.stdout:3615 trunc from 0xa8c8200 to 0x895cc00 2024-09-14T09:08:38.346 INFO:teuthology.orchestra.run.smithi148.stdout:3616 read 0x6508400 thru 0x650d388 (0x4f89 bytes) 2024-09-14T09:08:38.347 INFO:teuthology.orchestra.run.smithi148.stdout:3619 read 0x68a8600 thru 0x68b6d17 (0xe718 bytes) 2024-09-14T09:08:38.348 INFO:teuthology.orchestra.run.smithi148.stdout:3622 read 0x7134600 thru 0x713af91 (0x6992 bytes) 2024-09-14T09:08:38.348 INFO:teuthology.orchestra.run.smithi148.stdout:3624 write 0x1a2ae00 thru 0x1a33fdd (0x91de bytes) 2024-09-14T09:08:38.348 INFO:teuthology.orchestra.run.smithi148.stdout:3625 trunc from 0x895cc00 to 0x8bb4200 2024-09-14T09:08:38.360 INFO:teuthology.orchestra.run.smithi148.stdout:3627 punch from 0x1e80600 to 0x1e8de00, (0xd800 bytes) 2024-09-14T09:08:38.365 INFO:teuthology.orchestra.run.smithi148.stdout:3628 punch from 0x18ae200 to 0x18b3800, (0x5600 bytes) 2024-09-14T09:08:38.396 INFO:teuthology.orchestra.run.smithi148.stdout:3629 write 0xc5abe00 thru 0xc5abfd7 (0x1d8 bytes) 2024-09-14T09:08:38.397 INFO:teuthology.orchestra.run.smithi148.stdout:3631 write 0x541de00 thru 0x5422750 (0x4951 bytes) 2024-09-14T09:08:38.400 INFO:teuthology.orchestra.run.smithi148.stdout:3633 trunc from 0xc5ac000 to 0xa1fce00 2024-09-14T09:08:38.412 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:38.414+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:38.418 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:38.419 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:38.429 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:08:38.434 INFO:teuthology.orchestra.run.smithi148.stdout:3635 trunc from 0xa1fce00 to 0x91c5000 2024-09-14T09:08:38.454 INFO:teuthology.orchestra.run.smithi148.stdout:3637 write 0x5d71800 thru 0x5d7e1e9 (0xc9ea bytes) 2024-09-14T09:08:38.460 INFO:teuthology.orchestra.run.smithi148.stdout:3640 trunc from 0x91c5000 to 0x558d000 2024-09-14T09:08:38.505 INFO:teuthology.orchestra.run.smithi148.stdout:3642 punch from 0x5148000 to 0x514ea00, (0x6a00 bytes) 2024-09-14T09:08:38.505 INFO:teuthology.orchestra.run.smithi148.stdout:3644 read 0x3633800 thru 0x36414f0 (0xdcf1 bytes) 2024-09-14T09:08:38.506 INFO:teuthology.orchestra.run.smithi148.stdout:3646 punch from 0xac1400 to 0xacb200, (0x9e00 bytes) 2024-09-14T09:08:38.506 INFO:teuthology.orchestra.run.smithi148.stdout:3647 punch from 0xea800 to 0xf3800, (0x9000 bytes) 2024-09-14T09:08:38.513 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:38.515+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:38.547 INFO:teuthology.orchestra.run.smithi148.stdout:3648 write 0x10f0800 thru 0x10fde14 (0xd615 bytes) 2024-09-14T09:08:38.555 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:38.555 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:38.565 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:08:38.611 INFO:teuthology.orchestra.run.smithi148.stdout:3649 trunc from 0x558d000 to 0x9761400 2024-09-14T09:08:38.649 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:38.651+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:38.715 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:38.717+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:38.730 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:38.730 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:38.735 INFO:teuthology.orchestra.run.smithi148.stdout:3650 write 0xcc81a00 thru 0xcc865b5 (0x4bb6 bytes) 2024-09-14T09:08:38.739 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:08:38.742 INFO:teuthology.orchestra.run.smithi148.stdout:3651 write 0x7642c00 thru 0x7643c60 (0x1061 bytes) 2024-09-14T09:08:38.742 INFO:teuthology.orchestra.run.smithi148.stdout:3652 punch from 0xa655600 to 0xa65ea00, (0x9400 bytes) 2024-09-14T09:08:38.742 INFO:teuthology.orchestra.run.smithi148.stdout:3654 punch from 0xc050a00 to 0xc055200, (0x4800 bytes) 2024-09-14T09:08:38.743 INFO:teuthology.orchestra.run.smithi148.stdout:3658 punch from 0x6a56c00 to 0x6a61a00, (0xae00 bytes) 2024-09-14T09:08:38.743 INFO:teuthology.orchestra.run.smithi148.stdout:3660 punch from 0x2cc3c00 to 0x2cd1000, (0xd400 bytes) 2024-09-14T09:08:38.793 INFO:teuthology.orchestra.run.smithi148.stdout:3661 write 0xd8ee200 thru 0xd8fd8b4 (0xf6b5 bytes) 2024-09-14T09:08:38.794 INFO:teuthology.orchestra.run.smithi148.stdout:3664 write 0x6b53600 thru 0x6b57137 (0x3b38 bytes) 2024-09-14T09:08:38.794 INFO:teuthology.orchestra.run.smithi148.stdout:3666 write 0x1cffa00 thru 0x1d08530 (0x8b31 bytes) 2024-09-14T09:08:38.795 INFO:teuthology.orchestra.run.smithi148.stdout:3667 read 0xafa3e00 thru 0xafb34d4 (0xf6d5 bytes) 2024-09-14T09:08:38.797 INFO:teuthology.orchestra.run.smithi148.stdout:3670 trunc from 0xd8fda00 to 0xbe9e400 2024-09-14T09:08:38.823 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:38.826+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:38.841 INFO:teuthology.orchestra.run.smithi148.stdout:3671 read 0x9176200 thru 0x9178d74 (0x2b75 bytes) 2024-09-14T09:08:38.842 INFO:teuthology.orchestra.run.smithi148.stdout:3672 punch from 0x7bc5800 to 0x7bcf400, (0x9c00 bytes) 2024-09-14T09:08:38.843 INFO:teuthology.orchestra.run.smithi148.stdout:3673 write 0x7768000 thru 0x7774939 (0xc93a bytes) 2024-09-14T09:08:38.843 INFO:teuthology.orchestra.run.smithi148.stdout:3676 read 0x2213c00 thru 0x221a09b (0x649c bytes) 2024-09-14T09:08:38.847 INFO:teuthology.orchestra.run.smithi148.stdout:3677 punch from 0xbc34800 to 0xbc36000, (0x1800 bytes) 2024-09-14T09:08:38.847 INFO:teuthology.orchestra.run.smithi148.stdout:3678 read 0x385c00 thru 0x3953a7 (0xf7a8 bytes) 2024-09-14T09:08:38.867 INFO:teuthology.orchestra.run.smithi148.stdout:3679 punch from 0x9dce600 to 0x9dd7400, (0x8e00 bytes) 2024-09-14T09:08:38.868 INFO:teuthology.orchestra.run.smithi148.stdout:3681 read 0x7961200 thru 0x7971033 (0xfe34 bytes) 2024-09-14T09:08:38.869 INFO:teuthology.orchestra.run.smithi148.stdout:3682 read 0xb664600 thru 0xb6665a5 (0x1fa6 bytes) 2024-09-14T09:08:38.869 INFO:teuthology.orchestra.run.smithi148.stdout:3684 read 0xafdf200 thru 0xafe26b9 (0x34ba bytes) 2024-09-14T09:08:38.869 INFO:teuthology.orchestra.run.smithi148.stdout:3686 read 0xb2f0c00 thru 0xb2fead3 (0xded4 bytes) 2024-09-14T09:08:38.869 INFO:teuthology.orchestra.run.smithi148.stdout:3689 write 0x1487400 thru 0x148f78d (0x838e bytes) 2024-09-14T09:08:38.873 INFO:teuthology.orchestra.run.smithi148.stdout:3690 trunc from 0xbe9e400 to 0x94e1400 2024-09-14T09:08:38.903 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:38.904 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:38.909 INFO:teuthology.orchestra.run.smithi148.stdout:3692 read 0x1484600 thru 0x14875b7 (0x2fb8 bytes) 2024-09-14T09:08:38.911 INFO:teuthology.orchestra.run.smithi148.stdout:3695 punch from 0x8e65000 to 0x8e65600, (0x600 bytes) 2024-09-14T09:08:38.913 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:08:38.922 INFO:teuthology.orchestra.run.smithi148.stdout:3696 trunc from 0x94e1400 to 0x3408c00 2024-09-14T09:08:38.956 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:38.956+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:38.969 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is unset 2024-09-14T09:08:38.997 INFO:teuthology.orchestra.run.smithi148.stdout:3698 write 0x6c78e00 thru 0x6c83952 (0xab53 bytes) 2024-09-14T09:08:39.000 INFO:teuthology.orchestra.run.smithi148.stdout:3702 trunc from 0x6c83a00 to 0x86cdc00 2024-09-14T09:08:39.017 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:39.019+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:39.023 INFO:teuthology.orchestra.run.smithi148.stdout:3703 read 0xa6d600 thru 0xa7c43d (0xee3e bytes) 2024-09-14T09:08:39.029 INFO:teuthology.orchestra.run.smithi148.stdout:3705 read 0x356b200 thru 0x357731e (0xc11f bytes) 2024-09-14T09:08:39.047 INFO:teuthology.orchestra.run.smithi148.stdout:3707 write 0xe481e00 thru 0xe48f5dd (0xd7de bytes) 2024-09-14T09:08:39.048 INFO:teuthology.orchestra.run.smithi148.stdout:3709 punch from 0x8469c00 to 0x8479000, (0xf400 bytes) 2024-09-14T09:08:39.049 INFO:teuthology.orchestra.run.smithi148.stdout:3710 read 0x8474e00 thru 0x847c76d (0x796e bytes) 2024-09-14T09:08:39.068 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:39.069 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:39.079 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:08:39.080 INFO:teuthology.orchestra.run.smithi148.stdout:3712 write 0x34b3400 thru 0x34bb697 (0x8298 bytes) 2024-09-14T09:08:39.087 INFO:teuthology.orchestra.run.smithi148.stdout:3713 trunc from 0xe48f600 to 0x792d800 2024-09-14T09:08:39.118 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:39.120+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:39.121 INFO:teuthology.orchestra.run.smithi148.stdout:3714 write 0x3cd0a00 thru 0x3cdaafe (0xa0ff bytes) 2024-09-14T09:08:39.122 INFO:teuthology.orchestra.run.smithi148.stdout:3715 read 0x165e200 thru 0x165f7dd (0x15de bytes) 2024-09-14T09:08:39.149 INFO:teuthology.orchestra.run.smithi148.stdout:3716 write 0x9014a00 thru 0x9014a65 (0x66 bytes) 2024-09-14T09:08:39.150 INFO:teuthology.orchestra.run.smithi148.stdout:3718 read 0x2290400 thru 0x229e231 (0xde32 bytes) 2024-09-14T09:08:39.151 INFO:teuthology.orchestra.run.smithi148.stdout:3722 write 0x17f6000 thru 0x17fe843 (0x8844 bytes) 2024-09-14T09:08:39.151 INFO:teuthology.orchestra.run.smithi148.stdout:3723 write 0x8f9b600 thru 0x8f9dc9c (0x269d bytes) 2024-09-14T09:08:39.154 INFO:teuthology.orchestra.run.smithi148.stdout:3724 trunc from 0x9014c00 to 0xad6ec00 2024-09-14T09:08:39.171 INFO:teuthology.orchestra.run.smithi148.stdout:3726 read 0x119ac00 thru 0x119c127 (0x1528 bytes) 2024-09-14T09:08:39.177 INFO:teuthology.orchestra.run.smithi148.stdout:3727 punch from 0x555e600 to 0x5563000, (0x4a00 bytes) 2024-09-14T09:08:39.192 INFO:teuthology.orchestra.run.smithi148.stdout:3728 write 0xddacc00 thru 0xddb335f (0x6760 bytes) 2024-09-14T09:08:39.198 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:39.199 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:39.208 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:08:39.211 INFO:teuthology.orchestra.run.smithi148.stdout:3729 trunc from 0xddb3400 to 0x501ac00 2024-09-14T09:08:39.247 INFO:teuthology.orchestra.run.smithi148.stdout:3730 read 0x22cdc00 thru 0x22d40bd (0x64be bytes) 2024-09-14T09:08:39.253 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:39.255+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:39.257 INFO:teuthology.orchestra.run.smithi148.stdout:3733 trunc from 0x501ac00 to 0x2aa1000 2024-09-14T09:08:39.285 INFO:teuthology.orchestra.run.smithi148.stdout:3735 read 0xf14e00 thru 0xf1601e (0x121f bytes) 2024-09-14T09:08:39.293 INFO:teuthology.orchestra.run.smithi148.stdout:3737 trunc from 0x2aa1000 to 0x3248800 2024-09-14T09:08:39.301 INFO:teuthology.orchestra.run.smithi148.stdout:3738 punch from 0x2e6c600 to 0x2e75800, (0x9200 bytes) 2024-09-14T09:08:39.302 INFO:teuthology.orchestra.run.smithi148.stdout:3740 punch from 0x2294000 to 0x22a1c00, (0xdc00 bytes) 2024-09-14T09:08:39.303 INFO:teuthology.orchestra.run.smithi148.stdout:3741 punch from 0x18d0400 to 0x18dc400, (0xc000 bytes) 2024-09-14T09:08:39.303 INFO:teuthology.orchestra.run.smithi148.stdout:3743 read 0x1afa800 thru 0x1b01035 (0x6836 bytes) 2024-09-14T09:08:39.309 INFO:teuthology.orchestra.run.smithi148.stdout:3745 read 0x28cc200 thru 0x28cf89d (0x369e bytes) 2024-09-14T09:08:39.310 INFO:teuthology.orchestra.run.smithi148.stdout:3748 read 0x2c10800 thru 0x2c13138 (0x2939 bytes) 2024-09-14T09:08:39.310 INFO:teuthology.orchestra.run.smithi148.stdout:3750 punch from 0xa1400 to 0xab400, (0xa000 bytes) 2024-09-14T09:08:39.319 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:39.321+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:39.332 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:39.332 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:39.344 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:08:39.384 INFO:teuthology.orchestra.run.smithi148.stdout:3752 write 0x7b6b800 thru 0x7b7af17 (0xf718 bytes) 2024-09-14T09:08:39.389 INFO:teuthology.orchestra.run.smithi148.stdout:3758 trunc from 0x7b7b000 to 0xb9a7200 2024-09-14T09:08:39.416 INFO:teuthology.orchestra.run.smithi148.stdout:3760 read 0x7c74c00 thru 0x7c8192d (0xcd2e bytes) 2024-09-14T09:08:39.419 INFO:teuthology.orchestra.run.smithi148.stdout:3763 read 0x8dd0800 thru 0x8ddbbc0 (0xb3c1 bytes) 2024-09-14T09:08:39.419 INFO:teuthology.orchestra.run.smithi148.stdout:3764 write 0xb80400 thru 0xb8db56 (0xd757 bytes) 2024-09-14T09:08:39.420 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:39.422+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:39.467 INFO:teuthology.orchestra.run.smithi148.stdout:3767 write 0xc1b1400 thru 0xc1b9472 (0x8073 bytes) 2024-09-14T09:08:39.468 INFO:teuthology.orchestra.run.smithi148.stdout:3768 read 0x7e69e00 thru 0x7e6bb71 (0x1d72 bytes) 2024-09-14T09:08:39.468 INFO:teuthology.orchestra.run.smithi148.stdout:3769 read 0x417dc00 thru 0x4181e91 (0x4292 bytes) 2024-09-14T09:08:39.468 INFO:teuthology.orchestra.run.smithi148.stdout:3770 punch from 0xac21a00 to 0xac27800, (0x5e00 bytes) 2024-09-14T09:08:39.471 INFO:teuthology.orchestra.run.smithi148.stdout:3771 trunc from 0xc1b9600 to 0x9f9f400 2024-09-14T09:08:39.500 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:39.500 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:39.502 INFO:teuthology.orchestra.run.smithi148.stdout:3772 punch from 0x6a8fe00 to 0x6a98200, (0x8400 bytes) 2024-09-14T09:08:39.507 INFO:teuthology.orchestra.run.smithi148.stdout:3776 trunc from 0x9f9f400 to 0x7752200 2024-09-14T09:08:39.509 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:08:39.520 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:39.522+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:39.532 INFO:teuthology.orchestra.run.smithi148.stdout:3777 write 0x6855400 thru 0x6861e26 (0xca27 bytes) 2024-09-14T09:08:39.533 INFO:teuthology.orchestra.run.smithi148.stdout:3778 write 0x437da00 thru 0x438d01a (0xf61b bytes) 2024-09-14T09:08:39.533 INFO:teuthology.orchestra.run.smithi148.stdout:3780 write 0x1f6e00 thru 0x1f7e5a (0x105b bytes) 2024-09-14T09:08:39.534 INFO:teuthology.orchestra.run.smithi148.stdout:3781 read 0x3c71000 thru 0x3c7f609 (0xe60a bytes) 2024-09-14T09:08:39.534 INFO:teuthology.orchestra.run.smithi148.stdout:3784 read 0x633f800 thru 0x6344746 (0x4f47 bytes) 2024-09-14T09:08:39.539 INFO:teuthology.orchestra.run.smithi148.stdout:3787 trunc from 0x7752200 to 0x38c6600 2024-09-14T09:08:39.621 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:39.623+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:39.627 INFO:teuthology.orchestra.run.smithi148.stdout:3789 punch from 0x26a8200 to 0x26b4a00, (0xc800 bytes) 2024-09-14T09:08:39.627 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:39.628 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:39.629 INFO:teuthology.orchestra.run.smithi148.stdout:3790 read 0x543800 thru 0x54eda1 (0xb5a2 bytes) 2024-09-14T09:08:39.634 INFO:teuthology.orchestra.run.smithi148.stdout:3792 read 0x330c200 thru 0x331419f (0x7fa0 bytes) 2024-09-14T09:08:39.634 INFO:teuthology.orchestra.run.smithi148.stdout:3793 read 0xe60600 thru 0xe6201f (0x1a20 bytes) 2024-09-14T09:08:39.638 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:08:39.647 INFO:teuthology.orchestra.run.smithi148.stdout:3795 write 0x5cb4000 thru 0x5cbf641 (0xb642 bytes) 2024-09-14T09:08:39.653 INFO:teuthology.orchestra.run.smithi148.stdout:3796 trunc from 0x5cbf800 to 0x187e000 2024-09-14T09:08:39.712 INFO:teuthology.orchestra.run.smithi148.stdout:3797 trunc from 0x187e000 to 0x3834600 2024-09-14T09:08:39.720 INFO:teuthology.orchestra.run.smithi148.stdout:3802 punch from 0x152a00 to 0x15a800, (0x7e00 bytes) 2024-09-14T09:08:39.722 INFO:teuthology.orchestra.run.smithi148.stdout:3803 read 0x2c16000 thru 0x2c2487c (0xe87d bytes) 2024-09-14T09:08:39.723 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:39.725+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:39.725 INFO:teuthology.orchestra.run.smithi148.stdout:3806 trunc from 0x3834600 to 0x57c200 2024-09-14T09:08:39.758 INFO:teuthology.orchestra.run.smithi148.stdout:3807 read 0x2b1e00 thru 0x2bb7f2 (0x99f3 bytes) 2024-09-14T09:08:39.777 INFO:teuthology.orchestra.run.smithi148.stdout:3808 trunc from 0x57c200 to 0xe747c00 2024-09-14T09:08:39.785 INFO:teuthology.orchestra.run.smithi148.stdout:3809 read 0xd89d600 thru 0xd8a5723 (0x8124 bytes) 2024-09-14T09:08:39.786 INFO:teuthology.orchestra.run.smithi148.stdout:3810 punch from 0xd658400 to 0xd665c00, (0xd800 bytes) 2024-09-14T09:08:39.793 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:39.793 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:39.803 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:08:39.816 INFO:teuthology.orchestra.run.smithi148.stdout:3811 write 0xedaae00 thru 0xedb2e41 (0x8042 bytes) 2024-09-14T09:08:39.828 INFO:teuthology.orchestra.run.smithi148.stdout:3812 trunc from 0xedb3000 to 0x5acec00 2024-09-14T09:08:39.844 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:39.846+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:39.865 INFO:teuthology.orchestra.run.smithi148.stdout:3813 read 0x21daa00 thru 0x21e4043 (0x9644 bytes) 2024-09-14T09:08:39.866 INFO:teuthology.orchestra.run.smithi148.stdout:3815 punch from 0x437ec00 to 0x4381c00, (0x3000 bytes) 2024-09-14T09:08:39.868 INFO:teuthology.orchestra.run.smithi148.stdout:3817 trunc from 0x5acec00 to 0x4608c00 2024-09-14T09:08:39.897 INFO:teuthology.orchestra.run.smithi148.stdout:3818 trunc from 0x4608c00 to 0xe424e00 2024-09-14T09:08:39.907 INFO:teuthology.orchestra.run.smithi148.stdout:3820 punch from 0xe07d800 to 0xe08a000, (0xc800 bytes) 2024-09-14T09:08:39.909 INFO:teuthology.orchestra.run.smithi148.stdout:3821 punch from 0xc2a0000 to 0xc2aca00, (0xca00 bytes) 2024-09-14T09:08:39.910 INFO:teuthology.orchestra.run.smithi148.stdout:3823 write 0x73d9600 thru 0x73dd620 (0x4021 bytes) 2024-09-14T09:08:39.910 INFO:teuthology.orchestra.run.smithi148.stdout:3824 write 0x4af1c00 thru 0x4b0133e (0xf73f bytes) 2024-09-14T09:08:39.923 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:39.925+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:39.937 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:39.937 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:39.948 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:08:39.972 INFO:teuthology.orchestra.run.smithi148.stdout:3828 write 0xe790600 thru 0xe7941a3 (0x3ba4 bytes) 2024-09-14T09:08:39.973 INFO:teuthology.orchestra.run.smithi148.stdout:3829 write 0xb38b600 thru 0xb39743d (0xbe3e bytes) 2024-09-14T09:08:39.973 INFO:teuthology.orchestra.run.smithi148.stdout:3836 write 0x3d74600 thru 0x3d753b3 (0xdb4 bytes) 2024-09-14T09:08:39.974 INFO:teuthology.orchestra.run.smithi148.stdout:3838 write 0x3ed8400 thru 0x3edc1e2 (0x3de3 bytes) 2024-09-14T09:08:39.974 INFO:teuthology.orchestra.run.smithi148.stdout:3841 write 0xc419000 thru 0xc420d89 (0x7d8a bytes) 2024-09-14T09:08:39.974 INFO:teuthology.orchestra.run.smithi148.stdout:3842 write 0xb341600 thru 0xb34a152 (0x8b53 bytes) 2024-09-14T09:08:39.980 INFO:teuthology.orchestra.run.smithi148.stdout:3843 trunc from 0xe794200 to 0x932ea00 2024-09-14T09:08:40.024 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:40.027+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:40.054 INFO:teuthology.orchestra.run.smithi148.stdout:3848 punch from 0x13b1800 to 0x13b6000, (0x4800 bytes) 2024-09-14T09:08:40.056 INFO:teuthology.orchestra.run.smithi148.stdout:3849 punch from 0x70cd200 to 0x70d4c00, (0x7a00 bytes) 2024-09-14T09:08:40.057 INFO:teuthology.orchestra.run.smithi148.stdout:3851 read 0x41a8200 thru 0x41ae767 (0x6568 bytes) 2024-09-14T09:08:40.076 INFO:teuthology.orchestra.run.smithi148.stdout:3852 write 0xbfeec00 thru 0xbffa429 (0xb82a bytes) 2024-09-14T09:08:40.078 INFO:teuthology.orchestra.run.smithi148.stdout:3853 write 0xb495e00 thru 0xb4a2150 (0xc351 bytes) 2024-09-14T09:08:40.082 INFO:teuthology.orchestra.run.smithi148.stdout:3857 trunc from 0xbffa600 to 0x898e200 2024-09-14T09:08:40.125 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:40.127+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:40.125 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:40.125 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:40.138 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:08:40.142 INFO:teuthology.orchestra.run.smithi148.stdout:3858 read 0x10dc000 thru 0x10dc874 (0x875 bytes) 2024-09-14T09:08:40.149 INFO:teuthology.orchestra.run.smithi148.stdout:3859 trunc from 0x898e200 to 0xe0a5e00 2024-09-14T09:08:40.170 INFO:teuthology.orchestra.run.smithi148.stdout:3862 write 0xe599200 thru 0xe59f4c5 (0x62c6 bytes) 2024-09-14T09:08:40.179 INFO:teuthology.orchestra.run.smithi148.stdout:3863 trunc from 0xe59f600 to 0x792c600 2024-09-14T09:08:40.201 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:08:40.205 INFO:teuthology.orchestra.run.smithi148.stdout:3865 write 0x4ad4a00 thru 0x4ad6021 (0x1622 bytes) 2024-09-14T09:08:40.208 INFO:teuthology.orchestra.run.smithi148.stdout:3866 punch from 0x6827600 to 0x6829400, (0x1e00 bytes) 2024-09-14T09:08:40.211 INFO:teuthology.orchestra.run.smithi148.stdout:3867 trunc from 0x792c600 to 0xb159e00 2024-09-14T09:08:40.224 INFO:teuthology.orchestra.run.smithi148.stdout:3869 write 0x1a2c800 thru 0x1a374e8 (0xace9 bytes) 2024-09-14T09:08:40.225 INFO:teuthology.orchestra.run.smithi148.stdout:3870 read 0xc31400 thru 0xc371fd (0x5dfe bytes) 2024-09-14T09:08:40.227 INFO:teuthology.orchestra.run.smithi148.stdout:3871 trunc from 0xb159e00 to 0x9681c00 2024-09-14T09:08:40.245 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:40.247+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:40.257 INFO:teuthology.orchestra.run.smithi148.stdout:3872 write 0x3e36000 thru 0x3e4293b (0xc93c bytes) 2024-09-14T09:08:40.258 INFO:teuthology.orchestra.run.smithi148.stdout:3873 read 0xa5e00 thru 0xabe8b (0x608c bytes) 2024-09-14T09:08:40.262 INFO:teuthology.orchestra.run.smithi148.stdout:3879 trunc from 0x9681c00 to 0xc2f0e00 2024-09-14T09:08:40.268 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:40.268 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:40.281 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:08:40.287 INFO:teuthology.orchestra.run.smithi148.stdout:3881 write 0xc284000 thru 0xc28721d (0x321e bytes) 2024-09-14T09:08:40.288 INFO:teuthology.orchestra.run.smithi148.stdout:3882 read 0x6231a00 thru 0x6233f35 (0x2536 bytes) 2024-09-14T09:08:40.288 INFO:teuthology.orchestra.run.smithi148.stdout:3884 read 0x9607200 thru 0x960d12d (0x5f2e bytes) 2024-09-14T09:08:40.297 INFO:teuthology.orchestra.run.smithi148.stdout:3885 trunc from 0xc2f0e00 to 0x47f1000 2024-09-14T09:08:40.305 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T09:08:40.306 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:08:40.306 INFO:tasks.thrashosds.thrasher:Removing osd 1, in_osds are: [0, 1, 2, 3, 4, 5] 2024-09-14T09:08:40.306 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 1 2024-09-14T09:08:40.329 INFO:teuthology.orchestra.run.smithi148.stdout:3886 trunc from 0x47f1000 to 0x4d03400 2024-09-14T09:08:40.347 INFO:teuthology.orchestra.run.smithi148.stdout:3889 trunc from 0x4d03400 to 0x1fb9200 2024-09-14T09:08:40.360 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:40.360 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:40.362 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:40.363+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:40.382 INFO:teuthology.orchestra.run.smithi148.stdout:3891 write 0x1777a00 thru 0x177a350 (0x2951 bytes) 2024-09-14T09:08:40.384 INFO:teuthology.orchestra.run.smithi148.stdout:3893 read 0x1638a00 thru 0x163bdd6 (0x33d7 bytes) 2024-09-14T09:08:40.385 INFO:teuthology.orchestra.run.smithi148.stdout:3894 punch from 0xf22e00 to 0xf26600, (0x3800 bytes) 2024-09-14T09:08:40.385 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:40.386 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:40.407 INFO:teuthology.orchestra.run.smithi148.stdout:3895 write 0x70e2800 thru 0x70e4c10 (0x2411 bytes) 2024-09-14T09:08:40.408 INFO:teuthology.orchestra.run.smithi148.stdout:3898 write 0x2b3e000 thru 0x2b46f00 (0x8f01 bytes) 2024-09-14T09:08:40.419 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:08:40.419 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:08:40.428 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:40.429+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:40.444 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:40.444 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:40.447 INFO:teuthology.orchestra.run.smithi148.stdout:3902 write 0xa7dd000 thru 0xa7df688 (0x2689 bytes) 2024-09-14T09:08:40.449 INFO:teuthology.orchestra.run.smithi148.stdout:3903 read 0x7ec3a00 thru 0x7ec7446 (0x3a47 bytes) 2024-09-14T09:08:40.464 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:40.464 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:40.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.465 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:24378 3.13 3:cd88a5b5:::rbd_object_map.111219b19df:head [call lock.assert_locked in=44b,call rbd.object_map_resize in=29b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-14T09:08:40.465 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:40.466113+0000", 2024-09-14T09:08:40.465 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.001047472, 2024-09-14T09:08:40.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001071032, 2024-09-14T09:08:40.465 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:40.465 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:40.465 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-09-14T09:08:40.465 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:40.465 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:40.465 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:40.465 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24378 2024-09-14T09:08:40.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.465 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:40.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:40.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:40.466113+0000", 2024-09-14T09:08:40.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:40.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:40.466113+0000", 2024-09-14T09:08:40.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:40.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:40.466113+0000", 2024-09-14T09:08:40.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2699999999999998e-07 2024-09-14T09:08:40.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:40.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:40.466119+0000", 2024-09-14T09:08:40.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.22e-06 2024-09-14T09:08:40.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:40.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:40.466132+0000", 2024-09-14T09:08:40.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.308e-05 2024-09-14T09:08:40.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:40.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:40.466139+0000", 2024-09-14T09:08:40.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.52e-06 2024-09-14T09:08:40.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:40.466177+0000", 2024-09-14T09:08:40.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7871999999999999e-05 2024-09-14T09:08:40.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:40.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:40.466222+0000", 2024-09-14T09:08:40.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5296000000000001e-05 2024-09-14T09:08:40.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:40.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:40.466369+0000", 2024-09-14T09:08:40.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000146176 2024-09-14T09:08:40.468 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.468 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:40.468 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.468 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.469 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:08:40.469 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 1 2024-09-14T09:08:40.469 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:40.469 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:40.469 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:40.470 INFO:teuthology.orchestra.run.smithi148.stdout:3907 write 0xba74800 thru 0xba79aae (0x52af bytes) 2024-09-14T09:08:40.471 INFO:teuthology.orchestra.run.smithi148.stdout:3915 punch from 0x8c62600 to 0x8c6e000, (0xba00 bytes) 2024-09-14T09:08:40.476 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:08:40.482 INFO:teuthology.orchestra.run.smithi148.stdout:3916 trunc from 0xba79c00 to 0x3102600 2024-09-14T09:08:40.492 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:40.493 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:40.528 INFO:teuthology.orchestra.run.smithi148.stdout:3917 read 0xeea800 thru 0xef9502 (0xed03 bytes) 2024-09-14T09:08:40.528 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:40.530+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:40.529 INFO:teuthology.orchestra.run.smithi148.stdout:3918 punch from 0x718600 to 0x720a00, (0x8400 bytes) 2024-09-14T09:08:40.547 INFO:teuthology.orchestra.run.smithi148.stdout:3919 write 0x713e000 thru 0x7149b92 (0xbb93 bytes) 2024-09-14T09:08:40.556 INFO:teuthology.orchestra.run.smithi148.stdout:3922 trunc from 0x7149c00 to 0x99be00 2024-09-14T09:08:40.629 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:40.629 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:40.629 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:40.629 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:40.629 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:40.629 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:40.631+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:40.638 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:08:40.639 INFO:teuthology.orchestra.run.smithi148.stdout:3923 write 0x9974200 thru 0x99746b5 (0x4b6 bytes) 2024-09-14T09:08:40.650 INFO:teuthology.orchestra.run.smithi148.stdout:3924 trunc from 0x9974800 to 0xbe0400 2024-09-14T09:08:40.675 INFO:teuthology.orchestra.run.smithi148.stdout:3925 trunc from 0xbe0400 to 0x4768200 2024-09-14T09:08:40.684 INFO:teuthology.orchestra.run.smithi148.stdout:3927 punch from 0xa03800 to 0xa0ae00, (0x7600 bytes) 2024-09-14T09:08:40.687 INFO:teuthology.orchestra.run.smithi148.stdout:3928 punch from 0x1b7cc00 to 0x1b89e00, (0xd200 bytes) 2024-09-14T09:08:40.718 INFO:tasks.ceph.mon.a.smithi116.stderr:2024-09-14T09:08:40.719+0000 7f4999343640 -1 mon.a@0(leader).osd e62 definitely_dead 0 2024-09-14T09:08:40.726 INFO:teuthology.orchestra.run.smithi148.stdout:3929 write 0x7de1000 thru 0x7de5e16 (0x4e17 bytes) 2024-09-14T09:08:40.727 INFO:teuthology.orchestra.run.smithi148.stdout:3930 punch from 0x40ca400 to 0x40d6600, (0xc200 bytes) 2024-09-14T09:08:40.729 INFO:teuthology.orchestra.run.smithi148.stdout:3932 punch from 0x450d600 to 0x450f800, (0x2200 bytes) 2024-09-14T09:08:40.729 INFO:teuthology.orchestra.run.smithi148.stdout:3935 read 0x2df4e00 thru 0x2dfafbb (0x61bc bytes) 2024-09-14T09:08:40.729 INFO:teuthology.orchestra.run.smithi148.stdout:3937 write 0x2d0da00 thru 0x2d173f3 (0x99f4 bytes) 2024-09-14T09:08:40.729 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:40.731+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:40.779 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:40.779 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:40.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:40.779 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:40.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.779 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:08:40.779 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:40.779 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 70.546916820000007, 2024-09-14T09:08:40.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72111598600000004, 2024-09-14T09:08:40.779 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:40.779 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:40.779 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:40.780 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:40.780 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:08:40.780 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:08:40.780 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1 2024-09-14T09:08:40.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.780 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:40.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:40.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:40.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:40.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:40.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:40.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233065+0000", 2024-09-14T09:08:40.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1909999999999999e-06 2024-09-14T09:08:40.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:40.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233071+0000", 2024-09-14T09:08:40.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5300000000000002e-06 2024-09-14T09:08:40.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:40.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233081+0000", 2024-09-14T09:08:40.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0339e-05 2024-09-14T09:08:40.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:40.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233093+0000", 2024-09-14T09:08:40.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1252e-05 2024-09-14T09:08:40.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233162+0000", 2024-09-14T09:08:40.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9678999999999995e-05 2024-09-14T09:08:40.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:08:40.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233171+0000", 2024-09-14T09:08:40.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.132e-06 2024-09-14T09:08:40.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952480+0000", 2024-09-14T09:08:40.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.71930839899999999 2024-09-14T09:08:40.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:40.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952655+0000", 2024-09-14T09:08:40.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017552 2024-09-14T09:08:40.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:40.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952835+0000", 2024-09-14T09:08:40.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001797 2024-09-14T09:08:40.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:40.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.953648+0000", 2024-09-14T09:08:40.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00081291700000000002 2024-09-14T09:08:40.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:40.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954108+0000", 2024-09-14T09:08:40.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045992800000000002 2024-09-14T09:08:40.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:40.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954149+0000", 2024-09-14T09:08:40.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1214999999999998e-05 2024-09-14T09:08:40.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:40.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954178+0000", 2024-09-14T09:08:40.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9184e-05 2024-09-14T09:08:40.785 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.785 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:40.785 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.786 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:11931 3.1a 3:5f6725a9:::rbd_header.111219b19df:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:40.786 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.722408+0000", 2024-09-14T09:08:40.786 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.0575716340000003, 2024-09-14T09:08:40.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.089863542000000005, 2024-09-14T09:08:40.786 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:40.786 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:40.786 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:40.786 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:40.786 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:08:40.786 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:08:40.786 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11931 2024-09-14T09:08:40.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.786 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:40.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:40.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.722408+0000", 2024-09-14T09:08:40.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:40.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.722408+0000", 2024-09-14T09:08:40.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:40.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812037+0000", 2024-09-14T09:08:40.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.089629082999999998 2024-09-14T09:08:40.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:40.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812042+0000", 2024-09-14T09:08:40.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5790000000000003e-06 2024-09-14T09:08:40.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:40.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812051+0000", 2024-09-14T09:08:40.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1689999999999998e-06 2024-09-14T09:08:40.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:40.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812058+0000", 2024-09-14T09:08:40.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.725e-06 2024-09-14T09:08:40.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812117+0000", 2024-09-14T09:08:40.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8483999999999998e-05 2024-09-14T09:08:40.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:40.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812183+0000", 2024-09-14T09:08:40.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6759000000000002e-05 2024-09-14T09:08:40.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:40.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812271+0000", 2024-09-14T09:08:40.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7743000000000003e-05 2024-09-14T09:08:40.790 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.790 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:40.790 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.790 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9655 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 811008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:40.790 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.688987+0000", 2024-09-14T09:08:40.790 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.0909922980000002, 2024-09-14T09:08:40.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044554783000000001, 2024-09-14T09:08:40.790 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:40.790 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:40.790 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:40.790 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:40.790 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:40.790 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:40.790 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9655 2024-09-14T09:08:40.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.791 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:40.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:40.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.688987+0000", 2024-09-14T09:08:40.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:40.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.688987+0000", 2024-09-14T09:08:40.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:40.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.688987+0000", 2024-09-14T09:08:40.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4300000000000003e-07 2024-09-14T09:08:40.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:40.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.688989+0000", 2024-09-14T09:08:40.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7969999999999999e-06 2024-09-14T09:08:40.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:40.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.688995+0000", 2024-09-14T09:08:40.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1310000000000003e-06 2024-09-14T09:08:40.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:40.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689000+0000", 2024-09-14T09:08:40.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4870000000000004e-06 2024-09-14T09:08:40.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733378+0000", 2024-09-14T09:08:40.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044377658 2024-09-14T09:08:40.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:40.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733454+0000", 2024-09-14T09:08:40.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6884000000000005e-05 2024-09-14T09:08:40.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:40.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733542+0000", 2024-09-14T09:08:40.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7282999999999998e-05 2024-09-14T09:08:40.794 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.794 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:40.794 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.794 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9656 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 872448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:40.794 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.689005+0000", 2024-09-14T09:08:40.794 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.09097395, 2024-09-14T09:08:40.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044678214000000001, 2024-09-14T09:08:40.794 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:40.794 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:40.794 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:40.794 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:40.794 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:40.795 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:40.795 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9656 2024-09-14T09:08:40.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.795 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:40.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:40.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689005+0000", 2024-09-14T09:08:40.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:40.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689005+0000", 2024-09-14T09:08:40.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:40.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689006+0000", 2024-09-14T09:08:40.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.51e-07 2024-09-14T09:08:40.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:40.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689007+0000", 2024-09-14T09:08:40.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.699e-06 2024-09-14T09:08:40.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:40.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689013+0000", 2024-09-14T09:08:40.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.609e-06 2024-09-14T09:08:40.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:40.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689018+0000", 2024-09-14T09:08:40.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7319999999999998e-06 2024-09-14T09:08:40.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733570+0000", 2024-09-14T09:08:40.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044552691999999998 2024-09-14T09:08:40.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:40.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733610+0000", 2024-09-14T09:08:40.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9366000000000002e-05 2024-09-14T09:08:40.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:40.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733683+0000", 2024-09-14T09:08:40.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3664999999999994e-05 2024-09-14T09:08:40.798 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.798 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:40.798 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.798 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9657 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 933888~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:40.798 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.689024+0000", 2024-09-14T09:08:40.798 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.0909556650000001, 2024-09-14T09:08:40.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044870122999999998, 2024-09-14T09:08:40.798 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:40.798 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:40.798 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:40.799 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:40.799 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:40.799 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:40.799 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9657 2024-09-14T09:08:40.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.799 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:40.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:40.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689024+0000", 2024-09-14T09:08:40.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:40.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689024+0000", 2024-09-14T09:08:40.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:40.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689024+0000", 2024-09-14T09:08:40.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.27e-07 2024-09-14T09:08:40.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:40.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689026+0000", 2024-09-14T09:08:40.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9180000000000001e-06 2024-09-14T09:08:40.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:40.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689032+0000", 2024-09-14T09:08:40.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9050000000000002e-06 2024-09-14T09:08:40.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:40.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689036+0000", 2024-09-14T09:08:40.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6380000000000003e-06 2024-09-14T09:08:40.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733724+0000", 2024-09-14T09:08:40.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044687326999999999 2024-09-14T09:08:40.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:40.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733802+0000", 2024-09-14T09:08:40.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8486999999999996e-05 2024-09-14T09:08:40.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:40.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733894+0000", 2024-09-14T09:08:40.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1520999999999993e-05 2024-09-14T09:08:40.802 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.802 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:40.802 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.802 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9658 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 995328~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:40.802 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.689042+0000", 2024-09-14T09:08:40.802 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.0909375059999999, 2024-09-14T09:08:40.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045057038000000001, 2024-09-14T09:08:40.802 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:40.802 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:40.803 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:40.803 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:40.803 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:40.803 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:40.803 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9658 2024-09-14T09:08:40.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.803 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:40.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:40.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689042+0000", 2024-09-14T09:08:40.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:40.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689042+0000", 2024-09-14T09:08:40.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:40.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693052+0000", 2024-09-14T09:08:40.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040104859999999997 2024-09-14T09:08:40.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:40.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693055+0000", 2024-09-14T09:08:40.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6929999999999999e-06 2024-09-14T09:08:40.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:40.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693065+0000", 2024-09-14T09:08:40.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0220999999999999e-05 2024-09-14T09:08:40.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:40.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693069+0000", 2024-09-14T09:08:40.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1180000000000002e-06 2024-09-14T09:08:40.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733926+0000", 2024-09-14T09:08:40.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040856418999999998 2024-09-14T09:08:40.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:40.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.734011+0000", 2024-09-14T09:08:40.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4902999999999997e-05 2024-09-14T09:08:40.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:40.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.734099+0000", 2024-09-14T09:08:40.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8197999999999998e-05 2024-09-14T09:08:40.806 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.806 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:40.806 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.806 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9683 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2531328~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:40.806 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.693341+0000", 2024-09-14T09:08:40.806 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.086637869, 2024-09-14T09:08:40.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044718463999999999, 2024-09-14T09:08:40.807 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:40.807 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:40.807 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:40.807 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:40.807 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:40.807 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:40.807 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9683 2024-09-14T09:08:40.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.807 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:40.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:40.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693341+0000", 2024-09-14T09:08:40.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:40.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693341+0000", 2024-09-14T09:08:40.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:40.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693342+0000", 2024-09-14T09:08:40.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:08:40.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:40.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693343+0000", 2024-09-14T09:08:40.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2219999999999999e-06 2024-09-14T09:08:40.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:40.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693346+0000", 2024-09-14T09:08:40.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.785e-06 2024-09-14T09:08:40.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:40.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693348+0000", 2024-09-14T09:08:40.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4229999999999999e-06 2024-09-14T09:08:40.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.737876+0000", 2024-09-14T09:08:40.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044527870999999997 2024-09-14T09:08:40.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:40.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.737968+0000", 2024-09-14T09:08:40.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1859000000000003e-05 2024-09-14T09:08:40.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:40.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738060+0000", 2024-09-14T09:08:40.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2095000000000005e-05 2024-09-14T09:08:40.810 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.810 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:40.810 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.811 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9684 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2592768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:40.811 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.693351+0000", 2024-09-14T09:08:40.811 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.0866282780000001, 2024-09-14T09:08:40.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044936873000000002, 2024-09-14T09:08:40.811 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:40.811 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:40.811 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:40.811 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:40.811 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:40.811 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:40.811 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9684 2024-09-14T09:08:40.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.811 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:40.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:40.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693351+0000", 2024-09-14T09:08:40.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:40.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693351+0000", 2024-09-14T09:08:40.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:40.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693351+0000", 2024-09-14T09:08:40.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3999999999999998e-07 2024-09-14T09:08:40.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:40.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693352+0000", 2024-09-14T09:08:40.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0470000000000001e-06 2024-09-14T09:08:40.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:40.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693355+0000", 2024-09-14T09:08:40.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8320000000000002e-06 2024-09-14T09:08:40.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:40.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693358+0000", 2024-09-14T09:08:40.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5270000000000001e-06 2024-09-14T09:08:40.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738104+0000", 2024-09-14T09:08:40.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044746459000000002 2024-09-14T09:08:40.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:40.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738194+0000", 2024-09-14T09:08:40.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0062999999999995e-05 2024-09-14T09:08:40.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:40.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738288+0000", 2024-09-14T09:08:40.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3704999999999998e-05 2024-09-14T09:08:40.814 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.814 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:40.814 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.815 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9685 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2654208~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:40.815 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.693377+0000", 2024-09-14T09:08:40.815 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.0866017100000001, 2024-09-14T09:08:40.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045136784999999999, 2024-09-14T09:08:40.815 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:40.815 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:40.815 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:40.815 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:40.815 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:40.815 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:40.815 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9685 2024-09-14T09:08:40.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.815 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:40.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:40.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693377+0000", 2024-09-14T09:08:40.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:40.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693377+0000", 2024-09-14T09:08:40.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:40.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693378+0000", 2024-09-14T09:08:40.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8500000000000002e-07 2024-09-14T09:08:40.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:40.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693379+0000", 2024-09-14T09:08:40.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.387e-06 2024-09-14T09:08:40.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:40.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693383+0000", 2024-09-14T09:08:40.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3699999999999999e-06 2024-09-14T09:08:40.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:40.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693385+0000", 2024-09-14T09:08:40.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5469999999999999e-06 2024-09-14T09:08:40.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738329+0000", 2024-09-14T09:08:40.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044943603999999998 2024-09-14T09:08:40.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:40.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738414+0000", 2024-09-14T09:08:40.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4763000000000001e-05 2024-09-14T09:08:40.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:40.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738514+0000", 2024-09-14T09:08:40.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000100629 2024-09-14T09:08:40.819 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.819 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:40.819 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.819 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9686 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2715648~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:40.819 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.693389+0000", 2024-09-14T09:08:40.819 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.0865906249999999, 2024-09-14T09:08:40.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045314315000000001, 2024-09-14T09:08:40.819 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:40.819 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:40.819 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:40.819 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:40.819 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:40.819 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:40.820 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9686 2024-09-14T09:08:40.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.820 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:40.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:40.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693389+0000", 2024-09-14T09:08:40.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:40.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693389+0000", 2024-09-14T09:08:40.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:40.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693389+0000", 2024-09-14T09:08:40.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9499999999999998e-07 2024-09-14T09:08:40.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:40.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693390+0000", 2024-09-14T09:08:40.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0410000000000001e-06 2024-09-14T09:08:40.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:40.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693393+0000", 2024-09-14T09:08:40.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.774e-06 2024-09-14T09:08:40.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:40.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693395+0000", 2024-09-14T09:08:40.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.475e-06 2024-09-14T09:08:40.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738539+0000", 2024-09-14T09:08:40.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045143902999999999 2024-09-14T09:08:40.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:40.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738613+0000", 2024-09-14T09:08:40.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4410000000000001e-05 2024-09-14T09:08:40.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:40.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738703+0000", 2024-09-14T09:08:40.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9417000000000001e-05 2024-09-14T09:08:40.823 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.823 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:40.823 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.823 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9687 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2777088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:40.823 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.693398+0000", 2024-09-14T09:08:40.823 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.086580944, 2024-09-14T09:08:40.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045501822999999997, 2024-09-14T09:08:40.823 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:40.823 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:40.823 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:40.823 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:40.823 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:40.823 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:40.824 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9687 2024-09-14T09:08:40.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.824 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:40.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:40.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693398+0000", 2024-09-14T09:08:40.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:40.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693398+0000", 2024-09-14T09:08:40.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:40.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694375+0000", 2024-09-14T09:08:40.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00097630899999999997 2024-09-14T09:08:40.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:40.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694377+0000", 2024-09-14T09:08:40.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.108e-06 2024-09-14T09:08:40.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:40.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694382+0000", 2024-09-14T09:08:40.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9679999999999997e-06 2024-09-14T09:08:40.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:40.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694385+0000", 2024-09-14T09:08:40.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2040000000000002e-06 2024-09-14T09:08:40.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738732+0000", 2024-09-14T09:08:40.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044346974999999997 2024-09-14T09:08:40.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:40.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738809+0000", 2024-09-14T09:08:40.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7174000000000003e-05 2024-09-14T09:08:40.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:40.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738900+0000", 2024-09-14T09:08:40.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1085e-05 2024-09-14T09:08:40.827 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.827 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:40.827 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.827 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9688 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2838528~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:40.827 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694390+0000", 2024-09-14T09:08:40.827 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.085588708, 2024-09-14T09:08:40.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044706231999999999, 2024-09-14T09:08:40.827 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:40.828 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:40.828 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:40.828 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:40.828 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:40.828 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:40.828 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9688 2024-09-14T09:08:40.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.828 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:40.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:40.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694390+0000", 2024-09-14T09:08:40.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:40.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694390+0000", 2024-09-14T09:08:40.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:40.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694391+0000", 2024-09-14T09:08:40.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.41e-07 2024-09-14T09:08:40.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:40.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694392+0000", 2024-09-14T09:08:40.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1090000000000001e-06 2024-09-14T09:08:40.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:40.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694397+0000", 2024-09-14T09:08:40.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.293e-06 2024-09-14T09:08:40.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:40.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694400+0000", 2024-09-14T09:08:40.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8909999999999999e-06 2024-09-14T09:08:40.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738930+0000", 2024-09-14T09:08:40.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044529812000000002 2024-09-14T09:08:40.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:40.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739011+0000", 2024-09-14T09:08:40.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1143999999999994e-05 2024-09-14T09:08:40.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:40.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739097+0000", 2024-09-14T09:08:40.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5741999999999993e-05 2024-09-14T09:08:40.831 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.831 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:40.831 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.832 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9689 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2899968~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:40.832 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694403+0000", 2024-09-14T09:08:40.832 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.0855758830000002, 2024-09-14T09:08:40.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044887095000000002, 2024-09-14T09:08:40.832 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:40.832 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:40.832 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:40.832 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:40.832 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:40.832 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:40.832 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9689 2024-09-14T09:08:40.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.832 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:40.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:40.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694403+0000", 2024-09-14T09:08:40.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:40.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694403+0000", 2024-09-14T09:08:40.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:40.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694404+0000", 2024-09-14T09:08:40.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.77e-07 2024-09-14T09:08:40.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:40.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694408+0000", 2024-09-14T09:08:40.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0010000000000003e-06 2024-09-14T09:08:40.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:40.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694412+0000", 2024-09-14T09:08:40.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0500000000000002e-06 2024-09-14T09:08:40.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:40.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694414+0000", 2024-09-14T09:08:40.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7300000000000001e-06 2024-09-14T09:08:40.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739126+0000", 2024-09-14T09:08:40.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044711199 2024-09-14T09:08:40.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:40.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739205+0000", 2024-09-14T09:08:40.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8926999999999998e-05 2024-09-14T09:08:40.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:40.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739290+0000", 2024-09-14T09:08:40.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5810999999999995e-05 2024-09-14T09:08:40.836 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.836 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:40.836 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.836 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9690 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2961408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:40.836 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694418+0000", 2024-09-14T09:08:40.836 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.0855613229999999, 2024-09-14T09:08:40.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045014599000000002, 2024-09-14T09:08:40.836 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:40.837 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:40.837 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:40.837 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:40.837 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:40.837 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:40.837 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9690 2024-09-14T09:08:40.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.837 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:40.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:40.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694418+0000", 2024-09-14T09:08:40.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:40.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694418+0000", 2024-09-14T09:08:40.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:40.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694418+0000", 2024-09-14T09:08:40.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.05e-07 2024-09-14T09:08:40.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:40.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694419+0000", 2024-09-14T09:08:40.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0890000000000001e-06 2024-09-14T09:08:40.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:40.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694422+0000", 2024-09-14T09:08:40.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.802e-06 2024-09-14T09:08:40.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:40.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694424+0000", 2024-09-14T09:08:40.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.497e-06 2024-09-14T09:08:40.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739328+0000", 2024-09-14T09:08:40.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044903699999999998 2024-09-14T09:08:40.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:40.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739375+0000", 2024-09-14T09:08:40.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7265000000000002e-05 2024-09-14T09:08:40.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:40.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739432+0000", 2024-09-14T09:08:40.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7040999999999998e-05 2024-09-14T09:08:40.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.841 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:40.841 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.841 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9691 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 3022848~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:40.841 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694427+0000", 2024-09-14T09:08:40.841 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.08555175, 2024-09-14T09:08:40.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045238403000000003, 2024-09-14T09:08:40.841 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:40.841 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:40.841 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:40.841 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:40.841 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:40.842 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:40.842 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9691 2024-09-14T09:08:40.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.842 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:40.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:40.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694427+0000", 2024-09-14T09:08:40.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:40.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694427+0000", 2024-09-14T09:08:40.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:40.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694428+0000", 2024-09-14T09:08:40.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.05e-07 2024-09-14T09:08:40.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:40.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694429+0000", 2024-09-14T09:08:40.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6700000000000002e-07 2024-09-14T09:08:40.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:40.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694432+0000", 2024-09-14T09:08:40.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8940000000000002e-06 2024-09-14T09:08:40.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:40.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694434+0000", 2024-09-14T09:08:40.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5009999999999999e-06 2024-09-14T09:08:40.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739479+0000", 2024-09-14T09:08:40.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045044806999999999 2024-09-14T09:08:40.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:40.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739568+0000", 2024-09-14T09:08:40.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9061999999999995e-05 2024-09-14T09:08:40.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:40.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739666+0000", 2024-09-14T09:08:40.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7967000000000006e-05 2024-09-14T09:08:40.845 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.845 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:40.845 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.845 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9692 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 3084288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:40.845 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694437+0000", 2024-09-14T09:08:40.845 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.0855422880000001, 2024-09-14T09:08:40.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045365111999999999, 2024-09-14T09:08:40.845 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:40.845 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:40.846 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:40.846 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:40.846 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:40.846 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:40.846 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9692 2024-09-14T09:08:40.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.846 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:40.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:40.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694437+0000", 2024-09-14T09:08:40.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:40.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694437+0000", 2024-09-14T09:08:40.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:40.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694437+0000", 2024-09-14T09:08:40.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8999999999999998e-07 2024-09-14T09:08:40.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:40.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694438+0000", 2024-09-14T09:08:40.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0249999999999999e-06 2024-09-14T09:08:40.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:40.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694441+0000", 2024-09-14T09:08:40.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.835e-06 2024-09-14T09:08:40.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:40.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694443+0000", 2024-09-14T09:08:40.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4329999999999998e-06 2024-09-14T09:08:40.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739699+0000", 2024-09-14T09:08:40.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045255457999999998 2024-09-14T09:08:40.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:40.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739746+0000", 2024-09-14T09:08:40.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7132000000000002e-05 2024-09-14T09:08:40.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:40.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739802+0000", 2024-09-14T09:08:40.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5939000000000001e-05 2024-09-14T09:08:40.849 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.849 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:40.849 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.849 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9693 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 3145728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:40.849 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694446+0000", 2024-09-14T09:08:40.849 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.0855329600000001, 2024-09-14T09:08:40.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045601007999999998, 2024-09-14T09:08:40.849 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:40.850 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:40.850 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:40.850 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:40.850 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:40.850 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:40.850 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9693 2024-09-14T09:08:40.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.850 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:40.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:40.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694446+0000", 2024-09-14T09:08:40.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:40.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694446+0000", 2024-09-14T09:08:40.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:40.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694446+0000", 2024-09-14T09:08:40.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1e-07 2024-09-14T09:08:40.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:40.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694447+0000", 2024-09-14T09:08:40.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9099999999999991e-07 2024-09-14T09:08:40.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:40.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694450+0000", 2024-09-14T09:08:40.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8049999999999998e-06 2024-09-14T09:08:40.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:40.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694453+0000", 2024-09-14T09:08:40.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4480000000000001e-06 2024-09-14T09:08:40.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739854+0000", 2024-09-14T09:08:40.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045401336 2024-09-14T09:08:40.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:40.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739942+0000", 2024-09-14T09:08:40.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8339999999999998e-05 2024-09-14T09:08:40.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:40.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.740047+0000", 2024-09-14T09:08:40.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010487799999999999 2024-09-14T09:08:40.853 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.853 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:40.853 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.853 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9694 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 3207168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:40.853 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694456+0000", 2024-09-14T09:08:40.853 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.0855236650000002, 2024-09-14T09:08:40.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045779780999999999, 2024-09-14T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9694 2024-09-14T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694456+0000", 2024-09-14T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:40.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694456+0000", 2024-09-14T09:08:40.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:40.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699125+0000", 2024-09-14T09:08:40.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046694359999999999 2024-09-14T09:08:40.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:40.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699127+0000", 2024-09-14T09:08:40.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.996e-06 2024-09-14T09:08:40.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:40.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699132+0000", 2024-09-14T09:08:40.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1970000000000004e-06 2024-09-14T09:08:40.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:40.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699136+0000", 2024-09-14T09:08:40.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3419999999999999e-06 2024-09-14T09:08:40.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.740084+0000", 2024-09-14T09:08:40.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040948311000000001 2024-09-14T09:08:40.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:40.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.740147+0000", 2024-09-14T09:08:40.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.368e-05 2024-09-14T09:08:40.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:40.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.740235+0000", 2024-09-14T09:08:40.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7818999999999994e-05 2024-09-14T09:08:40.857 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.857 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:40.857 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.857 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9748 3.10 3:0e07f4ad:::rbd_data.111219b19df.00000000000001c6:head [set-alloc-hint object_size 524288 write_size 524288,write 413696~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:40.857 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.699380+0000", 2024-09-14T09:08:40.857 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.080599061, 2024-09-14T09:08:40.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045171442999999999, 2024-09-14T09:08:40.858 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:40.858 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:40.858 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:40.858 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:40.858 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:40.858 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:40.858 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9748 2024-09-14T09:08:40.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.858 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:40.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:40.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699380+0000", 2024-09-14T09:08:40.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:40.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699380+0000", 2024-09-14T09:08:40.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:40.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699380+0000", 2024-09-14T09:08:40.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2000000000000001e-07 2024-09-14T09:08:40.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:40.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699386+0000", 2024-09-14T09:08:40.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9390000000000002e-06 2024-09-14T09:08:40.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:40.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699390+0000", 2024-09-14T09:08:40.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.32e-06 2024-09-14T09:08:40.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:40.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699392+0000", 2024-09-14T09:08:40.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5019999999999999e-06 2024-09-14T09:08:40.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.743265+0000", 2024-09-14T09:08:40.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.043872479999999998 2024-09-14T09:08:40.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:40.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.743387+0000", 2024-09-14T09:08:40.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012264 2024-09-14T09:08:40.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:40.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.743546+0000", 2024-09-14T09:08:40.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000158369 2024-09-14T09:08:40.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:40.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744431+0000", 2024-09-14T09:08:40.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00088561900000000003 2024-09-14T09:08:40.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:40.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744449+0000", 2024-09-14T09:08:40.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8096000000000001e-05 2024-09-14T09:08:40.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:40.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744504+0000", 2024-09-14T09:08:40.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4837999999999999e-05 2024-09-14T09:08:40.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:40.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744552+0000", 2024-09-14T09:08:40.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7420000000000003e-05 2024-09-14T09:08:40.862 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.862 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:40.862 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.863 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9766 3.10 3:0e07f4ad:::rbd_data.111219b19df.00000000000001c6:head [read 409600~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:40.863 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.699552+0000", 2024-09-14T09:08:40.863 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.0804267250000001, 2024-09-14T09:08:40.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045179127999999999, 2024-09-14T09:08:40.863 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:40.863 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:40.863 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:40.863 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:40.863 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:40.863 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:40.863 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9766 2024-09-14T09:08:40.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.863 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:40.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:40.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699552+0000", 2024-09-14T09:08:40.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:40.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699552+0000", 2024-09-14T09:08:40.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:40.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:40.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699553+0000", 2024-09-14T09:08:40.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0200000000000003e-07 2024-09-14T09:08:40.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:40.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699555+0000", 2024-09-14T09:08:40.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.844e-06 2024-09-14T09:08:40.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:40.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699561+0000", 2024-09-14T09:08:40.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0859999999999998e-06 2024-09-14T09:08:40.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:40.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699567+0000", 2024-09-14T09:08:40.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8619999999999999e-06 2024-09-14T09:08:40.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744017+0000", 2024-09-14T09:08:40.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044450311999999999 2024-09-14T09:08:40.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for rw locks", 2024-09-14T09:08:40.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744054+0000", 2024-09-14T09:08:40.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6910999999999999e-05 2024-09-14T09:08:40.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:40.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744581+0000", 2024-09-14T09:08:40.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00052667899999999995 2024-09-14T09:08:40.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:40.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744639+0000", 2024-09-14T09:08:40.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8310999999999998e-05 2024-09-14T09:08:40.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:40.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:40.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:40.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744732+0000", 2024-09-14T09:08:40.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2720999999999995e-05 2024-09-14T09:08:40.867 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.867 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:40.867 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.867 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:40.867 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:40.867 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:40.869 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:08:40.869 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:40.870+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:40.870 INFO:teuthology.orchestra.run.smithi148.stdout:3938 write 0xbb0e000 thru 0xbb107f5 (0x27f6 bytes) 2024-09-14T09:08:40.870 INFO:teuthology.orchestra.run.smithi148.stdout:3942 trunc from 0xbb10800 to 0x89b8e00 2024-09-14T09:08:40.870 INFO:teuthology.orchestra.run.smithi148.stdout:3946 write 0x8eb9c00 thru 0x8ebccf6 (0x30f7 bytes) 2024-09-14T09:08:40.870 INFO:teuthology.orchestra.run.smithi148.stdout:3948 write 0x5ead600 thru 0x5ebc3d2 (0xedd3 bytes) 2024-09-14T09:08:40.870 INFO:teuthology.orchestra.run.smithi148.stdout:3949 read 0x462c800 thru 0x462d52e (0xd2f bytes) 2024-09-14T09:08:40.870 INFO:teuthology.orchestra.run.smithi148.stdout:3950 write 0x4b96200 thru 0x4b9c3bd (0x61be bytes) 2024-09-14T09:08:40.870 INFO:teuthology.orchestra.run.smithi148.stdout:3951 read 0x297c00 thru 0x297c7e (0x7f bytes) 2024-09-14T09:08:40.871 INFO:teuthology.orchestra.run.smithi148.stdout:3953 read 0x26c9a00 thru 0x26d6605 (0xcc06 bytes) 2024-09-14T09:08:40.871 INFO:teuthology.orchestra.run.smithi148.stdout:3954 punch from 0x31e4200 to 0x31f3800, (0xf600 bytes) 2024-09-14T09:08:40.871 INFO:teuthology.orchestra.run.smithi148.stdout:3955 read 0x2469600 thru 0x246fde4 (0x67e5 bytes) 2024-09-14T09:08:40.871 INFO:teuthology.orchestra.run.smithi148.stdout:3957 write 0x17c0c00 thru 0x17c6aca (0x5ecb bytes) 2024-09-14T09:08:40.871 INFO:teuthology.orchestra.run.smithi148.stdout:3958 punch from 0x4723200 to 0x4729a00, (0x6800 bytes) 2024-09-14T09:08:40.871 INFO:teuthology.orchestra.run.smithi148.stdout:3960 write 0x6e96800 thru 0x6ea6251 (0xfa52 bytes) 2024-09-14T09:08:40.871 INFO:teuthology.orchestra.run.smithi148.stdout:3962 trunc from 0x8ebce00 to 0x1bca800 2024-09-14T09:08:40.946 INFO:teuthology.orchestra.run.smithi148.stdout:3966 write 0x4a0f400 thru 0x4a16494 (0x7095 bytes) 2024-09-14T09:08:40.950 INFO:teuthology.orchestra.run.smithi148.stdout:3967 trunc from 0x4a16600 to 0x1adfc00 2024-09-14T09:08:40.969 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:40.970+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:40.985 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T09:08:40.986 INFO:teuthology.orchestra.run.smithi116.stderr:marked out osd.1. 2024-09-14T09:08:41.031 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:41.032 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:41.032 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:08:41.032 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:41.041 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:08:41.069 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:41.072+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:41.170 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:41.172+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:41.185 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:41.186 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:41.186 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:41.186 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:41.186 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:41.194 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:08:41.271 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:41.273+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:41.339 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:41.339 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:41.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:41.339 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:41.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.339 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4604.0:364 3.1d 3:bb0fb96d:::rbd_data.1112609a9334.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 28633088~35328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-14T09:08:41.339 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:04.667444+0000", 2024-09-14T09:08:41.339 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.672807773999999, 2024-09-14T09:08:41.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.052308081999999999, 2024-09-14T09:08:41.339 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:41.339 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:41.339 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:41.340 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:41.340 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4604", 2024-09-14T09:08:41.340 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/335524879", 2024-09-14T09:08:41.340 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 364 2024-09-14T09:08:41.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.340 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:41.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:41.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.667444+0000", 2024-09-14T09:08:41.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:41.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.667444+0000", 2024-09-14T09:08:41.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:41.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.667445+0000", 2024-09-14T09:08:41.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1999999999999998e-07 2024-09-14T09:08:41.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:41.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681087+0000", 2024-09-14T09:08:41.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013641863000000001 2024-09-14T09:08:41.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:41.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681113+0000", 2024-09-14T09:08:41.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6310000000000001e-05 2024-09-14T09:08:41.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681123+0000", 2024-09-14T09:08:41.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7289999999999995e-06 2024-09-14T09:08:41.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:41.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681203+0000", 2024-09-14T09:08:41.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0628000000000001e-05 2024-09-14T09:08:41.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:41.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.681323+0000", 2024-09-14T09:08:41.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000119722 2024-09-14T09:08:41.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:41.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.682203+0000", 2024-09-14T09:08:41.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00087938299999999997 2024-09-14T09:08:41.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:41.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719043+0000", 2024-09-14T09:08:41.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036840218000000001 2024-09-14T09:08:41.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:41.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719654+0000", 2024-09-14T09:08:41.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00061077199999999999 2024-09-14T09:08:41.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:41.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719698+0000", 2024-09-14T09:08:41.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4177000000000001e-05 2024-09-14T09:08:41.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:41.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:04.719752+0000", 2024-09-14T09:08:41.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4459999999999997e-05 2024-09-14T09:08:41.344 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.344 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:41.344 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.345 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7885 3.1e 3:79089f6b:::rbd_data.11123620c885.0000000000000002:12 [read 256000~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:41.345 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075571+0000", 2024-09-14T09:08:41.345 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.264680812999998, 2024-09-14T09:08:41.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036029795000000003, 2024-09-14T09:08:41.345 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:41.345 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:41.345 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:41.345 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:41.345 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:41.345 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:41.345 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7885 2024-09-14T09:08:41.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.345 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:41.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:41.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075571+0000", 2024-09-14T09:08:41.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:41.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075571+0000", 2024-09-14T09:08:41.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:41.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075571+0000", 2024-09-14T09:08:41.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.01e-07 2024-09-14T09:08:41.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:41.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075573+0000", 2024-09-14T09:08:41.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6789999999999999e-06 2024-09-14T09:08:41.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:41.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075579+0000", 2024-09-14T09:08:41.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6489999999999996e-06 2024-09-14T09:08:41.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075584+0000", 2024-09-14T09:08:41.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7530000000000001e-06 2024-09-14T09:08:41.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:41.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111315+0000", 2024-09-14T09:08:41.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035731375000000003 2024-09-14T09:08:41.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:41.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111421+0000", 2024-09-14T09:08:41.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106124 2024-09-14T09:08:41.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:41.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111601+0000", 2024-09-14T09:08:41.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017981400000000001 2024-09-14T09:08:41.349 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.349 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:41.349 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.349 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7958 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 4096~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:41.349 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075911+0000", 2024-09-14T09:08:41.349 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.264340747999999, 2024-09-14T09:08:41.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035748988000000002, 2024-09-14T09:08:41.349 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:41.349 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:41.349 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:41.349 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:41.349 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:41.350 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:41.350 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7958 2024-09-14T09:08:41.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.350 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:41.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:41.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075911+0000", 2024-09-14T09:08:41.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:41.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075911+0000", 2024-09-14T09:08:41.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:41.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075911+0000", 2024-09-14T09:08:41.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0800000000000001e-07 2024-09-14T09:08:41.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:41.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075917+0000", 2024-09-14T09:08:41.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0800000000000002e-06 2024-09-14T09:08:41.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:41.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075921+0000", 2024-09-14T09:08:41.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7610000000000001e-06 2024-09-14T09:08:41.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075924+0000", 2024-09-14T09:08:41.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5349999999999999e-06 2024-09-14T09:08:41.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:41.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111099+0000", 2024-09-14T09:08:41.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035175728000000003 2024-09-14T09:08:41.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:41.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111185+0000", 2024-09-14T09:08:41.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5185000000000005e-05 2024-09-14T09:08:41.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:41.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111660+0000", 2024-09-14T09:08:41.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00047549099999999998 2024-09-14T09:08:41.353 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.353 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:41.353 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.353 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7959 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 14336~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:41.353 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075927+0000", 2024-09-14T09:08:41.353 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.264324655999999, 2024-09-14T09:08:41.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036277579999999997, 2024-09-14T09:08:41.353 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:41.354 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:41.354 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:41.354 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:41.354 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:41.354 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:41.354 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7959 2024-09-14T09:08:41.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.354 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:41.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:41.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075927+0000", 2024-09-14T09:08:41.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:41.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075927+0000", 2024-09-14T09:08:41.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:41.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075927+0000", 2024-09-14T09:08:41.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4200000000000002e-07 2024-09-14T09:08:41.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:41.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075929+0000", 2024-09-14T09:08:41.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0750000000000001e-06 2024-09-14T09:08:41.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:41.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075931+0000", 2024-09-14T09:08:41.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8289999999999999e-06 2024-09-14T09:08:41.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075934+0000", 2024-09-14T09:08:41.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.525e-06 2024-09-14T09:08:41.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:41.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111692+0000", 2024-09-14T09:08:41.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035757780000000003 2024-09-14T09:08:41.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:41.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.111772+0000", 2024-09-14T09:08:41.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0173999999999995e-05 2024-09-14T09:08:41.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:41.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112205+0000", 2024-09-14T09:08:41.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000432955 2024-09-14T09:08:41.357 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.357 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:41.357 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.357 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7960 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 40960~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:41.357 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075937+0000", 2024-09-14T09:08:41.358 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.264314829, 2024-09-14T09:08:41.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036668890000000003, 2024-09-14T09:08:41.358 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:41.358 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:41.358 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:41.358 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:41.358 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:41.358 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:41.358 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7960 2024-09-14T09:08:41.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.358 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:41.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:41.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075937+0000", 2024-09-14T09:08:41.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:41.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075937+0000", 2024-09-14T09:08:41.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:41.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075937+0000", 2024-09-14T09:08:41.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:08:41.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:41.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075938+0000", 2024-09-14T09:08:41.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4900000000000004e-07 2024-09-14T09:08:41.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:41.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075941+0000", 2024-09-14T09:08:41.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7199999999999998e-06 2024-09-14T09:08:41.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075944+0000", 2024-09-14T09:08:41.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6850000000000001e-06 2024-09-14T09:08:41.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:41.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112243+0000", 2024-09-14T09:08:41.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036299512999999999 2024-09-14T09:08:41.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:41.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112343+0000", 2024-09-14T09:08:41.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9722000000000005e-05 2024-09-14T09:08:41.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:41.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112606+0000", 2024-09-14T09:08:41.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026292600000000002 2024-09-14T09:08:41.361 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.361 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:41.362 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.362 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7961 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 51200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:41.362 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075947+0000", 2024-09-14T09:08:41.362 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.264305245999999, 2024-09-14T09:08:41.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037048949999999997, 2024-09-14T09:08:41.362 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:41.362 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:41.362 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:41.362 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:41.362 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:41.362 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:41.363 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7961 2024-09-14T09:08:41.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.363 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:41.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:41.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075947+0000", 2024-09-14T09:08:41.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:41.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075947+0000", 2024-09-14T09:08:41.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:41.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075947+0000", 2024-09-14T09:08:41.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.05e-07 2024-09-14T09:08:41.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:41.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075948+0000", 2024-09-14T09:08:41.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.28e-06 2024-09-14T09:08:41.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:41.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075951+0000", 2024-09-14T09:08:41.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7829999999999999e-06 2024-09-14T09:08:41.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075953+0000", 2024-09-14T09:08:41.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5239999999999999e-06 2024-09-14T09:08:41.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:41.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112642+0000", 2024-09-14T09:08:41.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036688193000000001 2024-09-14T09:08:41.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:41.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112741+0000", 2024-09-14T09:08:41.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9816999999999997e-05 2024-09-14T09:08:41.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:41.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.112996+0000", 2024-09-14T09:08:41.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025414799999999999 2024-09-14T09:08:41.366 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.366 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:41.367 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.367 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7962 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 61440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:41.367 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075956+0000", 2024-09-14T09:08:41.367 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.264295629999999, 2024-09-14T09:08:41.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037427290000000002, 2024-09-14T09:08:41.367 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:41.367 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:41.367 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:41.367 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:41.367 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:41.367 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:41.368 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7962 2024-09-14T09:08:41.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.368 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:41.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:41.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075956+0000", 2024-09-14T09:08:41.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:41.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075956+0000", 2024-09-14T09:08:41.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:41.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075956+0000", 2024-09-14T09:08:41.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:08:41.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:41.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075958+0000", 2024-09-14T09:08:41.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.102e-06 2024-09-14T09:08:41.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:41.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075968+0000", 2024-09-14T09:08:41.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0774000000000001e-05 2024-09-14T09:08:41.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075973+0000", 2024-09-14T09:08:41.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6809999999999997e-06 2024-09-14T09:08:41.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:41.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113030+0000", 2024-09-14T09:08:41.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037057198999999999 2024-09-14T09:08:41.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:41.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113127+0000", 2024-09-14T09:08:41.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7094000000000002e-05 2024-09-14T09:08:41.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:41.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113384+0000", 2024-09-14T09:08:41.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025623099999999999 2024-09-14T09:08:41.371 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.371 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:41.371 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.371 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7963 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 71680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:41.371 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075980+0000", 2024-09-14T09:08:41.371 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.264271644000001, 2024-09-14T09:08:41.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037742675000000003, 2024-09-14T09:08:41.372 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:41.372 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:41.372 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:41.372 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:41.372 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:41.372 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:41.372 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7963 2024-09-14T09:08:41.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.372 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:41.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:41.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075980+0000", 2024-09-14T09:08:41.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:41.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075980+0000", 2024-09-14T09:08:41.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:41.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075981+0000", 2024-09-14T09:08:41.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0299999999999999e-07 2024-09-14T09:08:41.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:41.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075983+0000", 2024-09-14T09:08:41.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.886e-06 2024-09-14T09:08:41.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:41.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075989+0000", 2024-09-14T09:08:41.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9499999999999998e-06 2024-09-14T09:08:41.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075993+0000", 2024-09-14T09:08:41.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2740000000000001e-06 2024-09-14T09:08:41.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:41.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113413+0000", 2024-09-14T09:08:41.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037420417999999997 2024-09-14T09:08:41.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:41.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113508+0000", 2024-09-14T09:08:41.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4636999999999995e-05 2024-09-14T09:08:41.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:41.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113723+0000", 2024-09-14T09:08:41.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000215007 2024-09-14T09:08:41.375 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.375 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:41.375 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.375 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7964 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 98304~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:41.376 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.075999+0000", 2024-09-14T09:08:41.376 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.264253363999998, 2024-09-14T09:08:41.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038103415000000002, 2024-09-14T09:08:41.376 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:41.376 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:41.376 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:41.376 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:41.376 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:41.376 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:41.376 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7964 2024-09-14T09:08:41.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.376 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:41.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:41.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075999+0000", 2024-09-14T09:08:41.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:41.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075999+0000", 2024-09-14T09:08:41.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:41.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.075999+0000", 2024-09-14T09:08:41.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6399999999999998e-07 2024-09-14T09:08:41.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:41.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076001+0000", 2024-09-14T09:08:41.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7999999999999999e-06 2024-09-14T09:08:41.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:41.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076005+0000", 2024-09-14T09:08:41.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3309999999999997e-06 2024-09-14T09:08:41.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076008+0000", 2024-09-14T09:08:41.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-06 2024-09-14T09:08:41.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:41.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113768+0000", 2024-09-14T09:08:41.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037760295999999999 2024-09-14T09:08:41.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:41.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.113854+0000", 2024-09-14T09:08:41.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6030000000000001e-05 2024-09-14T09:08:41.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:41.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114102+0000", 2024-09-14T09:08:41.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024789000000000001 2024-09-14T09:08:41.379 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.379 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:41.379 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.379 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7965 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 108544~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:41.379 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076011+0000", 2024-09-14T09:08:41.380 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.264240895, 2024-09-14T09:08:41.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038452854000000002, 2024-09-14T09:08:41.380 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:41.380 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:41.380 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:41.380 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:41.380 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:41.380 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:41.380 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7965 2024-09-14T09:08:41.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.380 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:41.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:41.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076011+0000", 2024-09-14T09:08:41.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:41.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076011+0000", 2024-09-14T09:08:41.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:41.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076011+0000", 2024-09-14T09:08:41.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1899999999999999e-07 2024-09-14T09:08:41.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:41.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076012+0000", 2024-09-14T09:08:41.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0610000000000001e-06 2024-09-14T09:08:41.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:41.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076015+0000", 2024-09-14T09:08:41.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8380000000000002e-06 2024-09-14T09:08:41.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076018+0000", 2024-09-14T09:08:41.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.458e-06 2024-09-14T09:08:41.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:41.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114136+0000", 2024-09-14T09:08:41.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038118217000000003 2024-09-14T09:08:41.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:41.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114218+0000", 2024-09-14T09:08:41.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2496000000000004e-05 2024-09-14T09:08:41.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:41.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114464+0000", 2024-09-14T09:08:41.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000245565 2024-09-14T09:08:41.383 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.383 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:41.383 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.384 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7966 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 118784~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:41.384 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076020+0000", 2024-09-14T09:08:41.384 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.26423162, 2024-09-14T09:08:41.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038813976, 2024-09-14T09:08:41.384 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:41.384 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:41.384 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:41.384 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:41.384 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:41.384 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:41.384 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7966 2024-09-14T09:08:41.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.385 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:41.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:41.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076020+0000", 2024-09-14T09:08:41.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:41.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076020+0000", 2024-09-14T09:08:41.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:41.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076020+0000", 2024-09-14T09:08:41.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1199999999999999e-07 2024-09-14T09:08:41.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:41.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076022+0000", 2024-09-14T09:08:41.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0610000000000001e-06 2024-09-14T09:08:41.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:41.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076025+0000", 2024-09-14T09:08:41.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4189999999999998e-06 2024-09-14T09:08:41.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076028+0000", 2024-09-14T09:08:41.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9909999999999998e-06 2024-09-14T09:08:41.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:41.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114497+0000", 2024-09-14T09:08:41.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038469376999999999 2024-09-14T09:08:41.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:41.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114596+0000", 2024-09-14T09:08:41.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8978e-05 2024-09-14T09:08:41.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:41.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114834+0000", 2024-09-14T09:08:41.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023793800000000001 2024-09-14T09:08:41.388 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.388 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:41.388 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.388 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7967 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 129024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:41.388 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076031+0000", 2024-09-14T09:08:41.389 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.264221107000001, 2024-09-14T09:08:41.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039142059, 2024-09-14T09:08:41.389 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:41.389 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:41.389 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:41.389 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:41.389 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:41.389 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:41.389 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7967 2024-09-14T09:08:41.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.389 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:41.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:41.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076031+0000", 2024-09-14T09:08:41.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:41.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076031+0000", 2024-09-14T09:08:41.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:41.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076031+0000", 2024-09-14T09:08:41.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.11e-07 2024-09-14T09:08:41.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:41.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076032+0000", 2024-09-14T09:08:41.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.037e-06 2024-09-14T09:08:41.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:41.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076035+0000", 2024-09-14T09:08:41.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7389999999999999e-06 2024-09-14T09:08:41.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076038+0000", 2024-09-14T09:08:41.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3780000000000001e-06 2024-09-14T09:08:41.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:41.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114868+0000", 2024-09-14T09:08:41.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038829977000000002 2024-09-14T09:08:41.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:41.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.114972+0000", 2024-09-14T09:08:41.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010364100000000001 2024-09-14T09:08:41.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:41.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115173+0000", 2024-09-14T09:08:41.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020107600000000001 2024-09-14T09:08:41.392 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.393 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:41.393 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.393 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7968 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 155648~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:41.393 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076041+0000", 2024-09-14T09:08:41.393 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.264210806000001, 2024-09-14T09:08:41.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039346991999999997, 2024-09-14T09:08:41.393 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:41.393 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:41.393 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:41.393 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:41.393 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:41.394 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:41.394 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7968 2024-09-14T09:08:41.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.394 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:41.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:41.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076041+0000", 2024-09-14T09:08:41.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:41.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076041+0000", 2024-09-14T09:08:41.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:41.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076041+0000", 2024-09-14T09:08:41.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0100000000000001e-07 2024-09-14T09:08:41.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:41.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076042+0000", 2024-09-14T09:08:41.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0380000000000001e-06 2024-09-14T09:08:41.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:41.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076045+0000", 2024-09-14T09:08:41.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7250000000000002e-06 2024-09-14T09:08:41.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076047+0000", 2024-09-14T09:08:41.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4600000000000002e-06 2024-09-14T09:08:41.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:41.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115220+0000", 2024-09-14T09:08:41.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039172430000000001 2024-09-14T09:08:41.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:41.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115316+0000", 2024-09-14T09:08:41.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5712999999999997e-05 2024-09-14T09:08:41.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:41.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115388+0000", 2024-09-14T09:08:41.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2424999999999999e-05 2024-09-14T09:08:41.397 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.397 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:41.397 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.397 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7969 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 165888~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:41.397 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076050+0000", 2024-09-14T09:08:41.397 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.264201581999998, 2024-09-14T09:08:41.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039616993000000003, 2024-09-14T09:08:41.397 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:41.397 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:41.398 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:41.398 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:41.398 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:41.398 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:41.398 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7969 2024-09-14T09:08:41.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.398 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:41.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:41.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076050+0000", 2024-09-14T09:08:41.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:41.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076050+0000", 2024-09-14T09:08:41.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:41.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076050+0000", 2024-09-14T09:08:41.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0699999999999999e-07 2024-09-14T09:08:41.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:41.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076051+0000", 2024-09-14T09:08:41.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0049999999999999e-06 2024-09-14T09:08:41.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:41.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076054+0000", 2024-09-14T09:08:41.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7800000000000001e-06 2024-09-14T09:08:41.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076057+0000", 2024-09-14T09:08:41.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5450000000000002e-06 2024-09-14T09:08:41.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:41.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115430+0000", 2024-09-14T09:08:41.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039373506000000003 2024-09-14T09:08:41.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:41.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115509+0000", 2024-09-14T09:08:41.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8276999999999996e-05 2024-09-14T09:08:41.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:41.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115667+0000", 2024-09-14T09:08:41.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015867299999999999 2024-09-14T09:08:41.401 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.401 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:41.401 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.401 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7970 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 176128~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:41.401 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076060+0000", 2024-09-14T09:08:41.401 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.264192319999999, 2024-09-14T09:08:41.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039793765000000002, 2024-09-14T09:08:41.402 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:41.402 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:41.402 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:41.402 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:41.402 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:41.402 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:41.402 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7970 2024-09-14T09:08:41.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.402 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:41.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:41.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076060+0000", 2024-09-14T09:08:41.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:41.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076060+0000", 2024-09-14T09:08:41.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:41.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076060+0000", 2024-09-14T09:08:41.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:08:41.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:41.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076064+0000", 2024-09-14T09:08:41.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3930000000000001e-06 2024-09-14T09:08:41.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:41.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076067+0000", 2024-09-14T09:08:41.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9809999999999999e-06 2024-09-14T09:08:41.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076070+0000", 2024-09-14T09:08:41.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6010000000000002e-06 2024-09-14T09:08:41.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:41.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115699+0000", 2024-09-14T09:08:41.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039629659999999997 2024-09-14T09:08:41.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:41.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115785+0000", 2024-09-14T09:08:41.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5109000000000001e-05 2024-09-14T09:08:41.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:41.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115853+0000", 2024-09-14T09:08:41.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8812000000000005e-05 2024-09-14T09:08:41.405 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.405 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:41.405 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.406 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7971 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 186368~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:41.406 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076073+0000", 2024-09-14T09:08:41.406 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.264179247000001, 2024-09-14T09:08:41.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039977828, 2024-09-14T09:08:41.406 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:41.406 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:41.406 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:41.406 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:41.406 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:41.406 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:41.406 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7971 2024-09-14T09:08:41.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.406 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:41.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:41.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076073+0000", 2024-09-14T09:08:41.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:41.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076073+0000", 2024-09-14T09:08:41.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:41.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076073+0000", 2024-09-14T09:08:41.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1500000000000001e-07 2024-09-14T09:08:41.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:41.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076074+0000", 2024-09-14T09:08:41.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4499999999999995e-07 2024-09-14T09:08:41.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:41.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076077+0000", 2024-09-14T09:08:41.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.785e-06 2024-09-14T09:08:41.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076079+0000", 2024-09-14T09:08:41.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6129999999999998e-06 2024-09-14T09:08:41.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:41.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115884+0000", 2024-09-14T09:08:41.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.039805261000000002 2024-09-14T09:08:41.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:41.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.115973+0000", 2024-09-14T09:08:41.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8381999999999995e-05 2024-09-14T09:08:41.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:41.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116050+0000", 2024-09-14T09:08:41.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7626999999999994e-05 2024-09-14T09:08:41.410 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.410 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:41.410 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.410 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7972 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 212992~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:41.410 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076082+0000", 2024-09-14T09:08:41.410 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.264169827, 2024-09-14T09:08:41.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040162654999999998, 2024-09-14T09:08:41.410 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:41.410 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:41.411 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:41.411 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:41.411 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:41.411 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:41.411 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7972 2024-09-14T09:08:41.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.411 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:41.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:41.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076082+0000", 2024-09-14T09:08:41.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:41.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076082+0000", 2024-09-14T09:08:41.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:41.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076082+0000", 2024-09-14T09:08:41.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3099999999999999e-07 2024-09-14T09:08:41.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:41.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076083+0000", 2024-09-14T09:08:41.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.64e-07 2024-09-14T09:08:41.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:41.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076086+0000", 2024-09-14T09:08:41.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7539999999999998e-06 2024-09-14T09:08:41.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076089+0000", 2024-09-14T09:08:41.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5409999999999999e-06 2024-09-14T09:08:41.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:41.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116091+0000", 2024-09-14T09:08:41.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040002204 2024-09-14T09:08:41.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:41.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116172+0000", 2024-09-14T09:08:41.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0833000000000003e-05 2024-09-14T09:08:41.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:41.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116245+0000", 2024-09-14T09:08:41.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3127999999999995e-05 2024-09-14T09:08:41.414 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.414 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:41.414 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.415 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7973 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 223232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:41.415 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076091+0000", 2024-09-14T09:08:41.415 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.264160460999999, 2024-09-14T09:08:41.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040345740999999997, 2024-09-14T09:08:41.415 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:41.415 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:41.415 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:41.415 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:41.415 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:41.415 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:41.415 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7973 2024-09-14T09:08:41.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.415 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:41.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:41.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076091+0000", 2024-09-14T09:08:41.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:41.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076091+0000", 2024-09-14T09:08:41.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:41.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076092+0000", 2024-09-14T09:08:41.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7300000000000002e-07 2024-09-14T09:08:41.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:41.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076093+0000", 2024-09-14T09:08:41.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0300000000000001e-06 2024-09-14T09:08:41.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:41.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076096+0000", 2024-09-14T09:08:41.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6049999999999998e-06 2024-09-14T09:08:41.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076099+0000", 2024-09-14T09:08:41.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8569999999999999e-06 2024-09-14T09:08:41.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:41.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116287+0000", 2024-09-14T09:08:41.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040187753 2024-09-14T09:08:41.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:41.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116370+0000", 2024-09-14T09:08:41.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2509000000000006e-05 2024-09-14T09:08:41.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:41.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116437+0000", 2024-09-14T09:08:41.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7613999999999993e-05 2024-09-14T09:08:41.418 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.418 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:41.418 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.419 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7974 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 233472~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:41.419 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076102+0000", 2024-09-14T09:08:41.419 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.264149711999998, 2024-09-14T09:08:41.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040515104000000003, 2024-09-14T09:08:41.419 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:41.419 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:41.419 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:41.419 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:41.419 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:41.419 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:41.419 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7974 2024-09-14T09:08:41.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.419 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:41.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:41.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076102+0000", 2024-09-14T09:08:41.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:41.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076102+0000", 2024-09-14T09:08:41.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:41.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076102+0000", 2024-09-14T09:08:41.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.04e-07 2024-09-14T09:08:41.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:41.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076103+0000", 2024-09-14T09:08:41.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.02e-06 2024-09-14T09:08:41.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:41.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076106+0000", 2024-09-14T09:08:41.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7499999999999999e-06 2024-09-14T09:08:41.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076109+0000", 2024-09-14T09:08:41.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3510000000000002e-06 2024-09-14T09:08:41.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:41.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116469+0000", 2024-09-14T09:08:41.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040359095999999997 2024-09-14T09:08:41.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:41.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116547+0000", 2024-09-14T09:08:41.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8509000000000003e-05 2024-09-14T09:08:41.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:41.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116617+0000", 2024-09-14T09:08:41.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0173999999999996e-05 2024-09-14T09:08:41.423 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.423 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:41.423 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.423 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4766.0:7975 3.e 3:7196a262:::rbd_data.11123620c885.0000000000000007:12 [read 243712~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-14T09:08:41.423 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:19.076113+0000", 2024-09-14T09:08:41.423 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.264139251, 2024-09-14T09:08:41.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040678662999999997, 2024-09-14T09:08:41.423 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:41.423 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:41.423 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:41.423 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:41.423 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4766", 2024-09-14T09:08:41.423 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/2382259597", 2024-09-14T09:08:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 7975 2024-09-14T09:08:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076113+0000", 2024-09-14T09:08:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076113+0000", 2024-09-14T09:08:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076113+0000", 2024-09-14T09:08:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.34e-07 2024-09-14T09:08:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076114+0000", 2024-09-14T09:08:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0410000000000001e-06 2024-09-14T09:08:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076117+0000", 2024-09-14T09:08:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7870000000000002e-06 2024-09-14T09:08:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.076121+0000", 2024-09-14T09:08:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1489999999999996e-06 2024-09-14T09:08:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116645+0000", 2024-09-14T09:08:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040523851999999999 2024-09-14T09:08:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116725+0000", 2024-09-14T09:08:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9985000000000001e-05 2024-09-14T09:08:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:19.116791+0000", 2024-09-14T09:08:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6614999999999998e-05 2024-09-14T09:08:41.427 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.427 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:41.427 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.427 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:41.427 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:41.427 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:41.428 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:08:41.429 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:41.430+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:41.528 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:41.530+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:41.536 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:41.536 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:41.536 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:41.536 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:41.545 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:08:41.629 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:41.631+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:41.688 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:41.688 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:41.688 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:41.688 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:41.688 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:41.696 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:08:41.731 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:41.733+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:41.777 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is unset 2024-09-14T09:08:41.806 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:41.806 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:41.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:41.806 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:41.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4782.0:881 3.1b 3:d82d5c58:::rbd_data.11127a12d636.000000000000000b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,truncate 4063232] snapc f=[f] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T09:08:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:09.937996+0000", 2024-09-14T09:08:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.869441336000001, 2024-09-14T09:08:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0081376629999999998, 2024-09-14T09:08:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4782", 2024-09-14T09:08:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/353415140", 2024-09-14T09:08:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 881 2024-09-14T09:08:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:41.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.937996+0000", 2024-09-14T09:08:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.937996+0000", 2024-09-14T09:08:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.937997+0000", 2024-09-14T09:08:41.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2419999999999999e-06 2024-09-14T09:08:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938002+0000", 2024-09-14T09:08:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3870000000000003e-06 2024-09-14T09:08:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938014+0000", 2024-09-14T09:08:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.22e-05 2024-09-14T09:08:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938020+0000", 2024-09-14T09:08:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9619999999999998e-06 2024-09-14T09:08:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938062+0000", 2024-09-14T09:08:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2150000000000001e-05 2024-09-14T09:08:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938156+0000", 2024-09-14T09:08:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3344999999999995e-05 2024-09-14T09:08:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-09-14T09:08:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.938275+0000", 2024-09-14T09:08:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000118983 2024-09-14T09:08:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.941256+0000", 2024-09-14T09:08:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002981151 2024-09-14T09:08:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.946065+0000", 2024-09-14T09:08:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048087190000000004 2024-09-14T09:08:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.946104+0000", 2024-09-14T09:08:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9363000000000002e-05 2024-09-14T09:08:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:09.946133+0000", 2024-09-14T09:08:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9161000000000001e-05 2024-09-14T09:08:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:246 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:41.812 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:08:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.010688924, 2024-09-14T09:08:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99004581000000003, 2024-09-14T09:08:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 246 2024-09-14T09:08:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:08:41.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:08:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796750+0000", 2024-09-14T09:08:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5519999999999999e-06 2024-09-14T09:08:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796754+0000", 2024-09-14T09:08:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2640000000000002e-06 2024-09-14T09:08:41.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796767+0000", 2024-09-14T09:08:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3517e-05 2024-09-14T09:08:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796775+0000", 2024-09-14T09:08:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8790000000000003e-06 2024-09-14T09:08:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796830+0000", 2024-09-14T09:08:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4829e-05 2024-09-14T09:08:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796843+0000", 2024-09-14T09:08:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.33e-05 2024-09-14T09:08:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786501+0000", 2024-09-14T09:08:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98965769299999995 2024-09-14T09:08:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786653+0000", 2024-09-14T09:08:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015237200000000001 2024-09-14T09:08:41.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786794+0000", 2024-09-14T09:08:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014040400000000001 2024-09-14T09:08:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:247 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 720896~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.010634138, 2024-09-14T09:08:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99048688100000004, 2024-09-14T09:08:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:41.817 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 247 2024-09-14T09:08:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:41.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7299999999999995e-07 2024-09-14T09:08:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796807+0000", 2024-09-14T09:08:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.106e-06 2024-09-14T09:08:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796815+0000", 2024-09-14T09:08:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4740000000000005e-06 2024-09-14T09:08:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796821+0000", 2024-09-14T09:08:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0469999999999999e-06 2024-09-14T09:08:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796872+0000", 2024-09-14T09:08:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0834000000000002e-05 2024-09-14T09:08:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796878+0000", 2024-09-14T09:08:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2990000000000002e-06 2024-09-14T09:08:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787176+0000", 2024-09-14T09:08:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99029817600000003 2024-09-14T09:08:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787225+0000", 2024-09-14T09:08:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8953999999999999e-05 2024-09-14T09:08:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:41.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787290+0000", 2024-09-14T09:08:41.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4318000000000003e-05 2024-09-14T09:08:41.822 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.822 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:41.822 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.822 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:248 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1179648~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:41.822 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:08:41.822 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.010603618999999, 2024-09-14T09:08:41.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99060754200000001, 2024-09-14T09:08:41.822 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:41.822 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:41.823 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:41.823 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:41.823 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:41.823 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:41.823 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 248 2024-09-14T09:08:41.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.823 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:41.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:41.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:08:41.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:08:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796834+0000", 2024-09-14T09:08:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4099999999999999e-07 2024-09-14T09:08:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796837+0000", 2024-09-14T09:08:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8459999999999999e-06 2024-09-14T09:08:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796844+0000", 2024-09-14T09:08:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1350000000000003e-06 2024-09-14T09:08:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796850+0000", 2024-09-14T09:08:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7139999999999998e-06 2024-09-14T09:08:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3909999999999998e-05 2024-09-14T09:08:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796899+0000", 2024-09-14T09:08:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7649999999999999e-06 2024-09-14T09:08:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787318+0000", 2024-09-14T09:08:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99041848300000002 2024-09-14T09:08:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787365+0000", 2024-09-14T09:08:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7086999999999998e-05 2024-09-14T09:08:41.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787441+0000", 2024-09-14T09:08:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6061000000000002e-05 2024-09-14T09:08:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:249 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1638400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:08:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.01056985, 2024-09-14T09:08:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99070346899999995, 2024-09-14T09:08:41.827 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 249 2024-09-14T09:08:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:08:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:08:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796868+0000", 2024-09-14T09:08:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2024-09-14T09:08:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796870+0000", 2024-09-14T09:08:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7889999999999999e-06 2024-09-14T09:08:41.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796877+0000", 2024-09-14T09:08:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8549999999999996e-06 2024-09-14T09:08:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796883+0000", 2024-09-14T09:08:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.665e-06 2024-09-14T09:08:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796915+0000", 2024-09-14T09:08:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2215999999999998e-05 2024-09-14T09:08:41.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796920+0000", 2024-09-14T09:08:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.527e-06 2024-09-14T09:08:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787468+0000", 2024-09-14T09:08:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99054877100000005 2024-09-14T09:08:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787512+0000", 2024-09-14T09:08:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3958000000000002e-05 2024-09-14T09:08:41.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787571+0000", 2024-09-14T09:08:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8167000000000001e-05 2024-09-14T09:08:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:250 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2097152~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.010543783999999, 2024-09-14T09:08:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99079431100000004, 2024-09-14T09:08:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:41.832 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 250 2024-09-14T09:08:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796894+0000", 2024-09-14T09:08:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2024-09-14T09:08:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796896+0000", 2024-09-14T09:08:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5600000000000001e-06 2024-09-14T09:08:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796902+0000", 2024-09-14T09:08:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3090000000000001e-06 2024-09-14T09:08:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796909+0000", 2024-09-14T09:08:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:08:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796942+0000", 2024-09-14T09:08:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-05 2024-09-14T09:08:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796948+0000", 2024-09-14T09:08:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5910000000000001e-06 2024-09-14T09:08:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787596+0000", 2024-09-14T09:08:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99064781400000002 2024-09-14T09:08:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:41.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787636+0000", 2024-09-14T09:08:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9715000000000002e-05 2024-09-14T09:08:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787687+0000", 2024-09-14T09:08:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1674e-05 2024-09-14T09:08:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:251 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.010518349, 2024-09-14T09:08:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99091769600000001, 2024-09-14T09:08:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 251 2024-09-14T09:08:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000005e-07 2024-09-14T09:08:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:41.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796922+0000", 2024-09-14T09:08:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.875e-06 2024-09-14T09:08:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796929+0000", 2024-09-14T09:08:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0260000000000002e-06 2024-09-14T09:08:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796935+0000", 2024-09-14T09:08:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7030000000000003e-06 2024-09-14T09:08:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796963+0000", 2024-09-14T09:08:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8368999999999999e-05 2024-09-14T09:08:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796966+0000", 2024-09-14T09:08:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4130000000000002e-06 2024-09-14T09:08:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787718+0000", 2024-09-14T09:08:41.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99075151100000003 2024-09-14T09:08:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787779+0000", 2024-09-14T09:08:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.088e-05 2024-09-14T09:08:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787836+0000", 2024-09-14T09:08:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7380000000000003e-05 2024-09-14T09:08:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:41.842 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:252 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:08:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.010492895000001, 2024-09-14T09:08:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99102491400000003, 2024-09-14T09:08:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 252 2024-09-14T09:08:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.843 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:08:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:08:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796945+0000", 2024-09-14T09:08:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2900000000000003e-07 2024-09-14T09:08:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796947+0000", 2024-09-14T09:08:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4279999999999999e-06 2024-09-14T09:08:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796954+0000", 2024-09-14T09:08:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5479999999999998e-06 2024-09-14T09:08:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796959+0000", 2024-09-14T09:08:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.22e-06 2024-09-14T09:08:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796988+0000", 2024-09-14T09:08:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9473000000000001e-05 2024-09-14T09:08:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:08:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:08:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787850+0000", 2024-09-14T09:08:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99085651100000005 2024-09-14T09:08:41.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787891+0000", 2024-09-14T09:08:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602000000000002e-05 2024-09-14T09:08:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787969+0000", 2024-09-14T09:08:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8063000000000001e-05 2024-09-14T09:08:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:253 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.010469015, 2024-09-14T09:08:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99122695699999996, 2024-09-14T09:08:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 253 2024-09-14T09:08:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.848 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:41.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:08:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:08:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:08:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796977+0000", 2024-09-14T09:08:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5030000000000002e-06 2024-09-14T09:08:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796982+0000", 2024-09-14T09:08:41.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2024-09-14T09:08:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797013+0000", 2024-09-14T09:08:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0451e-05 2024-09-14T09:08:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:08:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1690000000000001e-06 2024-09-14T09:08:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788011+0000", 2024-09-14T09:08:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99099490300000004 2024-09-14T09:08:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788102+0000", 2024-09-14T09:08:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0730999999999996e-05 2024-09-14T09:08:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788195+0000", 2024-09-14T09:08:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3245999999999995e-05 2024-09-14T09:08:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:254 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3932160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:08:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.010437457, 2024-09-14T09:08:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99137410500000001, 2024-09-14T09:08:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 254 2024-09-14T09:08:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.853 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:08:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:08:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797000+0000", 2024-09-14T09:08:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:08:41.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797003+0000", 2024-09-14T09:08:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7659999999999999e-06 2024-09-14T09:08:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797010+0000", 2024-09-14T09:08:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.029e-06 2024-09-14T09:08:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:08:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2024-09-14T09:08:41.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797044+0000", 2024-09-14T09:08:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9213e-05 2024-09-14T09:08:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797048+0000", 2024-09-14T09:08:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3400000000000002e-06 2024-09-14T09:08:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788222+0000", 2024-09-14T09:08:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99117407400000002 2024-09-14T09:08:41.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788306+0000", 2024-09-14T09:08:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4512999999999995e-05 2024-09-14T09:08:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788374+0000", 2024-09-14T09:08:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7226999999999999e-05 2024-09-14T09:08:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:264 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.010411099000001, 2024-09-14T09:08:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99161474699999996, 2024-09-14T09:08:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 264 2024-09-14T09:08:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:41.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2024-09-14T09:08:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:08:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2800000000000002e-06 2024-09-14T09:08:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:08:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0979999999999999e-06 2024-09-14T09:08:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797040+0000", 2024-09-14T09:08:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:08:41.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797068+0000", 2024-09-14T09:08:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7302999999999999e-05 2024-09-14T09:08:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797071+0000", 2024-09-14T09:08:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3610000000000001e-06 2024-09-14T09:08:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788436+0000", 2024-09-14T09:08:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99136489500000002 2024-09-14T09:08:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788538+0000", 2024-09-14T09:08:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101931 2024-09-14T09:08:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788641+0000", 2024-09-14T09:08:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010273899999999999 2024-09-14T09:08:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:265 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:08:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.010387740000001, 2024-09-14T09:08:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99176878199999996, 2024-09-14T09:08:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 265 2024-09-14T09:08:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:08:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:08:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:08:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.39e-07 2024-09-14T09:08:41.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797052+0000", 2024-09-14T09:08:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.345e-06 2024-09-14T09:08:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797058+0000", 2024-09-14T09:08:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5429999999999999e-06 2024-09-14T09:08:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797064+0000", 2024-09-14T09:08:41.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2000000000000002e-06 2024-09-14T09:08:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797091+0000", 2024-09-14T09:08:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7804e-05 2024-09-14T09:08:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797095+0000", 2024-09-14T09:08:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2024-09-14T09:08:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788667+0000", 2024-09-14T09:08:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157211300000003 2024-09-14T09:08:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788742+0000", 2024-09-14T09:08:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5159000000000003e-05 2024-09-14T09:08:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788818+0000", 2024-09-14T09:08:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6038000000000006e-05 2024-09-14T09:08:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:266 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.010364909, 2024-09-14T09:08:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99193390100000001, 2024-09-14T09:08:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 266 2024-09-14T09:08:41.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:08:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797075+0000", 2024-09-14T09:08:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2570000000000002e-06 2024-09-14T09:08:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797082+0000", 2024-09-14T09:08:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8029999999999997e-06 2024-09-14T09:08:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797088+0000", 2024-09-14T09:08:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.468e-06 2024-09-14T09:08:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797116+0000", 2024-09-14T09:08:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7752000000000001e-05 2024-09-14T09:08:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797121+0000", 2024-09-14T09:08:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5960000000000003e-06 2024-09-14T09:08:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788846+0000", 2024-09-14T09:08:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99172512199999996 2024-09-14T09:08:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788916+0000", 2024-09-14T09:08:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9843000000000002e-05 2024-09-14T09:08:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789006+0000", 2024-09-14T09:08:41.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9608e-05 2024-09-14T09:08:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:267 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.010340102000001, 2024-09-14T09:08:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99210926799999999, 2024-09-14T09:08:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:41.873 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 267 2024-09-14T09:08:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:41.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2399999999999999e-07 2024-09-14T09:08:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797099+0000", 2024-09-14T09:08:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.091e-06 2024-09-14T09:08:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:41.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797105+0000", 2024-09-14T09:08:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-09-14T09:08:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797111+0000", 2024-09-14T09:08:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5130000000000004e-06 2024-09-14T09:08:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797140+0000", 2024-09-14T09:08:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9513999999999999e-05 2024-09-14T09:08:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:41.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797145+0000", 2024-09-14T09:08:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:08:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789037+0000", 2024-09-14T09:08:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99189253899999996 2024-09-14T09:08:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789110+0000", 2024-09-14T09:08:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2848000000000005e-05 2024-09-14T09:08:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789206+0000", 2024-09-14T09:08:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5778000000000004e-05 2024-09-14T09:08:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:268 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.010316863, 2024-09-14T09:08:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992276359, 2024-09-14T09:08:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:41.878 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 268 2024-09-14T09:08:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:41.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:08:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797123+0000", 2024-09-14T09:08:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2740000000000002e-06 2024-09-14T09:08:41.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797129+0000", 2024-09-14T09:08:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-06 2024-09-14T09:08:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797134+0000", 2024-09-14T09:08:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9099999999999996e-06 2024-09-14T09:08:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797163+0000", 2024-09-14T09:08:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9709999999999998e-05 2024-09-14T09:08:41.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8709999999999999e-06 2024-09-14T09:08:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789231+0000", 2024-09-14T09:08:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992063959 2024-09-14T09:08:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789306+0000", 2024-09-14T09:08:41.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5289000000000004e-05 2024-09-14T09:08:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789396+0000", 2024-09-14T09:08:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9939999999999996e-05 2024-09-14T09:08:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:269 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2457600~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.010293354, 2024-09-14T09:08:41.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99242174400000005, 2024-09-14T09:08:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 269 2024-09-14T09:08:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:08:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797146+0000", 2024-09-14T09:08:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5289999999999998e-06 2024-09-14T09:08:41.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797153+0000", 2024-09-14T09:08:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1920000000000002e-06 2024-09-14T09:08:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797158+0000", 2024-09-14T09:08:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099999999999998e-06 2024-09-14T09:08:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797188+0000", 2024-09-14T09:08:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0128e-05 2024-09-14T09:08:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797194+0000", 2024-09-14T09:08:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6250000000000004e-06 2024-09-14T09:08:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789439+0000", 2024-09-14T09:08:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99224531000000005 2024-09-14T09:08:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789489+0000", 2024-09-14T09:08:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9830000000000002e-05 2024-09-14T09:08:41.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789565+0000", 2024-09-14T09:08:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6229000000000005e-05 2024-09-14T09:08:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:270 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.010269532000001, 2024-09-14T09:08:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99257721899999996, 2024-09-14T09:08:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:41.888 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 270 2024-09-14T09:08:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:41.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797168+0000", 2024-09-14T09:08:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2024-09-14T09:08:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797170+0000", 2024-09-14T09:08:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3120000000000001e-06 2024-09-14T09:08:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:41.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797177+0000", 2024-09-14T09:08:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0960000000000003e-06 2024-09-14T09:08:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797183+0000", 2024-09-14T09:08:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1669999999999998e-06 2024-09-14T09:08:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797213+0000", 2024-09-14T09:08:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0494e-05 2024-09-14T09:08:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:08:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:08:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789586+0000", 2024-09-14T09:08:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99236692100000001 2024-09-14T09:08:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789658+0000", 2024-09-14T09:08:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2279000000000004e-05 2024-09-14T09:08:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789745+0000", 2024-09-14T09:08:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6698000000000002e-05 2024-09-14T09:08:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:271 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3375104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.010244333999999, 2024-09-14T09:08:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99274791699999998, 2024-09-14T09:08:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:41.893 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 271 2024-09-14T09:08:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:41.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:08:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797195+0000", 2024-09-14T09:08:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1639999999999999e-06 2024-09-14T09:08:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:41.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797201+0000", 2024-09-14T09:08:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1290000000000001e-06 2024-09-14T09:08:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797206+0000", 2024-09-14T09:08:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9300000000000002e-06 2024-09-14T09:08:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797237+0000", 2024-09-14T09:08:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1285000000000003e-05 2024-09-14T09:08:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:41.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797242+0000", 2024-09-14T09:08:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6e-06 2024-09-14T09:08:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789768+0000", 2024-09-14T09:08:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99252547400000002 2024-09-14T09:08:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789826+0000", 2024-09-14T09:08:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8155999999999997e-05 2024-09-14T09:08:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789940+0000", 2024-09-14T09:08:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114788 2024-09-14T09:08:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:272 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.01022094, 2024-09-14T09:08:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99285248800000003, 2024-09-14T09:08:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:41.898 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 272 2024-09-14T09:08:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:41.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:08:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:08:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5129999999999999e-06 2024-09-14T09:08:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797226+0000", 2024-09-14T09:08:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4529999999999996e-06 2024-09-14T09:08:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797232+0000", 2024-09-14T09:08:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1839999999999998e-06 2024-09-14T09:08:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797264+0000", 2024-09-14T09:08:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2691999999999998e-05 2024-09-14T09:08:41.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797270+0000", 2024-09-14T09:08:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-06 2024-09-14T09:08:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789965+0000", 2024-09-14T09:08:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99269526200000002 2024-09-14T09:08:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790021+0000", 2024-09-14T09:08:41.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5297000000000003e-05 2024-09-14T09:08:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790068+0000", 2024-09-14T09:08:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7664999999999998e-05 2024-09-14T09:08:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:11604 3.1b 3:ddebdc6b:::rbd_data.111219b19df.0000000000000013:head [stat,write 397312~512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:41.903 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:38.051301+0000", 2024-09-14T09:08:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.756136379, 2024-09-14T09:08:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0086490479999999995, 2024-09-14T09:08:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 11604 2024-09-14T09:08:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:38.051301+0000", 2024-09-14T09:08:41.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:38.051301+0000", 2024-09-14T09:08:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:38.051301+0000", 2024-09-14T09:08:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3099999999999998e-07 2024-09-14T09:08:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:41.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:38.051304+0000", 2024-09-14T09:08:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9349999999999999e-06 2024-09-14T09:08:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:38.051311+0000", 2024-09-14T09:08:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3150000000000003e-06 2024-09-14T09:08:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:38.051317+0000", 2024-09-14T09:08:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6710000000000004e-06 2024-09-14T09:08:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:38.051359+0000", 2024-09-14T09:08:41.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1646000000000001e-05 2024-09-14T09:08:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:38.051427+0000", 2024-09-14T09:08:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8775000000000005e-05 2024-09-14T09:08:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-09-14T09:08:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:38.051561+0000", 2024-09-14T09:08:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013366300000000001 2024-09-14T09:08:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:41.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:38.058226+0000", 2024-09-14T09:08:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0066649889999999996 2024-09-14T09:08:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:38.059893+0000", 2024-09-14T09:08:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016669230000000001 2024-09-14T09:08:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:38.059924+0000", 2024-09-14T09:08:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0821999999999997e-05 2024-09-14T09:08:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:41.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:38.059950+0000", 2024-09-14T09:08:41.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5778e-05 2024-09-14T09:08:41.909 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.909 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:41.909 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.909 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:41.909 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:41.909 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:41.910 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:08:41.911 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:41.912+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:42.010 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:42.013+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:42.057 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:42.057 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:42.066 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:08:42.150 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:42.152+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:42.210 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:42.211 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:42.212 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:42.214+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:42.219 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:08:42.312 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:42.314+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:42.362 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5285 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 4370432~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.247472+0000", 2024-09-14T09:08:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.1165357240000002, 2024-09-14T09:08:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038449069000000002, 2024-09-14T09:08:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5285 2024-09-14T09:08:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247472+0000", 2024-09-14T09:08:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247472+0000", 2024-09-14T09:08:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247472+0000", 2024-09-14T09:08:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6899999999999998e-07 2024-09-14T09:08:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247474+0000", 2024-09-14T09:08:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9290000000000001e-06 2024-09-14T09:08:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247481+0000", 2024-09-14T09:08:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7499999999999997e-06 2024-09-14T09:08:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247486+0000", 2024-09-14T09:08:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5709999999999999e-06 2024-09-14T09:08:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.285757+0000", 2024-09-14T09:08:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038271289999999999 2024-09-14T09:08:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.285836+0000", 2024-09-14T09:08:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8753999999999998e-05 2024-09-14T09:08:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.285921+0000", 2024-09-14T09:08:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5406000000000002e-05 2024-09-14T09:08:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5286 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 4431872~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.247491+0000", 2024-09-14T09:08:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.1165163749999998, 2024-09-14T09:08:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038550628000000003, 2024-09-14T09:08:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5286 2024-09-14T09:08:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247491+0000", 2024-09-14T09:08:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247491+0000", 2024-09-14T09:08:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247492+0000", 2024-09-14T09:08:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.37e-07 2024-09-14T09:08:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247494+0000", 2024-09-14T09:08:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7239999999999999e-06 2024-09-14T09:08:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247499+0000", 2024-09-14T09:08:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5620000000000003e-06 2024-09-14T09:08:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247504+0000", 2024-09-14T09:08:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4769999999999997e-06 2024-09-14T09:08:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.285949+0000", 2024-09-14T09:08:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038445314000000001 2024-09-14T09:08:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.285993+0000", 2024-09-14T09:08:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4397999999999997e-05 2024-09-14T09:08:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.286042+0000", 2024-09-14T09:08:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8615999999999997e-05 2024-09-14T09:08:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5287 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 4493312~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.247509+0000", 2024-09-14T09:08:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.1164986470000002, 2024-09-14T09:08:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038729007000000003, 2024-09-14T09:08:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5287 2024-09-14T09:08:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247509+0000", 2024-09-14T09:08:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247509+0000", 2024-09-14T09:08:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.248863+0000", 2024-09-14T09:08:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001354325 2024-09-14T09:08:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.248867+0000", 2024-09-14T09:08:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4350000000000001e-06 2024-09-14T09:08:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.248876+0000", 2024-09-14T09:08:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8179999999999993e-06 2024-09-14T09:08:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.248882+0000", 2024-09-14T09:08:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0580000000000003e-06 2024-09-14T09:08:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.286074+0000", 2024-09-14T09:08:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.037192058 2024-09-14T09:08:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.286153+0000", 2024-09-14T09:08:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9456999999999995e-05 2024-09-14T09:08:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.286238+0000", 2024-09-14T09:08:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4856000000000002e-05 2024-09-14T09:08:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5296 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5046272~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249051+0000", 2024-09-14T09:08:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.1149565389999996, 2024-09-14T09:08:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038542414999999997, 2024-09-14T09:08:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5296 2024-09-14T09:08:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249051+0000", 2024-09-14T09:08:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249051+0000", 2024-09-14T09:08:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249052+0000", 2024-09-14T09:08:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2800000000000002e-07 2024-09-14T09:08:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249054+0000", 2024-09-14T09:08:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.996e-06 2024-09-14T09:08:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249059+0000", 2024-09-14T09:08:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9529999999999996e-06 2024-09-14T09:08:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249064+0000", 2024-09-14T09:08:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7509999999999999e-06 2024-09-14T09:08:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287505+0000", 2024-09-14T09:08:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038440400999999999 2024-09-14T09:08:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287547+0000", 2024-09-14T09:08:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2287999999999999e-05 2024-09-14T09:08:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287594+0000", 2024-09-14T09:08:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6597999999999997e-05 2024-09-14T09:08:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5297 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5107712~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249083+0000", 2024-09-14T09:08:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.1149251429999998, 2024-09-14T09:08:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038705564999999997, 2024-09-14T09:08:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5297 2024-09-14T09:08:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249083+0000", 2024-09-14T09:08:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249083+0000", 2024-09-14T09:08:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249083+0000", 2024-09-14T09:08:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0399999999999996e-07 2024-09-14T09:08:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249085+0000", 2024-09-14T09:08:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1849999999999998e-06 2024-09-14T09:08:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249092+0000", 2024-09-14T09:08:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4500000000000001e-06 2024-09-14T09:08:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249097+0000", 2024-09-14T09:08:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0710000000000002e-06 2024-09-14T09:08:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287625+0000", 2024-09-14T09:08:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038527990999999998 2024-09-14T09:08:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287700+0000", 2024-09-14T09:08:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5149999999999997e-05 2024-09-14T09:08:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287788+0000", 2024-09-14T09:08:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8114000000000004e-05 2024-09-14T09:08:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5298 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5169152~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249104+0000", 2024-09-14T09:08:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.1149040289999999, 2024-09-14T09:08:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038798922999999999, 2024-09-14T09:08:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5298 2024-09-14T09:08:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249104+0000", 2024-09-14T09:08:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249104+0000", 2024-09-14T09:08:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249104+0000", 2024-09-14T09:08:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.89e-07 2024-09-14T09:08:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249106+0000", 2024-09-14T09:08:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9980000000000002e-06 2024-09-14T09:08:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249112+0000", 2024-09-14T09:08:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6779999999999997e-06 2024-09-14T09:08:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249117+0000", 2024-09-14T09:08:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8049999999999997e-06 2024-09-14T09:08:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287812+0000", 2024-09-14T09:08:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038695845 2024-09-14T09:08:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287856+0000", 2024-09-14T09:08:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3445000000000002e-05 2024-09-14T09:08:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287903+0000", 2024-09-14T09:08:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6662999999999997e-05 2024-09-14T09:08:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5299 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5230592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:08:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.1148852119999999, 2024-09-14T09:08:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038972887999999997, 2024-09-14T09:08:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5299 2024-09-14T09:08:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:08:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:08:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249123+0000", 2024-09-14T09:08:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1199999999999998e-07 2024-09-14T09:08:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249125+0000", 2024-09-14T09:08:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.855e-06 2024-09-14T09:08:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249131+0000", 2024-09-14T09:08:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2949999999999999e-06 2024-09-14T09:08:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249136+0000", 2024-09-14T09:08:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9779999999999996e-06 2024-09-14T09:08:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287933+0000", 2024-09-14T09:08:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038796663000000002 2024-09-14T09:08:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288012+0000", 2024-09-14T09:08:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9617999999999996e-05 2024-09-14T09:08:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288095+0000", 2024-09-14T09:08:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3066999999999996e-05 2024-09-14T09:08:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5300 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5292032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:08:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.1148658229999997, 2024-09-14T09:08:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039068578, 2024-09-14T09:08:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5300 2024-09-14T09:08:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:08:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:08:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254832+0000", 2024-09-14T09:08:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056899180000000004 2024-09-14T09:08:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254836+0000", 2024-09-14T09:08:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7809999999999999e-06 2024-09-14T09:08:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254845+0000", 2024-09-14T09:08:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.516e-06 2024-09-14T09:08:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254851+0000", 2024-09-14T09:08:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9109999999999998e-06 2024-09-14T09:08:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288122+0000", 2024-09-14T09:08:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.033270776000000002 2024-09-14T09:08:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288163+0000", 2024-09-14T09:08:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1700999999999999e-05 2024-09-14T09:08:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288210+0000", 2024-09-14T09:08:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6974999999999997e-05 2024-09-14T09:08:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5339 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7688192~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255650+0000", 2024-09-14T09:08:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.108357313, 2024-09-14T09:08:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038551183000000003, 2024-09-14T09:08:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5339 2024-09-14T09:08:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255650+0000", 2024-09-14T09:08:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255650+0000", 2024-09-14T09:08:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255651+0000", 2024-09-14T09:08:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8400000000000004e-07 2024-09-14T09:08:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255653+0000", 2024-09-14T09:08:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.12e-06 2024-09-14T09:08:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255660+0000", 2024-09-14T09:08:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8260000000000004e-06 2024-09-14T09:08:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255665+0000", 2024-09-14T09:08:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8860000000000003e-06 2024-09-14T09:08:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294041+0000", 2024-09-14T09:08:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038375805999999998 2024-09-14T09:08:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294119+0000", 2024-09-14T09:08:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8633000000000004e-05 2024-09-14T09:08:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294202+0000", 2024-09-14T09:08:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2328000000000002e-05 2024-09-14T09:08:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5340 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7749632~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255671+0000", 2024-09-14T09:08:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.1083364790000001, 2024-09-14T09:08:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038644492000000003, 2024-09-14T09:08:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5340 2024-09-14T09:08:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255671+0000", 2024-09-14T09:08:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255671+0000", 2024-09-14T09:08:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255672+0000", 2024-09-14T09:08:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:08:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255674+0000", 2024-09-14T09:08:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9580000000000001e-06 2024-09-14T09:08:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255685+0000", 2024-09-14T09:08:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1302e-05 2024-09-14T09:08:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255691+0000", 2024-09-14T09:08:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.319e-06 2024-09-14T09:08:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294228+0000", 2024-09-14T09:08:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038537188999999999 2024-09-14T09:08:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294269+0000", 2024-09-14T09:08:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0241000000000003e-05 2024-09-14T09:08:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294316+0000", 2024-09-14T09:08:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6984000000000003e-05 2024-09-14T09:08:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5341 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7811072~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255698+0000", 2024-09-14T09:08:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.1083096619999999, 2024-09-14T09:08:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038826833999999998, 2024-09-14T09:08:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5341 2024-09-14T09:08:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255698+0000", 2024-09-14T09:08:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255698+0000", 2024-09-14T09:08:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255698+0000", 2024-09-14T09:08:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.03e-07 2024-09-14T09:08:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255701+0000", 2024-09-14T09:08:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2259999999999999e-06 2024-09-14T09:08:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255707+0000", 2024-09-14T09:08:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0220000000000001e-06 2024-09-14T09:08:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255712+0000", 2024-09-14T09:08:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3680000000000001e-06 2024-09-14T09:08:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294347+0000", 2024-09-14T09:08:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038634746999999997 2024-09-14T09:08:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294434+0000", 2024-09-14T09:08:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7094000000000003e-05 2024-09-14T09:08:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294525+0000", 2024-09-14T09:08:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0974e-05 2024-09-14T09:08:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5342 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7872512~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:08:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.1082896379999996, 2024-09-14T09:08:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038906217999999999, 2024-09-14T09:08:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5342 2024-09-14T09:08:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:08:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:08:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:08:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8700000000000001e-07 2024-09-14T09:08:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255720+0000", 2024-09-14T09:08:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.739e-06 2024-09-14T09:08:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255726+0000", 2024-09-14T09:08:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.981e-06 2024-09-14T09:08:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255737+0000", 2024-09-14T09:08:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0621e-05 2024-09-14T09:08:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294538+0000", 2024-09-14T09:08:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038801012000000003 2024-09-14T09:08:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294577+0000", 2024-09-14T09:08:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9042000000000003e-05 2024-09-14T09:08:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294624+0000", 2024-09-14T09:08:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7435999999999998e-05 2024-09-14T09:08:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5343 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7933952~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:08:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.108263762, 2024-09-14T09:08:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039081811000000001, 2024-09-14T09:08:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5343 2024-09-14T09:08:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:08:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:08:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:08:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1800000000000001e-07 2024-09-14T09:08:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255746+0000", 2024-09-14T09:08:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.103e-06 2024-09-14T09:08:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255753+0000", 2024-09-14T09:08:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0929999999999999e-06 2024-09-14T09:08:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255757+0000", 2024-09-14T09:08:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9579999999999998e-06 2024-09-14T09:08:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294656+0000", 2024-09-14T09:08:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038898508999999998 2024-09-14T09:08:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294738+0000", 2024-09-14T09:08:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2423999999999996e-05 2024-09-14T09:08:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294826+0000", 2024-09-14T09:08:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7305999999999994e-05 2024-09-14T09:08:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5344 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7995392~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:08:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.1082443299999998, 2024-09-14T09:08:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039165567999999998, 2024-09-14T09:08:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5344 2024-09-14T09:08:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:08:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:08:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255764+0000", 2024-09-14T09:08:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7899999999999999e-07 2024-09-14T09:08:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255765+0000", 2024-09-14T09:08:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.782e-06 2024-09-14T09:08:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255774+0000", 2024-09-14T09:08:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8070000000000006e-06 2024-09-14T09:08:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255779+0000", 2024-09-14T09:08:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9180000000000002e-06 2024-09-14T09:08:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294841+0000", 2024-09-14T09:08:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039061514999999998 2024-09-14T09:08:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294881+0000", 2024-09-14T09:08:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0027999999999997e-05 2024-09-14T09:08:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294929+0000", 2024-09-14T09:08:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8139000000000001e-05 2024-09-14T09:08:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5345 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8056832~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:08:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.1082220920000001, 2024-09-14T09:08:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039340027999999999, 2024-09-14T09:08:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5345 2024-09-14T09:08:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:08:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:08:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:08:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8099999999999998e-07 2024-09-14T09:08:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255788+0000", 2024-09-14T09:08:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1280000000000002e-06 2024-09-14T09:08:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255794+0000", 2024-09-14T09:08:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0020000000000003e-06 2024-09-14T09:08:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255800+0000", 2024-09-14T09:08:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2009999999999996e-06 2024-09-14T09:08:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294960+0000", 2024-09-14T09:08:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039159674999999998 2024-09-14T09:08:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295041+0000", 2024-09-14T09:08:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0648000000000004e-05 2024-09-14T09:08:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295126+0000", 2024-09-14T09:08:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4993000000000004e-05 2024-09-14T09:08:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5346 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8118272~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:08:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.1082010980000003, 2024-09-14T09:08:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039433228000000001, 2024-09-14T09:08:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5346 2024-09-14T09:08:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:08:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:08:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:08:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6899999999999998e-07 2024-09-14T09:08:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255809+0000", 2024-09-14T09:08:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9580000000000001e-06 2024-09-14T09:08:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255815+0000", 2024-09-14T09:08:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6579999999999999e-06 2024-09-14T09:08:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255819+0000", 2024-09-14T09:08:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5839999999999996e-06 2024-09-14T09:08:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295152+0000", 2024-09-14T09:08:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039332677000000003 2024-09-14T09:08:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295192+0000", 2024-09-14T09:08:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0491999999999998e-05 2024-09-14T09:08:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295240+0000", 2024-09-14T09:08:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7490000000000001e-05 2024-09-14T09:08:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5347 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8179712~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:08:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.1081735009999996, 2024-09-14T09:08:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039601193999999999, 2024-09-14T09:08:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5347 2024-09-14T09:08:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:08:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:08:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255835+0000", 2024-09-14T09:08:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.82e-07 2024-09-14T09:08:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255837+0000", 2024-09-14T09:08:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0959999999999999e-06 2024-09-14T09:08:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255843+0000", 2024-09-14T09:08:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3779999999999998e-06 2024-09-14T09:08:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255848+0000", 2024-09-14T09:08:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7609999999999998e-06 2024-09-14T09:08:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295271+0000", 2024-09-14T09:08:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039423079 2024-09-14T09:08:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295350+0000", 2024-09-14T09:08:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8623999999999998e-05 2024-09-14T09:08:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295435+0000", 2024-09-14T09:08:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5674000000000007e-05 2024-09-14T09:08:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5348 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8241152~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:08:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.1081532919999999, 2024-09-14T09:08:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039695057999999998, 2024-09-14T09:08:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5348 2024-09-14T09:08:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:08:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:08:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255855+0000", 2024-09-14T09:08:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7599999999999997e-07 2024-09-14T09:08:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255857+0000", 2024-09-14T09:08:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.905e-06 2024-09-14T09:08:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255863+0000", 2024-09-14T09:08:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0669999999999997e-06 2024-09-14T09:08:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255867+0000", 2024-09-14T09:08:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4730000000000002e-06 2024-09-14T09:08:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295461+0000", 2024-09-14T09:08:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039594074 2024-09-14T09:08:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295503+0000", 2024-09-14T09:08:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1363999999999999e-05 2024-09-14T09:08:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295549+0000", 2024-09-14T09:08:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6699000000000001e-05 2024-09-14T09:08:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5349 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8302592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:08:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.1081343319999997, 2024-09-14T09:08:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039875928999999997, 2024-09-14T09:08:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5349 2024-09-14T09:08:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:08:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:08:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255874+0000", 2024-09-14T09:08:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4900000000000001e-07 2024-09-14T09:08:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255880+0000", 2024-09-14T09:08:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9939999999999997e-06 2024-09-14T09:08:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255886+0000", 2024-09-14T09:08:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3899999999999998e-06 2024-09-14T09:08:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255891+0000", 2024-09-14T09:08:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.938e-06 2024-09-14T09:08:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295580+0000", 2024-09-14T09:08:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039688681000000003 2024-09-14T09:08:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295653+0000", 2024-09-14T09:08:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3045000000000003e-05 2024-09-14T09:08:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295749+0000", 2024-09-14T09:08:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6532000000000003e-05 2024-09-14T09:08:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5350 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8364032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:08:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.1081105249999998, 2024-09-14T09:08:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039989719, 2024-09-14T09:08:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5350 2024-09-14T09:08:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:08:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:08:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255898+0000", 2024-09-14T09:08:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2024-09-14T09:08:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255899+0000", 2024-09-14T09:08:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9139999999999998e-06 2024-09-14T09:08:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255905+0000", 2024-09-14T09:08:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7289999999999997e-06 2024-09-14T09:08:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255910+0000", 2024-09-14T09:08:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6210000000000003e-06 2024-09-14T09:08:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295775+0000", 2024-09-14T09:08:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039864973999999997 2024-09-14T09:08:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295828+0000", 2024-09-14T09:08:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3411000000000001e-05 2024-09-14T09:08:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295887+0000", 2024-09-14T09:08:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699000000000002e-05 2024-09-14T09:08:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.454 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:42.455 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:08:42.456 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:42.457+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:42.509 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:08:42.555 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:42.557+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:42.600 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:42.600 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:42.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.600 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:26573 3.1a 3.95a4e6fa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-14T09:08:42.600 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:41.781677+0000", 2024-09-14T09:08:42.600 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.82094463299999998, 2024-09-14T09:08:42.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.82096500800000005, 2024-09-14T09:08:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 26573 2024-09-14T09:08:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.781677+0000", 2024-09-14T09:08:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.781677+0000", 2024-09-14T09:08:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.781679+0000", 2024-09-14T09:08:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1880000000000001e-06 2024-09-14T09:08:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.781690+0000", 2024-09-14T09:08:42.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0332999999999999e-05 2024-09-14T09:08:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.781709+0000", 2024-09-14T09:08:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9633e-05 2024-09-14T09:08:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.781720+0000", 2024-09-14T09:08:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0339999999999999e-05 2024-09-14T09:08:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.781798+0000", 2024-09-14T09:08:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8726000000000005e-05 2024-09-14T09:08:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:08:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.781803+0000", 2024-09-14T09:08:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.181e-06 2024-09-14T09:08:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.788958+0000", 2024-09-14T09:08:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0071543650000000002 2024-09-14T09:08:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:42.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.788965+0000", 2024-09-14T09:08:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.737e-06 2024-09-14T09:08:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4370.0:13861 3.1a 3.95a4e6fa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-14T09:08:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:41.789407+0000", 2024-09-14T09:08:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.81321504899999997, 2024-09-14T09:08:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.81328513800000002, 2024-09-14T09:08:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:42.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4370", 2024-09-14T09:08:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:08:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 13861 2024-09-14T09:08:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.789407+0000", 2024-09-14T09:08:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.789407+0000", 2024-09-14T09:08:42.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.789408+0000", 2024-09-14T09:08:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.384e-06 2024-09-14T09:08:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.789414+0000", 2024-09-14T09:08:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7019999999999998e-06 2024-09-14T09:08:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.789424+0000", 2024-09-14T09:08:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0103e-05 2024-09-14T09:08:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.789433+0000", 2024-09-14T09:08:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2429999999999994e-06 2024-09-14T09:08:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.790346+0000", 2024-09-14T09:08:42.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00091255800000000005 2024-09-14T09:08:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.790397+0000", 2024-09-14T09:08:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0951000000000001e-05 2024-09-14T09:08:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:26566 3.10 3.83727ff0 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e63)", 2024-09-14T09:08:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:40.980757+0000", 2024-09-14T09:08:42.609 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.6218645139999999, 2024-09-14T09:08:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6219648979999999, 2024-09-14T09:08:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 26566 2024-09-14T09:08:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.980757+0000", 2024-09-14T09:08:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.980757+0000", 2024-09-14T09:08:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.980758+0000", 2024-09-14T09:08:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4900000000000005e-07 2024-09-14T09:08:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.980762+0000", 2024-09-14T09:08:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0450000000000002e-06 2024-09-14T09:08:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.980772+0000", 2024-09-14T09:08:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0195e-05 2024-09-14T09:08:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.980777+0000", 2024-09-14T09:08:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8570000000000003e-06 2024-09-14T09:08:42.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.980821+0000", 2024-09-14T09:08:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3356000000000003e-05 2024-09-14T09:08:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:08:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.980825+0000", 2024-09-14T09:08:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3599999999999998e-06 2024-09-14T09:08:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.988768+0000", 2024-09-14T09:08:42.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079430539999999997 2024-09-14T09:08:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.988779+0000", 2024-09-14T09:08:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0803e-05 2024-09-14T09:08:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.788455+0000", 2024-09-14T09:08:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.79967670300000004 2024-09-14T09:08:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.788466+0000", 2024-09-14T09:08:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.08e-05 2024-09-14T09:08:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:26571 3.1a 3.95a4e6fa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-14T09:08:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:40.980789+0000", 2024-09-14T09:08:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.6218322490000001, 2024-09-14T09:08:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6219775840000001, 2024-09-14T09:08:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.615 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 26571 2024-09-14T09:08:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.980789+0000", 2024-09-14T09:08:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.980789+0000", 2024-09-14T09:08:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.980790+0000", 2024-09-14T09:08:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0400000000000002e-07 2024-09-14T09:08:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.980791+0000", 2024-09-14T09:08:42.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.466e-06 2024-09-14T09:08:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.980797+0000", 2024-09-14T09:08:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.818e-06 2024-09-14T09:08:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.980800+0000", 2024-09-14T09:08:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9739999999999998e-06 2024-09-14T09:08:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.980834+0000", 2024-09-14T09:08:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3856000000000002e-05 2024-09-14T09:08:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:08:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.980838+0000", 2024-09-14T09:08:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7699999999999999e-06 2024-09-14T09:08:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.987930+0000", 2024-09-14T09:08:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070922850000000003 2024-09-14T09:08:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.987940+0000", 2024-09-14T09:08:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.91e-06 2024-09-14T09:08:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.788896+0000", 2024-09-14T09:08:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.80095664099999997 2024-09-14T09:08:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.788905+0000", 2024-09-14T09:08:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6580000000000008e-06 2024-09-14T09:08:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.620 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4370.0:13860 3.1a 3.95a4e6fa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-14T09:08:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:40.981614+0000", 2024-09-14T09:08:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.621007329, 2024-09-14T09:08:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.621189542, 2024-09-14T09:08:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4370", 2024-09-14T09:08:42.621 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:08:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 13860 2024-09-14T09:08:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.981614+0000", 2024-09-14T09:08:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.981614+0000", 2024-09-14T09:08:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.981615+0000", 2024-09-14T09:08:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9599999999999998e-07 2024-09-14T09:08:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.981619+0000", 2024-09-14T09:08:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6619999999999998e-06 2024-09-14T09:08:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.981630+0000", 2024-09-14T09:08:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1e-05 2024-09-14T09:08:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.981635+0000", 2024-09-14T09:08:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3909999999999997e-06 2024-09-14T09:08:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.981666+0000", 2024-09-14T09:08:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1127999999999997e-05 2024-09-14T09:08:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:08:42.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.981669+0000", 2024-09-14T09:08:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7190000000000001e-06 2024-09-14T09:08:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.987968+0000", 2024-09-14T09:08:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062987909999999998 2024-09-14T09:08:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:40.987975+0000", 2024-09-14T09:08:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.464e-06 2024-09-14T09:08:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.789145+0000", 2024-09-14T09:08:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.80116928399999998 2024-09-14T09:08:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.789157+0000", 2024-09-14T09:08:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1792e-05 2024-09-14T09:08:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.626 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:26572 3.1a 3.95a4e6fa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-14T09:08:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:41.277335+0000", 2024-09-14T09:08:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.3252862830000001, 2024-09-14T09:08:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.325505017, 2024-09-14T09:08:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 26572 2024-09-14T09:08:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.277335+0000", 2024-09-14T09:08:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.277335+0000", 2024-09-14T09:08:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.277336+0000", 2024-09-14T09:08:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4199999999999996e-07 2024-09-14T09:08:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.277340+0000", 2024-09-14T09:08:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1690000000000002e-06 2024-09-14T09:08:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.277346+0000", 2024-09-14T09:08:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.558e-06 2024-09-14T09:08:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.277352+0000", 2024-09-14T09:08:42.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.054e-06 2024-09-14T09:08:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.277409+0000", 2024-09-14T09:08:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7116e-05 2024-09-14T09:08:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.277416+0000", 2024-09-14T09:08:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5700000000000004e-06 2024-09-14T09:08:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.788929+0000", 2024-09-14T09:08:42.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.51151298700000003 2024-09-14T09:08:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:41.788936+0000", 2024-09-14T09:08:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8560000000000001e-06 2024-09-14T09:08:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-14T09:08:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 6 2024-09-14T09:08:42.631 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:42.632 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:42.632 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:42.633 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:08:42.644 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:42.645 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:42.660 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:08:42.660 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:08:42.677 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:42.677 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:42.677 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:42.679+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:42.693 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:42.693 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:42.710 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:42.710 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:42.737 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:42.738 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:42.746 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:08:42.761 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:42.763+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:42.831 INFO:teuthology.orchestra.run.smithi148.stdout:3969 read 0xdb200 thru 0xe614e (0xaf4f bytes) 2024-09-14T09:08:42.834 INFO:teuthology.orchestra.run.smithi148.stdout:3970 read 0x17cd400 thru 0x17d6223 (0x8e24 bytes) 2024-09-14T09:08:42.835 INFO:teuthology.orchestra.run.smithi148.stdout:3971 read 0x326600 thru 0x3276a5 (0x10a6 bytes) 2024-09-14T09:08:42.857 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:42.859+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:42.864 INFO:teuthology.orchestra.run.smithi148.stdout:3972 write 0x7b57600 thru 0x7b638c0 (0xc2c1 bytes) 2024-09-14T09:08:42.910 INFO:teuthology.orchestra.run.smithi148.stdout:3976 write 0xa248800 thru 0xa2488dc (0xdd bytes) 2024-09-14T09:08:42.911 INFO:teuthology.orchestra.run.smithi148.stdout:3978 punch from 0x240a800 to 0x2413600, (0x8e00 bytes) 2024-09-14T09:08:42.913 INFO:teuthology.orchestra.run.smithi148.stdout:3980 read 0x2d91e00 thru 0x2d9fb10 (0xdd11 bytes) 2024-09-14T09:08:42.913 INFO:teuthology.orchestra.run.smithi148.stdout:3982 punch from 0x8e47200 to 0x8e55800, (0xe600 bytes) 2024-09-14T09:08:42.945 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:42.945 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:42.958 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:42.961+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:42.960 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:08:42.961 INFO:teuthology.orchestra.run.smithi148.stdout:3985 write 0xb568e00 thru 0xb569c32 (0xe33 bytes) 2024-09-14T09:08:42.963 INFO:teuthology.orchestra.run.smithi148.stdout:3986 read 0x9634800 thru 0x96377fa (0x2ffb bytes) 2024-09-14T09:08:42.963 INFO:teuthology.orchestra.run.smithi148.stdout:3989 write 0xa693800 thru 0xa6a016d (0xc96e bytes) 2024-09-14T09:08:42.963 INFO:teuthology.orchestra.run.smithi148.stdout:3991 write 0xa3cde00 thru 0xa3d3d89 (0x5f8a bytes) 2024-09-14T09:08:42.964 INFO:teuthology.orchestra.run.smithi148.stdout:3994 read 0x266d800 thru 0x267081f (0x3020 bytes) 2024-09-14T09:08:42.964 INFO:teuthology.orchestra.run.smithi148.stdout:3996 read 0xe1ce00 thru 0xe21e25 (0x5026 bytes) 2024-09-14T09:08:42.964 INFO:teuthology.orchestra.run.smithi148.stdout:3999 write 0x12a7a00 thru 0x12af357 (0x7958 bytes) 2024-09-14T09:08:42.965 INFO:teuthology.orchestra.run.smithi148.stdout:4001 trunc from 0xb569e00 to 0xc3e8800 2024-09-14T09:08:43.028 INFO:teuthology.orchestra.run.smithi148.stdout:4002 read 0x76aba00 thru 0x76af038 (0x3639 bytes) 2024-09-14T09:08:43.030 INFO:teuthology.orchestra.run.smithi148.stdout:4003 read 0x370d200 thru 0x370f8f3 (0x26f4 bytes) 2024-09-14T09:08:43.030 INFO:teuthology.orchestra.run.smithi148.stdout:4004 punch from 0x3206800 to 0x3215000, (0xe800 bytes) 2024-09-14T09:08:43.031 INFO:teuthology.orchestra.run.smithi148.stdout:4005 write 0x4e57000 thru 0x4e6404f (0xd050 bytes) 2024-09-14T09:08:43.031 INFO:teuthology.orchestra.run.smithi148.stdout:4006 punch from 0x4159a00 to 0x4165c00, (0xc200 bytes) 2024-09-14T09:08:43.032 INFO:teuthology.orchestra.run.smithi148.stdout:4007 read 0x9c79400 thru 0x9c80e08 (0x7a09 bytes) 2024-09-14T09:08:43.032 INFO:teuthology.orchestra.run.smithi148.stdout:4010 punch from 0xb01d400 to 0xb025800, (0x8400 bytes) 2024-09-14T09:08:43.033 INFO:teuthology.orchestra.run.smithi148.stdout:4011 write 0xa560200 thru 0xa567a04 (0x7805 bytes) 2024-09-14T09:08:43.033 INFO:teuthology.orchestra.run.smithi148.stdout:4012 read 0xa59c000 thru 0xa5a8b2a (0xcb2b bytes) 2024-09-14T09:08:43.034 INFO:teuthology.orchestra.run.smithi148.stdout:4013 read 0xb13ca00 thru 0xb13e621 (0x1c22 bytes) 2024-09-14T09:08:43.059 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:43.061+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:43.106 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:43.106 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:43.119 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:08:43.133 INFO:teuthology.orchestra.run.smithi148.stdout:4015 write 0xd8c6a00 thru 0xd8d1295 (0xa896 bytes) 2024-09-14T09:08:43.135 INFO:teuthology.orchestra.run.smithi148.stdout:4019 write 0x236da00 thru 0x2374e33 (0x7434 bytes) 2024-09-14T09:08:43.136 INFO:teuthology.orchestra.run.smithi148.stdout:4020 write 0xb7e5200 thru 0xb7e904b (0x3e4c bytes) 2024-09-14T09:08:43.136 INFO:teuthology.orchestra.run.smithi148.stdout:4026 write 0x9ef4e00 thru 0x9efe83b (0x9a3c bytes) 2024-09-14T09:08:43.137 INFO:teuthology.orchestra.run.smithi148.stdout:4027 read 0x9192e00 thru 0x919f4eb (0xc6ec bytes) 2024-09-14T09:08:43.137 INFO:teuthology.orchestra.run.smithi148.stdout:4028 read 0x2b29200 thru 0x2b2c4a0 (0x32a1 bytes) 2024-09-14T09:08:43.137 INFO:teuthology.orchestra.run.smithi148.stdout:4029 write 0x905d000 thru 0x9069c5d (0xcc5e bytes) 2024-09-14T09:08:43.137 INFO:teuthology.orchestra.run.smithi148.stdout:4031 read 0x2637e00 thru 0x2642b87 (0xad88 bytes) 2024-09-14T09:08:43.137 INFO:teuthology.orchestra.run.smithi148.stdout:4034 read 0xb7b8000 thru 0xb7b938e (0x138f bytes) 2024-09-14T09:08:43.137 INFO:teuthology.orchestra.run.smithi148.stdout:4035 clone 23 order 20 su 16384 sc 12 2024-09-14T09:08:43.162 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:43.164+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:43.250 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:43.251 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:43.260 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:08:43.261 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:43.263+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:43.362 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:43.364+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:43.411 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:43.411 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:43.420 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:08:43.465 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:43.467+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:43.524 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:43.524 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:43.533 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:08:43.564 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:43.566+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:43.665 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:43.667+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:43.674 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:43.674 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:43.683 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:08:43.766 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:43.768+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:43.792 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:43.792 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:43.798 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T09:08:43.801 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:08:43.867 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:43.869+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:43.947 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:43.947 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:43.956 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:08:43.999 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:44.001+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:44.061 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:44.061 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:44.069 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:08:44.070 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:44.071+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:44.170 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:44.172+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:44.211 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:44.212 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:44.220 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:08:44.271 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:44.273+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:44.327 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:44.327 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:44.335 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:08:44.372 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:44.374+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:44.438 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:44.439 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:44.447 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:08:44.491 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:44.493+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:44.550 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:44.550 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:44.559 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:08:44.600 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:44.602+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:44.676 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:44.677+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:44.701 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:44.701 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:44.710 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:08:44.721 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:08:44.776 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:44.778+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:44.781 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is set 2024-09-14T09:08:44.821 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:44.821 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:44.830 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:08:44.846 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:44.846 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:44.862 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:44.863 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:44.878 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:08:44.879 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:08:44.896 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:44.897 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:44.905 INFO:teuthology.orchestra.run.smithi148.stdout:leaving image image_client.0-clone22 intact 2024-09-14T09:08:44.913 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:44.913 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:44.915 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:44.917+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:44.929 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:44.929 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:44.975 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:44.975 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:44.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:44.975 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:44.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5285 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 4370432~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.247472+0000", 2024-09-14T09:08:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7294084200000004, 2024-09-14T09:08:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038449069000000002, 2024-09-14T09:08:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5285 2024-09-14T09:08:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247472+0000", 2024-09-14T09:08:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247472+0000", 2024-09-14T09:08:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247472+0000", 2024-09-14T09:08:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6899999999999998e-07 2024-09-14T09:08:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247474+0000", 2024-09-14T09:08:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9290000000000001e-06 2024-09-14T09:08:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247481+0000", 2024-09-14T09:08:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7499999999999997e-06 2024-09-14T09:08:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247486+0000", 2024-09-14T09:08:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5709999999999999e-06 2024-09-14T09:08:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.285757+0000", 2024-09-14T09:08:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038271289999999999 2024-09-14T09:08:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.285836+0000", 2024-09-14T09:08:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8753999999999998e-05 2024-09-14T09:08:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.285921+0000", 2024-09-14T09:08:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5406000000000002e-05 2024-09-14T09:08:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5286 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 4431872~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.247491+0000", 2024-09-14T09:08:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7293890709999999, 2024-09-14T09:08:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038550628000000003, 2024-09-14T09:08:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5286 2024-09-14T09:08:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247491+0000", 2024-09-14T09:08:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247491+0000", 2024-09-14T09:08:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247492+0000", 2024-09-14T09:08:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.37e-07 2024-09-14T09:08:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247494+0000", 2024-09-14T09:08:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7239999999999999e-06 2024-09-14T09:08:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247499+0000", 2024-09-14T09:08:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5620000000000003e-06 2024-09-14T09:08:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247504+0000", 2024-09-14T09:08:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4769999999999997e-06 2024-09-14T09:08:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.285949+0000", 2024-09-14T09:08:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038445314000000001 2024-09-14T09:08:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.285993+0000", 2024-09-14T09:08:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4397999999999997e-05 2024-09-14T09:08:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.286042+0000", 2024-09-14T09:08:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8615999999999997e-05 2024-09-14T09:08:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5287 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 4493312~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.247509+0000", 2024-09-14T09:08:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7293713430000004, 2024-09-14T09:08:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038729007000000003, 2024-09-14T09:08:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5287 2024-09-14T09:08:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247509+0000", 2024-09-14T09:08:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247509+0000", 2024-09-14T09:08:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.248863+0000", 2024-09-14T09:08:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001354325 2024-09-14T09:08:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.248867+0000", 2024-09-14T09:08:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4350000000000001e-06 2024-09-14T09:08:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.248876+0000", 2024-09-14T09:08:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8179999999999993e-06 2024-09-14T09:08:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.248882+0000", 2024-09-14T09:08:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0580000000000003e-06 2024-09-14T09:08:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.286074+0000", 2024-09-14T09:08:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.037192058 2024-09-14T09:08:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.286153+0000", 2024-09-14T09:08:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9456999999999995e-05 2024-09-14T09:08:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.286238+0000", 2024-09-14T09:08:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4856000000000002e-05 2024-09-14T09:08:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5296 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5046272~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249051+0000", 2024-09-14T09:08:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7278292349999997, 2024-09-14T09:08:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038542414999999997, 2024-09-14T09:08:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5296 2024-09-14T09:08:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249051+0000", 2024-09-14T09:08:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249051+0000", 2024-09-14T09:08:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249052+0000", 2024-09-14T09:08:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2800000000000002e-07 2024-09-14T09:08:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249054+0000", 2024-09-14T09:08:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.996e-06 2024-09-14T09:08:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249059+0000", 2024-09-14T09:08:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9529999999999996e-06 2024-09-14T09:08:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249064+0000", 2024-09-14T09:08:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7509999999999999e-06 2024-09-14T09:08:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287505+0000", 2024-09-14T09:08:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038440400999999999 2024-09-14T09:08:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287547+0000", 2024-09-14T09:08:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2287999999999999e-05 2024-09-14T09:08:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287594+0000", 2024-09-14T09:08:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6597999999999997e-05 2024-09-14T09:08:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5297 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5107712~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249083+0000", 2024-09-14T09:08:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7277978389999999, 2024-09-14T09:08:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038705564999999997, 2024-09-14T09:08:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5297 2024-09-14T09:08:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249083+0000", 2024-09-14T09:08:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249083+0000", 2024-09-14T09:08:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249083+0000", 2024-09-14T09:08:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0399999999999996e-07 2024-09-14T09:08:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249085+0000", 2024-09-14T09:08:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1849999999999998e-06 2024-09-14T09:08:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249092+0000", 2024-09-14T09:08:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4500000000000001e-06 2024-09-14T09:08:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249097+0000", 2024-09-14T09:08:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0710000000000002e-06 2024-09-14T09:08:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287625+0000", 2024-09-14T09:08:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038527990999999998 2024-09-14T09:08:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287700+0000", 2024-09-14T09:08:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5149999999999997e-05 2024-09-14T09:08:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287788+0000", 2024-09-14T09:08:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8114000000000004e-05 2024-09-14T09:08:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5298 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5169152~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249104+0000", 2024-09-14T09:08:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.727776725, 2024-09-14T09:08:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038798922999999999, 2024-09-14T09:08:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5298 2024-09-14T09:08:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249104+0000", 2024-09-14T09:08:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249104+0000", 2024-09-14T09:08:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249104+0000", 2024-09-14T09:08:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.89e-07 2024-09-14T09:08:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249106+0000", 2024-09-14T09:08:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9980000000000002e-06 2024-09-14T09:08:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249112+0000", 2024-09-14T09:08:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6779999999999997e-06 2024-09-14T09:08:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249117+0000", 2024-09-14T09:08:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8049999999999997e-06 2024-09-14T09:08:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287812+0000", 2024-09-14T09:08:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038695845 2024-09-14T09:08:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287856+0000", 2024-09-14T09:08:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3445000000000002e-05 2024-09-14T09:08:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287903+0000", 2024-09-14T09:08:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6662999999999997e-05 2024-09-14T09:08:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5299 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5230592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:08:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7277579080000001, 2024-09-14T09:08:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038972887999999997, 2024-09-14T09:08:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5299 2024-09-14T09:08:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:08:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:08:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249123+0000", 2024-09-14T09:08:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1199999999999998e-07 2024-09-14T09:08:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249125+0000", 2024-09-14T09:08:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.855e-06 2024-09-14T09:08:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249131+0000", 2024-09-14T09:08:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2949999999999999e-06 2024-09-14T09:08:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249136+0000", 2024-09-14T09:08:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9779999999999996e-06 2024-09-14T09:08:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287933+0000", 2024-09-14T09:08:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038796663000000002 2024-09-14T09:08:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288012+0000", 2024-09-14T09:08:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9617999999999996e-05 2024-09-14T09:08:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288095+0000", 2024-09-14T09:08:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3066999999999996e-05 2024-09-14T09:08:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5300 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5292032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:08:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7277385189999999, 2024-09-14T09:08:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039068578, 2024-09-14T09:08:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5300 2024-09-14T09:08:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:08:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:08:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254832+0000", 2024-09-14T09:08:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056899180000000004 2024-09-14T09:08:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254836+0000", 2024-09-14T09:08:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7809999999999999e-06 2024-09-14T09:08:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254845+0000", 2024-09-14T09:08:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.516e-06 2024-09-14T09:08:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254851+0000", 2024-09-14T09:08:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9109999999999998e-06 2024-09-14T09:08:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288122+0000", 2024-09-14T09:08:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.033270776000000002 2024-09-14T09:08:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288163+0000", 2024-09-14T09:08:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1700999999999999e-05 2024-09-14T09:08:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288210+0000", 2024-09-14T09:08:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6974999999999997e-05 2024-09-14T09:08:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5339 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7688192~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255650+0000", 2024-09-14T09:08:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7212300090000001, 2024-09-14T09:08:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038551183000000003, 2024-09-14T09:08:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5339 2024-09-14T09:08:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255650+0000", 2024-09-14T09:08:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255650+0000", 2024-09-14T09:08:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255651+0000", 2024-09-14T09:08:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8400000000000004e-07 2024-09-14T09:08:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255653+0000", 2024-09-14T09:08:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.12e-06 2024-09-14T09:08:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255660+0000", 2024-09-14T09:08:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8260000000000004e-06 2024-09-14T09:08:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255665+0000", 2024-09-14T09:08:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8860000000000003e-06 2024-09-14T09:08:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294041+0000", 2024-09-14T09:08:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038375805999999998 2024-09-14T09:08:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294119+0000", 2024-09-14T09:08:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8633000000000004e-05 2024-09-14T09:08:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294202+0000", 2024-09-14T09:08:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2328000000000002e-05 2024-09-14T09:08:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5340 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7749632~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255671+0000", 2024-09-14T09:08:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7212091750000003, 2024-09-14T09:08:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038644492000000003, 2024-09-14T09:08:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5340 2024-09-14T09:08:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255671+0000", 2024-09-14T09:08:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255671+0000", 2024-09-14T09:08:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255672+0000", 2024-09-14T09:08:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:08:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255674+0000", 2024-09-14T09:08:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9580000000000001e-06 2024-09-14T09:08:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255685+0000", 2024-09-14T09:08:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1302e-05 2024-09-14T09:08:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255691+0000", 2024-09-14T09:08:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.319e-06 2024-09-14T09:08:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294228+0000", 2024-09-14T09:08:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038537188999999999 2024-09-14T09:08:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294269+0000", 2024-09-14T09:08:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0241000000000003e-05 2024-09-14T09:08:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294316+0000", 2024-09-14T09:08:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6984000000000003e-05 2024-09-14T09:08:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5341 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7811072~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255698+0000", 2024-09-14T09:08:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7211823580000001, 2024-09-14T09:08:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038826833999999998, 2024-09-14T09:08:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5341 2024-09-14T09:08:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255698+0000", 2024-09-14T09:08:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255698+0000", 2024-09-14T09:08:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255698+0000", 2024-09-14T09:08:45.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.03e-07 2024-09-14T09:08:45.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255701+0000", 2024-09-14T09:08:45.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2259999999999999e-06 2024-09-14T09:08:45.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255707+0000", 2024-09-14T09:08:45.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0220000000000001e-06 2024-09-14T09:08:45.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255712+0000", 2024-09-14T09:08:45.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3680000000000001e-06 2024-09-14T09:08:45.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294347+0000", 2024-09-14T09:08:45.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038634746999999997 2024-09-14T09:08:45.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294434+0000", 2024-09-14T09:08:45.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7094000000000003e-05 2024-09-14T09:08:45.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294525+0000", 2024-09-14T09:08:45.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0974e-05 2024-09-14T09:08:45.025 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.025 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.025 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.025 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5342 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7872512~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:45.025 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:08:45.025 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7211623339999997, 2024-09-14T09:08:45.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038906217999999999, 2024-09-14T09:08:45.025 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5342 2024-09-14T09:08:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:08:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:08:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:08:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8700000000000001e-07 2024-09-14T09:08:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255720+0000", 2024-09-14T09:08:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.739e-06 2024-09-14T09:08:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255726+0000", 2024-09-14T09:08:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.981e-06 2024-09-14T09:08:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255737+0000", 2024-09-14T09:08:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0621e-05 2024-09-14T09:08:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294538+0000", 2024-09-14T09:08:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038801012000000003 2024-09-14T09:08:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294577+0000", 2024-09-14T09:08:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9042000000000003e-05 2024-09-14T09:08:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294624+0000", 2024-09-14T09:08:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7435999999999998e-05 2024-09-14T09:08:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5343 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7933952~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:08:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7211364580000001, 2024-09-14T09:08:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039081811000000001, 2024-09-14T09:08:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5343 2024-09-14T09:08:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:08:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:08:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:08:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1800000000000001e-07 2024-09-14T09:08:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255746+0000", 2024-09-14T09:08:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.103e-06 2024-09-14T09:08:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255753+0000", 2024-09-14T09:08:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0929999999999999e-06 2024-09-14T09:08:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255757+0000", 2024-09-14T09:08:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9579999999999998e-06 2024-09-14T09:08:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294656+0000", 2024-09-14T09:08:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038898508999999998 2024-09-14T09:08:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294738+0000", 2024-09-14T09:08:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2423999999999996e-05 2024-09-14T09:08:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294826+0000", 2024-09-14T09:08:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7305999999999994e-05 2024-09-14T09:08:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5344 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7995392~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:08:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7211170259999999, 2024-09-14T09:08:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039165567999999998, 2024-09-14T09:08:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5344 2024-09-14T09:08:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:08:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:08:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255764+0000", 2024-09-14T09:08:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7899999999999999e-07 2024-09-14T09:08:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255765+0000", 2024-09-14T09:08:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.782e-06 2024-09-14T09:08:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255774+0000", 2024-09-14T09:08:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8070000000000006e-06 2024-09-14T09:08:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255779+0000", 2024-09-14T09:08:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9180000000000002e-06 2024-09-14T09:08:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294841+0000", 2024-09-14T09:08:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039061514999999998 2024-09-14T09:08:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294881+0000", 2024-09-14T09:08:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0027999999999997e-05 2024-09-14T09:08:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294929+0000", 2024-09-14T09:08:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8139000000000001e-05 2024-09-14T09:08:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5345 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8056832~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:08:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7210947880000003, 2024-09-14T09:08:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039340027999999999, 2024-09-14T09:08:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5345 2024-09-14T09:08:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:08:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:08:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:08:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8099999999999998e-07 2024-09-14T09:08:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255788+0000", 2024-09-14T09:08:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1280000000000002e-06 2024-09-14T09:08:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255794+0000", 2024-09-14T09:08:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0020000000000003e-06 2024-09-14T09:08:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255800+0000", 2024-09-14T09:08:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2009999999999996e-06 2024-09-14T09:08:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294960+0000", 2024-09-14T09:08:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039159674999999998 2024-09-14T09:08:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295041+0000", 2024-09-14T09:08:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0648000000000004e-05 2024-09-14T09:08:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295126+0000", 2024-09-14T09:08:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4993000000000004e-05 2024-09-14T09:08:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5346 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8118272~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:08:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7210737940000005, 2024-09-14T09:08:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039433228000000001, 2024-09-14T09:08:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5346 2024-09-14T09:08:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:08:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:08:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:08:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6899999999999998e-07 2024-09-14T09:08:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255809+0000", 2024-09-14T09:08:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9580000000000001e-06 2024-09-14T09:08:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255815+0000", 2024-09-14T09:08:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6579999999999999e-06 2024-09-14T09:08:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255819+0000", 2024-09-14T09:08:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5839999999999996e-06 2024-09-14T09:08:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295152+0000", 2024-09-14T09:08:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039332677000000003 2024-09-14T09:08:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295192+0000", 2024-09-14T09:08:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0491999999999998e-05 2024-09-14T09:08:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295240+0000", 2024-09-14T09:08:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7490000000000001e-05 2024-09-14T09:08:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5347 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8179712~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:08:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7210461969999997, 2024-09-14T09:08:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039601193999999999, 2024-09-14T09:08:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5347 2024-09-14T09:08:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:08:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:08:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255835+0000", 2024-09-14T09:08:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.82e-07 2024-09-14T09:08:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255837+0000", 2024-09-14T09:08:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0959999999999999e-06 2024-09-14T09:08:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255843+0000", 2024-09-14T09:08:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3779999999999998e-06 2024-09-14T09:08:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255848+0000", 2024-09-14T09:08:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7609999999999998e-06 2024-09-14T09:08:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295271+0000", 2024-09-14T09:08:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039423079 2024-09-14T09:08:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295350+0000", 2024-09-14T09:08:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8623999999999998e-05 2024-09-14T09:08:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295435+0000", 2024-09-14T09:08:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5674000000000007e-05 2024-09-14T09:08:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5348 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8241152~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:08:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7210259880000001, 2024-09-14T09:08:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039695057999999998, 2024-09-14T09:08:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5348 2024-09-14T09:08:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:08:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:08:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255855+0000", 2024-09-14T09:08:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7599999999999997e-07 2024-09-14T09:08:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255857+0000", 2024-09-14T09:08:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.905e-06 2024-09-14T09:08:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255863+0000", 2024-09-14T09:08:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0669999999999997e-06 2024-09-14T09:08:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255867+0000", 2024-09-14T09:08:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4730000000000002e-06 2024-09-14T09:08:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295461+0000", 2024-09-14T09:08:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039594074 2024-09-14T09:08:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295503+0000", 2024-09-14T09:08:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1363999999999999e-05 2024-09-14T09:08:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295549+0000", 2024-09-14T09:08:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6699000000000001e-05 2024-09-14T09:08:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5349 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8302592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:08:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7210070279999998, 2024-09-14T09:08:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039875928999999997, 2024-09-14T09:08:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5349 2024-09-14T09:08:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:08:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:08:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255874+0000", 2024-09-14T09:08:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4900000000000001e-07 2024-09-14T09:08:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255880+0000", 2024-09-14T09:08:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9939999999999997e-06 2024-09-14T09:08:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255886+0000", 2024-09-14T09:08:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3899999999999998e-06 2024-09-14T09:08:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255891+0000", 2024-09-14T09:08:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.938e-06 2024-09-14T09:08:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295580+0000", 2024-09-14T09:08:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039688681000000003 2024-09-14T09:08:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295653+0000", 2024-09-14T09:08:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3045000000000003e-05 2024-09-14T09:08:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295749+0000", 2024-09-14T09:08:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6532000000000003e-05 2024-09-14T09:08:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5350 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8364032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:08:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.720983221, 2024-09-14T09:08:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039989719, 2024-09-14T09:08:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5350 2024-09-14T09:08:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:08:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:08:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255898+0000", 2024-09-14T09:08:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2024-09-14T09:08:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255899+0000", 2024-09-14T09:08:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9139999999999998e-06 2024-09-14T09:08:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255905+0000", 2024-09-14T09:08:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7289999999999997e-06 2024-09-14T09:08:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255910+0000", 2024-09-14T09:08:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6210000000000003e-06 2024-09-14T09:08:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295775+0000", 2024-09-14T09:08:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039864973999999997 2024-09-14T09:08:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295828+0000", 2024-09-14T09:08:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3411000000000001e-05 2024-09-14T09:08:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295887+0000", 2024-09-14T09:08:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699000000000002e-05 2024-09-14T09:08:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.066 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.066 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:45.067 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:08:45.068 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:45.069+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:45.167 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:45.170+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:45.213 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:45.213 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:45.213 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:45.213 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:45.222 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:08:45.268 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:45.270+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:45.369 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:45.371+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:45.371 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:45.371 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:45.372 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:45.372 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:45.372 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:45.380 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:08:45.385 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #21, image image_client.0-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent22 2024-09-14T09:08:45.470 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:45.471+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:45.492 INFO:teuthology.orchestra.run.smithi148.stdout:4036 write 0x7219e00 thru 0x721c4de (0x26df bytes) 2024-09-14T09:08:45.493 INFO:teuthology.orchestra.run.smithi148.stdout:4037 punch from 0xa0c9e00 to 0xa0d1000, (0x7200 bytes) 2024-09-14T09:08:45.535 INFO:teuthology.orchestra.run.smithi148.stdout:4039 write 0x3d5f000 thru 0x3d5fece (0xecf bytes) 2024-09-14T09:08:45.535 INFO:teuthology.orchestra.run.smithi148.stdout:4040 read 0x2a70e00 thru 0x2a7a0d5 (0x92d6 bytes) 2024-09-14T09:08:45.535 INFO:teuthology.orchestra.run.smithi148.stdout:4042 write 0x156400 thru 0x15937c (0x2f7d bytes) 2024-09-14T09:08:45.536 INFO:teuthology.orchestra.run.smithi148.stdout:4045 write 0x8e18a00 thru 0x8e2251f (0x9b20 bytes) 2024-09-14T09:08:45.537 INFO:teuthology.orchestra.run.smithi148.stdout:4046 write 0xd2ce800 thru 0xd2d7bdf (0x93e0 bytes) 2024-09-14T09:08:45.538 INFO:teuthology.orchestra.run.smithi148.stdout:4047 write 0xcd03e00 thru 0xcd0bacd (0x7cce bytes) 2024-09-14T09:08:45.538 INFO:teuthology.orchestra.run.smithi148.stdout:4049 punch from 0x9dee00 to 0x9e6e00, (0x8000 bytes) 2024-09-14T09:08:45.545 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:45.545 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:45.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:45.545 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:228 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 360448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:08:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.747286483, 2024-09-14T09:08:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99234476999999999, 2024-09-14T09:08:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 228 2024-09-14T09:08:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:08:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:08:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796906+0000", 2024-09-14T09:08:45.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9399999999999995e-07 2024-09-14T09:08:45.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796917+0000", 2024-09-14T09:08:45.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0801e-05 2024-09-14T09:08:45.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796924+0000", 2024-09-14T09:08:45.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7750000000000004e-06 2024-09-14T09:08:45.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:08:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9972000000000001e-05 2024-09-14T09:08:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798671+0000", 2024-09-14T09:08:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017271330000000001 2024-09-14T09:08:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798675+0000", 2024-09-14T09:08:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.194e-06 2024-09-14T09:08:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789003+0000", 2024-09-14T09:08:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99032768400000004 2024-09-14T09:08:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789115+0000", 2024-09-14T09:08:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112236 2024-09-14T09:08:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789250+0000", 2024-09-14T09:08:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013548100000000001 2024-09-14T09:08:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:229 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 819200~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:08:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.747234260000001, 2024-09-14T09:08:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99287024599999996, 2024-09-14T09:08:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 229 2024-09-14T09:08:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:08:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:08:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:08:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999999e-07 2024-09-14T09:08:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796962+0000", 2024-09-14T09:08:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1479999999999999e-06 2024-09-14T09:08:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796967+0000", 2024-09-14T09:08:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1499999999999998e-06 2024-09-14T09:08:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:08:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-06 2024-09-14T09:08:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798688+0000", 2024-09-14T09:08:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017172660000000001 2024-09-14T09:08:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798691+0000", 2024-09-14T09:08:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:08:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789599+0000", 2024-09-14T09:08:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99090839399999997 2024-09-14T09:08:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789716+0000", 2024-09-14T09:08:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116474 2024-09-14T09:08:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789828+0000", 2024-09-14T09:08:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112293 2024-09-14T09:08:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:230 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1277952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:08:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.747213611999999, 2024-09-14T09:08:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99307501600000003, 2024-09-14T09:08:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 230 2024-09-14T09:08:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:08:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:08:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796979+0000", 2024-09-14T09:08:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.34e-07 2024-09-14T09:08:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796980+0000", 2024-09-14T09:08:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.53e-06 2024-09-14T09:08:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796986+0000", 2024-09-14T09:08:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9989999999999997e-06 2024-09-14T09:08:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796989+0000", 2024-09-14T09:08:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0340000000000001e-06 2024-09-14T09:08:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798702+0000", 2024-09-14T09:08:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001712756 2024-09-14T09:08:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798705+0000", 2024-09-14T09:08:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7750000000000001e-06 2024-09-14T09:08:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789870+0000", 2024-09-14T09:08:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991165026 2024-09-14T09:08:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789955+0000", 2024-09-14T09:08:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4839999999999994e-05 2024-09-14T09:08:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790053+0000", 2024-09-14T09:08:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8721999999999994e-05 2024-09-14T09:08:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:231 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:08:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.747198284, 2024-09-14T09:08:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99319130300000003, 2024-09-14T09:08:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 231 2024-09-14T09:08:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:08:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:08:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:08:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2024-09-14T09:08:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796995+0000", 2024-09-14T09:08:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2500000000000001e-06 2024-09-14T09:08:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796998+0000", 2024-09-14T09:08:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3230000000000002e-06 2024-09-14T09:08:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797001+0000", 2024-09-14T09:08:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7099999999999999e-06 2024-09-14T09:08:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798718+0000", 2024-09-14T09:08:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017168070000000001 2024-09-14T09:08:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798721+0000", 2024-09-14T09:08:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.853e-06 2024-09-14T09:08:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790077+0000", 2024-09-14T09:08:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991356393 2024-09-14T09:08:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790129+0000", 2024-09-14T09:08:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2240999999999997e-05 2024-09-14T09:08:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790185+0000", 2024-09-14T09:08:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5515e-05 2024-09-14T09:08:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:232 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2195456~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:08:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.747187628000001, 2024-09-14T09:08:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99329117899999997, 2024-09-14T09:08:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 232 2024-09-14T09:08:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:08:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:08:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797005+0000", 2024-09-14T09:08:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2024-09-14T09:08:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797006+0000", 2024-09-14T09:08:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3200000000000001e-06 2024-09-14T09:08:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797009+0000", 2024-09-14T09:08:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4680000000000001e-06 2024-09-14T09:08:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797012+0000", 2024-09-14T09:08:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4770000000000002e-06 2024-09-14T09:08:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798743+0000", 2024-09-14T09:08:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017312 2024-09-14T09:08:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798747+0000", 2024-09-14T09:08:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.484e-06 2024-09-14T09:08:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790201+0000", 2024-09-14T09:08:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99145419499999998 2024-09-14T09:08:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790241+0000", 2024-09-14T09:08:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0587999999999998e-05 2024-09-14T09:08:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790296+0000", 2024-09-14T09:08:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4212000000000002e-05 2024-09-14T09:08:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:233 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2654208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:08:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.747177004999999, 2024-09-14T09:08:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99337220100000001, 2024-09-14T09:08:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 233 2024-09-14T09:08:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:08:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:08:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:08:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:08:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:08:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.269e-06 2024-09-14T09:08:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797019+0000", 2024-09-14T09:08:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9519999999999999e-06 2024-09-14T09:08:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797022+0000", 2024-09-14T09:08:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6079999999999998e-06 2024-09-14T09:08:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798759+0000", 2024-09-14T09:08:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001737342 2024-09-14T09:08:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798762+0000", 2024-09-14T09:08:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:08:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790310+0000", 2024-09-14T09:08:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99154738799999997 2024-09-14T09:08:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790349+0000", 2024-09-14T09:08:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9573000000000002e-05 2024-09-14T09:08:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790387+0000", 2024-09-14T09:08:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7985999999999998e-05 2024-09-14T09:08:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:234 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3112960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:08:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.747166959999999, 2024-09-14T09:08:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99345674500000003, 2024-09-14T09:08:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 234 2024-09-14T09:08:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:08:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:08:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:08:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0100000000000001e-07 2024-09-14T09:08:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0699999999999999e-06 2024-09-14T09:08:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:08:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.886e-06 2024-09-14T09:08:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797032+0000", 2024-09-14T09:08:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7149999999999998e-06 2024-09-14T09:08:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798778+0000", 2024-09-14T09:08:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017460329999999999 2024-09-14T09:08:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798783+0000", 2024-09-14T09:08:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0760000000000002e-06 2024-09-14T09:08:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790408+0000", 2024-09-14T09:08:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99162473299999998 2024-09-14T09:08:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790446+0000", 2024-09-14T09:08:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8389000000000001e-05 2024-09-14T09:08:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790482+0000", 2024-09-14T09:08:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5642000000000002e-05 2024-09-14T09:08:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:235 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3571712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:08:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.747157061999999, 2024-09-14T09:08:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993539477, 2024-09-14T09:08:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 235 2024-09-14T09:08:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:08:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:08:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:08:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9999999999999999e-07 2024-09-14T09:08:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797036+0000", 2024-09-14T09:08:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.051e-06 2024-09-14T09:08:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797039+0000", 2024-09-14T09:08:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:08:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797042+0000", 2024-09-14T09:08:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5280000000000002e-06 2024-09-14T09:08:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798809+0000", 2024-09-14T09:08:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001767394 2024-09-14T09:08:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798815+0000", 2024-09-14T09:08:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0859999999999998e-06 2024-09-14T09:08:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790502+0000", 2024-09-14T09:08:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99168652300000004 2024-09-14T09:08:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790539+0000", 2024-09-14T09:08:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7471000000000001e-05 2024-09-14T09:08:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790574+0000", 2024-09-14T09:08:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5292e-05 2024-09-14T09:08:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:236 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 4030464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:08:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.747146829, 2024-09-14T09:08:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993619743, 2024-09-14T09:08:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 236 2024-09-14T09:08:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:08:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:08:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:08:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1400000000000001e-07 2024-09-14T09:08:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797047+0000", 2024-09-14T09:08:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3400000000000001e-06 2024-09-14T09:08:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:08:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0699999999999998e-06 2024-09-14T09:08:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797053+0000", 2024-09-14T09:08:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7310000000000002e-06 2024-09-14T09:08:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798839+0000", 2024-09-14T09:08:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001786403 2024-09-14T09:08:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798844+0000", 2024-09-14T09:08:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3730000000000001e-06 2024-09-14T09:08:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790592+0000", 2024-09-14T09:08:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99174818099999995 2024-09-14T09:08:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790628+0000", 2024-09-14T09:08:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5831000000000003e-05 2024-09-14T09:08:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790665+0000", 2024-09-14T09:08:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-05 2024-09-14T09:08:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:365 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:08:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.744959801, 2024-09-14T09:08:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157278400000004, 2024-09-14T09:08:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 365 2024-09-14T09:08:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:08:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:08:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:08:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:08:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799233+0000", 2024-09-14T09:08:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.057e-06 2024-09-14T09:08:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799236+0000", 2024-09-14T09:08:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0249999999999998e-06 2024-09-14T09:08:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799239+0000", 2024-09-14T09:08:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.481e-06 2024-09-14T09:08:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800963+0000", 2024-09-14T09:08:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017240440000000001 2024-09-14T09:08:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800969+0000", 2024-09-14T09:08:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1410000000000002e-06 2024-09-14T09:08:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790682+0000", 2024-09-14T09:08:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98971330300000004 2024-09-14T09:08:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790753+0000", 2024-09-14T09:08:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0548000000000003e-05 2024-09-14T09:08:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790805+0000", 2024-09-14T09:08:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1981999999999998e-05 2024-09-14T09:08:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:366 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:08:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.744949708, 2024-09-14T09:08:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99173757299999998, 2024-09-14T09:08:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 366 2024-09-14T09:08:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:08:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:08:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:08:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-07 2024-09-14T09:08:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799244+0000", 2024-09-14T09:08:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.359e-06 2024-09-14T09:08:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799247+0000", 2024-09-14T09:08:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4929999999999998e-06 2024-09-14T09:08:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799250+0000", 2024-09-14T09:08:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:08:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800991+0000", 2024-09-14T09:08:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017412809999999999 2024-09-14T09:08:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800997+0000", 2024-09-14T09:08:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:08:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790824+0000", 2024-09-14T09:08:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98982735399999999 2024-09-14T09:08:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790891+0000", 2024-09-14T09:08:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7243999999999995e-05 2024-09-14T09:08:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790980+0000", 2024-09-14T09:08:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8608000000000003e-05 2024-09-14T09:08:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:367 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:08:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.744938336000001, 2024-09-14T09:08:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99188259999999995, 2024-09-14T09:08:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 367 2024-09-14T09:08:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:08:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:08:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:08:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-07 2024-09-14T09:08:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799255+0000", 2024-09-14T09:08:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.111e-06 2024-09-14T09:08:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799259+0000", 2024-09-14T09:08:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8650000000000003e-06 2024-09-14T09:08:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799262+0000", 2024-09-14T09:08:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.128e-06 2024-09-14T09:08:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801029+0000", 2024-09-14T09:08:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017668460000000001 2024-09-14T09:08:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801032+0000", 2024-09-14T09:08:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3179999999999998e-06 2024-09-14T09:08:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791011+0000", 2024-09-14T09:08:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98997920399999995 2024-09-14T09:08:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791077+0000", 2024-09-14T09:08:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5214000000000003e-05 2024-09-14T09:08:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791136+0000", 2024-09-14T09:08:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9710000000000003e-05 2024-09-14T09:08:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:368 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:08:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.744926792999999, 2024-09-14T09:08:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99201753800000003, 2024-09-14T09:08:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 368 2024-09-14T09:08:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:08:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:08:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:08:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4900000000000002e-07 2024-09-14T09:08:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799267+0000", 2024-09-14T09:08:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.079e-06 2024-09-14T09:08:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799270+0000", 2024-09-14T09:08:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.993e-06 2024-09-14T09:08:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799272+0000", 2024-09-14T09:08:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.695e-06 2024-09-14T09:08:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801043+0000", 2024-09-14T09:08:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001771105 2024-09-14T09:08:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801046+0000", 2024-09-14T09:08:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7999999999999999e-06 2024-09-14T09:08:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791150+0000", 2024-09-14T09:08:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99010348699999995 2024-09-14T09:08:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791193+0000", 2024-09-14T09:08:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3615999999999997e-05 2024-09-14T09:08:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791283+0000", 2024-09-14T09:08:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9513999999999997e-05 2024-09-14T09:08:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:369 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:08:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.744916455, 2024-09-14T09:08:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99213433600000001, 2024-09-14T09:08:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 369 2024-09-14T09:08:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:08:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:08:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:08:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:08:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799277+0000", 2024-09-14T09:08:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.108e-06 2024-09-14T09:08:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799280+0000", 2024-09-14T09:08:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:08:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799283+0000", 2024-09-14T09:08:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.531e-06 2024-09-14T09:08:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801058+0000", 2024-09-14T09:08:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001775085 2024-09-14T09:08:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801060+0000", 2024-09-14T09:08:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8260000000000001e-06 2024-09-14T09:08:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791299+0000", 2024-09-14T09:08:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99023856799999999 2024-09-14T09:08:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791352+0000", 2024-09-14T09:08:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2528000000000003e-05 2024-09-14T09:08:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791410+0000", 2024-09-14T09:08:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8298000000000003e-05 2024-09-14T09:08:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:370 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2457600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:08:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.744891687999999, 2024-09-14T09:08:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99220795399999995, 2024-09-14T09:08:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 370 2024-09-14T09:08:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:08:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:08:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799301+0000", 2024-09-14T09:08:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2024-09-14T09:08:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799303+0000", 2024-09-14T09:08:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9319999999999999e-06 2024-09-14T09:08:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799310+0000", 2024-09-14T09:08:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8680000000000001e-06 2024-09-14T09:08:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799315+0000", 2024-09-14T09:08:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.921e-06 2024-09-14T09:08:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801071+0000", 2024-09-14T09:08:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001756678 2024-09-14T09:08:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801080+0000", 2024-09-14T09:08:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6060000000000003e-06 2024-09-14T09:08:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791429+0000", 2024-09-14T09:08:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99034944599999997 2024-09-14T09:08:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791471+0000", 2024-09-14T09:08:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1279999999999998e-05 2024-09-14T09:08:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791508+0000", 2024-09-14T09:08:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7663999999999997e-05 2024-09-14T09:08:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:371 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2916352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:08:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.744870516000001, 2024-09-14T09:08:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99228692299999999, 2024-09-14T09:08:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 371 2024-09-14T09:08:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:08:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:08:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799322+0000", 2024-09-14T09:08:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:08:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799333+0000", 2024-09-14T09:08:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1044e-05 2024-09-14T09:08:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799341+0000", 2024-09-14T09:08:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8439999999999998e-06 2024-09-14T09:08:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799354+0000", 2024-09-14T09:08:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3114e-05 2024-09-14T09:08:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801093+0000", 2024-09-14T09:08:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017385910000000001 2024-09-14T09:08:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801096+0000", 2024-09-14T09:08:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0680000000000001e-06 2024-09-14T09:08:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791528+0000", 2024-09-14T09:08:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99043264200000003 2024-09-14T09:08:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791570+0000", 2024-09-14T09:08:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2144999999999997e-05 2024-09-14T09:08:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791608+0000", 2024-09-14T09:08:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7966000000000002e-05 2024-09-14T09:08:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:372 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3375104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:08:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.744829967999999, 2024-09-14T09:08:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992342897, 2024-09-14T09:08:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 372 2024-09-14T09:08:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:08:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:08:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799363+0000", 2024-09-14T09:08:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2024-09-14T09:08:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799365+0000", 2024-09-14T09:08:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5500000000000001e-06 2024-09-14T09:08:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799371+0000", 2024-09-14T09:08:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2500000000000003e-06 2024-09-14T09:08:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799377+0000", 2024-09-14T09:08:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7509999999999997e-06 2024-09-14T09:08:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801107+0000", 2024-09-14T09:08:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017298019999999999 2024-09-14T09:08:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801111+0000", 2024-09-14T09:08:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8619999999999996e-06 2024-09-14T09:08:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791626+0000", 2024-09-14T09:08:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99051563300000001 2024-09-14T09:08:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791668+0000", 2024-09-14T09:08:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1424000000000002e-05 2024-09-14T09:08:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791705+0000", 2024-09-14T09:08:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7035e-05 2024-09-14T09:08:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:373 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:08:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.744808023000001, 2024-09-14T09:08:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99253589399999997, 2024-09-14T09:08:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 373 2024-09-14T09:08:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:08:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:08:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:08:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2024-09-14T09:08:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799387+0000", 2024-09-14T09:08:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1019999999999999e-06 2024-09-14T09:08:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799393+0000", 2024-09-14T09:08:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0190000000000003e-06 2024-09-14T09:08:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799398+0000", 2024-09-14T09:08:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:08:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801123+0000", 2024-09-14T09:08:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017251949999999999 2024-09-14T09:08:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801126+0000", 2024-09-14T09:08:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9280000000000002e-06 2024-09-14T09:08:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791746+0000", 2024-09-14T09:08:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99062036899999995 2024-09-14T09:08:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791835+0000", 2024-09-14T09:08:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9004000000000004e-05 2024-09-14T09:08:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791920+0000", 2024-09-14T09:08:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4524000000000006e-05 2024-09-14T09:08:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:10395 3.17 3:e9053d87:::rbd_data.111228c3791c.0000000000000006:18 [read 962560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.797914+0000", 2024-09-14T09:08:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7462781229999997, 2024-09-14T09:08:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034376019000000001, 2024-09-14T09:08:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10395 2024-09-14T09:08:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.797914+0000", 2024-09-14T09:08:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.797914+0000", 2024-09-14T09:08:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798042+0000", 2024-09-14T09:08:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012855399999999999 2024-09-14T09:08:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798044+0000", 2024-09-14T09:08:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.086e-06 2024-09-14T09:08:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798049+0000", 2024-09-14T09:08:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7770000000000002e-06 2024-09-14T09:08:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798066+0000", 2024-09-14T09:08:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6405999999999998e-05 2024-09-14T09:08:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832200+0000", 2024-09-14T09:08:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034134022 2024-09-14T09:08:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832241+0000", 2024-09-14T09:08:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1566999999999997e-05 2024-09-14T09:08:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832290+0000", 2024-09-14T09:08:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8606999999999997e-05 2024-09-14T09:08:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:10397 3.17 3:e9053d87:::rbd_data.111228c3791c.0000000000000006:18 [read 1085440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.798088+0000", 2024-09-14T09:08:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.7461042100000004, 2024-09-14T09:08:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034429187, 2024-09-14T09:08:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10397 2024-09-14T09:08:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:45.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798088+0000", 2024-09-14T09:08:45.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:45.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798088+0000", 2024-09-14T09:08:45.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:45.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:45.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803904+0000", 2024-09-14T09:08:45.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058164799999999997 2024-09-14T09:08:45.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:45.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803908+0000", 2024-09-14T09:08:45.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8580000000000002e-06 2024-09-14T09:08:45.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:45.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803918+0000", 2024-09-14T09:08:45.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4939999999999992e-06 2024-09-14T09:08:45.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:45.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803923+0000", 2024-09-14T09:08:45.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2599999999999996e-06 2024-09-14T09:08:45.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:45.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832428+0000", 2024-09-14T09:08:45.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.028504788 2024-09-14T09:08:45.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:45.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832470+0000", 2024-09-14T09:08:45.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2358999999999999e-05 2024-09-14T09:08:45.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:45.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:45.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:45.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832517+0000", 2024-09-14T09:08:45.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6947999999999998e-05 2024-09-14T09:08:45.647 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.648 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.648 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.648 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:45.648 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:45.648 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:45.649 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:08:45.650 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:08:45.651+0000 7fbee48e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31872) UID: 0 2024-09-14T09:08:45.749 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:45.751+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:45.753 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:45.753 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:45.753 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:08:45.753 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:45.762 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:08:45.834 INFO:teuthology.orchestra.run.smithi148.stdout:4050 punch from 0x2370600 to 0x2380200, (0xfc00 bytes) 2024-09-14T09:08:45.850 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:45.852+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:45.887 INFO:teuthology.orchestra.run.smithi148.stdout:4051 read 0x597b000 thru 0x597e2be (0x32bf bytes) 2024-09-14T09:08:45.887 INFO:teuthology.orchestra.run.smithi148.stdout:4052 write 0x38b3a00 thru 0x38b81f4 (0x47f5 bytes) 2024-09-14T09:08:45.887 INFO:teuthology.orchestra.run.smithi148.stdout:4053 read 0x108800 thru 0x10cb05 (0x4306 bytes) 2024-09-14T09:08:45.890 INFO:teuthology.orchestra.run.smithi148.stdout:4054 trunc from 0xd8d1400 to 0xc19c400 2024-09-14T09:08:45.915 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:45.915 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:45.915 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:45.915 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:45.916 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:45.924 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:08:45.949 INFO:teuthology.orchestra.run.smithi148.stdout:4055 trunc from 0xc19c400 to 0x9876c00 2024-09-14T09:08:45.966 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:45.968+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:46.001 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5] out_osds: [1] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T09:08:46.001 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:08:46.002 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 1, 2, 3, 4, 5] 2024-09-14T09:08:46.002 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-14T09:08:46.002 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T09:08:46.051 INFO:tasks.ceph.osd.2:Stopped 2024-09-14T09:08:46.051 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.2 2024-09-14T09:08:46.051 INFO:tasks.thrashosds.thrasher:remote for osd 2 is ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T09:08:46.051 DEBUG:teuthology.orchestra.run.smithi116:> type ceph-objectstore-tool 2024-09-14T09:08:46.085 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:46.085 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:46.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:46.085 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:46.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.086 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2265 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4034560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.086 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:08:46.086 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2239334500000005, 2024-09-14T09:08:46.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073974829000000006, 2024-09-14T09:08:46.086 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.086 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.086 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.086 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.086 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.086 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.086 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2265 2024-09-14T09:08:46.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.086 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:08:46.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:08:46.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862542+0000", 2024-09-14T09:08:46.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:08:46.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862543+0000", 2024-09-14T09:08:46.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.81e-06 2024-09-14T09:08:46.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862549+0000", 2024-09-14T09:08:46.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8850000000000004e-06 2024-09-14T09:08:46.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862554+0000", 2024-09-14T09:08:46.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5279999999999997e-06 2024-09-14T09:08:46.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936318+0000", 2024-09-14T09:08:46.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073764422999999996 2024-09-14T09:08:46.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936412+0000", 2024-09-14T09:08:46.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3801000000000005e-05 2024-09-14T09:08:46.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936516+0000", 2024-09-14T09:08:46.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000104007 2024-09-14T09:08:46.090 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.090 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.090 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.090 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2266 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4096000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.090 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:08:46.090 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2239155860000004, 2024-09-14T09:08:46.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074208332000000002, 2024-09-14T09:08:46.090 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.090 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.090 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.090 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.091 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.091 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.091 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2266 2024-09-14T09:08:46.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.091 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:08:46.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:08:46.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862738+0000", 2024-09-14T09:08:46.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017920300000000001 2024-09-14T09:08:46.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862744+0000", 2024-09-14T09:08:46.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3000000000000001e-06 2024-09-14T09:08:46.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862753+0000", 2024-09-14T09:08:46.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8179999999999999e-06 2024-09-14T09:08:46.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862785+0000", 2024-09-14T09:08:46.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1949000000000002e-05 2024-09-14T09:08:46.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936556+0000", 2024-09-14T09:08:46.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073770268999999999 2024-09-14T09:08:46.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936657+0000", 2024-09-14T09:08:46.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101387 2024-09-14T09:08:46.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936767+0000", 2024-09-14T09:08:46.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110406 2024-09-14T09:08:46.094 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.094 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.094 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.094 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2267 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4157440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.095 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:08:46.095 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2236770040000007, 2024-09-14T09:08:46.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074200918000000005, 2024-09-14T09:08:46.095 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.095 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.095 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.095 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.095 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.095 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.095 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2267 2024-09-14T09:08:46.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.095 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:08:46.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:08:46.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863416+0000", 2024-09-14T09:08:46.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000618492 2024-09-14T09:08:46.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863421+0000", 2024-09-14T09:08:46.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1359999999999996e-06 2024-09-14T09:08:46.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863434+0000", 2024-09-14T09:08:46.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2291e-05 2024-09-14T09:08:46.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863444+0000", 2024-09-14T09:08:46.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9769999999999995e-06 2024-09-14T09:08:46.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936808+0000", 2024-09-14T09:08:46.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073364051999999999 2024-09-14T09:08:46.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936892+0000", 2024-09-14T09:08:46.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4641999999999994e-05 2024-09-14T09:08:46.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936999+0000", 2024-09-14T09:08:46.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106328 2024-09-14T09:08:46.098 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.098 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.098 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.099 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2328 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 45056~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.099 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.863458+0000", 2024-09-14T09:08:46.099 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2230167650000006, 2024-09-14T09:08:46.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073931949999999996, 2024-09-14T09:08:46.099 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.099 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.099 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.099 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.099 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.099 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.099 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2328 2024-09-14T09:08:46.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.100 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863458+0000", 2024-09-14T09:08:46.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863458+0000", 2024-09-14T09:08:46.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863489+0000", 2024-09-14T09:08:46.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1270999999999999e-05 2024-09-14T09:08:46.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863500+0000", 2024-09-14T09:08:46.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0969e-05 2024-09-14T09:08:46.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863509+0000", 2024-09-14T09:08:46.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5210000000000002e-06 2024-09-14T09:08:46.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863515+0000", 2024-09-14T09:08:46.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-09-14T09:08:46.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937038+0000", 2024-09-14T09:08:46.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073522901000000002 2024-09-14T09:08:46.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937131+0000", 2024-09-14T09:08:46.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.276e-05 2024-09-14T09:08:46.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937390+0000", 2024-09-14T09:08:46.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025917099999999999 2024-09-14T09:08:46.103 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.103 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.103 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.103 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2329 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 106496~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.103 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:08:46.103 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2229483949999995, 2024-09-14T09:08:46.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074180251000000003, 2024-09-14T09:08:46.103 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.103 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.103 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.103 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.104 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.104 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.104 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2329 2024-09-14T09:08:46.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.104 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:08:46.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:08:46.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864203+0000", 2024-09-14T09:08:46.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000677015 2024-09-14T09:08:46.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864208+0000", 2024-09-14T09:08:46.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.972e-06 2024-09-14T09:08:46.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864221+0000", 2024-09-14T09:08:46.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2683e-05 2024-09-14T09:08:46.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864229+0000", 2024-09-14T09:08:46.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0809999999999994e-06 2024-09-14T09:08:46.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937430+0000", 2024-09-14T09:08:46.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073201231000000005 2024-09-14T09:08:46.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937513+0000", 2024-09-14T09:08:46.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2652999999999996e-05 2024-09-14T09:08:46.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937707+0000", 2024-09-14T09:08:46.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000193616 2024-09-14T09:08:46.107 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.107 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.107 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.107 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2331 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 229376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.107 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:08:46.108 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2221308979999996, 2024-09-14T09:08:46.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.07400843, 2024-09-14T09:08:46.108 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.108 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.108 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.108 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.108 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.108 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.108 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2331 2024-09-14T09:08:46.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.108 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:08:46.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:08:46.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868104+0000", 2024-09-14T09:08:46.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003760453 2024-09-14T09:08:46.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868109+0000", 2024-09-14T09:08:46.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9339999999999997e-06 2024-09-14T09:08:46.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868119+0000", 2024-09-14T09:08:46.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5389999999999996e-06 2024-09-14T09:08:46.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868126+0000", 2024-09-14T09:08:46.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4499999999999998e-06 2024-09-14T09:08:46.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938065+0000", 2024-09-14T09:08:46.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069938809000000005 2024-09-14T09:08:46.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938148+0000", 2024-09-14T09:08:46.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3171999999999996e-05 2024-09-14T09:08:46.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938352+0000", 2024-09-14T09:08:46.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020407300000000001 2024-09-14T09:08:46.114 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.114 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.114 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.114 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2380 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3239936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.114 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:08:46.114 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2071058699999995, 2024-09-14T09:08:46.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073985913, 2024-09-14T09:08:46.115 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.115 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.115 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.115 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.115 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.115 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.116 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2380 2024-09-14T09:08:46.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.116 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:08:46.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:08:46.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879697+0000", 2024-09-14T09:08:46.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032864100000000001 2024-09-14T09:08:46.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879702+0000", 2024-09-14T09:08:46.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.578e-06 2024-09-14T09:08:46.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879716+0000", 2024-09-14T09:08:46.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.413e-05 2024-09-14T09:08:46.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879724+0000", 2024-09-14T09:08:46.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.559e-06 2024-09-14T09:08:46.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953155+0000", 2024-09-14T09:08:46.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073431221000000005 2024-09-14T09:08:46.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953247+0000", 2024-09-14T09:08:46.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1662000000000004e-05 2024-09-14T09:08:46.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953355+0000", 2024-09-14T09:08:46.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010812200000000001 2024-09-14T09:08:46.121 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.121 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.121 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.121 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2500 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2789376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.121 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:08:46.122 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.1885748249999999, 2024-09-14T09:08:46.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073867281000000007, 2024-09-14T09:08:46.122 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.122 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.122 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.122 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.122 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.122 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.122 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2500 2024-09-14T09:08:46.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.122 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:08:46.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:08:46.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:08:46.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1e-07 2024-09-14T09:08:46.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897901+0000", 2024-09-14T09:08:46.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1650000000000001e-06 2024-09-14T09:08:46.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897905+0000", 2024-09-14T09:08:46.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.755e-06 2024-09-14T09:08:46.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897908+0000", 2024-09-14T09:08:46.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7480000000000002e-06 2024-09-14T09:08:46.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971448+0000", 2024-09-14T09:08:46.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073539801000000002 2024-09-14T09:08:46.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971535+0000", 2024-09-14T09:08:46.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7085999999999999e-05 2024-09-14T09:08:46.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971767+0000", 2024-09-14T09:08:46.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023251599999999999 2024-09-14T09:08:46.125 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.126 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.126 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.126 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2501 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2850816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.126 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:08:46.126 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.1885635659999991, 2024-09-14T09:08:46.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074288858999999999, 2024-09-14T09:08:46.126 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.126 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.126 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.126 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.126 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.126 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.126 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2501 2024-09-14T09:08:46.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.127 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:08:46.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:08:46.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:08:46.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.41e-07 2024-09-14T09:08:46.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897913+0000", 2024-09-14T09:08:46.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3090000000000001e-06 2024-09-14T09:08:46.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897918+0000", 2024-09-14T09:08:46.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8470000000000003e-06 2024-09-14T09:08:46.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897922+0000", 2024-09-14T09:08:46.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5549999999999996e-06 2024-09-14T09:08:46.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971872+0000", 2024-09-14T09:08:46.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073950057999999999 2024-09-14T09:08:46.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971958+0000", 2024-09-14T09:08:46.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5941999999999998e-05 2024-09-14T09:08:46.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972200+0000", 2024-09-14T09:08:46.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000241907 2024-09-14T09:08:46.130 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.130 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.130 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.130 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2502 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2912256~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.130 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:08:46.130 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.1885243859999992, 2024-09-14T09:08:46.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074614080999999999, 2024-09-14T09:08:46.130 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.131 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.131 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.131 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.131 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.131 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.131 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2502 2024-09-14T09:08:46.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.131 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:08:46.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:08:46.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897951+0000", 2024-09-14T09:08:46.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:08:46.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897953+0000", 2024-09-14T09:08:46.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5670000000000002e-06 2024-09-14T09:08:46.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897970+0000", 2024-09-14T09:08:46.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6319000000000001e-05 2024-09-14T09:08:46.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897976+0000", 2024-09-14T09:08:46.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8760000000000002e-06 2024-09-14T09:08:46.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972245+0000", 2024-09-14T09:08:46.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074269186000000001 2024-09-14T09:08:46.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972333+0000", 2024-09-14T09:08:46.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7800999999999995e-05 2024-09-14T09:08:46.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972564+0000", 2024-09-14T09:08:46.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000231833 2024-09-14T09:08:46.134 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.134 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.135 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.135 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2503 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2973696~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.135 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:08:46.135 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.1884903690000002, 2024-09-14T09:08:46.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074944286999999998, 2024-09-14T09:08:46.135 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.135 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.135 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.135 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.135 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.135 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.135 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2503 2024-09-14T09:08:46.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.136 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:08:46.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:08:46.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897985+0000", 2024-09-14T09:08:46.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999998e-07 2024-09-14T09:08:46.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897987+0000", 2024-09-14T09:08:46.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.401e-06 2024-09-14T09:08:46.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897999+0000", 2024-09-14T09:08:46.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1851999999999999e-05 2024-09-14T09:08:46.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898005+0000", 2024-09-14T09:08:46.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9789999999999998e-06 2024-09-14T09:08:46.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972609+0000", 2024-09-14T09:08:46.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074604217 2024-09-14T09:08:46.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972684+0000", 2024-09-14T09:08:46.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4777999999999995e-05 2024-09-14T09:08:46.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972929+0000", 2024-09-14T09:08:46.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024448100000000001 2024-09-14T09:08:46.139 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.139 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.139 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.139 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2504 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3035136~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.139 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:08:46.139 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.1884622769999993, 2024-09-14T09:08:46.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075285131000000005, 2024-09-14T09:08:46.139 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.139 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.139 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.140 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.140 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.140 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.140 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2504 2024-09-14T09:08:46.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.140 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:08:46.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:08:46.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898078+0000", 2024-09-14T09:08:46.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5775e-05 2024-09-14T09:08:46.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898082+0000", 2024-09-14T09:08:46.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.49e-06 2024-09-14T09:08:46.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898092+0000", 2024-09-14T09:08:46.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0509999999999999e-05 2024-09-14T09:08:46.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898099+0000", 2024-09-14T09:08:46.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.81e-06 2024-09-14T09:08:46.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972971+0000", 2024-09-14T09:08:46.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074871788999999994 2024-09-14T09:08:46.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973055+0000", 2024-09-14T09:08:46.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3980000000000006e-05 2024-09-14T09:08:46.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973298+0000", 2024-09-14T09:08:46.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024277700000000001 2024-09-14T09:08:46.143 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.143 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.143 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.143 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2505 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3096576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.143 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:08:46.143 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.1883660220000003, 2024-09-14T09:08:46.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075506668999999998, 2024-09-14T09:08:46.144 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.144 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.144 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.144 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.144 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.144 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.144 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2505 2024-09-14T09:08:46.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.144 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:08:46.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:08:46.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898370+0000", 2024-09-14T09:08:46.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026128799999999998 2024-09-14T09:08:46.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898374+0000", 2024-09-14T09:08:46.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8070000000000001e-06 2024-09-14T09:08:46.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898383+0000", 2024-09-14T09:08:46.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0520000000000007e-06 2024-09-14T09:08:46.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898389+0000", 2024-09-14T09:08:46.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2639999999999997e-06 2024-09-14T09:08:46.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973330+0000", 2024-09-14T09:08:46.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074940548999999995 2024-09-14T09:08:46.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973402+0000", 2024-09-14T09:08:46.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2556000000000001e-05 2024-09-14T09:08:46.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973615+0000", 2024-09-14T09:08:46.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000213153 2024-09-14T09:08:46.147 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.147 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.147 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.148 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2506 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3158016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.148 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:08:46.148 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.1880727780000004, 2024-09-14T09:08:46.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075556110999999995, 2024-09-14T09:08:46.148 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.148 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.148 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.148 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.148 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.148 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.149 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2506 2024-09-14T09:08:46.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.149 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:08:46.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:08:46.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898497+0000", 2024-09-14T09:08:46.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4806e-05 2024-09-14T09:08:46.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898500+0000", 2024-09-14T09:08:46.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.54e-06 2024-09-14T09:08:46.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898507+0000", 2024-09-14T09:08:46.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1590000000000004e-06 2024-09-14T09:08:46.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898513+0000", 2024-09-14T09:08:46.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.015e-06 2024-09-14T09:08:46.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973656+0000", 2024-09-14T09:08:46.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075142929999999997 2024-09-14T09:08:46.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973742+0000", 2024-09-14T09:08:46.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5535e-05 2024-09-14T09:08:46.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973958+0000", 2024-09-14T09:08:46.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000216126 2024-09-14T09:08:46.152 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.152 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.152 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.152 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2507 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3219456~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.152 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:08:46.152 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.187944194, 2024-09-14T09:08:46.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075623459000000004, 2024-09-14T09:08:46.153 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.153 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.153 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.153 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.153 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.153 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.153 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2507 2024-09-14T09:08:46.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.153 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:08:46.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:08:46.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898761+0000", 2024-09-14T09:08:46.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000230614 2024-09-14T09:08:46.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898765+0000", 2024-09-14T09:08:46.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6629999999999999e-06 2024-09-14T09:08:46.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898774+0000", 2024-09-14T09:08:46.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6749999999999997e-06 2024-09-14T09:08:46.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898781+0000", 2024-09-14T09:08:46.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4640000000000003e-06 2024-09-14T09:08:46.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973985+0000", 2024-09-14T09:08:46.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075204101999999995 2024-09-14T09:08:46.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974063+0000", 2024-09-14T09:08:46.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7632000000000005e-05 2024-09-14T09:08:46.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974154+0000", 2024-09-14T09:08:46.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1309000000000003e-05 2024-09-14T09:08:46.157 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.157 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.157 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.157 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2508 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3280896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.157 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:08:46.157 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.1876824310000007, 2024-09-14T09:08:46.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075576943999999993, 2024-09-14T09:08:46.157 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.157 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.157 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.157 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.157 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.157 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.158 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2508 2024-09-14T09:08:46.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.158 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:08:46.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:08:46.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899176+0000", 2024-09-14T09:08:46.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038340500000000002 2024-09-14T09:08:46.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899179+0000", 2024-09-14T09:08:46.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0290000000000001e-06 2024-09-14T09:08:46.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899186+0000", 2024-09-14T09:08:46.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8199999999999999e-06 2024-09-14T09:08:46.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899190+0000", 2024-09-14T09:08:46.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2050000000000004e-06 2024-09-14T09:08:46.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974193+0000", 2024-09-14T09:08:46.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075003632000000001 2024-09-14T09:08:46.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974276+0000", 2024-09-14T09:08:46.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2272000000000001e-05 2024-09-14T09:08:46.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974369+0000", 2024-09-14T09:08:46.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3580999999999997e-05 2024-09-14T09:08:46.161 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.161 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.161 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.161 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2509 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3342336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.162 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:08:46.162 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.1872748140000002, 2024-09-14T09:08:46.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075356229999999996, 2024-09-14T09:08:46.162 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.162 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.162 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.162 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.162 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.162 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.162 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2509 2024-09-14T09:08:46.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.162 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:08:46.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:08:46.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899439+0000", 2024-09-14T09:08:46.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023958599999999999 2024-09-14T09:08:46.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899444+0000", 2024-09-14T09:08:46.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8790000000000002e-06 2024-09-14T09:08:46.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899455+0000", 2024-09-14T09:08:46.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0597999999999999e-05 2024-09-14T09:08:46.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899462+0000", 2024-09-14T09:08:46.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8179999999999998e-06 2024-09-14T09:08:46.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974400+0000", 2024-09-14T09:08:46.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074937999000000005 2024-09-14T09:08:46.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974465+0000", 2024-09-14T09:08:46.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5134000000000004e-05 2024-09-14T09:08:46.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974556+0000", 2024-09-14T09:08:46.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1216000000000002e-05 2024-09-14T09:08:46.167 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.167 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.167 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.167 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2510 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3403776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.167 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:08:46.167 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.1869994209999994, 2024-09-14T09:08:46.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075295775999999995, 2024-09-14T09:08:46.167 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.167 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.167 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.167 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.168 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.168 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.168 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2510 2024-09-14T09:08:46.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.168 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:08:46.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:08:46.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899691+0000", 2024-09-14T09:08:46.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021615999999999999 2024-09-14T09:08:46.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899696+0000", 2024-09-14T09:08:46.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3200000000000001e-06 2024-09-14T09:08:46.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899704+0000", 2024-09-14T09:08:46.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9440000000000005e-06 2024-09-14T09:08:46.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899710+0000", 2024-09-14T09:08:46.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.584e-06 2024-09-14T09:08:46.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974594+0000", 2024-09-14T09:08:46.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074883551000000007 2024-09-14T09:08:46.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974679+0000", 2024-09-14T09:08:46.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5365999999999995e-05 2024-09-14T09:08:46.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974771+0000", 2024-09-14T09:08:46.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1850999999999999e-05 2024-09-14T09:08:46.171 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.171 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.171 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.171 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2511 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3465216~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.171 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:08:46.172 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.1867532030000003, 2024-09-14T09:08:46.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075234668000000005, 2024-09-14T09:08:46.172 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.172 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.172 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.172 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.172 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.172 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.172 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2511 2024-09-14T09:08:46.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.172 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:08:46.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:08:46.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899951+0000", 2024-09-14T09:08:46.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000229569 2024-09-14T09:08:46.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899955+0000", 2024-09-14T09:08:46.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1010000000000002e-06 2024-09-14T09:08:46.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899971+0000", 2024-09-14T09:08:46.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5648999999999999e-05 2024-09-14T09:08:46.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899978+0000", 2024-09-14T09:08:46.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0829999999999998e-06 2024-09-14T09:08:46.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974806+0000", 2024-09-14T09:08:46.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074828092999999998 2024-09-14T09:08:46.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974870+0000", 2024-09-14T09:08:46.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4492000000000005e-05 2024-09-14T09:08:46.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974956+0000", 2024-09-14T09:08:46.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5680999999999995e-05 2024-09-14T09:08:46.176 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.176 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.176 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.177 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2512 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3526656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.177 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:08:46.177 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.1864856580000005, 2024-09-14T09:08:46.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075178812999999997, 2024-09-14T09:08:46.177 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.178 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.178 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.178 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.178 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.178 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.178 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2512 2024-09-14T09:08:46.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.179 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:08:46.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:08:46.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904181+0000", 2024-09-14T09:08:46.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041919399999999999 2024-09-14T09:08:46.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904186+0000", 2024-09-14T09:08:46.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2390000000000002e-06 2024-09-14T09:08:46.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904199+0000", 2024-09-14T09:08:46.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2709e-05 2024-09-14T09:08:46.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904207+0000", 2024-09-14T09:08:46.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8150000000000006e-06 2024-09-14T09:08:46.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975000+0000", 2024-09-14T09:08:46.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.070793444999999997 2024-09-14T09:08:46.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975079+0000", 2024-09-14T09:08:46.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8480999999999996e-05 2024-09-14T09:08:46.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975168+0000", 2024-09-14T09:08:46.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9184000000000005e-05 2024-09-14T09:08:46.182 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.182 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.182 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.182 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.182 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.182 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:46.183 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:46.086+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:46.184 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:08:46.185 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:46.187+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:46.196 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-14T09:08:46.197 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --op list-pgs 2024-09-14T09:08:46.286 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:46.287+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:46.341 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:46.341 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:46.341 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:08:46.341 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:46.349 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:08:46.390 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:46.392+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:46.488 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:46.490+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:46.491 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:46.491 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:46.491 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:46.491 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:46.491 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:46.500 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:08:46.590 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:46.592+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:46.606 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:46.606 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:46.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:46.606 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:46.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.607 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:08:46.607 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:46.607 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.374722414000004, 2024-09-14T09:08:46.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72111598600000004, 2024-09-14T09:08:46.607 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.607 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.607 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:46.607 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.607 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:08:46.607 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:08:46.607 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1 2024-09-14T09:08:46.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.608 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:46.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:46.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233065+0000", 2024-09-14T09:08:46.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1909999999999999e-06 2024-09-14T09:08:46.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233071+0000", 2024-09-14T09:08:46.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5300000000000002e-06 2024-09-14T09:08:46.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233081+0000", 2024-09-14T09:08:46.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0339e-05 2024-09-14T09:08:46.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233093+0000", 2024-09-14T09:08:46.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1252e-05 2024-09-14T09:08:46.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233162+0000", 2024-09-14T09:08:46.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9678999999999995e-05 2024-09-14T09:08:46.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:08:46.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233171+0000", 2024-09-14T09:08:46.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.132e-06 2024-09-14T09:08:46.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952480+0000", 2024-09-14T09:08:46.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.71930839899999999 2024-09-14T09:08:46.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952655+0000", 2024-09-14T09:08:46.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017552 2024-09-14T09:08:46.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:46.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952835+0000", 2024-09-14T09:08:46.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001797 2024-09-14T09:08:46.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:46.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.953648+0000", 2024-09-14T09:08:46.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00081291700000000002 2024-09-14T09:08:46.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:46.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954108+0000", 2024-09-14T09:08:46.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045992800000000002 2024-09-14T09:08:46.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:46.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954149+0000", 2024-09-14T09:08:46.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1214999999999998e-05 2024-09-14T09:08:46.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954178+0000", 2024-09-14T09:08:46.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9184e-05 2024-09-14T09:08:46.613 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.613 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.613 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.614 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:11931 3.1a 3:5f6725a9:::rbd_header.111219b19df:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.614 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.722408+0000", 2024-09-14T09:08:46.614 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.8853772279999994, 2024-09-14T09:08:46.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.089863542000000005, 2024-09-14T09:08:46.614 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.614 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.614 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.614 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.614 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:08:46.614 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:08:46.614 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11931 2024-09-14T09:08:46.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.615 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.722408+0000", 2024-09-14T09:08:46.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.722408+0000", 2024-09-14T09:08:46.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812037+0000", 2024-09-14T09:08:46.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.089629082999999998 2024-09-14T09:08:46.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812042+0000", 2024-09-14T09:08:46.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5790000000000003e-06 2024-09-14T09:08:46.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812051+0000", 2024-09-14T09:08:46.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1689999999999998e-06 2024-09-14T09:08:46.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812058+0000", 2024-09-14T09:08:46.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.725e-06 2024-09-14T09:08:46.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812117+0000", 2024-09-14T09:08:46.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8483999999999998e-05 2024-09-14T09:08:46.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812183+0000", 2024-09-14T09:08:46.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6759000000000002e-05 2024-09-14T09:08:46.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812271+0000", 2024-09-14T09:08:46.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7743000000000003e-05 2024-09-14T09:08:46.618 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.618 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.618 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.618 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9655 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 811008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.619 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.688987+0000", 2024-09-14T09:08:46.619 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.9187978920000006, 2024-09-14T09:08:46.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044554783000000001, 2024-09-14T09:08:46.619 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.619 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.619 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.619 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.619 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.619 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.619 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9655 2024-09-14T09:08:46.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.619 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.688987+0000", 2024-09-14T09:08:46.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.688987+0000", 2024-09-14T09:08:46.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.688987+0000", 2024-09-14T09:08:46.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4300000000000003e-07 2024-09-14T09:08:46.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.688989+0000", 2024-09-14T09:08:46.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7969999999999999e-06 2024-09-14T09:08:46.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.688995+0000", 2024-09-14T09:08:46.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1310000000000003e-06 2024-09-14T09:08:46.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689000+0000", 2024-09-14T09:08:46.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4870000000000004e-06 2024-09-14T09:08:46.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733378+0000", 2024-09-14T09:08:46.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044377658 2024-09-14T09:08:46.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733454+0000", 2024-09-14T09:08:46.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6884000000000005e-05 2024-09-14T09:08:46.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733542+0000", 2024-09-14T09:08:46.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7282999999999998e-05 2024-09-14T09:08:46.623 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.623 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.623 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.623 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9656 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 872448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.624 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.689005+0000", 2024-09-14T09:08:46.624 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.9187795439999995, 2024-09-14T09:08:46.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044678214000000001, 2024-09-14T09:08:46.624 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.624 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.624 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.624 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.624 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.624 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.624 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9656 2024-09-14T09:08:46.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.624 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689005+0000", 2024-09-14T09:08:46.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689005+0000", 2024-09-14T09:08:46.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689006+0000", 2024-09-14T09:08:46.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.51e-07 2024-09-14T09:08:46.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689007+0000", 2024-09-14T09:08:46.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.699e-06 2024-09-14T09:08:46.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689013+0000", 2024-09-14T09:08:46.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.609e-06 2024-09-14T09:08:46.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689018+0000", 2024-09-14T09:08:46.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7319999999999998e-06 2024-09-14T09:08:46.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733570+0000", 2024-09-14T09:08:46.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044552691999999998 2024-09-14T09:08:46.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733610+0000", 2024-09-14T09:08:46.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9366000000000002e-05 2024-09-14T09:08:46.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733683+0000", 2024-09-14T09:08:46.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3664999999999994e-05 2024-09-14T09:08:46.628 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.628 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.628 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.628 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9657 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 933888~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.628 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.689024+0000", 2024-09-14T09:08:46.628 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.9187612590000001, 2024-09-14T09:08:46.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044870122999999998, 2024-09-14T09:08:46.628 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.629 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.629 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.629 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.629 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.629 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.629 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9657 2024-09-14T09:08:46.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.629 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689024+0000", 2024-09-14T09:08:46.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689024+0000", 2024-09-14T09:08:46.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689024+0000", 2024-09-14T09:08:46.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.27e-07 2024-09-14T09:08:46.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689026+0000", 2024-09-14T09:08:46.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9180000000000001e-06 2024-09-14T09:08:46.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689032+0000", 2024-09-14T09:08:46.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9050000000000002e-06 2024-09-14T09:08:46.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689036+0000", 2024-09-14T09:08:46.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6380000000000003e-06 2024-09-14T09:08:46.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733724+0000", 2024-09-14T09:08:46.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044687326999999999 2024-09-14T09:08:46.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733802+0000", 2024-09-14T09:08:46.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8486999999999996e-05 2024-09-14T09:08:46.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733894+0000", 2024-09-14T09:08:46.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1520999999999993e-05 2024-09-14T09:08:46.632 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.633 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.633 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.633 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9658 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 995328~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.633 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.689042+0000", 2024-09-14T09:08:46.633 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.9187431000000004, 2024-09-14T09:08:46.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045057038000000001, 2024-09-14T09:08:46.633 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.633 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.633 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.633 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.633 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.633 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.634 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9658 2024-09-14T09:08:46.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.634 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689042+0000", 2024-09-14T09:08:46.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689042+0000", 2024-09-14T09:08:46.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693052+0000", 2024-09-14T09:08:46.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040104859999999997 2024-09-14T09:08:46.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693055+0000", 2024-09-14T09:08:46.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6929999999999999e-06 2024-09-14T09:08:46.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693065+0000", 2024-09-14T09:08:46.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0220999999999999e-05 2024-09-14T09:08:46.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693069+0000", 2024-09-14T09:08:46.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1180000000000002e-06 2024-09-14T09:08:46.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733926+0000", 2024-09-14T09:08:46.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040856418999999998 2024-09-14T09:08:46.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.734011+0000", 2024-09-14T09:08:46.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4902999999999997e-05 2024-09-14T09:08:46.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.734099+0000", 2024-09-14T09:08:46.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8197999999999998e-05 2024-09-14T09:08:46.637 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.637 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.637 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.638 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9683 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2531328~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.638 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.693341+0000", 2024-09-14T09:08:46.638 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.9144434629999996, 2024-09-14T09:08:46.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044718463999999999, 2024-09-14T09:08:46.638 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.638 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.638 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.638 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.638 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.638 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.638 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9683 2024-09-14T09:08:46.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.638 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693341+0000", 2024-09-14T09:08:46.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693341+0000", 2024-09-14T09:08:46.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693342+0000", 2024-09-14T09:08:46.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:08:46.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693343+0000", 2024-09-14T09:08:46.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2219999999999999e-06 2024-09-14T09:08:46.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693346+0000", 2024-09-14T09:08:46.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.785e-06 2024-09-14T09:08:46.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693348+0000", 2024-09-14T09:08:46.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4229999999999999e-06 2024-09-14T09:08:46.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.737876+0000", 2024-09-14T09:08:46.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044527870999999997 2024-09-14T09:08:46.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.737968+0000", 2024-09-14T09:08:46.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1859000000000003e-05 2024-09-14T09:08:46.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738060+0000", 2024-09-14T09:08:46.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2095000000000005e-05 2024-09-14T09:08:46.642 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.642 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.642 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.642 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9684 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2592768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.642 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.693351+0000", 2024-09-14T09:08:46.642 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.914433872, 2024-09-14T09:08:46.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044936873000000002, 2024-09-14T09:08:46.642 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.642 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.643 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.643 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.643 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.643 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.643 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9684 2024-09-14T09:08:46.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.643 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693351+0000", 2024-09-14T09:08:46.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693351+0000", 2024-09-14T09:08:46.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693351+0000", 2024-09-14T09:08:46.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3999999999999998e-07 2024-09-14T09:08:46.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693352+0000", 2024-09-14T09:08:46.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0470000000000001e-06 2024-09-14T09:08:46.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693355+0000", 2024-09-14T09:08:46.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8320000000000002e-06 2024-09-14T09:08:46.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693358+0000", 2024-09-14T09:08:46.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5270000000000001e-06 2024-09-14T09:08:46.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738104+0000", 2024-09-14T09:08:46.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044746459000000002 2024-09-14T09:08:46.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738194+0000", 2024-09-14T09:08:46.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0062999999999995e-05 2024-09-14T09:08:46.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738288+0000", 2024-09-14T09:08:46.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3704999999999998e-05 2024-09-14T09:08:46.646 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.646 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.646 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.647 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9685 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2654208~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.647 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.693377+0000", 2024-09-14T09:08:46.647 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.9144073040000009, 2024-09-14T09:08:46.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045136784999999999, 2024-09-14T09:08:46.647 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.647 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.647 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.647 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.647 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.647 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.647 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9685 2024-09-14T09:08:46.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.647 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693377+0000", 2024-09-14T09:08:46.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693377+0000", 2024-09-14T09:08:46.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693378+0000", 2024-09-14T09:08:46.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8500000000000002e-07 2024-09-14T09:08:46.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693379+0000", 2024-09-14T09:08:46.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.387e-06 2024-09-14T09:08:46.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693383+0000", 2024-09-14T09:08:46.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3699999999999999e-06 2024-09-14T09:08:46.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693385+0000", 2024-09-14T09:08:46.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5469999999999999e-06 2024-09-14T09:08:46.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738329+0000", 2024-09-14T09:08:46.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044943603999999998 2024-09-14T09:08:46.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738414+0000", 2024-09-14T09:08:46.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4763000000000001e-05 2024-09-14T09:08:46.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738514+0000", 2024-09-14T09:08:46.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000100629 2024-09-14T09:08:46.650 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.650 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.651 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.651 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9686 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2715648~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.651 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.693389+0000", 2024-09-14T09:08:46.651 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.9143962190000003, 2024-09-14T09:08:46.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045314315000000001, 2024-09-14T09:08:46.651 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.651 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.651 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.651 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.651 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.651 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.651 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9686 2024-09-14T09:08:46.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.652 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693389+0000", 2024-09-14T09:08:46.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693389+0000", 2024-09-14T09:08:46.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693389+0000", 2024-09-14T09:08:46.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9499999999999998e-07 2024-09-14T09:08:46.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693390+0000", 2024-09-14T09:08:46.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0410000000000001e-06 2024-09-14T09:08:46.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693393+0000", 2024-09-14T09:08:46.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.774e-06 2024-09-14T09:08:46.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693395+0000", 2024-09-14T09:08:46.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.475e-06 2024-09-14T09:08:46.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738539+0000", 2024-09-14T09:08:46.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045143902999999999 2024-09-14T09:08:46.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738613+0000", 2024-09-14T09:08:46.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4410000000000001e-05 2024-09-14T09:08:46.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738703+0000", 2024-09-14T09:08:46.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9417000000000001e-05 2024-09-14T09:08:46.655 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.655 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.655 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.655 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9687 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2777088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.655 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.693398+0000", 2024-09-14T09:08:46.655 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.9143865380000005, 2024-09-14T09:08:46.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045501822999999997, 2024-09-14T09:08:46.656 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.656 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.656 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.656 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.656 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.656 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.656 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9687 2024-09-14T09:08:46.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.656 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693398+0000", 2024-09-14T09:08:46.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693398+0000", 2024-09-14T09:08:46.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694375+0000", 2024-09-14T09:08:46.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00097630899999999997 2024-09-14T09:08:46.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694377+0000", 2024-09-14T09:08:46.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.108e-06 2024-09-14T09:08:46.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694382+0000", 2024-09-14T09:08:46.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9679999999999997e-06 2024-09-14T09:08:46.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694385+0000", 2024-09-14T09:08:46.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2040000000000002e-06 2024-09-14T09:08:46.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738732+0000", 2024-09-14T09:08:46.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044346974999999997 2024-09-14T09:08:46.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738809+0000", 2024-09-14T09:08:46.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7174000000000003e-05 2024-09-14T09:08:46.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738900+0000", 2024-09-14T09:08:46.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1085e-05 2024-09-14T09:08:46.659 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.659 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.659 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.660 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9688 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2838528~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.660 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694390+0000", 2024-09-14T09:08:46.660 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.9133943020000004, 2024-09-14T09:08:46.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044706231999999999, 2024-09-14T09:08:46.660 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.660 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.660 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.660 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.660 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.660 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.660 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9688 2024-09-14T09:08:46.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.660 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694390+0000", 2024-09-14T09:08:46.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694390+0000", 2024-09-14T09:08:46.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694391+0000", 2024-09-14T09:08:46.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.41e-07 2024-09-14T09:08:46.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694392+0000", 2024-09-14T09:08:46.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1090000000000001e-06 2024-09-14T09:08:46.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694397+0000", 2024-09-14T09:08:46.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.293e-06 2024-09-14T09:08:46.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694400+0000", 2024-09-14T09:08:46.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8909999999999999e-06 2024-09-14T09:08:46.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738930+0000", 2024-09-14T09:08:46.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044529812000000002 2024-09-14T09:08:46.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739011+0000", 2024-09-14T09:08:46.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1143999999999994e-05 2024-09-14T09:08:46.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739097+0000", 2024-09-14T09:08:46.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5741999999999993e-05 2024-09-14T09:08:46.663 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.664 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.664 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.664 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9689 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2899968~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.664 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694403+0000", 2024-09-14T09:08:46.664 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.9133814769999997, 2024-09-14T09:08:46.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044887095000000002, 2024-09-14T09:08:46.664 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.664 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.664 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.665 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.665 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9689 2024-09-14T09:08:46.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.665 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694403+0000", 2024-09-14T09:08:46.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694403+0000", 2024-09-14T09:08:46.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694404+0000", 2024-09-14T09:08:46.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.77e-07 2024-09-14T09:08:46.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694408+0000", 2024-09-14T09:08:46.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0010000000000003e-06 2024-09-14T09:08:46.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694412+0000", 2024-09-14T09:08:46.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0500000000000002e-06 2024-09-14T09:08:46.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694414+0000", 2024-09-14T09:08:46.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7300000000000001e-06 2024-09-14T09:08:46.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739126+0000", 2024-09-14T09:08:46.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044711199 2024-09-14T09:08:46.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739205+0000", 2024-09-14T09:08:46.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8926999999999998e-05 2024-09-14T09:08:46.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739290+0000", 2024-09-14T09:08:46.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5810999999999995e-05 2024-09-14T09:08:46.668 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.668 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.668 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.668 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9690 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2961408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.668 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694418+0000", 2024-09-14T09:08:46.668 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.9133669169999994, 2024-09-14T09:08:46.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045014599000000002, 2024-09-14T09:08:46.669 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.669 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.669 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.669 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.669 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.669 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.669 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9690 2024-09-14T09:08:46.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.669 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694418+0000", 2024-09-14T09:08:46.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694418+0000", 2024-09-14T09:08:46.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694418+0000", 2024-09-14T09:08:46.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.05e-07 2024-09-14T09:08:46.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694419+0000", 2024-09-14T09:08:46.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0890000000000001e-06 2024-09-14T09:08:46.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694422+0000", 2024-09-14T09:08:46.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.802e-06 2024-09-14T09:08:46.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694424+0000", 2024-09-14T09:08:46.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.497e-06 2024-09-14T09:08:46.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739328+0000", 2024-09-14T09:08:46.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044903699999999998 2024-09-14T09:08:46.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739375+0000", 2024-09-14T09:08:46.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7265000000000002e-05 2024-09-14T09:08:46.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739432+0000", 2024-09-14T09:08:46.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7040999999999998e-05 2024-09-14T09:08:46.672 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.673 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.673 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.673 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9691 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 3022848~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.673 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694427+0000", 2024-09-14T09:08:46.673 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.9133573439999996, 2024-09-14T09:08:46.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045238403000000003, 2024-09-14T09:08:46.673 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.673 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.673 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.673 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.673 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.673 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.674 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9691 2024-09-14T09:08:46.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.674 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694427+0000", 2024-09-14T09:08:46.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694427+0000", 2024-09-14T09:08:46.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694428+0000", 2024-09-14T09:08:46.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.05e-07 2024-09-14T09:08:46.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694429+0000", 2024-09-14T09:08:46.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6700000000000002e-07 2024-09-14T09:08:46.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694432+0000", 2024-09-14T09:08:46.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8940000000000002e-06 2024-09-14T09:08:46.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694434+0000", 2024-09-14T09:08:46.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5009999999999999e-06 2024-09-14T09:08:46.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739479+0000", 2024-09-14T09:08:46.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045044806999999999 2024-09-14T09:08:46.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739568+0000", 2024-09-14T09:08:46.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9061999999999995e-05 2024-09-14T09:08:46.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739666+0000", 2024-09-14T09:08:46.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7967000000000006e-05 2024-09-14T09:08:46.677 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.677 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.677 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.677 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9692 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 3084288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.677 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694437+0000", 2024-09-14T09:08:46.677 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.9133478820000001, 2024-09-14T09:08:46.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045365111999999999, 2024-09-14T09:08:46.677 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.678 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.678 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.678 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.678 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.678 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.678 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9692 2024-09-14T09:08:46.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.678 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694437+0000", 2024-09-14T09:08:46.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694437+0000", 2024-09-14T09:08:46.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694437+0000", 2024-09-14T09:08:46.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8999999999999998e-07 2024-09-14T09:08:46.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694438+0000", 2024-09-14T09:08:46.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0249999999999999e-06 2024-09-14T09:08:46.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694441+0000", 2024-09-14T09:08:46.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.835e-06 2024-09-14T09:08:46.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694443+0000", 2024-09-14T09:08:46.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4329999999999998e-06 2024-09-14T09:08:46.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739699+0000", 2024-09-14T09:08:46.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045255457999999998 2024-09-14T09:08:46.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739746+0000", 2024-09-14T09:08:46.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7132000000000002e-05 2024-09-14T09:08:46.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739802+0000", 2024-09-14T09:08:46.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5939000000000001e-05 2024-09-14T09:08:46.681 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.681 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.681 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.682 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9693 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 3145728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.682 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694446+0000", 2024-09-14T09:08:46.682 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.9133385539999992, 2024-09-14T09:08:46.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045601007999999998, 2024-09-14T09:08:46.682 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.682 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.682 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.682 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.682 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.682 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.682 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9693 2024-09-14T09:08:46.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.682 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694446+0000", 2024-09-14T09:08:46.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694446+0000", 2024-09-14T09:08:46.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694446+0000", 2024-09-14T09:08:46.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1e-07 2024-09-14T09:08:46.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694447+0000", 2024-09-14T09:08:46.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9099999999999991e-07 2024-09-14T09:08:46.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694450+0000", 2024-09-14T09:08:46.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8049999999999998e-06 2024-09-14T09:08:46.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694453+0000", 2024-09-14T09:08:46.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4480000000000001e-06 2024-09-14T09:08:46.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739854+0000", 2024-09-14T09:08:46.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045401336 2024-09-14T09:08:46.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739942+0000", 2024-09-14T09:08:46.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8339999999999998e-05 2024-09-14T09:08:46.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.740047+0000", 2024-09-14T09:08:46.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010487799999999999 2024-09-14T09:08:46.686 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.686 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.686 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.686 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9694 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 3207168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.686 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694456+0000", 2024-09-14T09:08:46.686 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.9133292589999993, 2024-09-14T09:08:46.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045779780999999999, 2024-09-14T09:08:46.686 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.686 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.687 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.687 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.687 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.687 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.687 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9694 2024-09-14T09:08:46.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.687 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694456+0000", 2024-09-14T09:08:46.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694456+0000", 2024-09-14T09:08:46.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699125+0000", 2024-09-14T09:08:46.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046694359999999999 2024-09-14T09:08:46.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699127+0000", 2024-09-14T09:08:46.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.996e-06 2024-09-14T09:08:46.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699132+0000", 2024-09-14T09:08:46.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1970000000000004e-06 2024-09-14T09:08:46.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699136+0000", 2024-09-14T09:08:46.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3419999999999999e-06 2024-09-14T09:08:46.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.740084+0000", 2024-09-14T09:08:46.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040948311000000001 2024-09-14T09:08:46.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.740147+0000", 2024-09-14T09:08:46.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.368e-05 2024-09-14T09:08:46.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.740235+0000", 2024-09-14T09:08:46.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7818999999999994e-05 2024-09-14T09:08:46.690 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.690 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.690 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.691 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9748 3.10 3:0e07f4ad:::rbd_data.111219b19df.00000000000001c6:head [set-alloc-hint object_size 524288 write_size 524288,write 413696~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.691 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.699380+0000", 2024-09-14T09:08:46.691 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.908404655, 2024-09-14T09:08:46.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045171442999999999, 2024-09-14T09:08:46.691 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.691 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.691 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:46.691 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.691 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.691 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.691 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9748 2024-09-14T09:08:46.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.691 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699380+0000", 2024-09-14T09:08:46.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699380+0000", 2024-09-14T09:08:46.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699380+0000", 2024-09-14T09:08:46.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2000000000000001e-07 2024-09-14T09:08:46.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699386+0000", 2024-09-14T09:08:46.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9390000000000002e-06 2024-09-14T09:08:46.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699390+0000", 2024-09-14T09:08:46.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.32e-06 2024-09-14T09:08:46.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699392+0000", 2024-09-14T09:08:46.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5019999999999999e-06 2024-09-14T09:08:46.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.743265+0000", 2024-09-14T09:08:46.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.043872479999999998 2024-09-14T09:08:46.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.743387+0000", 2024-09-14T09:08:46.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012264 2024-09-14T09:08:46.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:46.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.743546+0000", 2024-09-14T09:08:46.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000158369 2024-09-14T09:08:46.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:46.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744431+0000", 2024-09-14T09:08:46.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00088561900000000003 2024-09-14T09:08:46.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:46.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744449+0000", 2024-09-14T09:08:46.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8096000000000001e-05 2024-09-14T09:08:46.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:46.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744504+0000", 2024-09-14T09:08:46.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4837999999999999e-05 2024-09-14T09:08:46.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744552+0000", 2024-09-14T09:08:46.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7420000000000003e-05 2024-09-14T09:08:46.696 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.696 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.696 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.696 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9766 3.10 3:0e07f4ad:::rbd_data.111219b19df.00000000000001c6:head [read 409600~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:46.697 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.699552+0000", 2024-09-14T09:08:46.697 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.9082323189999997, 2024-09-14T09:08:46.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045179127999999999, 2024-09-14T09:08:46.697 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:46.697 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:46.697 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:46.697 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:46.697 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:46.697 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:46.697 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9766 2024-09-14T09:08:46.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.698 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:46.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:46.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699552+0000", 2024-09-14T09:08:46.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:46.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699552+0000", 2024-09-14T09:08:46.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:46.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:46.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699553+0000", 2024-09-14T09:08:46.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0200000000000003e-07 2024-09-14T09:08:46.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:46.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699555+0000", 2024-09-14T09:08:46.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.844e-06 2024-09-14T09:08:46.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:46.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699561+0000", 2024-09-14T09:08:46.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0859999999999998e-06 2024-09-14T09:08:46.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:46.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699567+0000", 2024-09-14T09:08:46.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8619999999999999e-06 2024-09-14T09:08:46.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744017+0000", 2024-09-14T09:08:46.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044450311999999999 2024-09-14T09:08:46.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for rw locks", 2024-09-14T09:08:46.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744054+0000", 2024-09-14T09:08:46.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6910999999999999e-05 2024-09-14T09:08:46.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:46.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744581+0000", 2024-09-14T09:08:46.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00052667899999999995 2024-09-14T09:08:46.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:46.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744639+0000", 2024-09-14T09:08:46.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8310999999999998e-05 2024-09-14T09:08:46.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:46.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:46.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:46.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744732+0000", 2024-09-14T09:08:46.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2720999999999995e-05 2024-09-14T09:08:46.701 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.701 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.701 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.701 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:46.702 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:46.702 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:46.703 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:08:46.704 INFO:teuthology.orchestra.run.smithi116.stdout:1.0 2024-09-14T09:08:46.704 INFO:teuthology.orchestra.run.smithi116.stdout:2.0 2024-09-14T09:08:46.704 INFO:teuthology.orchestra.run.smithi116.stdout:3.14 2024-09-14T09:08:46.704 INFO:teuthology.orchestra.run.smithi116.stdout:3.2 2024-09-14T09:08:46.704 INFO:teuthology.orchestra.run.smithi116.stdout:2.3 2024-09-14T09:08:46.704 INFO:teuthology.orchestra.run.smithi116.stdout:3.1d 2024-09-14T09:08:46.704 INFO:teuthology.orchestra.run.smithi116.stdout:3.0 2024-09-14T09:08:46.704 INFO:teuthology.orchestra.run.smithi116.stdout:3.5 2024-09-14T09:08:46.704 INFO:teuthology.orchestra.run.smithi116.stdout:3.13 2024-09-14T09:08:46.704 INFO:teuthology.orchestra.run.smithi116.stdout:3.3 2024-09-14T09:08:46.704 INFO:teuthology.orchestra.run.smithi116.stdout:3.9 2024-09-14T09:08:46.705 INFO:teuthology.orchestra.run.smithi116.stdout:3.e 2024-09-14T09:08:46.705 INFO:teuthology.orchestra.run.smithi116.stdout:3.f 2024-09-14T09:08:46.705 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:46.705+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:46.799 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T09:08:46.804 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:46.807+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:46.822 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:46.822 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:46.823 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:46.823 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:46.831 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:08:46.905 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:46.907+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:46.911 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --op export --pgid 3.f --file /var/log/ceph/exp.3.f.2 2024-09-14T09:08:46.940 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:08:46.980 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:46.980 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:46.980 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:46.980 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:46.980 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:46.989 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:08:47.032 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:47.034+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:47.072 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:47.072 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:47.089 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:47.089 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:47.090 INFO:teuthology.orchestra.run.smithi116.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-14T09:08:47.095 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:47.095 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:47.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:47.096 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:47.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.096 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:246 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:47.096 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:08:47.096 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.300105998999999, 2024-09-14T09:08:47.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99004581000000003, 2024-09-14T09:08:47.096 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:47.096 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:47.096 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:47.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:47.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:47.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:47.096 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 246 2024-09-14T09:08:47.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.097 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:47.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:47.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:08:47.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:47.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:08:47.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:47.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796750+0000", 2024-09-14T09:08:47.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5519999999999999e-06 2024-09-14T09:08:47.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:47.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796754+0000", 2024-09-14T09:08:47.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2640000000000002e-06 2024-09-14T09:08:47.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:47.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796767+0000", 2024-09-14T09:08:47.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3517e-05 2024-09-14T09:08:47.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:47.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796775+0000", 2024-09-14T09:08:47.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8790000000000003e-06 2024-09-14T09:08:47.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796830+0000", 2024-09-14T09:08:47.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4829e-05 2024-09-14T09:08:47.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:47.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796843+0000", 2024-09-14T09:08:47.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.33e-05 2024-09-14T09:08:47.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786501+0000", 2024-09-14T09:08:47.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98965769299999995 2024-09-14T09:08:47.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:47.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786653+0000", 2024-09-14T09:08:47.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015237200000000001 2024-09-14T09:08:47.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:47.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786794+0000", 2024-09-14T09:08:47.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014040400000000001 2024-09-14T09:08:47.100 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.100 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:47.101 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.101 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:247 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 720896~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:47.101 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:47.101 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.300051213, 2024-09-14T09:08:47.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99048688100000004, 2024-09-14T09:08:47.101 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:47.101 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:47.101 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:47.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:47.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:47.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:47.101 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 247 2024-09-14T09:08:47.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.102 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:47.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:47.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:47.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:47.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:47.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:47.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:47.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7299999999999995e-07 2024-09-14T09:08:47.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:47.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796807+0000", 2024-09-14T09:08:47.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.106e-06 2024-09-14T09:08:47.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:47.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796815+0000", 2024-09-14T09:08:47.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4740000000000005e-06 2024-09-14T09:08:47.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:47.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796821+0000", 2024-09-14T09:08:47.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0469999999999999e-06 2024-09-14T09:08:47.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796872+0000", 2024-09-14T09:08:47.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0834000000000002e-05 2024-09-14T09:08:47.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:47.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796878+0000", 2024-09-14T09:08:47.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2990000000000002e-06 2024-09-14T09:08:47.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787176+0000", 2024-09-14T09:08:47.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99029817600000003 2024-09-14T09:08:47.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:47.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787225+0000", 2024-09-14T09:08:47.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8953999999999999e-05 2024-09-14T09:08:47.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:47.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787290+0000", 2024-09-14T09:08:47.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4318000000000003e-05 2024-09-14T09:08:47.105 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.105 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:47.105 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.106 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:248 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1179648~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:47.106 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:08:47.106 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.300020694000001, 2024-09-14T09:08:47.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99060754200000001, 2024-09-14T09:08:47.106 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:47.106 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:47.106 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:47.106 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:47.106 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:47.106 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:47.106 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 248 2024-09-14T09:08:47.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.106 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:47.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:47.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:08:47.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:47.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:08:47.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:47.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796834+0000", 2024-09-14T09:08:47.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4099999999999999e-07 2024-09-14T09:08:47.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:47.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796837+0000", 2024-09-14T09:08:47.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8459999999999999e-06 2024-09-14T09:08:47.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:47.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796844+0000", 2024-09-14T09:08:47.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1350000000000003e-06 2024-09-14T09:08:47.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:47.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796850+0000", 2024-09-14T09:08:47.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7139999999999998e-06 2024-09-14T09:08:47.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:47.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3909999999999998e-05 2024-09-14T09:08:47.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:47.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796899+0000", 2024-09-14T09:08:47.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7649999999999999e-06 2024-09-14T09:08:47.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787318+0000", 2024-09-14T09:08:47.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99041848300000002 2024-09-14T09:08:47.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:47.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787365+0000", 2024-09-14T09:08:47.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7086999999999998e-05 2024-09-14T09:08:47.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:47.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787441+0000", 2024-09-14T09:08:47.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6061000000000002e-05 2024-09-14T09:08:47.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.110 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:47.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.110 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:249 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1638400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:47.111 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:08:47.111 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.299986925000001, 2024-09-14T09:08:47.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99070346899999995, 2024-09-14T09:08:47.111 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:47.111 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:47.111 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:47.111 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:47.111 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:47.111 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:47.111 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 249 2024-09-14T09:08:47.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.111 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:47.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:47.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:08:47.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:47.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:08:47.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:47.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796868+0000", 2024-09-14T09:08:47.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2024-09-14T09:08:47.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:47.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796870+0000", 2024-09-14T09:08:47.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7889999999999999e-06 2024-09-14T09:08:47.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:47.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796877+0000", 2024-09-14T09:08:47.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8549999999999996e-06 2024-09-14T09:08:47.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:47.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796883+0000", 2024-09-14T09:08:47.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.665e-06 2024-09-14T09:08:47.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796915+0000", 2024-09-14T09:08:47.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2215999999999998e-05 2024-09-14T09:08:47.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:47.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796920+0000", 2024-09-14T09:08:47.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.527e-06 2024-09-14T09:08:47.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787468+0000", 2024-09-14T09:08:47.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99054877100000005 2024-09-14T09:08:47.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:47.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787512+0000", 2024-09-14T09:08:47.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3958000000000002e-05 2024-09-14T09:08:47.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:47.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787571+0000", 2024-09-14T09:08:47.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8167000000000001e-05 2024-09-14T09:08:47.115 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.115 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:47.115 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.115 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:250 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2097152~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:47.116 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:47.116 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.299960859, 2024-09-14T09:08:47.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99079431100000004, 2024-09-14T09:08:47.116 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:47.116 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:47.116 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:47.116 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:47.116 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:47.116 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:47.116 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 250 2024-09-14T09:08:47.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.116 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:47.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:47.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:47.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:47.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:47.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:47.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796894+0000", 2024-09-14T09:08:47.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2024-09-14T09:08:47.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:47.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796896+0000", 2024-09-14T09:08:47.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5600000000000001e-06 2024-09-14T09:08:47.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:47.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796902+0000", 2024-09-14T09:08:47.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3090000000000001e-06 2024-09-14T09:08:47.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:47.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796909+0000", 2024-09-14T09:08:47.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:08:47.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796942+0000", 2024-09-14T09:08:47.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-05 2024-09-14T09:08:47.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:47.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796948+0000", 2024-09-14T09:08:47.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5910000000000001e-06 2024-09-14T09:08:47.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787596+0000", 2024-09-14T09:08:47.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99064781400000002 2024-09-14T09:08:47.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:47.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787636+0000", 2024-09-14T09:08:47.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9715000000000002e-05 2024-09-14T09:08:47.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:47.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787687+0000", 2024-09-14T09:08:47.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1674e-05 2024-09-14T09:08:47.121 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.121 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:47.121 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.121 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:251 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:47.121 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:47.122 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.299935423999999, 2024-09-14T09:08:47.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99091769600000001, 2024-09-14T09:08:47.122 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:47.122 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:47.122 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:47.122 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:47.122 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:47.122 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:47.122 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 251 2024-09-14T09:08:47.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.122 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:47.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:47.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:47.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:47.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:47.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:47.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:47.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000005e-07 2024-09-14T09:08:47.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:47.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796922+0000", 2024-09-14T09:08:47.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.875e-06 2024-09-14T09:08:47.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:47.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796929+0000", 2024-09-14T09:08:47.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0260000000000002e-06 2024-09-14T09:08:47.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:47.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796935+0000", 2024-09-14T09:08:47.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7030000000000003e-06 2024-09-14T09:08:47.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796963+0000", 2024-09-14T09:08:47.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8368999999999999e-05 2024-09-14T09:08:47.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:47.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796966+0000", 2024-09-14T09:08:47.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4130000000000002e-06 2024-09-14T09:08:47.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787718+0000", 2024-09-14T09:08:47.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99075151100000003 2024-09-14T09:08:47.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:47.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787779+0000", 2024-09-14T09:08:47.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.088e-05 2024-09-14T09:08:47.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:47.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787836+0000", 2024-09-14T09:08:47.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7380000000000003e-05 2024-09-14T09:08:47.127 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.127 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:47.127 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.127 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:252 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:47.127 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:08:47.127 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.29990997, 2024-09-14T09:08:47.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99102491400000003, 2024-09-14T09:08:47.128 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:47.128 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:47.128 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:47.128 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:47.128 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:47.128 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:47.128 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 252 2024-09-14T09:08:47.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.128 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:47.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:47.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:08:47.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:47.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:08:47.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:47.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796945+0000", 2024-09-14T09:08:47.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2900000000000003e-07 2024-09-14T09:08:47.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:47.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796947+0000", 2024-09-14T09:08:47.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4279999999999999e-06 2024-09-14T09:08:47.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:47.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796954+0000", 2024-09-14T09:08:47.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5479999999999998e-06 2024-09-14T09:08:47.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:47.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796959+0000", 2024-09-14T09:08:47.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.22e-06 2024-09-14T09:08:47.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796988+0000", 2024-09-14T09:08:47.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9473000000000001e-05 2024-09-14T09:08:47.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:47.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:08:47.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:08:47.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787850+0000", 2024-09-14T09:08:47.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99085651100000005 2024-09-14T09:08:47.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:47.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787891+0000", 2024-09-14T09:08:47.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602000000000002e-05 2024-09-14T09:08:47.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:47.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787969+0000", 2024-09-14T09:08:47.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8063000000000001e-05 2024-09-14T09:08:47.132 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.132 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:47.133 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.133 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:253 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:47.133 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:47.133 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.299886089999999, 2024-09-14T09:08:47.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99122695699999996, 2024-09-14T09:08:47.133 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:47.133 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:47.133 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:47.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:47.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:47.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:47.134 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 253 2024-09-14T09:08:47.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.134 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:47.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:47.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:47.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:47.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:47.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:47.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:47.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:08:47.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:47.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:08:47.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:08:47.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:47.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796977+0000", 2024-09-14T09:08:47.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5030000000000002e-06 2024-09-14T09:08:47.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:47.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796982+0000", 2024-09-14T09:08:47.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2024-09-14T09:08:47.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797013+0000", 2024-09-14T09:08:47.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0451e-05 2024-09-14T09:08:47.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:47.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:08:47.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1690000000000001e-06 2024-09-14T09:08:47.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788011+0000", 2024-09-14T09:08:47.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99099490300000004 2024-09-14T09:08:47.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:47.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788102+0000", 2024-09-14T09:08:47.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0730999999999996e-05 2024-09-14T09:08:47.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:47.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788195+0000", 2024-09-14T09:08:47.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3245999999999995e-05 2024-09-14T09:08:47.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.138 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:47.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.138 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:254 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3932160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:47.138 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:08:47.138 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.299854531999999, 2024-09-14T09:08:47.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99137410500000001, 2024-09-14T09:08:47.139 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:47.139 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:47.139 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:47.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:47.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:47.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:47.139 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 254 2024-09-14T09:08:47.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.139 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:47.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:47.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:08:47.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:47.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:08:47.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:47.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797000+0000", 2024-09-14T09:08:47.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:08:47.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:47.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797003+0000", 2024-09-14T09:08:47.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7659999999999999e-06 2024-09-14T09:08:47.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:47.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797010+0000", 2024-09-14T09:08:47.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.029e-06 2024-09-14T09:08:47.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:47.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:08:47.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2024-09-14T09:08:47.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797044+0000", 2024-09-14T09:08:47.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9213e-05 2024-09-14T09:08:47.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:47.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797048+0000", 2024-09-14T09:08:47.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3400000000000002e-06 2024-09-14T09:08:47.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788222+0000", 2024-09-14T09:08:47.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99117407400000002 2024-09-14T09:08:47.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:47.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788306+0000", 2024-09-14T09:08:47.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4512999999999995e-05 2024-09-14T09:08:47.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:47.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788374+0000", 2024-09-14T09:08:47.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7226999999999999e-05 2024-09-14T09:08:47.145 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.145 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:47.145 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.146 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:264 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:47.146 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:47.146 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.299828174, 2024-09-14T09:08:47.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99161474699999996, 2024-09-14T09:08:47.146 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:47.147 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:47.147 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:47.147 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:47.147 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:47.147 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:47.147 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 264 2024-09-14T09:08:47.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.148 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:47.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:47.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:47.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:47.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:47.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:47.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:47.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2024-09-14T09:08:47.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:47.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:08:47.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2800000000000002e-06 2024-09-14T09:08:47.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:47.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:08:47.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0979999999999999e-06 2024-09-14T09:08:47.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:47.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797040+0000", 2024-09-14T09:08:47.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:08:47.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797068+0000", 2024-09-14T09:08:47.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7302999999999999e-05 2024-09-14T09:08:47.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:47.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797071+0000", 2024-09-14T09:08:47.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3610000000000001e-06 2024-09-14T09:08:47.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788436+0000", 2024-09-14T09:08:47.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99136489500000002 2024-09-14T09:08:47.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:47.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788538+0000", 2024-09-14T09:08:47.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101931 2024-09-14T09:08:47.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:47.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788641+0000", 2024-09-14T09:08:47.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010273899999999999 2024-09-14T09:08:47.157 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.157 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:47.157 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.158 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:265 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:47.158 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:08:47.158 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.299804815, 2024-09-14T09:08:47.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99176878199999996, 2024-09-14T09:08:47.158 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:47.159 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:47.159 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:47.159 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:47.159 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:47.159 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:47.159 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 265 2024-09-14T09:08:47.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.160 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:47.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:47.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:08:47.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:47.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:08:47.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:47.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:08:47.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.39e-07 2024-09-14T09:08:47.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:47.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797052+0000", 2024-09-14T09:08:47.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.345e-06 2024-09-14T09:08:47.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:47.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797058+0000", 2024-09-14T09:08:47.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5429999999999999e-06 2024-09-14T09:08:47.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:47.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797064+0000", 2024-09-14T09:08:47.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2000000000000002e-06 2024-09-14T09:08:47.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797091+0000", 2024-09-14T09:08:47.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7804e-05 2024-09-14T09:08:47.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:47.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797095+0000", 2024-09-14T09:08:47.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2024-09-14T09:08:47.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788667+0000", 2024-09-14T09:08:47.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157211300000003 2024-09-14T09:08:47.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:47.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788742+0000", 2024-09-14T09:08:47.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5159000000000003e-05 2024-09-14T09:08:47.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:47.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788818+0000", 2024-09-14T09:08:47.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6038000000000006e-05 2024-09-14T09:08:47.169 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.169 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:47.169 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.169 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:266 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:47.169 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:47.169 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.299781983999999, 2024-09-14T09:08:47.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99193390100000001, 2024-09-14T09:08:47.169 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:47.169 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:47.169 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:47.170 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:47.170 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:47.170 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:47.170 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 266 2024-09-14T09:08:47.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.170 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:47.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:47.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:47.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:47.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:47.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:47.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:47.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:08:47.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:47.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797075+0000", 2024-09-14T09:08:47.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2570000000000002e-06 2024-09-14T09:08:47.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:47.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797082+0000", 2024-09-14T09:08:47.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8029999999999997e-06 2024-09-14T09:08:47.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:47.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797088+0000", 2024-09-14T09:08:47.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.468e-06 2024-09-14T09:08:47.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797116+0000", 2024-09-14T09:08:47.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7752000000000001e-05 2024-09-14T09:08:47.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:47.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797121+0000", 2024-09-14T09:08:47.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5960000000000003e-06 2024-09-14T09:08:47.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788846+0000", 2024-09-14T09:08:47.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99172512199999996 2024-09-14T09:08:47.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:47.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788916+0000", 2024-09-14T09:08:47.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9843000000000002e-05 2024-09-14T09:08:47.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:47.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789006+0000", 2024-09-14T09:08:47.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9608e-05 2024-09-14T09:08:47.174 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.174 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:47.174 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.174 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:267 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:47.175 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:47.175 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.299757177, 2024-09-14T09:08:47.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99210926799999999, 2024-09-14T09:08:47.175 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:47.175 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:47.175 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:47.175 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:47.175 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:47.175 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:47.175 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 267 2024-09-14T09:08:47.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.175 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:47.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:47.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:47.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:47.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:47.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:47.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:47.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2399999999999999e-07 2024-09-14T09:08:47.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:47.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797099+0000", 2024-09-14T09:08:47.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.091e-06 2024-09-14T09:08:47.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:47.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797105+0000", 2024-09-14T09:08:47.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-09-14T09:08:47.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:47.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797111+0000", 2024-09-14T09:08:47.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5130000000000004e-06 2024-09-14T09:08:47.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797140+0000", 2024-09-14T09:08:47.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9513999999999999e-05 2024-09-14T09:08:47.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:47.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797145+0000", 2024-09-14T09:08:47.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:08:47.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789037+0000", 2024-09-14T09:08:47.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99189253899999996 2024-09-14T09:08:47.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:47.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789110+0000", 2024-09-14T09:08:47.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2848000000000005e-05 2024-09-14T09:08:47.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:47.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789206+0000", 2024-09-14T09:08:47.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5778000000000004e-05 2024-09-14T09:08:47.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.180 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:47.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.180 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:268 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:47.180 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:47.180 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.299733937999999, 2024-09-14T09:08:47.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992276359, 2024-09-14T09:08:47.180 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:47.180 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:47.180 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:47.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:47.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:47.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:47.181 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 268 2024-09-14T09:08:47.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.181 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:47.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:47.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:47.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:47.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:47.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:47.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:47.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:08:47.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:47.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797123+0000", 2024-09-14T09:08:47.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2740000000000002e-06 2024-09-14T09:08:47.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:47.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797129+0000", 2024-09-14T09:08:47.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-06 2024-09-14T09:08:47.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:47.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797134+0000", 2024-09-14T09:08:47.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9099999999999996e-06 2024-09-14T09:08:47.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797163+0000", 2024-09-14T09:08:47.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9709999999999998e-05 2024-09-14T09:08:47.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:47.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:47.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8709999999999999e-06 2024-09-14T09:08:47.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789231+0000", 2024-09-14T09:08:47.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992063959 2024-09-14T09:08:47.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:47.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789306+0000", 2024-09-14T09:08:47.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5289000000000004e-05 2024-09-14T09:08:47.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:47.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789396+0000", 2024-09-14T09:08:47.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9939999999999996e-05 2024-09-14T09:08:47.185 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.185 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:47.185 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.185 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:269 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2457600~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:47.185 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:47.185 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.299710428999999, 2024-09-14T09:08:47.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99242174400000005, 2024-09-14T09:08:47.185 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:47.185 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:47.186 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:47.186 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:47.186 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:47.186 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:47.186 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 269 2024-09-14T09:08:47.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.186 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:47.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:47.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:47.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:47.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:47.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:47.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:47.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:08:47.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:47.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797146+0000", 2024-09-14T09:08:47.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5289999999999998e-06 2024-09-14T09:08:47.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:47.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797153+0000", 2024-09-14T09:08:47.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1920000000000002e-06 2024-09-14T09:08:47.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:47.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797158+0000", 2024-09-14T09:08:47.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099999999999998e-06 2024-09-14T09:08:47.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797188+0000", 2024-09-14T09:08:47.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0128e-05 2024-09-14T09:08:47.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:47.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797194+0000", 2024-09-14T09:08:47.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6250000000000004e-06 2024-09-14T09:08:47.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789439+0000", 2024-09-14T09:08:47.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99224531000000005 2024-09-14T09:08:47.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:47.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789489+0000", 2024-09-14T09:08:47.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9830000000000002e-05 2024-09-14T09:08:47.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:47.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789565+0000", 2024-09-14T09:08:47.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6229000000000005e-05 2024-09-14T09:08:47.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.190 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:47.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.190 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:270 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:47.190 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:47.190 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.299686607, 2024-09-14T09:08:47.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99257721899999996, 2024-09-14T09:08:47.190 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:47.190 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:47.190 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:47.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:47.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:47.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:47.191 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 270 2024-09-14T09:08:47.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.191 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:47.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:47.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:47.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:47.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:47.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:47.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797168+0000", 2024-09-14T09:08:47.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2024-09-14T09:08:47.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:47.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797170+0000", 2024-09-14T09:08:47.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3120000000000001e-06 2024-09-14T09:08:47.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:47.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797177+0000", 2024-09-14T09:08:47.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0960000000000003e-06 2024-09-14T09:08:47.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:47.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797183+0000", 2024-09-14T09:08:47.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1669999999999998e-06 2024-09-14T09:08:47.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797213+0000", 2024-09-14T09:08:47.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0494e-05 2024-09-14T09:08:47.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:47.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:08:47.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:08:47.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789586+0000", 2024-09-14T09:08:47.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99236692100000001 2024-09-14T09:08:47.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:47.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789658+0000", 2024-09-14T09:08:47.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2279000000000004e-05 2024-09-14T09:08:47.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:47.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789745+0000", 2024-09-14T09:08:47.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6698000000000002e-05 2024-09-14T09:08:47.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.195 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:47.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.195 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:271 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3375104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:47.195 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:47.195 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.299661409, 2024-09-14T09:08:47.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99274791699999998, 2024-09-14T09:08:47.195 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:47.195 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:47.195 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:47.196 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:47.196 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:47.196 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:47.196 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 271 2024-09-14T09:08:47.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.196 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:47.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:47.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:47.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:47.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:47.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:47.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:47.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:08:47.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:47.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797195+0000", 2024-09-14T09:08:47.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1639999999999999e-06 2024-09-14T09:08:47.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:47.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797201+0000", 2024-09-14T09:08:47.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1290000000000001e-06 2024-09-14T09:08:47.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:47.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797206+0000", 2024-09-14T09:08:47.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9300000000000002e-06 2024-09-14T09:08:47.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797237+0000", 2024-09-14T09:08:47.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1285000000000003e-05 2024-09-14T09:08:47.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:47.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797242+0000", 2024-09-14T09:08:47.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6e-06 2024-09-14T09:08:47.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789768+0000", 2024-09-14T09:08:47.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99252547400000002 2024-09-14T09:08:47.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:47.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789826+0000", 2024-09-14T09:08:47.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8155999999999997e-05 2024-09-14T09:08:47.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:47.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789940+0000", 2024-09-14T09:08:47.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114788 2024-09-14T09:08:47.201 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.201 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:47.201 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.201 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:272 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:47.201 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:47.202 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.299638014999999, 2024-09-14T09:08:47.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99285248800000003, 2024-09-14T09:08:47.202 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:47.202 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:47.202 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:47.202 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:47.202 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:47.202 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:47.203 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 272 2024-09-14T09:08:47.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.203 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:47.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:47.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:47.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:47.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:47.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:47.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:47.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:08:47.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:47.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:08:47.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5129999999999999e-06 2024-09-14T09:08:47.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:47.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797226+0000", 2024-09-14T09:08:47.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4529999999999996e-06 2024-09-14T09:08:47.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:47.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797232+0000", 2024-09-14T09:08:47.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1839999999999998e-06 2024-09-14T09:08:47.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797264+0000", 2024-09-14T09:08:47.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2691999999999998e-05 2024-09-14T09:08:47.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:47.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797270+0000", 2024-09-14T09:08:47.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-06 2024-09-14T09:08:47.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789965+0000", 2024-09-14T09:08:47.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99269526200000002 2024-09-14T09:08:47.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:47.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790021+0000", 2024-09-14T09:08:47.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5297000000000003e-05 2024-09-14T09:08:47.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:47.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790068+0000", 2024-09-14T09:08:47.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7664999999999998e-05 2024-09-14T09:08:47.209 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.209 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:47.210 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.210 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5006.0:4897 3.1b 3:dc4939f3:::rbd_object_map.11125497cb52:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-14T09:08:47.210 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:45.922622+0000", 2024-09-14T09:08:47.210 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.174231759, 2024-09-14T09:08:47.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011994009, 2024-09-14T09:08:47.210 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:47.211 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:47.211 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:47.211 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:47.211 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5006", 2024-09-14T09:08:47.211 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/3107765484", 2024-09-14T09:08:47.211 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4897 2024-09-14T09:08:47.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.211 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:47.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:47.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922622+0000", 2024-09-14T09:08:47.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:47.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922622+0000", 2024-09-14T09:08:47.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:47.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922623+0000", 2024-09-14T09:08:47.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2999999999999999e-07 2024-09-14T09:08:47.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:47.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922628+0000", 2024-09-14T09:08:47.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.459e-06 2024-09-14T09:08:47.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:47.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922639+0000", 2024-09-14T09:08:47.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1099e-05 2024-09-14T09:08:47.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:47.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922650+0000", 2024-09-14T09:08:47.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1695999999999999e-05 2024-09-14T09:08:47.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.925576+0000", 2024-09-14T09:08:47.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002925839 2024-09-14T09:08:47.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:47.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.925628+0000", 2024-09-14T09:08:47.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1536000000000003e-05 2024-09-14T09:08:47.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:47.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.925833+0000", 2024-09-14T09:08:47.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00020529000000000001 2024-09-14T09:08:47.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:47.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.927960+0000", 2024-09-14T09:08:47.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021266169999999999 2024-09-14T09:08:47.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:47.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934526+0000", 2024-09-14T09:08:47.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006566293 2024-09-14T09:08:47.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:47.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934576+0000", 2024-09-14T09:08:47.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0022000000000003e-05 2024-09-14T09:08:47.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:47.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934616+0000", 2024-09-14T09:08:47.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0228000000000002e-05 2024-09-14T09:08:47.216 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.217 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:47.217 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.217 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5006.0:4898 3.1b 3:dc4939f3:::rbd_object_map.11125497cb52:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-14T09:08:47.217 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:45.923037+0000", 2024-09-14T09:08:47.217 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1738165170000001, 2024-09-14T09:08:47.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011707255, 2024-09-14T09:08:47.217 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:47.217 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:47.218 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:47.218 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:47.218 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5006", 2024-09-14T09:08:47.218 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/3107765484", 2024-09-14T09:08:47.218 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4898 2024-09-14T09:08:47.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.218 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:47.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:47.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923037+0000", 2024-09-14T09:08:47.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:47.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923037+0000", 2024-09-14T09:08:47.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:47.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:47.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923038+0000", 2024-09-14T09:08:47.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5199999999999996e-07 2024-09-14T09:08:47.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:47.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923045+0000", 2024-09-14T09:08:47.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9280000000000004e-06 2024-09-14T09:08:47.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:47.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923052+0000", 2024-09-14T09:08:47.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0180000000000004e-06 2024-09-14T09:08:47.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:47.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923057+0000", 2024-09-14T09:08:47.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5970000000000002e-06 2024-09-14T09:08:47.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:47.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.926369+0000", 2024-09-14T09:08:47.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003312204 2024-09-14T09:08:47.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:47.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.926458+0000", 2024-09-14T09:08:47.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8682000000000002e-05 2024-09-14T09:08:47.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:47.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.926817+0000", 2024-09-14T09:08:47.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00035913200000000002 2024-09-14T09:08:47.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:47.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.928477+0000", 2024-09-14T09:08:47.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016600250000000001 2024-09-14T09:08:47.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:47.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934653+0000", 2024-09-14T09:08:47.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061763089999999996 2024-09-14T09:08:47.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:47.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934706+0000", 2024-09-14T09:08:47.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2475000000000002e-05 2024-09-14T09:08:47.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:47.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:47.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:47.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934745+0000", 2024-09-14T09:08:47.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9133e-05 2024-09-14T09:08:47.223 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.223 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:47.223 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.223 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:47.223 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:47.223 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:47.224 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:47.225 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:47.226 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:47.226 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:47.227 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:08:47.227 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:47.227+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:47.227 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:47.228 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T09:08:47.228 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:47.228 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T09:08:47.325 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:47.327+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:47.342 INFO:teuthology.orchestra.run.smithi116.stderr:Exporting 3.f info 3.f( v 65'185 (0'0,65'185] local-lis/les=66/67 n=28 ec=22/22 lis/c=66/66 les/c/f=67/67/0 sis=66) 2024-09-14T09:08:47.344 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f02c87af:::rbd_data.11123620c885.000000000000036c:12# 2024-09-14T09:08:47.344 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f02c87af:::rbd_data.11123620c885.000000000000036c:head# 2024-09-14T09:08:47.344 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f08fb0a9:::rbd_data.111232b23a18.0000000000000072:head# 2024-09-14T09:08:47.345 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f0c988e9:::rbd_data.111219b19df.000000000000002f:head# 2024-09-14T09:08:47.346 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f13def0a:::rbd_id.image_client.0-clone8:head# 2024-09-14T09:08:47.346 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f244351a:::rbd_data.111213dcc65d.000000000000000c:head# 2024-09-14T09:08:47.346 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f29ed170:::rbd_data.111219b19df.00000000000001b2:head# 2024-09-14T09:08:47.347 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f359f5dd:::rbd_data.111219b19df.000000000000014f:head# 2024-09-14T09:08:47.347 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f3ef26b9:::rbd_data.11126408a170.000000000000024e:head# 2024-09-14T09:08:47.347 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f450d1a6:::rbd_data.111232b23a18.000000000000002e:head# 2024-09-14T09:08:47.347 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f48173b0:::rbd_data.111232b23a18.0000000000000041:head# 2024-09-14T09:08:47.348 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f4c685dd:::rbd_data.111219b19df.000000000000010e:head# 2024-09-14T09:08:47.353 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f555927d:::rbd_data.111219b19df.0000000000000152:head# 2024-09-14T09:08:47.353 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f5656382:::rbd_data.11128e9202c2.000000000000000b:d# 2024-09-14T09:08:47.353 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f5656382:::rbd_data.11128e9202c2.000000000000000b:head# 2024-09-14T09:08:47.353 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f56dfae4:::rbd_data.11128e9202c2.0000000000000008:d# 2024-09-14T09:08:47.353 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f56dfae4:::rbd_data.11128e9202c2.0000000000000008:head# 2024-09-14T09:08:47.353 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f5706fb4:::rbd_data.1112ca7492e7.0000000000000022:b# 2024-09-14T09:08:47.354 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f5706fb4:::rbd_data.1112ca7492e7.0000000000000022:head# 2024-09-14T09:08:47.354 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f5a4a317:::rbd_data.111219b19df.0000000000000011:head# 2024-09-14T09:08:47.354 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f6215976:::rbd_object_map.1112609a9334.000000000000000c:head# 2024-09-14T09:08:47.354 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f62910e4:::rbd_data.11128e9202c2.0000000000000005:d# 2024-09-14T09:08:47.354 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f62910e4:::rbd_data.11128e9202c2.0000000000000005:head# 2024-09-14T09:08:47.354 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f63ff947:::rbd_data.11126408a170.00000000000000ac:head# 2024-09-14T09:08:47.355 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f69daed4:::rbd_data.111219b19df.00000000000001a9:head# 2024-09-14T09:08:47.355 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f6ec14b2:::rbd_data.1112ca7492e7.0000000000000026:b# 2024-09-14T09:08:47.355 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f6ec14b2:::rbd_data.1112ca7492e7.0000000000000026:head# 2024-09-14T09:08:47.355 INFO:teuthology.orchestra.run.smithi116.stderr:Read #3:f766b40e:::rbd_data.111232b23a18.0000000000000044:head# 2024-09-14T09:08:47.355 INFO:teuthology.orchestra.run.smithi116.stderr:Export successful 2024-09-14T09:08:47.371 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:47.371 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:47.380 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:08:47.426 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:47.428+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:47.483 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:47.484 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:47.492 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:08:47.534 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:47.536+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:47.619 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --force --op remove --pgid 3.f 2024-09-14T09:08:47.627 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:47.629+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:47.635 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:47.635 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:47.644 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:08:47.728 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:47.730+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:47.787 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:47.787 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:47.796 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:08:47.804 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is set 2024-09-14T09:08:47.815 INFO:teuthology.orchestra.run.smithi148.stdout:4056 punch from 0x389fa00 to 0x38a0e00, (0x1400 bytes) 2024-09-14T09:08:47.825 INFO:teuthology.orchestra.run.smithi148.stdout:4058 trunc from 0x9876c00 to 0xb9b5000 2024-09-14T09:08:47.837 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:47.839+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:47.857 INFO:teuthology.orchestra.run.smithi148.stdout:4059 write 0xe4dd000 thru 0xe4e92ae (0xc2af bytes) 2024-09-14T09:08:47.857 INFO:teuthology.orchestra.run.smithi148.stdout:4060 read 0xc3e7a00 thru 0xc3f615c (0xe75d bytes) 2024-09-14T09:08:47.857 INFO:teuthology.orchestra.run.smithi148.stdout:4061 punch from 0xcef0200 to 0xcef0a00, (0x800 bytes) 2024-09-14T09:08:47.858 INFO:teuthology.orchestra.run.smithi148.stdout:4064 write 0x62b4200 thru 0x62b8b96 (0x4997 bytes) 2024-09-14T09:08:47.858 INFO:teuthology.orchestra.run.smithi148.stdout:4065 read 0x6c2f600 thru 0x6c34692 (0x5093 bytes) 2024-09-14T09:08:47.858 INFO:teuthology.orchestra.run.smithi148.stdout:4067 write 0xcd84200 thru 0xcd87cd9 (0x3ada bytes) 2024-09-14T09:08:47.859 INFO:teuthology.orchestra.run.smithi148.stdout:4068 read 0x5c53200 thru 0x5c58c0a (0x5a0b bytes) 2024-09-14T09:08:47.859 INFO:teuthology.orchestra.run.smithi148.stdout:4069 trunc from 0xe4e9400 to 0xdef8e00 2024-09-14T09:08:47.902 INFO:teuthology.orchestra.run.smithi148.stdout:4070 write 0xe87aa00 thru 0xe889df1 (0xf3f2 bytes) 2024-09-14T09:08:47.903 INFO:teuthology.orchestra.run.smithi148.stdout:4072 write 0xc207600 thru 0xc20f724 (0x8125 bytes) 2024-09-14T09:08:47.903 INFO:teuthology.orchestra.run.smithi148.stdout:4074 write 0x35bdc00 thru 0x35c6bde (0x8fdf bytes) 2024-09-14T09:08:47.903 INFO:teuthology.orchestra.run.smithi148.stdout:4075 flatten 2024-09-14T09:08:47.930 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:47.932+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:47.983 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:47.984 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:47.998 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:08:48.031 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:48.033+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:48.132 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:48.134+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:48.210 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:48.210 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:48.221 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:08:48.262 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:48.264+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:48.333 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:48.335+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:48.334 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:48.335 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:48.344 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:08:48.434 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:48.435+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:48.460 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:48.460 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:48.470 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:08:48.535 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:48.537+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:48.617 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:48.617 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:48.627 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:08:48.670 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:48.672+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:48.736 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:48.737 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:48.737 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:48.739+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:48.744 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:08:48.775 INFO:teuthology.orchestra.run.smithi148.stdout:4076 write 0x68f5a00 thru 0x6900d9e (0xb39f bytes) 2024-09-14T09:08:48.775 INFO:teuthology.orchestra.run.smithi148.stdout:4077 trunc from 0xe889e00 to 0xe6d1200 2024-09-14T09:08:48.802 INFO:teuthology.orchestra.run.smithi148.stdout:4078 trunc from 0xe6d1200 to 0x9c66e00 2024-09-14T09:08:48.826 INFO:teuthology.orchestra.run.smithi148.stdout:4079 read 0x924d400 thru 0x9255d2c (0x892d bytes) 2024-09-14T09:08:48.838 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:48.840+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:48.841 INFO:teuthology.orchestra.run.smithi148.stdout:4080 write 0xd3fc000 thru 0xd400f2e (0x4f2f bytes) 2024-09-14T09:08:48.842 INFO:teuthology.orchestra.run.smithi148.stdout:4081 punch from 0x3a46a00 to 0x3a48400, (0x1a00 bytes) 2024-09-14T09:08:48.855 INFO:teuthology.orchestra.run.smithi148.stdout:4082 trunc from 0xd401000 to 0x346d400 2024-09-14T09:08:48.900 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:48.900 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:48.907 INFO:teuthology.orchestra.run.smithi148.stdout:4085 write 0xb2f2c00 thru 0xb2f68b1 (0x3cb2 bytes) 2024-09-14T09:08:48.909 INFO:teuthology.orchestra.run.smithi148.stdout:4086 punch from 0x8b4f200 to 0x8b50a00, (0x1800 bytes) 2024-09-14T09:08:48.910 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:08:48.917 INFO:teuthology.orchestra.run.smithi148.stdout:4087 trunc from 0xb2f6a00 to 0x4b1fc00 2024-09-14T09:08:48.933 INFO:teuthology.orchestra.run.smithi148.stdout:4090 punch from 0x1106c00 to 0x110e600, (0x7a00 bytes) 2024-09-14T09:08:48.936 INFO:teuthology.orchestra.run.smithi148.stdout:4091 trunc from 0x4b1fc00 to 0x57e0600 2024-09-14T09:08:48.939 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:48.941+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:48.960 INFO:teuthology.orchestra.run.smithi148.stdout:4093 write 0x1e5f800 thru 0x1e61386 (0x1b87 bytes) 2024-09-14T09:08:48.961 INFO:teuthology.orchestra.run.smithi148.stdout:4095 write 0x137c000 thru 0x1387fb9 (0xbfba bytes) 2024-09-14T09:08:48.970 INFO:teuthology.orchestra.run.smithi148.stdout:4096 trunc from 0x57e0600 to 0xd298200 2024-09-14T09:08:48.989 INFO:teuthology.orchestra.run.smithi148.stdout:4097 punch from 0xb196a00 to 0xb19c600, (0x5c00 bytes) 2024-09-14T09:08:48.991 INFO:teuthology.orchestra.run.smithi148.stdout:4098 write 0x4ab5c00 thru 0x4abfa34 (0x9e35 bytes) 2024-09-14T09:08:48.991 INFO:teuthology.orchestra.run.smithi148.stdout:4100 write 0x476a00 thru 0x47c4da (0x5adb bytes) 2024-09-14T09:08:48.993 INFO:teuthology.orchestra.run.smithi148.stdout:4101 write 0x988ea00 thru 0x9897af5 (0x90f6 bytes) 2024-09-14T09:08:48.993 INFO:teuthology.orchestra.run.smithi148.stdout:4102 write 0x5877800 thru 0x58850bc (0xd8bd bytes) 2024-09-14T09:08:48.993 INFO:teuthology.orchestra.run.smithi148.stdout:4103 read 0xc9fae00 thru 0xc9ff8b7 (0x4ab8 bytes) 2024-09-14T09:08:48.993 INFO:teuthology.orchestra.run.smithi148.stdout:4104 read 0x2831e00 thru 0x2839a12 (0x7c13 bytes) 2024-09-14T09:08:48.993 INFO:teuthology.orchestra.run.smithi148.stdout:4105 punch from 0x507b200 to 0x5083c00, (0x8a00 bytes) 2024-09-14T09:08:48.994 INFO:teuthology.orchestra.run.smithi148.stdout:4106 read 0xac7e400 thru 0xac8991a (0xb51b bytes) 2024-09-14T09:08:48.994 INFO:teuthology.orchestra.run.smithi148.stdout:4108 write 0x1515c00 thru 0x152180a (0xbc0b bytes) 2024-09-14T09:08:48.994 INFO:teuthology.orchestra.run.smithi148.stdout:4109 read 0x38cd400 thru 0x38dc81f (0xf420 bytes) 2024-09-14T09:08:48.995 INFO:teuthology.orchestra.run.smithi148.stdout:4110 read 0x1014600 thru 0x1020b72 (0xc573 bytes) 2024-09-14T09:08:48.996 INFO:teuthology.orchestra.run.smithi148.stdout:4112 trunc from 0xd298200 to 0xd1a7800 2024-09-14T09:08:49.019 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:49.019 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:49.026 INFO:teuthology.orchestra.run.smithi148.stdout:4114 read 0xb6f600 thru 0xb7c1f8 (0xcbf9 bytes) 2024-09-14T09:08:49.028 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:08:49.029 INFO:teuthology.orchestra.run.smithi148.stdout:4115 punch from 0xc772e00 to 0xc782c00, (0xfe00 bytes) 2024-09-14T09:08:49.029 INFO:teuthology.orchestra.run.smithi148.stdout:4117 punch from 0x707be00 to 0x708ae00, (0xf000 bytes) 2024-09-14T09:08:49.029 INFO:teuthology.orchestra.run.smithi148.stdout:4121 read 0xa42600 thru 0xa519d6 (0xf3d7 bytes) 2024-09-14T09:08:49.049 INFO:teuthology.orchestra.run.smithi148.stdout:4123 write 0xe6ba200 thru 0xe6c4bf5 (0xa9f6 bytes) 2024-09-14T09:08:49.065 INFO:teuthology.orchestra.run.smithi148.stdout:4127 trunc from 0xe6c4c00 to 0x5d04000 2024-09-14T09:08:49.074 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:49.076+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:49.097 INFO:teuthology.orchestra.run.smithi148.stdout:4128 write 0x2c90800 thru 0x2c9dd44 (0xd545 bytes) 2024-09-14T09:08:49.102 INFO:teuthology.orchestra.run.smithi148.stdout:4129 read 0x1ab8800 thru 0x1abeda9 (0x65aa bytes) 2024-09-14T09:08:49.126 INFO:teuthology.orchestra.run.smithi148.stdout:4130 write 0xb6de000 thru 0xb6de25a (0x25b bytes) 2024-09-14T09:08:49.141 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:49.143+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:49.142 INFO:teuthology.orchestra.run.smithi148.stdout:4133 write 0xe367e00 thru 0xe36a51e (0x271f bytes) 2024-09-14T09:08:49.142 INFO:teuthology.orchestra.run.smithi148.stdout:4136 write 0x5355000 thru 0x5355efb (0xefc bytes) 2024-09-14T09:08:49.143 INFO:teuthology.orchestra.run.smithi148.stdout:4139 read 0x8454000 thru 0x845afc0 (0x6fc1 bytes) 2024-09-14T09:08:49.143 INFO:teuthology.orchestra.run.smithi148.stdout:4140 read 0x380d800 thru 0x38198a6 (0xc0a7 bytes) 2024-09-14T09:08:49.144 INFO:teuthology.orchestra.run.smithi148.stdout:4141 read 0x7ea2600 thru 0x7eaf6a6 (0xd0a7 bytes) 2024-09-14T09:08:49.144 INFO:teuthology.orchestra.run.smithi148.stdout:4142 write 0x9f8e400 thru 0x9f99f67 (0xbb68 bytes) 2024-09-14T09:08:49.144 INFO:teuthology.orchestra.run.smithi148.stdout:4143 write 0x9d39000 thru 0x9d42827 (0x9828 bytes) 2024-09-14T09:08:49.144 INFO:teuthology.orchestra.run.smithi148.stdout:4144 read 0xd3b8600 thru 0xd3c4197 (0xbb98 bytes) 2024-09-14T09:08:49.144 INFO:teuthology.orchestra.run.smithi148.stdout:4145 read 0xdf31600 thru 0xdf33b57 (0x2558 bytes) 2024-09-14T09:08:49.144 INFO:teuthology.orchestra.run.smithi148.stdout:4146 punch from 0x4fd000 to 0x506e00, (0x9e00 bytes) 2024-09-14T09:08:49.145 INFO:teuthology.orchestra.run.smithi148.stdout:4151 clone 24 order 19 su 262144 sc 7 2024-09-14T09:08:49.149 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:49.150 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:49.162 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:08:49.229 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:08:49.247 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:49.249+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:49.306 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:49.306 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:49.314 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:08:49.349 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:49.349 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:49.356 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:49.358+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:49.367 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:49.367 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:49.367 INFO:teuthology.orchestra.run.smithi116.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-14T09:08:49.384 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:49.384 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:49.401 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:49.401 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:49.417 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:49.418 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:49.420 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T09:08:49.421 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T09:08:49.444 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:49.446+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:49.461 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:49.461 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:49.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:49.462 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:49.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.462 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:246 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:49.462 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:08:49.463 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.665424955999999, 2024-09-14T09:08:49.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99004581000000003, 2024-09-14T09:08:49.463 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:49.463 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:49.463 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:49.463 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:49.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:49.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:49.464 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 246 2024-09-14T09:08:49.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.464 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:49.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:49.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:08:49.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:49.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:08:49.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:49.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796750+0000", 2024-09-14T09:08:49.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5519999999999999e-06 2024-09-14T09:08:49.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:49.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796754+0000", 2024-09-14T09:08:49.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2640000000000002e-06 2024-09-14T09:08:49.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:49.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796767+0000", 2024-09-14T09:08:49.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3517e-05 2024-09-14T09:08:49.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:49.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796775+0000", 2024-09-14T09:08:49.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8790000000000003e-06 2024-09-14T09:08:49.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796830+0000", 2024-09-14T09:08:49.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4829e-05 2024-09-14T09:08:49.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:49.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796843+0000", 2024-09-14T09:08:49.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.33e-05 2024-09-14T09:08:49.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786501+0000", 2024-09-14T09:08:49.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98965769299999995 2024-09-14T09:08:49.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:49.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786653+0000", 2024-09-14T09:08:49.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015237200000000001 2024-09-14T09:08:49.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:49.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786794+0000", 2024-09-14T09:08:49.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014040400000000001 2024-09-14T09:08:49.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.474 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:49.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.475 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:247 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 720896~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:49.475 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:49.475 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.665370169999999, 2024-09-14T09:08:49.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99048688100000004, 2024-09-14T09:08:49.475 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:49.476 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:49.476 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:49.476 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:49.476 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:49.476 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:49.476 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 247 2024-09-14T09:08:49.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.477 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:49.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:49.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:49.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:49.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:49.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:49.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:49.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7299999999999995e-07 2024-09-14T09:08:49.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:49.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796807+0000", 2024-09-14T09:08:49.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.106e-06 2024-09-14T09:08:49.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:49.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796815+0000", 2024-09-14T09:08:49.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4740000000000005e-06 2024-09-14T09:08:49.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:49.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796821+0000", 2024-09-14T09:08:49.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0469999999999999e-06 2024-09-14T09:08:49.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796872+0000", 2024-09-14T09:08:49.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0834000000000002e-05 2024-09-14T09:08:49.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:49.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796878+0000", 2024-09-14T09:08:49.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2990000000000002e-06 2024-09-14T09:08:49.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787176+0000", 2024-09-14T09:08:49.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99029817600000003 2024-09-14T09:08:49.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:49.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787225+0000", 2024-09-14T09:08:49.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8953999999999999e-05 2024-09-14T09:08:49.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:49.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787290+0000", 2024-09-14T09:08:49.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4318000000000003e-05 2024-09-14T09:08:49.484 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.485 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:49.485 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.485 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:248 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1179648~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:49.485 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:08:49.485 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.665339651, 2024-09-14T09:08:49.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99060754200000001, 2024-09-14T09:08:49.485 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:49.485 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:49.485 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:49.485 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:49.485 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:49.486 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:49.486 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 248 2024-09-14T09:08:49.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.486 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:49.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:49.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:08:49.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:49.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:08:49.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:49.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796834+0000", 2024-09-14T09:08:49.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4099999999999999e-07 2024-09-14T09:08:49.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:49.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796837+0000", 2024-09-14T09:08:49.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8459999999999999e-06 2024-09-14T09:08:49.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:49.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796844+0000", 2024-09-14T09:08:49.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1350000000000003e-06 2024-09-14T09:08:49.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:49.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796850+0000", 2024-09-14T09:08:49.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7139999999999998e-06 2024-09-14T09:08:49.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:49.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3909999999999998e-05 2024-09-14T09:08:49.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:49.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796899+0000", 2024-09-14T09:08:49.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7649999999999999e-06 2024-09-14T09:08:49.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787318+0000", 2024-09-14T09:08:49.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99041848300000002 2024-09-14T09:08:49.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:49.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787365+0000", 2024-09-14T09:08:49.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7086999999999998e-05 2024-09-14T09:08:49.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:49.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787441+0000", 2024-09-14T09:08:49.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6061000000000002e-05 2024-09-14T09:08:49.490 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.490 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:49.490 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.490 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:249 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1638400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:49.491 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:08:49.491 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.665305881999998, 2024-09-14T09:08:49.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99070346899999995, 2024-09-14T09:08:49.491 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:49.491 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:49.491 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:49.491 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:49.491 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:49.491 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:49.491 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 249 2024-09-14T09:08:49.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.491 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:49.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:49.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:08:49.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:49.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:08:49.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:49.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796868+0000", 2024-09-14T09:08:49.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2024-09-14T09:08:49.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:49.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796870+0000", 2024-09-14T09:08:49.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7889999999999999e-06 2024-09-14T09:08:49.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:49.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796877+0000", 2024-09-14T09:08:49.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8549999999999996e-06 2024-09-14T09:08:49.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:49.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796883+0000", 2024-09-14T09:08:49.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.665e-06 2024-09-14T09:08:49.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796915+0000", 2024-09-14T09:08:49.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2215999999999998e-05 2024-09-14T09:08:49.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:49.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796920+0000", 2024-09-14T09:08:49.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.527e-06 2024-09-14T09:08:49.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787468+0000", 2024-09-14T09:08:49.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99054877100000005 2024-09-14T09:08:49.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:49.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787512+0000", 2024-09-14T09:08:49.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3958000000000002e-05 2024-09-14T09:08:49.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:49.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787571+0000", 2024-09-14T09:08:49.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8167000000000001e-05 2024-09-14T09:08:49.495 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.495 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:49.495 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.496 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:250 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2097152~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:49.496 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:49.496 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.665279816000002, 2024-09-14T09:08:49.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99079431100000004, 2024-09-14T09:08:49.496 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:49.496 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:49.496 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:49.496 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:49.496 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:49.496 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:49.496 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 250 2024-09-14T09:08:49.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.496 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:49.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:49.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:49.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:49.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:49.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:49.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796894+0000", 2024-09-14T09:08:49.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2024-09-14T09:08:49.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:49.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796896+0000", 2024-09-14T09:08:49.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5600000000000001e-06 2024-09-14T09:08:49.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:49.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796902+0000", 2024-09-14T09:08:49.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3090000000000001e-06 2024-09-14T09:08:49.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:49.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796909+0000", 2024-09-14T09:08:49.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:08:49.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796942+0000", 2024-09-14T09:08:49.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-05 2024-09-14T09:08:49.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:49.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796948+0000", 2024-09-14T09:08:49.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5910000000000001e-06 2024-09-14T09:08:49.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787596+0000", 2024-09-14T09:08:49.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99064781400000002 2024-09-14T09:08:49.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:49.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787636+0000", 2024-09-14T09:08:49.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9715000000000002e-05 2024-09-14T09:08:49.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:49.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787687+0000", 2024-09-14T09:08:49.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1674e-05 2024-09-14T09:08:49.500 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.500 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:49.500 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.500 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:251 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:49.501 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:49.501 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.665254381, 2024-09-14T09:08:49.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99091769600000001, 2024-09-14T09:08:49.501 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:49.501 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:49.501 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:49.501 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:49.501 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:49.501 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:49.501 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 251 2024-09-14T09:08:49.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.501 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:49.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:49.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:49.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:49.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:49.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:49.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:49.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000005e-07 2024-09-14T09:08:49.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:49.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796922+0000", 2024-09-14T09:08:49.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.875e-06 2024-09-14T09:08:49.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:49.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796929+0000", 2024-09-14T09:08:49.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0260000000000002e-06 2024-09-14T09:08:49.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:49.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796935+0000", 2024-09-14T09:08:49.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7030000000000003e-06 2024-09-14T09:08:49.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796963+0000", 2024-09-14T09:08:49.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8368999999999999e-05 2024-09-14T09:08:49.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:49.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796966+0000", 2024-09-14T09:08:49.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4130000000000002e-06 2024-09-14T09:08:49.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787718+0000", 2024-09-14T09:08:49.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99075151100000003 2024-09-14T09:08:49.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:49.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787779+0000", 2024-09-14T09:08:49.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.088e-05 2024-09-14T09:08:49.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:49.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787836+0000", 2024-09-14T09:08:49.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7380000000000003e-05 2024-09-14T09:08:49.506 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.506 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:49.506 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.506 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:252 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:49.506 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:08:49.506 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.665228927000001, 2024-09-14T09:08:49.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99102491400000003, 2024-09-14T09:08:49.506 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:49.506 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:49.506 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:49.507 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:49.507 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:49.507 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:49.507 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 252 2024-09-14T09:08:49.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.507 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:49.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:49.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:08:49.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:49.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:08:49.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:49.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796945+0000", 2024-09-14T09:08:49.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2900000000000003e-07 2024-09-14T09:08:49.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:49.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796947+0000", 2024-09-14T09:08:49.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4279999999999999e-06 2024-09-14T09:08:49.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:49.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796954+0000", 2024-09-14T09:08:49.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5479999999999998e-06 2024-09-14T09:08:49.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:49.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796959+0000", 2024-09-14T09:08:49.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.22e-06 2024-09-14T09:08:49.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796988+0000", 2024-09-14T09:08:49.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9473000000000001e-05 2024-09-14T09:08:49.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:49.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:08:49.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:08:49.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787850+0000", 2024-09-14T09:08:49.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99085651100000005 2024-09-14T09:08:49.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:49.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787891+0000", 2024-09-14T09:08:49.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602000000000002e-05 2024-09-14T09:08:49.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:49.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787969+0000", 2024-09-14T09:08:49.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8063000000000001e-05 2024-09-14T09:08:49.511 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.511 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:49.511 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.511 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:253 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:49.511 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:49.511 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.665205047000001, 2024-09-14T09:08:49.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99122695699999996, 2024-09-14T09:08:49.511 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:49.511 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:49.511 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:49.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:49.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:49.512 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:49.512 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 253 2024-09-14T09:08:49.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.512 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:49.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:49.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:49.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:49.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:49.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:49.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:49.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:08:49.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:49.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:08:49.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:08:49.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:49.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796977+0000", 2024-09-14T09:08:49.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5030000000000002e-06 2024-09-14T09:08:49.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:49.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796982+0000", 2024-09-14T09:08:49.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2024-09-14T09:08:49.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797013+0000", 2024-09-14T09:08:49.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0451e-05 2024-09-14T09:08:49.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:49.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:08:49.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1690000000000001e-06 2024-09-14T09:08:49.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788011+0000", 2024-09-14T09:08:49.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99099490300000004 2024-09-14T09:08:49.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:49.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788102+0000", 2024-09-14T09:08:49.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0730999999999996e-05 2024-09-14T09:08:49.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:49.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788195+0000", 2024-09-14T09:08:49.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3245999999999995e-05 2024-09-14T09:08:49.516 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.516 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:49.516 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.517 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:254 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3932160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:49.517 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:08:49.517 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.665173489000001, 2024-09-14T09:08:49.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99137410500000001, 2024-09-14T09:08:49.517 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:49.517 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:49.517 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:49.517 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:49.517 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:49.517 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:49.517 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 254 2024-09-14T09:08:49.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.518 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:49.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:49.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:08:49.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:49.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:08:49.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:49.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797000+0000", 2024-09-14T09:08:49.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:08:49.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:49.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797003+0000", 2024-09-14T09:08:49.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7659999999999999e-06 2024-09-14T09:08:49.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:49.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797010+0000", 2024-09-14T09:08:49.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.029e-06 2024-09-14T09:08:49.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:49.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:08:49.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2024-09-14T09:08:49.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797044+0000", 2024-09-14T09:08:49.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9213e-05 2024-09-14T09:08:49.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:49.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797048+0000", 2024-09-14T09:08:49.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3400000000000002e-06 2024-09-14T09:08:49.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788222+0000", 2024-09-14T09:08:49.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99117407400000002 2024-09-14T09:08:49.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:49.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788306+0000", 2024-09-14T09:08:49.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4512999999999995e-05 2024-09-14T09:08:49.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:49.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788374+0000", 2024-09-14T09:08:49.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7226999999999999e-05 2024-09-14T09:08:49.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.522 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:49.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.523 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:264 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:49.523 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:49.523 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.665147131000001, 2024-09-14T09:08:49.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99161474699999996, 2024-09-14T09:08:49.523 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:49.523 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:49.523 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:49.523 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:49.523 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:49.523 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:49.523 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 264 2024-09-14T09:08:49.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.523 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:49.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:49.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:49.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:49.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:49.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:49.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:49.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2024-09-14T09:08:49.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:49.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:08:49.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2800000000000002e-06 2024-09-14T09:08:49.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:49.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:08:49.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0979999999999999e-06 2024-09-14T09:08:49.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:49.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797040+0000", 2024-09-14T09:08:49.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:08:49.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797068+0000", 2024-09-14T09:08:49.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7302999999999999e-05 2024-09-14T09:08:49.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:49.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797071+0000", 2024-09-14T09:08:49.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3610000000000001e-06 2024-09-14T09:08:49.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788436+0000", 2024-09-14T09:08:49.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99136489500000002 2024-09-14T09:08:49.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:49.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788538+0000", 2024-09-14T09:08:49.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101931 2024-09-14T09:08:49.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:49.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788641+0000", 2024-09-14T09:08:49.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010273899999999999 2024-09-14T09:08:49.528 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.528 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:49.528 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.528 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:265 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:49.528 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:08:49.528 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.665123772000001, 2024-09-14T09:08:49.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99176878199999996, 2024-09-14T09:08:49.529 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:49.529 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:49.529 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:49.529 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:49.529 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:49.529 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:49.529 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 265 2024-09-14T09:08:49.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.529 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:49.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:49.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:08:49.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:49.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:08:49.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:49.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:08:49.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.39e-07 2024-09-14T09:08:49.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:49.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797052+0000", 2024-09-14T09:08:49.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.345e-06 2024-09-14T09:08:49.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:49.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797058+0000", 2024-09-14T09:08:49.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5429999999999999e-06 2024-09-14T09:08:49.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:49.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797064+0000", 2024-09-14T09:08:49.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2000000000000002e-06 2024-09-14T09:08:49.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797091+0000", 2024-09-14T09:08:49.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7804e-05 2024-09-14T09:08:49.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:49.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797095+0000", 2024-09-14T09:08:49.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2024-09-14T09:08:49.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788667+0000", 2024-09-14T09:08:49.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157211300000003 2024-09-14T09:08:49.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:49.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788742+0000", 2024-09-14T09:08:49.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5159000000000003e-05 2024-09-14T09:08:49.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:49.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788818+0000", 2024-09-14T09:08:49.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6038000000000006e-05 2024-09-14T09:08:49.533 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.533 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:49.533 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.534 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:266 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:49.534 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:49.534 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.665100940999999, 2024-09-14T09:08:49.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99193390100000001, 2024-09-14T09:08:49.534 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:49.534 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:49.535 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:49.535 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:49.535 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:49.535 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:49.535 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 266 2024-09-14T09:08:49.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.535 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:49.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:49.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:49.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:49.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:49.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:49.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:49.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:08:49.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:49.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797075+0000", 2024-09-14T09:08:49.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2570000000000002e-06 2024-09-14T09:08:49.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:49.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797082+0000", 2024-09-14T09:08:49.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8029999999999997e-06 2024-09-14T09:08:49.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:49.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797088+0000", 2024-09-14T09:08:49.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.468e-06 2024-09-14T09:08:49.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797116+0000", 2024-09-14T09:08:49.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7752000000000001e-05 2024-09-14T09:08:49.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:49.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797121+0000", 2024-09-14T09:08:49.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5960000000000003e-06 2024-09-14T09:08:49.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788846+0000", 2024-09-14T09:08:49.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99172512199999996 2024-09-14T09:08:49.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:49.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788916+0000", 2024-09-14T09:08:49.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9843000000000002e-05 2024-09-14T09:08:49.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:49.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789006+0000", 2024-09-14T09:08:49.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9608e-05 2024-09-14T09:08:49.539 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.539 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:49.539 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.539 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:267 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:49.539 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:49.539 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.665076134, 2024-09-14T09:08:49.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99210926799999999, 2024-09-14T09:08:49.539 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:49.539 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:49.539 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:49.539 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:49.540 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:49.540 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:49.540 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 267 2024-09-14T09:08:49.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.540 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:49.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:49.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:49.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:49.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:49.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:49.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:49.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2399999999999999e-07 2024-09-14T09:08:49.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:49.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797099+0000", 2024-09-14T09:08:49.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.091e-06 2024-09-14T09:08:49.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:49.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797105+0000", 2024-09-14T09:08:49.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-09-14T09:08:49.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:49.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797111+0000", 2024-09-14T09:08:49.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5130000000000004e-06 2024-09-14T09:08:49.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797140+0000", 2024-09-14T09:08:49.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9513999999999999e-05 2024-09-14T09:08:49.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:49.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797145+0000", 2024-09-14T09:08:49.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:08:49.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789037+0000", 2024-09-14T09:08:49.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99189253899999996 2024-09-14T09:08:49.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:49.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789110+0000", 2024-09-14T09:08:49.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2848000000000005e-05 2024-09-14T09:08:49.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:49.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789206+0000", 2024-09-14T09:08:49.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5778000000000004e-05 2024-09-14T09:08:49.544 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.544 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:49.544 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.544 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:268 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:49.544 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:49.544 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.665052894999999, 2024-09-14T09:08:49.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992276359, 2024-09-14T09:08:49.544 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:49.545 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:49.545 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:49.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:49.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:49.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:49.545 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 268 2024-09-14T09:08:49.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.545 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:49.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:49.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:49.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:49.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:49.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:49.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:49.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:08:49.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:49.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797123+0000", 2024-09-14T09:08:49.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2740000000000002e-06 2024-09-14T09:08:49.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:49.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797129+0000", 2024-09-14T09:08:49.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-06 2024-09-14T09:08:49.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:49.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797134+0000", 2024-09-14T09:08:49.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9099999999999996e-06 2024-09-14T09:08:49.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797163+0000", 2024-09-14T09:08:49.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9709999999999998e-05 2024-09-14T09:08:49.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:49.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:49.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8709999999999999e-06 2024-09-14T09:08:49.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789231+0000", 2024-09-14T09:08:49.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992063959 2024-09-14T09:08:49.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:49.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789306+0000", 2024-09-14T09:08:49.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5289000000000004e-05 2024-09-14T09:08:49.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:49.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789396+0000", 2024-09-14T09:08:49.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9939999999999996e-05 2024-09-14T09:08:49.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.549 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:49.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.549 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:269 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2457600~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:49.549 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:49.549 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.665029386, 2024-09-14T09:08:49.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99242174400000005, 2024-09-14T09:08:49.550 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:49.550 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:49.550 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:49.550 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:49.550 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:49.550 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:49.550 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 269 2024-09-14T09:08:49.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.550 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:49.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:49.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:49.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:49.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:49.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:49.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:49.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:08:49.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:49.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797146+0000", 2024-09-14T09:08:49.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5289999999999998e-06 2024-09-14T09:08:49.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:49.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797153+0000", 2024-09-14T09:08:49.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1920000000000002e-06 2024-09-14T09:08:49.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:49.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797158+0000", 2024-09-14T09:08:49.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099999999999998e-06 2024-09-14T09:08:49.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797188+0000", 2024-09-14T09:08:49.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0128e-05 2024-09-14T09:08:49.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:49.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797194+0000", 2024-09-14T09:08:49.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6250000000000004e-06 2024-09-14T09:08:49.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789439+0000", 2024-09-14T09:08:49.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99224531000000005 2024-09-14T09:08:49.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:49.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789489+0000", 2024-09-14T09:08:49.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9830000000000002e-05 2024-09-14T09:08:49.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:49.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789565+0000", 2024-09-14T09:08:49.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6229000000000005e-05 2024-09-14T09:08:49.554 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.554 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:49.554 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.555 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:270 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:49.555 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:49.555 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.665005564000001, 2024-09-14T09:08:49.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99257721899999996, 2024-09-14T09:08:49.555 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:49.555 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:49.555 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:49.555 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:49.555 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:49.555 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:49.555 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 270 2024-09-14T09:08:49.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.555 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:49.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:49.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:49.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:49.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:49.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:49.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797168+0000", 2024-09-14T09:08:49.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2024-09-14T09:08:49.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:49.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797170+0000", 2024-09-14T09:08:49.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3120000000000001e-06 2024-09-14T09:08:49.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:49.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797177+0000", 2024-09-14T09:08:49.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0960000000000003e-06 2024-09-14T09:08:49.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:49.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797183+0000", 2024-09-14T09:08:49.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1669999999999998e-06 2024-09-14T09:08:49.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797213+0000", 2024-09-14T09:08:49.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0494e-05 2024-09-14T09:08:49.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:49.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:08:49.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:08:49.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789586+0000", 2024-09-14T09:08:49.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99236692100000001 2024-09-14T09:08:49.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:49.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789658+0000", 2024-09-14T09:08:49.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2279000000000004e-05 2024-09-14T09:08:49.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:49.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789745+0000", 2024-09-14T09:08:49.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6698000000000002e-05 2024-09-14T09:08:49.559 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.559 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:49.559 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.559 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:271 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3375104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:49.560 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:49.560 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.664980366000002, 2024-09-14T09:08:49.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99274791699999998, 2024-09-14T09:08:49.560 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:49.560 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:49.560 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:49.560 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:49.560 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:49.560 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:49.560 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 271 2024-09-14T09:08:49.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.561 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:49.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:49.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:49.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:49.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:49.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:49.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:49.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:08:49.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:49.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797195+0000", 2024-09-14T09:08:49.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1639999999999999e-06 2024-09-14T09:08:49.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:49.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797201+0000", 2024-09-14T09:08:49.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1290000000000001e-06 2024-09-14T09:08:49.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:49.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797206+0000", 2024-09-14T09:08:49.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9300000000000002e-06 2024-09-14T09:08:49.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797237+0000", 2024-09-14T09:08:49.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1285000000000003e-05 2024-09-14T09:08:49.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:49.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797242+0000", 2024-09-14T09:08:49.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6e-06 2024-09-14T09:08:49.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789768+0000", 2024-09-14T09:08:49.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99252547400000002 2024-09-14T09:08:49.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:49.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789826+0000", 2024-09-14T09:08:49.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8155999999999997e-05 2024-09-14T09:08:49.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:49.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789940+0000", 2024-09-14T09:08:49.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114788 2024-09-14T09:08:49.564 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.564 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:49.564 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.565 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:272 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:49.565 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:49.565 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.664956971999999, 2024-09-14T09:08:49.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99285248800000003, 2024-09-14T09:08:49.565 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:49.565 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:49.565 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:49.565 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:49.565 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:49.565 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:49.565 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 272 2024-09-14T09:08:49.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.565 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:49.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:49.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:49.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:49.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:49.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:49.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:49.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:08:49.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:49.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:08:49.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5129999999999999e-06 2024-09-14T09:08:49.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:49.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797226+0000", 2024-09-14T09:08:49.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4529999999999996e-06 2024-09-14T09:08:49.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:49.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797232+0000", 2024-09-14T09:08:49.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1839999999999998e-06 2024-09-14T09:08:49.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797264+0000", 2024-09-14T09:08:49.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2691999999999998e-05 2024-09-14T09:08:49.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:49.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797270+0000", 2024-09-14T09:08:49.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-06 2024-09-14T09:08:49.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789965+0000", 2024-09-14T09:08:49.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99269526200000002 2024-09-14T09:08:49.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:49.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790021+0000", 2024-09-14T09:08:49.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5297000000000003e-05 2024-09-14T09:08:49.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:49.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790068+0000", 2024-09-14T09:08:49.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7664999999999998e-05 2024-09-14T09:08:49.569 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.569 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:49.569 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.570 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5006.0:4897 3.1b 3:dc4939f3:::rbd_object_map.11125497cb52:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-14T09:08:49.570 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:45.922622+0000", 2024-09-14T09:08:49.570 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.5395507159999999, 2024-09-14T09:08:49.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011994009, 2024-09-14T09:08:49.570 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:49.570 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:49.570 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:49.570 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:49.570 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5006", 2024-09-14T09:08:49.570 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/3107765484", 2024-09-14T09:08:49.570 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4897 2024-09-14T09:08:49.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.571 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:49.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:49.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922622+0000", 2024-09-14T09:08:49.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:49.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922622+0000", 2024-09-14T09:08:49.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:49.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922623+0000", 2024-09-14T09:08:49.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2999999999999999e-07 2024-09-14T09:08:49.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:49.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922628+0000", 2024-09-14T09:08:49.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.459e-06 2024-09-14T09:08:49.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:49.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922639+0000", 2024-09-14T09:08:49.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1099e-05 2024-09-14T09:08:49.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:49.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922650+0000", 2024-09-14T09:08:49.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1695999999999999e-05 2024-09-14T09:08:49.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.925576+0000", 2024-09-14T09:08:49.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002925839 2024-09-14T09:08:49.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:49.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.925628+0000", 2024-09-14T09:08:49.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1536000000000003e-05 2024-09-14T09:08:49.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:49.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.925833+0000", 2024-09-14T09:08:49.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00020529000000000001 2024-09-14T09:08:49.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:49.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.927960+0000", 2024-09-14T09:08:49.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021266169999999999 2024-09-14T09:08:49.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:49.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934526+0000", 2024-09-14T09:08:49.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006566293 2024-09-14T09:08:49.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:49.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934576+0000", 2024-09-14T09:08:49.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0022000000000003e-05 2024-09-14T09:08:49.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:49.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934616+0000", 2024-09-14T09:08:49.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0228000000000002e-05 2024-09-14T09:08:49.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.575 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:49.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.575 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5006.0:4898 3.1b 3:dc4939f3:::rbd_object_map.11125497cb52:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-14T09:08:49.576 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:45.923037+0000", 2024-09-14T09:08:49.576 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.5391354740000001, 2024-09-14T09:08:49.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011707255, 2024-09-14T09:08:49.576 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:49.576 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:49.576 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:49.576 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:49.576 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5006", 2024-09-14T09:08:49.576 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/3107765484", 2024-09-14T09:08:49.576 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4898 2024-09-14T09:08:49.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.576 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:49.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:49.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923037+0000", 2024-09-14T09:08:49.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:49.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923037+0000", 2024-09-14T09:08:49.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:49.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:49.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923038+0000", 2024-09-14T09:08:49.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5199999999999996e-07 2024-09-14T09:08:49.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:49.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923045+0000", 2024-09-14T09:08:49.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9280000000000004e-06 2024-09-14T09:08:49.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:49.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923052+0000", 2024-09-14T09:08:49.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0180000000000004e-06 2024-09-14T09:08:49.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:49.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923057+0000", 2024-09-14T09:08:49.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5970000000000002e-06 2024-09-14T09:08:49.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:49.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.926369+0000", 2024-09-14T09:08:49.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003312204 2024-09-14T09:08:49.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:49.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.926458+0000", 2024-09-14T09:08:49.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8682000000000002e-05 2024-09-14T09:08:49.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:49.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.926817+0000", 2024-09-14T09:08:49.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00035913200000000002 2024-09-14T09:08:49.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:49.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.928477+0000", 2024-09-14T09:08:49.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016600250000000001 2024-09-14T09:08:49.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:49.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934653+0000", 2024-09-14T09:08:49.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061763089999999996 2024-09-14T09:08:49.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:49.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934706+0000", 2024-09-14T09:08:49.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2475000000000002e-05 2024-09-14T09:08:49.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:49.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:49.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:49.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934745+0000", 2024-09-14T09:08:49.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9133e-05 2024-09-14T09:08:49.581 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.581 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:49.581 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.581 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:49.581 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:49.582 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:49.583 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:08:49.584 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:49.585+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:49.646 INFO:teuthology.orchestra.run.smithi116.stdout: marking collection for removal 2024-09-14T09:08:49.647 INFO:teuthology.orchestra.run.smithi116.stdout:setting '_remove' omap key 2024-09-14T09:08:49.647 INFO:teuthology.orchestra.run.smithi116.stdout:finish_remove_pgs 3.f_head removing 3.f 2024-09-14T09:08:49.649 INFO:teuthology.orchestra.run.smithi116.stdout:Remove successful 2024-09-14T09:08:49.684 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:49.686+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:49.729 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:49.729 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:49.729 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:49.730 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:49.737 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:08:49.818 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T09:08:49.823 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:49.825+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:49.886 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:49.886 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:49.886 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:49.886 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:49.886 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:49.887 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:49.888+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:49.894 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:08:49.987 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:49.988+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:50.042 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:50.042 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:50.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:50.042 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:50.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.042 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5285 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 4370432~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:50.042 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.247472+0000", 2024-09-14T09:08:50.043 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.796213979999999, 2024-09-14T09:08:50.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038449069000000002, 2024-09-14T09:08:50.043 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.043 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.043 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.043 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.043 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:50.043 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:50.043 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5285 2024-09-14T09:08:50.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.043 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247472+0000", 2024-09-14T09:08:50.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247472+0000", 2024-09-14T09:08:50.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247472+0000", 2024-09-14T09:08:50.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6899999999999998e-07 2024-09-14T09:08:50.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247474+0000", 2024-09-14T09:08:50.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9290000000000001e-06 2024-09-14T09:08:50.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247481+0000", 2024-09-14T09:08:50.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7499999999999997e-06 2024-09-14T09:08:50.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247486+0000", 2024-09-14T09:08:50.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5709999999999999e-06 2024-09-14T09:08:50.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.285757+0000", 2024-09-14T09:08:50.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038271289999999999 2024-09-14T09:08:50.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.285836+0000", 2024-09-14T09:08:50.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8753999999999998e-05 2024-09-14T09:08:50.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.285921+0000", 2024-09-14T09:08:50.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5406000000000002e-05 2024-09-14T09:08:50.047 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.047 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.047 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.047 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5286 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 4431872~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:50.047 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.247491+0000", 2024-09-14T09:08:50.047 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.796194631000001, 2024-09-14T09:08:50.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038550628000000003, 2024-09-14T09:08:50.047 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.047 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.047 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.047 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.048 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:50.048 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:50.048 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5286 2024-09-14T09:08:50.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.048 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247491+0000", 2024-09-14T09:08:50.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247491+0000", 2024-09-14T09:08:50.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247492+0000", 2024-09-14T09:08:50.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.37e-07 2024-09-14T09:08:50.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247494+0000", 2024-09-14T09:08:50.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7239999999999999e-06 2024-09-14T09:08:50.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247499+0000", 2024-09-14T09:08:50.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5620000000000003e-06 2024-09-14T09:08:50.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247504+0000", 2024-09-14T09:08:50.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4769999999999997e-06 2024-09-14T09:08:50.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.285949+0000", 2024-09-14T09:08:50.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038445314000000001 2024-09-14T09:08:50.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.285993+0000", 2024-09-14T09:08:50.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4397999999999997e-05 2024-09-14T09:08:50.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.286042+0000", 2024-09-14T09:08:50.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8615999999999997e-05 2024-09-14T09:08:50.051 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.051 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.051 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.052 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5287 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 4493312~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:50.052 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.247509+0000", 2024-09-14T09:08:50.052 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.796176902999999, 2024-09-14T09:08:50.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038729007000000003, 2024-09-14T09:08:50.052 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.052 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.052 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:50.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:50.052 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5287 2024-09-14T09:08:50.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.052 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247509+0000", 2024-09-14T09:08:50.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247509+0000", 2024-09-14T09:08:50.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.248863+0000", 2024-09-14T09:08:50.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001354325 2024-09-14T09:08:50.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.248867+0000", 2024-09-14T09:08:50.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4350000000000001e-06 2024-09-14T09:08:50.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.248876+0000", 2024-09-14T09:08:50.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8179999999999993e-06 2024-09-14T09:08:50.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.248882+0000", 2024-09-14T09:08:50.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0580000000000003e-06 2024-09-14T09:08:50.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.286074+0000", 2024-09-14T09:08:50.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.037192058 2024-09-14T09:08:50.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.286153+0000", 2024-09-14T09:08:50.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9456999999999995e-05 2024-09-14T09:08:50.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.286238+0000", 2024-09-14T09:08:50.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4856000000000002e-05 2024-09-14T09:08:50.056 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.056 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.056 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.056 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5296 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5046272~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:50.056 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249051+0000", 2024-09-14T09:08:50.056 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.794634795, 2024-09-14T09:08:50.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038542414999999997, 2024-09-14T09:08:50.056 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.056 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.057 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.057 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.057 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:50.057 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:50.057 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5296 2024-09-14T09:08:50.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.057 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249051+0000", 2024-09-14T09:08:50.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249051+0000", 2024-09-14T09:08:50.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249052+0000", 2024-09-14T09:08:50.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2800000000000002e-07 2024-09-14T09:08:50.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249054+0000", 2024-09-14T09:08:50.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.996e-06 2024-09-14T09:08:50.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249059+0000", 2024-09-14T09:08:50.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9529999999999996e-06 2024-09-14T09:08:50.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249064+0000", 2024-09-14T09:08:50.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7509999999999999e-06 2024-09-14T09:08:50.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287505+0000", 2024-09-14T09:08:50.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038440400999999999 2024-09-14T09:08:50.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287547+0000", 2024-09-14T09:08:50.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2287999999999999e-05 2024-09-14T09:08:50.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287594+0000", 2024-09-14T09:08:50.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6597999999999997e-05 2024-09-14T09:08:50.060 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.060 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.060 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.060 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5297 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5107712~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:50.060 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249083+0000", 2024-09-14T09:08:50.060 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.794603399, 2024-09-14T09:08:50.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038705564999999997, 2024-09-14T09:08:50.061 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.061 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.061 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.061 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.061 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:50.061 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:50.061 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5297 2024-09-14T09:08:50.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.061 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249083+0000", 2024-09-14T09:08:50.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249083+0000", 2024-09-14T09:08:50.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249083+0000", 2024-09-14T09:08:50.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0399999999999996e-07 2024-09-14T09:08:50.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249085+0000", 2024-09-14T09:08:50.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1849999999999998e-06 2024-09-14T09:08:50.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249092+0000", 2024-09-14T09:08:50.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4500000000000001e-06 2024-09-14T09:08:50.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249097+0000", 2024-09-14T09:08:50.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0710000000000002e-06 2024-09-14T09:08:50.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287625+0000", 2024-09-14T09:08:50.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038527990999999998 2024-09-14T09:08:50.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287700+0000", 2024-09-14T09:08:50.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5149999999999997e-05 2024-09-14T09:08:50.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287788+0000", 2024-09-14T09:08:50.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8114000000000004e-05 2024-09-14T09:08:50.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.065 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.065 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5298 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5169152~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:50.065 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249104+0000", 2024-09-14T09:08:50.065 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.794582285000001, 2024-09-14T09:08:50.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038798922999999999, 2024-09-14T09:08:50.065 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.065 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.066 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.066 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.066 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:50.066 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:50.066 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5298 2024-09-14T09:08:50.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.066 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249104+0000", 2024-09-14T09:08:50.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249104+0000", 2024-09-14T09:08:50.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249104+0000", 2024-09-14T09:08:50.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.89e-07 2024-09-14T09:08:50.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249106+0000", 2024-09-14T09:08:50.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9980000000000002e-06 2024-09-14T09:08:50.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249112+0000", 2024-09-14T09:08:50.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6779999999999997e-06 2024-09-14T09:08:50.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249117+0000", 2024-09-14T09:08:50.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8049999999999997e-06 2024-09-14T09:08:50.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287812+0000", 2024-09-14T09:08:50.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038695845 2024-09-14T09:08:50.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287856+0000", 2024-09-14T09:08:50.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3445000000000002e-05 2024-09-14T09:08:50.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287903+0000", 2024-09-14T09:08:50.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6662999999999997e-05 2024-09-14T09:08:50.069 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.069 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.069 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.070 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5299 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5230592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:50.070 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:08:50.070 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.794563468, 2024-09-14T09:08:50.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038972887999999997, 2024-09-14T09:08:50.070 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.070 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.070 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:50.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:50.070 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5299 2024-09-14T09:08:50.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.071 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:08:50.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:08:50.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249123+0000", 2024-09-14T09:08:50.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1199999999999998e-07 2024-09-14T09:08:50.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249125+0000", 2024-09-14T09:08:50.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.855e-06 2024-09-14T09:08:50.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249131+0000", 2024-09-14T09:08:50.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2949999999999999e-06 2024-09-14T09:08:50.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249136+0000", 2024-09-14T09:08:50.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9779999999999996e-06 2024-09-14T09:08:50.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287933+0000", 2024-09-14T09:08:50.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038796663000000002 2024-09-14T09:08:50.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288012+0000", 2024-09-14T09:08:50.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9617999999999996e-05 2024-09-14T09:08:50.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288095+0000", 2024-09-14T09:08:50.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3066999999999996e-05 2024-09-14T09:08:50.074 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.074 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.074 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.074 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5300 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5292032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:50.074 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:08:50.074 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.794544079, 2024-09-14T09:08:50.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039068578, 2024-09-14T09:08:50.075 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.075 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.075 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.075 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.075 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:50.075 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:50.075 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5300 2024-09-14T09:08:50.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.075 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:08:50.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:08:50.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254832+0000", 2024-09-14T09:08:50.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056899180000000004 2024-09-14T09:08:50.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254836+0000", 2024-09-14T09:08:50.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7809999999999999e-06 2024-09-14T09:08:50.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254845+0000", 2024-09-14T09:08:50.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.516e-06 2024-09-14T09:08:50.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254851+0000", 2024-09-14T09:08:50.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9109999999999998e-06 2024-09-14T09:08:50.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288122+0000", 2024-09-14T09:08:50.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.033270776000000002 2024-09-14T09:08:50.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288163+0000", 2024-09-14T09:08:50.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1700999999999999e-05 2024-09-14T09:08:50.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288210+0000", 2024-09-14T09:08:50.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6974999999999997e-05 2024-09-14T09:08:50.079 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.079 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.079 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.079 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5339 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7688192~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:50.079 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255650+0000", 2024-09-14T09:08:50.079 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.788035569, 2024-09-14T09:08:50.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038551183000000003, 2024-09-14T09:08:50.079 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.079 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.079 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.079 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.079 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:50.080 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:50.080 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5339 2024-09-14T09:08:50.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.080 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255650+0000", 2024-09-14T09:08:50.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255650+0000", 2024-09-14T09:08:50.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255651+0000", 2024-09-14T09:08:50.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8400000000000004e-07 2024-09-14T09:08:50.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255653+0000", 2024-09-14T09:08:50.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.12e-06 2024-09-14T09:08:50.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255660+0000", 2024-09-14T09:08:50.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8260000000000004e-06 2024-09-14T09:08:50.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255665+0000", 2024-09-14T09:08:50.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8860000000000003e-06 2024-09-14T09:08:50.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294041+0000", 2024-09-14T09:08:50.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038375805999999998 2024-09-14T09:08:50.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294119+0000", 2024-09-14T09:08:50.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8633000000000004e-05 2024-09-14T09:08:50.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294202+0000", 2024-09-14T09:08:50.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2328000000000002e-05 2024-09-14T09:08:50.083 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.083 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.083 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.083 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5340 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7749632~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:50.083 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255671+0000", 2024-09-14T09:08:50.083 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.788014735000001, 2024-09-14T09:08:50.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038644492000000003, 2024-09-14T09:08:50.084 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.084 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.084 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.084 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.084 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:50.084 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:50.084 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5340 2024-09-14T09:08:50.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.084 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255671+0000", 2024-09-14T09:08:50.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255671+0000", 2024-09-14T09:08:50.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255672+0000", 2024-09-14T09:08:50.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:08:50.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255674+0000", 2024-09-14T09:08:50.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9580000000000001e-06 2024-09-14T09:08:50.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255685+0000", 2024-09-14T09:08:50.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1302e-05 2024-09-14T09:08:50.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255691+0000", 2024-09-14T09:08:50.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.319e-06 2024-09-14T09:08:50.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294228+0000", 2024-09-14T09:08:50.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038537188999999999 2024-09-14T09:08:50.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294269+0000", 2024-09-14T09:08:50.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0241000000000003e-05 2024-09-14T09:08:50.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294316+0000", 2024-09-14T09:08:50.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6984000000000003e-05 2024-09-14T09:08:50.087 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.087 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.087 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.088 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5341 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7811072~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:50.088 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255698+0000", 2024-09-14T09:08:50.088 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.787987918000001, 2024-09-14T09:08:50.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038826833999999998, 2024-09-14T09:08:50.088 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.088 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.088 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:50.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:50.088 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5341 2024-09-14T09:08:50.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.088 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255698+0000", 2024-09-14T09:08:50.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255698+0000", 2024-09-14T09:08:50.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255698+0000", 2024-09-14T09:08:50.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.03e-07 2024-09-14T09:08:50.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255701+0000", 2024-09-14T09:08:50.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2259999999999999e-06 2024-09-14T09:08:50.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255707+0000", 2024-09-14T09:08:50.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0220000000000001e-06 2024-09-14T09:08:50.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255712+0000", 2024-09-14T09:08:50.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3680000000000001e-06 2024-09-14T09:08:50.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294347+0000", 2024-09-14T09:08:50.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038634746999999997 2024-09-14T09:08:50.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294434+0000", 2024-09-14T09:08:50.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7094000000000003e-05 2024-09-14T09:08:50.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294525+0000", 2024-09-14T09:08:50.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0974e-05 2024-09-14T09:08:50.092 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.092 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.092 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.092 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5342 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7872512~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:50.092 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:08:50.092 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.787967893999999, 2024-09-14T09:08:50.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038906217999999999, 2024-09-14T09:08:50.092 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.092 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.092 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.093 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:50.093 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:50.093 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5342 2024-09-14T09:08:50.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.093 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:08:50.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:08:50.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:08:50.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8700000000000001e-07 2024-09-14T09:08:50.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255720+0000", 2024-09-14T09:08:50.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.739e-06 2024-09-14T09:08:50.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255726+0000", 2024-09-14T09:08:50.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.981e-06 2024-09-14T09:08:50.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255737+0000", 2024-09-14T09:08:50.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0621e-05 2024-09-14T09:08:50.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294538+0000", 2024-09-14T09:08:50.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038801012000000003 2024-09-14T09:08:50.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294577+0000", 2024-09-14T09:08:50.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9042000000000003e-05 2024-09-14T09:08:50.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294624+0000", 2024-09-14T09:08:50.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7435999999999998e-05 2024-09-14T09:08:50.096 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.096 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.096 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.097 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5343 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7933952~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:50.097 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:08:50.097 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.787942018000001, 2024-09-14T09:08:50.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039081811000000001, 2024-09-14T09:08:50.097 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.097 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.097 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.097 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.097 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:50.097 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:50.097 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5343 2024-09-14T09:08:50.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.098 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:08:50.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:08:50.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:08:50.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1800000000000001e-07 2024-09-14T09:08:50.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255746+0000", 2024-09-14T09:08:50.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.103e-06 2024-09-14T09:08:50.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255753+0000", 2024-09-14T09:08:50.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0929999999999999e-06 2024-09-14T09:08:50.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255757+0000", 2024-09-14T09:08:50.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9579999999999998e-06 2024-09-14T09:08:50.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294656+0000", 2024-09-14T09:08:50.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038898508999999998 2024-09-14T09:08:50.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294738+0000", 2024-09-14T09:08:50.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2423999999999996e-05 2024-09-14T09:08:50.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294826+0000", 2024-09-14T09:08:50.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7305999999999994e-05 2024-09-14T09:08:50.101 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.101 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.101 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.101 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5344 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7995392~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:50.101 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:08:50.101 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.787922586000001, 2024-09-14T09:08:50.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039165567999999998, 2024-09-14T09:08:50.101 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.102 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.102 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.102 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.102 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:50.102 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:50.102 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5344 2024-09-14T09:08:50.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.102 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:08:50.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:08:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255764+0000", 2024-09-14T09:08:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7899999999999999e-07 2024-09-14T09:08:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255765+0000", 2024-09-14T09:08:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.782e-06 2024-09-14T09:08:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255774+0000", 2024-09-14T09:08:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8070000000000006e-06 2024-09-14T09:08:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255779+0000", 2024-09-14T09:08:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9180000000000002e-06 2024-09-14T09:08:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294841+0000", 2024-09-14T09:08:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039061514999999998 2024-09-14T09:08:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294881+0000", 2024-09-14T09:08:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0027999999999997e-05 2024-09-14T09:08:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294929+0000", 2024-09-14T09:08:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8139000000000001e-05 2024-09-14T09:08:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5345 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8056832~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:08:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.787900348000001, 2024-09-14T09:08:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039340027999999999, 2024-09-14T09:08:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5345 2024-09-14T09:08:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:08:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:08:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:08:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8099999999999998e-07 2024-09-14T09:08:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255788+0000", 2024-09-14T09:08:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1280000000000002e-06 2024-09-14T09:08:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255794+0000", 2024-09-14T09:08:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0020000000000003e-06 2024-09-14T09:08:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255800+0000", 2024-09-14T09:08:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2009999999999996e-06 2024-09-14T09:08:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294960+0000", 2024-09-14T09:08:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039159674999999998 2024-09-14T09:08:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295041+0000", 2024-09-14T09:08:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0648000000000004e-05 2024-09-14T09:08:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295126+0000", 2024-09-14T09:08:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4993000000000004e-05 2024-09-14T09:08:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5346 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8118272~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:08:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.787879353999999, 2024-09-14T09:08:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039433228000000001, 2024-09-14T09:08:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5346 2024-09-14T09:08:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:08:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:08:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:08:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6899999999999998e-07 2024-09-14T09:08:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255809+0000", 2024-09-14T09:08:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9580000000000001e-06 2024-09-14T09:08:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255815+0000", 2024-09-14T09:08:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6579999999999999e-06 2024-09-14T09:08:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255819+0000", 2024-09-14T09:08:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5839999999999996e-06 2024-09-14T09:08:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295152+0000", 2024-09-14T09:08:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039332677000000003 2024-09-14T09:08:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295192+0000", 2024-09-14T09:08:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0491999999999998e-05 2024-09-14T09:08:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295240+0000", 2024-09-14T09:08:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7490000000000001e-05 2024-09-14T09:08:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5347 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8179712~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:08:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.787851757, 2024-09-14T09:08:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039601193999999999, 2024-09-14T09:08:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5347 2024-09-14T09:08:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:08:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:08:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255835+0000", 2024-09-14T09:08:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.82e-07 2024-09-14T09:08:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255837+0000", 2024-09-14T09:08:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0959999999999999e-06 2024-09-14T09:08:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255843+0000", 2024-09-14T09:08:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3779999999999998e-06 2024-09-14T09:08:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255848+0000", 2024-09-14T09:08:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7609999999999998e-06 2024-09-14T09:08:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295271+0000", 2024-09-14T09:08:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039423079 2024-09-14T09:08:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295350+0000", 2024-09-14T09:08:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8623999999999998e-05 2024-09-14T09:08:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295435+0000", 2024-09-14T09:08:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5674000000000007e-05 2024-09-14T09:08:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5348 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8241152~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:08:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.787831548, 2024-09-14T09:08:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039695057999999998, 2024-09-14T09:08:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5348 2024-09-14T09:08:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:08:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:08:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255855+0000", 2024-09-14T09:08:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7599999999999997e-07 2024-09-14T09:08:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255857+0000", 2024-09-14T09:08:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.905e-06 2024-09-14T09:08:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255863+0000", 2024-09-14T09:08:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0669999999999997e-06 2024-09-14T09:08:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255867+0000", 2024-09-14T09:08:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4730000000000002e-06 2024-09-14T09:08:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295461+0000", 2024-09-14T09:08:50.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039594074 2024-09-14T09:08:50.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295503+0000", 2024-09-14T09:08:50.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1363999999999999e-05 2024-09-14T09:08:50.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295549+0000", 2024-09-14T09:08:50.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6699000000000001e-05 2024-09-14T09:08:50.122 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.122 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5349 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8302592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:08:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.787812588, 2024-09-14T09:08:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039875928999999997, 2024-09-14T09:08:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5349 2024-09-14T09:08:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:08:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:08:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255874+0000", 2024-09-14T09:08:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4900000000000001e-07 2024-09-14T09:08:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255880+0000", 2024-09-14T09:08:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9939999999999997e-06 2024-09-14T09:08:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255886+0000", 2024-09-14T09:08:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3899999999999998e-06 2024-09-14T09:08:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255891+0000", 2024-09-14T09:08:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.938e-06 2024-09-14T09:08:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295580+0000", 2024-09-14T09:08:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039688681000000003 2024-09-14T09:08:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295653+0000", 2024-09-14T09:08:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3045000000000003e-05 2024-09-14T09:08:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295749+0000", 2024-09-14T09:08:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6532000000000003e-05 2024-09-14T09:08:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5350 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8364032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:08:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.787788781, 2024-09-14T09:08:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039989719, 2024-09-14T09:08:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5350 2024-09-14T09:08:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:08:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:08:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255898+0000", 2024-09-14T09:08:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2024-09-14T09:08:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255899+0000", 2024-09-14T09:08:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9139999999999998e-06 2024-09-14T09:08:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255905+0000", 2024-09-14T09:08:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7289999999999997e-06 2024-09-14T09:08:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255910+0000", 2024-09-14T09:08:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6210000000000003e-06 2024-09-14T09:08:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295775+0000", 2024-09-14T09:08:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039864973999999997 2024-09-14T09:08:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295828+0000", 2024-09-14T09:08:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3411000000000001e-05 2024-09-14T09:08:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295887+0000", 2024-09-14T09:08:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699000000000002e-05 2024-09-14T09:08:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.132 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.132 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.132 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.132 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:50.133 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:08:50.134 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:50.135+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:50.160 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.3.f.2 2024-09-14T09:08:50.233 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:50.236+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:50.281 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:50.281 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:50.281 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:50.281 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:50.285 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #22, image image_client.0-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent23 2024-09-14T09:08:50.290 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:08:50.334 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:50.336+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:50.435 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:50.437+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:50.492 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:50.492 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:50.492 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:50.492 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:50.492 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:50.504 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:08:50.536 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:50.537+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:50.637 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:50.640+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:50.707 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:50.707 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:50.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:50.707 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:50.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.708 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:228 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 360448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:50.708 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:08:50.708 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.910373800999999, 2024-09-14T09:08:50.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99234476999999999, 2024-09-14T09:08:50.708 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.708 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.708 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.708 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.708 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:50.708 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:50.708 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 228 2024-09-14T09:08:50.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.709 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:08:50.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:08:50.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796906+0000", 2024-09-14T09:08:50.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9399999999999995e-07 2024-09-14T09:08:50.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796917+0000", 2024-09-14T09:08:50.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0801e-05 2024-09-14T09:08:50.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796924+0000", 2024-09-14T09:08:50.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7750000000000004e-06 2024-09-14T09:08:50.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:08:50.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9972000000000001e-05 2024-09-14T09:08:50.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798671+0000", 2024-09-14T09:08:50.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017271330000000001 2024-09-14T09:08:50.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:50.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798675+0000", 2024-09-14T09:08:50.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.194e-06 2024-09-14T09:08:50.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789003+0000", 2024-09-14T09:08:50.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99032768400000004 2024-09-14T09:08:50.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789115+0000", 2024-09-14T09:08:50.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112236 2024-09-14T09:08:50.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789250+0000", 2024-09-14T09:08:50.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013548100000000001 2024-09-14T09:08:50.714 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.714 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.714 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.714 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:229 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 819200~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:50.714 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:08:50.714 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.910321578000001, 2024-09-14T09:08:50.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99287024599999996, 2024-09-14T09:08:50.714 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.715 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.715 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.715 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.715 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:50.715 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:50.715 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 229 2024-09-14T09:08:50.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.715 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:08:50.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:08:50.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:08:50.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999999e-07 2024-09-14T09:08:50.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796962+0000", 2024-09-14T09:08:50.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1479999999999999e-06 2024-09-14T09:08:50.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796967+0000", 2024-09-14T09:08:50.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1499999999999998e-06 2024-09-14T09:08:50.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:08:50.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-06 2024-09-14T09:08:50.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798688+0000", 2024-09-14T09:08:50.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017172660000000001 2024-09-14T09:08:50.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:50.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798691+0000", 2024-09-14T09:08:50.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:08:50.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789599+0000", 2024-09-14T09:08:50.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99090839399999997 2024-09-14T09:08:50.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789716+0000", 2024-09-14T09:08:50.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116474 2024-09-14T09:08:50.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789828+0000", 2024-09-14T09:08:50.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112293 2024-09-14T09:08:50.720 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.720 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.720 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.720 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:230 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1277952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:50.720 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:08:50.720 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.910300929999998, 2024-09-14T09:08:50.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99307501600000003, 2024-09-14T09:08:50.720 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.721 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.721 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.721 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.721 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:50.721 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:50.721 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 230 2024-09-14T09:08:50.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.721 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:08:50.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:08:50.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796979+0000", 2024-09-14T09:08:50.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.34e-07 2024-09-14T09:08:50.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796980+0000", 2024-09-14T09:08:50.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.53e-06 2024-09-14T09:08:50.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796986+0000", 2024-09-14T09:08:50.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9989999999999997e-06 2024-09-14T09:08:50.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796989+0000", 2024-09-14T09:08:50.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0340000000000001e-06 2024-09-14T09:08:50.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798702+0000", 2024-09-14T09:08:50.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001712756 2024-09-14T09:08:50.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:50.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798705+0000", 2024-09-14T09:08:50.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7750000000000001e-06 2024-09-14T09:08:50.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789870+0000", 2024-09-14T09:08:50.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991165026 2024-09-14T09:08:50.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789955+0000", 2024-09-14T09:08:50.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4839999999999994e-05 2024-09-14T09:08:50.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790053+0000", 2024-09-14T09:08:50.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8721999999999994e-05 2024-09-14T09:08:50.726 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.726 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.726 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.726 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:231 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:50.726 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:08:50.726 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.910285601999998, 2024-09-14T09:08:50.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99319130300000003, 2024-09-14T09:08:50.727 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.727 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.727 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.727 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.727 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:50.727 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:50.727 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 231 2024-09-14T09:08:50.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.727 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:08:50.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:08:50.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:08:50.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2024-09-14T09:08:50.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796995+0000", 2024-09-14T09:08:50.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2500000000000001e-06 2024-09-14T09:08:50.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796998+0000", 2024-09-14T09:08:50.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3230000000000002e-06 2024-09-14T09:08:50.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797001+0000", 2024-09-14T09:08:50.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7099999999999999e-06 2024-09-14T09:08:50.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798718+0000", 2024-09-14T09:08:50.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017168070000000001 2024-09-14T09:08:50.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:50.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798721+0000", 2024-09-14T09:08:50.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.853e-06 2024-09-14T09:08:50.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790077+0000", 2024-09-14T09:08:50.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991356393 2024-09-14T09:08:50.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790129+0000", 2024-09-14T09:08:50.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2240999999999997e-05 2024-09-14T09:08:50.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790185+0000", 2024-09-14T09:08:50.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5515e-05 2024-09-14T09:08:50.732 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.732 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.732 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.732 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:232 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2195456~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:50.732 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:08:50.732 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.910274946000001, 2024-09-14T09:08:50.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99329117899999997, 2024-09-14T09:08:50.733 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.733 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.733 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.733 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.733 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:50.733 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:50.733 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 232 2024-09-14T09:08:50.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.733 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:08:50.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:08:50.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797005+0000", 2024-09-14T09:08:50.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2024-09-14T09:08:50.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797006+0000", 2024-09-14T09:08:50.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3200000000000001e-06 2024-09-14T09:08:50.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797009+0000", 2024-09-14T09:08:50.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4680000000000001e-06 2024-09-14T09:08:50.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797012+0000", 2024-09-14T09:08:50.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4770000000000002e-06 2024-09-14T09:08:50.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798743+0000", 2024-09-14T09:08:50.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017312 2024-09-14T09:08:50.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:50.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798747+0000", 2024-09-14T09:08:50.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.484e-06 2024-09-14T09:08:50.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790201+0000", 2024-09-14T09:08:50.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99145419499999998 2024-09-14T09:08:50.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790241+0000", 2024-09-14T09:08:50.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0587999999999998e-05 2024-09-14T09:08:50.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790296+0000", 2024-09-14T09:08:50.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4212000000000002e-05 2024-09-14T09:08:50.738 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.738 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.738 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.739 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:233 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2654208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:50.739 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:08:50.739 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.910264323, 2024-09-14T09:08:50.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99337220100000001, 2024-09-14T09:08:50.739 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.739 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.739 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.739 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.739 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:50.739 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:50.739 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 233 2024-09-14T09:08:50.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.740 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:08:50.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:08:50.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:08:50.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:08:50.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:08:50.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.269e-06 2024-09-14T09:08:50.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797019+0000", 2024-09-14T09:08:50.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9519999999999999e-06 2024-09-14T09:08:50.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797022+0000", 2024-09-14T09:08:50.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6079999999999998e-06 2024-09-14T09:08:50.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798759+0000", 2024-09-14T09:08:50.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001737342 2024-09-14T09:08:50.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:50.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798762+0000", 2024-09-14T09:08:50.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:08:50.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790310+0000", 2024-09-14T09:08:50.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99154738799999997 2024-09-14T09:08:50.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790349+0000", 2024-09-14T09:08:50.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9573000000000002e-05 2024-09-14T09:08:50.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790387+0000", 2024-09-14T09:08:50.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7985999999999998e-05 2024-09-14T09:08:50.744 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.744 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.744 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.744 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:234 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3112960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:50.744 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:08:50.744 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.910254278, 2024-09-14T09:08:50.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99345674500000003, 2024-09-14T09:08:50.745 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.745 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.745 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.745 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.745 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:50.745 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:50.745 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 234 2024-09-14T09:08:50.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.745 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:08:50.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:08:50.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:08:50.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0100000000000001e-07 2024-09-14T09:08:50.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:50.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0699999999999999e-06 2024-09-14T09:08:50.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:08:50.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.886e-06 2024-09-14T09:08:50.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797032+0000", 2024-09-14T09:08:50.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7149999999999998e-06 2024-09-14T09:08:50.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798778+0000", 2024-09-14T09:08:50.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017460329999999999 2024-09-14T09:08:50.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:50.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798783+0000", 2024-09-14T09:08:50.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0760000000000002e-06 2024-09-14T09:08:50.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790408+0000", 2024-09-14T09:08:50.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99162473299999998 2024-09-14T09:08:50.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790446+0000", 2024-09-14T09:08:50.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8389000000000001e-05 2024-09-14T09:08:50.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790482+0000", 2024-09-14T09:08:50.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5642000000000002e-05 2024-09-14T09:08:50.750 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.750 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.750 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.750 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:235 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3571712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:50.750 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:08:50.750 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.910244380000002, 2024-09-14T09:08:50.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993539477, 2024-09-14T09:08:50.750 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.750 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.750 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.751 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.751 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:50.751 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:50.751 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 235 2024-09-14T09:08:50.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.751 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:08:50.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:08:50.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:08:50.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9999999999999999e-07 2024-09-14T09:08:50.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797036+0000", 2024-09-14T09:08:50.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.051e-06 2024-09-14T09:08:50.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797039+0000", 2024-09-14T09:08:50.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:08:50.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797042+0000", 2024-09-14T09:08:50.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5280000000000002e-06 2024-09-14T09:08:50.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798809+0000", 2024-09-14T09:08:50.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001767394 2024-09-14T09:08:50.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:50.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798815+0000", 2024-09-14T09:08:50.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0859999999999998e-06 2024-09-14T09:08:50.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790502+0000", 2024-09-14T09:08:50.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99168652300000004 2024-09-14T09:08:50.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790539+0000", 2024-09-14T09:08:50.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7471000000000001e-05 2024-09-14T09:08:50.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790574+0000", 2024-09-14T09:08:50.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5292e-05 2024-09-14T09:08:50.755 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.755 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.755 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.756 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:236 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 4030464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:50.756 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:08:50.756 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.910234147000001, 2024-09-14T09:08:50.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993619743, 2024-09-14T09:08:50.756 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.756 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.756 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.756 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.756 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:50.756 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:50.756 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 236 2024-09-14T09:08:50.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.757 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:08:50.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:08:50.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:08:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1400000000000001e-07 2024-09-14T09:08:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797047+0000", 2024-09-14T09:08:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3400000000000001e-06 2024-09-14T09:08:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:08:50.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0699999999999998e-06 2024-09-14T09:08:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797053+0000", 2024-09-14T09:08:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7310000000000002e-06 2024-09-14T09:08:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798839+0000", 2024-09-14T09:08:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001786403 2024-09-14T09:08:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798844+0000", 2024-09-14T09:08:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3730000000000001e-06 2024-09-14T09:08:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790592+0000", 2024-09-14T09:08:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99174818099999995 2024-09-14T09:08:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790628+0000", 2024-09-14T09:08:50.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5831000000000003e-05 2024-09-14T09:08:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790665+0000", 2024-09-14T09:08:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-05 2024-09-14T09:08:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:365 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:50.761 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:08:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.908047118999999, 2024-09-14T09:08:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157278400000004, 2024-09-14T09:08:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 365 2024-09-14T09:08:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:08:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:08:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:08:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:08:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799233+0000", 2024-09-14T09:08:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.057e-06 2024-09-14T09:08:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799236+0000", 2024-09-14T09:08:50.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0249999999999998e-06 2024-09-14T09:08:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799239+0000", 2024-09-14T09:08:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.481e-06 2024-09-14T09:08:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800963+0000", 2024-09-14T09:08:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017240440000000001 2024-09-14T09:08:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800969+0000", 2024-09-14T09:08:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1410000000000002e-06 2024-09-14T09:08:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790682+0000", 2024-09-14T09:08:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98971330300000004 2024-09-14T09:08:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790753+0000", 2024-09-14T09:08:50.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0548000000000003e-05 2024-09-14T09:08:50.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790805+0000", 2024-09-14T09:08:50.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1981999999999998e-05 2024-09-14T09:08:50.767 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.767 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.767 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.768 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:366 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:50.768 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:08:50.768 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.908037025999999, 2024-09-14T09:08:50.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99173757299999998, 2024-09-14T09:08:50.768 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.768 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.768 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.768 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.769 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:50.769 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:50.769 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 366 2024-09-14T09:08:50.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.769 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:08:50.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:08:50.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:08:50.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-07 2024-09-14T09:08:50.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799244+0000", 2024-09-14T09:08:50.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.359e-06 2024-09-14T09:08:50.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799247+0000", 2024-09-14T09:08:50.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4929999999999998e-06 2024-09-14T09:08:50.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799250+0000", 2024-09-14T09:08:50.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:08:50.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800991+0000", 2024-09-14T09:08:50.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017412809999999999 2024-09-14T09:08:50.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:50.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800997+0000", 2024-09-14T09:08:50.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:08:50.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790824+0000", 2024-09-14T09:08:50.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98982735399999999 2024-09-14T09:08:50.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790891+0000", 2024-09-14T09:08:50.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7243999999999995e-05 2024-09-14T09:08:50.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790980+0000", 2024-09-14T09:08:50.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8608000000000003e-05 2024-09-14T09:08:50.774 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.774 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.774 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.775 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:367 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:50.775 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:08:50.775 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.908025653999999, 2024-09-14T09:08:50.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99188259999999995, 2024-09-14T09:08:50.775 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.775 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.775 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.775 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.775 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:50.775 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:50.775 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 367 2024-09-14T09:08:50.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.776 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:08:50.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:08:50.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:08:50.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-07 2024-09-14T09:08:50.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799255+0000", 2024-09-14T09:08:50.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.111e-06 2024-09-14T09:08:50.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799259+0000", 2024-09-14T09:08:50.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8650000000000003e-06 2024-09-14T09:08:50.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799262+0000", 2024-09-14T09:08:50.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.128e-06 2024-09-14T09:08:50.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801029+0000", 2024-09-14T09:08:50.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017668460000000001 2024-09-14T09:08:50.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:50.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801032+0000", 2024-09-14T09:08:50.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3179999999999998e-06 2024-09-14T09:08:50.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791011+0000", 2024-09-14T09:08:50.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98997920399999995 2024-09-14T09:08:50.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791077+0000", 2024-09-14T09:08:50.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5214000000000003e-05 2024-09-14T09:08:50.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791136+0000", 2024-09-14T09:08:50.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9710000000000003e-05 2024-09-14T09:08:50.781 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.781 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.781 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.781 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:368 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:50.782 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:08:50.782 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.908014111, 2024-09-14T09:08:50.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99201753800000003, 2024-09-14T09:08:50.782 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.782 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.782 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.782 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.782 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:50.782 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:50.782 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 368 2024-09-14T09:08:50.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.782 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:08:50.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:08:50.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:08:50.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4900000000000002e-07 2024-09-14T09:08:50.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799267+0000", 2024-09-14T09:08:50.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.079e-06 2024-09-14T09:08:50.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799270+0000", 2024-09-14T09:08:50.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.993e-06 2024-09-14T09:08:50.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799272+0000", 2024-09-14T09:08:50.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.695e-06 2024-09-14T09:08:50.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801043+0000", 2024-09-14T09:08:50.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001771105 2024-09-14T09:08:50.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:50.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801046+0000", 2024-09-14T09:08:50.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7999999999999999e-06 2024-09-14T09:08:50.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791150+0000", 2024-09-14T09:08:50.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99010348699999995 2024-09-14T09:08:50.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791193+0000", 2024-09-14T09:08:50.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3615999999999997e-05 2024-09-14T09:08:50.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791283+0000", 2024-09-14T09:08:50.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9513999999999997e-05 2024-09-14T09:08:50.787 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.787 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.787 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.787 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:369 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:50.788 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:08:50.788 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.908003773000001, 2024-09-14T09:08:50.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99213433600000001, 2024-09-14T09:08:50.788 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.788 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.788 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.788 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.788 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:50.788 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:50.788 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 369 2024-09-14T09:08:50.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.788 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:08:50.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:08:50.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:08:50.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:08:50.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799277+0000", 2024-09-14T09:08:50.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.108e-06 2024-09-14T09:08:50.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799280+0000", 2024-09-14T09:08:50.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:08:50.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799283+0000", 2024-09-14T09:08:50.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.531e-06 2024-09-14T09:08:50.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801058+0000", 2024-09-14T09:08:50.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001775085 2024-09-14T09:08:50.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:50.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801060+0000", 2024-09-14T09:08:50.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8260000000000001e-06 2024-09-14T09:08:50.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791299+0000", 2024-09-14T09:08:50.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99023856799999999 2024-09-14T09:08:50.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791352+0000", 2024-09-14T09:08:50.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2528000000000003e-05 2024-09-14T09:08:50.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791410+0000", 2024-09-14T09:08:50.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8298000000000003e-05 2024-09-14T09:08:50.793 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.793 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.793 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.793 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:370 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2457600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:50.793 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:08:50.794 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.907979006000001, 2024-09-14T09:08:50.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99220795399999995, 2024-09-14T09:08:50.794 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.794 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.794 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.794 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.794 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:50.794 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:50.794 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 370 2024-09-14T09:08:50.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.794 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:08:50.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:08:50.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799301+0000", 2024-09-14T09:08:50.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2024-09-14T09:08:50.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799303+0000", 2024-09-14T09:08:50.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9319999999999999e-06 2024-09-14T09:08:50.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799310+0000", 2024-09-14T09:08:50.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8680000000000001e-06 2024-09-14T09:08:50.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799315+0000", 2024-09-14T09:08:50.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.921e-06 2024-09-14T09:08:50.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801071+0000", 2024-09-14T09:08:50.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001756678 2024-09-14T09:08:50.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:50.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801080+0000", 2024-09-14T09:08:50.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6060000000000003e-06 2024-09-14T09:08:50.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791429+0000", 2024-09-14T09:08:50.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99034944599999997 2024-09-14T09:08:50.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791471+0000", 2024-09-14T09:08:50.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1279999999999998e-05 2024-09-14T09:08:50.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791508+0000", 2024-09-14T09:08:50.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7663999999999997e-05 2024-09-14T09:08:50.799 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.799 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.799 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.799 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:371 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2916352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:50.799 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:08:50.799 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.907957834000001, 2024-09-14T09:08:50.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99228692299999999, 2024-09-14T09:08:50.799 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.799 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.800 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.800 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.800 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:50.800 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:50.800 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 371 2024-09-14T09:08:50.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.800 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:08:50.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.801 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:08:50.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.801 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799322+0000", 2024-09-14T09:08:50.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:08:50.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.801 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799333+0000", 2024-09-14T09:08:50.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1044e-05 2024-09-14T09:08:50.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799341+0000", 2024-09-14T09:08:50.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8439999999999998e-06 2024-09-14T09:08:50.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799354+0000", 2024-09-14T09:08:50.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3114e-05 2024-09-14T09:08:50.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801093+0000", 2024-09-14T09:08:50.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017385910000000001 2024-09-14T09:08:50.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:50.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801096+0000", 2024-09-14T09:08:50.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0680000000000001e-06 2024-09-14T09:08:50.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791528+0000", 2024-09-14T09:08:50.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99043264200000003 2024-09-14T09:08:50.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791570+0000", 2024-09-14T09:08:50.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2144999999999997e-05 2024-09-14T09:08:50.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791608+0000", 2024-09-14T09:08:50.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7966000000000002e-05 2024-09-14T09:08:50.804 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.804 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.804 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.805 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:372 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3375104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:50.805 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:08:50.805 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.907917286, 2024-09-14T09:08:50.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992342897, 2024-09-14T09:08:50.805 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.805 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.805 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.805 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.805 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:50.805 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:50.805 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 372 2024-09-14T09:08:50.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.806 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:08:50.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:08:50.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799363+0000", 2024-09-14T09:08:50.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2024-09-14T09:08:50.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799365+0000", 2024-09-14T09:08:50.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5500000000000001e-06 2024-09-14T09:08:50.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799371+0000", 2024-09-14T09:08:50.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2500000000000003e-06 2024-09-14T09:08:50.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799377+0000", 2024-09-14T09:08:50.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7509999999999997e-06 2024-09-14T09:08:50.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801107+0000", 2024-09-14T09:08:50.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017298019999999999 2024-09-14T09:08:50.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:50.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801111+0000", 2024-09-14T09:08:50.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8619999999999996e-06 2024-09-14T09:08:50.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791626+0000", 2024-09-14T09:08:50.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99051563300000001 2024-09-14T09:08:50.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791668+0000", 2024-09-14T09:08:50.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1424000000000002e-05 2024-09-14T09:08:50.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791705+0000", 2024-09-14T09:08:50.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7035e-05 2024-09-14T09:08:50.810 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.810 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.810 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.810 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:373 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:50.810 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:08:50.810 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.907895341, 2024-09-14T09:08:50.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99253589399999997, 2024-09-14T09:08:50.811 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.811 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.811 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.811 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.811 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:50.811 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:50.811 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 373 2024-09-14T09:08:50.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.811 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:08:50.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:08:50.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:08:50.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2024-09-14T09:08:50.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799387+0000", 2024-09-14T09:08:50.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1019999999999999e-06 2024-09-14T09:08:50.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799393+0000", 2024-09-14T09:08:50.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0190000000000003e-06 2024-09-14T09:08:50.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799398+0000", 2024-09-14T09:08:50.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:08:50.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801123+0000", 2024-09-14T09:08:50.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017251949999999999 2024-09-14T09:08:50.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:50.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801126+0000", 2024-09-14T09:08:50.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9280000000000002e-06 2024-09-14T09:08:50.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791746+0000", 2024-09-14T09:08:50.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99062036899999995 2024-09-14T09:08:50.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791835+0000", 2024-09-14T09:08:50.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9004000000000004e-05 2024-09-14T09:08:50.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791920+0000", 2024-09-14T09:08:50.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4524000000000006e-05 2024-09-14T09:08:50.816 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.816 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.816 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.816 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:10395 3.17 3:e9053d87:::rbd_data.111228c3791c.0000000000000006:18 [read 962560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:50.816 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.797914+0000", 2024-09-14T09:08:50.816 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.909365441, 2024-09-14T09:08:50.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034376019000000001, 2024-09-14T09:08:50.816 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.816 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.816 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.816 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.817 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:50.817 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:50.817 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10395 2024-09-14T09:08:50.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.817 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.797914+0000", 2024-09-14T09:08:50.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.797914+0000", 2024-09-14T09:08:50.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798042+0000", 2024-09-14T09:08:50.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012855399999999999 2024-09-14T09:08:50.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798044+0000", 2024-09-14T09:08:50.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.086e-06 2024-09-14T09:08:50.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798049+0000", 2024-09-14T09:08:50.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7770000000000002e-06 2024-09-14T09:08:50.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798066+0000", 2024-09-14T09:08:50.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6405999999999998e-05 2024-09-14T09:08:50.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832200+0000", 2024-09-14T09:08:50.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034134022 2024-09-14T09:08:50.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832241+0000", 2024-09-14T09:08:50.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1566999999999997e-05 2024-09-14T09:08:50.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832290+0000", 2024-09-14T09:08:50.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8606999999999997e-05 2024-09-14T09:08:50.820 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.820 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.820 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.821 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:10397 3.17 3:e9053d87:::rbd_data.111228c3791c.0000000000000006:18 [read 1085440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:50.821 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.798088+0000", 2024-09-14T09:08:50.821 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.909191528000001, 2024-09-14T09:08:50.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034429187, 2024-09-14T09:08:50.821 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:50.821 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:50.821 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:50.821 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:50.821 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:50.821 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:50.821 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10397 2024-09-14T09:08:50.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.822 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:50.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:50.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798088+0000", 2024-09-14T09:08:50.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:50.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798088+0000", 2024-09-14T09:08:50.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:50.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:50.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803904+0000", 2024-09-14T09:08:50.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058164799999999997 2024-09-14T09:08:50.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:50.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803908+0000", 2024-09-14T09:08:50.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8580000000000002e-06 2024-09-14T09:08:50.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:50.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803918+0000", 2024-09-14T09:08:50.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4939999999999992e-06 2024-09-14T09:08:50.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:50.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803923+0000", 2024-09-14T09:08:50.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2599999999999996e-06 2024-09-14T09:08:50.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:50.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832428+0000", 2024-09-14T09:08:50.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.028504788 2024-09-14T09:08:50.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:50.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832470+0000", 2024-09-14T09:08:50.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2358999999999999e-05 2024-09-14T09:08:50.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:50.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:50.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:50.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832517+0000", 2024-09-14T09:08:50.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6947999999999998e-05 2024-09-14T09:08:50.825 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.825 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.825 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.825 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:50.825 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:50.826 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:50.826 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is unset 2024-09-14T09:08:50.827 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:50.829+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:50.828 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:08:50.927 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:50.929+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:50.985 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:50.985 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:50.986 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:08:50.986 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:50.995 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:08:51.029 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:51.031+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:51.130 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:51.132+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:51.154 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:51.154 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:51.154 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:51.154 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:51.154 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:51.167 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:08:51.230 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:51.232+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:51.277 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:51.277 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:51.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:51.277 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:51.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.278 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2265 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4034560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:51.278 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:08:51.278 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.416144632, 2024-09-14T09:08:51.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073974829000000006, 2024-09-14T09:08:51.278 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:51.278 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:51.278 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:51.278 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:51.278 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:51.278 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:51.278 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2265 2024-09-14T09:08:51.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.278 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:51.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:51.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:08:51.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:51.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:08:51.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:51.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862542+0000", 2024-09-14T09:08:51.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:08:51.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:51.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862543+0000", 2024-09-14T09:08:51.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.81e-06 2024-09-14T09:08:51.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:51.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862549+0000", 2024-09-14T09:08:51.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8850000000000004e-06 2024-09-14T09:08:51.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:51.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862554+0000", 2024-09-14T09:08:51.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5279999999999997e-06 2024-09-14T09:08:51.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:51.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936318+0000", 2024-09-14T09:08:51.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073764422999999996 2024-09-14T09:08:51.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:51.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936412+0000", 2024-09-14T09:08:51.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3801000000000005e-05 2024-09-14T09:08:51.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:51.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936516+0000", 2024-09-14T09:08:51.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000104007 2024-09-14T09:08:51.282 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.282 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:51.282 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.282 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2266 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4096000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:51.282 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:08:51.282 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.416126768, 2024-09-14T09:08:51.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074208332000000002, 2024-09-14T09:08:51.282 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:51.283 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:51.283 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:51.283 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:51.283 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:51.283 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:51.283 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2266 2024-09-14T09:08:51.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.283 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:51.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:51.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:08:51.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:51.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:08:51.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:51.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862738+0000", 2024-09-14T09:08:51.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017920300000000001 2024-09-14T09:08:51.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:51.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862744+0000", 2024-09-14T09:08:51.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3000000000000001e-06 2024-09-14T09:08:51.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:51.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862753+0000", 2024-09-14T09:08:51.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8179999999999999e-06 2024-09-14T09:08:51.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:51.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862785+0000", 2024-09-14T09:08:51.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1949000000000002e-05 2024-09-14T09:08:51.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:51.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936556+0000", 2024-09-14T09:08:51.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073770268999999999 2024-09-14T09:08:51.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:51.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936657+0000", 2024-09-14T09:08:51.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101387 2024-09-14T09:08:51.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:51.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936767+0000", 2024-09-14T09:08:51.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110406 2024-09-14T09:08:51.286 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.286 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:51.286 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.287 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2267 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4157440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:51.287 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:08:51.287 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.415888186, 2024-09-14T09:08:51.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074200918000000005, 2024-09-14T09:08:51.287 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:51.287 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:51.287 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:51.287 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:51.287 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:51.287 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:51.287 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2267 2024-09-14T09:08:51.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.288 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:51.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:51.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:08:51.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:51.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:08:51.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:51.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863416+0000", 2024-09-14T09:08:51.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000618492 2024-09-14T09:08:51.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:51.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863421+0000", 2024-09-14T09:08:51.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1359999999999996e-06 2024-09-14T09:08:51.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:51.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863434+0000", 2024-09-14T09:08:51.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2291e-05 2024-09-14T09:08:51.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:51.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863444+0000", 2024-09-14T09:08:51.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9769999999999995e-06 2024-09-14T09:08:51.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:51.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936808+0000", 2024-09-14T09:08:51.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073364051999999999 2024-09-14T09:08:51.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:51.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936892+0000", 2024-09-14T09:08:51.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4641999999999994e-05 2024-09-14T09:08:51.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:51.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936999+0000", 2024-09-14T09:08:51.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106328 2024-09-14T09:08:51.291 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.291 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:51.291 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.291 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2328 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 45056~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:51.291 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.863458+0000", 2024-09-14T09:08:51.291 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.415227947, 2024-09-14T09:08:51.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073931949999999996, 2024-09-14T09:08:51.291 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:51.291 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:51.292 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:51.292 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:51.292 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:51.292 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:51.292 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2328 2024-09-14T09:08:51.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.292 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:51.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:51.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863458+0000", 2024-09-14T09:08:51.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:51.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863458+0000", 2024-09-14T09:08:51.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:51.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863489+0000", 2024-09-14T09:08:51.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1270999999999999e-05 2024-09-14T09:08:51.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:51.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863500+0000", 2024-09-14T09:08:51.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0969e-05 2024-09-14T09:08:51.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:51.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863509+0000", 2024-09-14T09:08:51.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5210000000000002e-06 2024-09-14T09:08:51.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:51.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863515+0000", 2024-09-14T09:08:51.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-09-14T09:08:51.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:51.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937038+0000", 2024-09-14T09:08:51.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073522901000000002 2024-09-14T09:08:51.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:51.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937131+0000", 2024-09-14T09:08:51.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.276e-05 2024-09-14T09:08:51.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:51.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937390+0000", 2024-09-14T09:08:51.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025917099999999999 2024-09-14T09:08:51.295 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.295 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:51.295 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.296 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2329 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 106496~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:51.296 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:08:51.296 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.415159577000001, 2024-09-14T09:08:51.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074180251000000003, 2024-09-14T09:08:51.296 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:51.296 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:51.296 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:51.296 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:51.296 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:51.296 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:51.296 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2329 2024-09-14T09:08:51.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.297 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:51.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:51.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:08:51.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:51.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:08:51.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:51.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864203+0000", 2024-09-14T09:08:51.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000677015 2024-09-14T09:08:51.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:51.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864208+0000", 2024-09-14T09:08:51.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.972e-06 2024-09-14T09:08:51.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:51.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864221+0000", 2024-09-14T09:08:51.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2683e-05 2024-09-14T09:08:51.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:51.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864229+0000", 2024-09-14T09:08:51.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0809999999999994e-06 2024-09-14T09:08:51.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:51.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937430+0000", 2024-09-14T09:08:51.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073201231000000005 2024-09-14T09:08:51.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:51.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937513+0000", 2024-09-14T09:08:51.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2652999999999996e-05 2024-09-14T09:08:51.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:51.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937707+0000", 2024-09-14T09:08:51.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000193616 2024-09-14T09:08:51.300 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.300 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:51.300 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.300 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2331 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 229376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:51.300 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:08:51.300 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.414342080000001, 2024-09-14T09:08:51.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.07400843, 2024-09-14T09:08:51.300 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:51.300 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:51.300 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:51.301 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:51.301 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:51.301 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:51.301 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2331 2024-09-14T09:08:51.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.301 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:51.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:51.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:08:51.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:51.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:08:51.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:51.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868104+0000", 2024-09-14T09:08:51.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003760453 2024-09-14T09:08:51.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:51.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868109+0000", 2024-09-14T09:08:51.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9339999999999997e-06 2024-09-14T09:08:51.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:51.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868119+0000", 2024-09-14T09:08:51.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5389999999999996e-06 2024-09-14T09:08:51.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:51.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868126+0000", 2024-09-14T09:08:51.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4499999999999998e-06 2024-09-14T09:08:51.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:51.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938065+0000", 2024-09-14T09:08:51.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069938809000000005 2024-09-14T09:08:51.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:51.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938148+0000", 2024-09-14T09:08:51.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3171999999999996e-05 2024-09-14T09:08:51.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:51.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938352+0000", 2024-09-14T09:08:51.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020407300000000001 2024-09-14T09:08:51.304 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.304 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:51.304 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.304 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2380 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3239936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:51.304 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:08:51.305 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.399317052000001, 2024-09-14T09:08:51.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073985913, 2024-09-14T09:08:51.305 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:51.305 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:51.305 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:51.305 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:51.305 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:51.305 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:51.305 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2380 2024-09-14T09:08:51.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.305 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:51.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:51.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:08:51.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:51.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:08:51.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:51.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879697+0000", 2024-09-14T09:08:51.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032864100000000001 2024-09-14T09:08:51.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:51.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879702+0000", 2024-09-14T09:08:51.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.578e-06 2024-09-14T09:08:51.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:51.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879716+0000", 2024-09-14T09:08:51.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.413e-05 2024-09-14T09:08:51.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:51.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879724+0000", 2024-09-14T09:08:51.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.559e-06 2024-09-14T09:08:51.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:51.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953155+0000", 2024-09-14T09:08:51.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073431221000000005 2024-09-14T09:08:51.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:51.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953247+0000", 2024-09-14T09:08:51.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1662000000000004e-05 2024-09-14T09:08:51.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:51.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953355+0000", 2024-09-14T09:08:51.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010812200000000001 2024-09-14T09:08:51.309 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.309 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:51.309 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.309 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2500 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2789376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:51.309 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:08:51.309 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.380786006999999, 2024-09-14T09:08:51.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073867281000000007, 2024-09-14T09:08:51.309 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:51.309 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:51.309 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:51.309 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2500 2024-09-14T09:08:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:08:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:08:51.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:51.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:08:51.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1e-07 2024-09-14T09:08:51.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:51.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897901+0000", 2024-09-14T09:08:51.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1650000000000001e-06 2024-09-14T09:08:51.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:51.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897905+0000", 2024-09-14T09:08:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.755e-06 2024-09-14T09:08:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897908+0000", 2024-09-14T09:08:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7480000000000002e-06 2024-09-14T09:08:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971448+0000", 2024-09-14T09:08:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073539801000000002 2024-09-14T09:08:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:51.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971535+0000", 2024-09-14T09:08:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7085999999999999e-05 2024-09-14T09:08:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971767+0000", 2024-09-14T09:08:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023251599999999999 2024-09-14T09:08:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2501 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2850816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:08:51.313 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.380774748, 2024-09-14T09:08:51.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074288858999999999, 2024-09-14T09:08:51.314 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:51.314 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:51.314 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:51.314 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:51.314 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:51.314 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:51.314 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2501 2024-09-14T09:08:51.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.314 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:51.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:51.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:08:51.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:08:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:08:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.41e-07 2024-09-14T09:08:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897913+0000", 2024-09-14T09:08:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3090000000000001e-06 2024-09-14T09:08:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897918+0000", 2024-09-14T09:08:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8470000000000003e-06 2024-09-14T09:08:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897922+0000", 2024-09-14T09:08:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5549999999999996e-06 2024-09-14T09:08:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971872+0000", 2024-09-14T09:08:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073950057999999999 2024-09-14T09:08:51.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971958+0000", 2024-09-14T09:08:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5941999999999998e-05 2024-09-14T09:08:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972200+0000", 2024-09-14T09:08:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000241907 2024-09-14T09:08:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2502 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2912256~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:08:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.380735568, 2024-09-14T09:08:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074614080999999999, 2024-09-14T09:08:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2502 2024-09-14T09:08:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:51.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:08:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:08:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897951+0000", 2024-09-14T09:08:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:08:51.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897953+0000", 2024-09-14T09:08:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5670000000000002e-06 2024-09-14T09:08:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897970+0000", 2024-09-14T09:08:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6319000000000001e-05 2024-09-14T09:08:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897976+0000", 2024-09-14T09:08:51.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8760000000000002e-06 2024-09-14T09:08:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972245+0000", 2024-09-14T09:08:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074269186000000001 2024-09-14T09:08:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972333+0000", 2024-09-14T09:08:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7800999999999995e-05 2024-09-14T09:08:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972564+0000", 2024-09-14T09:08:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000231833 2024-09-14T09:08:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2503 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2973696~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:08:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.380701551, 2024-09-14T09:08:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074944286999999998, 2024-09-14T09:08:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:51.322 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:51.323 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:51.323 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:51.323 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2503 2024-09-14T09:08:51.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.323 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:51.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:51.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:08:51.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:51.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:08:51.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:51.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897985+0000", 2024-09-14T09:08:51.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999998e-07 2024-09-14T09:08:51.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:51.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897987+0000", 2024-09-14T09:08:51.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.401e-06 2024-09-14T09:08:51.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:51.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897999+0000", 2024-09-14T09:08:51.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1851999999999999e-05 2024-09-14T09:08:51.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:51.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898005+0000", 2024-09-14T09:08:51.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9789999999999998e-06 2024-09-14T09:08:51.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:51.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972609+0000", 2024-09-14T09:08:51.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074604217 2024-09-14T09:08:51.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:51.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972684+0000", 2024-09-14T09:08:51.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4777999999999995e-05 2024-09-14T09:08:51.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:51.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972929+0000", 2024-09-14T09:08:51.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024448100000000001 2024-09-14T09:08:51.326 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.326 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:51.326 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.326 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2504 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3035136~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:51.327 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:08:51.327 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.380673459, 2024-09-14T09:08:51.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075285131000000005, 2024-09-14T09:08:51.327 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:51.327 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:51.327 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:51.327 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:51.327 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:51.327 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:51.327 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2504 2024-09-14T09:08:51.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.327 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:51.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:08:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:08:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898078+0000", 2024-09-14T09:08:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5775e-05 2024-09-14T09:08:51.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:51.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898082+0000", 2024-09-14T09:08:51.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.49e-06 2024-09-14T09:08:51.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:51.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898092+0000", 2024-09-14T09:08:51.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0509999999999999e-05 2024-09-14T09:08:51.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:51.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898099+0000", 2024-09-14T09:08:51.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.81e-06 2024-09-14T09:08:51.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:51.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972971+0000", 2024-09-14T09:08:51.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074871788999999994 2024-09-14T09:08:51.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:51.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973055+0000", 2024-09-14T09:08:51.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3980000000000006e-05 2024-09-14T09:08:51.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:51.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973298+0000", 2024-09-14T09:08:51.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024277700000000001 2024-09-14T09:08:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2505 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3096576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:08:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.380577204, 2024-09-14T09:08:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075506668999999998, 2024-09-14T09:08:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:51.331 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2505 2024-09-14T09:08:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:08:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:08:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898370+0000", 2024-09-14T09:08:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026128799999999998 2024-09-14T09:08:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898374+0000", 2024-09-14T09:08:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8070000000000001e-06 2024-09-14T09:08:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898383+0000", 2024-09-14T09:08:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0520000000000007e-06 2024-09-14T09:08:51.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898389+0000", 2024-09-14T09:08:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2639999999999997e-06 2024-09-14T09:08:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973330+0000", 2024-09-14T09:08:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074940548999999995 2024-09-14T09:08:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:51.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973402+0000", 2024-09-14T09:08:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2556000000000001e-05 2024-09-14T09:08:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973615+0000", 2024-09-14T09:08:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000213153 2024-09-14T09:08:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2506 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3158016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:08:51.335 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.38028396, 2024-09-14T09:08:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075556110999999995, 2024-09-14T09:08:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2506 2024-09-14T09:08:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:08:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:08:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898497+0000", 2024-09-14T09:08:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4806e-05 2024-09-14T09:08:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898500+0000", 2024-09-14T09:08:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.54e-06 2024-09-14T09:08:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898507+0000", 2024-09-14T09:08:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1590000000000004e-06 2024-09-14T09:08:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898513+0000", 2024-09-14T09:08:51.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.015e-06 2024-09-14T09:08:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973656+0000", 2024-09-14T09:08:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075142929999999997 2024-09-14T09:08:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973742+0000", 2024-09-14T09:08:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5535e-05 2024-09-14T09:08:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:51.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973958+0000", 2024-09-14T09:08:51.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000216126 2024-09-14T09:08:51.340 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.340 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:51.340 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.340 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2507 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3219456~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:08:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.380155375999999, 2024-09-14T09:08:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075623459000000004, 2024-09-14T09:08:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2507 2024-09-14T09:08:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:08:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:08:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898761+0000", 2024-09-14T09:08:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000230614 2024-09-14T09:08:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898765+0000", 2024-09-14T09:08:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6629999999999999e-06 2024-09-14T09:08:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898774+0000", 2024-09-14T09:08:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6749999999999997e-06 2024-09-14T09:08:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898781+0000", 2024-09-14T09:08:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4640000000000003e-06 2024-09-14T09:08:51.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973985+0000", 2024-09-14T09:08:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075204101999999995 2024-09-14T09:08:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974063+0000", 2024-09-14T09:08:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7632000000000005e-05 2024-09-14T09:08:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974154+0000", 2024-09-14T09:08:51.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1309000000000003e-05 2024-09-14T09:08:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2508 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3280896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:08:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.379893613, 2024-09-14T09:08:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075576943999999993, 2024-09-14T09:08:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:51.345 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2508 2024-09-14T09:08:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:08:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:08:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899176+0000", 2024-09-14T09:08:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038340500000000002 2024-09-14T09:08:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899179+0000", 2024-09-14T09:08:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0290000000000001e-06 2024-09-14T09:08:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899186+0000", 2024-09-14T09:08:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8199999999999999e-06 2024-09-14T09:08:51.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899190+0000", 2024-09-14T09:08:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2050000000000004e-06 2024-09-14T09:08:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974193+0000", 2024-09-14T09:08:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075003632000000001 2024-09-14T09:08:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974276+0000", 2024-09-14T09:08:51.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2272000000000001e-05 2024-09-14T09:08:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974369+0000", 2024-09-14T09:08:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3580999999999997e-05 2024-09-14T09:08:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2509 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3342336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:08:51.349 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.379485996, 2024-09-14T09:08:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075356229999999996, 2024-09-14T09:08:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2509 2024-09-14T09:08:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:08:51.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:08:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899439+0000", 2024-09-14T09:08:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023958599999999999 2024-09-14T09:08:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:51.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899444+0000", 2024-09-14T09:08:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8790000000000002e-06 2024-09-14T09:08:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899455+0000", 2024-09-14T09:08:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0597999999999999e-05 2024-09-14T09:08:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899462+0000", 2024-09-14T09:08:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8179999999999998e-06 2024-09-14T09:08:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974400+0000", 2024-09-14T09:08:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074937999000000005 2024-09-14T09:08:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974465+0000", 2024-09-14T09:08:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5134000000000004e-05 2024-09-14T09:08:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974556+0000", 2024-09-14T09:08:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1216000000000002e-05 2024-09-14T09:08:51.353 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2510 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3403776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:08:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.379210603000001, 2024-09-14T09:08:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075295775999999995, 2024-09-14T09:08:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:51.354 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2510 2024-09-14T09:08:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:08:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:08:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:51.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899691+0000", 2024-09-14T09:08:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021615999999999999 2024-09-14T09:08:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899696+0000", 2024-09-14T09:08:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3200000000000001e-06 2024-09-14T09:08:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899704+0000", 2024-09-14T09:08:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9440000000000005e-06 2024-09-14T09:08:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899710+0000", 2024-09-14T09:08:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.584e-06 2024-09-14T09:08:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974594+0000", 2024-09-14T09:08:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074883551000000007 2024-09-14T09:08:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974679+0000", 2024-09-14T09:08:51.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5365999999999995e-05 2024-09-14T09:08:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974771+0000", 2024-09-14T09:08:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1850999999999999e-05 2024-09-14T09:08:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2511 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3465216~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:08:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.378964385, 2024-09-14T09:08:51.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075234668000000005, 2024-09-14T09:08:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2511 2024-09-14T09:08:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:08:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:08:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899951+0000", 2024-09-14T09:08:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000229569 2024-09-14T09:08:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899955+0000", 2024-09-14T09:08:51.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1010000000000002e-06 2024-09-14T09:08:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899971+0000", 2024-09-14T09:08:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5648999999999999e-05 2024-09-14T09:08:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899978+0000", 2024-09-14T09:08:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0829999999999998e-06 2024-09-14T09:08:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:51.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974806+0000", 2024-09-14T09:08:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074828092999999998 2024-09-14T09:08:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974870+0000", 2024-09-14T09:08:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4492000000000005e-05 2024-09-14T09:08:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974956+0000", 2024-09-14T09:08:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5680999999999995e-05 2024-09-14T09:08:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.362 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2512 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3526656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:08:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.37869684, 2024-09-14T09:08:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075178812999999997, 2024-09-14T09:08:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2512 2024-09-14T09:08:51.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:08:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:08:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:51.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904181+0000", 2024-09-14T09:08:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041919399999999999 2024-09-14T09:08:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904186+0000", 2024-09-14T09:08:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2390000000000002e-06 2024-09-14T09:08:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904199+0000", 2024-09-14T09:08:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2709e-05 2024-09-14T09:08:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904207+0000", 2024-09-14T09:08:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8150000000000006e-06 2024-09-14T09:08:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975000+0000", 2024-09-14T09:08:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.070793444999999997 2024-09-14T09:08:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975079+0000", 2024-09-14T09:08:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8480999999999996e-05 2024-09-14T09:08:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975168+0000", 2024-09-14T09:08:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9184000000000005e-05 2024-09-14T09:08:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:51.367 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:51.369 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:08:51.369 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:51.370+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:51.421 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:08:51.469 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:51.471+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:51.477 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:51.477 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:51.477 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:08:51.478 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:51.486 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:08:51.544 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:51.545 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:51.561 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:51.562 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:51.562 INFO:teuthology.orchestra.run.smithi116.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-14T09:08:51.570 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:51.572+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:51.578 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:51.578 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:51.595 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:51.595 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:51.612 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:51.612 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:51.616 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T09:08:51.617 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T09:08:51.633 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:51.633 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:51.642 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:08:51.645 INFO:teuthology.orchestra.run.smithi148.stdout:4154 read 0xc42a200 thru 0xc42e41f (0x4220 bytes) 2024-09-14T09:08:51.646 INFO:teuthology.orchestra.run.smithi148.stdout:4155 write 0x249de00 thru 0x24a1374 (0x3575 bytes) 2024-09-14T09:08:51.647 INFO:teuthology.orchestra.run.smithi148.stdout:4158 write 0x4886800 thru 0x488d853 (0x7054 bytes) 2024-09-14T09:08:51.648 INFO:teuthology.orchestra.run.smithi148.stdout:4159 read 0x74ee00 thru 0x7504f7 (0x16f8 bytes) 2024-09-14T09:08:51.649 INFO:teuthology.orchestra.run.smithi148.stdout:4161 flatten 2024-09-14T09:08:51.672 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:51.673+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:51.772 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:51.773+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:51.798 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:51.798 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:51.808 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:08:51.873 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:51.875+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:51.949 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:51.949 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:51.958 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:08:51.974 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:51.976+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:52.074 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:52.076+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:52.075 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:52.075 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:52.086 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:08:52.132 INFO:teuthology.orchestra.run.smithi116.stdout:get_pg_num_history pg_num_history pg_num_history(e67 pg_nums {1={14=1},2={17=8},3={22=32}} deleted_pools ) 2024-09-14T09:08:52.133 INFO:teuthology.orchestra.run.smithi116.stdout:Importing pgid 3.f 2024-09-14T09:08:52.133 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f02c87af:::rbd_data.11123620c885.000000000000036c:12# 2024-09-14T09:08:52.133 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f02c87af:::rbd_data.11123620c885.000000000000036c:head# 2024-09-14T09:08:52.133 INFO:teuthology.orchestra.run.smithi116.stdout:snapset 12=[]:{12=[12]} 2024-09-14T09:08:52.134 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f08fb0a9:::rbd_data.111232b23a18.0000000000000072:head# 2024-09-14T09:08:52.134 INFO:teuthology.orchestra.run.smithi116.stdout:snapset 0=[]:{} 2024-09-14T09:08:52.134 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f0c988e9:::rbd_data.111219b19df.000000000000002f:head# 2024-09-14T09:08:52.134 INFO:teuthology.orchestra.run.smithi116.stdout:snapset 0=[]:{} 2024-09-14T09:08:52.135 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f13def0a:::rbd_id.image_client.0-clone8:head# 2024-09-14T09:08:52.135 INFO:teuthology.orchestra.run.smithi116.stdout:snapset 0=[]:{} 2024-09-14T09:08:52.136 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f244351a:::rbd_data.111213dcc65d.000000000000000c:head# 2024-09-14T09:08:52.136 INFO:teuthology.orchestra.run.smithi116.stdout:snapset 5=[]:{} 2024-09-14T09:08:52.136 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f29ed170:::rbd_data.111219b19df.00000000000001b2:head# 2024-09-14T09:08:52.136 INFO:teuthology.orchestra.run.smithi116.stdout:snapset 0=[]:{} 2024-09-14T09:08:52.137 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f359f5dd:::rbd_data.111219b19df.000000000000014f:head# 2024-09-14T09:08:52.137 INFO:teuthology.orchestra.run.smithi116.stdout:snapset 0=[]:{} 2024-09-14T09:08:52.137 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f3ef26b9:::rbd_data.11126408a170.000000000000024e:head# 2024-09-14T09:08:52.137 INFO:teuthology.orchestra.run.smithi116.stdout:snapset 0=[]:{} 2024-09-14T09:08:52.137 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f450d1a6:::rbd_data.111232b23a18.000000000000002e:head# 2024-09-14T09:08:52.138 INFO:teuthology.orchestra.run.smithi116.stdout:snapset 0=[]:{} 2024-09-14T09:08:52.138 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f48173b0:::rbd_data.111232b23a18.0000000000000041:head# 2024-09-14T09:08:52.138 INFO:teuthology.orchestra.run.smithi116.stdout:snapset 0=[]:{} 2024-09-14T09:08:52.139 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f4c685dd:::rbd_data.111219b19df.000000000000010e:head# 2024-09-14T09:08:52.139 INFO:teuthology.orchestra.run.smithi116.stdout:snapset 0=[]:{} 2024-09-14T09:08:52.140 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f555927d:::rbd_data.111219b19df.0000000000000152:head# 2024-09-14T09:08:52.140 INFO:teuthology.orchestra.run.smithi116.stdout:snapset 0=[]:{} 2024-09-14T09:08:52.140 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f5656382:::rbd_data.11128e9202c2.000000000000000b:d# 2024-09-14T09:08:52.141 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f5656382:::rbd_data.11128e9202c2.000000000000000b:head# 2024-09-14T09:08:52.141 INFO:teuthology.orchestra.run.smithi116.stdout:snapset d=[]:{d=[d]} 2024-09-14T09:08:52.141 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f56dfae4:::rbd_data.11128e9202c2.0000000000000008:d# 2024-09-14T09:08:52.141 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f56dfae4:::rbd_data.11128e9202c2.0000000000000008:head# 2024-09-14T09:08:52.142 INFO:teuthology.orchestra.run.smithi116.stdout:snapset d=[]:{d=[d]} 2024-09-14T09:08:52.142 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f5706fb4:::rbd_data.1112ca7492e7.0000000000000022:b# 2024-09-14T09:08:52.142 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f5706fb4:::rbd_data.1112ca7492e7.0000000000000022:head# 2024-09-14T09:08:52.142 INFO:teuthology.orchestra.run.smithi116.stdout:snapset b=[]:{b=[b]} 2024-09-14T09:08:52.142 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f5a4a317:::rbd_data.111219b19df.0000000000000011:head# 2024-09-14T09:08:52.143 INFO:teuthology.orchestra.run.smithi116.stdout:snapset 0=[]:{} 2024-09-14T09:08:52.144 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f6215976:::rbd_object_map.1112609a9334.000000000000000c:head# 2024-09-14T09:08:52.144 INFO:teuthology.orchestra.run.smithi116.stdout:snapset 0=[]:{} 2024-09-14T09:08:52.144 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f62910e4:::rbd_data.11128e9202c2.0000000000000005:d# 2024-09-14T09:08:52.144 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f62910e4:::rbd_data.11128e9202c2.0000000000000005:head# 2024-09-14T09:08:52.145 INFO:teuthology.orchestra.run.smithi116.stdout:snapset d=[]:{d=[d]} 2024-09-14T09:08:52.145 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f63ff947:::rbd_data.11126408a170.00000000000000ac:head# 2024-09-14T09:08:52.145 INFO:teuthology.orchestra.run.smithi116.stdout:snapset 0=[]:{} 2024-09-14T09:08:52.145 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f69daed4:::rbd_data.111219b19df.00000000000001a9:head# 2024-09-14T09:08:52.146 INFO:teuthology.orchestra.run.smithi116.stdout:snapset 0=[]:{} 2024-09-14T09:08:52.146 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f6ec14b2:::rbd_data.1112ca7492e7.0000000000000026:b# 2024-09-14T09:08:52.146 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f6ec14b2:::rbd_data.1112ca7492e7.0000000000000026:head# 2024-09-14T09:08:52.146 INFO:teuthology.orchestra.run.smithi116.stdout:snapset b=[]:{b=[b]} 2024-09-14T09:08:52.146 INFO:teuthology.orchestra.run.smithi116.stdout:Write #3:f766b40e:::rbd_data.111232b23a18.0000000000000044:head# 2024-09-14T09:08:52.146 INFO:teuthology.orchestra.run.smithi116.stdout:snapset 0=[]:{} 2024-09-14T09:08:52.147 INFO:teuthology.orchestra.run.smithi116.stdout:write_pg epoch 67 info 3.f( v 65'185 (0'0,65'185] local-lis/les=66/67 n=28 ec=22/22 lis/c=66/66 les/c/f=67/67/0 sis=66) 2024-09-14T09:08:52.148 INFO:teuthology.orchestra.run.smithi116.stdout:Import successful 2024-09-14T09:08:52.175 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:52.177+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:52.193 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:52.193 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:52.202 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:08:52.287 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:52.289+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:52.351 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:52.352 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:52.361 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:08:52.403 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:52.405+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:52.478 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:52.479+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:52.516 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:52.517 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:52.528 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:08:52.578 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:52.580+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:52.634 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:52.634 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:52.643 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:08:52.667 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f /var/log/ceph/exp.3.f.2 2024-09-14T09:08:52.684 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:52.686+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:52.769 INFO:teuthology.orchestra.run.smithi148.stdout:4162 write 0x4880600 thru 0x488d525 (0xcf26 bytes) 2024-09-14T09:08:52.770 INFO:teuthology.orchestra.run.smithi148.stdout:4164 write 0xa8aca00 thru 0xa8adfb2 (0x15b3 bytes) 2024-09-14T09:08:52.780 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:52.782+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:52.781 INFO:teuthology.orchestra.run.smithi148.stdout:4165 trunc from 0xe36a600 to 0x47d1400 2024-09-14T09:08:52.801 INFO:teuthology.orchestra.run.smithi148.stdout:4166 punch from 0x40c4800 to 0x40ce200, (0x9a00 bytes) 2024-09-14T09:08:52.804 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:52.804 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:52.805 INFO:teuthology.orchestra.run.smithi148.stdout:4167 read 0x1070a00 thru 0x107e13c (0xd73d bytes) 2024-09-14T09:08:52.805 INFO:teuthology.orchestra.run.smithi148.stdout:4168 read 0x1f45c00 thru 0x1f4733d (0x173e bytes) 2024-09-14T09:08:52.805 INFO:teuthology.orchestra.run.smithi148.stdout:4169 read 0x1b6ea00 thru 0x1b79bdd (0xb1de bytes) 2024-09-14T09:08:52.808 INFO:teuthology.orchestra.run.smithi148.stdout:4170 trunc from 0x47d1400 to 0x1b4da00 2024-09-14T09:08:52.814 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:08:52.830 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T09:08:52.846 INFO:teuthology.orchestra.run.smithi148.stdout:4175 write 0x6245c00 thru 0x6254727 (0xeb28 bytes) 2024-09-14T09:08:52.860 INFO:teuthology.orchestra.run.smithi148.stdout:4176 write 0x6ac4e00 thru 0x6ac556c (0x76d bytes) 2024-09-14T09:08:52.861 INFO:teuthology.orchestra.run.smithi148.stdout:4178 read 0x4972c00 thru 0x497910c (0x650d bytes) 2024-09-14T09:08:52.861 INFO:teuthology.orchestra.run.smithi148.stdout:4180 clone 25 order 21 su 524288 sc 2 2024-09-14T09:08:52.881 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:52.883+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:52.924 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:52.924 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:52.933 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:08:52.981 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:52.983+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:53.076 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:53.076 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:53.082 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:53.084+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:53.084 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:08:53.183 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:53.185+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:53.187 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:53.187 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:53.196 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:08:53.284 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:53.286+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:53.339 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:53.340 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:53.348 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:08:53.389 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:53.391+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:53.486 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:53.488+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:53.490 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:53.490 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:53.499 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:08:53.587 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:53.589+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:53.618 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:08:53.644 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:53.644 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:53.653 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:08:53.688 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:53.690+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:53.739 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:53.739 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:53.756 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:53.756 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:53.756 INFO:teuthology.orchestra.run.smithi116.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-14T09:08:53.773 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:53.773 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:53.789 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:53.791+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:53.790 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:53.790 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:53.799 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:53.799 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:53.799 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:53.799 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:53.799 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:53.807 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:53.807 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:53.808 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:08:53.811 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T09:08:53.811 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T09:08:53.825 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is unset 2024-09-14T09:08:53.890 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:53.892+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:53.919 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:53.919 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:53.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:53.919 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:53.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.919 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:08:53.919 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:53.919 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 83.687464098999996, 2024-09-14T09:08:53.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72111598600000004, 2024-09-14T09:08:53.920 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:53.920 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:53.920 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:53.920 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:53.920 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:08:53.920 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:08:53.920 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1 2024-09-14T09:08:53.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.920 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:53.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.921 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:53.921 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:53.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.921 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:53.921 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:53.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.921 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:53.921 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233065+0000", 2024-09-14T09:08:53.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1909999999999999e-06 2024-09-14T09:08:53.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:53.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233071+0000", 2024-09-14T09:08:53.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5300000000000002e-06 2024-09-14T09:08:53.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:53.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233081+0000", 2024-09-14T09:08:53.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0339e-05 2024-09-14T09:08:53.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:53.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233093+0000", 2024-09-14T09:08:53.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1252e-05 2024-09-14T09:08:53.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:53.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233162+0000", 2024-09-14T09:08:53.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9678999999999995e-05 2024-09-14T09:08:53.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:08:53.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233171+0000", 2024-09-14T09:08:53.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.132e-06 2024-09-14T09:08:53.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:53.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952480+0000", 2024-09-14T09:08:53.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.71930839899999999 2024-09-14T09:08:53.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:53.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952655+0000", 2024-09-14T09:08:53.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017552 2024-09-14T09:08:53.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:53.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952835+0000", 2024-09-14T09:08:53.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001797 2024-09-14T09:08:53.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:53.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.953648+0000", 2024-09-14T09:08:53.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00081291700000000002 2024-09-14T09:08:53.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:53.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954108+0000", 2024-09-14T09:08:53.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045992800000000002 2024-09-14T09:08:53.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:53.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954149+0000", 2024-09-14T09:08:53.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1214999999999998e-05 2024-09-14T09:08:53.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.926 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:53.926 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954178+0000", 2024-09-14T09:08:53.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9184e-05 2024-09-14T09:08:53.926 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.926 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:53.926 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.926 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:11931 3.1a 3:5f6725a9:::rbd_header.111219b19df:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:53.926 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.722408+0000", 2024-09-14T09:08:53.926 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.198118912999998, 2024-09-14T09:08:53.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.089863542000000005, 2024-09-14T09:08:53.927 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:53.927 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:53.927 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:53.927 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:53.927 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:08:53.927 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:08:53.927 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11931 2024-09-14T09:08:53.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.927 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:53.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.927 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:53.927 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.722408+0000", 2024-09-14T09:08:53.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:53.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.722408+0000", 2024-09-14T09:08:53.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:53.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812037+0000", 2024-09-14T09:08:53.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.089629082999999998 2024-09-14T09:08:53.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:53.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812042+0000", 2024-09-14T09:08:53.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5790000000000003e-06 2024-09-14T09:08:53.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:53.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812051+0000", 2024-09-14T09:08:53.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1689999999999998e-06 2024-09-14T09:08:53.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:53.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812058+0000", 2024-09-14T09:08:53.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.725e-06 2024-09-14T09:08:53.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:53.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812117+0000", 2024-09-14T09:08:53.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8483999999999998e-05 2024-09-14T09:08:53.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:53.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812183+0000", 2024-09-14T09:08:53.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6759000000000002e-05 2024-09-14T09:08:53.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:53.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812271+0000", 2024-09-14T09:08:53.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7743000000000003e-05 2024-09-14T09:08:53.930 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.930 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:53.930 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.930 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9655 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 811008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:53.930 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.688987+0000", 2024-09-14T09:08:53.931 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.231539576999999, 2024-09-14T09:08:53.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044554783000000001, 2024-09-14T09:08:53.931 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:53.931 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:53.931 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:53.931 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:53.931 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:53.931 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:53.931 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9655 2024-09-14T09:08:53.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.931 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:53.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.931 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:53.931 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.688987+0000", 2024-09-14T09:08:53.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:53.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.688987+0000", 2024-09-14T09:08:53.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:53.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.688987+0000", 2024-09-14T09:08:53.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4300000000000003e-07 2024-09-14T09:08:53.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:53.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.688989+0000", 2024-09-14T09:08:53.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7969999999999999e-06 2024-09-14T09:08:53.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:53.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.688995+0000", 2024-09-14T09:08:53.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1310000000000003e-06 2024-09-14T09:08:53.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:53.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689000+0000", 2024-09-14T09:08:53.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4870000000000004e-06 2024-09-14T09:08:53.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:53.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733378+0000", 2024-09-14T09:08:53.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044377658 2024-09-14T09:08:53.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:53.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733454+0000", 2024-09-14T09:08:53.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6884000000000005e-05 2024-09-14T09:08:53.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:53.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733542+0000", 2024-09-14T09:08:53.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7282999999999998e-05 2024-09-14T09:08:53.934 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.934 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:53.934 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.935 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9656 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 872448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:53.935 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.689005+0000", 2024-09-14T09:08:53.935 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.231521228999998, 2024-09-14T09:08:53.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044678214000000001, 2024-09-14T09:08:53.935 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:53.935 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:53.935 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:53.935 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:53.935 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:53.935 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:53.936 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9656 2024-09-14T09:08:53.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.936 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:53.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:53.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689005+0000", 2024-09-14T09:08:53.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:53.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689005+0000", 2024-09-14T09:08:53.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:53.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689006+0000", 2024-09-14T09:08:53.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.51e-07 2024-09-14T09:08:53.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:53.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689007+0000", 2024-09-14T09:08:53.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.699e-06 2024-09-14T09:08:53.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:53.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689013+0000", 2024-09-14T09:08:53.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.609e-06 2024-09-14T09:08:53.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:53.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689018+0000", 2024-09-14T09:08:53.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7319999999999998e-06 2024-09-14T09:08:53.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:53.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733570+0000", 2024-09-14T09:08:53.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044552691999999998 2024-09-14T09:08:53.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:53.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733610+0000", 2024-09-14T09:08:53.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9366000000000002e-05 2024-09-14T09:08:53.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:53.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733683+0000", 2024-09-14T09:08:53.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3664999999999994e-05 2024-09-14T09:08:53.939 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.939 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:53.939 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.939 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9657 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 933888~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:53.939 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.689024+0000", 2024-09-14T09:08:53.939 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.231502943999999, 2024-09-14T09:08:53.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044870122999999998, 2024-09-14T09:08:53.939 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:53.939 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:53.939 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:53.940 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:53.940 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:53.940 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:53.940 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9657 2024-09-14T09:08:53.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.940 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:53.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:53.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689024+0000", 2024-09-14T09:08:53.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:53.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689024+0000", 2024-09-14T09:08:53.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:53.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689024+0000", 2024-09-14T09:08:53.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.27e-07 2024-09-14T09:08:53.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:53.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689026+0000", 2024-09-14T09:08:53.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9180000000000001e-06 2024-09-14T09:08:53.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:53.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689032+0000", 2024-09-14T09:08:53.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9050000000000002e-06 2024-09-14T09:08:53.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:53.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689036+0000", 2024-09-14T09:08:53.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6380000000000003e-06 2024-09-14T09:08:53.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:53.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733724+0000", 2024-09-14T09:08:53.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044687326999999999 2024-09-14T09:08:53.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:53.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733802+0000", 2024-09-14T09:08:53.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8486999999999996e-05 2024-09-14T09:08:53.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:53.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733894+0000", 2024-09-14T09:08:53.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1520999999999993e-05 2024-09-14T09:08:53.943 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.943 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:53.943 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.944 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9658 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 995328~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:53.944 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.689042+0000", 2024-09-14T09:08:53.944 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.231484784999999, 2024-09-14T09:08:53.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045057038000000001, 2024-09-14T09:08:53.944 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:53.944 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:53.944 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:53.944 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:53.944 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:53.944 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:53.944 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9658 2024-09-14T09:08:53.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.944 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:53.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:53.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689042+0000", 2024-09-14T09:08:53.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:53.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689042+0000", 2024-09-14T09:08:53.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:53.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693052+0000", 2024-09-14T09:08:53.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040104859999999997 2024-09-14T09:08:53.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:53.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693055+0000", 2024-09-14T09:08:53.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6929999999999999e-06 2024-09-14T09:08:53.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:53.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693065+0000", 2024-09-14T09:08:53.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0220999999999999e-05 2024-09-14T09:08:53.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:53.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693069+0000", 2024-09-14T09:08:53.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1180000000000002e-06 2024-09-14T09:08:53.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:53.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733926+0000", 2024-09-14T09:08:53.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040856418999999998 2024-09-14T09:08:53.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:53.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.734011+0000", 2024-09-14T09:08:53.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4902999999999997e-05 2024-09-14T09:08:53.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:53.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.734099+0000", 2024-09-14T09:08:53.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8197999999999998e-05 2024-09-14T09:08:53.948 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.948 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:53.948 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.948 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9683 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2531328~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:53.948 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.693341+0000", 2024-09-14T09:08:53.948 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.227185148, 2024-09-14T09:08:53.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044718463999999999, 2024-09-14T09:08:53.948 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:53.948 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:53.948 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:53.948 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:53.949 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:53.949 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:53.949 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9683 2024-09-14T09:08:53.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.949 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:53.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:53.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693341+0000", 2024-09-14T09:08:53.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:53.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693341+0000", 2024-09-14T09:08:53.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:53.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693342+0000", 2024-09-14T09:08:53.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:08:53.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:53.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693343+0000", 2024-09-14T09:08:53.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2219999999999999e-06 2024-09-14T09:08:53.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:53.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693346+0000", 2024-09-14T09:08:53.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.785e-06 2024-09-14T09:08:53.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:53.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693348+0000", 2024-09-14T09:08:53.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4229999999999999e-06 2024-09-14T09:08:53.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:53.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.737876+0000", 2024-09-14T09:08:53.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044527870999999997 2024-09-14T09:08:53.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:53.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.737968+0000", 2024-09-14T09:08:53.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1859000000000003e-05 2024-09-14T09:08:53.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:53.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738060+0000", 2024-09-14T09:08:53.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2095000000000005e-05 2024-09-14T09:08:53.952 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.952 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:53.952 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.952 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9684 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2592768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:53.953 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.693351+0000", 2024-09-14T09:08:53.953 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.227175556999999, 2024-09-14T09:08:53.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044936873000000002, 2024-09-14T09:08:53.953 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:53.953 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:53.953 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:53.953 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:53.953 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:53.953 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:53.953 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9684 2024-09-14T09:08:53.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.953 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:53.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:53.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693351+0000", 2024-09-14T09:08:53.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:53.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693351+0000", 2024-09-14T09:08:53.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:53.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693351+0000", 2024-09-14T09:08:53.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3999999999999998e-07 2024-09-14T09:08:53.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:53.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693352+0000", 2024-09-14T09:08:53.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0470000000000001e-06 2024-09-14T09:08:53.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:53.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693355+0000", 2024-09-14T09:08:53.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8320000000000002e-06 2024-09-14T09:08:53.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:53.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693358+0000", 2024-09-14T09:08:53.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5270000000000001e-06 2024-09-14T09:08:53.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:53.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738104+0000", 2024-09-14T09:08:53.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044746459000000002 2024-09-14T09:08:53.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:53.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738194+0000", 2024-09-14T09:08:53.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0062999999999995e-05 2024-09-14T09:08:53.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:53.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738288+0000", 2024-09-14T09:08:53.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3704999999999998e-05 2024-09-14T09:08:53.956 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.956 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:53.957 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.957 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9685 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2654208~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:53.957 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.693377+0000", 2024-09-14T09:08:53.957 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.227148989, 2024-09-14T09:08:53.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045136784999999999, 2024-09-14T09:08:53.957 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:53.957 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:53.957 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:53.957 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:53.957 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:53.957 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:53.957 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9685 2024-09-14T09:08:53.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.958 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:53.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:53.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693377+0000", 2024-09-14T09:08:53.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:53.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693377+0000", 2024-09-14T09:08:53.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:53.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693378+0000", 2024-09-14T09:08:53.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8500000000000002e-07 2024-09-14T09:08:53.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:53.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693379+0000", 2024-09-14T09:08:53.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.387e-06 2024-09-14T09:08:53.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:53.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693383+0000", 2024-09-14T09:08:53.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3699999999999999e-06 2024-09-14T09:08:53.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:53.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693385+0000", 2024-09-14T09:08:53.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5469999999999999e-06 2024-09-14T09:08:53.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:53.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738329+0000", 2024-09-14T09:08:53.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044943603999999998 2024-09-14T09:08:53.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:53.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738414+0000", 2024-09-14T09:08:53.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4763000000000001e-05 2024-09-14T09:08:53.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:53.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738514+0000", 2024-09-14T09:08:53.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000100629 2024-09-14T09:08:53.961 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.961 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:53.961 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.961 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9686 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2715648~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:53.961 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.693389+0000", 2024-09-14T09:08:53.961 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.227137903999999, 2024-09-14T09:08:53.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045314315000000001, 2024-09-14T09:08:53.962 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:53.962 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:53.962 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:53.962 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:53.962 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:53.962 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:53.962 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9686 2024-09-14T09:08:53.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.962 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:53.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:53.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693389+0000", 2024-09-14T09:08:53.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:53.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693389+0000", 2024-09-14T09:08:53.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:53.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693389+0000", 2024-09-14T09:08:53.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9499999999999998e-07 2024-09-14T09:08:53.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:53.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693390+0000", 2024-09-14T09:08:53.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0410000000000001e-06 2024-09-14T09:08:53.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:53.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693393+0000", 2024-09-14T09:08:53.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.774e-06 2024-09-14T09:08:53.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:53.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693395+0000", 2024-09-14T09:08:53.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.475e-06 2024-09-14T09:08:53.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:53.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738539+0000", 2024-09-14T09:08:53.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045143902999999999 2024-09-14T09:08:53.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:53.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738613+0000", 2024-09-14T09:08:53.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4410000000000001e-05 2024-09-14T09:08:53.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:53.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738703+0000", 2024-09-14T09:08:53.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9417000000000001e-05 2024-09-14T09:08:53.966 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.966 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:53.966 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.966 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9687 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2777088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:53.966 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.693398+0000", 2024-09-14T09:08:53.966 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.227128223000001, 2024-09-14T09:08:53.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045501822999999997, 2024-09-14T09:08:53.966 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:53.966 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:53.966 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:53.967 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:53.967 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:53.967 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:53.967 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9687 2024-09-14T09:08:53.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.967 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:53.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:53.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693398+0000", 2024-09-14T09:08:53.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:53.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693398+0000", 2024-09-14T09:08:53.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:53.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694375+0000", 2024-09-14T09:08:53.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00097630899999999997 2024-09-14T09:08:53.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:53.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694377+0000", 2024-09-14T09:08:53.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.108e-06 2024-09-14T09:08:53.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:53.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694382+0000", 2024-09-14T09:08:53.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9679999999999997e-06 2024-09-14T09:08:53.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:53.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694385+0000", 2024-09-14T09:08:53.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2040000000000002e-06 2024-09-14T09:08:53.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:53.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738732+0000", 2024-09-14T09:08:53.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044346974999999997 2024-09-14T09:08:53.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:53.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738809+0000", 2024-09-14T09:08:53.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7174000000000003e-05 2024-09-14T09:08:53.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:53.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738900+0000", 2024-09-14T09:08:53.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1085e-05 2024-09-14T09:08:53.970 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.971 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:53.971 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.971 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9688 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2838528~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:53.971 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694390+0000", 2024-09-14T09:08:53.971 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.226135986999999, 2024-09-14T09:08:53.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044706231999999999, 2024-09-14T09:08:53.971 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:53.971 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:53.971 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:53.972 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:53.972 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:53.972 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:53.972 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9688 2024-09-14T09:08:53.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.972 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:53.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:53.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694390+0000", 2024-09-14T09:08:53.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:53.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694390+0000", 2024-09-14T09:08:53.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:53.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694391+0000", 2024-09-14T09:08:53.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.41e-07 2024-09-14T09:08:53.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:53.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694392+0000", 2024-09-14T09:08:53.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1090000000000001e-06 2024-09-14T09:08:53.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:53.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694397+0000", 2024-09-14T09:08:53.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.293e-06 2024-09-14T09:08:53.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:53.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694400+0000", 2024-09-14T09:08:53.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8909999999999999e-06 2024-09-14T09:08:53.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:53.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738930+0000", 2024-09-14T09:08:53.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044529812000000002 2024-09-14T09:08:53.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:53.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739011+0000", 2024-09-14T09:08:53.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1143999999999994e-05 2024-09-14T09:08:53.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:53.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739097+0000", 2024-09-14T09:08:53.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5741999999999993e-05 2024-09-14T09:08:53.975 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.975 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:53.975 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.976 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9689 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2899968~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:53.976 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694403+0000", 2024-09-14T09:08:53.976 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.226123162, 2024-09-14T09:08:53.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044887095000000002, 2024-09-14T09:08:53.976 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:53.976 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:53.976 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:53.976 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:53.976 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:53.976 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:53.976 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9689 2024-09-14T09:08:53.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.977 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:53.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:53.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694403+0000", 2024-09-14T09:08:53.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:53.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694403+0000", 2024-09-14T09:08:53.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:53.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694404+0000", 2024-09-14T09:08:53.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.77e-07 2024-09-14T09:08:53.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:53.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694408+0000", 2024-09-14T09:08:53.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0010000000000003e-06 2024-09-14T09:08:53.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:53.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694412+0000", 2024-09-14T09:08:53.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0500000000000002e-06 2024-09-14T09:08:53.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:53.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694414+0000", 2024-09-14T09:08:53.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7300000000000001e-06 2024-09-14T09:08:53.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:53.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739126+0000", 2024-09-14T09:08:53.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044711199 2024-09-14T09:08:53.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:53.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739205+0000", 2024-09-14T09:08:53.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8926999999999998e-05 2024-09-14T09:08:53.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:53.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739290+0000", 2024-09-14T09:08:53.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5810999999999995e-05 2024-09-14T09:08:53.980 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.980 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:53.980 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.980 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9690 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2961408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694418+0000", 2024-09-14T09:08:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.226108602, 2024-09-14T09:08:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045014599000000002, 2024-09-14T09:08:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9690 2024-09-14T09:08:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694418+0000", 2024-09-14T09:08:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694418+0000", 2024-09-14T09:08:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694418+0000", 2024-09-14T09:08:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.05e-07 2024-09-14T09:08:53.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694419+0000", 2024-09-14T09:08:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0890000000000001e-06 2024-09-14T09:08:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694422+0000", 2024-09-14T09:08:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.802e-06 2024-09-14T09:08:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694424+0000", 2024-09-14T09:08:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.497e-06 2024-09-14T09:08:53.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739328+0000", 2024-09-14T09:08:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044903699999999998 2024-09-14T09:08:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739375+0000", 2024-09-14T09:08:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7265000000000002e-05 2024-09-14T09:08:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739432+0000", 2024-09-14T09:08:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7040999999999998e-05 2024-09-14T09:08:53.984 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9691 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 3022848~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694427+0000", 2024-09-14T09:08:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.226099029, 2024-09-14T09:08:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045238403000000003, 2024-09-14T09:08:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:53.985 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9691 2024-09-14T09:08:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694427+0000", 2024-09-14T09:08:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694427+0000", 2024-09-14T09:08:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:53.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694428+0000", 2024-09-14T09:08:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.05e-07 2024-09-14T09:08:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694429+0000", 2024-09-14T09:08:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6700000000000002e-07 2024-09-14T09:08:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694432+0000", 2024-09-14T09:08:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8940000000000002e-06 2024-09-14T09:08:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694434+0000", 2024-09-14T09:08:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5009999999999999e-06 2024-09-14T09:08:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739479+0000", 2024-09-14T09:08:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045044806999999999 2024-09-14T09:08:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739568+0000", 2024-09-14T09:08:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9061999999999995e-05 2024-09-14T09:08:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739666+0000", 2024-09-14T09:08:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7967000000000006e-05 2024-09-14T09:08:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9692 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 3084288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694437+0000", 2024-09-14T09:08:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.226089566999999, 2024-09-14T09:08:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045365111999999999, 2024-09-14T09:08:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:53.989 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9692 2024-09-14T09:08:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694437+0000", 2024-09-14T09:08:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:53.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694437+0000", 2024-09-14T09:08:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694437+0000", 2024-09-14T09:08:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8999999999999998e-07 2024-09-14T09:08:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694438+0000", 2024-09-14T09:08:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0249999999999999e-06 2024-09-14T09:08:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694441+0000", 2024-09-14T09:08:53.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.835e-06 2024-09-14T09:08:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694443+0000", 2024-09-14T09:08:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4329999999999998e-06 2024-09-14T09:08:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739699+0000", 2024-09-14T09:08:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045255457999999998 2024-09-14T09:08:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739746+0000", 2024-09-14T09:08:53.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7132000000000002e-05 2024-09-14T09:08:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739802+0000", 2024-09-14T09:08:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5939000000000001e-05 2024-09-14T09:08:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9693 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 3145728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694446+0000", 2024-09-14T09:08:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.226080239000002, 2024-09-14T09:08:53.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045601007999999998, 2024-09-14T09:08:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9693 2024-09-14T09:08:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694446+0000", 2024-09-14T09:08:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694446+0000", 2024-09-14T09:08:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694446+0000", 2024-09-14T09:08:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1e-07 2024-09-14T09:08:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694447+0000", 2024-09-14T09:08:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9099999999999991e-07 2024-09-14T09:08:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694450+0000", 2024-09-14T09:08:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8049999999999998e-06 2024-09-14T09:08:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694453+0000", 2024-09-14T09:08:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4480000000000001e-06 2024-09-14T09:08:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739854+0000", 2024-09-14T09:08:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045401336 2024-09-14T09:08:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739942+0000", 2024-09-14T09:08:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8339999999999998e-05 2024-09-14T09:08:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.740047+0000", 2024-09-14T09:08:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010487799999999999 2024-09-14T09:08:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9694 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 3207168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:53.997 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694456+0000", 2024-09-14T09:08:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.226070944, 2024-09-14T09:08:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045779780999999999, 2024-09-14T09:08:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9694 2024-09-14T09:08:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694456+0000", 2024-09-14T09:08:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694456+0000", 2024-09-14T09:08:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699125+0000", 2024-09-14T09:08:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046694359999999999 2024-09-14T09:08:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699127+0000", 2024-09-14T09:08:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.996e-06 2024-09-14T09:08:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699132+0000", 2024-09-14T09:08:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1970000000000004e-06 2024-09-14T09:08:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699136+0000", 2024-09-14T09:08:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3419999999999999e-06 2024-09-14T09:08:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.740084+0000", 2024-09-14T09:08:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040948311000000001 2024-09-14T09:08:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.740147+0000", 2024-09-14T09:08:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.368e-05 2024-09-14T09:08:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.740235+0000", 2024-09-14T09:08:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7818999999999994e-05 2024-09-14T09:08:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9748 3.10 3:0e07f4ad:::rbd_data.111219b19df.00000000000001c6:head [set-alloc-hint object_size 524288 write_size 524288,write 413696~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.699380+0000", 2024-09-14T09:08:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.221146340000001, 2024-09-14T09:08:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045171442999999999, 2024-09-14T09:08:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9748 2024-09-14T09:08:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699380+0000", 2024-09-14T09:08:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699380+0000", 2024-09-14T09:08:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699380+0000", 2024-09-14T09:08:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2000000000000001e-07 2024-09-14T09:08:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699386+0000", 2024-09-14T09:08:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9390000000000002e-06 2024-09-14T09:08:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699390+0000", 2024-09-14T09:08:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.32e-06 2024-09-14T09:08:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699392+0000", 2024-09-14T09:08:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5019999999999999e-06 2024-09-14T09:08:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.743265+0000", 2024-09-14T09:08:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.043872479999999998 2024-09-14T09:08:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.743387+0000", 2024-09-14T09:08:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012264 2024-09-14T09:08:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.743546+0000", 2024-09-14T09:08:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000158369 2024-09-14T09:08:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744431+0000", 2024-09-14T09:08:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00088561900000000003 2024-09-14T09:08:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744449+0000", 2024-09-14T09:08:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8096000000000001e-05 2024-09-14T09:08:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744504+0000", 2024-09-14T09:08:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4837999999999999e-05 2024-09-14T09:08:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744552+0000", 2024-09-14T09:08:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7420000000000003e-05 2024-09-14T09:08:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9766 3.10 3:0e07f4ad:::rbd_data.111219b19df.00000000000001c6:head [read 409600~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.699552+0000", 2024-09-14T09:08:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.220974003999999, 2024-09-14T09:08:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045179127999999999, 2024-09-14T09:08:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9766 2024-09-14T09:08:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699552+0000", 2024-09-14T09:08:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699552+0000", 2024-09-14T09:08:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699553+0000", 2024-09-14T09:08:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0200000000000003e-07 2024-09-14T09:08:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699555+0000", 2024-09-14T09:08:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.844e-06 2024-09-14T09:08:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699561+0000", 2024-09-14T09:08:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0859999999999998e-06 2024-09-14T09:08:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699567+0000", 2024-09-14T09:08:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8619999999999999e-06 2024-09-14T09:08:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744017+0000", 2024-09-14T09:08:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044450311999999999 2024-09-14T09:08:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for rw locks", 2024-09-14T09:08:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744054+0000", 2024-09-14T09:08:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6910999999999999e-05 2024-09-14T09:08:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744581+0000", 2024-09-14T09:08:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00052667899999999995 2024-09-14T09:08:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744639+0000", 2024-09-14T09:08:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8310999999999998e-05 2024-09-14T09:08:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744732+0000", 2024-09-14T09:08:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2720999999999995e-05 2024-09-14T09:08:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:54.014 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:54.015 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:08:54.016 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:54.017+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:54.116 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:54.118+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:54.126 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:54.126 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:54.126 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:54.126 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:54.134 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:08:54.217 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:54.219+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:54.283 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:54.284 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:54.284 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:54.284 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:54.284 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:54.284 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:08:54.318 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:54.320+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:54.371 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #23, image image_client.0-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent24 2024-09-14T09:08:54.419 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:54.421+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:54.438 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:54.438 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:54.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:54.438 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:54.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.438 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:246 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:54.438 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:08:54.438 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.641469444999998, 2024-09-14T09:08:54.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99004581000000003, 2024-09-14T09:08:54.438 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 246 2024-09-14T09:08:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:08:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:08:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796750+0000", 2024-09-14T09:08:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5519999999999999e-06 2024-09-14T09:08:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796754+0000", 2024-09-14T09:08:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2640000000000002e-06 2024-09-14T09:08:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796767+0000", 2024-09-14T09:08:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3517e-05 2024-09-14T09:08:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796775+0000", 2024-09-14T09:08:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8790000000000003e-06 2024-09-14T09:08:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796830+0000", 2024-09-14T09:08:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4829e-05 2024-09-14T09:08:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796843+0000", 2024-09-14T09:08:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.33e-05 2024-09-14T09:08:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786501+0000", 2024-09-14T09:08:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98965769299999995 2024-09-14T09:08:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786653+0000", 2024-09-14T09:08:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015237200000000001 2024-09-14T09:08:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786794+0000", 2024-09-14T09:08:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014040400000000001 2024-09-14T09:08:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:247 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 720896~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.641414658999999, 2024-09-14T09:08:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99048688100000004, 2024-09-14T09:08:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 247 2024-09-14T09:08:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7299999999999995e-07 2024-09-14T09:08:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796807+0000", 2024-09-14T09:08:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.106e-06 2024-09-14T09:08:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796815+0000", 2024-09-14T09:08:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4740000000000005e-06 2024-09-14T09:08:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796821+0000", 2024-09-14T09:08:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0469999999999999e-06 2024-09-14T09:08:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796872+0000", 2024-09-14T09:08:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0834000000000002e-05 2024-09-14T09:08:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796878+0000", 2024-09-14T09:08:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2990000000000002e-06 2024-09-14T09:08:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787176+0000", 2024-09-14T09:08:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99029817600000003 2024-09-14T09:08:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787225+0000", 2024-09-14T09:08:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8953999999999999e-05 2024-09-14T09:08:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787290+0000", 2024-09-14T09:08:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4318000000000003e-05 2024-09-14T09:08:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:248 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1179648~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:08:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.64138414, 2024-09-14T09:08:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99060754200000001, 2024-09-14T09:08:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 248 2024-09-14T09:08:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:08:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:08:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796834+0000", 2024-09-14T09:08:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4099999999999999e-07 2024-09-14T09:08:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796837+0000", 2024-09-14T09:08:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8459999999999999e-06 2024-09-14T09:08:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796844+0000", 2024-09-14T09:08:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1350000000000003e-06 2024-09-14T09:08:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796850+0000", 2024-09-14T09:08:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7139999999999998e-06 2024-09-14T09:08:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3909999999999998e-05 2024-09-14T09:08:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796899+0000", 2024-09-14T09:08:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7649999999999999e-06 2024-09-14T09:08:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787318+0000", 2024-09-14T09:08:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99041848300000002 2024-09-14T09:08:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787365+0000", 2024-09-14T09:08:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7086999999999998e-05 2024-09-14T09:08:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787441+0000", 2024-09-14T09:08:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6061000000000002e-05 2024-09-14T09:08:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:249 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1638400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:08:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.641350371000001, 2024-09-14T09:08:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99070346899999995, 2024-09-14T09:08:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 249 2024-09-14T09:08:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:08:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:08:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796868+0000", 2024-09-14T09:08:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2024-09-14T09:08:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796870+0000", 2024-09-14T09:08:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7889999999999999e-06 2024-09-14T09:08:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796877+0000", 2024-09-14T09:08:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8549999999999996e-06 2024-09-14T09:08:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796883+0000", 2024-09-14T09:08:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.665e-06 2024-09-14T09:08:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796915+0000", 2024-09-14T09:08:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2215999999999998e-05 2024-09-14T09:08:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796920+0000", 2024-09-14T09:08:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.527e-06 2024-09-14T09:08:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787468+0000", 2024-09-14T09:08:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99054877100000005 2024-09-14T09:08:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787512+0000", 2024-09-14T09:08:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3958000000000002e-05 2024-09-14T09:08:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787571+0000", 2024-09-14T09:08:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8167000000000001e-05 2024-09-14T09:08:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:250 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2097152~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.641324305000001, 2024-09-14T09:08:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99079431100000004, 2024-09-14T09:08:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 250 2024-09-14T09:08:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796894+0000", 2024-09-14T09:08:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2024-09-14T09:08:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796896+0000", 2024-09-14T09:08:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5600000000000001e-06 2024-09-14T09:08:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796902+0000", 2024-09-14T09:08:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3090000000000001e-06 2024-09-14T09:08:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796909+0000", 2024-09-14T09:08:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:08:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796942+0000", 2024-09-14T09:08:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-05 2024-09-14T09:08:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796948+0000", 2024-09-14T09:08:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5910000000000001e-06 2024-09-14T09:08:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787596+0000", 2024-09-14T09:08:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99064781400000002 2024-09-14T09:08:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787636+0000", 2024-09-14T09:08:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9715000000000002e-05 2024-09-14T09:08:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787687+0000", 2024-09-14T09:08:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1674e-05 2024-09-14T09:08:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:251 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:54.469 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.64129887, 2024-09-14T09:08:54.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99091769600000001, 2024-09-14T09:08:54.469 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:54.469 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:54.469 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:54.469 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:54.469 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:54.469 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:54.469 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 251 2024-09-14T09:08:54.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.469 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:54.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:54.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000005e-07 2024-09-14T09:08:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796922+0000", 2024-09-14T09:08:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.875e-06 2024-09-14T09:08:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796929+0000", 2024-09-14T09:08:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0260000000000002e-06 2024-09-14T09:08:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796935+0000", 2024-09-14T09:08:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7030000000000003e-06 2024-09-14T09:08:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796963+0000", 2024-09-14T09:08:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8368999999999999e-05 2024-09-14T09:08:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796966+0000", 2024-09-14T09:08:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4130000000000002e-06 2024-09-14T09:08:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787718+0000", 2024-09-14T09:08:54.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99075151100000003 2024-09-14T09:08:54.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:54.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787779+0000", 2024-09-14T09:08:54.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.088e-05 2024-09-14T09:08:54.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787836+0000", 2024-09-14T09:08:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7380000000000003e-05 2024-09-14T09:08:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:252 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:08:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.641273416000001, 2024-09-14T09:08:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99102491400000003, 2024-09-14T09:08:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 252 2024-09-14T09:08:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:08:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:08:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796945+0000", 2024-09-14T09:08:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2900000000000003e-07 2024-09-14T09:08:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796947+0000", 2024-09-14T09:08:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4279999999999999e-06 2024-09-14T09:08:54.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:54.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796954+0000", 2024-09-14T09:08:54.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5479999999999998e-06 2024-09-14T09:08:54.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796959+0000", 2024-09-14T09:08:54.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.22e-06 2024-09-14T09:08:54.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796988+0000", 2024-09-14T09:08:54.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9473000000000001e-05 2024-09-14T09:08:54.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:54.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:08:54.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:08:54.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787850+0000", 2024-09-14T09:08:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99085651100000005 2024-09-14T09:08:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787891+0000", 2024-09-14T09:08:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602000000000002e-05 2024-09-14T09:08:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787969+0000", 2024-09-14T09:08:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8063000000000001e-05 2024-09-14T09:08:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:253 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.641249536, 2024-09-14T09:08:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99122695699999996, 2024-09-14T09:08:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:54.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:54.481 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 253 2024-09-14T09:08:54.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.481 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:54.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:54.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:54.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:54.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:54.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:08:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:08:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:08:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796977+0000", 2024-09-14T09:08:54.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5030000000000002e-06 2024-09-14T09:08:54.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796982+0000", 2024-09-14T09:08:54.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2024-09-14T09:08:54.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797013+0000", 2024-09-14T09:08:54.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0451e-05 2024-09-14T09:08:54.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:54.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:08:54.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1690000000000001e-06 2024-09-14T09:08:54.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788011+0000", 2024-09-14T09:08:54.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99099490300000004 2024-09-14T09:08:54.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:54.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788102+0000", 2024-09-14T09:08:54.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0730999999999996e-05 2024-09-14T09:08:54.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:54.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788195+0000", 2024-09-14T09:08:54.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3245999999999995e-05 2024-09-14T09:08:54.485 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.485 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.485 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.485 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:254 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3932160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:54.485 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:08:54.485 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.641217978, 2024-09-14T09:08:54.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99137410500000001, 2024-09-14T09:08:54.486 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:54.486 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:54.486 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:54.486 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:54.486 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:54.486 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:54.486 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 254 2024-09-14T09:08:54.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.486 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:54.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:54.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:08:54.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:54.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:08:54.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:54.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797000+0000", 2024-09-14T09:08:54.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:08:54.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797003+0000", 2024-09-14T09:08:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7659999999999999e-06 2024-09-14T09:08:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797010+0000", 2024-09-14T09:08:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.029e-06 2024-09-14T09:08:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:08:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2024-09-14T09:08:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797044+0000", 2024-09-14T09:08:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9213e-05 2024-09-14T09:08:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797048+0000", 2024-09-14T09:08:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3400000000000002e-06 2024-09-14T09:08:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788222+0000", 2024-09-14T09:08:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99117407400000002 2024-09-14T09:08:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788306+0000", 2024-09-14T09:08:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4512999999999995e-05 2024-09-14T09:08:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788374+0000", 2024-09-14T09:08:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7226999999999999e-05 2024-09-14T09:08:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:264 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.641191620000001, 2024-09-14T09:08:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99161474699999996, 2024-09-14T09:08:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 264 2024-09-14T09:08:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2024-09-14T09:08:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:08:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2800000000000002e-06 2024-09-14T09:08:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:08:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0979999999999999e-06 2024-09-14T09:08:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797040+0000", 2024-09-14T09:08:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:08:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797068+0000", 2024-09-14T09:08:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7302999999999999e-05 2024-09-14T09:08:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797071+0000", 2024-09-14T09:08:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3610000000000001e-06 2024-09-14T09:08:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788436+0000", 2024-09-14T09:08:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99136489500000002 2024-09-14T09:08:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788538+0000", 2024-09-14T09:08:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101931 2024-09-14T09:08:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788641+0000", 2024-09-14T09:08:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010273899999999999 2024-09-14T09:08:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:265 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:08:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.641168261000001, 2024-09-14T09:08:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99176878199999996, 2024-09-14T09:08:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 265 2024-09-14T09:08:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:08:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:08:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:08:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.39e-07 2024-09-14T09:08:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797052+0000", 2024-09-14T09:08:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.345e-06 2024-09-14T09:08:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797058+0000", 2024-09-14T09:08:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5429999999999999e-06 2024-09-14T09:08:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797064+0000", 2024-09-14T09:08:54.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2000000000000002e-06 2024-09-14T09:08:54.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797091+0000", 2024-09-14T09:08:54.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7804e-05 2024-09-14T09:08:54.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:54.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797095+0000", 2024-09-14T09:08:54.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2024-09-14T09:08:54.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788667+0000", 2024-09-14T09:08:54.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157211300000003 2024-09-14T09:08:54.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:54.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788742+0000", 2024-09-14T09:08:54.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5159000000000003e-05 2024-09-14T09:08:54.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:54.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788818+0000", 2024-09-14T09:08:54.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6038000000000006e-05 2024-09-14T09:08:54.503 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.503 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.503 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.503 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:266 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:54.503 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:54.503 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.641145430000002, 2024-09-14T09:08:54.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99193390100000001, 2024-09-14T09:08:54.504 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:54.504 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:54.504 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:54.504 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:54.504 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:54.504 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:54.505 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 266 2024-09-14T09:08:54.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.505 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:54.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:54.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:54.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:54.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:54.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:08:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797075+0000", 2024-09-14T09:08:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2570000000000002e-06 2024-09-14T09:08:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797082+0000", 2024-09-14T09:08:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8029999999999997e-06 2024-09-14T09:08:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797088+0000", 2024-09-14T09:08:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.468e-06 2024-09-14T09:08:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797116+0000", 2024-09-14T09:08:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7752000000000001e-05 2024-09-14T09:08:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797121+0000", 2024-09-14T09:08:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5960000000000003e-06 2024-09-14T09:08:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788846+0000", 2024-09-14T09:08:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99172512199999996 2024-09-14T09:08:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788916+0000", 2024-09-14T09:08:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9843000000000002e-05 2024-09-14T09:08:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789006+0000", 2024-09-14T09:08:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9608e-05 2024-09-14T09:08:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:267 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.641120622999999, 2024-09-14T09:08:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99210926799999999, 2024-09-14T09:08:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 267 2024-09-14T09:08:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:54.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:54.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2399999999999999e-07 2024-09-14T09:08:54.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:54.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797099+0000", 2024-09-14T09:08:54.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.091e-06 2024-09-14T09:08:54.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:54.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797105+0000", 2024-09-14T09:08:54.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-09-14T09:08:54.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797111+0000", 2024-09-14T09:08:54.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5130000000000004e-06 2024-09-14T09:08:54.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797140+0000", 2024-09-14T09:08:54.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9513999999999999e-05 2024-09-14T09:08:54.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797145+0000", 2024-09-14T09:08:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:08:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789037+0000", 2024-09-14T09:08:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99189253899999996 2024-09-14T09:08:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789110+0000", 2024-09-14T09:08:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2848000000000005e-05 2024-09-14T09:08:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789206+0000", 2024-09-14T09:08:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5778000000000004e-05 2024-09-14T09:08:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:268 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.641097383999998, 2024-09-14T09:08:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992276359, 2024-09-14T09:08:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 268 2024-09-14T09:08:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:08:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797123+0000", 2024-09-14T09:08:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2740000000000002e-06 2024-09-14T09:08:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797129+0000", 2024-09-14T09:08:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-06 2024-09-14T09:08:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797134+0000", 2024-09-14T09:08:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9099999999999996e-06 2024-09-14T09:08:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797163+0000", 2024-09-14T09:08:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9709999999999998e-05 2024-09-14T09:08:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8709999999999999e-06 2024-09-14T09:08:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789231+0000", 2024-09-14T09:08:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992063959 2024-09-14T09:08:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789306+0000", 2024-09-14T09:08:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5289000000000004e-05 2024-09-14T09:08:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789396+0000", 2024-09-14T09:08:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9939999999999996e-05 2024-09-14T09:08:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:269 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2457600~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.641073875, 2024-09-14T09:08:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99242174400000005, 2024-09-14T09:08:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:54.521 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:54.521 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:54.521 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 269 2024-09-14T09:08:54.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.521 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:54.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:54.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:54.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:54.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:08:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797146+0000", 2024-09-14T09:08:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5289999999999998e-06 2024-09-14T09:08:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797153+0000", 2024-09-14T09:08:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1920000000000002e-06 2024-09-14T09:08:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797158+0000", 2024-09-14T09:08:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099999999999998e-06 2024-09-14T09:08:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797188+0000", 2024-09-14T09:08:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0128e-05 2024-09-14T09:08:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797194+0000", 2024-09-14T09:08:54.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6250000000000004e-06 2024-09-14T09:08:54.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789439+0000", 2024-09-14T09:08:54.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99224531000000005 2024-09-14T09:08:54.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:54.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789489+0000", 2024-09-14T09:08:54.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9830000000000002e-05 2024-09-14T09:08:54.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:54.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789565+0000", 2024-09-14T09:08:54.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6229000000000005e-05 2024-09-14T09:08:54.525 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.525 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.525 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.526 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:270 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:54.526 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:54.526 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.641050053000001, 2024-09-14T09:08:54.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99257721899999996, 2024-09-14T09:08:54.526 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:54.526 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:54.526 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 270 2024-09-14T09:08:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:54.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:54.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:54.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797168+0000", 2024-09-14T09:08:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2024-09-14T09:08:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797170+0000", 2024-09-14T09:08:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3120000000000001e-06 2024-09-14T09:08:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797177+0000", 2024-09-14T09:08:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0960000000000003e-06 2024-09-14T09:08:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797183+0000", 2024-09-14T09:08:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1669999999999998e-06 2024-09-14T09:08:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797213+0000", 2024-09-14T09:08:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0494e-05 2024-09-14T09:08:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:08:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:08:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789586+0000", 2024-09-14T09:08:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99236692100000001 2024-09-14T09:08:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789658+0000", 2024-09-14T09:08:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2279000000000004e-05 2024-09-14T09:08:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789745+0000", 2024-09-14T09:08:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6698000000000002e-05 2024-09-14T09:08:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:271 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3375104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.641024855000001, 2024-09-14T09:08:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99274791699999998, 2024-09-14T09:08:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 271 2024-09-14T09:08:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:08:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797195+0000", 2024-09-14T09:08:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1639999999999999e-06 2024-09-14T09:08:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797201+0000", 2024-09-14T09:08:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1290000000000001e-06 2024-09-14T09:08:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797206+0000", 2024-09-14T09:08:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9300000000000002e-06 2024-09-14T09:08:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797237+0000", 2024-09-14T09:08:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1285000000000003e-05 2024-09-14T09:08:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797242+0000", 2024-09-14T09:08:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6e-06 2024-09-14T09:08:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789768+0000", 2024-09-14T09:08:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99252547400000002 2024-09-14T09:08:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789826+0000", 2024-09-14T09:08:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8155999999999997e-05 2024-09-14T09:08:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789940+0000", 2024-09-14T09:08:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114788 2024-09-14T09:08:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:272 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.641001460999998, 2024-09-14T09:08:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99285248800000003, 2024-09-14T09:08:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 272 2024-09-14T09:08:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:08:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:54.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:08:54.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5129999999999999e-06 2024-09-14T09:08:54.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:54.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797226+0000", 2024-09-14T09:08:54.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4529999999999996e-06 2024-09-14T09:08:54.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797232+0000", 2024-09-14T09:08:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1839999999999998e-06 2024-09-14T09:08:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797264+0000", 2024-09-14T09:08:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2691999999999998e-05 2024-09-14T09:08:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797270+0000", 2024-09-14T09:08:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-06 2024-09-14T09:08:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789965+0000", 2024-09-14T09:08:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99269526200000002 2024-09-14T09:08:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790021+0000", 2024-09-14T09:08:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5297000000000003e-05 2024-09-14T09:08:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790068+0000", 2024-09-14T09:08:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7664999999999998e-05 2024-09-14T09:08:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5006.0:4897 3.1b 3:dc4939f3:::rbd_object_map.11125497cb52:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-14T09:08:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:45.922622+0000", 2024-09-14T09:08:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.5155952050000003, 2024-09-14T09:08:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011994009, 2024-09-14T09:08:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5006", 2024-09-14T09:08:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/3107765484", 2024-09-14T09:08:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4897 2024-09-14T09:08:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922622+0000", 2024-09-14T09:08:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922622+0000", 2024-09-14T09:08:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:54.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922623+0000", 2024-09-14T09:08:54.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2999999999999999e-07 2024-09-14T09:08:54.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:54.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922628+0000", 2024-09-14T09:08:54.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.459e-06 2024-09-14T09:08:54.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:54.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922639+0000", 2024-09-14T09:08:54.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1099e-05 2024-09-14T09:08:54.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922650+0000", 2024-09-14T09:08:54.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1695999999999999e-05 2024-09-14T09:08:54.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.925576+0000", 2024-09-14T09:08:54.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002925839 2024-09-14T09:08:54.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:54.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.925628+0000", 2024-09-14T09:08:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1536000000000003e-05 2024-09-14T09:08:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.925833+0000", 2024-09-14T09:08:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00020529000000000001 2024-09-14T09:08:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.927960+0000", 2024-09-14T09:08:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021266169999999999 2024-09-14T09:08:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934526+0000", 2024-09-14T09:08:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006566293 2024-09-14T09:08:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934576+0000", 2024-09-14T09:08:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0022000000000003e-05 2024-09-14T09:08:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934616+0000", 2024-09-14T09:08:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0228000000000002e-05 2024-09-14T09:08:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5006.0:4898 3.1b 3:dc4939f3:::rbd_object_map.11125497cb52:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-14T09:08:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:45.923037+0000", 2024-09-14T09:08:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.5151799629999996, 2024-09-14T09:08:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011707255, 2024-09-14T09:08:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5006", 2024-09-14T09:08:54.551 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/3107765484", 2024-09-14T09:08:54.551 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4898 2024-09-14T09:08:54.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.551 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:54.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:54.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923037+0000", 2024-09-14T09:08:54.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:54.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923037+0000", 2024-09-14T09:08:54.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:54.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923038+0000", 2024-09-14T09:08:54.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5199999999999996e-07 2024-09-14T09:08:54.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:54.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923045+0000", 2024-09-14T09:08:54.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9280000000000004e-06 2024-09-14T09:08:54.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:54.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923052+0000", 2024-09-14T09:08:54.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0180000000000004e-06 2024-09-14T09:08:54.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923057+0000", 2024-09-14T09:08:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5970000000000002e-06 2024-09-14T09:08:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.926369+0000", 2024-09-14T09:08:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003312204 2024-09-14T09:08:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.926458+0000", 2024-09-14T09:08:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8682000000000002e-05 2024-09-14T09:08:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.926817+0000", 2024-09-14T09:08:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00035913200000000002 2024-09-14T09:08:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.928477+0000", 2024-09-14T09:08:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016600250000000001 2024-09-14T09:08:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934653+0000", 2024-09-14T09:08:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061763089999999996 2024-09-14T09:08:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:54.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934706+0000", 2024-09-14T09:08:54.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2475000000000002e-05 2024-09-14T09:08:54.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:54.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934745+0000", 2024-09-14T09:08:54.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9133e-05 2024-09-14T09:08:54.556 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.556 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.556 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.556 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.556 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.556 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:54.558 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:54.559+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:54.558 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:08:54.659 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:54.661+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:54.712 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:54.713 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:54.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.713 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5299.0:5345 3.7 3:e4196b37:::rbd_data.11125497cb52.000000000000004e:head [read 81920~16384 out=16384b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-09-14T09:08:54.713 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:54.714356+0000", 2024-09-14T09:08:54.713 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00030307199999999999, 2024-09-14T09:08:54.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000333161, 2024-09-14T09:08:54.714 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:54.714 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:54.714 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:54.714 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:54.714 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5299", 2024-09-14T09:08:54.714 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2641120438", 2024-09-14T09:08:54.715 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5345 2024-09-14T09:08:54.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.715 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:54.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:54.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:54.714356+0000", 2024-09-14T09:08:54.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:54.714356+0000", 2024-09-14T09:08:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:54.714356+0000", 2024-09-14T09:08:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.68e-07 2024-09-14T09:08:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:54.714359+0000", 2024-09-14T09:08:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5579999999999999e-06 2024-09-14T09:08:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:54.714365+0000", 2024-09-14T09:08:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4579999999999998e-06 2024-09-14T09:08:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:54.714370+0000", 2024-09-14T09:08:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.955e-06 2024-09-14T09:08:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:54.714452+0000", 2024-09-14T09:08:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1539999999999995e-05 2024-09-14T09:08:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:54.714530+0000", 2024-09-14T09:08:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7602999999999995e-05 2024-09-14T09:08:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5299.0:5346 3.14 3:2f1a0d4b:::rbd_data.11125497cb52.000000000000004f:head [read 81920~16384 out=16384b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-09-14T09:08:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:54.714389+0000", 2024-09-14T09:08:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00027004200000000001, 2024-09-14T09:08:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00036682000000000001, 2024-09-14T09:08:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5299", 2024-09-14T09:08:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2641120438", 2024-09-14T09:08:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5346 2024-09-14T09:08:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:54.714389+0000", 2024-09-14T09:08:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:54.714389+0000", 2024-09-14T09:08:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:54.714389+0000", 2024-09-14T09:08:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6599999999999996e-07 2024-09-14T09:08:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:54.714392+0000", 2024-09-14T09:08:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7310000000000002e-06 2024-09-14T09:08:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:54.714401+0000", 2024-09-14T09:08:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8270000000000004e-06 2024-09-14T09:08:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:54.714406+0000", 2024-09-14T09:08:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4550000000000003e-06 2024-09-14T09:08:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:54.714628+0000", 2024-09-14T09:08:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022193199999999999 2024-09-14T09:08:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:54.714699+0000", 2024-09-14T09:08:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0450000000000005e-05 2024-09-14T09:08:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.723 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:54.723 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.723 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:54.723 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-14T09:08:54.723 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 2 2024-09-14T09:08:54.723 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:54.724 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:08:54.769 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:54.771+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:54.860 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:54.862+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:54.876 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:54.876 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:54.877 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:54.877 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:54.877 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:54.889 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:08:54.961 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:54.963+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:55.062 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:55.064+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:55.082 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:55.082 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:55.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:55.082 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:55.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.082 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5285 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 4370432~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:55.082 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.247472+0000", 2024-09-14T09:08:55.083 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.835219101, 2024-09-14T09:08:55.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038449069000000002, 2024-09-14T09:08:55.083 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.083 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.083 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.083 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.083 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:55.083 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:55.083 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5285 2024-09-14T09:08:55.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.083 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247472+0000", 2024-09-14T09:08:55.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247472+0000", 2024-09-14T09:08:55.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247472+0000", 2024-09-14T09:08:55.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6899999999999998e-07 2024-09-14T09:08:55.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247474+0000", 2024-09-14T09:08:55.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9290000000000001e-06 2024-09-14T09:08:55.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247481+0000", 2024-09-14T09:08:55.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7499999999999997e-06 2024-09-14T09:08:55.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247486+0000", 2024-09-14T09:08:55.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5709999999999999e-06 2024-09-14T09:08:55.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.285757+0000", 2024-09-14T09:08:55.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038271289999999999 2024-09-14T09:08:55.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.285836+0000", 2024-09-14T09:08:55.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8753999999999998e-05 2024-09-14T09:08:55.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.285921+0000", 2024-09-14T09:08:55.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5406000000000002e-05 2024-09-14T09:08:55.086 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.087 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.087 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.087 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5286 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 4431872~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:55.087 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.247491+0000", 2024-09-14T09:08:55.087 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.835199752000001, 2024-09-14T09:08:55.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038550628000000003, 2024-09-14T09:08:55.087 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.087 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.087 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:55.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:55.087 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5286 2024-09-14T09:08:55.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.088 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247491+0000", 2024-09-14T09:08:55.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247491+0000", 2024-09-14T09:08:55.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247492+0000", 2024-09-14T09:08:55.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.37e-07 2024-09-14T09:08:55.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247494+0000", 2024-09-14T09:08:55.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7239999999999999e-06 2024-09-14T09:08:55.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247499+0000", 2024-09-14T09:08:55.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5620000000000003e-06 2024-09-14T09:08:55.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247504+0000", 2024-09-14T09:08:55.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4769999999999997e-06 2024-09-14T09:08:55.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.285949+0000", 2024-09-14T09:08:55.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038445314000000001 2024-09-14T09:08:55.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.285993+0000", 2024-09-14T09:08:55.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4397999999999997e-05 2024-09-14T09:08:55.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.286042+0000", 2024-09-14T09:08:55.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8615999999999997e-05 2024-09-14T09:08:55.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.091 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.091 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5287 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 4493312~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:55.091 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.247509+0000", 2024-09-14T09:08:55.091 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.835182024000002, 2024-09-14T09:08:55.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038729007000000003, 2024-09-14T09:08:55.091 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.091 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.091 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:55.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:55.092 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5287 2024-09-14T09:08:55.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.092 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247509+0000", 2024-09-14T09:08:55.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.247509+0000", 2024-09-14T09:08:55.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.248863+0000", 2024-09-14T09:08:55.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001354325 2024-09-14T09:08:55.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.248867+0000", 2024-09-14T09:08:55.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4350000000000001e-06 2024-09-14T09:08:55.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.248876+0000", 2024-09-14T09:08:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8179999999999993e-06 2024-09-14T09:08:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.248882+0000", 2024-09-14T09:08:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0580000000000003e-06 2024-09-14T09:08:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.286074+0000", 2024-09-14T09:08:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.037192058 2024-09-14T09:08:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.286153+0000", 2024-09-14T09:08:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9456999999999995e-05 2024-09-14T09:08:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.286238+0000", 2024-09-14T09:08:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4856000000000002e-05 2024-09-14T09:08:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5296 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5046272~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249051+0000", 2024-09-14T09:08:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.833639915999999, 2024-09-14T09:08:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038542414999999997, 2024-09-14T09:08:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5296 2024-09-14T09:08:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249051+0000", 2024-09-14T09:08:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249051+0000", 2024-09-14T09:08:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249052+0000", 2024-09-14T09:08:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2800000000000002e-07 2024-09-14T09:08:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249054+0000", 2024-09-14T09:08:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.996e-06 2024-09-14T09:08:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249059+0000", 2024-09-14T09:08:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9529999999999996e-06 2024-09-14T09:08:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249064+0000", 2024-09-14T09:08:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7509999999999999e-06 2024-09-14T09:08:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287505+0000", 2024-09-14T09:08:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038440400999999999 2024-09-14T09:08:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287547+0000", 2024-09-14T09:08:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2287999999999999e-05 2024-09-14T09:08:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287594+0000", 2024-09-14T09:08:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6597999999999997e-05 2024-09-14T09:08:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5297 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5107712~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249083+0000", 2024-09-14T09:08:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.833608519999999, 2024-09-14T09:08:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038705564999999997, 2024-09-14T09:08:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5297 2024-09-14T09:08:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249083+0000", 2024-09-14T09:08:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249083+0000", 2024-09-14T09:08:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249083+0000", 2024-09-14T09:08:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0399999999999996e-07 2024-09-14T09:08:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249085+0000", 2024-09-14T09:08:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1849999999999998e-06 2024-09-14T09:08:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249092+0000", 2024-09-14T09:08:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4500000000000001e-06 2024-09-14T09:08:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249097+0000", 2024-09-14T09:08:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0710000000000002e-06 2024-09-14T09:08:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287625+0000", 2024-09-14T09:08:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038527990999999998 2024-09-14T09:08:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287700+0000", 2024-09-14T09:08:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5149999999999997e-05 2024-09-14T09:08:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287788+0000", 2024-09-14T09:08:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8114000000000004e-05 2024-09-14T09:08:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5298 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5169152~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249104+0000", 2024-09-14T09:08:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.833587405999999, 2024-09-14T09:08:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038798922999999999, 2024-09-14T09:08:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5298 2024-09-14T09:08:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249104+0000", 2024-09-14T09:08:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249104+0000", 2024-09-14T09:08:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249104+0000", 2024-09-14T09:08:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.89e-07 2024-09-14T09:08:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249106+0000", 2024-09-14T09:08:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9980000000000002e-06 2024-09-14T09:08:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249112+0000", 2024-09-14T09:08:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6779999999999997e-06 2024-09-14T09:08:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249117+0000", 2024-09-14T09:08:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8049999999999997e-06 2024-09-14T09:08:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287812+0000", 2024-09-14T09:08:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038695845 2024-09-14T09:08:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287856+0000", 2024-09-14T09:08:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3445000000000002e-05 2024-09-14T09:08:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287903+0000", 2024-09-14T09:08:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6662999999999997e-05 2024-09-14T09:08:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.108 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.108 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.108 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5299 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5230592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:55.108 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:08:55.108 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.833568588999999, 2024-09-14T09:08:55.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038972887999999997, 2024-09-14T09:08:55.108 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.108 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.108 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.108 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.108 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:55.108 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:55.108 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5299 2024-09-14T09:08:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:08:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:08:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249123+0000", 2024-09-14T09:08:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1199999999999998e-07 2024-09-14T09:08:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249125+0000", 2024-09-14T09:08:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.855e-06 2024-09-14T09:08:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249131+0000", 2024-09-14T09:08:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2949999999999999e-06 2024-09-14T09:08:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249136+0000", 2024-09-14T09:08:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9779999999999996e-06 2024-09-14T09:08:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287933+0000", 2024-09-14T09:08:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038796663000000002 2024-09-14T09:08:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288012+0000", 2024-09-14T09:08:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9617999999999996e-05 2024-09-14T09:08:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288095+0000", 2024-09-14T09:08:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3066999999999996e-05 2024-09-14T09:08:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5300 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5292032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:08:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.8335492, 2024-09-14T09:08:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039068578, 2024-09-14T09:08:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5300 2024-09-14T09:08:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:08:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:08:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254832+0000", 2024-09-14T09:08:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056899180000000004 2024-09-14T09:08:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254836+0000", 2024-09-14T09:08:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7809999999999999e-06 2024-09-14T09:08:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254845+0000", 2024-09-14T09:08:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.516e-06 2024-09-14T09:08:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254851+0000", 2024-09-14T09:08:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9109999999999998e-06 2024-09-14T09:08:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288122+0000", 2024-09-14T09:08:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.033270776000000002 2024-09-14T09:08:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288163+0000", 2024-09-14T09:08:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1700999999999999e-05 2024-09-14T09:08:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288210+0000", 2024-09-14T09:08:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6974999999999997e-05 2024-09-14T09:08:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5339 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7688192~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255650+0000", 2024-09-14T09:08:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.82704069, 2024-09-14T09:08:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038551183000000003, 2024-09-14T09:08:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5339 2024-09-14T09:08:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255650+0000", 2024-09-14T09:08:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255650+0000", 2024-09-14T09:08:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255651+0000", 2024-09-14T09:08:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8400000000000004e-07 2024-09-14T09:08:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255653+0000", 2024-09-14T09:08:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.12e-06 2024-09-14T09:08:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255660+0000", 2024-09-14T09:08:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8260000000000004e-06 2024-09-14T09:08:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255665+0000", 2024-09-14T09:08:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8860000000000003e-06 2024-09-14T09:08:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294041+0000", 2024-09-14T09:08:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038375805999999998 2024-09-14T09:08:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294119+0000", 2024-09-14T09:08:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8633000000000004e-05 2024-09-14T09:08:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294202+0000", 2024-09-14T09:08:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2328000000000002e-05 2024-09-14T09:08:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5340 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7749632~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255671+0000", 2024-09-14T09:08:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.827019856, 2024-09-14T09:08:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038644492000000003, 2024-09-14T09:08:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5340 2024-09-14T09:08:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255671+0000", 2024-09-14T09:08:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255671+0000", 2024-09-14T09:08:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255672+0000", 2024-09-14T09:08:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:08:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255674+0000", 2024-09-14T09:08:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9580000000000001e-06 2024-09-14T09:08:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255685+0000", 2024-09-14T09:08:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1302e-05 2024-09-14T09:08:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255691+0000", 2024-09-14T09:08:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.319e-06 2024-09-14T09:08:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294228+0000", 2024-09-14T09:08:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038537188999999999 2024-09-14T09:08:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294269+0000", 2024-09-14T09:08:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0241000000000003e-05 2024-09-14T09:08:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294316+0000", 2024-09-14T09:08:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6984000000000003e-05 2024-09-14T09:08:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5341 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7811072~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255698+0000", 2024-09-14T09:08:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.826993039000001, 2024-09-14T09:08:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038826833999999998, 2024-09-14T09:08:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5341 2024-09-14T09:08:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255698+0000", 2024-09-14T09:08:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255698+0000", 2024-09-14T09:08:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255698+0000", 2024-09-14T09:08:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.03e-07 2024-09-14T09:08:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255701+0000", 2024-09-14T09:08:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2259999999999999e-06 2024-09-14T09:08:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255707+0000", 2024-09-14T09:08:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0220000000000001e-06 2024-09-14T09:08:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255712+0000", 2024-09-14T09:08:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3680000000000001e-06 2024-09-14T09:08:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294347+0000", 2024-09-14T09:08:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038634746999999997 2024-09-14T09:08:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294434+0000", 2024-09-14T09:08:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7094000000000003e-05 2024-09-14T09:08:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294525+0000", 2024-09-14T09:08:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0974e-05 2024-09-14T09:08:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5342 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7872512~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:08:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.826973015, 2024-09-14T09:08:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038906217999999999, 2024-09-14T09:08:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5342 2024-09-14T09:08:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:08:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:08:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:08:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8700000000000001e-07 2024-09-14T09:08:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255720+0000", 2024-09-14T09:08:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.739e-06 2024-09-14T09:08:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255726+0000", 2024-09-14T09:08:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.981e-06 2024-09-14T09:08:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255737+0000", 2024-09-14T09:08:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0621e-05 2024-09-14T09:08:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294538+0000", 2024-09-14T09:08:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038801012000000003 2024-09-14T09:08:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294577+0000", 2024-09-14T09:08:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9042000000000003e-05 2024-09-14T09:08:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294624+0000", 2024-09-14T09:08:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7435999999999998e-05 2024-09-14T09:08:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5343 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7933952~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:08:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.826947139000001, 2024-09-14T09:08:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039081811000000001, 2024-09-14T09:08:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5343 2024-09-14T09:08:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:08:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:08:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:08:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1800000000000001e-07 2024-09-14T09:08:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255746+0000", 2024-09-14T09:08:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.103e-06 2024-09-14T09:08:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255753+0000", 2024-09-14T09:08:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0929999999999999e-06 2024-09-14T09:08:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255757+0000", 2024-09-14T09:08:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9579999999999998e-06 2024-09-14T09:08:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294656+0000", 2024-09-14T09:08:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038898508999999998 2024-09-14T09:08:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294738+0000", 2024-09-14T09:08:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2423999999999996e-05 2024-09-14T09:08:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294826+0000", 2024-09-14T09:08:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7305999999999994e-05 2024-09-14T09:08:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5344 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7995392~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:08:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.826927706999999, 2024-09-14T09:08:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039165567999999998, 2024-09-14T09:08:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5344 2024-09-14T09:08:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:08:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:08:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255764+0000", 2024-09-14T09:08:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7899999999999999e-07 2024-09-14T09:08:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255765+0000", 2024-09-14T09:08:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.782e-06 2024-09-14T09:08:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255774+0000", 2024-09-14T09:08:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8070000000000006e-06 2024-09-14T09:08:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255779+0000", 2024-09-14T09:08:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9180000000000002e-06 2024-09-14T09:08:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294841+0000", 2024-09-14T09:08:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039061514999999998 2024-09-14T09:08:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294881+0000", 2024-09-14T09:08:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0027999999999997e-05 2024-09-14T09:08:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294929+0000", 2024-09-14T09:08:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8139000000000001e-05 2024-09-14T09:08:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5345 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8056832~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:08:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.826905469, 2024-09-14T09:08:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039340027999999999, 2024-09-14T09:08:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5345 2024-09-14T09:08:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:08:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:08:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:08:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8099999999999998e-07 2024-09-14T09:08:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255788+0000", 2024-09-14T09:08:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1280000000000002e-06 2024-09-14T09:08:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255794+0000", 2024-09-14T09:08:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0020000000000003e-06 2024-09-14T09:08:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255800+0000", 2024-09-14T09:08:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2009999999999996e-06 2024-09-14T09:08:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294960+0000", 2024-09-14T09:08:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039159674999999998 2024-09-14T09:08:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295041+0000", 2024-09-14T09:08:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0648000000000004e-05 2024-09-14T09:08:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295126+0000", 2024-09-14T09:08:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4993000000000004e-05 2024-09-14T09:08:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5346 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8118272~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:08:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.826884475, 2024-09-14T09:08:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039433228000000001, 2024-09-14T09:08:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5346 2024-09-14T09:08:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:08:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:08:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:08:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6899999999999998e-07 2024-09-14T09:08:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255809+0000", 2024-09-14T09:08:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9580000000000001e-06 2024-09-14T09:08:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255815+0000", 2024-09-14T09:08:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6579999999999999e-06 2024-09-14T09:08:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255819+0000", 2024-09-14T09:08:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5839999999999996e-06 2024-09-14T09:08:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295152+0000", 2024-09-14T09:08:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039332677000000003 2024-09-14T09:08:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295192+0000", 2024-09-14T09:08:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0491999999999998e-05 2024-09-14T09:08:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295240+0000", 2024-09-14T09:08:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7490000000000001e-05 2024-09-14T09:08:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5347 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8179712~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:08:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.826856878000001, 2024-09-14T09:08:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039601193999999999, 2024-09-14T09:08:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5347 2024-09-14T09:08:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:08:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:08:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255835+0000", 2024-09-14T09:08:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.82e-07 2024-09-14T09:08:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255837+0000", 2024-09-14T09:08:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0959999999999999e-06 2024-09-14T09:08:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255843+0000", 2024-09-14T09:08:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3779999999999998e-06 2024-09-14T09:08:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255848+0000", 2024-09-14T09:08:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7609999999999998e-06 2024-09-14T09:08:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295271+0000", 2024-09-14T09:08:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039423079 2024-09-14T09:08:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295350+0000", 2024-09-14T09:08:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8623999999999998e-05 2024-09-14T09:08:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295435+0000", 2024-09-14T09:08:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5674000000000007e-05 2024-09-14T09:08:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5348 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8241152~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:08:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.826836668999999, 2024-09-14T09:08:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039695057999999998, 2024-09-14T09:08:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5348 2024-09-14T09:08:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:08:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:08:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255855+0000", 2024-09-14T09:08:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7599999999999997e-07 2024-09-14T09:08:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255857+0000", 2024-09-14T09:08:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.905e-06 2024-09-14T09:08:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255863+0000", 2024-09-14T09:08:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0669999999999997e-06 2024-09-14T09:08:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255867+0000", 2024-09-14T09:08:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4730000000000002e-06 2024-09-14T09:08:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295461+0000", 2024-09-14T09:08:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039594074 2024-09-14T09:08:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295503+0000", 2024-09-14T09:08:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1363999999999999e-05 2024-09-14T09:08:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295549+0000", 2024-09-14T09:08:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6699000000000001e-05 2024-09-14T09:08:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5349 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8302592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:08:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.826817709, 2024-09-14T09:08:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039875928999999997, 2024-09-14T09:08:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5349 2024-09-14T09:08:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:08:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:08:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255874+0000", 2024-09-14T09:08:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4900000000000001e-07 2024-09-14T09:08:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255880+0000", 2024-09-14T09:08:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9939999999999997e-06 2024-09-14T09:08:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255886+0000", 2024-09-14T09:08:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3899999999999998e-06 2024-09-14T09:08:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255891+0000", 2024-09-14T09:08:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.938e-06 2024-09-14T09:08:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295580+0000", 2024-09-14T09:08:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039688681000000003 2024-09-14T09:08:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295653+0000", 2024-09-14T09:08:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3045000000000003e-05 2024-09-14T09:08:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295749+0000", 2024-09-14T09:08:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6532000000000003e-05 2024-09-14T09:08:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5350 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8364032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:08:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.826793901999999, 2024-09-14T09:08:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039989719, 2024-09-14T09:08:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5350 2024-09-14T09:08:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:08:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:08:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255898+0000", 2024-09-14T09:08:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2024-09-14T09:08:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255899+0000", 2024-09-14T09:08:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9139999999999998e-06 2024-09-14T09:08:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255905+0000", 2024-09-14T09:08:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7289999999999997e-06 2024-09-14T09:08:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255910+0000", 2024-09-14T09:08:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6210000000000003e-06 2024-09-14T09:08:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295775+0000", 2024-09-14T09:08:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039864973999999997 2024-09-14T09:08:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295828+0000", 2024-09-14T09:08:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3411000000000001e-05 2024-09-14T09:08:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295887+0000", 2024-09-14T09:08:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699000000000002e-05 2024-09-14T09:08:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.170 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:55.172 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:08:55.172 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:55.174+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:55.272 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:55.274+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:55.318 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:55.318 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:55.318 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:55.318 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:55.326 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:08:55.373 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:55.375+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:55.421 INFO:teuthology.orchestra.run.smithi148.stdout:4181 write 0x6545e00 thru 0x654bfe2 (0x61e3 bytes) 2024-09-14T09:08:55.421 INFO:teuthology.orchestra.run.smithi148.stdout:4182 read 0x19f5c00 thru 0x1a0510e (0xf50f bytes) 2024-09-14T09:08:55.422 INFO:teuthology.orchestra.run.smithi148.stdout:4183 punch from 0x1922400 to 0x1924800, (0x2400 bytes) 2024-09-14T09:08:55.429 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:55.429 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:55.429 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:55.429 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:55.429 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:55.434 INFO:teuthology.orchestra.run.smithi148.stdout:4184 read 0x86e800 thru 0x870635 (0x1e36 bytes) 2024-09-14T09:08:55.434 INFO:teuthology.orchestra.run.smithi148.stdout:4185 read 0x44d8a00 thru 0x44dbe09 (0x340a bytes) 2024-09-14T09:08:55.434 INFO:teuthology.orchestra.run.smithi148.stdout:4188 punch from 0x4b98600 to 0x4ba3c00, (0xb600 bytes) 2024-09-14T09:08:55.438 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:08:55.441 INFO:teuthology.orchestra.run.smithi148.stdout:4189 trunc from 0x6ac5600 to 0x97b4800 2024-09-14T09:08:55.450 INFO:teuthology.orchestra.run.smithi148.stdout:4193 read 0x928f200 thru 0x9299d8d (0xab8e bytes) 2024-09-14T09:08:55.452 INFO:teuthology.orchestra.run.smithi148.stdout:4194 write 0x9a9200 thru 0x9b64f5 (0xd2f6 bytes) 2024-09-14T09:08:55.454 INFO:teuthology.orchestra.run.smithi148.stdout:4196 trunc from 0x97b4800 to 0x7fa5200 2024-09-14T09:08:55.466 INFO:teuthology.orchestra.run.smithi148.stdout:4197 read 0x2f06600 thru 0x2f0ccf2 (0x66f3 bytes) 2024-09-14T09:08:55.466 INFO:teuthology.orchestra.run.smithi148.stdout:4198 punch from 0x67e00 to 0x71e00, (0xa000 bytes) 2024-09-14T09:08:55.473 INFO:teuthology.orchestra.run.smithi148.stdout:4199 trunc from 0x7fa5200 to 0xc7b7800 2024-09-14T09:08:55.473 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:55.475+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:55.487 INFO:teuthology.orchestra.run.smithi148.stdout:4201 punch from 0x81b8e00 to 0x81ba400, (0x1600 bytes) 2024-09-14T09:08:55.492 INFO:teuthology.orchestra.run.smithi148.stdout:4205 punch from 0x713f000 to 0x7147200, (0x8200 bytes) 2024-09-14T09:08:55.501 INFO:teuthology.orchestra.run.smithi148.stdout:4206 trunc from 0xc7b7800 to 0x4eaaa00 2024-09-14T09:08:55.533 INFO:teuthology.orchestra.run.smithi148.stdout:4207 write 0x8256600 thru 0x826140e (0xae0f bytes) 2024-09-14T09:08:55.533 INFO:teuthology.orchestra.run.smithi148.stdout:4209 read 0x812e000 thru 0x812e7a7 (0x7a8 bytes) 2024-09-14T09:08:55.534 INFO:teuthology.orchestra.run.smithi148.stdout:4214 trunc from 0x8261600 to 0x6e85a00 2024-09-14T09:08:55.552 INFO:teuthology.orchestra.run.smithi148.stdout:4215 read 0x1234600 thru 0x1237054 (0x2a55 bytes) 2024-09-14T09:08:55.553 INFO:teuthology.orchestra.run.smithi148.stdout:4217 punch from 0x2148c00 to 0x214a200, (0x1600 bytes) 2024-09-14T09:08:55.573 INFO:teuthology.orchestra.run.smithi148.stdout:4218 write 0xdd1c400 thru 0xdd25861 (0x9462 bytes) 2024-09-14T09:08:55.574 INFO:teuthology.orchestra.run.smithi148.stdout:4219 write 0x52fd000 thru 0x52ffbc4 (0x2bc5 bytes) 2024-09-14T09:08:55.574 INFO:teuthology.orchestra.run.smithi148.stdout:4220 write 0x9d91800 thru 0x9d99d42 (0x8543 bytes) 2024-09-14T09:08:55.574 INFO:teuthology.orchestra.run.smithi148.stdout:4221 write 0x96a5000 thru 0x96a7be4 (0x2be5 bytes) 2024-09-14T09:08:55.575 INFO:teuthology.orchestra.run.smithi148.stdout:4222 punch from 0xad2e00 to 0xadce00, (0xa000 bytes) 2024-09-14T09:08:55.575 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:55.576+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:55.588 INFO:teuthology.orchestra.run.smithi148.stdout:4224 trunc from 0xdd25a00 to 0x3c92400 2024-09-14T09:08:55.594 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:55.594 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:55.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:55.594 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:55.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.594 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:228 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 360448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:55.595 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:08:55.595 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.798298001999999, 2024-09-14T09:08:55.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99234476999999999, 2024-09-14T09:08:55.595 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.595 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.595 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.595 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.595 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:55.595 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:55.595 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 228 2024-09-14T09:08:55.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.595 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:08:55.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:08:55.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796906+0000", 2024-09-14T09:08:55.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9399999999999995e-07 2024-09-14T09:08:55.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796917+0000", 2024-09-14T09:08:55.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0801e-05 2024-09-14T09:08:55.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796924+0000", 2024-09-14T09:08:55.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7750000000000004e-06 2024-09-14T09:08:55.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:08:55.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9972000000000001e-05 2024-09-14T09:08:55.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798671+0000", 2024-09-14T09:08:55.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017271330000000001 2024-09-14T09:08:55.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:55.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798675+0000", 2024-09-14T09:08:55.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.194e-06 2024-09-14T09:08:55.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789003+0000", 2024-09-14T09:08:55.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99032768400000004 2024-09-14T09:08:55.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789115+0000", 2024-09-14T09:08:55.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112236 2024-09-14T09:08:55.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789250+0000", 2024-09-14T09:08:55.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013548100000000001 2024-09-14T09:08:55.599 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.599 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.599 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.599 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:229 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 819200~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:55.599 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:08:55.600 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.798245778999998, 2024-09-14T09:08:55.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99287024599999996, 2024-09-14T09:08:55.600 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.600 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.600 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:55.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:55.600 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 229 2024-09-14T09:08:55.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.600 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:08:55.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:08:55.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:08:55.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999999e-07 2024-09-14T09:08:55.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796962+0000", 2024-09-14T09:08:55.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1479999999999999e-06 2024-09-14T09:08:55.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796967+0000", 2024-09-14T09:08:55.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1499999999999998e-06 2024-09-14T09:08:55.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:08:55.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-06 2024-09-14T09:08:55.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798688+0000", 2024-09-14T09:08:55.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017172660000000001 2024-09-14T09:08:55.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:55.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798691+0000", 2024-09-14T09:08:55.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:08:55.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789599+0000", 2024-09-14T09:08:55.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99090839399999997 2024-09-14T09:08:55.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789716+0000", 2024-09-14T09:08:55.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116474 2024-09-14T09:08:55.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789828+0000", 2024-09-14T09:08:55.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112293 2024-09-14T09:08:55.605 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.605 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.605 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.605 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:230 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1277952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:55.605 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:08:55.605 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.798225130999999, 2024-09-14T09:08:55.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99307501600000003, 2024-09-14T09:08:55.605 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.605 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.605 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.606 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.606 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:55.606 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:55.606 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 230 2024-09-14T09:08:55.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.606 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:08:55.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:08:55.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796979+0000", 2024-09-14T09:08:55.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.34e-07 2024-09-14T09:08:55.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796980+0000", 2024-09-14T09:08:55.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.53e-06 2024-09-14T09:08:55.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796986+0000", 2024-09-14T09:08:55.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9989999999999997e-06 2024-09-14T09:08:55.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796989+0000", 2024-09-14T09:08:55.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0340000000000001e-06 2024-09-14T09:08:55.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798702+0000", 2024-09-14T09:08:55.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001712756 2024-09-14T09:08:55.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:55.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798705+0000", 2024-09-14T09:08:55.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7750000000000001e-06 2024-09-14T09:08:55.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789870+0000", 2024-09-14T09:08:55.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991165026 2024-09-14T09:08:55.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789955+0000", 2024-09-14T09:08:55.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4839999999999994e-05 2024-09-14T09:08:55.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790053+0000", 2024-09-14T09:08:55.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8721999999999994e-05 2024-09-14T09:08:55.610 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.610 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.610 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.610 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:231 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:55.610 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:08:55.610 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.798209802999999, 2024-09-14T09:08:55.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99319130300000003, 2024-09-14T09:08:55.610 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.610 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.610 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.611 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.611 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:55.611 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:55.611 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 231 2024-09-14T09:08:55.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.611 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:08:55.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:08:55.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:08:55.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2024-09-14T09:08:55.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796995+0000", 2024-09-14T09:08:55.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2500000000000001e-06 2024-09-14T09:08:55.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796998+0000", 2024-09-14T09:08:55.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3230000000000002e-06 2024-09-14T09:08:55.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797001+0000", 2024-09-14T09:08:55.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7099999999999999e-06 2024-09-14T09:08:55.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798718+0000", 2024-09-14T09:08:55.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017168070000000001 2024-09-14T09:08:55.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:55.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798721+0000", 2024-09-14T09:08:55.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.853e-06 2024-09-14T09:08:55.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790077+0000", 2024-09-14T09:08:55.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991356393 2024-09-14T09:08:55.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790129+0000", 2024-09-14T09:08:55.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2240999999999997e-05 2024-09-14T09:08:55.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790185+0000", 2024-09-14T09:08:55.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5515e-05 2024-09-14T09:08:55.615 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.615 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.615 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.615 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:232 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2195456~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:55.615 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:08:55.615 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.798199146999998, 2024-09-14T09:08:55.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99329117899999997, 2024-09-14T09:08:55.615 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.615 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.615 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:55.616 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:55.616 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 232 2024-09-14T09:08:55.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.616 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:08:55.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:08:55.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797005+0000", 2024-09-14T09:08:55.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2024-09-14T09:08:55.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797006+0000", 2024-09-14T09:08:55.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3200000000000001e-06 2024-09-14T09:08:55.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797009+0000", 2024-09-14T09:08:55.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4680000000000001e-06 2024-09-14T09:08:55.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797012+0000", 2024-09-14T09:08:55.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4770000000000002e-06 2024-09-14T09:08:55.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798743+0000", 2024-09-14T09:08:55.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017312 2024-09-14T09:08:55.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:55.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798747+0000", 2024-09-14T09:08:55.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.484e-06 2024-09-14T09:08:55.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790201+0000", 2024-09-14T09:08:55.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99145419499999998 2024-09-14T09:08:55.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790241+0000", 2024-09-14T09:08:55.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0587999999999998e-05 2024-09-14T09:08:55.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790296+0000", 2024-09-14T09:08:55.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4212000000000002e-05 2024-09-14T09:08:55.620 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.620 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.620 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.620 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:233 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2654208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:55.620 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:08:55.620 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.798188524, 2024-09-14T09:08:55.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99337220100000001, 2024-09-14T09:08:55.620 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.620 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.620 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.620 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.621 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:55.621 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:55.621 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 233 2024-09-14T09:08:55.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.621 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:08:55.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:08:55.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:08:55.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:08:55.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:08:55.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.269e-06 2024-09-14T09:08:55.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797019+0000", 2024-09-14T09:08:55.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9519999999999999e-06 2024-09-14T09:08:55.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797022+0000", 2024-09-14T09:08:55.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6079999999999998e-06 2024-09-14T09:08:55.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798759+0000", 2024-09-14T09:08:55.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001737342 2024-09-14T09:08:55.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:55.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798762+0000", 2024-09-14T09:08:55.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:08:55.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790310+0000", 2024-09-14T09:08:55.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99154738799999997 2024-09-14T09:08:55.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790349+0000", 2024-09-14T09:08:55.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9573000000000002e-05 2024-09-14T09:08:55.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790387+0000", 2024-09-14T09:08:55.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7985999999999998e-05 2024-09-14T09:08:55.625 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.625 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.625 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.625 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:234 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3112960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:55.626 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:08:55.626 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.798178479000001, 2024-09-14T09:08:55.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99345674500000003, 2024-09-14T09:08:55.626 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.626 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.626 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.626 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.626 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:55.626 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:55.626 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 234 2024-09-14T09:08:55.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.626 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:08:55.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:08:55.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:08:55.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0100000000000001e-07 2024-09-14T09:08:55.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:55.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0699999999999999e-06 2024-09-14T09:08:55.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:08:55.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.886e-06 2024-09-14T09:08:55.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797032+0000", 2024-09-14T09:08:55.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7149999999999998e-06 2024-09-14T09:08:55.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798778+0000", 2024-09-14T09:08:55.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017460329999999999 2024-09-14T09:08:55.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:55.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798783+0000", 2024-09-14T09:08:55.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0760000000000002e-06 2024-09-14T09:08:55.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790408+0000", 2024-09-14T09:08:55.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99162473299999998 2024-09-14T09:08:55.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790446+0000", 2024-09-14T09:08:55.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8389000000000001e-05 2024-09-14T09:08:55.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790482+0000", 2024-09-14T09:08:55.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5642000000000002e-05 2024-09-14T09:08:55.630 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.630 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.630 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.630 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:235 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3571712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:55.631 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:08:55.631 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.798168580999999, 2024-09-14T09:08:55.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993539477, 2024-09-14T09:08:55.631 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.631 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.631 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.631 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.631 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:55.631 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:55.631 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 235 2024-09-14T09:08:55.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.631 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:08:55.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:08:55.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:08:55.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9999999999999999e-07 2024-09-14T09:08:55.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797036+0000", 2024-09-14T09:08:55.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.051e-06 2024-09-14T09:08:55.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797039+0000", 2024-09-14T09:08:55.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:08:55.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797042+0000", 2024-09-14T09:08:55.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5280000000000002e-06 2024-09-14T09:08:55.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798809+0000", 2024-09-14T09:08:55.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001767394 2024-09-14T09:08:55.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:55.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798815+0000", 2024-09-14T09:08:55.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0859999999999998e-06 2024-09-14T09:08:55.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790502+0000", 2024-09-14T09:08:55.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99168652300000004 2024-09-14T09:08:55.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790539+0000", 2024-09-14T09:08:55.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7471000000000001e-05 2024-09-14T09:08:55.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790574+0000", 2024-09-14T09:08:55.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5292e-05 2024-09-14T09:08:55.635 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.635 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.635 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.636 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:236 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 4030464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:55.636 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:08:55.636 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.798158348000001, 2024-09-14T09:08:55.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993619743, 2024-09-14T09:08:55.636 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.636 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.636 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.636 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.636 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:55.636 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:55.636 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 236 2024-09-14T09:08:55.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.636 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:08:55.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:08:55.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:08:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1400000000000001e-07 2024-09-14T09:08:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797047+0000", 2024-09-14T09:08:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3400000000000001e-06 2024-09-14T09:08:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:08:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0699999999999998e-06 2024-09-14T09:08:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797053+0000", 2024-09-14T09:08:55.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7310000000000002e-06 2024-09-14T09:08:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798839+0000", 2024-09-14T09:08:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001786403 2024-09-14T09:08:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798844+0000", 2024-09-14T09:08:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3730000000000001e-06 2024-09-14T09:08:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790592+0000", 2024-09-14T09:08:55.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99174818099999995 2024-09-14T09:08:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790628+0000", 2024-09-14T09:08:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5831000000000003e-05 2024-09-14T09:08:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790665+0000", 2024-09-14T09:08:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-05 2024-09-14T09:08:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:365 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:08:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.79597132, 2024-09-14T09:08:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157278400000004, 2024-09-14T09:08:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 365 2024-09-14T09:08:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:08:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:08:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:08:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:08:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799233+0000", 2024-09-14T09:08:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.057e-06 2024-09-14T09:08:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799236+0000", 2024-09-14T09:08:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0249999999999998e-06 2024-09-14T09:08:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799239+0000", 2024-09-14T09:08:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.481e-06 2024-09-14T09:08:55.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800963+0000", 2024-09-14T09:08:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017240440000000001 2024-09-14T09:08:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800969+0000", 2024-09-14T09:08:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1410000000000002e-06 2024-09-14T09:08:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790682+0000", 2024-09-14T09:08:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98971330300000004 2024-09-14T09:08:55.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790753+0000", 2024-09-14T09:08:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0548000000000003e-05 2024-09-14T09:08:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790805+0000", 2024-09-14T09:08:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1981999999999998e-05 2024-09-14T09:08:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.645 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:366 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:08:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.795961226999999, 2024-09-14T09:08:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99173757299999998, 2024-09-14T09:08:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 366 2024-09-14T09:08:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:08:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:08:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:08:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-07 2024-09-14T09:08:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799244+0000", 2024-09-14T09:08:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.359e-06 2024-09-14T09:08:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799247+0000", 2024-09-14T09:08:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4929999999999998e-06 2024-09-14T09:08:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799250+0000", 2024-09-14T09:08:55.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:08:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800991+0000", 2024-09-14T09:08:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017412809999999999 2024-09-14T09:08:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800997+0000", 2024-09-14T09:08:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:08:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790824+0000", 2024-09-14T09:08:55.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98982735399999999 2024-09-14T09:08:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790891+0000", 2024-09-14T09:08:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7243999999999995e-05 2024-09-14T09:08:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790980+0000", 2024-09-14T09:08:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8608000000000003e-05 2024-09-14T09:08:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:367 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:08:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.795949855, 2024-09-14T09:08:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99188259999999995, 2024-09-14T09:08:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 367 2024-09-14T09:08:55.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:08:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:08:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:08:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-07 2024-09-14T09:08:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799255+0000", 2024-09-14T09:08:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.111e-06 2024-09-14T09:08:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799259+0000", 2024-09-14T09:08:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8650000000000003e-06 2024-09-14T09:08:55.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799262+0000", 2024-09-14T09:08:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.128e-06 2024-09-14T09:08:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801029+0000", 2024-09-14T09:08:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017668460000000001 2024-09-14T09:08:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801032+0000", 2024-09-14T09:08:55.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3179999999999998e-06 2024-09-14T09:08:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791011+0000", 2024-09-14T09:08:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98997920399999995 2024-09-14T09:08:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791077+0000", 2024-09-14T09:08:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5214000000000003e-05 2024-09-14T09:08:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791136+0000", 2024-09-14T09:08:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9710000000000003e-05 2024-09-14T09:08:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:368 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:08:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.795938312000001, 2024-09-14T09:08:55.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99201753800000003, 2024-09-14T09:08:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 368 2024-09-14T09:08:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:08:55.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:08:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:08:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4900000000000002e-07 2024-09-14T09:08:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799267+0000", 2024-09-14T09:08:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.079e-06 2024-09-14T09:08:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799270+0000", 2024-09-14T09:08:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.993e-06 2024-09-14T09:08:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799272+0000", 2024-09-14T09:08:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.695e-06 2024-09-14T09:08:55.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801043+0000", 2024-09-14T09:08:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001771105 2024-09-14T09:08:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801046+0000", 2024-09-14T09:08:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7999999999999999e-06 2024-09-14T09:08:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791150+0000", 2024-09-14T09:08:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99010348699999995 2024-09-14T09:08:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791193+0000", 2024-09-14T09:08:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3615999999999997e-05 2024-09-14T09:08:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791283+0000", 2024-09-14T09:08:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9513999999999997e-05 2024-09-14T09:08:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.661 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:369 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:08:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.795927974000001, 2024-09-14T09:08:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99213433600000001, 2024-09-14T09:08:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 369 2024-09-14T09:08:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.662 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:08:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:08:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:08:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:08:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799277+0000", 2024-09-14T09:08:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.108e-06 2024-09-14T09:08:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799280+0000", 2024-09-14T09:08:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:08:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799283+0000", 2024-09-14T09:08:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.531e-06 2024-09-14T09:08:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801058+0000", 2024-09-14T09:08:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001775085 2024-09-14T09:08:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801060+0000", 2024-09-14T09:08:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8260000000000001e-06 2024-09-14T09:08:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791299+0000", 2024-09-14T09:08:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99023856799999999 2024-09-14T09:08:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791352+0000", 2024-09-14T09:08:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2528000000000003e-05 2024-09-14T09:08:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791410+0000", 2024-09-14T09:08:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8298000000000003e-05 2024-09-14T09:08:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:370 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2457600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:08:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.795903206999999, 2024-09-14T09:08:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99220795399999995, 2024-09-14T09:08:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 370 2024-09-14T09:08:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:08:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:08:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799301+0000", 2024-09-14T09:08:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2024-09-14T09:08:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799303+0000", 2024-09-14T09:08:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9319999999999999e-06 2024-09-14T09:08:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799310+0000", 2024-09-14T09:08:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8680000000000001e-06 2024-09-14T09:08:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799315+0000", 2024-09-14T09:08:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.921e-06 2024-09-14T09:08:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801071+0000", 2024-09-14T09:08:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001756678 2024-09-14T09:08:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801080+0000", 2024-09-14T09:08:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6060000000000003e-06 2024-09-14T09:08:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791429+0000", 2024-09-14T09:08:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99034944599999997 2024-09-14T09:08:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791471+0000", 2024-09-14T09:08:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1279999999999998e-05 2024-09-14T09:08:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791508+0000", 2024-09-14T09:08:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7663999999999997e-05 2024-09-14T09:08:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:371 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2916352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:08:55.671 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.795882034999998, 2024-09-14T09:08:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99228692299999999, 2024-09-14T09:08:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 371 2024-09-14T09:08:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:08:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:08:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799322+0000", 2024-09-14T09:08:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:08:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799333+0000", 2024-09-14T09:08:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1044e-05 2024-09-14T09:08:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799341+0000", 2024-09-14T09:08:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8439999999999998e-06 2024-09-14T09:08:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799354+0000", 2024-09-14T09:08:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3114e-05 2024-09-14T09:08:55.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801093+0000", 2024-09-14T09:08:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017385910000000001 2024-09-14T09:08:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801096+0000", 2024-09-14T09:08:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0680000000000001e-06 2024-09-14T09:08:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791528+0000", 2024-09-14T09:08:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99043264200000003 2024-09-14T09:08:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791570+0000", 2024-09-14T09:08:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2144999999999997e-05 2024-09-14T09:08:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791608+0000", 2024-09-14T09:08:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7966000000000002e-05 2024-09-14T09:08:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:372 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3375104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:55.676 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:08:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.795841487000001, 2024-09-14T09:08:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992342897, 2024-09-14T09:08:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 372 2024-09-14T09:08:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:08:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:08:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799363+0000", 2024-09-14T09:08:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2024-09-14T09:08:55.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799365+0000", 2024-09-14T09:08:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5500000000000001e-06 2024-09-14T09:08:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799371+0000", 2024-09-14T09:08:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2500000000000003e-06 2024-09-14T09:08:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799377+0000", 2024-09-14T09:08:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7509999999999997e-06 2024-09-14T09:08:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801107+0000", 2024-09-14T09:08:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017298019999999999 2024-09-14T09:08:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801111+0000", 2024-09-14T09:08:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8619999999999996e-06 2024-09-14T09:08:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791626+0000", 2024-09-14T09:08:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99051563300000001 2024-09-14T09:08:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791668+0000", 2024-09-14T09:08:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1424000000000002e-05 2024-09-14T09:08:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791705+0000", 2024-09-14T09:08:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7035e-05 2024-09-14T09:08:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.681 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:373 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:08:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.795819542, 2024-09-14T09:08:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99253589399999997, 2024-09-14T09:08:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:55.682 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 373 2024-09-14T09:08:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:08:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:08:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:08:55.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2024-09-14T09:08:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799387+0000", 2024-09-14T09:08:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1019999999999999e-06 2024-09-14T09:08:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799393+0000", 2024-09-14T09:08:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0190000000000003e-06 2024-09-14T09:08:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799398+0000", 2024-09-14T09:08:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:08:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801123+0000", 2024-09-14T09:08:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017251949999999999 2024-09-14T09:08:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:55.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801126+0000", 2024-09-14T09:08:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9280000000000002e-06 2024-09-14T09:08:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791746+0000", 2024-09-14T09:08:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99062036899999995 2024-09-14T09:08:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791835+0000", 2024-09-14T09:08:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9004000000000004e-05 2024-09-14T09:08:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791920+0000", 2024-09-14T09:08:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4524000000000006e-05 2024-09-14T09:08:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:10395 3.17 3:e9053d87:::rbd_data.111228c3791c.0000000000000006:18 [read 962560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.797914+0000", 2024-09-14T09:08:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.797289641999999, 2024-09-14T09:08:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034376019000000001, 2024-09-14T09:08:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.687 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10395 2024-09-14T09:08:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.797914+0000", 2024-09-14T09:08:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.797914+0000", 2024-09-14T09:08:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798042+0000", 2024-09-14T09:08:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012855399999999999 2024-09-14T09:08:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798044+0000", 2024-09-14T09:08:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.086e-06 2024-09-14T09:08:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798049+0000", 2024-09-14T09:08:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7770000000000002e-06 2024-09-14T09:08:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798066+0000", 2024-09-14T09:08:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6405999999999998e-05 2024-09-14T09:08:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832200+0000", 2024-09-14T09:08:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034134022 2024-09-14T09:08:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832241+0000", 2024-09-14T09:08:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1566999999999997e-05 2024-09-14T09:08:55.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832290+0000", 2024-09-14T09:08:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8606999999999997e-05 2024-09-14T09:08:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:10397 3.17 3:e9053d87:::rbd_data.111228c3791c.0000000000000006:18 [read 1085440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.798088+0000", 2024-09-14T09:08:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.797115729000001, 2024-09-14T09:08:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034429187, 2024-09-14T09:08:55.691 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10397 2024-09-14T09:08:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798088+0000", 2024-09-14T09:08:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:55.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798088+0000", 2024-09-14T09:08:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803904+0000", 2024-09-14T09:08:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058164799999999997 2024-09-14T09:08:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803908+0000", 2024-09-14T09:08:55.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8580000000000002e-06 2024-09-14T09:08:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803918+0000", 2024-09-14T09:08:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4939999999999992e-06 2024-09-14T09:08:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803923+0000", 2024-09-14T09:08:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2599999999999996e-06 2024-09-14T09:08:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832428+0000", 2024-09-14T09:08:55.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.028504788 2024-09-14T09:08:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832470+0000", 2024-09-14T09:08:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2358999999999999e-05 2024-09-14T09:08:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832517+0000", 2024-09-14T09:08:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6947999999999998e-05 2024-09-14T09:08:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.695 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:55.696 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:55.696 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:55.697 INFO:teuthology.orchestra.run.smithi148.stdout:4225 punch from 0x1b86600 to 0x1b91c00, (0xb600 bytes) 2024-09-14T09:08:55.697 INFO:teuthology.orchestra.run.smithi148.stdout:4229 write 0x6663800 thru 0x666df8c (0xa78d bytes) 2024-09-14T09:08:55.697 INFO:teuthology.orchestra.run.smithi148.stdout:4231 write 0xdff8c00 thru 0xe007799 (0xeb9a bytes) 2024-09-14T09:08:55.697 INFO:teuthology.orchestra.run.smithi148.stdout:4232 write 0x89e5400 thru 0x89ecef2 (0x7af3 bytes) 2024-09-14T09:08:55.698 INFO:teuthology.orchestra.run.smithi148.stdout:4233 trunc from 0xe007800 to 0x237a400 2024-09-14T09:08:55.698 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:55.699+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:55.698 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:08:55.699 INFO:teuthology.orchestra.run.smithi148.stdout:4235 read 0x40200 thru 0x48116 (0x7f17 bytes) 2024-09-14T09:08:55.732 INFO:teuthology.orchestra.run.smithi148.stdout:4239 write 0xb5a3000 thru 0xb5aafe2 (0x7fe3 bytes) 2024-09-14T09:08:55.732 INFO:teuthology.orchestra.run.smithi148.stdout:4240 read 0x2878600 thru 0x2887975 (0xf376 bytes) 2024-09-14T09:08:55.734 INFO:teuthology.orchestra.run.smithi148.stdout:4241 trunc from 0xb5ab000 to 0xda7a600 2024-09-14T09:08:55.751 INFO:teuthology.orchestra.run.smithi148.stdout:4243 read 0x397a000 thru 0x3980551 (0x6552 bytes) 2024-09-14T09:08:55.751 INFO:teuthology.orchestra.run.smithi148.stdout:4249 write 0x3ab0c00 thru 0x3ab8382 (0x7783 bytes) 2024-09-14T09:08:55.751 INFO:teuthology.orchestra.run.smithi148.stdout:4250 punch from 0x3333a00 to 0x3339200, (0x5800 bytes) 2024-09-14T09:08:55.752 INFO:teuthology.orchestra.run.smithi148.stdout:4251 punch from 0x8838400 to 0x8844400, (0xc000 bytes) 2024-09-14T09:08:55.752 INFO:teuthology.orchestra.run.smithi148.stdout:4253 trunc from 0xda7a600 to 0xd3be600 2024-09-14T09:08:55.778 INFO:teuthology.orchestra.run.smithi148.stdout:4255 write 0x82e7200 thru 0x82ef7f1 (0x85f2 bytes) 2024-09-14T09:08:55.786 INFO:teuthology.orchestra.run.smithi148.stdout:4258 trunc from 0xd3be600 to 0x5dd9600 2024-09-14T09:08:55.797 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:55.799+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:55.806 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:55.806 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:55.806 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:08:55.806 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:55.810 INFO:teuthology.orchestra.run.smithi148.stdout:4265 read 0x958000 thru 0x95b8c3 (0x38c4 bytes) 2024-09-14T09:08:55.810 INFO:teuthology.orchestra.run.smithi148.stdout:4266 write 0x38f5200 thru 0x38fd79e (0x859f bytes) 2024-09-14T09:08:55.811 INFO:teuthology.orchestra.run.smithi148.stdout:4269 write 0x3ad1000 thru 0x3adb2bc (0xa2bd bytes) 2024-09-14T09:08:55.811 INFO:teuthology.orchestra.run.smithi148.stdout:4270 punch from 0x107ee00 to 0x1087a00, (0x8c00 bytes) 2024-09-14T09:08:55.812 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:08:55.816 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:08:55.818 INFO:teuthology.orchestra.run.smithi148.stdout:4272 trunc from 0x5dd9600 to 0xb157c00 2024-09-14T09:08:55.841 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T09:08:55.845 INFO:teuthology.orchestra.run.smithi148.stdout:4275 trunc from 0xb157c00 to 0x2305c00 2024-09-14T09:08:55.868 INFO:teuthology.orchestra.run.smithi148.stdout:4277 trunc from 0x2305c00 to 0x7c2e800 2024-09-14T09:08:55.879 INFO:teuthology.orchestra.run.smithi148.stdout:4281 write 0x6c06400 thru 0x6c0d4c4 (0x70c5 bytes) 2024-09-14T09:08:55.881 INFO:teuthology.orchestra.run.smithi148.stdout:4284 punch from 0x5aa0a00 to 0x5aa8600, (0x7c00 bytes) 2024-09-14T09:08:55.881 INFO:teuthology.orchestra.run.smithi148.stdout:4286 punch from 0x1d5d800 to 0x1d6aa00, (0xd200 bytes) 2024-09-14T09:08:55.885 INFO:teuthology.orchestra.run.smithi148.stdout:4287 trunc from 0x7c2e800 to 0xacc5000 2024-09-14T09:08:55.897 INFO:teuthology.orchestra.run.smithi148.stdout:4289 read 0x5dc0800 thru 0x5dc8609 (0x7e0a bytes) 2024-09-14T09:08:55.898 INFO:teuthology.orchestra.run.smithi148.stdout:4290 write 0x63ffe00 thru 0x6402a98 (0x2c99 bytes) 2024-09-14T09:08:55.898 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:55.900+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:55.908 INFO:teuthology.orchestra.run.smithi148.stdout:4292 trunc from 0xacc5000 to 0x272dc00 2024-09-14T09:08:55.931 INFO:teuthology.orchestra.run.smithi148.stdout:4293 trunc from 0x272dc00 to 0x5291000 2024-09-14T09:08:55.939 INFO:teuthology.orchestra.run.smithi148.stdout:4295 punch from 0xfcd600 to 0xfd0800, (0x3200 bytes) 2024-09-14T09:08:55.941 INFO:teuthology.orchestra.run.smithi148.stdout:4298 punch from 0x8c2e00 to 0x8c9000, (0x6200 bytes) 2024-09-14T09:08:55.941 INFO:teuthology.orchestra.run.smithi148.stdout:4299 write 0x106a600 thru 0x1070c18 (0x6619 bytes) 2024-09-14T09:08:55.942 INFO:teuthology.orchestra.run.smithi148.stdout:4303 clone 26 order 18 su 4096 sc 7 2024-09-14T09:08:55.947 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:55.947 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:55.965 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:55.965 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:55.965 INFO:teuthology.orchestra.run.smithi116.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-14T09:08:55.971 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:55.971 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:55.981 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:08:55.983 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:55.984 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:55.999 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:56.001+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:55.999 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:56.000 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:56.017 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:56.017 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:56.020 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T09:08:56.020 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T09:08:56.086 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:56.086 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:56.095 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:08:56.139 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:56.141+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:56.200 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:56.200 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:56.200 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:56.202+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:56.208 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:08:56.301 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:56.303+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:56.351 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:56.351 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:56.361 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:08:56.401 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:56.404+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:56.502 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:56.505+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:56.503 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:56.503 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:56.512 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:08:56.603 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:56.605+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:56.620 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:56.620 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:56.629 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:08:56.704 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:56.706+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:56.773 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:56.773 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:56.781 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:08:56.825 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:56.827+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:56.829 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is set 2024-09-14T09:08:56.893 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:56.893 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:56.897 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone25 from 0x5291000 (overlap 0x2305c00) to 0x1c04800 2024-09-14T09:08:56.902 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:08:56.943 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:56.945+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:57.007 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:57.009+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:57.049 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:57.049 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:57.058 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:08:57.107 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:57.109+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:57.162 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #24, image image_client.0-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent25 2024-09-14T09:08:57.208 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:57.211+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:57.210 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:57.210 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:57.220 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:08:57.310 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:57.311+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:57.380 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:57.381 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:57.390 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:08:57.411 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:08:57.412+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:08:57.494 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:57.494 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:57.504 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:08:57.508 INFO:teuthology.orchestra.run.smithi148.stdout:4304 write 0x78aec00 thru 0x78b23ba (0x37bb bytes) 2024-09-14T09:08:57.510 INFO:teuthology.orchestra.run.smithi148.stdout:4305 read 0x166e400 thru 0x1677a58 (0x9659 bytes) 2024-09-14T09:08:57.510 INFO:teuthology.orchestra.run.smithi148.stdout:4306 read 0x3ddc00 thru 0x3edb21 (0xff22 bytes) 2024-09-14T09:08:57.516 INFO:teuthology.orchestra.run.smithi148.stdout:4307 trunc from 0x78b2400 to 0x1efa200 2024-09-14T09:08:57.549 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:57.551+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:57.588 INFO:teuthology.orchestra.run.smithi148.stdout:4308 punch from 0x19e6e00 to 0x19f0c00, (0x9e00 bytes) 2024-09-14T09:08:57.613 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:57.615+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:57.621 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:57.621 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:57.631 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:08:57.637 INFO:teuthology.orchestra.run.smithi148.stdout:4311 write 0xcc5d400 thru 0xcc6362d (0x622e bytes) 2024-09-14T09:08:57.637 INFO:teuthology.orchestra.run.smithi148.stdout:4313 punch from 0x9a99c00 to 0x9a9a200, (0x600 bytes) 2024-09-14T09:08:57.638 INFO:teuthology.orchestra.run.smithi148.stdout:4314 write 0x8fae400 thru 0x8fb3f31 (0x5b32 bytes) 2024-09-14T09:08:57.639 INFO:teuthology.orchestra.run.smithi148.stdout:4315 trunc from 0xcc63800 to 0xbf0bc00 2024-09-14T09:08:57.674 INFO:teuthology.orchestra.run.smithi148.stdout:4316 write 0x4771c00 thru 0x477a4d1 (0x88d2 bytes) 2024-09-14T09:08:57.675 INFO:teuthology.orchestra.run.smithi148.stdout:4317 write 0xb8a2c00 thru 0xb8a48df (0x1ce0 bytes) 2024-09-14T09:08:57.675 INFO:teuthology.orchestra.run.smithi148.stdout:4319 punch from 0x6f2e000 to 0x6f31c00, (0x3c00 bytes) 2024-09-14T09:08:57.688 INFO:teuthology.orchestra.run.smithi148.stdout:4320 trunc from 0xbf0bc00 to 0x12e2000 2024-09-14T09:08:57.716 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:57.718+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:57.735 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5] out_osds: [1] dead_osds: [2] live_osds: [0, 1, 3, 4, 5] 2024-09-14T09:08:57.735 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:08:57.735 INFO:tasks.thrashosds.thrasher:Adding osd 1 2024-09-14T09:08:57.735 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 1 2024-09-14T09:08:57.788 INFO:teuthology.orchestra.run.smithi148.stdout:4323 read 0xd50a00 thru 0xd5d559 (0xcb5a bytes) 2024-09-14T09:08:57.789 INFO:teuthology.orchestra.run.smithi148.stdout:4332 clone 27 order 19 su 32768 sc 12 2024-09-14T09:08:57.805 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:57.805 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:57.815 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:57.817+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:57.815 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:08:57.915 INFO:teuthology.orchestra.run.smithi148.stdout:flattening image image_client.0-clone26 2024-09-14T09:08:57.915 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:57.918+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:57.922 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:57.922 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:57.931 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:08:58.017 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:58.019+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:58.021 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:08:58.035 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:08:58.035 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:08:58.045 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:08:58.048 INFO:tasks.ceph.mon.a.smithi116.stderr:2024-09-14T09:08:58.050+0000 7f4999343640 -1 mon.a@0(leader).osd e74 definitely_dead 0 2024-09-14T09:08:58.118 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:58.120+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:58.143 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:08:58.144 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:08:58.156 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:58.156 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:58.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:58.156 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:58.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.156 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2265 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4034560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.156 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:08:58.156 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.294029041000002, 2024-09-14T09:08:58.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073974829000000006, 2024-09-14T09:08:58.156 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2265 2024-09-14T09:08:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:08:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:08:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862542+0000", 2024-09-14T09:08:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:08:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862543+0000", 2024-09-14T09:08:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.81e-06 2024-09-14T09:08:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862549+0000", 2024-09-14T09:08:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8850000000000004e-06 2024-09-14T09:08:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862554+0000", 2024-09-14T09:08:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5279999999999997e-06 2024-09-14T09:08:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936318+0000", 2024-09-14T09:08:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073764422999999996 2024-09-14T09:08:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936412+0000", 2024-09-14T09:08:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3801000000000005e-05 2024-09-14T09:08:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936516+0000", 2024-09-14T09:08:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000104007 2024-09-14T09:08:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2266 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4096000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:08:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.294011177000002, 2024-09-14T09:08:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074208332000000002, 2024-09-14T09:08:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2266 2024-09-14T09:08:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:08:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:08:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862738+0000", 2024-09-14T09:08:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017920300000000001 2024-09-14T09:08:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862744+0000", 2024-09-14T09:08:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3000000000000001e-06 2024-09-14T09:08:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862753+0000", 2024-09-14T09:08:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8179999999999999e-06 2024-09-14T09:08:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862785+0000", 2024-09-14T09:08:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1949000000000002e-05 2024-09-14T09:08:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936556+0000", 2024-09-14T09:08:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073770268999999999 2024-09-14T09:08:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936657+0000", 2024-09-14T09:08:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101387 2024-09-14T09:08:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936767+0000", 2024-09-14T09:08:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110406 2024-09-14T09:08:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2267 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4157440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:08:58.166 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.293772595, 2024-09-14T09:08:58.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074200918000000005, 2024-09-14T09:08:58.166 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.166 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2267 2024-09-14T09:08:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:08:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:08:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863416+0000", 2024-09-14T09:08:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000618492 2024-09-14T09:08:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863421+0000", 2024-09-14T09:08:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1359999999999996e-06 2024-09-14T09:08:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863434+0000", 2024-09-14T09:08:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2291e-05 2024-09-14T09:08:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863444+0000", 2024-09-14T09:08:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9769999999999995e-06 2024-09-14T09:08:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936808+0000", 2024-09-14T09:08:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073364051999999999 2024-09-14T09:08:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936892+0000", 2024-09-14T09:08:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4641999999999994e-05 2024-09-14T09:08:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936999+0000", 2024-09-14T09:08:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106328 2024-09-14T09:08:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2328 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 45056~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.863458+0000", 2024-09-14T09:08:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.293112356000002, 2024-09-14T09:08:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073931949999999996, 2024-09-14T09:08:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2328 2024-09-14T09:08:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863458+0000", 2024-09-14T09:08:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863458+0000", 2024-09-14T09:08:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863489+0000", 2024-09-14T09:08:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1270999999999999e-05 2024-09-14T09:08:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863500+0000", 2024-09-14T09:08:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0969e-05 2024-09-14T09:08:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863509+0000", 2024-09-14T09:08:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5210000000000002e-06 2024-09-14T09:08:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863515+0000", 2024-09-14T09:08:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-09-14T09:08:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937038+0000", 2024-09-14T09:08:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073522901000000002 2024-09-14T09:08:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937131+0000", 2024-09-14T09:08:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.276e-05 2024-09-14T09:08:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937390+0000", 2024-09-14T09:08:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025917099999999999 2024-09-14T09:08:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2329 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 106496~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:08:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.293043986000001, 2024-09-14T09:08:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074180251000000003, 2024-09-14T09:08:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2329 2024-09-14T09:08:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:08:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:08:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864203+0000", 2024-09-14T09:08:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000677015 2024-09-14T09:08:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864208+0000", 2024-09-14T09:08:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.972e-06 2024-09-14T09:08:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864221+0000", 2024-09-14T09:08:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2683e-05 2024-09-14T09:08:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864229+0000", 2024-09-14T09:08:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0809999999999994e-06 2024-09-14T09:08:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937430+0000", 2024-09-14T09:08:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073201231000000005 2024-09-14T09:08:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937513+0000", 2024-09-14T09:08:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2652999999999996e-05 2024-09-14T09:08:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937707+0000", 2024-09-14T09:08:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000193616 2024-09-14T09:08:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2331 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 229376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:08:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.292226489000001, 2024-09-14T09:08:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.07400843, 2024-09-14T09:08:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2331 2024-09-14T09:08:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:08:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:08:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868104+0000", 2024-09-14T09:08:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003760453 2024-09-14T09:08:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868109+0000", 2024-09-14T09:08:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9339999999999997e-06 2024-09-14T09:08:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868119+0000", 2024-09-14T09:08:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5389999999999996e-06 2024-09-14T09:08:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868126+0000", 2024-09-14T09:08:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4499999999999998e-06 2024-09-14T09:08:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938065+0000", 2024-09-14T09:08:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069938809000000005 2024-09-14T09:08:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938148+0000", 2024-09-14T09:08:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3171999999999996e-05 2024-09-14T09:08:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938352+0000", 2024-09-14T09:08:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020407300000000001 2024-09-14T09:08:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2380 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3239936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:08:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.277201461000001, 2024-09-14T09:08:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073985913, 2024-09-14T09:08:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2380 2024-09-14T09:08:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:08:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:08:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879697+0000", 2024-09-14T09:08:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032864100000000001 2024-09-14T09:08:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879702+0000", 2024-09-14T09:08:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.578e-06 2024-09-14T09:08:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879716+0000", 2024-09-14T09:08:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.413e-05 2024-09-14T09:08:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879724+0000", 2024-09-14T09:08:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.559e-06 2024-09-14T09:08:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953155+0000", 2024-09-14T09:08:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073431221000000005 2024-09-14T09:08:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953247+0000", 2024-09-14T09:08:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1662000000000004e-05 2024-09-14T09:08:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953355+0000", 2024-09-14T09:08:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010812200000000001 2024-09-14T09:08:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2500 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2789376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:08:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.258670416000001, 2024-09-14T09:08:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073867281000000007, 2024-09-14T09:08:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2500 2024-09-14T09:08:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:08:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:08:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:08:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1e-07 2024-09-14T09:08:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897901+0000", 2024-09-14T09:08:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1650000000000001e-06 2024-09-14T09:08:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897905+0000", 2024-09-14T09:08:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.755e-06 2024-09-14T09:08:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897908+0000", 2024-09-14T09:08:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7480000000000002e-06 2024-09-14T09:08:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971448+0000", 2024-09-14T09:08:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073539801000000002 2024-09-14T09:08:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971535+0000", 2024-09-14T09:08:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7085999999999999e-05 2024-09-14T09:08:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971767+0000", 2024-09-14T09:08:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023251599999999999 2024-09-14T09:08:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2501 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2850816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:08:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.258659157, 2024-09-14T09:08:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074288858999999999, 2024-09-14T09:08:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2501 2024-09-14T09:08:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:08:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:08:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:08:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.41e-07 2024-09-14T09:08:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897913+0000", 2024-09-14T09:08:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3090000000000001e-06 2024-09-14T09:08:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897918+0000", 2024-09-14T09:08:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8470000000000003e-06 2024-09-14T09:08:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897922+0000", 2024-09-14T09:08:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5549999999999996e-06 2024-09-14T09:08:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971872+0000", 2024-09-14T09:08:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073950057999999999 2024-09-14T09:08:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971958+0000", 2024-09-14T09:08:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5941999999999998e-05 2024-09-14T09:08:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972200+0000", 2024-09-14T09:08:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000241907 2024-09-14T09:08:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2502 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2912256~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:08:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.258619976999999, 2024-09-14T09:08:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074614080999999999, 2024-09-14T09:08:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2502 2024-09-14T09:08:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:08:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:08:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897951+0000", 2024-09-14T09:08:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:08:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897953+0000", 2024-09-14T09:08:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5670000000000002e-06 2024-09-14T09:08:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897970+0000", 2024-09-14T09:08:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6319000000000001e-05 2024-09-14T09:08:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897976+0000", 2024-09-14T09:08:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8760000000000002e-06 2024-09-14T09:08:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972245+0000", 2024-09-14T09:08:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074269186000000001 2024-09-14T09:08:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972333+0000", 2024-09-14T09:08:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7800999999999995e-05 2024-09-14T09:08:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972564+0000", 2024-09-14T09:08:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000231833 2024-09-14T09:08:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2503 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2973696~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:08:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.258585960000001, 2024-09-14T09:08:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074944286999999998, 2024-09-14T09:08:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2503 2024-09-14T09:08:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:08:58.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:08:58.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897985+0000", 2024-09-14T09:08:58.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999998e-07 2024-09-14T09:08:58.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897987+0000", 2024-09-14T09:08:58.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.401e-06 2024-09-14T09:08:58.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897999+0000", 2024-09-14T09:08:58.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1851999999999999e-05 2024-09-14T09:08:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898005+0000", 2024-09-14T09:08:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9789999999999998e-06 2024-09-14T09:08:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972609+0000", 2024-09-14T09:08:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074604217 2024-09-14T09:08:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972684+0000", 2024-09-14T09:08:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4777999999999995e-05 2024-09-14T09:08:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972929+0000", 2024-09-14T09:08:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024448100000000001 2024-09-14T09:08:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2504 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3035136~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:08:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.258557868, 2024-09-14T09:08:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075285131000000005, 2024-09-14T09:08:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2504 2024-09-14T09:08:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:08:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:08:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898078+0000", 2024-09-14T09:08:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5775e-05 2024-09-14T09:08:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898082+0000", 2024-09-14T09:08:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.49e-06 2024-09-14T09:08:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898092+0000", 2024-09-14T09:08:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0509999999999999e-05 2024-09-14T09:08:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898099+0000", 2024-09-14T09:08:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.81e-06 2024-09-14T09:08:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972971+0000", 2024-09-14T09:08:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074871788999999994 2024-09-14T09:08:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973055+0000", 2024-09-14T09:08:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3980000000000006e-05 2024-09-14T09:08:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973298+0000", 2024-09-14T09:08:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024277700000000001 2024-09-14T09:08:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2505 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3096576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:08:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.258461613000001, 2024-09-14T09:08:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075506668999999998, 2024-09-14T09:08:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2505 2024-09-14T09:08:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:08:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:08:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898370+0000", 2024-09-14T09:08:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026128799999999998 2024-09-14T09:08:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898374+0000", 2024-09-14T09:08:58.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8070000000000001e-06 2024-09-14T09:08:58.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898383+0000", 2024-09-14T09:08:58.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0520000000000007e-06 2024-09-14T09:08:58.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898389+0000", 2024-09-14T09:08:58.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2639999999999997e-06 2024-09-14T09:08:58.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973330+0000", 2024-09-14T09:08:58.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074940548999999995 2024-09-14T09:08:58.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973402+0000", 2024-09-14T09:08:58.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2556000000000001e-05 2024-09-14T09:08:58.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973615+0000", 2024-09-14T09:08:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000213153 2024-09-14T09:08:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2506 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3158016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:08:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.258168369, 2024-09-14T09:08:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075556110999999995, 2024-09-14T09:08:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.214 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2506 2024-09-14T09:08:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:08:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:08:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898497+0000", 2024-09-14T09:08:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4806e-05 2024-09-14T09:08:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898500+0000", 2024-09-14T09:08:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.54e-06 2024-09-14T09:08:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898507+0000", 2024-09-14T09:08:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1590000000000004e-06 2024-09-14T09:08:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898513+0000", 2024-09-14T09:08:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.015e-06 2024-09-14T09:08:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973656+0000", 2024-09-14T09:08:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075142929999999997 2024-09-14T09:08:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973742+0000", 2024-09-14T09:08:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5535e-05 2024-09-14T09:08:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973958+0000", 2024-09-14T09:08:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000216126 2024-09-14T09:08:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2507 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3219456~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:08:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.258039785000001, 2024-09-14T09:08:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075623459000000004, 2024-09-14T09:08:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2507 2024-09-14T09:08:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:08:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:08:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898761+0000", 2024-09-14T09:08:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000230614 2024-09-14T09:08:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898765+0000", 2024-09-14T09:08:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6629999999999999e-06 2024-09-14T09:08:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898774+0000", 2024-09-14T09:08:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6749999999999997e-06 2024-09-14T09:08:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898781+0000", 2024-09-14T09:08:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4640000000000003e-06 2024-09-14T09:08:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973985+0000", 2024-09-14T09:08:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075204101999999995 2024-09-14T09:08:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974063+0000", 2024-09-14T09:08:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7632000000000005e-05 2024-09-14T09:08:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974154+0000", 2024-09-14T09:08:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1309000000000003e-05 2024-09-14T09:08:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2508 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3280896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:08:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.257778022, 2024-09-14T09:08:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075576943999999993, 2024-09-14T09:08:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2508 2024-09-14T09:08:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:08:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:08:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899176+0000", 2024-09-14T09:08:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038340500000000002 2024-09-14T09:08:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899179+0000", 2024-09-14T09:08:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0290000000000001e-06 2024-09-14T09:08:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899186+0000", 2024-09-14T09:08:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8199999999999999e-06 2024-09-14T09:08:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899190+0000", 2024-09-14T09:08:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2050000000000004e-06 2024-09-14T09:08:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974193+0000", 2024-09-14T09:08:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075003632000000001 2024-09-14T09:08:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974276+0000", 2024-09-14T09:08:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2272000000000001e-05 2024-09-14T09:08:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974369+0000", 2024-09-14T09:08:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3580999999999997e-05 2024-09-14T09:08:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2509 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3342336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:08:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.257370405, 2024-09-14T09:08:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075356229999999996, 2024-09-14T09:08:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2509 2024-09-14T09:08:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:08:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:08:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899439+0000", 2024-09-14T09:08:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023958599999999999 2024-09-14T09:08:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899444+0000", 2024-09-14T09:08:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8790000000000002e-06 2024-09-14T09:08:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899455+0000", 2024-09-14T09:08:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0597999999999999e-05 2024-09-14T09:08:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899462+0000", 2024-09-14T09:08:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8179999999999998e-06 2024-09-14T09:08:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974400+0000", 2024-09-14T09:08:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074937999000000005 2024-09-14T09:08:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974465+0000", 2024-09-14T09:08:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5134000000000004e-05 2024-09-14T09:08:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974556+0000", 2024-09-14T09:08:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1216000000000002e-05 2024-09-14T09:08:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2510 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3403776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:08:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.257095012000001, 2024-09-14T09:08:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075295775999999995, 2024-09-14T09:08:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2510 2024-09-14T09:08:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:08:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:08:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899691+0000", 2024-09-14T09:08:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021615999999999999 2024-09-14T09:08:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899696+0000", 2024-09-14T09:08:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3200000000000001e-06 2024-09-14T09:08:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899704+0000", 2024-09-14T09:08:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9440000000000005e-06 2024-09-14T09:08:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899710+0000", 2024-09-14T09:08:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.584e-06 2024-09-14T09:08:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974594+0000", 2024-09-14T09:08:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074883551000000007 2024-09-14T09:08:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974679+0000", 2024-09-14T09:08:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5365999999999995e-05 2024-09-14T09:08:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974771+0000", 2024-09-14T09:08:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1850999999999999e-05 2024-09-14T09:08:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2511 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3465216~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:08:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.256848794, 2024-09-14T09:08:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075234668000000005, 2024-09-14T09:08:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2511 2024-09-14T09:08:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:08:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:08:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899951+0000", 2024-09-14T09:08:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000229569 2024-09-14T09:08:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899955+0000", 2024-09-14T09:08:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1010000000000002e-06 2024-09-14T09:08:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899971+0000", 2024-09-14T09:08:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5648999999999999e-05 2024-09-14T09:08:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899978+0000", 2024-09-14T09:08:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0829999999999998e-06 2024-09-14T09:08:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974806+0000", 2024-09-14T09:08:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074828092999999998 2024-09-14T09:08:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974870+0000", 2024-09-14T09:08:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4492000000000005e-05 2024-09-14T09:08:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974956+0000", 2024-09-14T09:08:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5680999999999995e-05 2024-09-14T09:08:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2512 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3526656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:08:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.256581249, 2024-09-14T09:08:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075178812999999997, 2024-09-14T09:08:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2512 2024-09-14T09:08:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:08:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:08:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904181+0000", 2024-09-14T09:08:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041919399999999999 2024-09-14T09:08:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904186+0000", 2024-09-14T09:08:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2390000000000002e-06 2024-09-14T09:08:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904199+0000", 2024-09-14T09:08:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2709e-05 2024-09-14T09:08:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904207+0000", 2024-09-14T09:08:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8150000000000006e-06 2024-09-14T09:08:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975000+0000", 2024-09-14T09:08:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.070793444999999997 2024-09-14T09:08:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975079+0000", 2024-09-14T09:08:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8480999999999996e-05 2024-09-14T09:08:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975168+0000", 2024-09-14T09:08:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9184000000000005e-05 2024-09-14T09:08:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.246 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:58.247 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:08:58.248 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:08:58.248 INFO:teuthology.orchestra.run.smithi116.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-14T09:08:58.249 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:08:58.249 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:08:58.249 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:08:58.250 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:08:58.250 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:08:58.250 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:08:58.251 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T09:08:58.251 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:08:58.251 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T09:08:58.252 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:58.250+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:58.349 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:58.351+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:58.394 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:58.394 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:58.395 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:08:58.395 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:58.403 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:08:58.449 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:58.451+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:58.507 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:58.508 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:08:58.508 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:08:58.508 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:08:58.508 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:58.517 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:08:58.534 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #25, image image_client.0-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent26 2024-09-14T09:08:58.560 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:58.562+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:58.624 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:08:58.624 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:08:58.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:08:58.624 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:08:58.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.624 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4171.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T09:08:58.624 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:58.625 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 88.392297037000006, 2024-09-14T09:08:58.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72111598600000004, 2024-09-14T09:08:58.625 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.625 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.625 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:58.625 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.625 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4171", 2024-09-14T09:08:58.625 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.144:0/3119569515", 2024-09-14T09:08:58.625 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1 2024-09-14T09:08:58.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.625 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:58.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233062+0000", 2024-09-14T09:08:58.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233065+0000", 2024-09-14T09:08:58.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1909999999999999e-06 2024-09-14T09:08:58.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233071+0000", 2024-09-14T09:08:58.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5300000000000002e-06 2024-09-14T09:08:58.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233081+0000", 2024-09-14T09:08:58.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0339e-05 2024-09-14T09:08:58.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233093+0000", 2024-09-14T09:08:58.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1252e-05 2024-09-14T09:08:58.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233162+0000", 2024-09-14T09:08:58.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9678999999999995e-05 2024-09-14T09:08:58.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:08:58.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.233171+0000", 2024-09-14T09:08:58.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.132e-06 2024-09-14T09:08:58.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952480+0000", 2024-09-14T09:08:58.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.71930839899999999 2024-09-14T09:08:58.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952655+0000", 2024-09-14T09:08:58.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017552 2024-09-14T09:08:58.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:58.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.952835+0000", 2024-09-14T09:08:58.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001797 2024-09-14T09:08:58.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:58.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.953648+0000", 2024-09-14T09:08:58.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00081291700000000002 2024-09-14T09:08:58.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:58.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954108+0000", 2024-09-14T09:08:58.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045992800000000002 2024-09-14T09:08:58.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:58.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954149+0000", 2024-09-14T09:08:58.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1214999999999998e-05 2024-09-14T09:08:58.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:07:30.954178+0000", 2024-09-14T09:08:58.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9184e-05 2024-09-14T09:08:58.632 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.632 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.632 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.632 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:11931 3.1a 3:5f6725a9:::rbd_header.111219b19df:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.632 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.722408+0000", 2024-09-14T09:08:58.632 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.902951851000001, 2024-09-14T09:08:58.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.089863542000000005, 2024-09-14T09:08:58.632 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.633 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.633 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.633 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.633 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:08:58.633 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:08:58.633 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 11931 2024-09-14T09:08:58.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.633 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.722408+0000", 2024-09-14T09:08:58.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.722408+0000", 2024-09-14T09:08:58.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812037+0000", 2024-09-14T09:08:58.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.089629082999999998 2024-09-14T09:08:58.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812042+0000", 2024-09-14T09:08:58.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5790000000000003e-06 2024-09-14T09:08:58.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812051+0000", 2024-09-14T09:08:58.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1689999999999998e-06 2024-09-14T09:08:58.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812058+0000", 2024-09-14T09:08:58.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.725e-06 2024-09-14T09:08:58.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812117+0000", 2024-09-14T09:08:58.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8483999999999998e-05 2024-09-14T09:08:58.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812183+0000", 2024-09-14T09:08:58.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6759000000000002e-05 2024-09-14T09:08:58.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.812271+0000", 2024-09-14T09:08:58.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7743000000000003e-05 2024-09-14T09:08:58.637 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.637 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.637 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.637 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9655 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 811008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.638 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.688987+0000", 2024-09-14T09:08:58.638 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.936372514999999, 2024-09-14T09:08:58.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044554783000000001, 2024-09-14T09:08:58.638 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.638 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.638 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.638 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.638 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.638 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.638 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9655 2024-09-14T09:08:58.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.638 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.688987+0000", 2024-09-14T09:08:58.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.688987+0000", 2024-09-14T09:08:58.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.688987+0000", 2024-09-14T09:08:58.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4300000000000003e-07 2024-09-14T09:08:58.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.688989+0000", 2024-09-14T09:08:58.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7969999999999999e-06 2024-09-14T09:08:58.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.688995+0000", 2024-09-14T09:08:58.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1310000000000003e-06 2024-09-14T09:08:58.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689000+0000", 2024-09-14T09:08:58.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4870000000000004e-06 2024-09-14T09:08:58.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733378+0000", 2024-09-14T09:08:58.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044377658 2024-09-14T09:08:58.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733454+0000", 2024-09-14T09:08:58.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6884000000000005e-05 2024-09-14T09:08:58.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733542+0000", 2024-09-14T09:08:58.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7282999999999998e-05 2024-09-14T09:08:58.642 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.642 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.642 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.643 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9656 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 872448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.643 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.689005+0000", 2024-09-14T09:08:58.643 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.936354167000001, 2024-09-14T09:08:58.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044678214000000001, 2024-09-14T09:08:58.643 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.643 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.643 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.643 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.643 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.643 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.644 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9656 2024-09-14T09:08:58.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.644 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689005+0000", 2024-09-14T09:08:58.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689005+0000", 2024-09-14T09:08:58.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689006+0000", 2024-09-14T09:08:58.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.51e-07 2024-09-14T09:08:58.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689007+0000", 2024-09-14T09:08:58.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.699e-06 2024-09-14T09:08:58.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689013+0000", 2024-09-14T09:08:58.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.609e-06 2024-09-14T09:08:58.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689018+0000", 2024-09-14T09:08:58.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7319999999999998e-06 2024-09-14T09:08:58.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733570+0000", 2024-09-14T09:08:58.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044552691999999998 2024-09-14T09:08:58.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733610+0000", 2024-09-14T09:08:58.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9366000000000002e-05 2024-09-14T09:08:58.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733683+0000", 2024-09-14T09:08:58.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3664999999999994e-05 2024-09-14T09:08:58.647 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.647 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.647 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.648 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9657 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 933888~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.648 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.689024+0000", 2024-09-14T09:08:58.648 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.936335882000002, 2024-09-14T09:08:58.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044870122999999998, 2024-09-14T09:08:58.648 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.648 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.648 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.648 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.648 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.648 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.649 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9657 2024-09-14T09:08:58.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.649 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689024+0000", 2024-09-14T09:08:58.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689024+0000", 2024-09-14T09:08:58.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689024+0000", 2024-09-14T09:08:58.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.27e-07 2024-09-14T09:08:58.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689026+0000", 2024-09-14T09:08:58.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9180000000000001e-06 2024-09-14T09:08:58.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689032+0000", 2024-09-14T09:08:58.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9050000000000002e-06 2024-09-14T09:08:58.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689036+0000", 2024-09-14T09:08:58.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6380000000000003e-06 2024-09-14T09:08:58.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733724+0000", 2024-09-14T09:08:58.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044687326999999999 2024-09-14T09:08:58.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733802+0000", 2024-09-14T09:08:58.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8486999999999996e-05 2024-09-14T09:08:58.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733894+0000", 2024-09-14T09:08:58.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1520999999999993e-05 2024-09-14T09:08:58.652 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.652 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.653 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.653 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9658 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 995328~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.653 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.689042+0000", 2024-09-14T09:08:58.653 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.936317722999998, 2024-09-14T09:08:58.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045057038000000001, 2024-09-14T09:08:58.653 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.653 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.653 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.653 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.654 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.654 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.654 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9658 2024-09-14T09:08:58.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.654 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689042+0000", 2024-09-14T09:08:58.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.689042+0000", 2024-09-14T09:08:58.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693052+0000", 2024-09-14T09:08:58.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040104859999999997 2024-09-14T09:08:58.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693055+0000", 2024-09-14T09:08:58.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6929999999999999e-06 2024-09-14T09:08:58.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693065+0000", 2024-09-14T09:08:58.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0220999999999999e-05 2024-09-14T09:08:58.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693069+0000", 2024-09-14T09:08:58.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1180000000000002e-06 2024-09-14T09:08:58.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.733926+0000", 2024-09-14T09:08:58.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040856418999999998 2024-09-14T09:08:58.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.734011+0000", 2024-09-14T09:08:58.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4902999999999997e-05 2024-09-14T09:08:58.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.734099+0000", 2024-09-14T09:08:58.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8197999999999998e-05 2024-09-14T09:08:58.657 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.657 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.658 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.658 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9683 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2531328~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.658 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.693341+0000", 2024-09-14T09:08:58.658 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.932018085999999, 2024-09-14T09:08:58.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044718463999999999, 2024-09-14T09:08:58.658 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.658 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.658 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.658 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.658 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.659 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.659 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9683 2024-09-14T09:08:58.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.659 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693341+0000", 2024-09-14T09:08:58.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693341+0000", 2024-09-14T09:08:58.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693342+0000", 2024-09-14T09:08:58.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:08:58.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693343+0000", 2024-09-14T09:08:58.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2219999999999999e-06 2024-09-14T09:08:58.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693346+0000", 2024-09-14T09:08:58.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.785e-06 2024-09-14T09:08:58.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693348+0000", 2024-09-14T09:08:58.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4229999999999999e-06 2024-09-14T09:08:58.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.737876+0000", 2024-09-14T09:08:58.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044527870999999997 2024-09-14T09:08:58.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.737968+0000", 2024-09-14T09:08:58.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1859000000000003e-05 2024-09-14T09:08:58.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738060+0000", 2024-09-14T09:08:58.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2095000000000005e-05 2024-09-14T09:08:58.663 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.663 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.663 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.663 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9684 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2592768~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.663 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.693351+0000", 2024-09-14T09:08:58.663 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.932008495000002, 2024-09-14T09:08:58.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044936873000000002, 2024-09-14T09:08:58.664 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.664 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.664 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.664 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9684 2024-09-14T09:08:58.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.664 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693351+0000", 2024-09-14T09:08:58.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693351+0000", 2024-09-14T09:08:58.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693351+0000", 2024-09-14T09:08:58.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3999999999999998e-07 2024-09-14T09:08:58.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693352+0000", 2024-09-14T09:08:58.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0470000000000001e-06 2024-09-14T09:08:58.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693355+0000", 2024-09-14T09:08:58.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8320000000000002e-06 2024-09-14T09:08:58.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693358+0000", 2024-09-14T09:08:58.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5270000000000001e-06 2024-09-14T09:08:58.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738104+0000", 2024-09-14T09:08:58.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044746459000000002 2024-09-14T09:08:58.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738194+0000", 2024-09-14T09:08:58.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0062999999999995e-05 2024-09-14T09:08:58.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738288+0000", 2024-09-14T09:08:58.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3704999999999998e-05 2024-09-14T09:08:58.669 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.669 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.669 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.669 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9685 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2654208~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.669 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.693377+0000", 2024-09-14T09:08:58.669 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.931981926999999, 2024-09-14T09:08:58.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045136784999999999, 2024-09-14T09:08:58.669 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.669 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.670 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.670 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.670 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.670 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.670 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9685 2024-09-14T09:08:58.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.670 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693377+0000", 2024-09-14T09:08:58.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693377+0000", 2024-09-14T09:08:58.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693378+0000", 2024-09-14T09:08:58.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8500000000000002e-07 2024-09-14T09:08:58.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693379+0000", 2024-09-14T09:08:58.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.387e-06 2024-09-14T09:08:58.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693383+0000", 2024-09-14T09:08:58.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3699999999999999e-06 2024-09-14T09:08:58.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693385+0000", 2024-09-14T09:08:58.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5469999999999999e-06 2024-09-14T09:08:58.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738329+0000", 2024-09-14T09:08:58.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044943603999999998 2024-09-14T09:08:58.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738414+0000", 2024-09-14T09:08:58.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4763000000000001e-05 2024-09-14T09:08:58.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738514+0000", 2024-09-14T09:08:58.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000100629 2024-09-14T09:08:58.674 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.674 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.674 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.674 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9686 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2715648~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.674 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.693389+0000", 2024-09-14T09:08:58.675 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.931970841999998, 2024-09-14T09:08:58.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045314315000000001, 2024-09-14T09:08:58.675 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.675 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.675 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.675 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.675 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.675 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.675 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9686 2024-09-14T09:08:58.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.675 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693389+0000", 2024-09-14T09:08:58.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693389+0000", 2024-09-14T09:08:58.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693389+0000", 2024-09-14T09:08:58.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9499999999999998e-07 2024-09-14T09:08:58.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693390+0000", 2024-09-14T09:08:58.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0410000000000001e-06 2024-09-14T09:08:58.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693393+0000", 2024-09-14T09:08:58.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.774e-06 2024-09-14T09:08:58.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693395+0000", 2024-09-14T09:08:58.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.475e-06 2024-09-14T09:08:58.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738539+0000", 2024-09-14T09:08:58.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045143902999999999 2024-09-14T09:08:58.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738613+0000", 2024-09-14T09:08:58.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4410000000000001e-05 2024-09-14T09:08:58.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738703+0000", 2024-09-14T09:08:58.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9417000000000001e-05 2024-09-14T09:08:58.679 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.679 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.679 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.680 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9687 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2777088~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.680 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.693398+0000", 2024-09-14T09:08:58.680 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.931961161, 2024-09-14T09:08:58.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045501822999999997, 2024-09-14T09:08:58.680 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.680 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.680 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.680 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.680 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.680 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.681 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9687 2024-09-14T09:08:58.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.681 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693398+0000", 2024-09-14T09:08:58.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.693398+0000", 2024-09-14T09:08:58.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694375+0000", 2024-09-14T09:08:58.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00097630899999999997 2024-09-14T09:08:58.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694377+0000", 2024-09-14T09:08:58.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.108e-06 2024-09-14T09:08:58.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694382+0000", 2024-09-14T09:08:58.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9679999999999997e-06 2024-09-14T09:08:58.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694385+0000", 2024-09-14T09:08:58.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2040000000000002e-06 2024-09-14T09:08:58.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738732+0000", 2024-09-14T09:08:58.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044346974999999997 2024-09-14T09:08:58.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738809+0000", 2024-09-14T09:08:58.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7174000000000003e-05 2024-09-14T09:08:58.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738900+0000", 2024-09-14T09:08:58.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1085e-05 2024-09-14T09:08:58.685 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.685 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.685 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.685 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9688 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2838528~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694390+0000", 2024-09-14T09:08:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.930968924999998, 2024-09-14T09:08:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044706231999999999, 2024-09-14T09:08:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9688 2024-09-14T09:08:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694390+0000", 2024-09-14T09:08:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694390+0000", 2024-09-14T09:08:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694391+0000", 2024-09-14T09:08:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.41e-07 2024-09-14T09:08:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694392+0000", 2024-09-14T09:08:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1090000000000001e-06 2024-09-14T09:08:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694397+0000", 2024-09-14T09:08:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.293e-06 2024-09-14T09:08:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694400+0000", 2024-09-14T09:08:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8909999999999999e-06 2024-09-14T09:08:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.738930+0000", 2024-09-14T09:08:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044529812000000002 2024-09-14T09:08:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739011+0000", 2024-09-14T09:08:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1143999999999994e-05 2024-09-14T09:08:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739097+0000", 2024-09-14T09:08:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5741999999999993e-05 2024-09-14T09:08:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9689 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2899968~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694403+0000", 2024-09-14T09:08:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.9309561, 2024-09-14T09:08:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044887095000000002, 2024-09-14T09:08:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9689 2024-09-14T09:08:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694403+0000", 2024-09-14T09:08:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694403+0000", 2024-09-14T09:08:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694404+0000", 2024-09-14T09:08:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.77e-07 2024-09-14T09:08:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694408+0000", 2024-09-14T09:08:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0010000000000003e-06 2024-09-14T09:08:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694412+0000", 2024-09-14T09:08:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0500000000000002e-06 2024-09-14T09:08:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694414+0000", 2024-09-14T09:08:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7300000000000001e-06 2024-09-14T09:08:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739126+0000", 2024-09-14T09:08:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044711199 2024-09-14T09:08:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739205+0000", 2024-09-14T09:08:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8926999999999998e-05 2024-09-14T09:08:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739290+0000", 2024-09-14T09:08:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5810999999999995e-05 2024-09-14T09:08:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9690 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 2961408~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694418+0000", 2024-09-14T09:08:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.930941539999999, 2024-09-14T09:08:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045014599000000002, 2024-09-14T09:08:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9690 2024-09-14T09:08:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694418+0000", 2024-09-14T09:08:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694418+0000", 2024-09-14T09:08:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694418+0000", 2024-09-14T09:08:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.05e-07 2024-09-14T09:08:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694419+0000", 2024-09-14T09:08:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0890000000000001e-06 2024-09-14T09:08:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694422+0000", 2024-09-14T09:08:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.802e-06 2024-09-14T09:08:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694424+0000", 2024-09-14T09:08:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.497e-06 2024-09-14T09:08:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739328+0000", 2024-09-14T09:08:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044903699999999998 2024-09-14T09:08:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739375+0000", 2024-09-14T09:08:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7265000000000002e-05 2024-09-14T09:08:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739432+0000", 2024-09-14T09:08:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7040999999999998e-05 2024-09-14T09:08:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9691 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 3022848~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694427+0000", 2024-09-14T09:08:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.930931966999999, 2024-09-14T09:08:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045238403000000003, 2024-09-14T09:08:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9691 2024-09-14T09:08:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694427+0000", 2024-09-14T09:08:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694427+0000", 2024-09-14T09:08:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694428+0000", 2024-09-14T09:08:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.05e-07 2024-09-14T09:08:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694429+0000", 2024-09-14T09:08:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6700000000000002e-07 2024-09-14T09:08:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694432+0000", 2024-09-14T09:08:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8940000000000002e-06 2024-09-14T09:08:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694434+0000", 2024-09-14T09:08:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5009999999999999e-06 2024-09-14T09:08:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739479+0000", 2024-09-14T09:08:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045044806999999999 2024-09-14T09:08:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739568+0000", 2024-09-14T09:08:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9061999999999995e-05 2024-09-14T09:08:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739666+0000", 2024-09-14T09:08:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7967000000000006e-05 2024-09-14T09:08:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9692 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 3084288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694437+0000", 2024-09-14T09:08:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.930922505000002, 2024-09-14T09:08:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045365111999999999, 2024-09-14T09:08:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9692 2024-09-14T09:08:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694437+0000", 2024-09-14T09:08:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694437+0000", 2024-09-14T09:08:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694437+0000", 2024-09-14T09:08:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8999999999999998e-07 2024-09-14T09:08:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694438+0000", 2024-09-14T09:08:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0249999999999999e-06 2024-09-14T09:08:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694441+0000", 2024-09-14T09:08:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.835e-06 2024-09-14T09:08:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694443+0000", 2024-09-14T09:08:58.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4329999999999998e-06 2024-09-14T09:08:58.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739699+0000", 2024-09-14T09:08:58.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045255457999999998 2024-09-14T09:08:58.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739746+0000", 2024-09-14T09:08:58.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7132000000000002e-05 2024-09-14T09:08:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739802+0000", 2024-09-14T09:08:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5939000000000001e-05 2024-09-14T09:08:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9693 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 3145728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694446+0000", 2024-09-14T09:08:58.712 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.930913177000001, 2024-09-14T09:08:58.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045601007999999998, 2024-09-14T09:08:58.712 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.712 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.712 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.712 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.712 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9693 2024-09-14T09:08:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694446+0000", 2024-09-14T09:08:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694446+0000", 2024-09-14T09:08:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694446+0000", 2024-09-14T09:08:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1e-07 2024-09-14T09:08:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694447+0000", 2024-09-14T09:08:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9099999999999991e-07 2024-09-14T09:08:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694450+0000", 2024-09-14T09:08:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8049999999999998e-06 2024-09-14T09:08:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694453+0000", 2024-09-14T09:08:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4480000000000001e-06 2024-09-14T09:08:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739854+0000", 2024-09-14T09:08:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045401336 2024-09-14T09:08:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.739942+0000", 2024-09-14T09:08:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8339999999999998e-05 2024-09-14T09:08:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.740047+0000", 2024-09-14T09:08:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010487799999999999 2024-09-14T09:08:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9694 3.10 3:0e1ef961:::rbd_data.111228c3791c.000000000000000a:18 [read 3207168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.694456+0000", 2024-09-14T09:08:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.930903881999999, 2024-09-14T09:08:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045779780999999999, 2024-09-14T09:08:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9694 2024-09-14T09:08:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694456+0000", 2024-09-14T09:08:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.694456+0000", 2024-09-14T09:08:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699125+0000", 2024-09-14T09:08:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046694359999999999 2024-09-14T09:08:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699127+0000", 2024-09-14T09:08:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.996e-06 2024-09-14T09:08:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699132+0000", 2024-09-14T09:08:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1970000000000004e-06 2024-09-14T09:08:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699136+0000", 2024-09-14T09:08:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3419999999999999e-06 2024-09-14T09:08:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.740084+0000", 2024-09-14T09:08:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.040948311000000001 2024-09-14T09:08:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.740147+0000", 2024-09-14T09:08:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.368e-05 2024-09-14T09:08:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.740235+0000", 2024-09-14T09:08:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7818999999999994e-05 2024-09-14T09:08:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9748 3.10 3:0e07f4ad:::rbd_data.111219b19df.00000000000001c6:head [set-alloc-hint object_size 524288 write_size 524288,write 413696~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.699380+0000", 2024-09-14T09:08:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.925979278, 2024-09-14T09:08:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045171442999999999, 2024-09-14T09:08:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9748 2024-09-14T09:08:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699380+0000", 2024-09-14T09:08:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699380+0000", 2024-09-14T09:08:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699380+0000", 2024-09-14T09:08:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2000000000000001e-07 2024-09-14T09:08:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699386+0000", 2024-09-14T09:08:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9390000000000002e-06 2024-09-14T09:08:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699390+0000", 2024-09-14T09:08:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.32e-06 2024-09-14T09:08:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699392+0000", 2024-09-14T09:08:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5019999999999999e-06 2024-09-14T09:08:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.743265+0000", 2024-09-14T09:08:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.043872479999999998 2024-09-14T09:08:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.743387+0000", 2024-09-14T09:08:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012264 2024-09-14T09:08:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.743546+0000", 2024-09-14T09:08:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000158369 2024-09-14T09:08:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744431+0000", 2024-09-14T09:08:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00088561900000000003 2024-09-14T09:08:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:08:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744449+0000", 2024-09-14T09:08:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8096000000000001e-05 2024-09-14T09:08:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:08:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744504+0000", 2024-09-14T09:08:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4837999999999999e-05 2024-09-14T09:08:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744552+0000", 2024-09-14T09:08:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7420000000000003e-05 2024-09-14T09:08:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:9766 3.10 3:0e07f4ad:::rbd_data.111219b19df.00000000000001c6:head [read 409600~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:37.699552+0000", 2024-09-14T09:08:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.925806942000001, 2024-09-14T09:08:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045179127999999999, 2024-09-14T09:08:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:08:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:08:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:08:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:08:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:08:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 9766 2024-09-14T09:08:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:08:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:08:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699552+0000", 2024-09-14T09:08:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:08:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699552+0000", 2024-09-14T09:08:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:08:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:08:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699553+0000", 2024-09-14T09:08:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0200000000000003e-07 2024-09-14T09:08:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:08:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699555+0000", 2024-09-14T09:08:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.844e-06 2024-09-14T09:08:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:08:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699561+0000", 2024-09-14T09:08:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0859999999999998e-06 2024-09-14T09:08:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.699567+0000", 2024-09-14T09:08:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8619999999999999e-06 2024-09-14T09:08:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744017+0000", 2024-09-14T09:08:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.044450311999999999 2024-09-14T09:08:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for rw locks", 2024-09-14T09:08:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744054+0000", 2024-09-14T09:08:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6910999999999999e-05 2024-09-14T09:08:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:08:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744581+0000", 2024-09-14T09:08:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00052667899999999995 2024-09-14T09:08:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:08:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744639+0000", 2024-09-14T09:08:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8310999999999998e-05 2024-09-14T09:08:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:08:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:08:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:08:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:37.744732+0000", 2024-09-14T09:08:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2720999999999995e-05 2024-09-14T09:08:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:08:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:08:58.736 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:08:58.738 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:58.740+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:58.739 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:08:58.741 INFO:teuthology.orchestra.run.smithi148.stdout:4333 write 0x21cdc00 thru 0x21d342f (0x5830 bytes) 2024-09-14T09:08:58.741 INFO:teuthology.orchestra.run.smithi148.stdout:4335 read 0x1d3a000 thru 0x1d42dca (0x8dcb bytes) 2024-09-14T09:08:58.741 INFO:teuthology.orchestra.run.smithi148.stdout:4336 read 0x1a02c00 thru 0x1a12a1b (0xfe1c bytes) 2024-09-14T09:08:58.741 INFO:teuthology.orchestra.run.smithi148.stdout:4338 punch from 0xd7d600 to 0xd7fc00, (0x2600 bytes) 2024-09-14T09:08:58.741 INFO:teuthology.orchestra.run.smithi148.stdout:4342 read 0xe9ce00 thru 0xea05a5 (0x37a6 bytes) 2024-09-14T09:08:58.741 INFO:teuthology.orchestra.run.smithi148.stdout:4343 write 0x4345000 thru 0x43476b4 (0x26b5 bytes) 2024-09-14T09:08:58.741 INFO:teuthology.orchestra.run.smithi148.stdout:4345 write 0xd689800 thru 0xd699209 (0xfa0a bytes) 2024-09-14T09:08:58.741 INFO:teuthology.orchestra.run.smithi148.stdout:4346 read 0x3c4a000 thru 0x3c4e653 (0x4654 bytes) 2024-09-14T09:08:58.741 INFO:teuthology.orchestra.run.smithi148.stdout:4347 write 0x5c58c00 thru 0x5c5e4e0 (0x58e1 bytes) 2024-09-14T09:08:58.742 INFO:teuthology.orchestra.run.smithi148.stdout:4353 write 0x9b8ec00 thru 0x9b9c7bf (0xdbc0 bytes) 2024-09-14T09:08:58.742 INFO:teuthology.orchestra.run.smithi148.stdout:4356 punch from 0x6350e00 to 0x635d200, (0xc400 bytes) 2024-09-14T09:08:58.742 INFO:teuthology.orchestra.run.smithi148.stdout:4357 write 0x1f14600 thru 0x1f18d03 (0x4704 bytes) 2024-09-14T09:08:58.742 INFO:teuthology.orchestra.run.smithi148.stdout:4358 punch from 0x8998000 to 0x899de00, (0x5e00 bytes) 2024-09-14T09:08:58.742 INFO:teuthology.orchestra.run.smithi148.stdout:4359 read 0x7a6f400 thru 0x7a75e8e (0x6a8f bytes) 2024-09-14T09:08:58.742 INFO:teuthology.orchestra.run.smithi148.stdout:4360 write 0x2d2c000 thru 0x2d2f13f (0x3140 bytes) 2024-09-14T09:08:58.742 INFO:teuthology.orchestra.run.smithi148.stdout:4362 punch from 0x5785e00 to 0x5793600, (0xd800 bytes) 2024-09-14T09:08:58.742 INFO:teuthology.orchestra.run.smithi148.stdout:4364 read 0x24f4c00 thru 0x2500025 (0xb426 bytes) 2024-09-14T09:08:58.742 INFO:teuthology.orchestra.run.smithi148.stdout:4365 write 0xc808200 thru 0xc8115eb (0x93ec bytes) 2024-09-14T09:08:58.742 INFO:teuthology.orchestra.run.smithi148.stdout:4367 trunc from 0xd699400 to 0xecd8a00 2024-09-14T09:08:58.771 INFO:teuthology.orchestra.run.smithi148.stdout:4369 read 0x1ce4600 thru 0x1ce543f (0xe40 bytes) 2024-09-14T09:08:58.771 INFO:teuthology.orchestra.run.smithi148.stdout:4372 read 0x1a17e00 thru 0x1a1903a (0x123b bytes) 2024-09-14T09:08:58.772 INFO:teuthology.orchestra.run.smithi148.stdout:4375 write 0xba67000 thru 0xba67dff (0xe00 bytes) 2024-09-14T09:08:58.772 INFO:teuthology.orchestra.run.smithi148.stdout:4376 read 0x2c53c00 thru 0x2c63542 (0xf943 bytes) 2024-09-14T09:08:58.772 INFO:teuthology.orchestra.run.smithi148.stdout:4379 write 0x9416a00 thru 0x9424bbf (0xe1c0 bytes) 2024-09-14T09:08:58.782 INFO:teuthology.orchestra.run.smithi148.stdout:4380 trunc from 0xecd8a00 to 0x55d0000 2024-09-14T09:08:58.827 INFO:teuthology.orchestra.run.smithi148.stdout:4381 write 0x7914c00 thru 0x79155f4 (0x9f5 bytes) 2024-09-14T09:08:58.838 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:58.841+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:58.845 INFO:teuthology.orchestra.run.smithi148.stdout:4383 write 0x923fc00 thru 0x924715a (0x755b bytes) 2024-09-14T09:08:58.845 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T09:08:58.846 INFO:teuthology.orchestra.run.smithi148.stdout:4384 write 0xca5400 thru 0xcb1f9f (0xcba0 bytes) 2024-09-14T09:08:58.846 INFO:teuthology.orchestra.run.smithi116.stderr:marked in osd.1. 2024-09-14T09:08:58.851 INFO:teuthology.orchestra.run.smithi148.stdout:4385 trunc from 0x9247200 to 0x4940c00 2024-09-14T09:08:58.865 INFO:tasks.thrashosds.thrasher:Added osd 1 2024-09-14T09:08:58.877 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1106 3.1b 3.194a76db (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:08:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.861317+0000", 2024-09-14T09:08:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018669005999999998, 2024-09-14T09:08:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018683966, 2024-09-14T09:08:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:08:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:08:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1106 2024-09-14T09:08:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861317+0000", 2024-09-14T09:08:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861317+0000", 2024-09-14T09:08:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861318+0000", 2024-09-14T09:08:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.384e-06 2024-09-14T09:08:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861324+0000", 2024-09-14T09:08:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5269999999999998e-06 2024-09-14T09:08:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861335+0000", 2024-09-14T09:08:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1388e-05 2024-09-14T09:08:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861348+0000", 2024-09-14T09:08:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2774e-05 2024-09-14T09:08:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861408+0000", 2024-09-14T09:08:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0000999999999997e-05 2024-09-14T09:08:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861417+0000", 2024-09-14T09:08:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2699999999999993e-06 2024-09-14T09:08:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1110 3.1b 3.75da4b5b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:08:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.861377+0000", 2024-09-14T09:08:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018608383999999999, 2024-09-14T09:08:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018673962999999998, 2024-09-14T09:08:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:08:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:08:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1110 2024-09-14T09:08:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861377+0000", 2024-09-14T09:08:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861377+0000", 2024-09-14T09:08:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861378+0000", 2024-09-14T09:08:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2099999999999996e-07 2024-09-14T09:08:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861381+0000", 2024-09-14T09:08:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2370000000000001e-06 2024-09-14T09:08:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861389+0000", 2024-09-14T09:08:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5519999999999999e-06 2024-09-14T09:08:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861394+0000", 2024-09-14T09:08:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5160000000000002e-06 2024-09-14T09:08:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861446+0000", 2024-09-14T09:08:58.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1588999999999997e-05 2024-09-14T09:08:58.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:58.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861453+0000", 2024-09-14T09:08:58.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4919999999999996e-06 2024-09-14T09:08:58.887 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:58.887 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:58.887 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:58.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1115 3.1b 3.194a76db (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:08:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.861403+0000", 2024-09-14T09:08:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018582471999999999, 2024-09-14T09:08:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018675298999999999, 2024-09-14T09:08:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:08:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:08:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1115 2024-09-14T09:08:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861403+0000", 2024-09-14T09:08:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861403+0000", 2024-09-14T09:08:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861404+0000", 2024-09-14T09:08:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.15e-07 2024-09-14T09:08:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861406+0000", 2024-09-14T09:08:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0760000000000001e-06 2024-09-14T09:08:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861411+0000", 2024-09-14T09:08:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5879999999999997e-06 2024-09-14T09:08:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861417+0000", 2024-09-14T09:08:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1599999999999997e-06 2024-09-14T09:08:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861778+0000", 2024-09-14T09:08:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000361493 2024-09-14T09:08:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861788+0000", 2024-09-14T09:08:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7559999999999994e-06 2024-09-14T09:08:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1119 3.1b 3.75da4b5b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:08:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.861680+0000", 2024-09-14T09:08:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018306097, 2024-09-14T09:08:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018425233999999999, 2024-09-14T09:08:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:08:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:08:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1119 2024-09-14T09:08:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861680+0000", 2024-09-14T09:08:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861680+0000", 2024-09-14T09:08:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861680+0000", 2024-09-14T09:08:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9699999999999995e-07 2024-09-14T09:08:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861684+0000", 2024-09-14T09:08:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9720000000000003e-06 2024-09-14T09:08:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861696+0000", 2024-09-14T09:08:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1177e-05 2024-09-14T09:08:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861703+0000", 2024-09-14T09:08:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.469e-06 2024-09-14T09:08:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861830+0000", 2024-09-14T09:08:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012731299999999999 2024-09-14T09:08:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861838+0000", 2024-09-14T09:08:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7959999999999996e-06 2024-09-14T09:08:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1120 3.1b 3.194a76db (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:08:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.861723+0000", 2024-09-14T09:08:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018262846999999999, 2024-09-14T09:08:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018408893999999999, 2024-09-14T09:08:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:08:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:08:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1120 2024-09-14T09:08:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861723+0000", 2024-09-14T09:08:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861723+0000", 2024-09-14T09:08:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861723+0000", 2024-09-14T09:08:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1099999999999996e-07 2024-09-14T09:08:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861726+0000", 2024-09-14T09:08:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.706e-06 2024-09-14T09:08:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861849+0000", 2024-09-14T09:08:58.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012267100000000001 2024-09-14T09:08:58.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861856+0000", 2024-09-14T09:08:58.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0480000000000001e-06 2024-09-14T09:08:58.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:58.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.862033+0000", 2024-09-14T09:08:58.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017714599999999999 2024-09-14T09:08:58.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.862045+0000", 2024-09-14T09:08:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1922e-05 2024-09-14T09:08:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1123 3.1b 3.75da4b5b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:08:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.861879+0000", 2024-09-14T09:08:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018107182999999999, 2024-09-14T09:08:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018279200999999998, 2024-09-14T09:08:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:08:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:08:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1123 2024-09-14T09:08:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861879+0000", 2024-09-14T09:08:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861879+0000", 2024-09-14T09:08:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861879+0000", 2024-09-14T09:08:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7199999999999997e-07 2024-09-14T09:08:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861883+0000", 2024-09-14T09:08:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0060000000000003e-06 2024-09-14T09:08:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861893+0000", 2024-09-14T09:08:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1819999999999995e-06 2024-09-14T09:08:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861899+0000", 2024-09-14T09:08:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2910000000000004e-06 2024-09-14T09:08:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.862071+0000", 2024-09-14T09:08:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000171616 2024-09-14T09:08:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.862078+0000", 2024-09-14T09:08:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1319999999999996e-06 2024-09-14T09:08:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1126 3.1b 3.194a76db (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:08:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.861907+0000", 2024-09-14T09:08:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018078281000000002, 2024-09-14T09:08:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018276496999999999, 2024-09-14T09:08:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:08:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:08:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1126 2024-09-14T09:08:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861907+0000", 2024-09-14T09:08:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861907+0000", 2024-09-14T09:08:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861908+0000", 2024-09-14T09:08:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3700000000000001e-07 2024-09-14T09:08:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861917+0000", 2024-09-14T09:08:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6100000000000006e-06 2024-09-14T09:08:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861926+0000", 2024-09-14T09:08:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9809999999999998e-06 2024-09-14T09:08:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861932+0000", 2024-09-14T09:08:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7219999999999996e-06 2024-09-14T09:08:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.862104+0000", 2024-09-14T09:08:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000171414 2024-09-14T09:08:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.862111+0000", 2024-09-14T09:08:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4109999999999999e-06 2024-09-14T09:08:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1129 3.1b 3.194a76db (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:08:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.861940+0000", 2024-09-14T09:08:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018045263999999998, 2024-09-14T09:08:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018270568000000001, 2024-09-14T09:08:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:08:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:08:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1129 2024-09-14T09:08:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861940+0000", 2024-09-14T09:08:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861940+0000", 2024-09-14T09:08:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861941+0000", 2024-09-14T09:08:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4499999999999997e-07 2024-09-14T09:08:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861943+0000", 2024-09-14T09:08:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1579999999999999e-06 2024-09-14T09:08:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861952+0000", 2024-09-14T09:08:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1949999999999992e-06 2024-09-14T09:08:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861958+0000", 2024-09-14T09:08:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5400000000000003e-06 2024-09-14T09:08:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.862135+0000", 2024-09-14T09:08:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017746099999999999 2024-09-14T09:08:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.862142+0000", 2024-09-14T09:08:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.939e-06 2024-09-14T09:08:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1131 3.1b 3.75da4b5b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:08:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.861967+0000", 2024-09-14T09:08:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018018744, 2024-09-14T09:08:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018270181999999999, 2024-09-14T09:08:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:08:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:08:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:08:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1131 2024-09-14T09:08:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861967+0000", 2024-09-14T09:08:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861967+0000", 2024-09-14T09:08:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861967+0000", 2024-09-14T09:08:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8100000000000003e-07 2024-09-14T09:08:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861970+0000", 2024-09-14T09:08:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.289e-06 2024-09-14T09:08:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861979+0000", 2024-09-14T09:08:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1370000000000008e-06 2024-09-14T09:08:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.861984+0000", 2024-09-14T09:08:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2220000000000001e-06 2024-09-14T09:08:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.862166+0000", 2024-09-14T09:08:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000181898 2024-09-14T09:08:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.862173+0000", 2024-09-14T09:08:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.024e-06 2024-09-14T09:08:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-14T09:08:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 9 2024-09-14T09:08:58.922 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:58.922 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:08:58.939 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:58.941+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:59.039 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:59.042+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:59.066 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:59.066 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:59.066 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:59.066 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:59.066 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:59.074 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:08:59.158 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:59.161+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:59.219 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:59.219 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:59.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:59.219 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:59.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.220 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:246 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:59.220 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:08:59.220 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.423927537000001, 2024-09-14T09:08:59.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99004581000000003, 2024-09-14T09:08:59.220 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.220 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.220 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.220 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.220 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:59.220 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:59.220 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 246 2024-09-14T09:08:59.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.221 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:08:59.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:08:59.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796750+0000", 2024-09-14T09:08:59.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5519999999999999e-06 2024-09-14T09:08:59.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796754+0000", 2024-09-14T09:08:59.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2640000000000002e-06 2024-09-14T09:08:59.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796767+0000", 2024-09-14T09:08:59.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3517e-05 2024-09-14T09:08:59.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796775+0000", 2024-09-14T09:08:59.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8790000000000003e-06 2024-09-14T09:08:59.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796830+0000", 2024-09-14T09:08:59.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4829e-05 2024-09-14T09:08:59.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:59.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796843+0000", 2024-09-14T09:08:59.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.33e-05 2024-09-14T09:08:59.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786501+0000", 2024-09-14T09:08:59.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98965769299999995 2024-09-14T09:08:59.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786653+0000", 2024-09-14T09:08:59.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015237200000000001 2024-09-14T09:08:59.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786794+0000", 2024-09-14T09:08:59.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014040400000000001 2024-09-14T09:08:59.225 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.225 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.225 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.225 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:247 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 720896~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:59.225 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:59.225 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.423872751000001, 2024-09-14T09:08:59.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99048688100000004, 2024-09-14T09:08:59.225 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.225 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.225 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.225 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.225 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:59.225 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:59.226 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 247 2024-09-14T09:08:59.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.226 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:59.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:59.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:08:59.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7299999999999995e-07 2024-09-14T09:08:59.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796807+0000", 2024-09-14T09:08:59.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.106e-06 2024-09-14T09:08:59.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796815+0000", 2024-09-14T09:08:59.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4740000000000005e-06 2024-09-14T09:08:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796821+0000", 2024-09-14T09:08:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0469999999999999e-06 2024-09-14T09:08:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796872+0000", 2024-09-14T09:08:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0834000000000002e-05 2024-09-14T09:08:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796878+0000", 2024-09-14T09:08:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2990000000000002e-06 2024-09-14T09:08:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787176+0000", 2024-09-14T09:08:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99029817600000003 2024-09-14T09:08:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787225+0000", 2024-09-14T09:08:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8953999999999999e-05 2024-09-14T09:08:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787290+0000", 2024-09-14T09:08:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4318000000000003e-05 2024-09-14T09:08:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:248 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1179648~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:08:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.423842231999998, 2024-09-14T09:08:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99060754200000001, 2024-09-14T09:08:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 248 2024-09-14T09:08:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:08:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:08:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796834+0000", 2024-09-14T09:08:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4099999999999999e-07 2024-09-14T09:08:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796837+0000", 2024-09-14T09:08:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8459999999999999e-06 2024-09-14T09:08:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796844+0000", 2024-09-14T09:08:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1350000000000003e-06 2024-09-14T09:08:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796850+0000", 2024-09-14T09:08:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7139999999999998e-06 2024-09-14T09:08:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3909999999999998e-05 2024-09-14T09:08:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796899+0000", 2024-09-14T09:08:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7649999999999999e-06 2024-09-14T09:08:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787318+0000", 2024-09-14T09:08:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99041848300000002 2024-09-14T09:08:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787365+0000", 2024-09-14T09:08:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7086999999999998e-05 2024-09-14T09:08:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787441+0000", 2024-09-14T09:08:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6061000000000002e-05 2024-09-14T09:08:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:249 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1638400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:08:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.423808463, 2024-09-14T09:08:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99070346899999995, 2024-09-14T09:08:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 249 2024-09-14T09:08:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:08:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:08:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796868+0000", 2024-09-14T09:08:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2024-09-14T09:08:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796870+0000", 2024-09-14T09:08:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7889999999999999e-06 2024-09-14T09:08:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796877+0000", 2024-09-14T09:08:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8549999999999996e-06 2024-09-14T09:08:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796883+0000", 2024-09-14T09:08:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.665e-06 2024-09-14T09:08:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796915+0000", 2024-09-14T09:08:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2215999999999998e-05 2024-09-14T09:08:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796920+0000", 2024-09-14T09:08:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.527e-06 2024-09-14T09:08:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787468+0000", 2024-09-14T09:08:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99054877100000005 2024-09-14T09:08:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787512+0000", 2024-09-14T09:08:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3958000000000002e-05 2024-09-14T09:08:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787571+0000", 2024-09-14T09:08:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8167000000000001e-05 2024-09-14T09:08:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:250 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2097152~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.423782397, 2024-09-14T09:08:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99079431100000004, 2024-09-14T09:08:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 250 2024-09-14T09:08:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:08:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796894+0000", 2024-09-14T09:08:59.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2024-09-14T09:08:59.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796896+0000", 2024-09-14T09:08:59.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5600000000000001e-06 2024-09-14T09:08:59.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796902+0000", 2024-09-14T09:08:59.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3090000000000001e-06 2024-09-14T09:08:59.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796909+0000", 2024-09-14T09:08:59.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:08:59.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796942+0000", 2024-09-14T09:08:59.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-05 2024-09-14T09:08:59.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:59.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796948+0000", 2024-09-14T09:08:59.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5910000000000001e-06 2024-09-14T09:08:59.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787596+0000", 2024-09-14T09:08:59.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99064781400000002 2024-09-14T09:08:59.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787636+0000", 2024-09-14T09:08:59.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9715000000000002e-05 2024-09-14T09:08:59.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787687+0000", 2024-09-14T09:08:59.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1674e-05 2024-09-14T09:08:59.249 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.249 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.250 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.250 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:251 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:59.250 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:59.250 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.423756961999999, 2024-09-14T09:08:59.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99091769600000001, 2024-09-14T09:08:59.251 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.251 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.251 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.251 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.251 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:59.252 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:59.252 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 251 2024-09-14T09:08:59.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.252 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:59.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:59.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:08:59.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000005e-07 2024-09-14T09:08:59.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796922+0000", 2024-09-14T09:08:59.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.875e-06 2024-09-14T09:08:59.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796929+0000", 2024-09-14T09:08:59.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0260000000000002e-06 2024-09-14T09:08:59.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796935+0000", 2024-09-14T09:08:59.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7030000000000003e-06 2024-09-14T09:08:59.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796963+0000", 2024-09-14T09:08:59.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8368999999999999e-05 2024-09-14T09:08:59.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:59.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796966+0000", 2024-09-14T09:08:59.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4130000000000002e-06 2024-09-14T09:08:59.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787718+0000", 2024-09-14T09:08:59.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99075151100000003 2024-09-14T09:08:59.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787779+0000", 2024-09-14T09:08:59.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.088e-05 2024-09-14T09:08:59.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787836+0000", 2024-09-14T09:08:59.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7380000000000003e-05 2024-09-14T09:08:59.262 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.262 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.262 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.263 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:252 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:59.263 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:08:59.263 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.423731507999999, 2024-09-14T09:08:59.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99102491400000003, 2024-09-14T09:08:59.263 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.263 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.264 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.264 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.264 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:59.264 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:59.264 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 252 2024-09-14T09:08:59.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.265 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:08:59.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:08:59.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796945+0000", 2024-09-14T09:08:59.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2900000000000003e-07 2024-09-14T09:08:59.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796947+0000", 2024-09-14T09:08:59.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4279999999999999e-06 2024-09-14T09:08:59.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796954+0000", 2024-09-14T09:08:59.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5479999999999998e-06 2024-09-14T09:08:59.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796959+0000", 2024-09-14T09:08:59.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.22e-06 2024-09-14T09:08:59.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796988+0000", 2024-09-14T09:08:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9473000000000001e-05 2024-09-14T09:08:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:08:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:08:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787850+0000", 2024-09-14T09:08:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99085651100000005 2024-09-14T09:08:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787891+0000", 2024-09-14T09:08:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602000000000002e-05 2024-09-14T09:08:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787969+0000", 2024-09-14T09:08:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8063000000000001e-05 2024-09-14T09:08:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.273 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.273 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.273 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:253 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:59.273 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:59.273 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.423707627999999, 2024-09-14T09:08:59.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99122695699999996, 2024-09-14T09:08:59.273 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.273 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.273 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.273 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.273 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 253 2024-09-14T09:08:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:08:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:08:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:08:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:08:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796977+0000", 2024-09-14T09:08:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5030000000000002e-06 2024-09-14T09:08:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796982+0000", 2024-09-14T09:08:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2024-09-14T09:08:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797013+0000", 2024-09-14T09:08:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0451e-05 2024-09-14T09:08:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:08:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1690000000000001e-06 2024-09-14T09:08:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788011+0000", 2024-09-14T09:08:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99099490300000004 2024-09-14T09:08:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788102+0000", 2024-09-14T09:08:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0730999999999996e-05 2024-09-14T09:08:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788195+0000", 2024-09-14T09:08:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3245999999999995e-05 2024-09-14T09:08:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:254 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3932160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:08:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.423676069999999, 2024-09-14T09:08:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99137410500000001, 2024-09-14T09:08:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 254 2024-09-14T09:08:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:08:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:08:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797000+0000", 2024-09-14T09:08:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:08:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797003+0000", 2024-09-14T09:08:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7659999999999999e-06 2024-09-14T09:08:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797010+0000", 2024-09-14T09:08:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.029e-06 2024-09-14T09:08:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:08:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2024-09-14T09:08:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797044+0000", 2024-09-14T09:08:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9213e-05 2024-09-14T09:08:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797048+0000", 2024-09-14T09:08:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3400000000000002e-06 2024-09-14T09:08:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788222+0000", 2024-09-14T09:08:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99117407400000002 2024-09-14T09:08:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788306+0000", 2024-09-14T09:08:59.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4512999999999995e-05 2024-09-14T09:08:59.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788374+0000", 2024-09-14T09:08:59.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7226999999999999e-05 2024-09-14T09:08:59.283 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.283 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.283 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.284 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:264 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:59.284 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:59.284 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.423649712, 2024-09-14T09:08:59.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99161474699999996, 2024-09-14T09:08:59.284 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.284 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.284 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:59.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:59.284 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 264 2024-09-14T09:08:59.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.285 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:59.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:59.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:08:59.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2024-09-14T09:08:59.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:08:59.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2800000000000002e-06 2024-09-14T09:08:59.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:08:59.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0979999999999999e-06 2024-09-14T09:08:59.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797040+0000", 2024-09-14T09:08:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:08:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797068+0000", 2024-09-14T09:08:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7302999999999999e-05 2024-09-14T09:08:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797071+0000", 2024-09-14T09:08:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3610000000000001e-06 2024-09-14T09:08:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788436+0000", 2024-09-14T09:08:59.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99136489500000002 2024-09-14T09:08:59.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788538+0000", 2024-09-14T09:08:59.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101931 2024-09-14T09:08:59.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788641+0000", 2024-09-14T09:08:59.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010273899999999999 2024-09-14T09:08:59.289 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.289 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.289 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.289 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:265 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:59.289 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:08:59.289 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.423626353, 2024-09-14T09:08:59.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99176878199999996, 2024-09-14T09:08:59.289 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.289 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 265 2024-09-14T09:08:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:08:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:08:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:08:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.39e-07 2024-09-14T09:08:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797052+0000", 2024-09-14T09:08:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.345e-06 2024-09-14T09:08:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797058+0000", 2024-09-14T09:08:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5429999999999999e-06 2024-09-14T09:08:59.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797064+0000", 2024-09-14T09:08:59.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2000000000000002e-06 2024-09-14T09:08:59.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797091+0000", 2024-09-14T09:08:59.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7804e-05 2024-09-14T09:08:59.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:59.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797095+0000", 2024-09-14T09:08:59.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2024-09-14T09:08:59.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788667+0000", 2024-09-14T09:08:59.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157211300000003 2024-09-14T09:08:59.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788742+0000", 2024-09-14T09:08:59.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5159000000000003e-05 2024-09-14T09:08:59.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788818+0000", 2024-09-14T09:08:59.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6038000000000006e-05 2024-09-14T09:08:59.294 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.294 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.294 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.294 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:266 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:59.295 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:59.295 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.423603522000001, 2024-09-14T09:08:59.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99193390100000001, 2024-09-14T09:08:59.295 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.295 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.295 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.295 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.295 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:59.295 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:59.296 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 266 2024-09-14T09:08:59.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.296 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:59.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:59.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:08:59.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:08:59.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797075+0000", 2024-09-14T09:08:59.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2570000000000002e-06 2024-09-14T09:08:59.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797082+0000", 2024-09-14T09:08:59.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8029999999999997e-06 2024-09-14T09:08:59.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797088+0000", 2024-09-14T09:08:59.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.468e-06 2024-09-14T09:08:59.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797116+0000", 2024-09-14T09:08:59.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7752000000000001e-05 2024-09-14T09:08:59.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:59.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797121+0000", 2024-09-14T09:08:59.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5960000000000003e-06 2024-09-14T09:08:59.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788846+0000", 2024-09-14T09:08:59.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99172512199999996 2024-09-14T09:08:59.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788916+0000", 2024-09-14T09:08:59.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9843000000000002e-05 2024-09-14T09:08:59.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789006+0000", 2024-09-14T09:08:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9608e-05 2024-09-14T09:08:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:267 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.423578715000001, 2024-09-14T09:08:59.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99210926799999999, 2024-09-14T09:08:59.301 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.301 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.301 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.301 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.301 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:59.301 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:59.301 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 267 2024-09-14T09:08:59.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.301 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:08:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2399999999999999e-07 2024-09-14T09:08:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797099+0000", 2024-09-14T09:08:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.091e-06 2024-09-14T09:08:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797105+0000", 2024-09-14T09:08:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-09-14T09:08:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797111+0000", 2024-09-14T09:08:59.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5130000000000004e-06 2024-09-14T09:08:59.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797140+0000", 2024-09-14T09:08:59.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9513999999999999e-05 2024-09-14T09:08:59.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:59.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797145+0000", 2024-09-14T09:08:59.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:08:59.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789037+0000", 2024-09-14T09:08:59.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99189253899999996 2024-09-14T09:08:59.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789110+0000", 2024-09-14T09:08:59.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2848000000000005e-05 2024-09-14T09:08:59.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789206+0000", 2024-09-14T09:08:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5778000000000004e-05 2024-09-14T09:08:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:268 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.423555476000001, 2024-09-14T09:08:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992276359, 2024-09-14T09:08:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 268 2024-09-14T09:08:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:08:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:08:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797123+0000", 2024-09-14T09:08:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2740000000000002e-06 2024-09-14T09:08:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797129+0000", 2024-09-14T09:08:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-06 2024-09-14T09:08:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797134+0000", 2024-09-14T09:08:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9099999999999996e-06 2024-09-14T09:08:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797163+0000", 2024-09-14T09:08:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9709999999999998e-05 2024-09-14T09:08:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8709999999999999e-06 2024-09-14T09:08:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789231+0000", 2024-09-14T09:08:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992063959 2024-09-14T09:08:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789306+0000", 2024-09-14T09:08:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5289000000000004e-05 2024-09-14T09:08:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789396+0000", 2024-09-14T09:08:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9939999999999996e-05 2024-09-14T09:08:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:269 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2457600~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.423531966999999, 2024-09-14T09:08:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99242174400000005, 2024-09-14T09:08:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 269 2024-09-14T09:08:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:08:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:08:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797146+0000", 2024-09-14T09:08:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5289999999999998e-06 2024-09-14T09:08:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797153+0000", 2024-09-14T09:08:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1920000000000002e-06 2024-09-14T09:08:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797158+0000", 2024-09-14T09:08:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099999999999998e-06 2024-09-14T09:08:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797188+0000", 2024-09-14T09:08:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0128e-05 2024-09-14T09:08:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797194+0000", 2024-09-14T09:08:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6250000000000004e-06 2024-09-14T09:08:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789439+0000", 2024-09-14T09:08:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99224531000000005 2024-09-14T09:08:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789489+0000", 2024-09-14T09:08:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9830000000000002e-05 2024-09-14T09:08:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789565+0000", 2024-09-14T09:08:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6229000000000005e-05 2024-09-14T09:08:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:270 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.423508145, 2024-09-14T09:08:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99257721899999996, 2024-09-14T09:08:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 270 2024-09-14T09:08:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:08:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797168+0000", 2024-09-14T09:08:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2024-09-14T09:08:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797170+0000", 2024-09-14T09:08:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3120000000000001e-06 2024-09-14T09:08:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797177+0000", 2024-09-14T09:08:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0960000000000003e-06 2024-09-14T09:08:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797183+0000", 2024-09-14T09:08:59.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1669999999999998e-06 2024-09-14T09:08:59.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797213+0000", 2024-09-14T09:08:59.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0494e-05 2024-09-14T09:08:59.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:59.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:08:59.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:08:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789586+0000", 2024-09-14T09:08:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99236692100000001 2024-09-14T09:08:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789658+0000", 2024-09-14T09:08:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2279000000000004e-05 2024-09-14T09:08:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789745+0000", 2024-09-14T09:08:59.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6698000000000002e-05 2024-09-14T09:08:59.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.322 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.322 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:271 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3375104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:59.322 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:59.322 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.423482947, 2024-09-14T09:08:59.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99274791699999998, 2024-09-14T09:08:59.322 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 271 2024-09-14T09:08:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:59.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:08:59.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:08:59.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797195+0000", 2024-09-14T09:08:59.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1639999999999999e-06 2024-09-14T09:08:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797201+0000", 2024-09-14T09:08:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1290000000000001e-06 2024-09-14T09:08:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797206+0000", 2024-09-14T09:08:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9300000000000002e-06 2024-09-14T09:08:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797237+0000", 2024-09-14T09:08:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1285000000000003e-05 2024-09-14T09:08:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797242+0000", 2024-09-14T09:08:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6e-06 2024-09-14T09:08:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789768+0000", 2024-09-14T09:08:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99252547400000002 2024-09-14T09:08:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789826+0000", 2024-09-14T09:08:59.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8155999999999997e-05 2024-09-14T09:08:59.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789940+0000", 2024-09-14T09:08:59.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114788 2024-09-14T09:08:59.327 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.327 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.327 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:272 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:08:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.423459553000001, 2024-09-14T09:08:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99285248800000003, 2024-09-14T09:08:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:08:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:08:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 272 2024-09-14T09:08:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:59.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:59.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:08:59.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:08:59.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:08:59.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5129999999999999e-06 2024-09-14T09:08:59.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797226+0000", 2024-09-14T09:08:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4529999999999996e-06 2024-09-14T09:08:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797232+0000", 2024-09-14T09:08:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1839999999999998e-06 2024-09-14T09:08:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797264+0000", 2024-09-14T09:08:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2691999999999998e-05 2024-09-14T09:08:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:08:59.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797270+0000", 2024-09-14T09:08:59.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-06 2024-09-14T09:08:59.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789965+0000", 2024-09-14T09:08:59.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99269526200000002 2024-09-14T09:08:59.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790021+0000", 2024-09-14T09:08:59.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5297000000000003e-05 2024-09-14T09:08:59.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790068+0000", 2024-09-14T09:08:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7664999999999998e-05 2024-09-14T09:08:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5006.0:4897 3.1b 3:dc4939f3:::rbd_object_map.11125497cb52:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-14T09:08:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:45.922622+0000", 2024-09-14T09:08:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.298053296999999, 2024-09-14T09:08:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011994009, 2024-09-14T09:08:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5006", 2024-09-14T09:08:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/3107765484", 2024-09-14T09:08:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4897 2024-09-14T09:08:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922622+0000", 2024-09-14T09:08:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922622+0000", 2024-09-14T09:08:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922623+0000", 2024-09-14T09:08:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2999999999999999e-07 2024-09-14T09:08:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922628+0000", 2024-09-14T09:08:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.459e-06 2024-09-14T09:08:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922639+0000", 2024-09-14T09:08:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1099e-05 2024-09-14T09:08:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922650+0000", 2024-09-14T09:08:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1695999999999999e-05 2024-09-14T09:08:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.925576+0000", 2024-09-14T09:08:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002925839 2024-09-14T09:08:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.925628+0000", 2024-09-14T09:08:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1536000000000003e-05 2024-09-14T09:08:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.925833+0000", 2024-09-14T09:08:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00020529000000000001 2024-09-14T09:08:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.927960+0000", 2024-09-14T09:08:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021266169999999999 2024-09-14T09:08:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934526+0000", 2024-09-14T09:08:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006566293 2024-09-14T09:08:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934576+0000", 2024-09-14T09:08:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0022000000000003e-05 2024-09-14T09:08:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934616+0000", 2024-09-14T09:08:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0228000000000002e-05 2024-09-14T09:08:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5006.0:4898 3.1b 3:dc4939f3:::rbd_object_map.11125497cb52:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-14T09:08:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:45.923037+0000", 2024-09-14T09:08:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.297638055, 2024-09-14T09:08:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011707255, 2024-09-14T09:08:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:08:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5006", 2024-09-14T09:08:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/3107765484", 2024-09-14T09:08:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4898 2024-09-14T09:08:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923037+0000", 2024-09-14T09:08:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923037+0000", 2024-09-14T09:08:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923038+0000", 2024-09-14T09:08:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5199999999999996e-07 2024-09-14T09:08:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923045+0000", 2024-09-14T09:08:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9280000000000004e-06 2024-09-14T09:08:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923052+0000", 2024-09-14T09:08:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0180000000000004e-06 2024-09-14T09:08:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923057+0000", 2024-09-14T09:08:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5970000000000002e-06 2024-09-14T09:08:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.926369+0000", 2024-09-14T09:08:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003312204 2024-09-14T09:08:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.926458+0000", 2024-09-14T09:08:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8682000000000002e-05 2024-09-14T09:08:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:08:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.926817+0000", 2024-09-14T09:08:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00035913200000000002 2024-09-14T09:08:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:08:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.928477+0000", 2024-09-14T09:08:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016600250000000001 2024-09-14T09:08:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:08:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934653+0000", 2024-09-14T09:08:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061763089999999996 2024-09-14T09:08:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:08:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934706+0000", 2024-09-14T09:08:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2475000000000002e-05 2024-09-14T09:08:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934745+0000", 2024-09-14T09:08:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9133e-05 2024-09-14T09:08:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.346 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:59.347 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:08:59.347 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:08:59.349+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:08:59.447 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:59.450+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:59.491 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:59.492 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:59.492 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:08:59.492 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:59.500 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:08:59.584 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:59.586+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:08:59.642 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:59.642 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:08:59.642 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:08:59.642 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:08:59.642 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:59.650 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:08:59.652+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:08:59.651 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:08:59.750 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:59.753+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:59.795 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:08:59.795 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:08:59.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:08:59.795 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:08:59.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.795 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5299 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5230592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:59.795 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:08:59.795 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.547203833000001, 2024-09-14T09:08:59.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038972887999999997, 2024-09-14T09:08:59.796 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.796 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.796 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.796 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.796 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:59.796 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:59.796 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5299 2024-09-14T09:08:59.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.796 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:08:59.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:08:59.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249123+0000", 2024-09-14T09:08:59.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1199999999999998e-07 2024-09-14T09:08:59.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249125+0000", 2024-09-14T09:08:59.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.855e-06 2024-09-14T09:08:59.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249131+0000", 2024-09-14T09:08:59.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2949999999999999e-06 2024-09-14T09:08:59.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249136+0000", 2024-09-14T09:08:59.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9779999999999996e-06 2024-09-14T09:08:59.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287933+0000", 2024-09-14T09:08:59.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038796663000000002 2024-09-14T09:08:59.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288012+0000", 2024-09-14T09:08:59.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9617999999999996e-05 2024-09-14T09:08:59.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288095+0000", 2024-09-14T09:08:59.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3066999999999996e-05 2024-09-14T09:08:59.800 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.801 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.801 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.801 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5300 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5292032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:59.801 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:08:59.801 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.547184443999999, 2024-09-14T09:08:59.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039068578, 2024-09-14T09:08:59.801 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.801 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.801 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.802 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.802 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:59.802 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:59.802 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5300 2024-09-14T09:08:59.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.802 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:08:59.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:08:59.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254832+0000", 2024-09-14T09:08:59.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056899180000000004 2024-09-14T09:08:59.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254836+0000", 2024-09-14T09:08:59.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7809999999999999e-06 2024-09-14T09:08:59.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254845+0000", 2024-09-14T09:08:59.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.516e-06 2024-09-14T09:08:59.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254851+0000", 2024-09-14T09:08:59.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9109999999999998e-06 2024-09-14T09:08:59.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288122+0000", 2024-09-14T09:08:59.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.033270776000000002 2024-09-14T09:08:59.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288163+0000", 2024-09-14T09:08:59.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1700999999999999e-05 2024-09-14T09:08:59.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288210+0000", 2024-09-14T09:08:59.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6974999999999997e-05 2024-09-14T09:08:59.806 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.806 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.806 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.806 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5342 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7872512~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:59.807 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:08:59.807 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.540608258999999, 2024-09-14T09:08:59.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038906217999999999, 2024-09-14T09:08:59.807 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.807 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.807 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.807 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.807 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:59.807 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:59.807 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5342 2024-09-14T09:08:59.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.807 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:08:59.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:08:59.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:08:59.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8700000000000001e-07 2024-09-14T09:08:59.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255720+0000", 2024-09-14T09:08:59.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.739e-06 2024-09-14T09:08:59.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255726+0000", 2024-09-14T09:08:59.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.981e-06 2024-09-14T09:08:59.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255737+0000", 2024-09-14T09:08:59.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0621e-05 2024-09-14T09:08:59.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294538+0000", 2024-09-14T09:08:59.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038801012000000003 2024-09-14T09:08:59.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294577+0000", 2024-09-14T09:08:59.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9042000000000003e-05 2024-09-14T09:08:59.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294624+0000", 2024-09-14T09:08:59.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7435999999999998e-05 2024-09-14T09:08:59.811 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.811 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.811 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.812 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5343 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7933952~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:59.812 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:08:59.812 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.540582383, 2024-09-14T09:08:59.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039081811000000001, 2024-09-14T09:08:59.812 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.812 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.812 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.812 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.812 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:59.812 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:59.812 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5343 2024-09-14T09:08:59.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.813 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:08:59.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:08:59.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:08:59.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1800000000000001e-07 2024-09-14T09:08:59.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255746+0000", 2024-09-14T09:08:59.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.103e-06 2024-09-14T09:08:59.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255753+0000", 2024-09-14T09:08:59.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0929999999999999e-06 2024-09-14T09:08:59.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255757+0000", 2024-09-14T09:08:59.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9579999999999998e-06 2024-09-14T09:08:59.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294656+0000", 2024-09-14T09:08:59.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038898508999999998 2024-09-14T09:08:59.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294738+0000", 2024-09-14T09:08:59.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2423999999999996e-05 2024-09-14T09:08:59.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294826+0000", 2024-09-14T09:08:59.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7305999999999994e-05 2024-09-14T09:08:59.816 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.816 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.817 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.817 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5344 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7995392~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:59.817 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:08:59.817 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.540562950999998, 2024-09-14T09:08:59.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039165567999999998, 2024-09-14T09:08:59.817 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.817 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.817 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.817 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.817 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:59.817 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:59.818 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5344 2024-09-14T09:08:59.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.818 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:08:59.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:08:59.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255764+0000", 2024-09-14T09:08:59.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7899999999999999e-07 2024-09-14T09:08:59.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255765+0000", 2024-09-14T09:08:59.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.782e-06 2024-09-14T09:08:59.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255774+0000", 2024-09-14T09:08:59.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8070000000000006e-06 2024-09-14T09:08:59.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255779+0000", 2024-09-14T09:08:59.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9180000000000002e-06 2024-09-14T09:08:59.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294841+0000", 2024-09-14T09:08:59.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039061514999999998 2024-09-14T09:08:59.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294881+0000", 2024-09-14T09:08:59.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0027999999999997e-05 2024-09-14T09:08:59.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294929+0000", 2024-09-14T09:08:59.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8139000000000001e-05 2024-09-14T09:08:59.821 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.821 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.821 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.822 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5345 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8056832~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:59.822 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:08:59.822 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.540540712999999, 2024-09-14T09:08:59.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039340027999999999, 2024-09-14T09:08:59.822 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.822 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.822 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.822 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.822 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:59.822 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:59.822 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5345 2024-09-14T09:08:59.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.823 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:08:59.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:08:59.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:08:59.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8099999999999998e-07 2024-09-14T09:08:59.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255788+0000", 2024-09-14T09:08:59.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1280000000000002e-06 2024-09-14T09:08:59.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255794+0000", 2024-09-14T09:08:59.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0020000000000003e-06 2024-09-14T09:08:59.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255800+0000", 2024-09-14T09:08:59.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2009999999999996e-06 2024-09-14T09:08:59.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294960+0000", 2024-09-14T09:08:59.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039159674999999998 2024-09-14T09:08:59.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295041+0000", 2024-09-14T09:08:59.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0648000000000004e-05 2024-09-14T09:08:59.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295126+0000", 2024-09-14T09:08:59.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4993000000000004e-05 2024-09-14T09:08:59.826 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.826 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.826 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.827 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5346 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8118272~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:59.827 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:08:59.827 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.540519718999999, 2024-09-14T09:08:59.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039433228000000001, 2024-09-14T09:08:59.827 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.827 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.827 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.827 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.827 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:59.827 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:59.827 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5346 2024-09-14T09:08:59.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.828 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:08:59.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:08:59.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:08:59.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6899999999999998e-07 2024-09-14T09:08:59.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255809+0000", 2024-09-14T09:08:59.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9580000000000001e-06 2024-09-14T09:08:59.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255815+0000", 2024-09-14T09:08:59.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6579999999999999e-06 2024-09-14T09:08:59.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255819+0000", 2024-09-14T09:08:59.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5839999999999996e-06 2024-09-14T09:08:59.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295152+0000", 2024-09-14T09:08:59.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039332677000000003 2024-09-14T09:08:59.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295192+0000", 2024-09-14T09:08:59.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0491999999999998e-05 2024-09-14T09:08:59.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295240+0000", 2024-09-14T09:08:59.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7490000000000001e-05 2024-09-14T09:08:59.831 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.831 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.831 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.831 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5347 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8179712~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:59.832 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:08:59.832 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.540492122, 2024-09-14T09:08:59.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039601193999999999, 2024-09-14T09:08:59.832 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.832 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.832 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.832 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.832 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:59.832 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:59.832 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5347 2024-09-14T09:08:59.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.832 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:08:59.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:08:59.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255835+0000", 2024-09-14T09:08:59.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.82e-07 2024-09-14T09:08:59.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255837+0000", 2024-09-14T09:08:59.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0959999999999999e-06 2024-09-14T09:08:59.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255843+0000", 2024-09-14T09:08:59.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3779999999999998e-06 2024-09-14T09:08:59.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255848+0000", 2024-09-14T09:08:59.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7609999999999998e-06 2024-09-14T09:08:59.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295271+0000", 2024-09-14T09:08:59.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039423079 2024-09-14T09:08:59.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295350+0000", 2024-09-14T09:08:59.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8623999999999998e-05 2024-09-14T09:08:59.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295435+0000", 2024-09-14T09:08:59.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5674000000000007e-05 2024-09-14T09:08:59.836 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.836 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.836 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.837 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5348 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8241152~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:59.837 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:08:59.837 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.540471913000001, 2024-09-14T09:08:59.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039695057999999998, 2024-09-14T09:08:59.837 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.837 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.837 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.837 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.837 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:59.837 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:59.837 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5348 2024-09-14T09:08:59.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.838 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:08:59.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:08:59.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255855+0000", 2024-09-14T09:08:59.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7599999999999997e-07 2024-09-14T09:08:59.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255857+0000", 2024-09-14T09:08:59.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.905e-06 2024-09-14T09:08:59.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255863+0000", 2024-09-14T09:08:59.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0669999999999997e-06 2024-09-14T09:08:59.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255867+0000", 2024-09-14T09:08:59.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4730000000000002e-06 2024-09-14T09:08:59.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295461+0000", 2024-09-14T09:08:59.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039594074 2024-09-14T09:08:59.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295503+0000", 2024-09-14T09:08:59.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1363999999999999e-05 2024-09-14T09:08:59.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295549+0000", 2024-09-14T09:08:59.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6699000000000001e-05 2024-09-14T09:08:59.842 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.842 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.842 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.842 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5349 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8302592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:59.842 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:08:59.842 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.540452952999999, 2024-09-14T09:08:59.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039875928999999997, 2024-09-14T09:08:59.843 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.843 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.843 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.843 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.843 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:59.843 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:59.843 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5349 2024-09-14T09:08:59.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.843 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:08:59.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:08:59.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255874+0000", 2024-09-14T09:08:59.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4900000000000001e-07 2024-09-14T09:08:59.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255880+0000", 2024-09-14T09:08:59.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9939999999999997e-06 2024-09-14T09:08:59.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255886+0000", 2024-09-14T09:08:59.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3899999999999998e-06 2024-09-14T09:08:59.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255891+0000", 2024-09-14T09:08:59.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.938e-06 2024-09-14T09:08:59.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295580+0000", 2024-09-14T09:08:59.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039688681000000003 2024-09-14T09:08:59.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295653+0000", 2024-09-14T09:08:59.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3045000000000003e-05 2024-09-14T09:08:59.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295749+0000", 2024-09-14T09:08:59.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6532000000000003e-05 2024-09-14T09:08:59.846 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.846 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.847 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.847 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5350 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8364032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:08:59.847 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:08:59.847 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.540429146000001, 2024-09-14T09:08:59.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039989719, 2024-09-14T09:08:59.847 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.847 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.847 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.847 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.847 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:08:59.847 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:08:59.848 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5350 2024-09-14T09:08:59.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.848 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:08:59.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:08:59.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255898+0000", 2024-09-14T09:08:59.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2024-09-14T09:08:59.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255899+0000", 2024-09-14T09:08:59.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9139999999999998e-06 2024-09-14T09:08:59.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255905+0000", 2024-09-14T09:08:59.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7289999999999997e-06 2024-09-14T09:08:59.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255910+0000", 2024-09-14T09:08:59.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6210000000000003e-06 2024-09-14T09:08:59.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295775+0000", 2024-09-14T09:08:59.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039864973999999997 2024-09-14T09:08:59.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295828+0000", 2024-09-14T09:08:59.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3411000000000001e-05 2024-09-14T09:08:59.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295887+0000", 2024-09-14T09:08:59.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699000000000002e-05 2024-09-14T09:08:59.851 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.851 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.851 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.851 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4639 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1843200~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:08:59.851 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:08:59.851 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.5965136869999998, 2024-09-14T09:08:59.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040843672999999997, 2024-09-14T09:08:59.852 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.852 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.852 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.852 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.852 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:08:59.852 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:08:59.852 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4639 2024-09-14T09:08:59.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.852 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:08:59.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:08:59.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:08:59.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:08:59.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199818+0000", 2024-09-14T09:08:59.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1450000000000001e-06 2024-09-14T09:08:59.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199827+0000", 2024-09-14T09:08:59.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3999999999999998e-06 2024-09-14T09:08:59.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199834+0000", 2024-09-14T09:08:59.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0809999999999996e-06 2024-09-14T09:08:59.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240541+0000", 2024-09-14T09:08:59.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040706941000000003 2024-09-14T09:08:59.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240584+0000", 2024-09-14T09:08:59.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3040999999999997e-05 2024-09-14T09:08:59.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240656+0000", 2024-09-14T09:08:59.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2200000000000007e-05 2024-09-14T09:08:59.855 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.855 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.855 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.856 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4640 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1871872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:08:59.856 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:08:59.856 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.596479202, 2024-09-14T09:08:59.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040967601999999999, 2024-09-14T09:08:59.856 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.856 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.856 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.856 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.856 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:08:59.856 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:08:59.856 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4640 2024-09-14T09:08:59.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.857 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:08:59.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:08:59.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199848+0000", 2024-09-14T09:08:59.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5400000000000002e-07 2024-09-14T09:08:59.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199850+0000", 2024-09-14T09:08:59.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2479999999999999e-06 2024-09-14T09:08:59.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199857+0000", 2024-09-14T09:08:59.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.187e-06 2024-09-14T09:08:59.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199862+0000", 2024-09-14T09:08:59.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5119999999999999e-06 2024-09-14T09:08:59.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240684+0000", 2024-09-14T09:08:59.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040821245999999999 2024-09-14T09:08:59.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240739+0000", 2024-09-14T09:08:59.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4991999999999998e-05 2024-09-14T09:08:59.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240815+0000", 2024-09-14T09:08:59.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5963000000000004e-05 2024-09-14T09:08:59.860 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.860 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.860 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.860 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4641 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1900544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:08:59.860 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:08:59.860 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.5964568720000001, 2024-09-14T09:08:59.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041205512, 2024-09-14T09:08:59.860 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.860 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.861 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.861 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.861 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:08:59.861 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:08:59.861 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4641 2024-09-14T09:08:59.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.861 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:08:59.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:08:59.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199870+0000", 2024-09-14T09:08:59.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0600000000000001e-07 2024-09-14T09:08:59.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199872+0000", 2024-09-14T09:08:59.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.928e-06 2024-09-14T09:08:59.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199877+0000", 2024-09-14T09:08:59.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6949999999999997e-06 2024-09-14T09:08:59.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199882+0000", 2024-09-14T09:08:59.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8210000000000001e-06 2024-09-14T09:08:59.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240847+0000", 2024-09-14T09:08:59.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040965201999999999 2024-09-14T09:08:59.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240888+0000", 2024-09-14T09:08:59.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0754000000000003e-05 2024-09-14T09:08:59.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241075+0000", 2024-09-14T09:08:59.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000186706 2024-09-14T09:08:59.864 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.864 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.864 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.865 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4642 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1929216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:08:59.865 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:08:59.865 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.5964379370000001, 2024-09-14T09:08:59.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041292575999999998, 2024-09-14T09:08:59.865 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.865 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.865 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.865 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.865 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:08:59.865 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:08:59.865 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4642 2024-09-14T09:08:59.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.865 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:08:59.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:08:59.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199889+0000", 2024-09-14T09:08:59.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2024-09-14T09:08:59.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199891+0000", 2024-09-14T09:08:59.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9e-06 2024-09-14T09:08:59.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199896+0000", 2024-09-14T09:08:59.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6960000000000002e-06 2024-09-14T09:08:59.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199901+0000", 2024-09-14T09:08:59.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6720000000000003e-06 2024-09-14T09:08:59.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241089+0000", 2024-09-14T09:08:59.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041187594000000001 2024-09-14T09:08:59.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241126+0000", 2024-09-14T09:08:59.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7490999999999997e-05 2024-09-14T09:08:59.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241181+0000", 2024-09-14T09:08:59.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4823e-05 2024-09-14T09:08:59.869 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.869 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.869 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.869 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4643 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1957888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:08:59.869 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:08:59.869 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.5964186580000002, 2024-09-14T09:08:59.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041418333000000002, 2024-09-14T09:08:59.869 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.869 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.869 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.870 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.870 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:08:59.870 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:08:59.870 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4643 2024-09-14T09:08:59.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.870 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:08:59.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:08:59.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:08:59.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5699999999999998e-07 2024-09-14T09:08:59.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199910+0000", 2024-09-14T09:08:59.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.829e-06 2024-09-14T09:08:59.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199916+0000", 2024-09-14T09:08:59.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8499999999999999e-06 2024-09-14T09:08:59.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199920+0000", 2024-09-14T09:08:59.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6530000000000002e-06 2024-09-14T09:08:59.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241211+0000", 2024-09-14T09:08:59.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041290327000000002 2024-09-14T09:08:59.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241257+0000", 2024-09-14T09:08:59.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6347000000000002e-05 2024-09-14T09:08:59.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241326+0000", 2024-09-14T09:08:59.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8969999999999999e-05 2024-09-14T09:08:59.873 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.874 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.874 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.874 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4644 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1986560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:08:59.874 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:08:59.874 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.5964003180000002, 2024-09-14T09:08:59.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041596269999999998, 2024-09-14T09:08:59.874 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.874 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.874 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.874 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.874 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:08:59.875 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:08:59.875 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4644 2024-09-14T09:08:59.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.875 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:08:59.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:08:59.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:08:59.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.41e-07 2024-09-14T09:08:59.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199928+0000", 2024-09-14T09:08:59.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8250000000000001e-06 2024-09-14T09:08:59.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199934+0000", 2024-09-14T09:08:59.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2280000000000003e-06 2024-09-14T09:08:59.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199939+0000", 2024-09-14T09:08:59.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8010000000000003e-06 2024-09-14T09:08:59.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241360+0000", 2024-09-14T09:08:59.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041421289 2024-09-14T09:08:59.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241435+0000", 2024-09-14T09:08:59.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4238000000000003e-05 2024-09-14T09:08:59.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241522+0000", 2024-09-14T09:08:59.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7547999999999996e-05 2024-09-14T09:08:59.878 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.878 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.878 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.878 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4645 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:08:59.878 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:08:59.878 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.5963814109999999, 2024-09-14T09:08:59.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041714660000000001, 2024-09-14T09:08:59.879 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.879 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.879 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:08:59.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:08:59.879 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4645 2024-09-14T09:08:59.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.879 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:08:59.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:08:59.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:08:59.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4700000000000002e-07 2024-09-14T09:08:59.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199947+0000", 2024-09-14T09:08:59.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.801e-06 2024-09-14T09:08:59.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199953+0000", 2024-09-14T09:08:59.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.694e-06 2024-09-14T09:08:59.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199957+0000", 2024-09-14T09:08:59.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3069999999999996e-06 2024-09-14T09:08:59.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241547+0000", 2024-09-14T09:08:59.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041589895000000002 2024-09-14T09:08:59.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241590+0000", 2024-09-14T09:08:59.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2985000000000003e-05 2024-09-14T09:08:59.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241660+0000", 2024-09-14T09:08:59.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9630999999999998e-05 2024-09-14T09:08:59.882 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.883 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.883 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.883 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4646 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2043904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:08:59.883 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:08:59.883 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.5963634230000001, 2024-09-14T09:08:59.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041827171000000003, 2024-09-14T09:08:59.883 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.883 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.883 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.883 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.883 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:08:59.883 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:08:59.883 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4646 2024-09-14T09:08:59.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.884 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:08:59.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:08:59.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:08:59.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6300000000000001e-07 2024-09-14T09:08:59.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199965+0000", 2024-09-14T09:08:59.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.035e-06 2024-09-14T09:08:59.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199973+0000", 2024-09-14T09:08:59.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9629999999999998e-06 2024-09-14T09:08:59.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199978+0000", 2024-09-14T09:08:59.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9069999999999998e-06 2024-09-14T09:08:59.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241677+0000", 2024-09-14T09:08:59.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041698662999999997 2024-09-14T09:08:59.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241717+0000", 2024-09-14T09:08:59.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602999999999997e-05 2024-09-14T09:08:59.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241790+0000", 2024-09-14T09:08:59.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2637000000000003e-05 2024-09-14T09:08:59.887 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.887 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.887 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.887 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4647 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2072576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:08:59.887 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:08:59.887 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.596334833, 2024-09-14T09:08:59.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041921189999999997, 2024-09-14T09:08:59.887 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:08:59.887 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:08:59.888 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:08:59.888 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:08:59.888 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:08:59.888 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:08:59.888 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4647 2024-09-14T09:08:59.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.888 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:08:59.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:08:59.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:08:59.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:08:59.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:08:59.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:08:59.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:08:59.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199992+0000", 2024-09-14T09:08:59.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3799999999999997e-07 2024-09-14T09:08:59.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:08:59.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199994+0000", 2024-09-14T09:08:59.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3020000000000002e-06 2024-09-14T09:08:59.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:08:59.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200004+0000", 2024-09-14T09:08:59.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3510000000000008e-06 2024-09-14T09:08:59.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:08:59.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200008+0000", 2024-09-14T09:08:59.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3329999999999998e-06 2024-09-14T09:08:59.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:08:59.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241814+0000", 2024-09-14T09:08:59.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041806280000000001 2024-09-14T09:08:59.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:08:59.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241855+0000", 2024-09-14T09:08:59.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0173999999999999e-05 2024-09-14T09:08:59.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:08:59.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:08:59.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:08:59.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241913+0000", 2024-09-14T09:08:59.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8112000000000002e-05 2024-09-14T09:08:59.891 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.891 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.891 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.891 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:08:59.891 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:08:59.891 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:08:59.893 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is set 2024-09-14T09:08:59.894 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:08:59.894 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:08:59.895+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:08:59.993 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:08:59.995+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:00.038 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:00.038 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:00.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.039 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1057 3.1f 3.6fdfdaff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:00.039 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.856014+0000", 2024-09-14T09:09:00.039 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.183844492, 2024-09-14T09:09:00.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1838628520000001, 2024-09-14T09:09:00.039 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.039 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.039 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:00.039 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.039 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:09:00.039 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:00.039 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1057 2024-09-14T09:09:00.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.039 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.856014+0000", 2024-09-14T09:09:00.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.856014+0000", 2024-09-14T09:09:00.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.856015+0000", 2024-09-14T09:09:00.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.75e-07 2024-09-14T09:09:00.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.856018+0000", 2024-09-14T09:09:00.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6850000000000001e-06 2024-09-14T09:09:00.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.856025+0000", 2024-09-14T09:09:00.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9260000000000003e-06 2024-09-14T09:09:00.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.856039+0000", 2024-09-14T09:09:00.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4039999999999999e-05 2024-09-14T09:09:00.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.857363+0000", 2024-09-14T09:09:00.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013237959999999999 2024-09-14T09:09:00.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:00.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.857371+0000", 2024-09-14T09:09:00.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5089999999999993e-06 2024-09-14T09:09:00.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859912+0000", 2024-09-14T09:09:00.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025411460000000002 2024-09-14T09:09:00.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859919+0000", 2024-09-14T09:09:00.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2119999999999997e-06 2024-09-14T09:09:00.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.859632+0000", 2024-09-14T09:09:00.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99971304599999999 2024-09-14T09:09:00.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.859641+0000", 2024-09-14T09:09:00.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6440000000000006e-06 2024-09-14T09:09:00.044 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.045 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.045 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.045 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1058 3.1f 3.6fdfdaff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:00.045 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.857385+0000", 2024-09-14T09:09:00.045 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.182474102, 2024-09-14T09:09:00.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.182539893, 2024-09-14T09:09:00.045 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.045 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.045 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:00.045 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.045 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:09:00.045 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:00.046 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1058 2024-09-14T09:09:00.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.046 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.857385+0000", 2024-09-14T09:09:00.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.857385+0000", 2024-09-14T09:09:00.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.857386+0000", 2024-09-14T09:09:00.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.02e-07 2024-09-14T09:09:00.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.857390+0000", 2024-09-14T09:09:00.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8079999999999998e-06 2024-09-14T09:09:00.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.857398+0000", 2024-09-14T09:09:00.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3739999999999998e-06 2024-09-14T09:09:00.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.857404+0000", 2024-09-14T09:09:00.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3110000000000002e-06 2024-09-14T09:09:00.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.857454+0000", 2024-09-14T09:09:00.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9583000000000003e-05 2024-09-14T09:09:00.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:00.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.857458+0000", 2024-09-14T09:09:00.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.442e-06 2024-09-14T09:09:00.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.860010+0000", 2024-09-14T09:09:00.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025517729999999998 2024-09-14T09:09:00.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.860018+0000", 2024-09-14T09:09:00.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5630000000000003e-06 2024-09-14T09:09:00.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.859723+0000", 2024-09-14T09:09:00.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99970491299999997 2024-09-14T09:09:00.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.859737+0000", 2024-09-14T09:09:00.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4549000000000001e-05 2024-09-14T09:09:00.050 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.050 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.050 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.050 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1079 3.1f 3.35d861ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:00.050 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.857467+0000", 2024-09-14T09:09:00.051 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1823924319999999, 2024-09-14T09:09:00.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.182495745, 2024-09-14T09:09:00.051 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.051 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.051 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:00.051 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.051 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:09:00.051 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:00.051 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1079 2024-09-14T09:09:00.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.051 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.857467+0000", 2024-09-14T09:09:00.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.857467+0000", 2024-09-14T09:09:00.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.857467+0000", 2024-09-14T09:09:00.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4499999999999997e-07 2024-09-14T09:09:00.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.857470+0000", 2024-09-14T09:09:00.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9969999999999999e-06 2024-09-14T09:09:00.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859583+0000", 2024-09-14T09:09:00.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021126460000000001 2024-09-14T09:09:00.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859591+0000", 2024-09-14T09:09:00.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7950000000000008e-06 2024-09-14T09:09:00.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.860059+0000", 2024-09-14T09:09:00.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000468961 2024-09-14T09:09:00.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.860068+0000", 2024-09-14T09:09:00.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2409999999999995e-06 2024-09-14T09:09:00.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.859765+0000", 2024-09-14T09:09:00.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.999697752 2024-09-14T09:09:00.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.859774+0000", 2024-09-14T09:09:00.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3550000000000005e-06 2024-09-14T09:09:00.055 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.055 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.055 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.056 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1080 3.1f 3.35d861ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:00.056 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.859605+0000", 2024-09-14T09:09:00.056 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1802539400000001, 2024-09-14T09:09:00.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.180389438, 2024-09-14T09:09:00.056 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.056 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.056 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:00.056 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.056 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:09:00.056 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:00.056 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1080 2024-09-14T09:09:00.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.056 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859605+0000", 2024-09-14T09:09:00.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859605+0000", 2024-09-14T09:09:00.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859606+0000", 2024-09-14T09:09:00.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0300000000000001e-06 2024-09-14T09:09:00.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859610+0000", 2024-09-14T09:09:00.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8569999999999997e-06 2024-09-14T09:09:00.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859617+0000", 2024-09-14T09:09:00.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.878e-06 2024-09-14T09:09:00.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859623+0000", 2024-09-14T09:09:00.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.993e-06 2024-09-14T09:09:00.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.860112+0000", 2024-09-14T09:09:00.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00048941100000000003 2024-09-14T09:09:00.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.860121+0000", 2024-09-14T09:09:00.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.918e-06 2024-09-14T09:09:00.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.859801+0000", 2024-09-14T09:09:00.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99968001399999995 2024-09-14T09:09:00.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.859808+0000", 2024-09-14T09:09:00.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1720000000000001e-06 2024-09-14T09:09:00.060 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.060 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.060 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.060 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1081 3.1f 3.35d861ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:00.060 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.859631+0000", 2024-09-14T09:09:00.060 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.18022805, 2024-09-14T09:09:00.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1803947379999999, 2024-09-14T09:09:00.061 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.061 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.061 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:00.061 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.061 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:09:00.061 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:00.061 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1081 2024-09-14T09:09:00.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.061 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859631+0000", 2024-09-14T09:09:00.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859631+0000", 2024-09-14T09:09:00.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859631+0000", 2024-09-14T09:09:00.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3599999999999999e-07 2024-09-14T09:09:00.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859634+0000", 2024-09-14T09:09:00.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5229999999999998e-06 2024-09-14T09:09:00.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859641+0000", 2024-09-14T09:09:00.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9750000000000001e-06 2024-09-14T09:09:00.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859646+0000", 2024-09-14T09:09:00.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9919999999999998e-06 2024-09-14T09:09:00.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.860172+0000", 2024-09-14T09:09:00.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00052658100000000003 2024-09-14T09:09:00.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.860181+0000", 2024-09-14T09:09:00.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1030000000000002e-06 2024-09-14T09:09:00.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.859846+0000", 2024-09-14T09:09:00.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99966522199999996 2024-09-14T09:09:00.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.859855+0000", 2024-09-14T09:09:00.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1060000000000006e-06 2024-09-14T09:09:00.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.065 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.065 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1082 3.1f 3.35d861ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:00.065 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.859653+0000", 2024-09-14T09:09:00.065 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.180206036, 2024-09-14T09:09:00.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1804037270000001, 2024-09-14T09:09:00.065 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.065 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.065 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:00.066 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.066 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:09:00.066 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:00.066 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1082 2024-09-14T09:09:00.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.066 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859653+0000", 2024-09-14T09:09:00.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859653+0000", 2024-09-14T09:09:00.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859653+0000", 2024-09-14T09:09:00.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.15e-07 2024-09-14T09:09:00.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859655+0000", 2024-09-14T09:09:00.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.922e-06 2024-09-14T09:09:00.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:00.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.896e-06 2024-09-14T09:09:00.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859666+0000", 2024-09-14T09:09:00.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8969999999999999e-06 2024-09-14T09:09:00.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.860220+0000", 2024-09-14T09:09:00.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00055394600000000004 2024-09-14T09:09:00.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.860229+0000", 2024-09-14T09:09:00.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0710000000000001e-06 2024-09-14T09:09:00.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.859897+0000", 2024-09-14T09:09:00.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99966829300000004 2024-09-14T09:09:00.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.859906+0000", 2024-09-14T09:09:00.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2970000000000004e-06 2024-09-14T09:09:00.069 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.069 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.070 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.070 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:995 3.1f 3.35d861ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:00.070 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.854768+0000", 2024-09-14T09:09:00.070 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1850909999999999, 2024-09-14T09:09:00.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1853207910000001, 2024-09-14T09:09:00.070 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.070 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.070 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:00.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:09:00.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:00.070 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 995 2024-09-14T09:09:00.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.071 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854768+0000", 2024-09-14T09:09:00.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854768+0000", 2024-09-14T09:09:00.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854769+0000", 2024-09-14T09:09:00.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.299e-06 2024-09-14T09:09:00.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854774+0000", 2024-09-14T09:09:00.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1830000000000002e-06 2024-09-14T09:09:00.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854836+0000", 2024-09-14T09:09:00.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1546999999999999e-05 2024-09-14T09:09:00.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854846+0000", 2024-09-14T09:09:00.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0379e-05 2024-09-14T09:09:00.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854897+0000", 2024-09-14T09:09:00.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0949000000000003e-05 2024-09-14T09:09:00.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:09:00.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854904+0000", 2024-09-14T09:09:00.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9369999999999998e-06 2024-09-14T09:09:00.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859234+0000", 2024-09-14T09:09:00.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043295570000000004 2024-09-14T09:09:00.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859243+0000", 2024-09-14T09:09:00.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2210000000000003e-06 2024-09-14T09:09:00.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.858692+0000", 2024-09-14T09:09:00.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99944876999999999 2024-09-14T09:09:00.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.858709+0000", 2024-09-14T09:09:00.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6818999999999999e-05 2024-09-14T09:09:00.075 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.075 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.075 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.076 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:996 3.1f 3.35d861ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:00.076 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.854862+0000", 2024-09-14T09:09:00.076 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1849971079999999, 2024-09-14T09:09:00.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.185262394, 2024-09-14T09:09:00.076 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.076 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.076 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:00.076 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.076 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:09:00.076 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:00.076 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 996 2024-09-14T09:09:00.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.077 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854862+0000", 2024-09-14T09:09:00.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854862+0000", 2024-09-14T09:09:00.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854862+0000", 2024-09-14T09:09:00.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699999999999995e-07 2024-09-14T09:09:00.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854866+0000", 2024-09-14T09:09:00.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3569999999999998e-06 2024-09-14T09:09:00.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854874+0000", 2024-09-14T09:09:00.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3250000000000008e-06 2024-09-14T09:09:00.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854880+0000", 2024-09-14T09:09:00.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8000000000000004e-06 2024-09-14T09:09:00.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854934+0000", 2024-09-14T09:09:00.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3927000000000001e-05 2024-09-14T09:09:00.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:00.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854938+0000", 2024-09-14T09:09:00.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5809999999999998e-06 2024-09-14T09:09:00.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859275+0000", 2024-09-14T09:09:00.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043361320000000004 2024-09-14T09:09:00.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859283+0000", 2024-09-14T09:09:00.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5019999999999992e-06 2024-09-14T09:09:00.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.858737+0000", 2024-09-14T09:09:00.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99945408599999996 2024-09-14T09:09:00.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.858746+0000", 2024-09-14T09:09:00.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2669999999999995e-06 2024-09-14T09:09:00.081 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.081 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.081 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.081 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:997 3.1f 3.35d861ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:00.081 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.854888+0000", 2024-09-14T09:09:00.081 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1849706200000001, 2024-09-14T09:09:00.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.185271473, 2024-09-14T09:09:00.081 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.081 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.081 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:00.082 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.082 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:09:00.082 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:00.082 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 997 2024-09-14T09:09:00.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.082 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854888+0000", 2024-09-14T09:09:00.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854888+0000", 2024-09-14T09:09:00.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854889+0000", 2024-09-14T09:09:00.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4000000000000002e-07 2024-09-14T09:09:00.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854891+0000", 2024-09-14T09:09:00.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4399999999999999e-06 2024-09-14T09:09:00.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854898+0000", 2024-09-14T09:09:00.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4740000000000002e-06 2024-09-14T09:09:00.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854903+0000", 2024-09-14T09:09:00.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.677e-06 2024-09-14T09:09:00.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854984+0000", 2024-09-14T09:09:00.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0907000000000003e-05 2024-09-14T09:09:00.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:00.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.854990+0000", 2024-09-14T09:09:00.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3600000000000004e-06 2024-09-14T09:09:00.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859321+0000", 2024-09-14T09:09:00.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043312910000000001 2024-09-14T09:09:00.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859337+0000", 2024-09-14T09:09:00.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6093e-05 2024-09-14T09:09:00.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.858773+0000", 2024-09-14T09:09:00.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99943581699999995 2024-09-14T09:09:00.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.858780+0000", 2024-09-14T09:09:00.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9380000000000003e-06 2024-09-14T09:09:00.086 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.086 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.086 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.087 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1099 3.1f 3.6fdfdaff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:00.087 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.859988+0000", 2024-09-14T09:09:00.087 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1798714340000001, 2024-09-14T09:09:00.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1802084269999999, 2024-09-14T09:09:00.087 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.087 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.087 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:00.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:09:00.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:00.087 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1099 2024-09-14T09:09:00.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.088 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859988+0000", 2024-09-14T09:09:00.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859988+0000", 2024-09-14T09:09:00.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859988+0000", 2024-09-14T09:09:00.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8899999999999999e-07 2024-09-14T09:09:00.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859992+0000", 2024-09-14T09:09:00.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6880000000000001e-06 2024-09-14T09:09:00.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.860001+0000", 2024-09-14T09:09:00.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2259999999999994e-06 2024-09-14T09:09:00.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.860008+0000", 2024-09-14T09:09:00.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0600000000000002e-06 2024-09-14T09:09:00.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.860261+0000", 2024-09-14T09:09:00.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00025278900000000001 2024-09-14T09:09:00.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.860270+0000", 2024-09-14T09:09:00.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6980000000000004e-06 2024-09-14T09:09:00.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.859937+0000", 2024-09-14T09:09:00.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99966702100000004 2024-09-14T09:09:00.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.859944+0000", 2024-09-14T09:09:00.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9430000000000003e-06 2024-09-14T09:09:00.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.091 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.092 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:998 3.1f 3.35d861ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:00.092 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.855015+0000", 2024-09-14T09:09:00.092 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1848441570000001, 2024-09-14T09:09:00.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1852124479999999, 2024-09-14T09:09:00.092 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.092 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.092 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:00.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:09:00.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:00.092 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 998 2024-09-14T09:09:00.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.093 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855015+0000", 2024-09-14T09:09:00.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855015+0000", 2024-09-14T09:09:00.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855016+0000", 2024-09-14T09:09:00.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9400000000000004e-07 2024-09-14T09:09:00.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855020+0000", 2024-09-14T09:09:00.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8890000000000004e-06 2024-09-14T09:09:00.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855029+0000", 2024-09-14T09:09:00.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.91e-06 2024-09-14T09:09:00.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855036+0000", 2024-09-14T09:09:00.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9070000000000001e-06 2024-09-14T09:09:00.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855088+0000", 2024-09-14T09:09:00.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1390000000000001e-05 2024-09-14T09:09:00.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:00.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855106+0000", 2024-09-14T09:09:00.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8219e-05 2024-09-14T09:09:00.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859562+0000", 2024-09-14T09:09:00.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044560959999999997 2024-09-14T09:09:00.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859570+0000", 2024-09-14T09:09:00.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2099999999999993e-06 2024-09-14T09:09:00.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.858848+0000", 2024-09-14T09:09:00.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99927776800000001 2024-09-14T09:09:00.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.858858+0000", 2024-09-14T09:09:00.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7040000000000006e-06 2024-09-14T09:09:00.097 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.097 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.097 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.097 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1100 3.1f 3.6fdfdaff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:00.097 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.860016+0000", 2024-09-14T09:09:00.097 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.179842912, 2024-09-14T09:09:00.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1802499, 2024-09-14T09:09:00.098 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.098 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.098 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:00.098 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.098 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:09:00.098 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:00.098 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1100 2024-09-14T09:09:00.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.098 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.860016+0000", 2024-09-14T09:09:00.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.860016+0000", 2024-09-14T09:09:00.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.860016+0000", 2024-09-14T09:09:00.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2024-09-14T09:09:00.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.860019+0000", 2024-09-14T09:09:00.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2290000000000002e-06 2024-09-14T09:09:00.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.860025+0000", 2024-09-14T09:09:00.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8510000000000004e-06 2024-09-14T09:09:00.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.860030+0000", 2024-09-14T09:09:00.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9520000000000002e-06 2024-09-14T09:09:00.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.860303+0000", 2024-09-14T09:09:00.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00027385099999999998 2024-09-14T09:09:00.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.860311+0000", 2024-09-14T09:09:00.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6310000000000003e-06 2024-09-14T09:09:00.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.859972+0000", 2024-09-14T09:09:00.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99966135099999998 2024-09-14T09:09:00.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.859980+0000", 2024-09-14T09:09:00.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0930000000000003e-06 2024-09-14T09:09:00.102 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.102 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.102 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.102 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1015 3.1f 3.6fdfdaff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:00.102 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.855561+0000", 2024-09-14T09:09:00.102 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.184297814, 2024-09-14T09:09:00.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1847362480000001, 2024-09-14T09:09:00.103 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.103 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.103 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:00.103 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.103 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:09:00.103 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:00.103 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1015 2024-09-14T09:09:00.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.103 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855561+0000", 2024-09-14T09:09:00.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855561+0000", 2024-09-14T09:09:00.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855562+0000", 2024-09-14T09:09:00.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6199999999999998e-07 2024-09-14T09:09:00.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855565+0000", 2024-09-14T09:09:00.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.01e-06 2024-09-14T09:09:00.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855575+0000", 2024-09-14T09:09:00.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0107e-05 2024-09-14T09:09:00.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855581+0000", 2024-09-14T09:09:00.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0050000000000001e-06 2024-09-14T09:09:00.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855841+0000", 2024-09-14T09:09:00.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00026010399999999999 2024-09-14T09:09:00.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:00.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855854+0000", 2024-09-14T09:09:00.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3158e-05 2024-09-14T09:09:00.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859605+0000", 2024-09-14T09:09:00.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037505780000000001 2024-09-14T09:09:00.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859613+0000", 2024-09-14T09:09:00.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9149999999999996e-06 2024-09-14T09:09:00.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.858885+0000", 2024-09-14T09:09:00.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99927226800000002 2024-09-14T09:09:00.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.858893+0000", 2024-09-14T09:09:00.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8250000000000005e-06 2024-09-14T09:09:00.107 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.107 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.107 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.108 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1016 3.1f 3.6fdfdaff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:00.108 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.855594+0000", 2024-09-14T09:09:00.108 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1842651499999999, 2024-09-14T09:09:00.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.184739177, 2024-09-14T09:09:00.108 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.108 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.108 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:00.108 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.108 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:09:00.108 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:00.108 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1016 2024-09-14T09:09:00.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.109 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855594+0000", 2024-09-14T09:09:00.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855594+0000", 2024-09-14T09:09:00.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855594+0000", 2024-09-14T09:09:00.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9399999999999995e-07 2024-09-14T09:09:00.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855597+0000", 2024-09-14T09:09:00.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3520000000000001e-06 2024-09-14T09:09:00.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855604+0000", 2024-09-14T09:09:00.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0090000000000001e-06 2024-09-14T09:09:00.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855609+0000", 2024-09-14T09:09:00.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.784e-06 2024-09-14T09:09:00.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855902+0000", 2024-09-14T09:09:00.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029237300000000001 2024-09-14T09:09:00.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:00.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855907+0000", 2024-09-14T09:09:00.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9280000000000001e-06 2024-09-14T09:09:00.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859643+0000", 2024-09-14T09:09:00.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037358890000000001 2024-09-14T09:09:00.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859651+0000", 2024-09-14T09:09:00.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4169999999999992e-06 2024-09-14T09:09:00.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.858915+0000", 2024-09-14T09:09:00.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99926389199999999 2024-09-14T09:09:00.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.858922+0000", 2024-09-14T09:09:00.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3860000000000001e-06 2024-09-14T09:09:00.113 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.113 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.113 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.113 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1037 3.1f 3.35d861ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:00.113 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.855617+0000", 2024-09-14T09:09:00.113 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.184242005, 2024-09-14T09:09:00.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1847517780000001, 2024-09-14T09:09:00.114 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.114 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.114 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:00.114 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.114 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:09:00.114 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:00.114 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1037 2024-09-14T09:09:00.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.114 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855617+0000", 2024-09-14T09:09:00.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855617+0000", 2024-09-14T09:09:00.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855617+0000", 2024-09-14T09:09:00.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:09:00.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855619+0000", 2024-09-14T09:09:00.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0140000000000001e-06 2024-09-14T09:09:00.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855626+0000", 2024-09-14T09:09:00.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3400000000000003e-06 2024-09-14T09:09:00.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855631+0000", 2024-09-14T09:09:00.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0050000000000004e-06 2024-09-14T09:09:00.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855939+0000", 2024-09-14T09:09:00.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030869600000000001 2024-09-14T09:09:00.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:00.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855944+0000", 2024-09-14T09:09:00.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7450000000000003e-06 2024-09-14T09:09:00.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859675+0000", 2024-09-14T09:09:00.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037305569999999998 2024-09-14T09:09:00.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859691+0000", 2024-09-14T09:09:00.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.609e-05 2024-09-14T09:09:00.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.858947+0000", 2024-09-14T09:09:00.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99925660199999999 2024-09-14T09:09:00.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.858956+0000", 2024-09-14T09:09:00.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3410000000000003e-06 2024-09-14T09:09:00.118 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.118 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.118 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.119 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1038 3.1f 3.35d861ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:00.119 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.855638+0000", 2024-09-14T09:09:00.119 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1842214360000001, 2024-09-14T09:09:00.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1847665590000001, 2024-09-14T09:09:00.119 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.119 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.119 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:00.119 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.119 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:09:00.119 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:00.119 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1038 2024-09-14T09:09:00.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.119 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855638+0000", 2024-09-14T09:09:00.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855638+0000", 2024-09-14T09:09:00.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855638+0000", 2024-09-14T09:09:00.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2100000000000002e-07 2024-09-14T09:09:00.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855640+0000", 2024-09-14T09:09:00.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0389999999999999e-06 2024-09-14T09:09:00.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855646+0000", 2024-09-14T09:09:00.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1750000000000002e-06 2024-09-14T09:09:00.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855651+0000", 2024-09-14T09:09:00.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9910000000000002e-06 2024-09-14T09:09:00.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855977+0000", 2024-09-14T09:09:00.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00032624900000000003 2024-09-14T09:09:00.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:00.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855982+0000", 2024-09-14T09:09:00.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2830000000000003e-06 2024-09-14T09:09:00.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859730+0000", 2024-09-14T09:09:00.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003748641 2024-09-14T09:09:00.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859778+0000", 2024-09-14T09:09:00.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7518999999999997e-05 2024-09-14T09:09:00.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.858980+0000", 2024-09-14T09:09:00.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99920201600000003 2024-09-14T09:09:00.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.858988+0000", 2024-09-14T09:09:00.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7149999999999998e-06 2024-09-14T09:09:00.124 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.124 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.124 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.124 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1039 3.1f 3.35d861ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:00.124 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.855658+0000", 2024-09-14T09:09:00.124 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.18420119, 2024-09-14T09:09:00.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.184781818, 2024-09-14T09:09:00.124 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.124 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.124 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:00.125 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.125 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:09:00.125 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:00.125 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1039 2024-09-14T09:09:00.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.125 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855658+0000", 2024-09-14T09:09:00.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855658+0000", 2024-09-14T09:09:00.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855658+0000", 2024-09-14T09:09:00.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4499999999999997e-07 2024-09-14T09:09:00.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855660+0000", 2024-09-14T09:09:00.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9580000000000001e-06 2024-09-14T09:09:00.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855666+0000", 2024-09-14T09:09:00.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2859999999999996e-06 2024-09-14T09:09:00.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855671+0000", 2024-09-14T09:09:00.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6149999999999999e-06 2024-09-14T09:09:00.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.856015+0000", 2024-09-14T09:09:00.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00034368499999999999 2024-09-14T09:09:00.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:00.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.856020+0000", 2024-09-14T09:09:00.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0320000000000003e-06 2024-09-14T09:09:00.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859821+0000", 2024-09-14T09:09:00.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038007539999999999 2024-09-14T09:09:00.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859828+0000", 2024-09-14T09:09:00.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7980000000000006e-06 2024-09-14T09:09:00.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.859011+0000", 2024-09-14T09:09:00.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99918282999999997 2024-09-14T09:09:00.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.859018+0000", 2024-09-14T09:09:00.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2389999999999996e-06 2024-09-14T09:09:00.129 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.129 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.129 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.129 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5117.0:1040 3.1f 3.35d861ff (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:00.129 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.855678+0000", 2024-09-14T09:09:00.130 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1841807150000001, 2024-09-14T09:09:00.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.184796789, 2024-09-14T09:09:00.130 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.130 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.130 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:00.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5117", 2024-09-14T09:09:00.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:00.130 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1040 2024-09-14T09:09:00.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.130 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855678+0000", 2024-09-14T09:09:00.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855678+0000", 2024-09-14T09:09:00.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855679+0000", 2024-09-14T09:09:00.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2100000000000002e-07 2024-09-14T09:09:00.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855681+0000", 2024-09-14T09:09:00.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0779999999999998e-06 2024-09-14T09:09:00.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855687+0000", 2024-09-14T09:09:00.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4300000000000003e-06 2024-09-14T09:09:00.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.855692+0000", 2024-09-14T09:09:00.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8550000000000001e-06 2024-09-14T09:09:00.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.856598+0000", 2024-09-14T09:09:00.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00090623099999999996 2024-09-14T09:09:00.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:00.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.856603+0000", 2024-09-14T09:09:00.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4340000000000002e-06 2024-09-14T09:09:00.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859870+0000", 2024-09-14T09:09:00.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032675180000000001 2024-09-14T09:09:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.859879+0000", 2024-09-14T09:09:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6929999999999996e-06 2024-09-14T09:09:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.859579+0000", 2024-09-14T09:09:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99970023100000005 2024-09-14T09:09:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:59.859589+0000", 2024-09-14T09:09:00.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4329999999999993e-06 2024-09-14T09:09:00.135 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.135 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.135 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.135 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.135 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-14T09:09:00.135 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 18 2024-09-14T09:09:00.135 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:00.136 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:00.137 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:00.138+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:00.237 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:00.240+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:00.252 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:09:00.279 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:00.279 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:00.279 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:00.279 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:00.279 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:00.287 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:09:00.338 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:00.340+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:00.374 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:00.375 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:00.390 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:00.391 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:00.391 INFO:teuthology.orchestra.run.smithi116.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-14T09:09:00.408 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:00.409 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:00.425 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:00.425 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:00.434 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:228 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 360448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.639255317, 2024-09-14T09:09:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99234476999999999, 2024-09-14T09:09:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 228 2024-09-14T09:09:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796906+0000", 2024-09-14T09:09:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9399999999999995e-07 2024-09-14T09:09:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796917+0000", 2024-09-14T09:09:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0801e-05 2024-09-14T09:09:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796924+0000", 2024-09-14T09:09:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7750000000000004e-06 2024-09-14T09:09:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9972000000000001e-05 2024-09-14T09:09:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798671+0000", 2024-09-14T09:09:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017271330000000001 2024-09-14T09:09:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798675+0000", 2024-09-14T09:09:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.194e-06 2024-09-14T09:09:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789003+0000", 2024-09-14T09:09:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99032768400000004 2024-09-14T09:09:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789115+0000", 2024-09-14T09:09:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112236 2024-09-14T09:09:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789250+0000", 2024-09-14T09:09:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013548100000000001 2024-09-14T09:09:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:229 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 819200~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.639203093999999, 2024-09-14T09:09:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99287024599999996, 2024-09-14T09:09:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 229 2024-09-14T09:09:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:00.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:00.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999999e-07 2024-09-14T09:09:00.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796962+0000", 2024-09-14T09:09:00.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1479999999999999e-06 2024-09-14T09:09:00.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796967+0000", 2024-09-14T09:09:00.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1499999999999998e-06 2024-09-14T09:09:00.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:09:00.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-06 2024-09-14T09:09:00.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798688+0000", 2024-09-14T09:09:00.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017172660000000001 2024-09-14T09:09:00.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798691+0000", 2024-09-14T09:09:00.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:09:00.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789599+0000", 2024-09-14T09:09:00.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99090839399999997 2024-09-14T09:09:00.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:00.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789716+0000", 2024-09-14T09:09:00.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116474 2024-09-14T09:09:00.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:00.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789828+0000", 2024-09-14T09:09:00.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112293 2024-09-14T09:09:00.445 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.445 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.445 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.445 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:230 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1277952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:00.445 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:00.445 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.639182446, 2024-09-14T09:09:00.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99307501600000003, 2024-09-14T09:09:00.446 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.446 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.446 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:00.446 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.446 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:00.446 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:00.446 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 230 2024-09-14T09:09:00.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.446 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:00.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796979+0000", 2024-09-14T09:09:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.34e-07 2024-09-14T09:09:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796980+0000", 2024-09-14T09:09:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.53e-06 2024-09-14T09:09:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796986+0000", 2024-09-14T09:09:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9989999999999997e-06 2024-09-14T09:09:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796989+0000", 2024-09-14T09:09:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0340000000000001e-06 2024-09-14T09:09:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798702+0000", 2024-09-14T09:09:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001712756 2024-09-14T09:09:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798705+0000", 2024-09-14T09:09:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7750000000000001e-06 2024-09-14T09:09:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789870+0000", 2024-09-14T09:09:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991165026 2024-09-14T09:09:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789955+0000", 2024-09-14T09:09:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4839999999999994e-05 2024-09-14T09:09:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790053+0000", 2024-09-14T09:09:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8721999999999994e-05 2024-09-14T09:09:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:231 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.639167118, 2024-09-14T09:09:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99319130300000003, 2024-09-14T09:09:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 231 2024-09-14T09:09:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2024-09-14T09:09:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796995+0000", 2024-09-14T09:09:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2500000000000001e-06 2024-09-14T09:09:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796998+0000", 2024-09-14T09:09:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3230000000000002e-06 2024-09-14T09:09:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797001+0000", 2024-09-14T09:09:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7099999999999999e-06 2024-09-14T09:09:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798718+0000", 2024-09-14T09:09:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017168070000000001 2024-09-14T09:09:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798721+0000", 2024-09-14T09:09:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.853e-06 2024-09-14T09:09:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790077+0000", 2024-09-14T09:09:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991356393 2024-09-14T09:09:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790129+0000", 2024-09-14T09:09:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2240999999999997e-05 2024-09-14T09:09:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790185+0000", 2024-09-14T09:09:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5515e-05 2024-09-14T09:09:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:232 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2195456~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.639156461999999, 2024-09-14T09:09:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99329117899999997, 2024-09-14T09:09:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 232 2024-09-14T09:09:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:00.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:00.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797005+0000", 2024-09-14T09:09:00.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2024-09-14T09:09:00.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797006+0000", 2024-09-14T09:09:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3200000000000001e-06 2024-09-14T09:09:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797009+0000", 2024-09-14T09:09:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4680000000000001e-06 2024-09-14T09:09:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797012+0000", 2024-09-14T09:09:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4770000000000002e-06 2024-09-14T09:09:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798743+0000", 2024-09-14T09:09:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017312 2024-09-14T09:09:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798747+0000", 2024-09-14T09:09:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.484e-06 2024-09-14T09:09:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790201+0000", 2024-09-14T09:09:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99145419499999998 2024-09-14T09:09:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790241+0000", 2024-09-14T09:09:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0587999999999998e-05 2024-09-14T09:09:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790296+0000", 2024-09-14T09:09:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4212000000000002e-05 2024-09-14T09:09:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:233 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2654208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.639145839000001, 2024-09-14T09:09:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99337220100000001, 2024-09-14T09:09:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 233 2024-09-14T09:09:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:09:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:09:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.269e-06 2024-09-14T09:09:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797019+0000", 2024-09-14T09:09:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9519999999999999e-06 2024-09-14T09:09:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797022+0000", 2024-09-14T09:09:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6079999999999998e-06 2024-09-14T09:09:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798759+0000", 2024-09-14T09:09:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001737342 2024-09-14T09:09:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798762+0000", 2024-09-14T09:09:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:09:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790310+0000", 2024-09-14T09:09:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99154738799999997 2024-09-14T09:09:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790349+0000", 2024-09-14T09:09:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9573000000000002e-05 2024-09-14T09:09:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790387+0000", 2024-09-14T09:09:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7985999999999998e-05 2024-09-14T09:09:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:234 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3112960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.639135794000001, 2024-09-14T09:09:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99345674500000003, 2024-09-14T09:09:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 234 2024-09-14T09:09:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0100000000000001e-07 2024-09-14T09:09:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0699999999999999e-06 2024-09-14T09:09:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:09:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.886e-06 2024-09-14T09:09:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797032+0000", 2024-09-14T09:09:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7149999999999998e-06 2024-09-14T09:09:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798778+0000", 2024-09-14T09:09:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017460329999999999 2024-09-14T09:09:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798783+0000", 2024-09-14T09:09:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0760000000000002e-06 2024-09-14T09:09:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790408+0000", 2024-09-14T09:09:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99162473299999998 2024-09-14T09:09:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790446+0000", 2024-09-14T09:09:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8389000000000001e-05 2024-09-14T09:09:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790482+0000", 2024-09-14T09:09:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5642000000000002e-05 2024-09-14T09:09:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:235 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3571712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.639125895999999, 2024-09-14T09:09:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993539477, 2024-09-14T09:09:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 235 2024-09-14T09:09:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9999999999999999e-07 2024-09-14T09:09:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797036+0000", 2024-09-14T09:09:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.051e-06 2024-09-14T09:09:00.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797039+0000", 2024-09-14T09:09:00.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:09:00.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797042+0000", 2024-09-14T09:09:00.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5280000000000002e-06 2024-09-14T09:09:00.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798809+0000", 2024-09-14T09:09:00.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001767394 2024-09-14T09:09:00.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798815+0000", 2024-09-14T09:09:00.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0859999999999998e-06 2024-09-14T09:09:00.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790502+0000", 2024-09-14T09:09:00.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99168652300000004 2024-09-14T09:09:00.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:00.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790539+0000", 2024-09-14T09:09:00.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7471000000000001e-05 2024-09-14T09:09:00.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:00.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790574+0000", 2024-09-14T09:09:00.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5292e-05 2024-09-14T09:09:00.479 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.479 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.479 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.479 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:236 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 4030464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:00.479 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:00.479 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.639115662999998, 2024-09-14T09:09:00.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993619743, 2024-09-14T09:09:00.480 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.480 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.480 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:00.480 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.480 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:00.480 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:00.480 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 236 2024-09-14T09:09:00.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.480 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:00.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:00.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:00.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1400000000000001e-07 2024-09-14T09:09:00.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797047+0000", 2024-09-14T09:09:00.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3400000000000001e-06 2024-09-14T09:09:00.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:09:00.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0699999999999998e-06 2024-09-14T09:09:00.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797053+0000", 2024-09-14T09:09:00.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7310000000000002e-06 2024-09-14T09:09:00.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798839+0000", 2024-09-14T09:09:00.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001786403 2024-09-14T09:09:00.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798844+0000", 2024-09-14T09:09:00.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3730000000000001e-06 2024-09-14T09:09:00.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790592+0000", 2024-09-14T09:09:00.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99174818099999995 2024-09-14T09:09:00.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:00.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790628+0000", 2024-09-14T09:09:00.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5831000000000003e-05 2024-09-14T09:09:00.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:00.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790665+0000", 2024-09-14T09:09:00.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-05 2024-09-14T09:09:00.484 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.484 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.484 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.484 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:365 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:00.485 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:00.485 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.636928635, 2024-09-14T09:09:00.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157278400000004, 2024-09-14T09:09:00.485 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.485 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.485 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:00.485 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.485 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:00.485 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:00.485 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 365 2024-09-14T09:09:00.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.485 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:00.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:00.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:00.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:09:00.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799233+0000", 2024-09-14T09:09:00.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.057e-06 2024-09-14T09:09:00.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799236+0000", 2024-09-14T09:09:00.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0249999999999998e-06 2024-09-14T09:09:00.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799239+0000", 2024-09-14T09:09:00.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.481e-06 2024-09-14T09:09:00.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800963+0000", 2024-09-14T09:09:00.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017240440000000001 2024-09-14T09:09:00.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800969+0000", 2024-09-14T09:09:00.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1410000000000002e-06 2024-09-14T09:09:00.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790682+0000", 2024-09-14T09:09:00.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98971330300000004 2024-09-14T09:09:00.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:00.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790753+0000", 2024-09-14T09:09:00.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0548000000000003e-05 2024-09-14T09:09:00.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:00.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790805+0000", 2024-09-14T09:09:00.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1981999999999998e-05 2024-09-14T09:09:00.489 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.489 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.489 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.490 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:366 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:00.490 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:00.490 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.636918542, 2024-09-14T09:09:00.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99173757299999998, 2024-09-14T09:09:00.490 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.490 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.490 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:00.490 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.490 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:00.490 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:00.490 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 366 2024-09-14T09:09:00.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.490 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:00.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:00.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:00.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-07 2024-09-14T09:09:00.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799244+0000", 2024-09-14T09:09:00.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.359e-06 2024-09-14T09:09:00.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799247+0000", 2024-09-14T09:09:00.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4929999999999998e-06 2024-09-14T09:09:00.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799250+0000", 2024-09-14T09:09:00.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:09:00.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800991+0000", 2024-09-14T09:09:00.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017412809999999999 2024-09-14T09:09:00.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800997+0000", 2024-09-14T09:09:00.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:09:00.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790824+0000", 2024-09-14T09:09:00.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98982735399999999 2024-09-14T09:09:00.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:00.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790891+0000", 2024-09-14T09:09:00.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7243999999999995e-05 2024-09-14T09:09:00.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:00.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790980+0000", 2024-09-14T09:09:00.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8608000000000003e-05 2024-09-14T09:09:00.494 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.494 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.494 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.495 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:367 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:00.495 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:00.495 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.636907170000001, 2024-09-14T09:09:00.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99188259999999995, 2024-09-14T09:09:00.495 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.495 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.495 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:00.495 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.495 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:00.495 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:00.495 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 367 2024-09-14T09:09:00.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.496 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:00.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:00.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:00.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-07 2024-09-14T09:09:00.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799255+0000", 2024-09-14T09:09:00.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.111e-06 2024-09-14T09:09:00.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799259+0000", 2024-09-14T09:09:00.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8650000000000003e-06 2024-09-14T09:09:00.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799262+0000", 2024-09-14T09:09:00.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.128e-06 2024-09-14T09:09:00.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801029+0000", 2024-09-14T09:09:00.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017668460000000001 2024-09-14T09:09:00.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801032+0000", 2024-09-14T09:09:00.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3179999999999998e-06 2024-09-14T09:09:00.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791011+0000", 2024-09-14T09:09:00.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98997920399999995 2024-09-14T09:09:00.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:00.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791077+0000", 2024-09-14T09:09:00.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5214000000000003e-05 2024-09-14T09:09:00.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:00.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791136+0000", 2024-09-14T09:09:00.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9710000000000003e-05 2024-09-14T09:09:00.499 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.500 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.500 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.500 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:368 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:00.500 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:00.500 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.636895627000001, 2024-09-14T09:09:00.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99201753800000003, 2024-09-14T09:09:00.500 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.500 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.500 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:00.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:00.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:00.501 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 368 2024-09-14T09:09:00.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.501 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:00.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:00.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:00.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4900000000000002e-07 2024-09-14T09:09:00.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799267+0000", 2024-09-14T09:09:00.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.079e-06 2024-09-14T09:09:00.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799270+0000", 2024-09-14T09:09:00.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.993e-06 2024-09-14T09:09:00.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799272+0000", 2024-09-14T09:09:00.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.695e-06 2024-09-14T09:09:00.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801043+0000", 2024-09-14T09:09:00.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001771105 2024-09-14T09:09:00.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801046+0000", 2024-09-14T09:09:00.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7999999999999999e-06 2024-09-14T09:09:00.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791150+0000", 2024-09-14T09:09:00.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99010348699999995 2024-09-14T09:09:00.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:00.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791193+0000", 2024-09-14T09:09:00.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3615999999999997e-05 2024-09-14T09:09:00.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:00.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791283+0000", 2024-09-14T09:09:00.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9513999999999997e-05 2024-09-14T09:09:00.505 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.505 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.505 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.505 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:369 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:00.505 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:00.505 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.636885288999999, 2024-09-14T09:09:00.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99213433600000001, 2024-09-14T09:09:00.505 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.505 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.505 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:00.506 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.506 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:00.506 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:00.506 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 369 2024-09-14T09:09:00.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.506 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:00.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:00.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:00.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:09:00.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799277+0000", 2024-09-14T09:09:00.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.108e-06 2024-09-14T09:09:00.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799280+0000", 2024-09-14T09:09:00.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:09:00.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799283+0000", 2024-09-14T09:09:00.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.531e-06 2024-09-14T09:09:00.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801058+0000", 2024-09-14T09:09:00.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001775085 2024-09-14T09:09:00.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801060+0000", 2024-09-14T09:09:00.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8260000000000001e-06 2024-09-14T09:09:00.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791299+0000", 2024-09-14T09:09:00.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99023856799999999 2024-09-14T09:09:00.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:00.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791352+0000", 2024-09-14T09:09:00.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2528000000000003e-05 2024-09-14T09:09:00.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:00.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791410+0000", 2024-09-14T09:09:00.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8298000000000003e-05 2024-09-14T09:09:00.510 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.510 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.510 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.510 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:370 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2457600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:00.510 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:00.510 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.636860521999999, 2024-09-14T09:09:00.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99220795399999995, 2024-09-14T09:09:00.510 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.511 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.511 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:00.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:00.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:00.511 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 370 2024-09-14T09:09:00.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.511 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:00.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:00.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799301+0000", 2024-09-14T09:09:00.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2024-09-14T09:09:00.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799303+0000", 2024-09-14T09:09:00.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9319999999999999e-06 2024-09-14T09:09:00.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799310+0000", 2024-09-14T09:09:00.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8680000000000001e-06 2024-09-14T09:09:00.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799315+0000", 2024-09-14T09:09:00.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.921e-06 2024-09-14T09:09:00.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801071+0000", 2024-09-14T09:09:00.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001756678 2024-09-14T09:09:00.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801080+0000", 2024-09-14T09:09:00.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6060000000000003e-06 2024-09-14T09:09:00.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791429+0000", 2024-09-14T09:09:00.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99034944599999997 2024-09-14T09:09:00.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:00.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791471+0000", 2024-09-14T09:09:00.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1279999999999998e-05 2024-09-14T09:09:00.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:00.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791508+0000", 2024-09-14T09:09:00.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7663999999999997e-05 2024-09-14T09:09:00.515 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.515 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.515 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.515 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:371 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2916352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:00.515 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:00.515 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.636839349999999, 2024-09-14T09:09:00.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99228692299999999, 2024-09-14T09:09:00.516 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.516 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.516 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:00.516 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.516 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:00.516 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:00.516 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 371 2024-09-14T09:09:00.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.516 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:00.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:00.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799322+0000", 2024-09-14T09:09:00.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:09:00.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799333+0000", 2024-09-14T09:09:00.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1044e-05 2024-09-14T09:09:00.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799341+0000", 2024-09-14T09:09:00.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8439999999999998e-06 2024-09-14T09:09:00.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799354+0000", 2024-09-14T09:09:00.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3114e-05 2024-09-14T09:09:00.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801093+0000", 2024-09-14T09:09:00.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017385910000000001 2024-09-14T09:09:00.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801096+0000", 2024-09-14T09:09:00.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0680000000000001e-06 2024-09-14T09:09:00.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791528+0000", 2024-09-14T09:09:00.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99043264200000003 2024-09-14T09:09:00.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:00.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791570+0000", 2024-09-14T09:09:00.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2144999999999997e-05 2024-09-14T09:09:00.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:00.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791608+0000", 2024-09-14T09:09:00.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7966000000000002e-05 2024-09-14T09:09:00.520 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.520 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.520 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.520 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:372 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3375104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:00.520 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:00.521 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.636798802000001, 2024-09-14T09:09:00.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992342897, 2024-09-14T09:09:00.521 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.521 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.521 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:00.521 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.521 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:00.521 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:00.521 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 372 2024-09-14T09:09:00.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.521 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:00.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:00.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799363+0000", 2024-09-14T09:09:00.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2024-09-14T09:09:00.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799365+0000", 2024-09-14T09:09:00.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5500000000000001e-06 2024-09-14T09:09:00.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799371+0000", 2024-09-14T09:09:00.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2500000000000003e-06 2024-09-14T09:09:00.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799377+0000", 2024-09-14T09:09:00.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7509999999999997e-06 2024-09-14T09:09:00.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801107+0000", 2024-09-14T09:09:00.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017298019999999999 2024-09-14T09:09:00.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801111+0000", 2024-09-14T09:09:00.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8619999999999996e-06 2024-09-14T09:09:00.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791626+0000", 2024-09-14T09:09:00.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99051563300000001 2024-09-14T09:09:00.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:00.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791668+0000", 2024-09-14T09:09:00.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1424000000000002e-05 2024-09-14T09:09:00.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:00.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791705+0000", 2024-09-14T09:09:00.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7035e-05 2024-09-14T09:09:00.525 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.525 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.525 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.526 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:373 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:00.526 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:00.526 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.636776857000001, 2024-09-14T09:09:00.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99253589399999997, 2024-09-14T09:09:00.526 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.526 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.526 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:00.526 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.526 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:00.526 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:00.526 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 373 2024-09-14T09:09:00.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.526 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:00.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:00.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:00.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2024-09-14T09:09:00.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799387+0000", 2024-09-14T09:09:00.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1019999999999999e-06 2024-09-14T09:09:00.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799393+0000", 2024-09-14T09:09:00.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0190000000000003e-06 2024-09-14T09:09:00.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799398+0000", 2024-09-14T09:09:00.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:09:00.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801123+0000", 2024-09-14T09:09:00.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017251949999999999 2024-09-14T09:09:00.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:00.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801126+0000", 2024-09-14T09:09:00.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9280000000000002e-06 2024-09-14T09:09:00.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791746+0000", 2024-09-14T09:09:00.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99062036899999995 2024-09-14T09:09:00.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:00.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791835+0000", 2024-09-14T09:09:00.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9004000000000004e-05 2024-09-14T09:09:00.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:00.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791920+0000", 2024-09-14T09:09:00.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4524000000000006e-05 2024-09-14T09:09:00.530 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.530 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.530 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.531 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:10395 3.17 3:e9053d87:::rbd_data.111228c3791c.0000000000000006:18 [read 962560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:00.531 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.797914+0000", 2024-09-14T09:09:00.531 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.638246957, 2024-09-14T09:09:00.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034376019000000001, 2024-09-14T09:09:00.531 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.531 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.531 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:00.531 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.531 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:00.531 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:00.531 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10395 2024-09-14T09:09:00.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.531 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.797914+0000", 2024-09-14T09:09:00.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.797914+0000", 2024-09-14T09:09:00.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798042+0000", 2024-09-14T09:09:00.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012855399999999999 2024-09-14T09:09:00.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798044+0000", 2024-09-14T09:09:00.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.086e-06 2024-09-14T09:09:00.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798049+0000", 2024-09-14T09:09:00.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7770000000000002e-06 2024-09-14T09:09:00.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798066+0000", 2024-09-14T09:09:00.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6405999999999998e-05 2024-09-14T09:09:00.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832200+0000", 2024-09-14T09:09:00.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034134022 2024-09-14T09:09:00.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:00.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832241+0000", 2024-09-14T09:09:00.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1566999999999997e-05 2024-09-14T09:09:00.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:00.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832290+0000", 2024-09-14T09:09:00.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8606999999999997e-05 2024-09-14T09:09:00.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.535 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.535 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:10397 3.17 3:e9053d87:::rbd_data.111228c3791c.0000000000000006:18 [read 1085440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:00.535 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.798088+0000", 2024-09-14T09:09:00.535 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.638073043999999, 2024-09-14T09:09:00.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034429187, 2024-09-14T09:09:00.535 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:00.535 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:00.535 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:00.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:00.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:00.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:00.536 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10397 2024-09-14T09:09:00.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.536 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:00.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:00.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798088+0000", 2024-09-14T09:09:00.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:00.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798088+0000", 2024-09-14T09:09:00.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:00.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:00.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803904+0000", 2024-09-14T09:09:00.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058164799999999997 2024-09-14T09:09:00.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:00.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803908+0000", 2024-09-14T09:09:00.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8580000000000002e-06 2024-09-14T09:09:00.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:00.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803918+0000", 2024-09-14T09:09:00.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4939999999999992e-06 2024-09-14T09:09:00.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:00.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803923+0000", 2024-09-14T09:09:00.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2599999999999996e-06 2024-09-14T09:09:00.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:00.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832428+0000", 2024-09-14T09:09:00.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.028504788 2024-09-14T09:09:00.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:00.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832470+0000", 2024-09-14T09:09:00.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2358999999999999e-05 2024-09-14T09:09:00.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:00.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:00.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:00.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832517+0000", 2024-09-14T09:09:00.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6947999999999998e-05 2024-09-14T09:09:00.539 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.539 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.539 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.539 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:00.539 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:00.539 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:00.540 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:00.541 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T09:09:00.542 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:09:00.542 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:00.543 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T09:09:00.543 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:00.543+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:00.642 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:00.644+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:00.686 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:00.686 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:00.694 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:09:00.744 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:00.745+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:00.796 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:00.796 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:00.804 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:09:00.849 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:00.851+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:00.928 INFO:teuthology.orchestra.run.smithi148.stdout:4386 punch from 0x1601e00 to 0x1603000, (0x1200 bytes) 2024-09-14T09:09:00.930 INFO:teuthology.orchestra.run.smithi148.stdout:4387 punch from 0x3ca1a00 to 0x3cabc00, (0xa200 bytes) 2024-09-14T09:09:00.930 INFO:teuthology.orchestra.run.smithi148.stdout:4388 read 0x789a00 thru 0x790470 (0x6a71 bytes) 2024-09-14T09:09:00.930 INFO:teuthology.orchestra.run.smithi148.stdout:skipping zero length punch hole 2024-09-14T09:09:00.930 INFO:teuthology.orchestra.run.smithi148.stdout:4392 read 0x3608000 thru 0x3609308 (0x1309 bytes) 2024-09-14T09:09:00.930 INFO:teuthology.orchestra.run.smithi148.stdout:4393 read 0xe84800 thru 0xe8c6b4 (0x7eb5 bytes) 2024-09-14T09:09:00.931 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:00.931 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:00.937 INFO:teuthology.orchestra.run.smithi148.stdout:4396 trunc from 0x4940c00 to 0x1aa8200 2024-09-14T09:09:00.941 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:09:00.960 INFO:teuthology.orchestra.run.smithi148.stdout:4399 trunc from 0x1aa8200 to 0x2ed8c00 2024-09-14T09:09:00.969 INFO:teuthology.orchestra.run.smithi148.stdout:4401 read 0x1b23c00 thru 0x1b24982 (0xd83 bytes) 2024-09-14T09:09:00.970 INFO:teuthology.orchestra.run.smithi148.stdout:4404 punch from 0x1f2600 to 0x201c00, (0xf600 bytes) 2024-09-14T09:09:00.974 INFO:teuthology.orchestra.run.smithi148.stdout:4407 read 0x2733800 thru 0x2742a09 (0xf20a bytes) 2024-09-14T09:09:00.978 INFO:teuthology.orchestra.run.smithi148.stdout:4409 trunc from 0x2ed8c00 to 0x7bb400 2024-09-14T09:09:00.982 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:00.984+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:01.045 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:01.048+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:01.088 INFO:teuthology.orchestra.run.smithi148.stdout:4410 write 0x3d5e800 thru 0x3d64bf5 (0x63f6 bytes) 2024-09-14T09:09:01.097 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:01.097 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:01.100 INFO:teuthology.orchestra.run.smithi148.stdout:4411 trunc from 0x3d64c00 to 0xc60d600 2024-09-14T09:09:01.107 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:09:01.118 INFO:teuthology.orchestra.run.smithi148.stdout:4412 punch from 0xa443a00 to 0xa449200, (0x5800 bytes) 2024-09-14T09:09:01.119 INFO:teuthology.orchestra.run.smithi148.stdout:4413 write 0x190e00 thru 0x19e47d (0xd67e bytes) 2024-09-14T09:09:01.123 INFO:teuthology.orchestra.run.smithi148.stdout:4415 trunc from 0xc60d600 to 0xeacfc00 2024-09-14T09:09:01.137 INFO:teuthology.orchestra.run.smithi148.stdout:4417 punch from 0xb410000 to 0xb417800, (0x7800 bytes) 2024-09-14T09:09:01.141 INFO:teuthology.orchestra.run.smithi148.stdout:4419 trunc from 0xeacfc00 to 0xbe52800 2024-09-14T09:09:01.146 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:01.149+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:01.156 INFO:teuthology.orchestra.run.smithi148.stdout:4420 trunc from 0xbe52800 to 0x7858400 2024-09-14T09:09:01.174 INFO:teuthology.orchestra.run.smithi148.stdout:4423 read 0x450c800 thru 0x451295a (0x615b bytes) 2024-09-14T09:09:01.175 INFO:teuthology.orchestra.run.smithi148.stdout:4426 read 0x295fe00 thru 0x296cb9e (0xcd9f bytes) 2024-09-14T09:09:01.175 INFO:teuthology.orchestra.run.smithi148.stdout:4427 read 0xbe8a00 thru 0xbeadc4 (0x23c5 bytes) 2024-09-14T09:09:01.180 INFO:teuthology.orchestra.run.smithi148.stdout:4430 write 0x6df6000 thru 0x6df9b54 (0x3b55 bytes) 2024-09-14T09:09:01.200 INFO:teuthology.orchestra.run.smithi148.stdout:4431 write 0xa558800 thru 0xa560201 (0x7a02 bytes) 2024-09-14T09:09:01.211 INFO:teuthology.orchestra.run.smithi148.stdout:4432 trunc from 0xa560400 to 0x21a0e00 2024-09-14T09:09:01.219 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:01.219 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:01.230 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:09:01.248 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:01.250+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:01.248 INFO:teuthology.orchestra.run.smithi148.stdout:4436 trunc from 0x21a0e00 to 0xeb5d400 2024-09-14T09:09:01.273 INFO:teuthology.orchestra.run.smithi148.stdout:4439 trunc from 0xeb5d400 to 0x1305a00 2024-09-14T09:09:01.308 INFO:teuthology.orchestra.run.smithi148.stdout:4442 trunc from 0x1305a00 to 0xd062400 2024-09-14T09:09:01.317 INFO:teuthology.orchestra.run.smithi148.stdout:4443 write 0x8886000 thru 0x8888c73 (0x2c74 bytes) 2024-09-14T09:09:01.317 INFO:teuthology.orchestra.run.smithi148.stdout:4444 punch from 0x4f53000 to 0x4f53a00, (0xa00 bytes) 2024-09-14T09:09:01.318 INFO:teuthology.orchestra.run.smithi148.stdout:4445 write 0x8842000 thru 0x884b3ff (0x9400 bytes) 2024-09-14T09:09:01.318 INFO:teuthology.orchestra.run.smithi148.stdout:4446 punch from 0x655a600 to 0x6568800, (0xe200 bytes) 2024-09-14T09:09:01.319 INFO:teuthology.orchestra.run.smithi148.stdout:4448 write 0x873ec00 thru 0x87441d2 (0x55d3 bytes) 2024-09-14T09:09:01.319 INFO:teuthology.orchestra.run.smithi148.stdout:4458 punch from 0x1250400 to 0x125fa00, (0xf600 bytes) 2024-09-14T09:09:01.319 INFO:teuthology.orchestra.run.smithi148.stdout:4461 write 0x91a400 thru 0x92539b (0xaf9c bytes) 2024-09-14T09:09:01.330 INFO:teuthology.orchestra.run.smithi148.stdout:4462 write 0x9ebd800 thru 0x9ebd8de (0xdf bytes) 2024-09-14T09:09:01.330 INFO:teuthology.orchestra.run.smithi148.stdout:4463 read 0xb0600 thru 0xbedec (0xe7ed bytes) 2024-09-14T09:09:01.333 INFO:teuthology.orchestra.run.smithi148.stdout:4465 read 0x9ebfe00 thru 0x9ec141b (0x161c bytes) 2024-09-14T09:09:01.334 INFO:teuthology.orchestra.run.smithi148.stdout:4466 punch from 0xc2cfe00 to 0xc2d3400, (0x3600 bytes) 2024-09-14T09:09:01.334 INFO:teuthology.orchestra.run.smithi148.stdout:4467 read 0xcce5000 thru 0xccec6f9 (0x76fa bytes) 2024-09-14T09:09:01.334 INFO:teuthology.orchestra.run.smithi148.stdout:4473 read 0x599c400 thru 0x59a9814 (0xd415 bytes) 2024-09-14T09:09:01.341 INFO:teuthology.orchestra.run.smithi148.stdout:4474 trunc from 0xd062400 to 0x6f9e800 2024-09-14T09:09:01.348 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:01.351+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:01.354 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:01.354 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:01.361 INFO:teuthology.orchestra.run.smithi148.stdout:4475 punch from 0x33ad400 to 0x33bc800, (0xf400 bytes) 2024-09-14T09:09:01.361 INFO:teuthology.orchestra.run.smithi148.stdout:4477 read 0x1f20c00 thru 0x1f29081 (0x8482 bytes) 2024-09-14T09:09:01.361 INFO:teuthology.orchestra.run.smithi148.stdout:4480 read 0x598b000 thru 0x5991ae1 (0x6ae2 bytes) 2024-09-14T09:09:01.361 INFO:teuthology.orchestra.run.smithi148.stdout:4482 read 0x709600 thru 0x7184d5 (0xeed6 bytes) 2024-09-14T09:09:01.365 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:09:01.366 INFO:teuthology.orchestra.run.smithi148.stdout:4485 trunc from 0x6f9e800 to 0x352ac00 2024-09-14T09:09:01.400 INFO:teuthology.orchestra.run.smithi148.stdout:4490 read 0x1c9b600 thru 0x1ca44ac (0x8ead bytes) 2024-09-14T09:09:01.401 INFO:teuthology.orchestra.run.smithi148.stdout:4491 read 0x1b1fc00 thru 0x1b2c461 (0xc862 bytes) 2024-09-14T09:09:01.405 INFO:teuthology.orchestra.run.smithi148.stdout:4493 trunc from 0x352ac00 to 0x7b9fc00 2024-09-14T09:09:01.422 INFO:teuthology.orchestra.run.smithi148.stdout:4495 read 0x14af600 thru 0x14b38b9 (0x42ba bytes) 2024-09-14T09:09:01.430 INFO:teuthology.orchestra.run.smithi148.stdout:4497 trunc from 0x7b9fc00 to 0x1063e00 2024-09-14T09:09:01.449 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:01.451+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:01.456 INFO:teuthology.orchestra.run.smithi148.stdout:4498 read 0x141600 thru 0x1474b6 (0x5eb7 bytes) 2024-09-14T09:09:01.457 INFO:teuthology.orchestra.run.smithi148.stdout:4500 read 0x178a00 thru 0x17b94b (0x2f4c bytes) 2024-09-14T09:09:01.458 INFO:teuthology.orchestra.run.smithi148.stdout:4501 read 0xc36c00 thru 0xc3bdfe (0x51ff bytes) 2024-09-14T09:09:01.468 INFO:teuthology.orchestra.run.smithi148.stdout:4503 trunc from 0x1063e00 to 0x9dd7c00 2024-09-14T09:09:01.494 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:01.494 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:01.502 INFO:teuthology.orchestra.run.smithi148.stdout:4504 write 0xe512400 thru 0xe514a91 (0x2692 bytes) 2024-09-14T09:09:01.504 INFO:teuthology.orchestra.run.smithi148.stdout:4507 write 0x529400 thru 0x531c83 (0x8884 bytes) 2024-09-14T09:09:01.505 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:09:01.505 INFO:teuthology.orchestra.run.smithi148.stdout:4509 read 0x6365a00 thru 0x636b9a1 (0x5fa2 bytes) 2024-09-14T09:09:01.517 INFO:teuthology.orchestra.run.smithi148.stdout:4510 trunc from 0xe514c00 to 0x39d3e00 2024-09-14T09:09:01.550 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:01.552+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:01.559 INFO:teuthology.orchestra.run.smithi148.stdout:4511 read 0x1487400 thru 0x148dc3a (0x683b bytes) 2024-09-14T09:09:01.560 INFO:teuthology.orchestra.run.smithi148.stdout:4512 read 0x5fc600 thru 0x5fea20 (0x2421 bytes) 2024-09-14T09:09:01.560 INFO:teuthology.orchestra.run.smithi148.stdout:4513 write 0x335a600 thru 0x336a3dd (0xfdde bytes) 2024-09-14T09:09:01.583 INFO:teuthology.orchestra.run.smithi148.stdout:4517 write 0x618be00 thru 0x619364c (0x784d bytes) 2024-09-14T09:09:01.589 INFO:teuthology.orchestra.run.smithi148.stdout:4518 trunc from 0x6193800 to 0xa703200 2024-09-14T09:09:01.623 INFO:teuthology.orchestra.run.smithi148.stdout:4519 write 0xec41c00 thru 0xec43b1d (0x1f1e bytes) 2024-09-14T09:09:01.627 INFO:teuthology.orchestra.run.smithi148.stdout:4520 trunc from 0xec43c00 to 0xbfdf800 2024-09-14T09:09:01.644 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:01.644 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:01.646 INFO:teuthology.orchestra.run.smithi148.stdout:4522 read 0x9150a00 thru 0x915ca79 (0xc07a bytes) 2024-09-14T09:09:01.650 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:01.652+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:01.654 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:09:01.660 INFO:teuthology.orchestra.run.smithi148.stdout:4523 trunc from 0xbfdf800 to 0x1465c00 2024-09-14T09:09:01.680 INFO:teuthology.orchestra.run.smithi148.stdout:4524 read 0x6d3600 thru 0x6e332e (0xfd2f bytes) 2024-09-14T09:09:01.693 INFO:teuthology.orchestra.run.smithi148.stdout:4526 trunc from 0x1465c00 to 0x891a800 2024-09-14T09:09:01.703 INFO:teuthology.orchestra.run.smithi148.stdout:4527 write 0x6e31800 thru 0x6e3f301 (0xdb02 bytes) 2024-09-14T09:09:01.728 INFO:teuthology.orchestra.run.smithi148.stdout:4531 write 0xdd24400 thru 0xdd28ea7 (0x4aa8 bytes) 2024-09-14T09:09:01.729 INFO:teuthology.orchestra.run.smithi148.stdout:4532 write 0x71b8200 thru 0x71c06b0 (0x84b1 bytes) 2024-09-14T09:09:01.729 INFO:teuthology.orchestra.run.smithi148.stdout:4535 read 0xc69e00 thru 0xc7575f (0xb960 bytes) 2024-09-14T09:09:01.745 INFO:teuthology.orchestra.run.smithi148.stdout:4536 trunc from 0xdd29000 to 0x31f600 2024-09-14T09:09:01.751 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:01.754+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:01.808 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:01.808 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:01.819 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:09:01.852 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:01.854+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:01.895 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T09:09:01.953 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:01.956+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:01.969 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:01.969 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:01.978 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:09:02.063 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:02.065+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:02.126 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:02.126 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:02.135 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:09:02.155 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:02.157+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:02.256 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:02.258+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:02.289 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:02.289 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:02.300 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:09:02.386 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:02.388+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:02.456 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:02.456 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:02.457 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:02.459+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:02.465 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:02.544 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:09:02.558 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:02.560+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:02.614 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:02.614 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:02.622 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:09:02.664 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:02.666+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:02.665 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:02.666 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:02.681 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:02.682 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:02.682 INFO:teuthology.orchestra.run.smithi116.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-14T09:09:02.699 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:02.699 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:02.716 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:02.717 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:02.733 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:02.733 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:02.736 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T09:09:02.737 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T09:09:02.759 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:02.761+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:02.769 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:02.769 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:02.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:02.769 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:228 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 360448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.973818023, 2024-09-14T09:09:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99234476999999999, 2024-09-14T09:09:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 228 2024-09-14T09:09:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796906+0000", 2024-09-14T09:09:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9399999999999995e-07 2024-09-14T09:09:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796917+0000", 2024-09-14T09:09:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0801e-05 2024-09-14T09:09:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796924+0000", 2024-09-14T09:09:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7750000000000004e-06 2024-09-14T09:09:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9972000000000001e-05 2024-09-14T09:09:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798671+0000", 2024-09-14T09:09:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017271330000000001 2024-09-14T09:09:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798675+0000", 2024-09-14T09:09:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.194e-06 2024-09-14T09:09:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789003+0000", 2024-09-14T09:09:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99032768400000004 2024-09-14T09:09:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789115+0000", 2024-09-14T09:09:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112236 2024-09-14T09:09:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789250+0000", 2024-09-14T09:09:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013548100000000001 2024-09-14T09:09:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:229 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 819200~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.973765799999999, 2024-09-14T09:09:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99287024599999996, 2024-09-14T09:09:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 229 2024-09-14T09:09:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999999e-07 2024-09-14T09:09:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796962+0000", 2024-09-14T09:09:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1479999999999999e-06 2024-09-14T09:09:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796967+0000", 2024-09-14T09:09:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1499999999999998e-06 2024-09-14T09:09:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:09:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-06 2024-09-14T09:09:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798688+0000", 2024-09-14T09:09:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017172660000000001 2024-09-14T09:09:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798691+0000", 2024-09-14T09:09:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:09:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789599+0000", 2024-09-14T09:09:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99090839399999997 2024-09-14T09:09:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789716+0000", 2024-09-14T09:09:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116474 2024-09-14T09:09:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789828+0000", 2024-09-14T09:09:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112293 2024-09-14T09:09:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:230 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1277952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.973745151999999, 2024-09-14T09:09:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99307501600000003, 2024-09-14T09:09:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 230 2024-09-14T09:09:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796979+0000", 2024-09-14T09:09:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.34e-07 2024-09-14T09:09:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796980+0000", 2024-09-14T09:09:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.53e-06 2024-09-14T09:09:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796986+0000", 2024-09-14T09:09:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9989999999999997e-06 2024-09-14T09:09:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796989+0000", 2024-09-14T09:09:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0340000000000001e-06 2024-09-14T09:09:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798702+0000", 2024-09-14T09:09:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001712756 2024-09-14T09:09:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798705+0000", 2024-09-14T09:09:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7750000000000001e-06 2024-09-14T09:09:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789870+0000", 2024-09-14T09:09:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991165026 2024-09-14T09:09:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789955+0000", 2024-09-14T09:09:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4839999999999994e-05 2024-09-14T09:09:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790053+0000", 2024-09-14T09:09:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8721999999999994e-05 2024-09-14T09:09:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:231 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.973729823999999, 2024-09-14T09:09:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99319130300000003, 2024-09-14T09:09:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 231 2024-09-14T09:09:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2024-09-14T09:09:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796995+0000", 2024-09-14T09:09:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2500000000000001e-06 2024-09-14T09:09:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796998+0000", 2024-09-14T09:09:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3230000000000002e-06 2024-09-14T09:09:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797001+0000", 2024-09-14T09:09:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7099999999999999e-06 2024-09-14T09:09:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798718+0000", 2024-09-14T09:09:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017168070000000001 2024-09-14T09:09:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798721+0000", 2024-09-14T09:09:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.853e-06 2024-09-14T09:09:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790077+0000", 2024-09-14T09:09:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991356393 2024-09-14T09:09:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790129+0000", 2024-09-14T09:09:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2240999999999997e-05 2024-09-14T09:09:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790185+0000", 2024-09-14T09:09:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5515e-05 2024-09-14T09:09:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:232 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2195456~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.973719167999999, 2024-09-14T09:09:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99329117899999997, 2024-09-14T09:09:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 232 2024-09-14T09:09:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797005+0000", 2024-09-14T09:09:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2024-09-14T09:09:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797006+0000", 2024-09-14T09:09:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3200000000000001e-06 2024-09-14T09:09:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797009+0000", 2024-09-14T09:09:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4680000000000001e-06 2024-09-14T09:09:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797012+0000", 2024-09-14T09:09:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4770000000000002e-06 2024-09-14T09:09:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798743+0000", 2024-09-14T09:09:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017312 2024-09-14T09:09:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798747+0000", 2024-09-14T09:09:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.484e-06 2024-09-14T09:09:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790201+0000", 2024-09-14T09:09:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99145419499999998 2024-09-14T09:09:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790241+0000", 2024-09-14T09:09:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0587999999999998e-05 2024-09-14T09:09:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790296+0000", 2024-09-14T09:09:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4212000000000002e-05 2024-09-14T09:09:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:233 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2654208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.973708545000001, 2024-09-14T09:09:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99337220100000001, 2024-09-14T09:09:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 233 2024-09-14T09:09:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:09:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:09:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.269e-06 2024-09-14T09:09:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797019+0000", 2024-09-14T09:09:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9519999999999999e-06 2024-09-14T09:09:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797022+0000", 2024-09-14T09:09:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6079999999999998e-06 2024-09-14T09:09:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798759+0000", 2024-09-14T09:09:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001737342 2024-09-14T09:09:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798762+0000", 2024-09-14T09:09:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:09:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790310+0000", 2024-09-14T09:09:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99154738799999997 2024-09-14T09:09:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790349+0000", 2024-09-14T09:09:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9573000000000002e-05 2024-09-14T09:09:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790387+0000", 2024-09-14T09:09:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7985999999999998e-05 2024-09-14T09:09:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:234 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3112960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.973698500000001, 2024-09-14T09:09:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99345674500000003, 2024-09-14T09:09:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 234 2024-09-14T09:09:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0100000000000001e-07 2024-09-14T09:09:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0699999999999999e-06 2024-09-14T09:09:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:09:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.886e-06 2024-09-14T09:09:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797032+0000", 2024-09-14T09:09:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7149999999999998e-06 2024-09-14T09:09:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798778+0000", 2024-09-14T09:09:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017460329999999999 2024-09-14T09:09:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798783+0000", 2024-09-14T09:09:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0760000000000002e-06 2024-09-14T09:09:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790408+0000", 2024-09-14T09:09:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99162473299999998 2024-09-14T09:09:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790446+0000", 2024-09-14T09:09:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8389000000000001e-05 2024-09-14T09:09:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790482+0000", 2024-09-14T09:09:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5642000000000002e-05 2024-09-14T09:09:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:235 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3571712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.973688601999999, 2024-09-14T09:09:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993539477, 2024-09-14T09:09:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 235 2024-09-14T09:09:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9999999999999999e-07 2024-09-14T09:09:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797036+0000", 2024-09-14T09:09:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.051e-06 2024-09-14T09:09:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797039+0000", 2024-09-14T09:09:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:09:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797042+0000", 2024-09-14T09:09:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5280000000000002e-06 2024-09-14T09:09:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798809+0000", 2024-09-14T09:09:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001767394 2024-09-14T09:09:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798815+0000", 2024-09-14T09:09:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0859999999999998e-06 2024-09-14T09:09:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790502+0000", 2024-09-14T09:09:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99168652300000004 2024-09-14T09:09:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790539+0000", 2024-09-14T09:09:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7471000000000001e-05 2024-09-14T09:09:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790574+0000", 2024-09-14T09:09:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5292e-05 2024-09-14T09:09:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:236 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 4030464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.973678369000002, 2024-09-14T09:09:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993619743, 2024-09-14T09:09:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 236 2024-09-14T09:09:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1400000000000001e-07 2024-09-14T09:09:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797047+0000", 2024-09-14T09:09:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3400000000000001e-06 2024-09-14T09:09:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:09:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0699999999999998e-06 2024-09-14T09:09:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797053+0000", 2024-09-14T09:09:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7310000000000002e-06 2024-09-14T09:09:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798839+0000", 2024-09-14T09:09:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001786403 2024-09-14T09:09:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798844+0000", 2024-09-14T09:09:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3730000000000001e-06 2024-09-14T09:09:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790592+0000", 2024-09-14T09:09:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99174818099999995 2024-09-14T09:09:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790628+0000", 2024-09-14T09:09:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5831000000000003e-05 2024-09-14T09:09:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790665+0000", 2024-09-14T09:09:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-05 2024-09-14T09:09:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:365 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.971491341, 2024-09-14T09:09:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157278400000004, 2024-09-14T09:09:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:02.819 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:02.819 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:02.819 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 365 2024-09-14T09:09:02.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.819 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:02.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:02.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:02.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:09:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799233+0000", 2024-09-14T09:09:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.057e-06 2024-09-14T09:09:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799236+0000", 2024-09-14T09:09:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0249999999999998e-06 2024-09-14T09:09:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799239+0000", 2024-09-14T09:09:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.481e-06 2024-09-14T09:09:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800963+0000", 2024-09-14T09:09:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017240440000000001 2024-09-14T09:09:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800969+0000", 2024-09-14T09:09:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1410000000000002e-06 2024-09-14T09:09:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790682+0000", 2024-09-14T09:09:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98971330300000004 2024-09-14T09:09:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790753+0000", 2024-09-14T09:09:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0548000000000003e-05 2024-09-14T09:09:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790805+0000", 2024-09-14T09:09:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1981999999999998e-05 2024-09-14T09:09:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:366 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.971481248, 2024-09-14T09:09:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99173757299999998, 2024-09-14T09:09:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 366 2024-09-14T09:09:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-07 2024-09-14T09:09:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799244+0000", 2024-09-14T09:09:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.359e-06 2024-09-14T09:09:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799247+0000", 2024-09-14T09:09:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4929999999999998e-06 2024-09-14T09:09:02.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:02.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799250+0000", 2024-09-14T09:09:02.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:09:02.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800991+0000", 2024-09-14T09:09:02.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017412809999999999 2024-09-14T09:09:02.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800997+0000", 2024-09-14T09:09:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:09:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790824+0000", 2024-09-14T09:09:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98982735399999999 2024-09-14T09:09:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790891+0000", 2024-09-14T09:09:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7243999999999995e-05 2024-09-14T09:09:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790980+0000", 2024-09-14T09:09:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8608000000000003e-05 2024-09-14T09:09:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:367 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.971469876, 2024-09-14T09:09:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99188259999999995, 2024-09-14T09:09:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 367 2024-09-14T09:09:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:02.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:02.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:02.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:02.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-07 2024-09-14T09:09:02.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:02.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799255+0000", 2024-09-14T09:09:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.111e-06 2024-09-14T09:09:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799259+0000", 2024-09-14T09:09:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8650000000000003e-06 2024-09-14T09:09:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799262+0000", 2024-09-14T09:09:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.128e-06 2024-09-14T09:09:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801029+0000", 2024-09-14T09:09:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017668460000000001 2024-09-14T09:09:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801032+0000", 2024-09-14T09:09:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3179999999999998e-06 2024-09-14T09:09:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791011+0000", 2024-09-14T09:09:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98997920399999995 2024-09-14T09:09:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791077+0000", 2024-09-14T09:09:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5214000000000003e-05 2024-09-14T09:09:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791136+0000", 2024-09-14T09:09:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9710000000000003e-05 2024-09-14T09:09:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:368 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.971458333000001, 2024-09-14T09:09:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99201753800000003, 2024-09-14T09:09:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 368 2024-09-14T09:09:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4900000000000002e-07 2024-09-14T09:09:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799267+0000", 2024-09-14T09:09:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.079e-06 2024-09-14T09:09:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799270+0000", 2024-09-14T09:09:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.993e-06 2024-09-14T09:09:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799272+0000", 2024-09-14T09:09:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.695e-06 2024-09-14T09:09:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801043+0000", 2024-09-14T09:09:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001771105 2024-09-14T09:09:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801046+0000", 2024-09-14T09:09:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7999999999999999e-06 2024-09-14T09:09:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791150+0000", 2024-09-14T09:09:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99010348699999995 2024-09-14T09:09:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791193+0000", 2024-09-14T09:09:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3615999999999997e-05 2024-09-14T09:09:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791283+0000", 2024-09-14T09:09:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9513999999999997e-05 2024-09-14T09:09:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:369 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.971447994999998, 2024-09-14T09:09:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99213433600000001, 2024-09-14T09:09:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 369 2024-09-14T09:09:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:09:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799277+0000", 2024-09-14T09:09:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.108e-06 2024-09-14T09:09:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799280+0000", 2024-09-14T09:09:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:09:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799283+0000", 2024-09-14T09:09:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.531e-06 2024-09-14T09:09:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801058+0000", 2024-09-14T09:09:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001775085 2024-09-14T09:09:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801060+0000", 2024-09-14T09:09:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8260000000000001e-06 2024-09-14T09:09:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791299+0000", 2024-09-14T09:09:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99023856799999999 2024-09-14T09:09:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791352+0000", 2024-09-14T09:09:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2528000000000003e-05 2024-09-14T09:09:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791410+0000", 2024-09-14T09:09:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8298000000000003e-05 2024-09-14T09:09:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:370 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2457600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.971423227999999, 2024-09-14T09:09:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99220795399999995, 2024-09-14T09:09:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 370 2024-09-14T09:09:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799301+0000", 2024-09-14T09:09:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2024-09-14T09:09:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799303+0000", 2024-09-14T09:09:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9319999999999999e-06 2024-09-14T09:09:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799310+0000", 2024-09-14T09:09:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8680000000000001e-06 2024-09-14T09:09:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799315+0000", 2024-09-14T09:09:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.921e-06 2024-09-14T09:09:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801071+0000", 2024-09-14T09:09:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001756678 2024-09-14T09:09:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801080+0000", 2024-09-14T09:09:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6060000000000003e-06 2024-09-14T09:09:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791429+0000", 2024-09-14T09:09:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99034944599999997 2024-09-14T09:09:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791471+0000", 2024-09-14T09:09:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1279999999999998e-05 2024-09-14T09:09:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791508+0000", 2024-09-14T09:09:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7663999999999997e-05 2024-09-14T09:09:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:371 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2916352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.971402055999999, 2024-09-14T09:09:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99228692299999999, 2024-09-14T09:09:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 371 2024-09-14T09:09:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799322+0000", 2024-09-14T09:09:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:09:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799333+0000", 2024-09-14T09:09:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1044e-05 2024-09-14T09:09:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799341+0000", 2024-09-14T09:09:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8439999999999998e-06 2024-09-14T09:09:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799354+0000", 2024-09-14T09:09:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3114e-05 2024-09-14T09:09:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801093+0000", 2024-09-14T09:09:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017385910000000001 2024-09-14T09:09:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801096+0000", 2024-09-14T09:09:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0680000000000001e-06 2024-09-14T09:09:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791528+0000", 2024-09-14T09:09:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99043264200000003 2024-09-14T09:09:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791570+0000", 2024-09-14T09:09:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2144999999999997e-05 2024-09-14T09:09:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791608+0000", 2024-09-14T09:09:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7966000000000002e-05 2024-09-14T09:09:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:372 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3375104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.971361508000001, 2024-09-14T09:09:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992342897, 2024-09-14T09:09:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 372 2024-09-14T09:09:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799363+0000", 2024-09-14T09:09:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2024-09-14T09:09:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799365+0000", 2024-09-14T09:09:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5500000000000001e-06 2024-09-14T09:09:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799371+0000", 2024-09-14T09:09:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2500000000000003e-06 2024-09-14T09:09:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799377+0000", 2024-09-14T09:09:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7509999999999997e-06 2024-09-14T09:09:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801107+0000", 2024-09-14T09:09:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017298019999999999 2024-09-14T09:09:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801111+0000", 2024-09-14T09:09:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8619999999999996e-06 2024-09-14T09:09:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791626+0000", 2024-09-14T09:09:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99051563300000001 2024-09-14T09:09:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:02.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791668+0000", 2024-09-14T09:09:02.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1424000000000002e-05 2024-09-14T09:09:02.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:02.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791705+0000", 2024-09-14T09:09:02.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7035e-05 2024-09-14T09:09:02.860 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.860 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:02.860 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:373 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.971339563000001, 2024-09-14T09:09:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99253589399999997, 2024-09-14T09:09:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 373 2024-09-14T09:09:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2024-09-14T09:09:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799387+0000", 2024-09-14T09:09:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1019999999999999e-06 2024-09-14T09:09:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799393+0000", 2024-09-14T09:09:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0190000000000003e-06 2024-09-14T09:09:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799398+0000", 2024-09-14T09:09:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:09:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801123+0000", 2024-09-14T09:09:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017251949999999999 2024-09-14T09:09:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801126+0000", 2024-09-14T09:09:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9280000000000002e-06 2024-09-14T09:09:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791746+0000", 2024-09-14T09:09:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99062036899999995 2024-09-14T09:09:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791835+0000", 2024-09-14T09:09:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9004000000000004e-05 2024-09-14T09:09:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791920+0000", 2024-09-14T09:09:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4524000000000006e-05 2024-09-14T09:09:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:10395 3.17 3:e9053d87:::rbd_data.111228c3791c.0000000000000006:18 [read 962560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.797914+0000", 2024-09-14T09:09:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.972809663, 2024-09-14T09:09:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034376019000000001, 2024-09-14T09:09:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10395 2024-09-14T09:09:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.797914+0000", 2024-09-14T09:09:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.797914+0000", 2024-09-14T09:09:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798042+0000", 2024-09-14T09:09:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012855399999999999 2024-09-14T09:09:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798044+0000", 2024-09-14T09:09:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.086e-06 2024-09-14T09:09:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798049+0000", 2024-09-14T09:09:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7770000000000002e-06 2024-09-14T09:09:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798066+0000", 2024-09-14T09:09:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6405999999999998e-05 2024-09-14T09:09:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832200+0000", 2024-09-14T09:09:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034134022 2024-09-14T09:09:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832241+0000", 2024-09-14T09:09:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1566999999999997e-05 2024-09-14T09:09:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832290+0000", 2024-09-14T09:09:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8606999999999997e-05 2024-09-14T09:09:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:10397 3.17 3:e9053d87:::rbd_data.111228c3791c.0000000000000006:18 [read 1085440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.798088+0000", 2024-09-14T09:09:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.972635749999998, 2024-09-14T09:09:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034429187, 2024-09-14T09:09:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10397 2024-09-14T09:09:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798088+0000", 2024-09-14T09:09:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798088+0000", 2024-09-14T09:09:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803904+0000", 2024-09-14T09:09:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058164799999999997 2024-09-14T09:09:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803908+0000", 2024-09-14T09:09:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8580000000000002e-06 2024-09-14T09:09:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803918+0000", 2024-09-14T09:09:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4939999999999992e-06 2024-09-14T09:09:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803923+0000", 2024-09-14T09:09:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2599999999999996e-06 2024-09-14T09:09:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832428+0000", 2024-09-14T09:09:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.028504788 2024-09-14T09:09:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832470+0000", 2024-09-14T09:09:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2358999999999999e-05 2024-09-14T09:09:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832517+0000", 2024-09-14T09:09:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6947999999999998e-05 2024-09-14T09:09:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:02.874 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:02.876 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is unset 2024-09-14T09:09:02.876 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:02.877+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:02.877 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:09:02.976 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:02.978+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:03.019 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:03.020 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:03.020 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:09:03.020 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:03.028 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:09:03.077 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:03.079+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:03.171 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:03.171 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:03.171 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:03.171 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:03.171 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:03.178 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:03.180+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:03.179 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:09:03.279 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:03.282+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:03.283 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2265 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4034560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.421936812999999, 2024-09-14T09:09:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073974829000000006, 2024-09-14T09:09:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2265 2024-09-14T09:09:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862542+0000", 2024-09-14T09:09:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:09:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862543+0000", 2024-09-14T09:09:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.81e-06 2024-09-14T09:09:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862549+0000", 2024-09-14T09:09:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8850000000000004e-06 2024-09-14T09:09:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862554+0000", 2024-09-14T09:09:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5279999999999997e-06 2024-09-14T09:09:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936318+0000", 2024-09-14T09:09:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073764422999999996 2024-09-14T09:09:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936412+0000", 2024-09-14T09:09:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3801000000000005e-05 2024-09-14T09:09:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936516+0000", 2024-09-14T09:09:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000104007 2024-09-14T09:09:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2266 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4096000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.421918948999998, 2024-09-14T09:09:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074208332000000002, 2024-09-14T09:09:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2266 2024-09-14T09:09:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862738+0000", 2024-09-14T09:09:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017920300000000001 2024-09-14T09:09:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862744+0000", 2024-09-14T09:09:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3000000000000001e-06 2024-09-14T09:09:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862753+0000", 2024-09-14T09:09:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8179999999999999e-06 2024-09-14T09:09:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862785+0000", 2024-09-14T09:09:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1949000000000002e-05 2024-09-14T09:09:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936556+0000", 2024-09-14T09:09:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073770268999999999 2024-09-14T09:09:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936657+0000", 2024-09-14T09:09:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101387 2024-09-14T09:09:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936767+0000", 2024-09-14T09:09:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110406 2024-09-14T09:09:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2267 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4157440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.421680367, 2024-09-14T09:09:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074200918000000005, 2024-09-14T09:09:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2267 2024-09-14T09:09:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863416+0000", 2024-09-14T09:09:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000618492 2024-09-14T09:09:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863421+0000", 2024-09-14T09:09:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1359999999999996e-06 2024-09-14T09:09:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863434+0000", 2024-09-14T09:09:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2291e-05 2024-09-14T09:09:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863444+0000", 2024-09-14T09:09:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9769999999999995e-06 2024-09-14T09:09:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936808+0000", 2024-09-14T09:09:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073364051999999999 2024-09-14T09:09:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936892+0000", 2024-09-14T09:09:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4641999999999994e-05 2024-09-14T09:09:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936999+0000", 2024-09-14T09:09:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106328 2024-09-14T09:09:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2328 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 45056~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.863458+0000", 2024-09-14T09:09:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.421020127999999, 2024-09-14T09:09:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073931949999999996, 2024-09-14T09:09:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2328 2024-09-14T09:09:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863458+0000", 2024-09-14T09:09:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863458+0000", 2024-09-14T09:09:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863489+0000", 2024-09-14T09:09:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1270999999999999e-05 2024-09-14T09:09:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863500+0000", 2024-09-14T09:09:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0969e-05 2024-09-14T09:09:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863509+0000", 2024-09-14T09:09:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5210000000000002e-06 2024-09-14T09:09:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863515+0000", 2024-09-14T09:09:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-09-14T09:09:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937038+0000", 2024-09-14T09:09:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073522901000000002 2024-09-14T09:09:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937131+0000", 2024-09-14T09:09:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.276e-05 2024-09-14T09:09:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937390+0000", 2024-09-14T09:09:03.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025917099999999999 2024-09-14T09:09:03.302 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.302 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.302 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.302 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2329 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 106496~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:03.302 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:03.302 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.420951758000001, 2024-09-14T09:09:03.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074180251000000003, 2024-09-14T09:09:03.302 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.303 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.303 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:03.303 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.303 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:03.303 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:03.303 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2329 2024-09-14T09:09:03.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.303 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:03.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:03.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864203+0000", 2024-09-14T09:09:03.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000677015 2024-09-14T09:09:03.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864208+0000", 2024-09-14T09:09:03.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.972e-06 2024-09-14T09:09:03.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864221+0000", 2024-09-14T09:09:03.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2683e-05 2024-09-14T09:09:03.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864229+0000", 2024-09-14T09:09:03.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0809999999999994e-06 2024-09-14T09:09:03.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937430+0000", 2024-09-14T09:09:03.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073201231000000005 2024-09-14T09:09:03.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:03.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937513+0000", 2024-09-14T09:09:03.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2652999999999996e-05 2024-09-14T09:09:03.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937707+0000", 2024-09-14T09:09:03.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000193616 2024-09-14T09:09:03.306 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.306 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.306 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.307 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2331 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 229376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:03.307 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:03.307 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.420134261000001, 2024-09-14T09:09:03.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.07400843, 2024-09-14T09:09:03.307 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.307 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.307 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:03.307 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.307 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:03.307 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:03.307 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2331 2024-09-14T09:09:03.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.307 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:03.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:03.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868104+0000", 2024-09-14T09:09:03.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003760453 2024-09-14T09:09:03.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868109+0000", 2024-09-14T09:09:03.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9339999999999997e-06 2024-09-14T09:09:03.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868119+0000", 2024-09-14T09:09:03.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5389999999999996e-06 2024-09-14T09:09:03.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868126+0000", 2024-09-14T09:09:03.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4499999999999998e-06 2024-09-14T09:09:03.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938065+0000", 2024-09-14T09:09:03.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069938809000000005 2024-09-14T09:09:03.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:03.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938148+0000", 2024-09-14T09:09:03.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3171999999999996e-05 2024-09-14T09:09:03.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938352+0000", 2024-09-14T09:09:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020407300000000001 2024-09-14T09:09:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2380 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3239936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.405109233000001, 2024-09-14T09:09:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073985913, 2024-09-14T09:09:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2380 2024-09-14T09:09:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879697+0000", 2024-09-14T09:09:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032864100000000001 2024-09-14T09:09:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879702+0000", 2024-09-14T09:09:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.578e-06 2024-09-14T09:09:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879716+0000", 2024-09-14T09:09:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.413e-05 2024-09-14T09:09:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879724+0000", 2024-09-14T09:09:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.559e-06 2024-09-14T09:09:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953155+0000", 2024-09-14T09:09:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073431221000000005 2024-09-14T09:09:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953247+0000", 2024-09-14T09:09:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1662000000000004e-05 2024-09-14T09:09:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953355+0000", 2024-09-14T09:09:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010812200000000001 2024-09-14T09:09:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2500 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2789376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:09:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.386578188000001, 2024-09-14T09:09:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073867281000000007, 2024-09-14T09:09:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2500 2024-09-14T09:09:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:09:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:09:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:09:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1e-07 2024-09-14T09:09:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897901+0000", 2024-09-14T09:09:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1650000000000001e-06 2024-09-14T09:09:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897905+0000", 2024-09-14T09:09:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.755e-06 2024-09-14T09:09:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897908+0000", 2024-09-14T09:09:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7480000000000002e-06 2024-09-14T09:09:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971448+0000", 2024-09-14T09:09:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073539801000000002 2024-09-14T09:09:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971535+0000", 2024-09-14T09:09:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7085999999999999e-05 2024-09-14T09:09:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971767+0000", 2024-09-14T09:09:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023251599999999999 2024-09-14T09:09:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2501 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2850816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.386566929000001, 2024-09-14T09:09:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074288858999999999, 2024-09-14T09:09:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2501 2024-09-14T09:09:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.41e-07 2024-09-14T09:09:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897913+0000", 2024-09-14T09:09:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3090000000000001e-06 2024-09-14T09:09:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897918+0000", 2024-09-14T09:09:03.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8470000000000003e-06 2024-09-14T09:09:03.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897922+0000", 2024-09-14T09:09:03.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5549999999999996e-06 2024-09-14T09:09:03.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971872+0000", 2024-09-14T09:09:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073950057999999999 2024-09-14T09:09:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971958+0000", 2024-09-14T09:09:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5941999999999998e-05 2024-09-14T09:09:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972200+0000", 2024-09-14T09:09:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000241907 2024-09-14T09:09:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2502 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2912256~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.386527748999999, 2024-09-14T09:09:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074614080999999999, 2024-09-14T09:09:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2502 2024-09-14T09:09:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897951+0000", 2024-09-14T09:09:03.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:09:03.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897953+0000", 2024-09-14T09:09:03.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5670000000000002e-06 2024-09-14T09:09:03.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897970+0000", 2024-09-14T09:09:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6319000000000001e-05 2024-09-14T09:09:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897976+0000", 2024-09-14T09:09:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8760000000000002e-06 2024-09-14T09:09:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972245+0000", 2024-09-14T09:09:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074269186000000001 2024-09-14T09:09:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:03.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972333+0000", 2024-09-14T09:09:03.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7800999999999995e-05 2024-09-14T09:09:03.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972564+0000", 2024-09-14T09:09:03.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000231833 2024-09-14T09:09:03.329 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.329 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.329 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2503 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2973696~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.386493732000002, 2024-09-14T09:09:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074944286999999998, 2024-09-14T09:09:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2503 2024-09-14T09:09:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897985+0000", 2024-09-14T09:09:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999998e-07 2024-09-14T09:09:03.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897987+0000", 2024-09-14T09:09:03.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.401e-06 2024-09-14T09:09:03.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897999+0000", 2024-09-14T09:09:03.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1851999999999999e-05 2024-09-14T09:09:03.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898005+0000", 2024-09-14T09:09:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9789999999999998e-06 2024-09-14T09:09:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972609+0000", 2024-09-14T09:09:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074604217 2024-09-14T09:09:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972684+0000", 2024-09-14T09:09:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4777999999999995e-05 2024-09-14T09:09:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972929+0000", 2024-09-14T09:09:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024448100000000001 2024-09-14T09:09:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2504 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3035136~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.386465640000001, 2024-09-14T09:09:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075285131000000005, 2024-09-14T09:09:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2504 2024-09-14T09:09:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898078+0000", 2024-09-14T09:09:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5775e-05 2024-09-14T09:09:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898082+0000", 2024-09-14T09:09:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.49e-06 2024-09-14T09:09:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898092+0000", 2024-09-14T09:09:03.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0509999999999999e-05 2024-09-14T09:09:03.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898099+0000", 2024-09-14T09:09:03.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.81e-06 2024-09-14T09:09:03.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972971+0000", 2024-09-14T09:09:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074871788999999994 2024-09-14T09:09:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973055+0000", 2024-09-14T09:09:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3980000000000006e-05 2024-09-14T09:09:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973298+0000", 2024-09-14T09:09:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024277700000000001 2024-09-14T09:09:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2505 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3096576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.386369384999998, 2024-09-14T09:09:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075506668999999998, 2024-09-14T09:09:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2505 2024-09-14T09:09:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898370+0000", 2024-09-14T09:09:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026128799999999998 2024-09-14T09:09:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898374+0000", 2024-09-14T09:09:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8070000000000001e-06 2024-09-14T09:09:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898383+0000", 2024-09-14T09:09:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0520000000000007e-06 2024-09-14T09:09:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898389+0000", 2024-09-14T09:09:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2639999999999997e-06 2024-09-14T09:09:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973330+0000", 2024-09-14T09:09:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074940548999999995 2024-09-14T09:09:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973402+0000", 2024-09-14T09:09:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2556000000000001e-05 2024-09-14T09:09:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973615+0000", 2024-09-14T09:09:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000213153 2024-09-14T09:09:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2506 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3158016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.386076141, 2024-09-14T09:09:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075556110999999995, 2024-09-14T09:09:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2506 2024-09-14T09:09:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898497+0000", 2024-09-14T09:09:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4806e-05 2024-09-14T09:09:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898500+0000", 2024-09-14T09:09:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.54e-06 2024-09-14T09:09:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898507+0000", 2024-09-14T09:09:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1590000000000004e-06 2024-09-14T09:09:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898513+0000", 2024-09-14T09:09:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.015e-06 2024-09-14T09:09:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973656+0000", 2024-09-14T09:09:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075142929999999997 2024-09-14T09:09:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973742+0000", 2024-09-14T09:09:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5535e-05 2024-09-14T09:09:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973958+0000", 2024-09-14T09:09:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000216126 2024-09-14T09:09:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2507 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3219456~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.385947557000001, 2024-09-14T09:09:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075623459000000004, 2024-09-14T09:09:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2507 2024-09-14T09:09:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898761+0000", 2024-09-14T09:09:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000230614 2024-09-14T09:09:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898765+0000", 2024-09-14T09:09:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6629999999999999e-06 2024-09-14T09:09:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898774+0000", 2024-09-14T09:09:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6749999999999997e-06 2024-09-14T09:09:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898781+0000", 2024-09-14T09:09:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4640000000000003e-06 2024-09-14T09:09:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973985+0000", 2024-09-14T09:09:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075204101999999995 2024-09-14T09:09:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974063+0000", 2024-09-14T09:09:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7632000000000005e-05 2024-09-14T09:09:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974154+0000", 2024-09-14T09:09:03.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1309000000000003e-05 2024-09-14T09:09:03.352 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.352 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.352 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.352 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2508 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3280896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:03.352 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:03.352 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.385685794, 2024-09-14T09:09:03.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075576943999999993, 2024-09-14T09:09:03.353 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.353 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.353 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:03.353 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.353 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:03.353 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:03.353 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2508 2024-09-14T09:09:03.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.353 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:03.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899176+0000", 2024-09-14T09:09:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038340500000000002 2024-09-14T09:09:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899179+0000", 2024-09-14T09:09:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0290000000000001e-06 2024-09-14T09:09:03.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899186+0000", 2024-09-14T09:09:03.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8199999999999999e-06 2024-09-14T09:09:03.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899190+0000", 2024-09-14T09:09:03.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2050000000000004e-06 2024-09-14T09:09:03.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974193+0000", 2024-09-14T09:09:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075003632000000001 2024-09-14T09:09:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974276+0000", 2024-09-14T09:09:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2272000000000001e-05 2024-09-14T09:09:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974369+0000", 2024-09-14T09:09:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3580999999999997e-05 2024-09-14T09:09:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.357 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.357 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2509 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3342336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:03.357 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:03.357 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.385278177, 2024-09-14T09:09:03.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075356229999999996, 2024-09-14T09:09:03.357 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.357 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.357 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:03.357 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.357 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:03.357 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:03.357 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2509 2024-09-14T09:09:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899439+0000", 2024-09-14T09:09:03.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023958599999999999 2024-09-14T09:09:03.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899444+0000", 2024-09-14T09:09:03.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8790000000000002e-06 2024-09-14T09:09:03.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899455+0000", 2024-09-14T09:09:03.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0597999999999999e-05 2024-09-14T09:09:03.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899462+0000", 2024-09-14T09:09:03.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8179999999999998e-06 2024-09-14T09:09:03.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974400+0000", 2024-09-14T09:09:03.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074937999000000005 2024-09-14T09:09:03.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:03.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974465+0000", 2024-09-14T09:09:03.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5134000000000004e-05 2024-09-14T09:09:03.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974556+0000", 2024-09-14T09:09:03.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1216000000000002e-05 2024-09-14T09:09:03.361 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.361 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.361 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.361 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2510 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3403776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:03.361 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:03.361 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.385002784000001, 2024-09-14T09:09:03.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075295775999999995, 2024-09-14T09:09:03.362 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.362 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.362 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:03.362 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.362 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:03.362 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:03.362 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2510 2024-09-14T09:09:03.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.362 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:03.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:03.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899691+0000", 2024-09-14T09:09:03.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021615999999999999 2024-09-14T09:09:03.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899696+0000", 2024-09-14T09:09:03.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3200000000000001e-06 2024-09-14T09:09:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899704+0000", 2024-09-14T09:09:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9440000000000005e-06 2024-09-14T09:09:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899710+0000", 2024-09-14T09:09:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.584e-06 2024-09-14T09:09:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974594+0000", 2024-09-14T09:09:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074883551000000007 2024-09-14T09:09:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974679+0000", 2024-09-14T09:09:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5365999999999995e-05 2024-09-14T09:09:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974771+0000", 2024-09-14T09:09:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1850999999999999e-05 2024-09-14T09:09:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.366 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.366 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2511 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3465216~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:03.366 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:03.366 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.384756566, 2024-09-14T09:09:03.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075234668000000005, 2024-09-14T09:09:03.366 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.366 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.366 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:03.366 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.366 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:03.366 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:03.366 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2511 2024-09-14T09:09:03.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.367 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:03.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:03.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899951+0000", 2024-09-14T09:09:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000229569 2024-09-14T09:09:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899955+0000", 2024-09-14T09:09:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1010000000000002e-06 2024-09-14T09:09:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899971+0000", 2024-09-14T09:09:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5648999999999999e-05 2024-09-14T09:09:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899978+0000", 2024-09-14T09:09:03.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0829999999999998e-06 2024-09-14T09:09:03.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974806+0000", 2024-09-14T09:09:03.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074828092999999998 2024-09-14T09:09:03.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:03.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974870+0000", 2024-09-14T09:09:03.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4492000000000005e-05 2024-09-14T09:09:03.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974956+0000", 2024-09-14T09:09:03.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5680999999999995e-05 2024-09-14T09:09:03.370 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.370 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.370 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.370 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2512 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3526656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:03.370 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:03.370 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.384489021, 2024-09-14T09:09:03.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075178812999999997, 2024-09-14T09:09:03.370 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.370 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.370 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:03.371 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.371 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:03.371 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:03.371 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2512 2024-09-14T09:09:03.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.371 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:03.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:03.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904181+0000", 2024-09-14T09:09:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041919399999999999 2024-09-14T09:09:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904186+0000", 2024-09-14T09:09:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2390000000000002e-06 2024-09-14T09:09:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904199+0000", 2024-09-14T09:09:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2709e-05 2024-09-14T09:09:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904207+0000", 2024-09-14T09:09:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8150000000000006e-06 2024-09-14T09:09:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975000+0000", 2024-09-14T09:09:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.070793444999999997 2024-09-14T09:09:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:03.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975079+0000", 2024-09-14T09:09:03.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8480999999999996e-05 2024-09-14T09:09:03.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975168+0000", 2024-09-14T09:09:03.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9184000000000005e-05 2024-09-14T09:09:03.374 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.374 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.374 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.374 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.374 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.374 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:03.375 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:09:03.380 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:03.382+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:03.477 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:5683 3.10 3.557be1b0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-14T09:09:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:02.808468+0000", 2024-09-14T09:09:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.67165907300000005, 2024-09-14T09:09:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67167875899999996, 2024-09-14T09:09:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 5683 2024-09-14T09:09:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.808468+0000", 2024-09-14T09:09:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.808468+0000", 2024-09-14T09:09:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.808469+0000", 2024-09-14T09:09:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0079999999999999e-06 2024-09-14T09:09:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.808925+0000", 2024-09-14T09:09:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00045545299999999998 2024-09-14T09:09:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.808934+0000", 2024-09-14T09:09:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7140000000000005e-06 2024-09-14T09:09:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.808941+0000", 2024-09-14T09:09:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2790000000000004e-06 2024-09-14T09:09:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.808992+0000", 2024-09-14T09:09:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1354999999999999e-05 2024-09-14T09:09:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.809000+0000", 2024-09-14T09:09:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5150000000000006e-06 2024-09-14T09:09:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:5688 3.1c 3.79a64b9c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-14T09:09:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:02.816639+0000", 2024-09-14T09:09:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.66348858399999999, 2024-09-14T09:09:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.66354388600000003, 2024-09-14T09:09:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 5688 2024-09-14T09:09:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.816639+0000", 2024-09-14T09:09:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.816639+0000", 2024-09-14T09:09:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.816641+0000", 2024-09-14T09:09:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.897e-06 2024-09-14T09:09:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.816651+0000", 2024-09-14T09:09:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0206e-05 2024-09-14T09:09:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.816678+0000", 2024-09-14T09:09:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7557000000000001e-05 2024-09-14T09:09:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.816692+0000", 2024-09-14T09:09:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4086e-05 2024-09-14T09:09:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.816793+0000", 2024-09-14T09:09:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000100995 2024-09-14T09:09:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.816800+0000", 2024-09-14T09:09:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6760000000000001e-06 2024-09-14T09:09:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:5689 3.c 3.c8aa14ac (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-14T09:09:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:02.818941+0000", 2024-09-14T09:09:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.66118666599999998, 2024-09-14T09:09:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.66127015099999997, 2024-09-14T09:09:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 5689 2024-09-14T09:09:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.818941+0000", 2024-09-14T09:09:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.818941+0000", 2024-09-14T09:09:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.818941+0000", 2024-09-14T09:09:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8400000000000003e-07 2024-09-14T09:09:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.818948+0000", 2024-09-14T09:09:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.297e-06 2024-09-14T09:09:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.818958+0000", 2024-09-14T09:09:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0239e-05 2024-09-14T09:09:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.818970+0000", 2024-09-14T09:09:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1848000000000001e-05 2024-09-14T09:09:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.819032+0000", 2024-09-14T09:09:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2615999999999998e-05 2024-09-14T09:09:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:02.819038+0000", 2024-09-14T09:09:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3650000000000003e-06 2024-09-14T09:09:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 3 2024-09-14T09:09:03.491 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:03.492 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:09:03.492 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:03.494+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:03.592 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:03.594+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:03.635 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:03.635 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:03.635 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:03.635 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:03.635 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:03.644 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:09:03.693 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:03.695+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:03.788 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:03.789 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:03.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:03.789 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:03.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.789 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:987 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:03.789 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:03.789 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.931338631, 2024-09-14T09:09:03.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001359466, 2024-09-14T09:09:03.789 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.789 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.789 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:03.789 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.790 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.790 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.790 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 987 2024-09-14T09:09:03.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.790 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:03.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:03.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858333+0000", 2024-09-14T09:09:03.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.621e-06 2024-09-14T09:09:03.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858349+0000", 2024-09-14T09:09:03.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5758000000000001e-05 2024-09-14T09:09:03.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858366+0000", 2024-09-14T09:09:03.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7368e-05 2024-09-14T09:09:03.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858382+0000", 2024-09-14T09:09:03.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6039e-05 2024-09-14T09:09:03.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858441+0000", 2024-09-14T09:09:03.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8662999999999997e-05 2024-09-14T09:09:03.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858449+0000", 2024-09-14T09:09:03.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3960000000000006e-06 2024-09-14T09:09:03.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859682+0000", 2024-09-14T09:09:03.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001233096 2024-09-14T09:09:03.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859691+0000", 2024-09-14T09:09:03.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5250000000000005e-06 2024-09-14T09:09:03.794 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.794 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.794 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.794 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:988 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:03.794 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:03.794 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.931210761, 2024-09-14T09:09:03.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0012656799999999, 2024-09-14T09:09:03.795 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.795 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.795 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:03.795 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.795 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.795 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.795 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 988 2024-09-14T09:09:03.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.795 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:03.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:03.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858460+0000", 2024-09-14T09:09:03.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9999999999999997e-07 2024-09-14T09:09:03.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858463+0000", 2024-09-14T09:09:03.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7459999999999998e-06 2024-09-14T09:09:03.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858471+0000", 2024-09-14T09:09:03.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3900000000000004e-06 2024-09-14T09:09:03.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858478+0000", 2024-09-14T09:09:03.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7020000000000004e-06 2024-09-14T09:09:03.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859102+0000", 2024-09-14T09:09:03.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062419699999999995 2024-09-14T09:09:03.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859109+0000", 2024-09-14T09:09:03.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7419999999999997e-06 2024-09-14T09:09:03.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859718+0000", 2024-09-14T09:09:03.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006085629999999 2024-09-14T09:09:03.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859725+0000", 2024-09-14T09:09:03.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7399999999999998e-06 2024-09-14T09:09:03.799 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.799 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.799 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.799 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:989 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:03.800 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859046+0000", 2024-09-14T09:09:03.800 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.9306240900000002, 2024-09-14T09:09:03.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000708894, 2024-09-14T09:09:03.800 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.800 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.800 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:03.800 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.800 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.800 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.800 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 989 2024-09-14T09:09:03.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.800 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859046+0000", 2024-09-14T09:09:03.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859046+0000", 2024-09-14T09:09:03.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859046+0000", 2024-09-14T09:09:03.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9599999999999999e-07 2024-09-14T09:09:03.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859050+0000", 2024-09-14T09:09:03.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9380000000000002e-06 2024-09-14T09:09:03.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859062+0000", 2024-09-14T09:09:03.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2103000000000001e-05 2024-09-14T09:09:03.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859072+0000", 2024-09-14T09:09:03.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4870000000000008e-06 2024-09-14T09:09:03.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859320+0000", 2024-09-14T09:09:03.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024821799999999997 2024-09-14T09:09:03.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859327+0000", 2024-09-14T09:09:03.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0480000000000001e-06 2024-09-14T09:09:03.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859746+0000", 2024-09-14T09:09:03.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0004190479999999 2024-09-14T09:09:03.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859755+0000", 2024-09-14T09:09:03.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3559999999999993e-06 2024-09-14T09:09:03.804 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.804 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.804 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.805 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:990 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:03.805 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859286+0000", 2024-09-14T09:09:03.805 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.9303833480000003, 2024-09-14T09:09:03.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0004942889999999, 2024-09-14T09:09:03.805 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.805 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.805 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:03.805 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.805 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.805 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.805 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 990 2024-09-14T09:09:03.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.806 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859286+0000", 2024-09-14T09:09:03.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859286+0000", 2024-09-14T09:09:03.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859287+0000", 2024-09-14T09:09:03.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1900000000000002e-07 2024-09-14T09:09:03.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859291+0000", 2024-09-14T09:09:03.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1239999999999998e-06 2024-09-14T09:09:03.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859302+0000", 2024-09-14T09:09:03.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0849999999999999e-05 2024-09-14T09:09:03.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859309+0000", 2024-09-14T09:09:03.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2880000000000004e-06 2024-09-14T09:09:03.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859352+0000", 2024-09-14T09:09:03.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2726999999999999e-05 2024-09-14T09:09:03.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:03.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4689999999999996e-06 2024-09-14T09:09:03.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859774+0000", 2024-09-14T09:09:03.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000416108 2024-09-14T09:09:03.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859781+0000", 2024-09-14T09:09:03.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0040000000000002e-06 2024-09-14T09:09:03.810 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.810 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.810 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.810 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1003 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:03.810 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:03.810 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.9303475240000001, 2024-09-14T09:09:03.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009495209999999, 2024-09-14T09:09:03.810 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.810 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.810 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:03.810 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.811 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.811 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.811 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1003 2024-09-14T09:09:03.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.811 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:03.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:03.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859323+0000", 2024-09-14T09:09:03.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3099999999999998e-07 2024-09-14T09:09:03.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859326+0000", 2024-09-14T09:09:03.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-06 2024-09-14T09:09:03.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859333+0000", 2024-09-14T09:09:03.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3300000000000001e-06 2024-09-14T09:09:03.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859339+0000", 2024-09-14T09:09:03.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6400000000000002e-06 2024-09-14T09:09:03.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859387+0000", 2024-09-14T09:09:03.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8448000000000001e-05 2024-09-14T09:09:03.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:09:03.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9540000000000004e-06 2024-09-14T09:09:03.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860260+0000", 2024-09-14T09:09:03.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000864921 2024-09-14T09:09:03.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860272+0000", 2024-09-14T09:09:03.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1993e-05 2024-09-14T09:09:03.815 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.815 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.815 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.815 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1004 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:03.815 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:03.816 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.930311949, 2024-09-14T09:09:03.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000947875, 2024-09-14T09:09:03.816 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.816 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.816 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:03.816 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.816 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.816 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.816 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1004 2024-09-14T09:09:03.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.816 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:03.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:03.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:03.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7199999999999999e-07 2024-09-14T09:09:03.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859361+0000", 2024-09-14T09:09:03.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.892e-06 2024-09-14T09:09:03.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859368+0000", 2024-09-14T09:09:03.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4370000000000004e-06 2024-09-14T09:09:03.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859373+0000", 2024-09-14T09:09:03.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6690000000000003e-06 2024-09-14T09:09:03.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859430+0000", 2024-09-14T09:09:03.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6456999999999998e-05 2024-09-14T09:09:03.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859434+0000", 2024-09-14T09:09:03.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8410000000000002e-06 2024-09-14T09:09:03.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860299+0000", 2024-09-14T09:09:03.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008650370000001 2024-09-14T09:09:03.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860306+0000", 2024-09-14T09:09:03.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0700000000000001e-06 2024-09-14T09:09:03.820 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.820 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.820 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.821 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1005 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:03.821 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:03.821 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.9302882759999997, 2024-09-14T09:09:03.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009585480000001, 2024-09-14T09:09:03.821 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.821 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.821 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:03.821 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.821 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.821 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.821 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1005 2024-09-14T09:09:03.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.822 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:03.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:03.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:03.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9700000000000002e-07 2024-09-14T09:09:03.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859384+0000", 2024-09-14T09:09:03.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.024e-06 2024-09-14T09:09:03.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859390+0000", 2024-09-14T09:09:03.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7080000000000002e-06 2024-09-14T09:09:03.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:09:03.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8980000000000004e-06 2024-09-14T09:09:03.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859527+0000", 2024-09-14T09:09:03.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013228099999999999 2024-09-14T09:09:03.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859532+0000", 2024-09-14T09:09:03.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5899999999999998e-06 2024-09-14T09:09:03.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860330+0000", 2024-09-14T09:09:03.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0007973509999999 2024-09-14T09:09:03.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860340+0000", 2024-09-14T09:09:03.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0299000000000001e-05 2024-09-14T09:09:03.825 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.825 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.825 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.826 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1006 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:03.826 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:03.826 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.9302650799999999, 2024-09-14T09:09:03.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001032039, 2024-09-14T09:09:03.826 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.826 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.826 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:03.826 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.826 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.826 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.826 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1006 2024-09-14T09:09:03.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.826 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:03.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:03.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:03.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6499999999999999e-07 2024-09-14T09:09:03.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859407+0000", 2024-09-14T09:09:03.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1160000000000002e-06 2024-09-14T09:09:03.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859413+0000", 2024-09-14T09:09:03.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8880000000000002e-06 2024-09-14T09:09:03.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859419+0000", 2024-09-14T09:09:03.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3550000000000004e-06 2024-09-14T09:09:03.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859558+0000", 2024-09-14T09:09:03.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000138942 2024-09-14T09:09:03.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859563+0000", 2024-09-14T09:09:03.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.665e-06 2024-09-14T09:09:03.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860427+0000", 2024-09-14T09:09:03.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008635299999999 2024-09-14T09:09:03.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860437+0000", 2024-09-14T09:09:03.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0078000000000001e-05 2024-09-14T09:09:03.830 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.830 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.830 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.831 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1029 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:03.831 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859527+0000", 2024-09-14T09:09:03.831 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.9301425309999996, 2024-09-14T09:09:03.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0002818689999999, 2024-09-14T09:09:03.831 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.831 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.831 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:03.831 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.831 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.831 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.831 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1029 2024-09-14T09:09:03.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.831 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859527+0000", 2024-09-14T09:09:03.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859527+0000", 2024-09-14T09:09:03.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859528+0000", 2024-09-14T09:09:03.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0200000000000002e-07 2024-09-14T09:09:03.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859530+0000", 2024-09-14T09:09:03.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3810000000000002e-06 2024-09-14T09:09:03.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859536+0000", 2024-09-14T09:09:03.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0000000000000002e-06 2024-09-14T09:09:03.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859541+0000", 2024-09-14T09:09:03.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2159999999999997e-06 2024-09-14T09:09:03.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859580+0000", 2024-09-14T09:09:03.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8432000000000001e-05 2024-09-14T09:09:03.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859587+0000", 2024-09-14T09:09:03.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7989999999999996e-06 2024-09-14T09:09:03.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859801+0000", 2024-09-14T09:09:03.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000214315 2024-09-14T09:09:03.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859809+0000", 2024-09-14T09:09:03.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2239999999999995e-06 2024-09-14T09:09:03.835 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.835 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.835 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.836 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1030 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:03.836 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859553+0000", 2024-09-14T09:09:03.836 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.9301170039999995, 2024-09-14T09:09:03.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0002901259999999, 2024-09-14T09:09:03.836 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.836 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.836 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:03.836 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.836 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.836 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.836 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1030 2024-09-14T09:09:03.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.836 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859553+0000", 2024-09-14T09:09:03.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859553+0000", 2024-09-14T09:09:03.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859553+0000", 2024-09-14T09:09:03.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8599999999999999e-07 2024-09-14T09:09:03.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859556+0000", 2024-09-14T09:09:03.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5679999999999998e-06 2024-09-14T09:09:03.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859561+0000", 2024-09-14T09:09:03.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.682e-06 2024-09-14T09:09:03.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859564+0000", 2024-09-14T09:09:03.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8380000000000002e-06 2024-09-14T09:09:03.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859619+0000", 2024-09-14T09:09:03.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4761e-05 2024-09-14T09:09:03.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859624+0000", 2024-09-14T09:09:03.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3360000000000002e-06 2024-09-14T09:09:03.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859834+0000", 2024-09-14T09:09:03.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0002094290000001 2024-09-14T09:09:03.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859843+0000", 2024-09-14T09:09:03.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1260000000000004e-06 2024-09-14T09:09:03.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.840 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.840 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1031 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:03.841 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859574+0000", 2024-09-14T09:09:03.841 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.9300958870000002, 2024-09-14T09:09:03.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0002981630000001, 2024-09-14T09:09:03.841 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.841 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.841 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:03.841 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.841 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.841 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.841 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1031 2024-09-14T09:09:03.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.841 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859574+0000", 2024-09-14T09:09:03.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859574+0000", 2024-09-14T09:09:03.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859574+0000", 2024-09-14T09:09:03.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7000000000000001e-07 2024-09-14T09:09:03.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859576+0000", 2024-09-14T09:09:03.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3069999999999999e-06 2024-09-14T09:09:03.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859579+0000", 2024-09-14T09:09:03.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3680000000000002e-06 2024-09-14T09:09:03.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859582+0000", 2024-09-14T09:09:03.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6029999999999999e-06 2024-09-14T09:09:03.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:03.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9903999999999999e-05 2024-09-14T09:09:03.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859667+0000", 2024-09-14T09:09:03.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.711e-06 2024-09-14T09:09:03.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859862+0000", 2024-09-14T09:09:03.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000194732 2024-09-14T09:09:03.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859872+0000", 2024-09-14T09:09:03.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268000000000001e-05 2024-09-14T09:09:03.845 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.845 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.845 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.845 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1032 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:03.846 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859586+0000", 2024-09-14T09:09:03.846 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.9300838430000002, 2024-09-14T09:09:03.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000315565, 2024-09-14T09:09:03.846 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.846 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.846 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:03.846 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.846 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.846 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.846 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1032 2024-09-14T09:09:03.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.846 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859586+0000", 2024-09-14T09:09:03.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859586+0000", 2024-09-14T09:09:03.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859586+0000", 2024-09-14T09:09:03.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.05e-07 2024-09-14T09:09:03.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859587+0000", 2024-09-14T09:09:03.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9600000000000008e-07 2024-09-14T09:09:03.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859590+0000", 2024-09-14T09:09:03.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9239999999999999e-06 2024-09-14T09:09:03.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859593+0000", 2024-09-14T09:09:03.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5160000000000001e-06 2024-09-14T09:09:03.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859687+0000", 2024-09-14T09:09:03.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4197000000000006e-05 2024-09-14T09:09:03.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859692+0000", 2024-09-14T09:09:03.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8960000000000002e-06 2024-09-14T09:09:03.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859895+0000", 2024-09-14T09:09:03.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0002035090000001 2024-09-14T09:09:03.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859902+0000", 2024-09-14T09:09:03.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3219999999999998e-06 2024-09-14T09:09:03.850 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.850 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.850 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.850 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1045 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:03.850 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:03.851 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.9300655999999998, 2024-09-14T09:09:03.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008612990000001, 2024-09-14T09:09:03.851 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.851 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.851 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:03.851 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.851 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.851 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.851 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1045 2024-09-14T09:09:03.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.851 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:03.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:03.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859605+0000", 2024-09-14T09:09:03.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6e-07 2024-09-14T09:09:03.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859606+0000", 2024-09-14T09:09:03.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8819999999999999e-06 2024-09-14T09:09:03.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859610+0000", 2024-09-14T09:09:03.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4290000000000001e-06 2024-09-14T09:09:03.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859612+0000", 2024-09-14T09:09:03.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6309999999999999e-06 2024-09-14T09:09:03.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859643+0000", 2024-09-14T09:09:03.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0224000000000001e-05 2024-09-14T09:09:03.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859647+0000", 2024-09-14T09:09:03.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9049999999999999e-06 2024-09-14T09:09:03.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860458+0000", 2024-09-14T09:09:03.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008111180000001 2024-09-14T09:09:03.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860466+0000", 2024-09-14T09:09:03.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:09:03.855 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.855 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.855 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.855 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1046 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:03.855 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:03.855 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.9300521430000002, 2024-09-14T09:09:03.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000874262, 2024-09-14T09:09:03.856 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.856 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.856 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:03.856 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.856 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.856 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.856 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1046 2024-09-14T09:09:03.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.856 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:03.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:03.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:03.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:09:03.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859619+0000", 2024-09-14T09:09:03.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0559999999999999e-06 2024-09-14T09:09:03.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859622+0000", 2024-09-14T09:09:03.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0170000000000001e-06 2024-09-14T09:09:03.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859625+0000", 2024-09-14T09:09:03.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7209999999999999e-06 2024-09-14T09:09:03.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859666+0000", 2024-09-14T09:09:03.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1677000000000001e-05 2024-09-14T09:09:03.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859672+0000", 2024-09-14T09:09:03.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4609999999999999e-06 2024-09-14T09:09:03.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860485+0000", 2024-09-14T09:09:03.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000813505 2024-09-14T09:09:03.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860492+0000", 2024-09-14T09:09:03.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6159999999999998e-06 2024-09-14T09:09:03.860 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.860 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.860 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.860 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1047 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:03.860 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:03.860 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.9300408090000003, 2024-09-14T09:09:03.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008950190000001, 2024-09-14T09:09:03.861 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.861 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.861 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:03.861 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.861 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.861 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.861 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1047 2024-09-14T09:09:03.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.861 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:03.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:03.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:03.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6600000000000003e-07 2024-09-14T09:09:03.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859631+0000", 2024-09-14T09:09:03.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5600000000000001e-06 2024-09-14T09:09:03.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859637+0000", 2024-09-14T09:09:03.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7309999999999998e-06 2024-09-14T09:09:03.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859641+0000", 2024-09-14T09:09:03.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0840000000000002e-06 2024-09-14T09:09:03.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859691+0000", 2024-09-14T09:09:03.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0587999999999997e-05 2024-09-14T09:09:03.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859696+0000", 2024-09-14T09:09:03.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8940000000000001e-06 2024-09-14T09:09:03.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860516+0000", 2024-09-14T09:09:03.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008200780000001 2024-09-14T09:09:03.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860524+0000", 2024-09-14T09:09:03.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8180000000000004e-06 2024-09-14T09:09:03.865 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.865 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.865 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.866 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1048 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:03.866 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:03.866 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.9300090499999998, 2024-09-14T09:09:03.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008904780000001, 2024-09-14T09:09:03.866 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.866 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.866 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:03.866 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.866 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.866 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.866 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1048 2024-09-14T09:09:03.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.866 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:03.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:03.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:03.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4700000000000002e-07 2024-09-14T09:09:03.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859663+0000", 2024-09-14T09:09:03.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0420000000000001e-06 2024-09-14T09:09:03.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859669+0000", 2024-09-14T09:09:03.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8989999999999998e-06 2024-09-14T09:09:03.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859673+0000", 2024-09-14T09:09:03.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2209999999999999e-06 2024-09-14T09:09:03.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859719+0000", 2024-09-14T09:09:03.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5788000000000003e-05 2024-09-14T09:09:03.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859725+0000", 2024-09-14T09:09:03.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4770000000000002e-06 2024-09-14T09:09:03.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860544+0000", 2024-09-14T09:09:03.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008194669999999 2024-09-14T09:09:03.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860551+0000", 2024-09-14T09:09:03.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1369999999999996e-06 2024-09-14T09:09:03.870 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.870 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.870 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.871 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1087 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:03.871 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859865+0000", 2024-09-14T09:09:03.871 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.9298047480000005, 2024-09-14T09:09:03.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000716274, 2024-09-14T09:09:03.871 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.871 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.871 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:03.871 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.871 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.871 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.871 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1087 2024-09-14T09:09:03.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.871 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859865+0000", 2024-09-14T09:09:03.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859865+0000", 2024-09-14T09:09:03.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859865+0000", 2024-09-14T09:09:03.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4999999999999999e-07 2024-09-14T09:09:03.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859867+0000", 2024-09-14T09:09:03.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2049999999999999e-06 2024-09-14T09:09:03.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859871+0000", 2024-09-14T09:09:03.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0080000000000004e-06 2024-09-14T09:09:03.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859873+0000", 2024-09-14T09:09:03.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9409999999999999e-06 2024-09-14T09:09:03.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859906+0000", 2024-09-14T09:09:03.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2801e-05 2024-09-14T09:09:03.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859912+0000", 2024-09-14T09:09:03.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3909999999999997e-06 2024-09-14T09:09:03.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860574+0000", 2024-09-14T09:09:03.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006619919999999 2024-09-14T09:09:03.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860581+0000", 2024-09-14T09:09:03.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6860000000000006e-06 2024-09-14T09:09:03.875 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.875 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.875 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.875 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1088 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:03.875 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:03.875 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.9297902130000004, 2024-09-14T09:09:03.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00073166, 2024-09-14T09:09:03.876 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.876 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.876 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:03.876 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.876 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.876 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.876 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1088 2024-09-14T09:09:03.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.876 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:03.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:03.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:03.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3700000000000001e-07 2024-09-14T09:09:03.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859882+0000", 2024-09-14T09:09:03.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.739e-06 2024-09-14T09:09:03.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859887+0000", 2024-09-14T09:09:03.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:09:03.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859892+0000", 2024-09-14T09:09:03.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7119999999999999e-06 2024-09-14T09:09:03.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859945+0000", 2024-09-14T09:09:03.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2762000000000001e-05 2024-09-14T09:09:03.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859950+0000", 2024-09-14T09:09:03.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-09-14T09:09:03.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860603+0000", 2024-09-14T09:09:03.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000653263 2024-09-14T09:09:03.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860611+0000", 2024-09-14T09:09:03.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-09-14T09:09:03.880 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.880 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.880 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.880 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1089 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:03.880 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:03.880 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.9297720570000001, 2024-09-14T09:09:03.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000733943, 2024-09-14T09:09:03.880 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.880 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.880 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:03.881 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.881 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.881 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.881 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1089 2024-09-14T09:09:03.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.881 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:03.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:03.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:03.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3000000000000002e-07 2024-09-14T09:09:03.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859900+0000", 2024-09-14T09:09:03.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9199999999999998e-06 2024-09-14T09:09:03.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859906+0000", 2024-09-14T09:09:03.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0889999999999996e-06 2024-09-14T09:09:03.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859911+0000", 2024-09-14T09:09:03.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6419999999999998e-06 2024-09-14T09:09:03.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860010+0000", 2024-09-14T09:09:03.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8956000000000006e-05 2024-09-14T09:09:03.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860014+0000", 2024-09-14T09:09:03.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.741e-06 2024-09-14T09:09:03.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860627+0000", 2024-09-14T09:09:03.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00061277 2024-09-14T09:09:03.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860632+0000", 2024-09-14T09:09:03.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:09:03.885 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.885 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.885 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.885 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1090 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:03.885 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:03.885 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.9297523850000005, 2024-09-14T09:09:03.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000740763, 2024-09-14T09:09:03.885 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:03.885 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:03.885 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:03.886 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:03.886 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:03.886 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:03.886 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1090 2024-09-14T09:09:03.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.886 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:03.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:03.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:03.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:03.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:03.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:03.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:03.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859918+0000", 2024-09-14T09:09:03.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5199999999999998e-07 2024-09-14T09:09:03.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:03.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859920+0000", 2024-09-14T09:09:03.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9240000000000001e-06 2024-09-14T09:09:03.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:03.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859925+0000", 2024-09-14T09:09:03.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3929999999999999e-06 2024-09-14T09:09:03.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:03.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859929+0000", 2024-09-14T09:09:03.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4769999999999999e-06 2024-09-14T09:09:03.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860034+0000", 2024-09-14T09:09:03.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010549500000000001 2024-09-14T09:09:03.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:03.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860039+0000", 2024-09-14T09:09:03.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5700000000000003e-06 2024-09-14T09:09:03.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:03.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860650+0000", 2024-09-14T09:09:03.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006116119999999 2024-09-14T09:09:03.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:03.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:03.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:03.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860658+0000", 2024-09-14T09:09:03.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:09:03.890 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.890 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.890 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.890 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:03.890 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:03.890 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:03.890 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 1] out_osds: [] dead_osds: [2] live_osds: [0, 1, 3, 4, 5] 2024-09-14T09:09:03.891 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:09:03.891 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-14T09:09:03.891 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T09:09:03.891 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T09:09:03.891 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-14T09:09:03.893 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:03.893+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:03.894 INFO:teuthology.orchestra.run.smithi148.stdout:4537 read 0x1f5e00 thru 0x2028eb (0xcaec bytes) 2024-09-14T09:09:03.894 INFO:teuthology.orchestra.run.smithi148.stdout:4539 read 0x1b5a00 thru 0x1c0d6e (0xb36f bytes) 2024-09-14T09:09:03.894 INFO:teuthology.orchestra.run.smithi148.stdout:4541 trunc from 0x31f600 to 0xc165800 2024-09-14T09:09:03.894 INFO:teuthology.orchestra.run.smithi148.stdout:4543 write 0xdfe3200 thru 0xdfe371e (0x51f bytes) 2024-09-14T09:09:03.894 INFO:teuthology.orchestra.run.smithi148.stdout:4548 trunc from 0xdfe3800 to 0x86fda00 2024-09-14T09:09:03.894 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:09:03.921 INFO:teuthology.orchestra.run.smithi148.stdout:4549 write 0xddab400 thru 0xddb2c32 (0x7833 bytes) 2024-09-14T09:09:03.921 INFO:teuthology.orchestra.run.smithi148.stdout:4550 write 0x849a800 thru 0x84a1c9e (0x749f bytes) 2024-09-14T09:09:03.921 INFO:teuthology.orchestra.run.smithi148.stdout:4551 punch from 0x6e1e000 to 0x6e25400, (0x7400 bytes) 2024-09-14T09:09:03.921 INFO:teuthology.orchestra.run.smithi148.stdout:4552 write 0xd100000 thru 0xd10322b (0x322c bytes) 2024-09-14T09:09:03.935 INFO:teuthology.orchestra.run.smithi148.stdout:4553 trunc from 0xddb2e00 to 0x2513800 2024-09-14T09:09:03.964 INFO:teuthology.orchestra.run.smithi148.stdout:4555 read 0x25f200 thru 0x264cd1 (0x5ad2 bytes) 2024-09-14T09:09:03.984 INFO:teuthology.orchestra.run.smithi148.stdout:4557 write 0x511be00 thru 0x5122134 (0x6335 bytes) 2024-09-14T09:09:03.992 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:03.994+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:03.996 INFO:teuthology.orchestra.run.smithi148.stdout:4560 trunc from 0x5122200 to 0xe955400 2024-09-14T09:09:04.009 INFO:teuthology.orchestra.run.smithi148.stdout:4562 punch from 0xbb2aa00 to 0xbb33600, (0x8c00 bytes) 2024-09-14T09:09:04.013 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:04.013 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "" 2024-09-14T09:09:04.013 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:04.015 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:04.015 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:04.015 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:09:04.015 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:04.017 INFO:teuthology.orchestra.run.smithi148.stdout:4564 write 0xc7c0000 thru 0xc7c4ea6 (0x4ea7 bytes) 2024-09-14T09:09:04.018 INFO:teuthology.orchestra.run.smithi148.stdout:4565 write 0xa627a00 thru 0xa634610 (0xcc11 bytes) 2024-09-14T09:09:04.026 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:09:04.032 INFO:teuthology.orchestra.run.smithi148.stdout:4567 trunc from 0xe955400 to 0x22ac600 2024-09-14T09:09:04.073 INFO:teuthology.orchestra.run.smithi148.stdout:4568 write 0x9c29800 thru 0x9c32dd3 (0x95d4 bytes) 2024-09-14T09:09:04.073 INFO:teuthology.orchestra.run.smithi148.stdout:4572 punch from 0x6426600 to 0x6433c00, (0xd600 bytes) 2024-09-14T09:09:04.074 INFO:teuthology.orchestra.run.smithi148.stdout:4573 read 0x67db600 thru 0x67e862f (0xd030 bytes) 2024-09-14T09:09:04.074 INFO:teuthology.orchestra.run.smithi148.stdout:4575 punch from 0x8e1b800 to 0x8e23200, (0x7a00 bytes) 2024-09-14T09:09:04.074 INFO:teuthology.orchestra.run.smithi148.stdout:4577 read 0x340f600 thru 0x3416a00 (0x7401 bytes) 2024-09-14T09:09:04.074 INFO:teuthology.orchestra.run.smithi148.stdout:4578 trunc from 0x9c32e00 to 0x9aeba00 2024-09-14T09:09:04.093 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:04.095+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:04.098 INFO:teuthology.orchestra.run.smithi148.stdout:4579 trunc from 0x9aeba00 to 0xb720200 2024-09-14T09:09:04.106 INFO:teuthology.orchestra.run.smithi148.stdout:4582 read 0x1c7ec00 thru 0x1c878d0 (0x8cd1 bytes) 2024-09-14T09:09:04.107 INFO:teuthology.orchestra.run.smithi148.stdout:4583 punch from 0x4bdf800 to 0x4be8e00, (0x9600 bytes) 2024-09-14T09:09:04.108 INFO:teuthology.orchestra.run.smithi148.stdout:4584 write 0x38fb600 thru 0x38fb907 (0x308 bytes) 2024-09-14T09:09:04.110 INFO:teuthology.orchestra.run.smithi148.stdout:4587 trunc from 0xb720200 to 0x9a67400 2024-09-14T09:09:04.123 INFO:teuthology.orchestra.run.smithi148.stdout:4589 write 0x7edb600 thru 0x7edc8e7 (0x12e8 bytes) 2024-09-14T09:09:04.125 INFO:teuthology.orchestra.run.smithi148.stdout:4590 punch from 0x84d0a00 to 0x84e0600, (0xfc00 bytes) 2024-09-14T09:09:04.125 INFO:teuthology.orchestra.run.smithi148.stdout:4591 punch from 0x52b9400 to 0x52be400, (0x5000 bytes) 2024-09-14T09:09:04.140 INFO:teuthology.orchestra.run.smithi148.stdout:4593 write 0xc6f5200 thru 0xc6fb016 (0x5e17 bytes) 2024-09-14T09:09:04.140 INFO:teuthology.orchestra.run.smithi148.stdout:4594 punch from 0x7c58000 to 0x7c63200, (0xb200 bytes) 2024-09-14T09:09:04.153 INFO:teuthology.orchestra.run.smithi148.stdout:4595 write 0xdd82800 thru 0xdd8fe76 (0xd677 bytes) 2024-09-14T09:09:04.167 INFO:teuthology.orchestra.run.smithi148.stdout:4596 write 0xe434200 thru 0xe442b26 (0xe927 bytes) 2024-09-14T09:09:04.168 INFO:teuthology.orchestra.run.smithi148.stdout:4597 punch from 0x8a85e00 to 0x8a8cc00, (0x6e00 bytes) 2024-09-14T09:09:04.168 INFO:teuthology.orchestra.run.smithi148.stdout:4598 read 0x66a6600 thru 0x66ac6f5 (0x60f6 bytes) 2024-09-14T09:09:04.181 INFO:teuthology.orchestra.run.smithi148.stdout:4599 trunc from 0xe442c00 to 0x28fd000 2024-09-14T09:09:04.194 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:04.196+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:04.197 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:04.197 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:04.197 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:04.197 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:04.197 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:04.210 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:09:04.220 INFO:teuthology.orchestra.run.smithi148.stdout:4601 read 0x26b9600 thru 0x26c513f (0xbb40 bytes) 2024-09-14T09:09:04.220 INFO:teuthology.orchestra.run.smithi148.stdout:4602 read 0x2440200 thru 0x24473fa (0x71fb bytes) 2024-09-14T09:09:04.220 INFO:teuthology.orchestra.run.smithi148.stdout:4604 punch from 0x2542a00 to 0x2545a00, (0x3000 bytes) 2024-09-14T09:09:04.220 INFO:teuthology.orchestra.run.smithi148.stdout:4605 read 0x329e00 thru 0x338aa6 (0xeca7 bytes) 2024-09-14T09:09:04.245 INFO:teuthology.orchestra.run.smithi148.stdout:4608 write 0xb418800 thru 0xb424ba7 (0xc3a8 bytes) 2024-09-14T09:09:04.246 INFO:teuthology.orchestra.run.smithi148.stdout:4609 write 0x36c8400 thru 0x36d0a88 (0x8689 bytes) 2024-09-14T09:09:04.267 INFO:teuthology.orchestra.run.smithi148.stdout:4610 write 0xc400400 thru 0xc40d1c6 (0xcdc7 bytes) 2024-09-14T09:09:04.267 INFO:teuthology.orchestra.run.smithi148.stdout:4611 punch from 0x7309400 to 0x7314a00, (0xb600 bytes) 2024-09-14T09:09:04.267 INFO:teuthology.orchestra.run.smithi148.stdout:4612 read 0x7564a00 thru 0x756ca99 (0x809a bytes) 2024-09-14T09:09:04.267 INFO:teuthology.orchestra.run.smithi148.stdout:4613 write 0x8c2c600 thru 0x8c32b90 (0x6591 bytes) 2024-09-14T09:09:04.267 INFO:teuthology.orchestra.run.smithi148.stdout:4614 punch from 0x51c9600 to 0x51d6a00, (0xd400 bytes) 2024-09-14T09:09:04.268 INFO:teuthology.orchestra.run.smithi148.stdout:4616 write 0x201fa00 thru 0x202224c (0x284d bytes) 2024-09-14T09:09:04.268 INFO:teuthology.orchestra.run.smithi148.stdout:4619 punch from 0x2f21600 to 0x2f21a00, (0x400 bytes) 2024-09-14T09:09:04.268 INFO:teuthology.orchestra.run.smithi148.stdout:4620 read 0x395d000 thru 0x3965614 (0x8615 bytes) 2024-09-14T09:09:04.269 INFO:teuthology.orchestra.run.smithi148.stdout:4621 write 0xa81e00 thru 0xa8a1ea (0x83eb bytes) 2024-09-14T09:09:04.269 INFO:teuthology.orchestra.run.smithi148.stdout:4622 write 0x3f65e00 thru 0x3f6fb9f (0x9da0 bytes) 2024-09-14T09:09:04.269 INFO:teuthology.orchestra.run.smithi148.stdout:4623 write 0x9101e00 thru 0x910f69c (0xd89d bytes) 2024-09-14T09:09:04.269 INFO:teuthology.orchestra.run.smithi148.stdout:4625 write 0x79b2c00 thru 0x79be1e9 (0xb5ea bytes) 2024-09-14T09:09:04.269 INFO:teuthology.orchestra.run.smithi148.stdout:4628 write 0x7979800 thru 0x79888d7 (0xf0d8 bytes) 2024-09-14T09:09:04.281 INFO:teuthology.orchestra.run.smithi148.stdout:4631 trunc from 0xc40d200 to 0x1521600 2024-09-14T09:09:04.294 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:04.296+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:04.362 INFO:teuthology.orchestra.run.smithi148.stdout:4632 write 0xdf76c00 thru 0xdf7eb53 (0x7f54 bytes) 2024-09-14T09:09:04.362 INFO:teuthology.orchestra.run.smithi148.stdout:4633 read 0x3c6ac00 thru 0x3c725be (0x79bf bytes) 2024-09-14T09:09:04.362 INFO:teuthology.orchestra.run.smithi148.stdout:4634 punch from 0x6011000 to 0x6020600, (0xf600 bytes) 2024-09-14T09:09:04.367 INFO:teuthology.orchestra.run.smithi148.stdout:4637 trunc from 0xdf7ec00 to 0x95d3c00 2024-09-14T09:09:04.378 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:04.378 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:04.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:04.378 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:04.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.378 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:246 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:04.378 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:09:04.378 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.582484514000001, 2024-09-14T09:09:04.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99004581000000003, 2024-09-14T09:09:04.379 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.379 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.379 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.379 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.379 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:04.379 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:04.379 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 246 2024-09-14T09:09:04.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.379 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:09:04.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:09:04.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796750+0000", 2024-09-14T09:09:04.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5519999999999999e-06 2024-09-14T09:09:04.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796754+0000", 2024-09-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2640000000000002e-06 2024-09-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796767+0000", 2024-09-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3517e-05 2024-09-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796775+0000", 2024-09-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8790000000000003e-06 2024-09-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796830+0000", 2024-09-14T09:09:04.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4829e-05 2024-09-14T09:09:04.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:04.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796843+0000", 2024-09-14T09:09:04.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.33e-05 2024-09-14T09:09:04.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786501+0000", 2024-09-14T09:09:04.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98965769299999995 2024-09-14T09:09:04.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786653+0000", 2024-09-14T09:09:04.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015237200000000001 2024-09-14T09:09:04.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786794+0000", 2024-09-14T09:09:04.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014040400000000001 2024-09-14T09:09:04.383 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.383 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.383 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.383 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:247 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 720896~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:04.383 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:09:04.383 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.582429728000001, 2024-09-14T09:09:04.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99048688100000004, 2024-09-14T09:09:04.384 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.384 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.384 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.384 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.384 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:04.384 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:04.384 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 247 2024-09-14T09:09:04.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.384 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:09:04.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:09:04.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:09:04.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7299999999999995e-07 2024-09-14T09:09:04.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796807+0000", 2024-09-14T09:09:04.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.106e-06 2024-09-14T09:09:04.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796815+0000", 2024-09-14T09:09:04.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4740000000000005e-06 2024-09-14T09:09:04.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796821+0000", 2024-09-14T09:09:04.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0469999999999999e-06 2024-09-14T09:09:04.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796872+0000", 2024-09-14T09:09:04.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0834000000000002e-05 2024-09-14T09:09:04.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:04.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796878+0000", 2024-09-14T09:09:04.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2990000000000002e-06 2024-09-14T09:09:04.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787176+0000", 2024-09-14T09:09:04.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99029817600000003 2024-09-14T09:09:04.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787225+0000", 2024-09-14T09:09:04.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8953999999999999e-05 2024-09-14T09:09:04.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787290+0000", 2024-09-14T09:09:04.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4318000000000003e-05 2024-09-14T09:09:04.388 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.388 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.388 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.389 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:248 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1179648~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:04.389 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:09:04.389 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.582399209000002, 2024-09-14T09:09:04.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99060754200000001, 2024-09-14T09:09:04.389 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.389 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.389 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.389 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.389 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:04.389 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:04.390 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 248 2024-09-14T09:09:04.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.390 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:09:04.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:09:04.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796834+0000", 2024-09-14T09:09:04.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4099999999999999e-07 2024-09-14T09:09:04.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796837+0000", 2024-09-14T09:09:04.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8459999999999999e-06 2024-09-14T09:09:04.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796844+0000", 2024-09-14T09:09:04.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1350000000000003e-06 2024-09-14T09:09:04.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796850+0000", 2024-09-14T09:09:04.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7139999999999998e-06 2024-09-14T09:09:04.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:04.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3909999999999998e-05 2024-09-14T09:09:04.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:04.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796899+0000", 2024-09-14T09:09:04.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7649999999999999e-06 2024-09-14T09:09:04.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787318+0000", 2024-09-14T09:09:04.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99041848300000002 2024-09-14T09:09:04.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787365+0000", 2024-09-14T09:09:04.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7086999999999998e-05 2024-09-14T09:09:04.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787441+0000", 2024-09-14T09:09:04.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6061000000000002e-05 2024-09-14T09:09:04.394 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.394 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.394 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.394 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:249 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1638400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:04.394 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:04.394 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.582365439999997, 2024-09-14T09:09:04.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99070346899999995, 2024-09-14T09:09:04.394 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.394 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.394 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.395 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.395 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:04.395 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:04.395 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 249 2024-09-14T09:09:04.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.395 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:04.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:04.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796868+0000", 2024-09-14T09:09:04.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2024-09-14T09:09:04.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796870+0000", 2024-09-14T09:09:04.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7889999999999999e-06 2024-09-14T09:09:04.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796877+0000", 2024-09-14T09:09:04.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8549999999999996e-06 2024-09-14T09:09:04.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796883+0000", 2024-09-14T09:09:04.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.665e-06 2024-09-14T09:09:04.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796915+0000", 2024-09-14T09:09:04.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2215999999999998e-05 2024-09-14T09:09:04.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:04.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796920+0000", 2024-09-14T09:09:04.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.527e-06 2024-09-14T09:09:04.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787468+0000", 2024-09-14T09:09:04.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99054877100000005 2024-09-14T09:09:04.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787512+0000", 2024-09-14T09:09:04.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3958000000000002e-05 2024-09-14T09:09:04.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787571+0000", 2024-09-14T09:09:04.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8167000000000001e-05 2024-09-14T09:09:04.399 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.399 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.399 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.399 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:250 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2097152~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:04.399 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:04.399 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.582339374, 2024-09-14T09:09:04.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99079431100000004, 2024-09-14T09:09:04.400 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.400 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.400 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.400 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.400 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:04.400 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:04.400 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 250 2024-09-14T09:09:04.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.400 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:04.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:04.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796894+0000", 2024-09-14T09:09:04.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2024-09-14T09:09:04.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796896+0000", 2024-09-14T09:09:04.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5600000000000001e-06 2024-09-14T09:09:04.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796902+0000", 2024-09-14T09:09:04.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3090000000000001e-06 2024-09-14T09:09:04.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796909+0000", 2024-09-14T09:09:04.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:09:04.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796942+0000", 2024-09-14T09:09:04.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-05 2024-09-14T09:09:04.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:04.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796948+0000", 2024-09-14T09:09:04.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5910000000000001e-06 2024-09-14T09:09:04.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787596+0000", 2024-09-14T09:09:04.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99064781400000002 2024-09-14T09:09:04.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787636+0000", 2024-09-14T09:09:04.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9715000000000002e-05 2024-09-14T09:09:04.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787687+0000", 2024-09-14T09:09:04.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1674e-05 2024-09-14T09:09:04.404 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.404 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.404 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.405 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:251 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:04.405 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:04.405 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.582313939000002, 2024-09-14T09:09:04.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99091769600000001, 2024-09-14T09:09:04.405 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.405 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.405 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.405 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.405 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:04.405 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:04.405 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 251 2024-09-14T09:09:04.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.406 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:04.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:04.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:04.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000005e-07 2024-09-14T09:09:04.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796922+0000", 2024-09-14T09:09:04.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.875e-06 2024-09-14T09:09:04.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796929+0000", 2024-09-14T09:09:04.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0260000000000002e-06 2024-09-14T09:09:04.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796935+0000", 2024-09-14T09:09:04.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7030000000000003e-06 2024-09-14T09:09:04.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796963+0000", 2024-09-14T09:09:04.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8368999999999999e-05 2024-09-14T09:09:04.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:04.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796966+0000", 2024-09-14T09:09:04.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4130000000000002e-06 2024-09-14T09:09:04.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787718+0000", 2024-09-14T09:09:04.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99075151100000003 2024-09-14T09:09:04.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787779+0000", 2024-09-14T09:09:04.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.088e-05 2024-09-14T09:09:04.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787836+0000", 2024-09-14T09:09:04.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7380000000000003e-05 2024-09-14T09:09:04.410 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.410 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.410 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.410 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:252 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:04.410 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:04.411 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.582288484999999, 2024-09-14T09:09:04.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99102491400000003, 2024-09-14T09:09:04.411 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.411 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.411 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.411 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.411 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:04.411 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:04.411 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 252 2024-09-14T09:09:04.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.411 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:04.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:04.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796945+0000", 2024-09-14T09:09:04.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2900000000000003e-07 2024-09-14T09:09:04.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796947+0000", 2024-09-14T09:09:04.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4279999999999999e-06 2024-09-14T09:09:04.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796954+0000", 2024-09-14T09:09:04.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5479999999999998e-06 2024-09-14T09:09:04.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796959+0000", 2024-09-14T09:09:04.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.22e-06 2024-09-14T09:09:04.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796988+0000", 2024-09-14T09:09:04.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9473000000000001e-05 2024-09-14T09:09:04.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:04.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:04.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:09:04.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787850+0000", 2024-09-14T09:09:04.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99085651100000005 2024-09-14T09:09:04.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787891+0000", 2024-09-14T09:09:04.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602000000000002e-05 2024-09-14T09:09:04.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787969+0000", 2024-09-14T09:09:04.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8063000000000001e-05 2024-09-14T09:09:04.415 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.415 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.416 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.416 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:253 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:04.416 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:04.416 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.582264604999999, 2024-09-14T09:09:04.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99122695699999996, 2024-09-14T09:09:04.416 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.416 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.416 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.416 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.416 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:04.416 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:04.416 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 253 2024-09-14T09:09:04.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.417 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:04.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:04.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:04.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:09:04.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:09:04.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:09:04.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796977+0000", 2024-09-14T09:09:04.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5030000000000002e-06 2024-09-14T09:09:04.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796982+0000", 2024-09-14T09:09:04.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2024-09-14T09:09:04.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797013+0000", 2024-09-14T09:09:04.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0451e-05 2024-09-14T09:09:04.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:04.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:09:04.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1690000000000001e-06 2024-09-14T09:09:04.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788011+0000", 2024-09-14T09:09:04.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99099490300000004 2024-09-14T09:09:04.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788102+0000", 2024-09-14T09:09:04.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0730999999999996e-05 2024-09-14T09:09:04.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788195+0000", 2024-09-14T09:09:04.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3245999999999995e-05 2024-09-14T09:09:04.421 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.421 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.421 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.421 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:254 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3932160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:04.421 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:04.421 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.582233047000003, 2024-09-14T09:09:04.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99137410500000001, 2024-09-14T09:09:04.421 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.422 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.422 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.422 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.422 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:04.422 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:04.422 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 254 2024-09-14T09:09:04.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.422 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:04.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:04.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797000+0000", 2024-09-14T09:09:04.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:09:04.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797003+0000", 2024-09-14T09:09:04.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7659999999999999e-06 2024-09-14T09:09:04.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797010+0000", 2024-09-14T09:09:04.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.029e-06 2024-09-14T09:09:04.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:04.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2024-09-14T09:09:04.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797044+0000", 2024-09-14T09:09:04.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9213e-05 2024-09-14T09:09:04.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:04.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797048+0000", 2024-09-14T09:09:04.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3400000000000002e-06 2024-09-14T09:09:04.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788222+0000", 2024-09-14T09:09:04.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99117407400000002 2024-09-14T09:09:04.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788306+0000", 2024-09-14T09:09:04.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4512999999999995e-05 2024-09-14T09:09:04.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788374+0000", 2024-09-14T09:09:04.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7226999999999999e-05 2024-09-14T09:09:04.426 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.426 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.427 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.427 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:264 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:04.427 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:04.427 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.582206689000003, 2024-09-14T09:09:04.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99161474699999996, 2024-09-14T09:09:04.427 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.427 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.427 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.427 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.427 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:04.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:04.428 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 264 2024-09-14T09:09:04.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.428 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:04.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:04.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:04.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2024-09-14T09:09:04.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:09:04.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2800000000000002e-06 2024-09-14T09:09:04.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:04.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0979999999999999e-06 2024-09-14T09:09:04.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797040+0000", 2024-09-14T09:09:04.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:09:04.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797068+0000", 2024-09-14T09:09:04.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7302999999999999e-05 2024-09-14T09:09:04.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:04.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797071+0000", 2024-09-14T09:09:04.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3610000000000001e-06 2024-09-14T09:09:04.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788436+0000", 2024-09-14T09:09:04.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99136489500000002 2024-09-14T09:09:04.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788538+0000", 2024-09-14T09:09:04.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101931 2024-09-14T09:09:04.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788641+0000", 2024-09-14T09:09:04.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010273899999999999 2024-09-14T09:09:04.432 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.432 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.432 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.432 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:265 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:04.432 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:04.432 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.582183329999999, 2024-09-14T09:09:04.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99176878199999996, 2024-09-14T09:09:04.433 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.433 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.433 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.433 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.433 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:04.433 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:04.433 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 265 2024-09-14T09:09:04.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.433 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:04.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:04.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:09:04.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.39e-07 2024-09-14T09:09:04.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797052+0000", 2024-09-14T09:09:04.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.345e-06 2024-09-14T09:09:04.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797058+0000", 2024-09-14T09:09:04.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5429999999999999e-06 2024-09-14T09:09:04.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797064+0000", 2024-09-14T09:09:04.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2000000000000002e-06 2024-09-14T09:09:04.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797091+0000", 2024-09-14T09:09:04.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7804e-05 2024-09-14T09:09:04.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:04.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797095+0000", 2024-09-14T09:09:04.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2024-09-14T09:09:04.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788667+0000", 2024-09-14T09:09:04.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157211300000003 2024-09-14T09:09:04.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788742+0000", 2024-09-14T09:09:04.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5159000000000003e-05 2024-09-14T09:09:04.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788818+0000", 2024-09-14T09:09:04.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6038000000000006e-05 2024-09-14T09:09:04.437 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.437 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.437 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.438 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:266 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:04.438 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:04.438 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.582160498999997, 2024-09-14T09:09:04.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99193390100000001, 2024-09-14T09:09:04.438 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.438 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.438 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.438 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.438 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:04.438 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:04.438 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 266 2024-09-14T09:09:04.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.438 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:04.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:04.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:04.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:09:04.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797075+0000", 2024-09-14T09:09:04.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2570000000000002e-06 2024-09-14T09:09:04.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797082+0000", 2024-09-14T09:09:04.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8029999999999997e-06 2024-09-14T09:09:04.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797088+0000", 2024-09-14T09:09:04.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.468e-06 2024-09-14T09:09:04.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797116+0000", 2024-09-14T09:09:04.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7752000000000001e-05 2024-09-14T09:09:04.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:04.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797121+0000", 2024-09-14T09:09:04.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5960000000000003e-06 2024-09-14T09:09:04.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788846+0000", 2024-09-14T09:09:04.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99172512199999996 2024-09-14T09:09:04.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788916+0000", 2024-09-14T09:09:04.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9843000000000002e-05 2024-09-14T09:09:04.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789006+0000", 2024-09-14T09:09:04.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9608e-05 2024-09-14T09:09:04.443 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.443 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.443 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.443 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:267 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:04.443 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:04.443 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.582135692000001, 2024-09-14T09:09:04.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99210926799999999, 2024-09-14T09:09:04.443 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.443 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.443 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.443 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.443 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:04.444 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:04.444 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 267 2024-09-14T09:09:04.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.444 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:04.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:04.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:04.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2399999999999999e-07 2024-09-14T09:09:04.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797099+0000", 2024-09-14T09:09:04.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.091e-06 2024-09-14T09:09:04.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797105+0000", 2024-09-14T09:09:04.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-09-14T09:09:04.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797111+0000", 2024-09-14T09:09:04.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5130000000000004e-06 2024-09-14T09:09:04.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797140+0000", 2024-09-14T09:09:04.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9513999999999999e-05 2024-09-14T09:09:04.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:04.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797145+0000", 2024-09-14T09:09:04.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:09:04.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789037+0000", 2024-09-14T09:09:04.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99189253899999996 2024-09-14T09:09:04.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789110+0000", 2024-09-14T09:09:04.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2848000000000005e-05 2024-09-14T09:09:04.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789206+0000", 2024-09-14T09:09:04.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5778000000000004e-05 2024-09-14T09:09:04.448 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.448 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.448 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.448 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:268 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:04.448 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:04.448 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.582112453000001, 2024-09-14T09:09:04.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992276359, 2024-09-14T09:09:04.448 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.449 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.449 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.449 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.449 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:04.449 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:04.449 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 268 2024-09-14T09:09:04.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.449 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:04.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:04.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:04.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:09:04.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797123+0000", 2024-09-14T09:09:04.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2740000000000002e-06 2024-09-14T09:09:04.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797129+0000", 2024-09-14T09:09:04.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-06 2024-09-14T09:09:04.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797134+0000", 2024-09-14T09:09:04.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9099999999999996e-06 2024-09-14T09:09:04.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797163+0000", 2024-09-14T09:09:04.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9709999999999998e-05 2024-09-14T09:09:04.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:04.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:04.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8709999999999999e-06 2024-09-14T09:09:04.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789231+0000", 2024-09-14T09:09:04.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992063959 2024-09-14T09:09:04.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789306+0000", 2024-09-14T09:09:04.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5289000000000004e-05 2024-09-14T09:09:04.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789396+0000", 2024-09-14T09:09:04.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9939999999999996e-05 2024-09-14T09:09:04.453 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.453 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.453 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.454 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:269 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2457600~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:04.454 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:04.454 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.582088943999999, 2024-09-14T09:09:04.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99242174400000005, 2024-09-14T09:09:04.454 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.454 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.454 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.454 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.454 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:04.454 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:04.454 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 269 2024-09-14T09:09:04.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.454 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:04.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:04.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:04.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:09:04.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797146+0000", 2024-09-14T09:09:04.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5289999999999998e-06 2024-09-14T09:09:04.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797153+0000", 2024-09-14T09:09:04.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1920000000000002e-06 2024-09-14T09:09:04.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797158+0000", 2024-09-14T09:09:04.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099999999999998e-06 2024-09-14T09:09:04.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797188+0000", 2024-09-14T09:09:04.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0128e-05 2024-09-14T09:09:04.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:04.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797194+0000", 2024-09-14T09:09:04.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6250000000000004e-06 2024-09-14T09:09:04.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789439+0000", 2024-09-14T09:09:04.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99224531000000005 2024-09-14T09:09:04.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789489+0000", 2024-09-14T09:09:04.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9830000000000002e-05 2024-09-14T09:09:04.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789565+0000", 2024-09-14T09:09:04.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6229000000000005e-05 2024-09-14T09:09:04.459 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.459 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.459 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.459 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:270 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:04.459 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:04.459 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.582065122000003, 2024-09-14T09:09:04.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99257721899999996, 2024-09-14T09:09:04.459 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.460 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.460 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.460 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.460 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:04.460 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:04.460 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 270 2024-09-14T09:09:04.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.460 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:04.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:04.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797168+0000", 2024-09-14T09:09:04.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2024-09-14T09:09:04.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797170+0000", 2024-09-14T09:09:04.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3120000000000001e-06 2024-09-14T09:09:04.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797177+0000", 2024-09-14T09:09:04.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0960000000000003e-06 2024-09-14T09:09:04.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797183+0000", 2024-09-14T09:09:04.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1669999999999998e-06 2024-09-14T09:09:04.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797213+0000", 2024-09-14T09:09:04.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0494e-05 2024-09-14T09:09:04.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:04.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:09:04.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:09:04.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789586+0000", 2024-09-14T09:09:04.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99236692100000001 2024-09-14T09:09:04.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789658+0000", 2024-09-14T09:09:04.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2279000000000004e-05 2024-09-14T09:09:04.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789745+0000", 2024-09-14T09:09:04.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6698000000000002e-05 2024-09-14T09:09:04.464 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.464 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.464 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.464 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:271 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3375104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:04.464 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:04.465 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.582039924, 2024-09-14T09:09:04.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99274791699999998, 2024-09-14T09:09:04.465 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.465 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.465 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.465 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.465 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:04.465 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:04.465 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 271 2024-09-14T09:09:04.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.465 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:04.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:04.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:04.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:09:04.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797195+0000", 2024-09-14T09:09:04.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1639999999999999e-06 2024-09-14T09:09:04.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797201+0000", 2024-09-14T09:09:04.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1290000000000001e-06 2024-09-14T09:09:04.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797206+0000", 2024-09-14T09:09:04.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9300000000000002e-06 2024-09-14T09:09:04.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797237+0000", 2024-09-14T09:09:04.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1285000000000003e-05 2024-09-14T09:09:04.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:04.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797242+0000", 2024-09-14T09:09:04.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6e-06 2024-09-14T09:09:04.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789768+0000", 2024-09-14T09:09:04.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99252547400000002 2024-09-14T09:09:04.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789826+0000", 2024-09-14T09:09:04.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8155999999999997e-05 2024-09-14T09:09:04.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789940+0000", 2024-09-14T09:09:04.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114788 2024-09-14T09:09:04.469 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.469 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.469 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.470 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:272 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:04.470 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:04.470 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.582016529999997, 2024-09-14T09:09:04.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99285248800000003, 2024-09-14T09:09:04.470 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.470 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.470 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.470 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.470 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:04.470 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:04.470 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 272 2024-09-14T09:09:04.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.471 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:04.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:04.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:04.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:09:04.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:09:04.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5129999999999999e-06 2024-09-14T09:09:04.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797226+0000", 2024-09-14T09:09:04.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4529999999999996e-06 2024-09-14T09:09:04.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797232+0000", 2024-09-14T09:09:04.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1839999999999998e-06 2024-09-14T09:09:04.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797264+0000", 2024-09-14T09:09:04.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2691999999999998e-05 2024-09-14T09:09:04.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:04.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797270+0000", 2024-09-14T09:09:04.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-06 2024-09-14T09:09:04.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789965+0000", 2024-09-14T09:09:04.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99269526200000002 2024-09-14T09:09:04.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790021+0000", 2024-09-14T09:09:04.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5297000000000003e-05 2024-09-14T09:09:04.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790068+0000", 2024-09-14T09:09:04.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7664999999999998e-05 2024-09-14T09:09:04.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.475 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.475 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.475 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5006.0:4897 3.1b 3:dc4939f3:::rbd_object_map.11125497cb52:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-14T09:09:04.475 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:45.922622+0000", 2024-09-14T09:09:04.475 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.456610273999999, 2024-09-14T09:09:04.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011994009, 2024-09-14T09:09:04.475 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.475 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.475 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:04.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5006", 2024-09-14T09:09:04.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/3107765484", 2024-09-14T09:09:04.475 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4897 2024-09-14T09:09:04.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.476 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922622+0000", 2024-09-14T09:09:04.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922622+0000", 2024-09-14T09:09:04.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922623+0000", 2024-09-14T09:09:04.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2999999999999999e-07 2024-09-14T09:09:04.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922628+0000", 2024-09-14T09:09:04.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.459e-06 2024-09-14T09:09:04.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922639+0000", 2024-09-14T09:09:04.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1099e-05 2024-09-14T09:09:04.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.922650+0000", 2024-09-14T09:09:04.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1695999999999999e-05 2024-09-14T09:09:04.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.925576+0000", 2024-09-14T09:09:04.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002925839 2024-09-14T09:09:04.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.925628+0000", 2024-09-14T09:09:04.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1536000000000003e-05 2024-09-14T09:09:04.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:09:04.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.925833+0000", 2024-09-14T09:09:04.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00020529000000000001 2024-09-14T09:09:04.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:09:04.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.927960+0000", 2024-09-14T09:09:04.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021266169999999999 2024-09-14T09:09:04.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:04.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934526+0000", 2024-09-14T09:09:04.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006566293 2024-09-14T09:09:04.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:09:04.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934576+0000", 2024-09-14T09:09:04.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0022000000000003e-05 2024-09-14T09:09:04.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934616+0000", 2024-09-14T09:09:04.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0228000000000002e-05 2024-09-14T09:09:04.480 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.480 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.481 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.481 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5006.0:4898 3.1b 3:dc4939f3:::rbd_object_map.11125497cb52:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-14T09:09:04.481 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:45.923037+0000", 2024-09-14T09:09:04.481 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.456195032, 2024-09-14T09:09:04.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011707255, 2024-09-14T09:09:04.481 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.481 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.481 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:04.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5006", 2024-09-14T09:09:04.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/3107765484", 2024-09-14T09:09:04.482 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4898 2024-09-14T09:09:04.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.482 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923037+0000", 2024-09-14T09:09:04.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923037+0000", 2024-09-14T09:09:04.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923038+0000", 2024-09-14T09:09:04.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5199999999999996e-07 2024-09-14T09:09:04.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923045+0000", 2024-09-14T09:09:04.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9280000000000004e-06 2024-09-14T09:09:04.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923052+0000", 2024-09-14T09:09:04.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0180000000000004e-06 2024-09-14T09:09:04.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.923057+0000", 2024-09-14T09:09:04.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5970000000000002e-06 2024-09-14T09:09:04.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.926369+0000", 2024-09-14T09:09:04.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003312204 2024-09-14T09:09:04.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.926458+0000", 2024-09-14T09:09:04.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8682000000000002e-05 2024-09-14T09:09:04.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:09:04.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.926817+0000", 2024-09-14T09:09:04.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00035913200000000002 2024-09-14T09:09:04.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:09:04.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.928477+0000", 2024-09-14T09:09:04.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016600250000000001 2024-09-14T09:09:04.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:04.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934653+0000", 2024-09-14T09:09:04.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061763089999999996 2024-09-14T09:09:04.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:09:04.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934706+0000", 2024-09-14T09:09:04.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2475000000000002e-05 2024-09-14T09:09:04.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:45.934745+0000", 2024-09-14T09:09:04.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9133e-05 2024-09-14T09:09:04.486 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.487 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.487 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.487 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:04.488 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:04.490+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:04.490 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:09:04.490 INFO:teuthology.orchestra.run.smithi148.stdout:4640 trunc from 0x95d3c00 to 0x38c3c00 2024-09-14T09:09:04.490 INFO:teuthology.orchestra.run.smithi148.stdout:4641 read 0x1f4a00 thru 0x1f54c8 (0xac9 bytes) 2024-09-14T09:09:04.490 INFO:teuthology.orchestra.run.smithi148.stdout:4642 read 0x1571e00 thru 0x1574808 (0x2a09 bytes) 2024-09-14T09:09:04.491 INFO:teuthology.orchestra.run.smithi148.stdout:4643 trunc from 0x38c3c00 to 0x94bbe00 2024-09-14T09:09:04.491 INFO:teuthology.orchestra.run.smithi148.stdout:4644 punch from 0x83f4600 to 0x83fd800, (0x9200 bytes) 2024-09-14T09:09:04.491 INFO:teuthology.orchestra.run.smithi148.stdout:4646 read 0x4f36800 thru 0x4f3f72c (0x8f2d bytes) 2024-09-14T09:09:04.491 INFO:teuthology.orchestra.run.smithi148.stdout:4647 trunc from 0x94bbe00 to 0x1bea200 2024-09-14T09:09:04.491 INFO:teuthology.orchestra.run.smithi148.stdout:4648 read 0x158d000 thru 0x1597ca5 (0xaca6 bytes) 2024-09-14T09:09:04.491 INFO:teuthology.orchestra.run.smithi148.stdout:4649 write 0x7a46c00 thru 0x7a48a07 (0x1e08 bytes) 2024-09-14T09:09:04.491 INFO:teuthology.orchestra.run.smithi148.stdout:4652 trunc from 0x7a48c00 to 0x129b800 2024-09-14T09:09:04.510 INFO:teuthology.orchestra.run.smithi148.stdout:4654 punch from 0x3a8c00 to 0x3a8e00, (0x200 bytes) 2024-09-14T09:09:04.512 INFO:teuthology.orchestra.run.smithi148.stdout:4655 read 0x81b600 thru 0x81cc87 (0x1688 bytes) 2024-09-14T09:09:04.512 INFO:teuthology.orchestra.run.smithi148.stdout:4656 read 0x1152400 thru 0x1153abc (0x16bd bytes) 2024-09-14T09:09:04.512 INFO:teuthology.orchestra.run.smithi148.stdout:4657 punch from 0x2ea200 to 0x2ed800, (0x3600 bytes) 2024-09-14T09:09:04.529 INFO:teuthology.orchestra.run.smithi148.stdout:4659 write 0x6584800 thru 0x658d9f8 (0x91f9 bytes) 2024-09-14T09:09:04.534 INFO:teuthology.orchestra.run.smithi148.stdout:4665 punch from 0x509cc00 to 0x509e400, (0x1800 bytes) 2024-09-14T09:09:04.534 INFO:teuthology.orchestra.run.smithi148.stdout:4666 read 0x58a8e00 thru 0x58ac5aa (0x37ab bytes) 2024-09-14T09:09:04.534 INFO:teuthology.orchestra.run.smithi148.stdout:4668 read 0x11bb600 thru 0x11c34f4 (0x7ef5 bytes) 2024-09-14T09:09:04.534 INFO:teuthology.orchestra.run.smithi148.stdout:4669 read 0x678400 thru 0x67a3b8 (0x1fb9 bytes) 2024-09-14T09:09:04.552 INFO:teuthology.orchestra.run.smithi148.stdout:4670 write 0xa41f400 thru 0xa427141 (0x7d42 bytes) 2024-09-14T09:09:04.559 INFO:teuthology.orchestra.run.smithi148.stdout:4671 read 0x7f05400 thru 0x7f12b0f (0xd710 bytes) 2024-09-14T09:09:04.560 INFO:teuthology.orchestra.run.smithi148.stdout:4672 punch from 0x293b200 to 0x2949400, (0xe200 bytes) 2024-09-14T09:09:04.560 INFO:teuthology.orchestra.run.smithi148.stdout:4673 punch from 0x661da00 to 0x6621600, (0x3c00 bytes) 2024-09-14T09:09:04.560 INFO:teuthology.orchestra.run.smithi148.stdout:4676 write 0x4ca7a00 thru 0x4cb297a (0xaf7b bytes) 2024-09-14T09:09:04.569 INFO:teuthology.orchestra.run.smithi148.stdout:4677 trunc from 0xa427200 to 0x2a7b800 2024-09-14T09:09:04.589 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:04.591+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:04.590 INFO:teuthology.orchestra.run.smithi148.stdout:4678 read 0x22ff600 thru 0x2304826 (0x5227 bytes) 2024-09-14T09:09:04.591 INFO:teuthology.orchestra.run.smithi148.stdout:4682 read 0x1385200 thru 0x138f06d (0x9e6e bytes) 2024-09-14T09:09:04.592 INFO:teuthology.orchestra.run.smithi148.stdout:4686 write 0x2421000 thru 0x242b0e4 (0xa0e5 bytes) 2024-09-14T09:09:04.603 INFO:teuthology.orchestra.run.smithi148.stdout:4687 trunc from 0x2a7b800 to 0xc6fe400 2024-09-14T09:09:04.608 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:04.609 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:04.609 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:09:04.609 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:04.616 INFO:teuthology.orchestra.run.smithi148.stdout:4690 read 0x1dbc400 thru 0x1dbff9c (0x3b9d bytes) 2024-09-14T09:09:04.618 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:09:04.619 INFO:teuthology.orchestra.run.smithi148.stdout:4693 write 0x93cda00 thru 0x93db37e (0xd97f bytes) 2024-09-14T09:09:04.619 INFO:teuthology.orchestra.run.smithi148.stdout:4694 read 0x1e8e400 thru 0x1e91fd2 (0x3bd3 bytes) 2024-09-14T09:09:04.622 INFO:teuthology.orchestra.run.smithi148.stdout:4695 write 0x6da6e00 thru 0x6da8a66 (0x1c67 bytes) 2024-09-14T09:09:04.622 INFO:teuthology.orchestra.run.smithi148.stdout:4698 punch from 0x63a3c00 to 0x63b3200, (0xf600 bytes) 2024-09-14T09:09:04.622 INFO:teuthology.orchestra.run.smithi148.stdout:4702 write 0x10dde00 thru 0x10e244e (0x464f bytes) 2024-09-14T09:09:04.622 INFO:teuthology.orchestra.run.smithi148.stdout:4703 write 0x5075200 thru 0x5082b37 (0xd938 bytes) 2024-09-14T09:09:04.643 INFO:teuthology.orchestra.run.smithi148.stdout:4708 write 0xd41c600 thru 0xd427fc3 (0xb9c4 bytes) 2024-09-14T09:09:04.644 INFO:teuthology.orchestra.run.smithi148.stdout:4709 write 0x6ccca00 thru 0x6ccfc13 (0x3214 bytes) 2024-09-14T09:09:04.647 INFO:teuthology.orchestra.run.smithi148.stdout:4710 trunc from 0xd428000 to 0xac46c00 2024-09-14T09:09:04.665 INFO:teuthology.orchestra.run.smithi148.stdout:4711 write 0x69daa00 thru 0x69e08af (0x5eb0 bytes) 2024-09-14T09:09:04.666 INFO:teuthology.orchestra.run.smithi148.stdout:4712 write 0x96f2000 thru 0x96f6aba (0x4abb bytes) 2024-09-14T09:09:04.666 INFO:teuthology.orchestra.run.smithi148.stdout:4717 read 0x20d0200 thru 0x20d68a1 (0x66a2 bytes) 2024-09-14T09:09:04.683 INFO:teuthology.orchestra.run.smithi148.stdout:4719 write 0xd090800 thru 0xd09914e (0x894f bytes) 2024-09-14T09:09:04.685 INFO:teuthology.orchestra.run.smithi148.stdout:4722 punch from 0x38bb600 to 0x38c1a00, (0x6400 bytes) 2024-09-14T09:09:04.685 INFO:teuthology.orchestra.run.smithi148.stdout:4725 read 0x29cf000 thru 0x29da7c7 (0xb7c8 bytes) 2024-09-14T09:09:04.686 INFO:teuthology.orchestra.run.smithi148.stdout:4727 read 0x1e68e00 thru 0x1e6fbad (0x6dae bytes) 2024-09-14T09:09:04.686 INFO:teuthology.orchestra.run.smithi148.stdout:4728 punch from 0x7585e00 to 0x758b200, (0x5400 bytes) 2024-09-14T09:09:04.689 INFO:teuthology.orchestra.run.smithi148.stdout:4729 trunc from 0xd099200 to 0xac62c00 2024-09-14T09:09:04.690 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:04.692+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:04.706 INFO:teuthology.orchestra.run.smithi148.stdout:4730 punch from 0x3d5b400 to 0x3d63600, (0x8200 bytes) 2024-09-14T09:09:04.721 INFO:teuthology.orchestra.run.smithi148.stdout:4731 write 0xeb82800 thru 0xeb83d3b (0x153c bytes) 2024-09-14T09:09:04.727 INFO:teuthology.orchestra.run.smithi148.stdout:4736 read 0xaf46a00 thru 0xaf4aa29 (0x402a bytes) 2024-09-14T09:09:04.727 INFO:teuthology.orchestra.run.smithi148.stdout:4737 write 0x4e40600 thru 0x4e421a5 (0x1ba6 bytes) 2024-09-14T09:09:04.728 INFO:teuthology.orchestra.run.smithi148.stdout:4738 read 0xe531c00 thru 0xe536ceb (0x50ec bytes) 2024-09-14T09:09:04.728 INFO:teuthology.orchestra.run.smithi148.stdout:4739 write 0xe653e00 thru 0xe658a53 (0x4c54 bytes) 2024-09-14T09:09:04.728 INFO:teuthology.orchestra.run.smithi148.stdout:4746 read 0xcb37200 thru 0xcb3b3f8 (0x41f9 bytes) 2024-09-14T09:09:04.728 INFO:teuthology.orchestra.run.smithi148.stdout:4747 punch from 0x7135000 to 0x7142800, (0xd800 bytes) 2024-09-14T09:09:04.729 INFO:teuthology.orchestra.run.smithi148.stdout:4748 read 0x246fc00 thru 0x247307e (0x347f bytes) 2024-09-14T09:09:04.734 INFO:teuthology.orchestra.run.smithi148.stdout:4750 trunc from 0xeb83e00 to 0x9dd0a00 2024-09-14T09:09:04.738 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:09:04.749 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:04.749 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:04.749 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:04.749 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:04.749 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:04.751 INFO:teuthology.orchestra.run.smithi148.stdout:4753 write 0x7fce00 thru 0x804e10 (0x8011 bytes) 2024-09-14T09:09:04.755 INFO:teuthology.orchestra.run.smithi148.stdout:4755 read 0x693ce00 thru 0x693d47d (0x67e bytes) 2024-09-14T09:09:04.758 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:09:04.769 INFO:teuthology.orchestra.run.smithi148.stdout:4756 write 0xda53200 thru 0xda5f381 (0xc182 bytes) 2024-09-14T09:09:04.770 INFO:teuthology.orchestra.run.smithi148.stdout:4757 punch from 0x4418600 to 0x4427e00, (0xf800 bytes) 2024-09-14T09:09:04.770 INFO:teuthology.orchestra.run.smithi148.stdout:4759 write 0x6fa2400 thru 0x6facfa4 (0xaba5 bytes) 2024-09-14T09:09:04.774 INFO:teuthology.orchestra.run.smithi148.stdout:4761 read 0x19b4000 thru 0x19c36f7 (0xf6f8 bytes) 2024-09-14T09:09:04.774 INFO:teuthology.orchestra.run.smithi148.stdout:4763 punch from 0x2f6bc00 to 0x2f6be00, (0x200 bytes) 2024-09-14T09:09:04.774 INFO:teuthology.orchestra.run.smithi148.stdout:4764 write 0x753ba00 thru 0x7544a6a (0x906b bytes) 2024-09-14T09:09:04.774 INFO:teuthology.orchestra.run.smithi148.stdout:4766 write 0xc80e200 thru 0xc811b11 (0x3912 bytes) 2024-09-14T09:09:04.774 INFO:teuthology.orchestra.run.smithi148.stdout:4767 write 0x6502400 thru 0x6508589 (0x618a bytes) 2024-09-14T09:09:04.775 INFO:teuthology.orchestra.run.smithi148.stdout:4768 write 0xc6cb400 thru 0xc6d756f (0xc170 bytes) 2024-09-14T09:09:04.775 INFO:teuthology.orchestra.run.smithi148.stdout:4769 write 0xb2db200 thru 0xb2dcd98 (0x1b99 bytes) 2024-09-14T09:09:04.775 INFO:teuthology.orchestra.run.smithi148.stdout:4771 write 0xa8d8600 thru 0xa8e136b (0x8d6c bytes) 2024-09-14T09:09:04.775 INFO:teuthology.orchestra.run.smithi148.stdout:4774 trunc from 0xda5f400 to 0xb9c8400 2024-09-14T09:09:04.791 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:04.793+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:04.801 INFO:teuthology.orchestra.run.smithi148.stdout:4775 read 0x9ad6200 thru 0x9ad9948 (0x3749 bytes) 2024-09-14T09:09:04.819 INFO:teuthology.orchestra.run.smithi148.stdout:4776 write 0xdec9400 thru 0xded76d9 (0xe2da bytes) 2024-09-14T09:09:04.820 INFO:teuthology.orchestra.run.smithi148.stdout:4777 clone 28 order 20 su 8192 sc 12 2024-09-14T09:09:04.863 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:04.864 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:04.877 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T09:09:04.880 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:04.881 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:04.881 INFO:teuthology.orchestra.run.smithi116.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-14T09:09:04.892 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:04.894+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:04.897 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:04.898 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:04.908 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:04.908 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:04.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:04.908 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:04.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.908 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5299 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5230592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:04.908 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:09:04.909 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.660568091999998, 2024-09-14T09:09:04.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038972887999999997, 2024-09-14T09:09:04.909 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.909 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.909 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.909 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.909 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:04.909 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:04.909 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5299 2024-09-14T09:09:04.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.909 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:09:04.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:09:04.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249123+0000", 2024-09-14T09:09:04.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1199999999999998e-07 2024-09-14T09:09:04.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249125+0000", 2024-09-14T09:09:04.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.855e-06 2024-09-14T09:09:04.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249131+0000", 2024-09-14T09:09:04.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2949999999999999e-06 2024-09-14T09:09:04.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249136+0000", 2024-09-14T09:09:04.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9779999999999996e-06 2024-09-14T09:09:04.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287933+0000", 2024-09-14T09:09:04.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038796663000000002 2024-09-14T09:09:04.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288012+0000", 2024-09-14T09:09:04.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9617999999999996e-05 2024-09-14T09:09:04.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288095+0000", 2024-09-14T09:09:04.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3066999999999996e-05 2024-09-14T09:09:04.912 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.912 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.912 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.913 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5300 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5292032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:04.913 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:09:04.913 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.660548703, 2024-09-14T09:09:04.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039068578, 2024-09-14T09:09:04.913 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.913 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.913 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.913 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.913 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:04.913 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:04.913 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5300 2024-09-14T09:09:04.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.914 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:09:04.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:09:04.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254832+0000", 2024-09-14T09:09:04.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056899180000000004 2024-09-14T09:09:04.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254836+0000", 2024-09-14T09:09:04.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7809999999999999e-06 2024-09-14T09:09:04.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254845+0000", 2024-09-14T09:09:04.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.516e-06 2024-09-14T09:09:04.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254851+0000", 2024-09-14T09:09:04.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9109999999999998e-06 2024-09-14T09:09:04.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288122+0000", 2024-09-14T09:09:04.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.033270776000000002 2024-09-14T09:09:04.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288163+0000", 2024-09-14T09:09:04.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1700999999999999e-05 2024-09-14T09:09:04.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288210+0000", 2024-09-14T09:09:04.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6974999999999997e-05 2024-09-14T09:09:04.917 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.917 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.917 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.917 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5342 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7872512~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:04.918 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:09:04.918 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.653972518, 2024-09-14T09:09:04.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038906217999999999, 2024-09-14T09:09:04.918 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.918 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.918 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.918 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.918 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:04.918 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:04.918 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5342 2024-09-14T09:09:04.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.918 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:09:04.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:09:04.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:09:04.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8700000000000001e-07 2024-09-14T09:09:04.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255720+0000", 2024-09-14T09:09:04.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.739e-06 2024-09-14T09:09:04.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255726+0000", 2024-09-14T09:09:04.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.981e-06 2024-09-14T09:09:04.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255737+0000", 2024-09-14T09:09:04.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0621e-05 2024-09-14T09:09:04.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294538+0000", 2024-09-14T09:09:04.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038801012000000003 2024-09-14T09:09:04.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294577+0000", 2024-09-14T09:09:04.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9042000000000003e-05 2024-09-14T09:09:04.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294624+0000", 2024-09-14T09:09:04.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7435999999999998e-05 2024-09-14T09:09:04.921 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.921 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.921 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.922 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5343 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7933952~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:04.922 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:09:04.922 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.653946642000001, 2024-09-14T09:09:04.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039081811000000001, 2024-09-14T09:09:04.922 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.922 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.922 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.922 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.922 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:04.922 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:04.922 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5343 2024-09-14T09:09:04.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.923 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:09:04.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:09:04.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:09:04.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1800000000000001e-07 2024-09-14T09:09:04.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255746+0000", 2024-09-14T09:09:04.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.103e-06 2024-09-14T09:09:04.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255753+0000", 2024-09-14T09:09:04.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0929999999999999e-06 2024-09-14T09:09:04.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255757+0000", 2024-09-14T09:09:04.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9579999999999998e-06 2024-09-14T09:09:04.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294656+0000", 2024-09-14T09:09:04.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038898508999999998 2024-09-14T09:09:04.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294738+0000", 2024-09-14T09:09:04.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2423999999999996e-05 2024-09-14T09:09:04.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294826+0000", 2024-09-14T09:09:04.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7305999999999994e-05 2024-09-14T09:09:04.926 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.926 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.926 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.926 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5344 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7995392~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:04.926 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:09:04.926 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.653927209999999, 2024-09-14T09:09:04.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039165567999999998, 2024-09-14T09:09:04.926 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.926 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.926 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.926 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.927 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:04.927 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:04.927 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5344 2024-09-14T09:09:04.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.927 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:09:04.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:09:04.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255764+0000", 2024-09-14T09:09:04.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7899999999999999e-07 2024-09-14T09:09:04.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255765+0000", 2024-09-14T09:09:04.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.782e-06 2024-09-14T09:09:04.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255774+0000", 2024-09-14T09:09:04.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8070000000000006e-06 2024-09-14T09:09:04.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255779+0000", 2024-09-14T09:09:04.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9180000000000002e-06 2024-09-14T09:09:04.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294841+0000", 2024-09-14T09:09:04.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039061514999999998 2024-09-14T09:09:04.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294881+0000", 2024-09-14T09:09:04.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0027999999999997e-05 2024-09-14T09:09:04.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294929+0000", 2024-09-14T09:09:04.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8139000000000001e-05 2024-09-14T09:09:04.930 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.930 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.930 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.930 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5345 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8056832~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:04.930 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:09:04.930 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.653904971999999, 2024-09-14T09:09:04.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039340027999999999, 2024-09-14T09:09:04.930 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.930 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.931 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.931 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.931 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:04.931 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:04.931 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5345 2024-09-14T09:09:04.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.931 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:09:04.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:09:04.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:09:04.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8099999999999998e-07 2024-09-14T09:09:04.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255788+0000", 2024-09-14T09:09:04.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1280000000000002e-06 2024-09-14T09:09:04.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255794+0000", 2024-09-14T09:09:04.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0020000000000003e-06 2024-09-14T09:09:04.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255800+0000", 2024-09-14T09:09:04.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2009999999999996e-06 2024-09-14T09:09:04.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294960+0000", 2024-09-14T09:09:04.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039159674999999998 2024-09-14T09:09:04.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295041+0000", 2024-09-14T09:09:04.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0648000000000004e-05 2024-09-14T09:09:04.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295126+0000", 2024-09-14T09:09:04.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4993000000000004e-05 2024-09-14T09:09:04.934 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.934 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.934 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.934 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5346 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8118272~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:04.934 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:09:04.935 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.653883978, 2024-09-14T09:09:04.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039433228000000001, 2024-09-14T09:09:04.935 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.935 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.935 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.935 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.935 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:04.935 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:04.935 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5346 2024-09-14T09:09:04.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.935 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:09:04.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:09:04.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:09:04.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6899999999999998e-07 2024-09-14T09:09:04.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255809+0000", 2024-09-14T09:09:04.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9580000000000001e-06 2024-09-14T09:09:04.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255815+0000", 2024-09-14T09:09:04.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6579999999999999e-06 2024-09-14T09:09:04.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255819+0000", 2024-09-14T09:09:04.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5839999999999996e-06 2024-09-14T09:09:04.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295152+0000", 2024-09-14T09:09:04.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039332677000000003 2024-09-14T09:09:04.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295192+0000", 2024-09-14T09:09:04.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0491999999999998e-05 2024-09-14T09:09:04.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295240+0000", 2024-09-14T09:09:04.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7490000000000001e-05 2024-09-14T09:09:04.938 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.939 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.939 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.939 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5347 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8179712~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:04.939 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:09:04.939 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.653856381000001, 2024-09-14T09:09:04.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039601193999999999, 2024-09-14T09:09:04.939 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.939 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.939 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.939 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.939 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:04.939 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:04.939 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5347 2024-09-14T09:09:04.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.940 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:09:04.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:09:04.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255835+0000", 2024-09-14T09:09:04.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.82e-07 2024-09-14T09:09:04.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255837+0000", 2024-09-14T09:09:04.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0959999999999999e-06 2024-09-14T09:09:04.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255843+0000", 2024-09-14T09:09:04.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3779999999999998e-06 2024-09-14T09:09:04.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255848+0000", 2024-09-14T09:09:04.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7609999999999998e-06 2024-09-14T09:09:04.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295271+0000", 2024-09-14T09:09:04.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039423079 2024-09-14T09:09:04.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295350+0000", 2024-09-14T09:09:04.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8623999999999998e-05 2024-09-14T09:09:04.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295435+0000", 2024-09-14T09:09:04.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5674000000000007e-05 2024-09-14T09:09:04.943 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.943 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.943 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.943 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5348 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8241152~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:04.943 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:09:04.943 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.653836171999998, 2024-09-14T09:09:04.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039695057999999998, 2024-09-14T09:09:04.943 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.943 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.943 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.943 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.944 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:04.944 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:04.944 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5348 2024-09-14T09:09:04.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.944 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:09:04.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:09:04.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255855+0000", 2024-09-14T09:09:04.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7599999999999997e-07 2024-09-14T09:09:04.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255857+0000", 2024-09-14T09:09:04.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.905e-06 2024-09-14T09:09:04.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255863+0000", 2024-09-14T09:09:04.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0669999999999997e-06 2024-09-14T09:09:04.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255867+0000", 2024-09-14T09:09:04.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4730000000000002e-06 2024-09-14T09:09:04.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295461+0000", 2024-09-14T09:09:04.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039594074 2024-09-14T09:09:04.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295503+0000", 2024-09-14T09:09:04.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1363999999999999e-05 2024-09-14T09:09:04.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295549+0000", 2024-09-14T09:09:04.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6699000000000001e-05 2024-09-14T09:09:04.947 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.947 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.947 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.947 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5349 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8302592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:04.947 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:04.947 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.653817212, 2024-09-14T09:09:04.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039875928999999997, 2024-09-14T09:09:04.948 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.948 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.948 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.948 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.948 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:04.948 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:04.948 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5349 2024-09-14T09:09:04.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.948 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:04.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:04.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255874+0000", 2024-09-14T09:09:04.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4900000000000001e-07 2024-09-14T09:09:04.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255880+0000", 2024-09-14T09:09:04.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9939999999999997e-06 2024-09-14T09:09:04.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255886+0000", 2024-09-14T09:09:04.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3899999999999998e-06 2024-09-14T09:09:04.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255891+0000", 2024-09-14T09:09:04.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.938e-06 2024-09-14T09:09:04.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295580+0000", 2024-09-14T09:09:04.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039688681000000003 2024-09-14T09:09:04.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295653+0000", 2024-09-14T09:09:04.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3045000000000003e-05 2024-09-14T09:09:04.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295749+0000", 2024-09-14T09:09:04.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6532000000000003e-05 2024-09-14T09:09:04.951 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.951 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.951 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.951 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5350 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8364032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:04.951 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:04.951 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.653793405000002, 2024-09-14T09:09:04.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039989719, 2024-09-14T09:09:04.952 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.952 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.952 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.952 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.952 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:04.952 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:04.952 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5350 2024-09-14T09:09:04.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.952 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:04.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:04.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255898+0000", 2024-09-14T09:09:04.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2024-09-14T09:09:04.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255899+0000", 2024-09-14T09:09:04.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9139999999999998e-06 2024-09-14T09:09:04.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255905+0000", 2024-09-14T09:09:04.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7289999999999997e-06 2024-09-14T09:09:04.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255910+0000", 2024-09-14T09:09:04.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6210000000000003e-06 2024-09-14T09:09:04.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295775+0000", 2024-09-14T09:09:04.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039864973999999997 2024-09-14T09:09:04.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295828+0000", 2024-09-14T09:09:04.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3411000000000001e-05 2024-09-14T09:09:04.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295887+0000", 2024-09-14T09:09:04.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699000000000002e-05 2024-09-14T09:09:04.955 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.956 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.956 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.956 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4639 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1843200~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:04.956 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:04.956 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 6.7098779459999998, 2024-09-14T09:09:04.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040843672999999997, 2024-09-14T09:09:04.956 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.956 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.956 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.957 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.957 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:04.957 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:04.957 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4639 2024-09-14T09:09:04.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.957 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:04.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:04.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:04.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:09:04.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199818+0000", 2024-09-14T09:09:04.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1450000000000001e-06 2024-09-14T09:09:04.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199827+0000", 2024-09-14T09:09:04.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3999999999999998e-06 2024-09-14T09:09:04.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199834+0000", 2024-09-14T09:09:04.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0809999999999996e-06 2024-09-14T09:09:04.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240541+0000", 2024-09-14T09:09:04.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040706941000000003 2024-09-14T09:09:04.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240584+0000", 2024-09-14T09:09:04.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3040999999999997e-05 2024-09-14T09:09:04.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240656+0000", 2024-09-14T09:09:04.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2200000000000007e-05 2024-09-14T09:09:04.961 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.961 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.961 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.961 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4640 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1871872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:04.961 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:04.961 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 6.7098434610000002, 2024-09-14T09:09:04.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040967601999999999, 2024-09-14T09:09:04.961 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.961 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.961 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.961 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.961 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:04.962 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:04.962 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4640 2024-09-14T09:09:04.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.962 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:04.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:04.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199848+0000", 2024-09-14T09:09:04.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5400000000000002e-07 2024-09-14T09:09:04.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199850+0000", 2024-09-14T09:09:04.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2479999999999999e-06 2024-09-14T09:09:04.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199857+0000", 2024-09-14T09:09:04.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.187e-06 2024-09-14T09:09:04.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199862+0000", 2024-09-14T09:09:04.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5119999999999999e-06 2024-09-14T09:09:04.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240684+0000", 2024-09-14T09:09:04.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040821245999999999 2024-09-14T09:09:04.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240739+0000", 2024-09-14T09:09:04.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4991999999999998e-05 2024-09-14T09:09:04.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240815+0000", 2024-09-14T09:09:04.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5963000000000004e-05 2024-09-14T09:09:04.965 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.965 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.965 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.965 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4641 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1900544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:04.965 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:04.966 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 6.709821131, 2024-09-14T09:09:04.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041205512, 2024-09-14T09:09:04.966 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.966 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.966 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.966 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.966 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:04.966 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:04.966 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4641 2024-09-14T09:09:04.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.966 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:04.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:04.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199870+0000", 2024-09-14T09:09:04.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0600000000000001e-07 2024-09-14T09:09:04.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199872+0000", 2024-09-14T09:09:04.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.928e-06 2024-09-14T09:09:04.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199877+0000", 2024-09-14T09:09:04.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6949999999999997e-06 2024-09-14T09:09:04.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199882+0000", 2024-09-14T09:09:04.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8210000000000001e-06 2024-09-14T09:09:04.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240847+0000", 2024-09-14T09:09:04.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040965201999999999 2024-09-14T09:09:04.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240888+0000", 2024-09-14T09:09:04.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0754000000000003e-05 2024-09-14T09:09:04.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241075+0000", 2024-09-14T09:09:04.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000186706 2024-09-14T09:09:04.969 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.969 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.970 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.970 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4642 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1929216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:04.970 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:04.970 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 6.7098021960000001, 2024-09-14T09:09:04.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041292575999999998, 2024-09-14T09:09:04.970 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.970 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.970 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.970 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.970 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:04.970 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:04.971 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4642 2024-09-14T09:09:04.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.971 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:04.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:04.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199889+0000", 2024-09-14T09:09:04.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2024-09-14T09:09:04.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199891+0000", 2024-09-14T09:09:04.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9e-06 2024-09-14T09:09:04.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199896+0000", 2024-09-14T09:09:04.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6960000000000002e-06 2024-09-14T09:09:04.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199901+0000", 2024-09-14T09:09:04.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6720000000000003e-06 2024-09-14T09:09:04.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241089+0000", 2024-09-14T09:09:04.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041187594000000001 2024-09-14T09:09:04.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241126+0000", 2024-09-14T09:09:04.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7490999999999997e-05 2024-09-14T09:09:04.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241181+0000", 2024-09-14T09:09:04.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4823e-05 2024-09-14T09:09:04.974 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.974 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.974 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.974 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4643 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1957888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:04.974 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:04.974 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 6.7097829170000001, 2024-09-14T09:09:04.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041418333000000002, 2024-09-14T09:09:04.975 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.975 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.975 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:04.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:04.975 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4643 2024-09-14T09:09:04.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.975 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:04.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:04.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:04.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5699999999999998e-07 2024-09-14T09:09:04.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199910+0000", 2024-09-14T09:09:04.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.829e-06 2024-09-14T09:09:04.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199916+0000", 2024-09-14T09:09:04.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8499999999999999e-06 2024-09-14T09:09:04.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199920+0000", 2024-09-14T09:09:04.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6530000000000002e-06 2024-09-14T09:09:04.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241211+0000", 2024-09-14T09:09:04.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041290327000000002 2024-09-14T09:09:04.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241257+0000", 2024-09-14T09:09:04.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6347000000000002e-05 2024-09-14T09:09:04.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241326+0000", 2024-09-14T09:09:04.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8969999999999999e-05 2024-09-14T09:09:04.978 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.978 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.979 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.979 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4644 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1986560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:04.979 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:04.979 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 6.7097645769999996, 2024-09-14T09:09:04.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041596269999999998, 2024-09-14T09:09:04.979 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.979 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.979 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.979 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.979 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:04.979 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:04.980 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4644 2024-09-14T09:09:04.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.980 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:04.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:04.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:04.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.41e-07 2024-09-14T09:09:04.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199928+0000", 2024-09-14T09:09:04.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8250000000000001e-06 2024-09-14T09:09:04.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199934+0000", 2024-09-14T09:09:04.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2280000000000003e-06 2024-09-14T09:09:04.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199939+0000", 2024-09-14T09:09:04.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8010000000000003e-06 2024-09-14T09:09:04.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241360+0000", 2024-09-14T09:09:04.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041421289 2024-09-14T09:09:04.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241435+0000", 2024-09-14T09:09:04.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4238000000000003e-05 2024-09-14T09:09:04.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241522+0000", 2024-09-14T09:09:04.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7547999999999996e-05 2024-09-14T09:09:04.983 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.983 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.983 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.983 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4645 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:04.984 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:04.984 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 6.7097456700000002, 2024-09-14T09:09:04.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041714660000000001, 2024-09-14T09:09:04.984 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.984 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.984 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.984 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.984 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:04.984 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:04.984 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4645 2024-09-14T09:09:04.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.984 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:04.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:04.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:04.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4700000000000002e-07 2024-09-14T09:09:04.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199947+0000", 2024-09-14T09:09:04.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.801e-06 2024-09-14T09:09:04.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199953+0000", 2024-09-14T09:09:04.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.694e-06 2024-09-14T09:09:04.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199957+0000", 2024-09-14T09:09:04.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3069999999999996e-06 2024-09-14T09:09:04.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241547+0000", 2024-09-14T09:09:04.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041589895000000002 2024-09-14T09:09:04.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241590+0000", 2024-09-14T09:09:04.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2985000000000003e-05 2024-09-14T09:09:04.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241660+0000", 2024-09-14T09:09:04.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9630999999999998e-05 2024-09-14T09:09:04.988 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.988 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.988 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.988 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4646 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2043904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:04.988 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:04.988 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 6.7097276820000005, 2024-09-14T09:09:04.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041827171000000003, 2024-09-14T09:09:04.988 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.988 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.988 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.988 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.989 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:04.989 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:04.989 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4646 2024-09-14T09:09:04.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.989 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:04.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:04.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:04.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6300000000000001e-07 2024-09-14T09:09:04.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199965+0000", 2024-09-14T09:09:04.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.035e-06 2024-09-14T09:09:04.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199973+0000", 2024-09-14T09:09:04.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9629999999999998e-06 2024-09-14T09:09:04.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199978+0000", 2024-09-14T09:09:04.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9069999999999998e-06 2024-09-14T09:09:04.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241677+0000", 2024-09-14T09:09:04.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041698662999999997 2024-09-14T09:09:04.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241717+0000", 2024-09-14T09:09:04.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602999999999997e-05 2024-09-14T09:09:04.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241790+0000", 2024-09-14T09:09:04.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2637000000000003e-05 2024-09-14T09:09:04.992 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.992 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.992 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.992 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4647 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2072576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:04.992 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:04.992 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 6.7096990920000001, 2024-09-14T09:09:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041921189999999997, 2024-09-14T09:09:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4647 2024-09-14T09:09:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199992+0000", 2024-09-14T09:09:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3799999999999997e-07 2024-09-14T09:09:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199994+0000", 2024-09-14T09:09:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3020000000000002e-06 2024-09-14T09:09:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200004+0000", 2024-09-14T09:09:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3510000000000008e-06 2024-09-14T09:09:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200008+0000", 2024-09-14T09:09:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3329999999999998e-06 2024-09-14T09:09:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241814+0000", 2024-09-14T09:09:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041806280000000001 2024-09-14T09:09:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241855+0000", 2024-09-14T09:09:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0173999999999999e-05 2024-09-14T09:09:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241913+0000", 2024-09-14T09:09:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8112000000000002e-05 2024-09-14T09:09:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.997 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.997 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:04.997 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:04.997 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:04.998 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:04.998 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:04.999 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:05.000 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:09:05.000 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:05.000+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:05.000 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T09:09:05.001 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:05.001 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T09:09:05.099 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:05.101+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:05.141 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:05.141 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:05.149 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:05.200 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:05.202+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:05.251 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:05.252 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:05.260 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:09:05.303 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:05.306+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:05.362 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:05.362 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:05.370 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:09:05.411 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:05.414+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:05.474 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:05.475 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:05.483 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:09:05.527 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:05.529+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:05.586 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:05.586 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:05.595 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:09:05.603 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:05.606+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:05.704 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:05.706+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:05.738 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:05.738 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:05.747 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:09:05.798 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is unset 2024-09-14T09:09:05.805 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:05.807+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:05.857 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:05.857 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:05.866 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:09:05.870 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone27 from 0xded7800 (overlap 0x31f600) to 0x4fe00 2024-09-14T09:09:05.909 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:05.911+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:05.972 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:05.973 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:05.981 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:09:06.007 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:06.009+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:06.108 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:06.110+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:06.128 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:06.128 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:06.137 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:09:06.155 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #26, image image_client.0-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent27 2024-09-14T09:09:06.208 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:06.211+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:06.261 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:06.261 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:06.270 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:09:06.289 INFO:teuthology.orchestra.run.smithi148.stdout:4779 read 0x8a9200 thru 0x8ab9f5 (0x27f6 bytes) 2024-09-14T09:09:06.290 INFO:teuthology.orchestra.run.smithi148.stdout:4781 read 0x21aa00 thru 0x21f40a (0x4a0b bytes) 2024-09-14T09:09:06.294 INFO:teuthology.orchestra.run.smithi148.stdout:4782 trunc from 0xded7800 to 0xc41de00 2024-09-14T09:09:06.311 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:06.313+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:06.320 INFO:teuthology.orchestra.run.smithi148.stdout:4785 write 0x708b000 thru 0x708ed48 (0x3d49 bytes) 2024-09-14T09:09:06.322 INFO:teuthology.orchestra.run.smithi148.stdout:4787 write 0x1abc800 thru 0x1ac9eec (0xd6ed bytes) 2024-09-14T09:09:06.322 INFO:teuthology.orchestra.run.smithi148.stdout:4788 punch from 0x393fc00 to 0x394be00, (0xc200 bytes) 2024-09-14T09:09:06.327 INFO:teuthology.orchestra.run.smithi148.stdout:4789 punch from 0xb405a00 to 0xb40b600, (0x5c00 bytes) 2024-09-14T09:09:06.328 INFO:teuthology.orchestra.run.smithi148.stdout:4790 read 0xf41800 thru 0xf4a3d7 (0x8bd8 bytes) 2024-09-14T09:09:06.329 INFO:teuthology.orchestra.run.smithi148.stdout:4791 punch from 0x2cab200 to 0x2cb3a00, (0x8800 bytes) 2024-09-14T09:09:06.331 INFO:teuthology.orchestra.run.smithi148.stdout:4794 write 0x8316200 thru 0x8322ce0 (0xcae1 bytes) 2024-09-14T09:09:06.332 INFO:teuthology.orchestra.run.smithi148.stdout:4800 write 0x127d800 thru 0x128635e (0x8b5f bytes) 2024-09-14T09:09:06.332 INFO:teuthology.orchestra.run.smithi148.stdout:4802 read 0x1b88800 thru 0x1b96a27 (0xe228 bytes) 2024-09-14T09:09:06.391 INFO:teuthology.orchestra.run.smithi148.stdout:4803 write 0xea8ee00 thru 0xea9be71 (0xd072 bytes) 2024-09-14T09:09:06.392 INFO:teuthology.orchestra.run.smithi148.stdout:4806 write 0x9329400 thru 0x9333835 (0xa436 bytes) 2024-09-14T09:09:06.392 INFO:teuthology.orchestra.run.smithi148.stdout:4808 punch from 0xa246600 to 0xa247800, (0x1200 bytes) 2024-09-14T09:09:06.395 INFO:teuthology.orchestra.run.smithi148.stdout:4809 punch from 0x3b25c00 to 0x3b35400, (0xf800 bytes) 2024-09-14T09:09:06.397 INFO:teuthology.orchestra.run.smithi148.stdout:4812 punch from 0x96d0c00 to 0x96d1200, (0x600 bytes) 2024-09-14T09:09:06.397 INFO:teuthology.orchestra.run.smithi148.stdout:4814 punch from 0x99d5200 to 0x99d9800, (0x4600 bytes) 2024-09-14T09:09:06.399 INFO:teuthology.orchestra.run.smithi148.stdout:4815 trunc from 0xea9c000 to 0xc8e0e00 2024-09-14T09:09:06.410 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:06.412+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:06.442 INFO:teuthology.orchestra.run.smithi148.stdout:4816 write 0xc852800 thru 0xc855de1 (0x35e2 bytes) 2024-09-14T09:09:06.447 INFO:teuthology.orchestra.run.smithi148.stdout:4817 trunc from 0xc8e0e00 to 0x94dc400 2024-09-14T09:09:06.453 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:06.453 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:06.466 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:09:06.489 INFO:teuthology.orchestra.run.smithi148.stdout:4818 write 0x3437600 thru 0x34383dd (0xdde bytes) 2024-09-14T09:09:06.495 INFO:teuthology.orchestra.run.smithi148.stdout:4820 write 0x8de7c00 thru 0x8deee03 (0x7204 bytes) 2024-09-14T09:09:06.496 INFO:teuthology.orchestra.run.smithi148.stdout:4822 trunc from 0x94dc400 to 0x88fe800 2024-09-14T09:09:06.511 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:06.513+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:06.536 INFO:teuthology.orchestra.run.smithi148.stdout:4824 read 0x403b800 thru 0x404512d (0x992e bytes) 2024-09-14T09:09:06.537 INFO:teuthology.orchestra.run.smithi148.stdout:4825 write 0x6a87800 thru 0x6a91fb0 (0xa7b1 bytes) 2024-09-14T09:09:06.584 INFO:teuthology.orchestra.run.smithi148.stdout:4827 write 0xdc78600 thru 0xdc879b4 (0xf3b5 bytes) 2024-09-14T09:09:06.585 INFO:teuthology.orchestra.run.smithi148.stdout:4834 write 0xa45e600 thru 0xa46aa86 (0xc487 bytes) 2024-09-14T09:09:06.585 INFO:teuthology.orchestra.run.smithi148.stdout:4836 read 0x806d000 thru 0x806f755 (0x2756 bytes) 2024-09-14T09:09:06.585 INFO:teuthology.orchestra.run.smithi148.stdout:4839 punch from 0xcccbe00 to 0xccd7400, (0xb600 bytes) 2024-09-14T09:09:06.586 INFO:teuthology.orchestra.run.smithi148.stdout:4842 write 0x9726600 thru 0x9734980 (0xe381 bytes) 2024-09-14T09:09:06.586 INFO:teuthology.orchestra.run.smithi148.stdout:4846 write 0x3448000 thru 0x3457407 (0xf408 bytes) 2024-09-14T09:09:06.601 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:06.601 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:06.605 INFO:teuthology.orchestra.run.smithi148.stdout:4847 write 0x81ca400 thru 0x81ce95c (0x455d bytes) 2024-09-14T09:09:06.606 INFO:teuthology.orchestra.run.smithi148.stdout:4850 punch from 0x2ce8400 to 0x2cf1600, (0x9200 bytes) 2024-09-14T09:09:06.608 INFO:teuthology.orchestra.run.smithi148.stdout:4853 clone 29 order 25 su 524288 sc 9 2024-09-14T09:09:06.612 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:06.614+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:06.614 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:09:06.713 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:06.716+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:06.719 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:06.719 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:06.728 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:09:06.814 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:06.816+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:06.835 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:06.835 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:06.844 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:09:06.880 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone28 from 0xdc87a00 (overlap 0x88fe800) to 0x447f400 2024-09-14T09:09:06.916 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:06.917+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:06.993 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:06.993 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:07.001 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:09:07.003 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:09:07.046 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:07.048+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:07.117 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:07.119+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:07.125 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:07.126 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:07.143 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:07.143 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:07.143 INFO:teuthology.orchestra.run.smithi116.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-14T09:09:07.153 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:07.153 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:07.161 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:07.161 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:07.163 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:07.178 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:07.178 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:07.195 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:07.195 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:07.198 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T09:09:07.198 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T09:09:07.247 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:07.250+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:07.312 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:07.312 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:07.312 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:07.312 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:07.312 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:07.319 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #27, image image_client.0-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent28 2024-09-14T09:09:07.319 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:07.321+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:07.321 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:09:07.369 INFO:teuthology.orchestra.run.smithi148.stdout:4855 write 0xcc73400 thru 0xcc7ae8b (0x7a8c bytes) 2024-09-14T09:09:07.370 INFO:teuthology.orchestra.run.smithi148.stdout:4856 read 0x1a66e00 thru 0x1a6b744 (0x4945 bytes) 2024-09-14T09:09:07.371 INFO:teuthology.orchestra.run.smithi148.stdout:4857 read 0x10ef000 thru 0x10f9608 (0xa609 bytes) 2024-09-14T09:09:07.372 INFO:teuthology.orchestra.run.smithi148.stdout:4859 punch from 0x5f03600 to 0x5f0ec00, (0xb600 bytes) 2024-09-14T09:09:07.419 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:07.421+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:07.475 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:07.475 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:07.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:07.475 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:07.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.476 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:228 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 360448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:07.476 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:07.476 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.679697070000003, 2024-09-14T09:09:07.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99234476999999999, 2024-09-14T09:09:07.476 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:07.476 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:07.476 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:07.476 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:07.476 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:07.476 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:07.476 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 228 2024-09-14T09:09:07.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.476 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:07.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:07.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:07.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:07.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:07.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:07.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796906+0000", 2024-09-14T09:09:07.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9399999999999995e-07 2024-09-14T09:09:07.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:07.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796917+0000", 2024-09-14T09:09:07.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0801e-05 2024-09-14T09:09:07.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:07.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796924+0000", 2024-09-14T09:09:07.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7750000000000004e-06 2024-09-14T09:09:07.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:07.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:07.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9972000000000001e-05 2024-09-14T09:09:07.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798671+0000", 2024-09-14T09:09:07.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017271330000000001 2024-09-14T09:09:07.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:07.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798675+0000", 2024-09-14T09:09:07.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.194e-06 2024-09-14T09:09:07.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789003+0000", 2024-09-14T09:09:07.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99032768400000004 2024-09-14T09:09:07.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:07.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789115+0000", 2024-09-14T09:09:07.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112236 2024-09-14T09:09:07.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:07.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789250+0000", 2024-09-14T09:09:07.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013548100000000001 2024-09-14T09:09:07.481 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.481 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:07.481 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.482 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:229 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 819200~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:07.482 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:07.482 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.679644846999999, 2024-09-14T09:09:07.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99287024599999996, 2024-09-14T09:09:07.482 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:07.482 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:07.482 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:07.482 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:07.482 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:07.482 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:07.482 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 229 2024-09-14T09:09:07.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.483 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:07.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:07.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:07.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:07.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:07.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:07.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:07.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999999e-07 2024-09-14T09:09:07.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:07.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796962+0000", 2024-09-14T09:09:07.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1479999999999999e-06 2024-09-14T09:09:07.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:07.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796967+0000", 2024-09-14T09:09:07.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1499999999999998e-06 2024-09-14T09:09:07.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:07.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:09:07.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-06 2024-09-14T09:09:07.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798688+0000", 2024-09-14T09:09:07.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017172660000000001 2024-09-14T09:09:07.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:07.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798691+0000", 2024-09-14T09:09:07.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:09:07.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789599+0000", 2024-09-14T09:09:07.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99090839399999997 2024-09-14T09:09:07.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:07.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789716+0000", 2024-09-14T09:09:07.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116474 2024-09-14T09:09:07.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:07.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789828+0000", 2024-09-14T09:09:07.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112293 2024-09-14T09:09:07.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.487 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:07.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.487 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:230 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1277952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:07.487 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:07.487 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.679624199000003, 2024-09-14T09:09:07.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99307501600000003, 2024-09-14T09:09:07.487 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:07.487 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:07.487 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:07.488 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:07.488 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:07.488 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:07.488 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 230 2024-09-14T09:09:07.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.488 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:07.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:07.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:07.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:07.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:07.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:07.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796979+0000", 2024-09-14T09:09:07.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.34e-07 2024-09-14T09:09:07.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:07.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796980+0000", 2024-09-14T09:09:07.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.53e-06 2024-09-14T09:09:07.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:07.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796986+0000", 2024-09-14T09:09:07.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9989999999999997e-06 2024-09-14T09:09:07.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:07.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796989+0000", 2024-09-14T09:09:07.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0340000000000001e-06 2024-09-14T09:09:07.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798702+0000", 2024-09-14T09:09:07.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001712756 2024-09-14T09:09:07.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:07.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798705+0000", 2024-09-14T09:09:07.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7750000000000001e-06 2024-09-14T09:09:07.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789870+0000", 2024-09-14T09:09:07.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991165026 2024-09-14T09:09:07.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:07.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789955+0000", 2024-09-14T09:09:07.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4839999999999994e-05 2024-09-14T09:09:07.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:07.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790053+0000", 2024-09-14T09:09:07.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8721999999999994e-05 2024-09-14T09:09:07.492 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.492 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:07.492 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.492 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:231 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:07.492 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:07.493 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.679608870999999, 2024-09-14T09:09:07.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99319130300000003, 2024-09-14T09:09:07.493 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:07.493 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:07.493 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:07.493 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:07.493 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:07.493 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:07.493 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 231 2024-09-14T09:09:07.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.493 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:07.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:07.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:07.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:07.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:07.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:07.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:07.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2024-09-14T09:09:07.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:07.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796995+0000", 2024-09-14T09:09:07.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2500000000000001e-06 2024-09-14T09:09:07.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:07.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796998+0000", 2024-09-14T09:09:07.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3230000000000002e-06 2024-09-14T09:09:07.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:07.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797001+0000", 2024-09-14T09:09:07.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7099999999999999e-06 2024-09-14T09:09:07.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798718+0000", 2024-09-14T09:09:07.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017168070000000001 2024-09-14T09:09:07.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:07.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798721+0000", 2024-09-14T09:09:07.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.853e-06 2024-09-14T09:09:07.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790077+0000", 2024-09-14T09:09:07.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991356393 2024-09-14T09:09:07.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:07.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790129+0000", 2024-09-14T09:09:07.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2240999999999997e-05 2024-09-14T09:09:07.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:07.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790185+0000", 2024-09-14T09:09:07.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5515e-05 2024-09-14T09:09:07.497 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.497 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:07.498 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.498 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:232 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2195456~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:07.498 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:07.498 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.679598214999999, 2024-09-14T09:09:07.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99329117899999997, 2024-09-14T09:09:07.498 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:07.498 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:07.498 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:07.498 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:07.498 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:07.498 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:07.499 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 232 2024-09-14T09:09:07.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.499 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:07.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:07.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:07.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:07.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:07.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:07.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797005+0000", 2024-09-14T09:09:07.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2024-09-14T09:09:07.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:07.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797006+0000", 2024-09-14T09:09:07.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3200000000000001e-06 2024-09-14T09:09:07.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:07.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797009+0000", 2024-09-14T09:09:07.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4680000000000001e-06 2024-09-14T09:09:07.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:07.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797012+0000", 2024-09-14T09:09:07.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4770000000000002e-06 2024-09-14T09:09:07.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798743+0000", 2024-09-14T09:09:07.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017312 2024-09-14T09:09:07.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:07.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798747+0000", 2024-09-14T09:09:07.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.484e-06 2024-09-14T09:09:07.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790201+0000", 2024-09-14T09:09:07.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99145419499999998 2024-09-14T09:09:07.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:07.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790241+0000", 2024-09-14T09:09:07.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0587999999999998e-05 2024-09-14T09:09:07.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:07.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790296+0000", 2024-09-14T09:09:07.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4212000000000002e-05 2024-09-14T09:09:07.503 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.504 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:07.504 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.504 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:233 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2654208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:07.504 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:07.504 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.679587591999997, 2024-09-14T09:09:07.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99337220100000001, 2024-09-14T09:09:07.504 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:07.504 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:07.504 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:07.504 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:07.504 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:07.505 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:07.505 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 233 2024-09-14T09:09:07.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.505 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:07.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:07.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:07.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:07.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:07.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:07.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:07.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:09:07.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:07.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:09:07.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.269e-06 2024-09-14T09:09:07.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:07.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797019+0000", 2024-09-14T09:09:07.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9519999999999999e-06 2024-09-14T09:09:07.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:07.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797022+0000", 2024-09-14T09:09:07.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6079999999999998e-06 2024-09-14T09:09:07.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798759+0000", 2024-09-14T09:09:07.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001737342 2024-09-14T09:09:07.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:07.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798762+0000", 2024-09-14T09:09:07.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:09:07.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790310+0000", 2024-09-14T09:09:07.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99154738799999997 2024-09-14T09:09:07.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:07.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790349+0000", 2024-09-14T09:09:07.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9573000000000002e-05 2024-09-14T09:09:07.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:07.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790387+0000", 2024-09-14T09:09:07.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7985999999999998e-05 2024-09-14T09:09:07.509 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.509 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:07.509 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.509 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:234 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3112960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:07.509 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:07.509 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.679577547000001, 2024-09-14T09:09:07.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99345674500000003, 2024-09-14T09:09:07.509 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:07.510 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:07.510 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:07.510 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:07.510 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:07.510 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:07.510 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 234 2024-09-14T09:09:07.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.510 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:07.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:07.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:07.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:07.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:07.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:07.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:07.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0100000000000001e-07 2024-09-14T09:09:07.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:07.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:07.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0699999999999999e-06 2024-09-14T09:09:07.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:07.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:09:07.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.886e-06 2024-09-14T09:09:07.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:07.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797032+0000", 2024-09-14T09:09:07.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7149999999999998e-06 2024-09-14T09:09:07.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798778+0000", 2024-09-14T09:09:07.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017460329999999999 2024-09-14T09:09:07.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:07.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798783+0000", 2024-09-14T09:09:07.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0760000000000002e-06 2024-09-14T09:09:07.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790408+0000", 2024-09-14T09:09:07.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99162473299999998 2024-09-14T09:09:07.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:07.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790446+0000", 2024-09-14T09:09:07.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8389000000000001e-05 2024-09-14T09:09:07.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:07.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790482+0000", 2024-09-14T09:09:07.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5642000000000002e-05 2024-09-14T09:09:07.514 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.514 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:07.514 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.514 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:235 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3571712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:07.514 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:07.514 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.679567648999999, 2024-09-14T09:09:07.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993539477, 2024-09-14T09:09:07.515 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:07.515 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:07.515 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:07.515 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:07.515 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:07.515 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:07.515 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 235 2024-09-14T09:09:07.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.515 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:07.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:07.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:07.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:07.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:07.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:07.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:07.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9999999999999999e-07 2024-09-14T09:09:07.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:07.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797036+0000", 2024-09-14T09:09:07.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.051e-06 2024-09-14T09:09:07.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:07.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797039+0000", 2024-09-14T09:09:07.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:09:07.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:07.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797042+0000", 2024-09-14T09:09:07.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5280000000000002e-06 2024-09-14T09:09:07.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798809+0000", 2024-09-14T09:09:07.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001767394 2024-09-14T09:09:07.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:07.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798815+0000", 2024-09-14T09:09:07.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0859999999999998e-06 2024-09-14T09:09:07.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790502+0000", 2024-09-14T09:09:07.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99168652300000004 2024-09-14T09:09:07.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:07.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790539+0000", 2024-09-14T09:09:07.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7471000000000001e-05 2024-09-14T09:09:07.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:07.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790574+0000", 2024-09-14T09:09:07.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5292e-05 2024-09-14T09:09:07.519 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.519 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:07.519 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.519 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:236 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 4030464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:07.520 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:07.520 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.679557416000002, 2024-09-14T09:09:07.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993619743, 2024-09-14T09:09:07.520 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:07.520 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:07.520 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:07.520 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:07.520 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:07.520 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:07.520 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 236 2024-09-14T09:09:07.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.520 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:07.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:07.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:07.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:07.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:07.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:07.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:07.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1400000000000001e-07 2024-09-14T09:09:07.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:07.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797047+0000", 2024-09-14T09:09:07.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3400000000000001e-06 2024-09-14T09:09:07.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:07.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:09:07.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0699999999999998e-06 2024-09-14T09:09:07.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:07.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797053+0000", 2024-09-14T09:09:07.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7310000000000002e-06 2024-09-14T09:09:07.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798839+0000", 2024-09-14T09:09:07.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001786403 2024-09-14T09:09:07.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:07.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798844+0000", 2024-09-14T09:09:07.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3730000000000001e-06 2024-09-14T09:09:07.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790592+0000", 2024-09-14T09:09:07.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99174818099999995 2024-09-14T09:09:07.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:07.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790628+0000", 2024-09-14T09:09:07.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5831000000000003e-05 2024-09-14T09:09:07.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:07.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790665+0000", 2024-09-14T09:09:07.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-05 2024-09-14T09:09:07.524 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.524 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:07.524 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.525 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:365 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:07.525 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:07.525 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.677370388, 2024-09-14T09:09:07.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157278400000004, 2024-09-14T09:09:07.525 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:07.525 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:07.525 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:07.525 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:07.525 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:07.525 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:07.525 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 365 2024-09-14T09:09:07.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.526 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:07.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:07.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:07.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:07.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:07.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:07.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:07.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:09:07.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:07.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799233+0000", 2024-09-14T09:09:07.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.057e-06 2024-09-14T09:09:07.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:07.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799236+0000", 2024-09-14T09:09:07.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0249999999999998e-06 2024-09-14T09:09:07.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:07.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799239+0000", 2024-09-14T09:09:07.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.481e-06 2024-09-14T09:09:07.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800963+0000", 2024-09-14T09:09:07.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017240440000000001 2024-09-14T09:09:07.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:07.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800969+0000", 2024-09-14T09:09:07.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1410000000000002e-06 2024-09-14T09:09:07.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790682+0000", 2024-09-14T09:09:07.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98971330300000004 2024-09-14T09:09:07.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:07.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790753+0000", 2024-09-14T09:09:07.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0548000000000003e-05 2024-09-14T09:09:07.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:07.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790805+0000", 2024-09-14T09:09:07.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1981999999999998e-05 2024-09-14T09:09:07.530 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.530 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:07.530 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.530 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:366 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:07.530 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:07.530 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.677360295, 2024-09-14T09:09:07.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99173757299999998, 2024-09-14T09:09:07.530 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:07.530 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:07.530 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:07.530 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:07.530 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:07.531 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:07.531 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 366 2024-09-14T09:09:07.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.531 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:07.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:07.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:07.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:07.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:07.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:07.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:07.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-07 2024-09-14T09:09:07.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:07.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799244+0000", 2024-09-14T09:09:07.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.359e-06 2024-09-14T09:09:07.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:07.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799247+0000", 2024-09-14T09:09:07.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4929999999999998e-06 2024-09-14T09:09:07.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:07.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799250+0000", 2024-09-14T09:09:07.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:09:07.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800991+0000", 2024-09-14T09:09:07.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017412809999999999 2024-09-14T09:09:07.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:07.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800997+0000", 2024-09-14T09:09:07.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:09:07.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790824+0000", 2024-09-14T09:09:07.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98982735399999999 2024-09-14T09:09:07.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:07.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790891+0000", 2024-09-14T09:09:07.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7243999999999995e-05 2024-09-14T09:09:07.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:07.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790980+0000", 2024-09-14T09:09:07.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8608000000000003e-05 2024-09-14T09:09:07.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.535 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:07.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.535 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:367 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:07.535 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:07.535 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.677348922999997, 2024-09-14T09:09:07.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99188259999999995, 2024-09-14T09:09:07.535 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:07.536 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:07.536 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:07.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:07.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:07.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:07.536 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 367 2024-09-14T09:09:07.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.536 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:07.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:07.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:07.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:07.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:07.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:07.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:07.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-07 2024-09-14T09:09:07.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:07.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799255+0000", 2024-09-14T09:09:07.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.111e-06 2024-09-14T09:09:07.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:07.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799259+0000", 2024-09-14T09:09:07.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8650000000000003e-06 2024-09-14T09:09:07.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:07.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799262+0000", 2024-09-14T09:09:07.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.128e-06 2024-09-14T09:09:07.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801029+0000", 2024-09-14T09:09:07.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017668460000000001 2024-09-14T09:09:07.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:07.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801032+0000", 2024-09-14T09:09:07.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3179999999999998e-06 2024-09-14T09:09:07.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791011+0000", 2024-09-14T09:09:07.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98997920399999995 2024-09-14T09:09:07.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:07.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791077+0000", 2024-09-14T09:09:07.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5214000000000003e-05 2024-09-14T09:09:07.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:07.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791136+0000", 2024-09-14T09:09:07.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9710000000000003e-05 2024-09-14T09:09:07.540 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.540 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:07.540 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.541 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:368 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:07.541 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:07.541 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.677337379999997, 2024-09-14T09:09:07.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99201753800000003, 2024-09-14T09:09:07.541 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:07.541 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:07.541 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:07.541 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:07.541 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:07.541 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:07.541 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 368 2024-09-14T09:09:07.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.542 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:07.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:07.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:07.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:07.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:07.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:07.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:07.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4900000000000002e-07 2024-09-14T09:09:07.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:07.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799267+0000", 2024-09-14T09:09:07.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.079e-06 2024-09-14T09:09:07.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:07.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799270+0000", 2024-09-14T09:09:07.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.993e-06 2024-09-14T09:09:07.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:07.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799272+0000", 2024-09-14T09:09:07.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.695e-06 2024-09-14T09:09:07.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801043+0000", 2024-09-14T09:09:07.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001771105 2024-09-14T09:09:07.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:07.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801046+0000", 2024-09-14T09:09:07.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7999999999999999e-06 2024-09-14T09:09:07.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791150+0000", 2024-09-14T09:09:07.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99010348699999995 2024-09-14T09:09:07.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:07.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791193+0000", 2024-09-14T09:09:07.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3615999999999997e-05 2024-09-14T09:09:07.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:07.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791283+0000", 2024-09-14T09:09:07.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9513999999999997e-05 2024-09-14T09:09:07.546 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.546 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:07.546 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.546 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:369 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:07.546 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:07.546 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.677327042000002, 2024-09-14T09:09:07.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99213433600000001, 2024-09-14T09:09:07.546 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:07.546 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:07.546 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:07.546 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:07.547 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:07.547 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:07.547 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 369 2024-09-14T09:09:07.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.547 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:07.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:07.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:07.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:07.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:07.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:07.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:07.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:09:07.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:07.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799277+0000", 2024-09-14T09:09:07.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.108e-06 2024-09-14T09:09:07.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:07.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799280+0000", 2024-09-14T09:09:07.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:09:07.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:07.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799283+0000", 2024-09-14T09:09:07.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.531e-06 2024-09-14T09:09:07.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801058+0000", 2024-09-14T09:09:07.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001775085 2024-09-14T09:09:07.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:07.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801060+0000", 2024-09-14T09:09:07.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8260000000000001e-06 2024-09-14T09:09:07.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791299+0000", 2024-09-14T09:09:07.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99023856799999999 2024-09-14T09:09:07.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:07.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791352+0000", 2024-09-14T09:09:07.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2528000000000003e-05 2024-09-14T09:09:07.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:07.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791410+0000", 2024-09-14T09:09:07.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8298000000000003e-05 2024-09-14T09:09:07.551 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.551 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:07.551 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.551 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:370 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2457600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:07.551 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:07.551 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.677302275000002, 2024-09-14T09:09:07.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99220795399999995, 2024-09-14T09:09:07.552 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:07.552 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:07.552 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:07.552 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:07.552 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:07.552 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:07.552 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 370 2024-09-14T09:09:07.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.552 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:07.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:07.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:07.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:07.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:07.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:07.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799301+0000", 2024-09-14T09:09:07.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2024-09-14T09:09:07.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:07.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799303+0000", 2024-09-14T09:09:07.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9319999999999999e-06 2024-09-14T09:09:07.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:07.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799310+0000", 2024-09-14T09:09:07.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8680000000000001e-06 2024-09-14T09:09:07.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:07.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799315+0000", 2024-09-14T09:09:07.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.921e-06 2024-09-14T09:09:07.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801071+0000", 2024-09-14T09:09:07.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001756678 2024-09-14T09:09:07.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:07.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801080+0000", 2024-09-14T09:09:07.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6060000000000003e-06 2024-09-14T09:09:07.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791429+0000", 2024-09-14T09:09:07.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99034944599999997 2024-09-14T09:09:07.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:07.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791471+0000", 2024-09-14T09:09:07.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1279999999999998e-05 2024-09-14T09:09:07.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:07.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791508+0000", 2024-09-14T09:09:07.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7663999999999997e-05 2024-09-14T09:09:07.556 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.556 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:07.556 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.557 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:371 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2916352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:07.557 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:07.557 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.677281102999999, 2024-09-14T09:09:07.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99228692299999999, 2024-09-14T09:09:07.557 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:07.557 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:07.557 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:07.557 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:07.557 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:07.557 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:07.557 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 371 2024-09-14T09:09:07.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.558 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:07.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:07.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:07.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:07.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:07.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:07.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799322+0000", 2024-09-14T09:09:07.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:09:07.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:07.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799333+0000", 2024-09-14T09:09:07.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1044e-05 2024-09-14T09:09:07.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:07.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799341+0000", 2024-09-14T09:09:07.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8439999999999998e-06 2024-09-14T09:09:07.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:07.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799354+0000", 2024-09-14T09:09:07.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3114e-05 2024-09-14T09:09:07.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801093+0000", 2024-09-14T09:09:07.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017385910000000001 2024-09-14T09:09:07.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:07.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801096+0000", 2024-09-14T09:09:07.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0680000000000001e-06 2024-09-14T09:09:07.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791528+0000", 2024-09-14T09:09:07.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99043264200000003 2024-09-14T09:09:07.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:07.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791570+0000", 2024-09-14T09:09:07.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2144999999999997e-05 2024-09-14T09:09:07.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:07.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791608+0000", 2024-09-14T09:09:07.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7966000000000002e-05 2024-09-14T09:09:07.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.562 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:07.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.562 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:372 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3375104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:07.562 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:07.562 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.677240554999997, 2024-09-14T09:09:07.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992342897, 2024-09-14T09:09:07.562 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:07.562 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:07.562 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:07.562 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:07.562 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:07.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:07.563 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 372 2024-09-14T09:09:07.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.563 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:07.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:07.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:07.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:07.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:07.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:07.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799363+0000", 2024-09-14T09:09:07.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2024-09-14T09:09:07.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:07.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799365+0000", 2024-09-14T09:09:07.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5500000000000001e-06 2024-09-14T09:09:07.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:07.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799371+0000", 2024-09-14T09:09:07.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2500000000000003e-06 2024-09-14T09:09:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799377+0000", 2024-09-14T09:09:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7509999999999997e-06 2024-09-14T09:09:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801107+0000", 2024-09-14T09:09:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017298019999999999 2024-09-14T09:09:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801111+0000", 2024-09-14T09:09:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8619999999999996e-06 2024-09-14T09:09:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791626+0000", 2024-09-14T09:09:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99051563300000001 2024-09-14T09:09:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791668+0000", 2024-09-14T09:09:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1424000000000002e-05 2024-09-14T09:09:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791705+0000", 2024-09-14T09:09:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7035e-05 2024-09-14T09:09:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:373 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.677218609999997, 2024-09-14T09:09:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99253589399999997, 2024-09-14T09:09:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 373 2024-09-14T09:09:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2024-09-14T09:09:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799387+0000", 2024-09-14T09:09:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1019999999999999e-06 2024-09-14T09:09:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799393+0000", 2024-09-14T09:09:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0190000000000003e-06 2024-09-14T09:09:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799398+0000", 2024-09-14T09:09:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:09:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801123+0000", 2024-09-14T09:09:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017251949999999999 2024-09-14T09:09:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801126+0000", 2024-09-14T09:09:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9280000000000002e-06 2024-09-14T09:09:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791746+0000", 2024-09-14T09:09:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99062036899999995 2024-09-14T09:09:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791835+0000", 2024-09-14T09:09:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9004000000000004e-05 2024-09-14T09:09:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791920+0000", 2024-09-14T09:09:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4524000000000006e-05 2024-09-14T09:09:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:10395 3.17 3:e9053d87:::rbd_data.111228c3791c.0000000000000006:18 [read 962560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.797914+0000", 2024-09-14T09:09:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 29.678688709999999, 2024-09-14T09:09:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034376019000000001, 2024-09-14T09:09:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10395 2024-09-14T09:09:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.797914+0000", 2024-09-14T09:09:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.797914+0000", 2024-09-14T09:09:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798042+0000", 2024-09-14T09:09:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012855399999999999 2024-09-14T09:09:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798044+0000", 2024-09-14T09:09:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.086e-06 2024-09-14T09:09:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798049+0000", 2024-09-14T09:09:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7770000000000002e-06 2024-09-14T09:09:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798066+0000", 2024-09-14T09:09:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6405999999999998e-05 2024-09-14T09:09:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832200+0000", 2024-09-14T09:09:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034134022 2024-09-14T09:09:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832241+0000", 2024-09-14T09:09:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1566999999999997e-05 2024-09-14T09:09:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832290+0000", 2024-09-14T09:09:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8606999999999997e-05 2024-09-14T09:09:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:10397 3.17 3:e9053d87:::rbd_data.111228c3791c.0000000000000006:18 [read 1085440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.798088+0000", 2024-09-14T09:09:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 29.678514796999998, 2024-09-14T09:09:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034429187, 2024-09-14T09:09:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10397 2024-09-14T09:09:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798088+0000", 2024-09-14T09:09:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.798088+0000", 2024-09-14T09:09:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803904+0000", 2024-09-14T09:09:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058164799999999997 2024-09-14T09:09:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803908+0000", 2024-09-14T09:09:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8580000000000002e-06 2024-09-14T09:09:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803918+0000", 2024-09-14T09:09:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4939999999999992e-06 2024-09-14T09:09:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.803923+0000", 2024-09-14T09:09:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2599999999999996e-06 2024-09-14T09:09:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832428+0000", 2024-09-14T09:09:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.028504788 2024-09-14T09:09:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832470+0000", 2024-09-14T09:09:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2358999999999999e-05 2024-09-14T09:09:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.832517+0000", 2024-09-14T09:09:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6947999999999998e-05 2024-09-14T09:09:07.581 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.581 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:07.581 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.581 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:07.581 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:07.581 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:07.582 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:09:07.583 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:07.584+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:07.588 INFO:teuthology.orchestra.run.smithi148.stdout:4860 write 0xed86e00 thru 0xed96d85 (0xff86 bytes) 2024-09-14T09:09:07.588 INFO:teuthology.orchestra.run.smithi148.stdout:4862 punch from 0xe46f000 to 0xe479c00, (0xac00 bytes) 2024-09-14T09:09:07.598 INFO:teuthology.orchestra.run.smithi148.stdout:4864 read 0xde0ac00 thru 0xde14996 (0x9d97 bytes) 2024-09-14T09:09:07.620 INFO:teuthology.orchestra.run.smithi148.stdout:4865 punch from 0x428dc00 to 0x4290800, (0x2c00 bytes) 2024-09-14T09:09:07.621 INFO:teuthology.orchestra.run.smithi148.stdout:4868 read 0x3890a00 thru 0x389d542 (0xcb43 bytes) 2024-09-14T09:09:07.621 INFO:teuthology.orchestra.run.smithi148.stdout:4871 read 0xd8cae00 thru 0xd8d4968 (0x9b69 bytes) 2024-09-14T09:09:07.622 INFO:teuthology.orchestra.run.smithi148.stdout:4872 punch from 0xa202c00 to 0xa207600, (0x4a00 bytes) 2024-09-14T09:09:07.629 INFO:teuthology.orchestra.run.smithi148.stdout:4873 punch from 0x49600 to 0x4fa00, (0x6400 bytes) 2024-09-14T09:09:07.641 INFO:teuthology.orchestra.run.smithi148.stdout:4874 trunc from 0xed96e00 to 0x8710e00 2024-09-14T09:09:07.683 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:07.685+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:07.701 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:07.701 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:07.701 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:09:07.701 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:07.711 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:09:07.795 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:07.797+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:07.814 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T09:09:07.874 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:07.874 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:07.874 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:07.874 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:07.874 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:07.885 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:09:07.885 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:07.886+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:07.985 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:07.987+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:07.999 INFO:teuthology.orchestra.run.smithi148.stdout:4875 read 0x37c4a00 thru 0x37c7bef (0x31f0 bytes) 2024-09-14T09:09:08.006 INFO:teuthology.orchestra.run.smithi148.stdout:4878 trunc from 0x8710e00 to 0xbf0ce00 2024-09-14T09:09:08.015 INFO:teuthology.orchestra.run.smithi148.stdout:4883 read 0x3331e00 thru 0x33409d0 (0xebd1 bytes) 2024-09-14T09:09:08.032 INFO:teuthology.orchestra.run.smithi148.stdout:4884 write 0xd6b7c00 thru 0xd6bca20 (0x4e21 bytes) 2024-09-14T09:09:08.041 INFO:teuthology.orchestra.run.smithi148.stdout:4885 write 0x7595a00 thru 0x75a2536 (0xcb37 bytes) 2024-09-14T09:09:08.042 INFO:teuthology.orchestra.run.smithi148.stdout:4886 write 0x60de00 thru 0x612416 (0x4617 bytes) 2024-09-14T09:09:08.047 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:08.047 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:08.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:08.047 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:08.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.047 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2265 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4034560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:08.047 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:08.047 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.185751839000002, 2024-09-14T09:09:08.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073974829000000006, 2024-09-14T09:09:08.048 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.048 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.048 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:08.048 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.048 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:08.048 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:08.048 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2265 2024-09-14T09:09:08.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.048 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:08.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:08.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862542+0000", 2024-09-14T09:09:08.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:09:08.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862543+0000", 2024-09-14T09:09:08.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.81e-06 2024-09-14T09:09:08.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862549+0000", 2024-09-14T09:09:08.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8850000000000004e-06 2024-09-14T09:09:08.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862554+0000", 2024-09-14T09:09:08.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5279999999999997e-06 2024-09-14T09:09:08.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936318+0000", 2024-09-14T09:09:08.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073764422999999996 2024-09-14T09:09:08.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:08.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936412+0000", 2024-09-14T09:09:08.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3801000000000005e-05 2024-09-14T09:09:08.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936516+0000", 2024-09-14T09:09:08.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000104007 2024-09-14T09:09:08.052 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.052 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.052 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.052 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2266 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4096000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:08.052 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:08.052 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.185733975000002, 2024-09-14T09:09:08.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074208332000000002, 2024-09-14T09:09:08.053 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.053 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.053 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:08.053 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.053 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:08.053 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:08.053 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2266 2024-09-14T09:09:08.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.053 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:08.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:08.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862738+0000", 2024-09-14T09:09:08.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017920300000000001 2024-09-14T09:09:08.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862744+0000", 2024-09-14T09:09:08.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3000000000000001e-06 2024-09-14T09:09:08.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862753+0000", 2024-09-14T09:09:08.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8179999999999999e-06 2024-09-14T09:09:08.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862785+0000", 2024-09-14T09:09:08.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1949000000000002e-05 2024-09-14T09:09:08.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936556+0000", 2024-09-14T09:09:08.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073770268999999999 2024-09-14T09:09:08.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:08.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936657+0000", 2024-09-14T09:09:08.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101387 2024-09-14T09:09:08.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936767+0000", 2024-09-14T09:09:08.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110406 2024-09-14T09:09:08.057 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.057 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.057 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.057 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2267 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4157440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:08.057 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:08.057 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.185495393, 2024-09-14T09:09:08.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074200918000000005, 2024-09-14T09:09:08.057 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.057 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.057 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:08.058 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.058 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:08.058 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:08.058 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2267 2024-09-14T09:09:08.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.058 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:08.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:08.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863416+0000", 2024-09-14T09:09:08.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000618492 2024-09-14T09:09:08.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863421+0000", 2024-09-14T09:09:08.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1359999999999996e-06 2024-09-14T09:09:08.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863434+0000", 2024-09-14T09:09:08.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2291e-05 2024-09-14T09:09:08.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863444+0000", 2024-09-14T09:09:08.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9769999999999995e-06 2024-09-14T09:09:08.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936808+0000", 2024-09-14T09:09:08.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073364051999999999 2024-09-14T09:09:08.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:08.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936892+0000", 2024-09-14T09:09:08.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4641999999999994e-05 2024-09-14T09:09:08.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936999+0000", 2024-09-14T09:09:08.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106328 2024-09-14T09:09:08.061 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.061 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.061 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.061 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2328 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 45056~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:08.062 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.863458+0000", 2024-09-14T09:09:08.062 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.184835154000002, 2024-09-14T09:09:08.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073931949999999996, 2024-09-14T09:09:08.062 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.062 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.062 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:08.062 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.062 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:08.062 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:08.062 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2328 2024-09-14T09:09:08.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.062 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863458+0000", 2024-09-14T09:09:08.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863458+0000", 2024-09-14T09:09:08.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863489+0000", 2024-09-14T09:09:08.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1270999999999999e-05 2024-09-14T09:09:08.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863500+0000", 2024-09-14T09:09:08.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0969e-05 2024-09-14T09:09:08.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863509+0000", 2024-09-14T09:09:08.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5210000000000002e-06 2024-09-14T09:09:08.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863515+0000", 2024-09-14T09:09:08.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-09-14T09:09:08.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937038+0000", 2024-09-14T09:09:08.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073522901000000002 2024-09-14T09:09:08.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:08.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937131+0000", 2024-09-14T09:09:08.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.276e-05 2024-09-14T09:09:08.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937390+0000", 2024-09-14T09:09:08.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025917099999999999 2024-09-14T09:09:08.066 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.066 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.066 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.066 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2329 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 106496~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:08.066 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:08.066 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.184766784000001, 2024-09-14T09:09:08.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074180251000000003, 2024-09-14T09:09:08.066 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.066 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.066 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:08.067 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.067 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:08.067 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:08.067 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2329 2024-09-14T09:09:08.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.067 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:08.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:08.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864203+0000", 2024-09-14T09:09:08.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000677015 2024-09-14T09:09:08.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864208+0000", 2024-09-14T09:09:08.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.972e-06 2024-09-14T09:09:08.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864221+0000", 2024-09-14T09:09:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2683e-05 2024-09-14T09:09:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864229+0000", 2024-09-14T09:09:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0809999999999994e-06 2024-09-14T09:09:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937430+0000", 2024-09-14T09:09:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073201231000000005 2024-09-14T09:09:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937513+0000", 2024-09-14T09:09:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2652999999999996e-05 2024-09-14T09:09:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937707+0000", 2024-09-14T09:09:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000193616 2024-09-14T09:09:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.070 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2331 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 229376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.183949287000001, 2024-09-14T09:09:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.07400843, 2024-09-14T09:09:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2331 2024-09-14T09:09:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868104+0000", 2024-09-14T09:09:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003760453 2024-09-14T09:09:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868109+0000", 2024-09-14T09:09:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9339999999999997e-06 2024-09-14T09:09:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868119+0000", 2024-09-14T09:09:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5389999999999996e-06 2024-09-14T09:09:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868126+0000", 2024-09-14T09:09:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4499999999999998e-06 2024-09-14T09:09:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938065+0000", 2024-09-14T09:09:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069938809000000005 2024-09-14T09:09:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938148+0000", 2024-09-14T09:09:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3171999999999996e-05 2024-09-14T09:09:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938352+0000", 2024-09-14T09:09:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020407300000000001 2024-09-14T09:09:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2380 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3239936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.168924259000001, 2024-09-14T09:09:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073985913, 2024-09-14T09:09:08.075 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2380 2024-09-14T09:09:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:08.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879697+0000", 2024-09-14T09:09:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032864100000000001 2024-09-14T09:09:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879702+0000", 2024-09-14T09:09:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.578e-06 2024-09-14T09:09:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879716+0000", 2024-09-14T09:09:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.413e-05 2024-09-14T09:09:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879724+0000", 2024-09-14T09:09:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.559e-06 2024-09-14T09:09:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953155+0000", 2024-09-14T09:09:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073431221000000005 2024-09-14T09:09:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953247+0000", 2024-09-14T09:09:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1662000000000004e-05 2024-09-14T09:09:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953355+0000", 2024-09-14T09:09:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010812200000000001 2024-09-14T09:09:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2500 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2789376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:09:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.150393214000001, 2024-09-14T09:09:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073867281000000007, 2024-09-14T09:09:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:08.080 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:08.081 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2500 2024-09-14T09:09:08.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.081 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:09:08.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:09:08.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:09:08.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1e-07 2024-09-14T09:09:08.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897901+0000", 2024-09-14T09:09:08.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1650000000000001e-06 2024-09-14T09:09:08.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897905+0000", 2024-09-14T09:09:08.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.755e-06 2024-09-14T09:09:08.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897908+0000", 2024-09-14T09:09:08.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7480000000000002e-06 2024-09-14T09:09:08.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971448+0000", 2024-09-14T09:09:08.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073539801000000002 2024-09-14T09:09:08.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:08.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971535+0000", 2024-09-14T09:09:08.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7085999999999999e-05 2024-09-14T09:09:08.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971767+0000", 2024-09-14T09:09:08.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023251599999999999 2024-09-14T09:09:08.084 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.084 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.084 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.084 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2501 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2850816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:08.084 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:08.085 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.150381955, 2024-09-14T09:09:08.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074288858999999999, 2024-09-14T09:09:08.085 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.085 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.085 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:08.085 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.085 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:08.085 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:08.085 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2501 2024-09-14T09:09:08.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.085 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:08.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:08.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:08.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.41e-07 2024-09-14T09:09:08.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897913+0000", 2024-09-14T09:09:08.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3090000000000001e-06 2024-09-14T09:09:08.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897918+0000", 2024-09-14T09:09:08.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8470000000000003e-06 2024-09-14T09:09:08.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897922+0000", 2024-09-14T09:09:08.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5549999999999996e-06 2024-09-14T09:09:08.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971872+0000", 2024-09-14T09:09:08.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073950057999999999 2024-09-14T09:09:08.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:08.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971958+0000", 2024-09-14T09:09:08.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5941999999999998e-05 2024-09-14T09:09:08.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972200+0000", 2024-09-14T09:09:08.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000241907 2024-09-14T09:09:08.088 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.088 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.089 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.089 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2502 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2912256~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:08.089 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:08.089 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.150342774999999, 2024-09-14T09:09:08.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074614080999999999, 2024-09-14T09:09:08.089 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.089 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.089 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:08.089 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.089 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:08.089 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:08.089 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2502 2024-09-14T09:09:08.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.090 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:08.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:08.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897951+0000", 2024-09-14T09:09:08.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:09:08.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897953+0000", 2024-09-14T09:09:08.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5670000000000002e-06 2024-09-14T09:09:08.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897970+0000", 2024-09-14T09:09:08.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6319000000000001e-05 2024-09-14T09:09:08.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897976+0000", 2024-09-14T09:09:08.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8760000000000002e-06 2024-09-14T09:09:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972245+0000", 2024-09-14T09:09:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074269186000000001 2024-09-14T09:09:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972333+0000", 2024-09-14T09:09:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7800999999999995e-05 2024-09-14T09:09:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972564+0000", 2024-09-14T09:09:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000231833 2024-09-14T09:09:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2503 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2973696~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.150308758000001, 2024-09-14T09:09:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074944286999999998, 2024-09-14T09:09:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2503 2024-09-14T09:09:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897985+0000", 2024-09-14T09:09:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999998e-07 2024-09-14T09:09:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897987+0000", 2024-09-14T09:09:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.401e-06 2024-09-14T09:09:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897999+0000", 2024-09-14T09:09:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1851999999999999e-05 2024-09-14T09:09:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898005+0000", 2024-09-14T09:09:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9789999999999998e-06 2024-09-14T09:09:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972609+0000", 2024-09-14T09:09:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074604217 2024-09-14T09:09:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972684+0000", 2024-09-14T09:09:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4777999999999995e-05 2024-09-14T09:09:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972929+0000", 2024-09-14T09:09:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024448100000000001 2024-09-14T09:09:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2504 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3035136~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.150280666, 2024-09-14T09:09:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075285131000000005, 2024-09-14T09:09:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2504 2024-09-14T09:09:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898078+0000", 2024-09-14T09:09:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5775e-05 2024-09-14T09:09:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898082+0000", 2024-09-14T09:09:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.49e-06 2024-09-14T09:09:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898092+0000", 2024-09-14T09:09:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0509999999999999e-05 2024-09-14T09:09:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898099+0000", 2024-09-14T09:09:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.81e-06 2024-09-14T09:09:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972971+0000", 2024-09-14T09:09:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074871788999999994 2024-09-14T09:09:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973055+0000", 2024-09-14T09:09:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3980000000000006e-05 2024-09-14T09:09:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973298+0000", 2024-09-14T09:09:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024277700000000001 2024-09-14T09:09:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.102 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2505 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3096576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:08.102 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:08.102 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.150184411000001, 2024-09-14T09:09:08.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075506668999999998, 2024-09-14T09:09:08.102 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.102 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.102 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:08.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2505 2024-09-14T09:09:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898370+0000", 2024-09-14T09:09:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026128799999999998 2024-09-14T09:09:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898374+0000", 2024-09-14T09:09:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8070000000000001e-06 2024-09-14T09:09:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898383+0000", 2024-09-14T09:09:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0520000000000007e-06 2024-09-14T09:09:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898389+0000", 2024-09-14T09:09:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2639999999999997e-06 2024-09-14T09:09:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973330+0000", 2024-09-14T09:09:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074940548999999995 2024-09-14T09:09:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973402+0000", 2024-09-14T09:09:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2556000000000001e-05 2024-09-14T09:09:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973615+0000", 2024-09-14T09:09:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000213153 2024-09-14T09:09:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.107 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2506 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3158016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:08.107 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:08.107 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.149891167, 2024-09-14T09:09:08.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075556110999999995, 2024-09-14T09:09:08.107 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.107 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.107 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:08.107 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.107 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:08.107 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:08.107 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2506 2024-09-14T09:09:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898497+0000", 2024-09-14T09:09:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4806e-05 2024-09-14T09:09:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898500+0000", 2024-09-14T09:09:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.54e-06 2024-09-14T09:09:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898507+0000", 2024-09-14T09:09:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1590000000000004e-06 2024-09-14T09:09:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898513+0000", 2024-09-14T09:09:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.015e-06 2024-09-14T09:09:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973656+0000", 2024-09-14T09:09:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075142929999999997 2024-09-14T09:09:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973742+0000", 2024-09-14T09:09:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5535e-05 2024-09-14T09:09:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973958+0000", 2024-09-14T09:09:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000216126 2024-09-14T09:09:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2507 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3219456~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.149762583000001, 2024-09-14T09:09:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075623459000000004, 2024-09-14T09:09:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2507 2024-09-14T09:09:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898761+0000", 2024-09-14T09:09:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000230614 2024-09-14T09:09:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898765+0000", 2024-09-14T09:09:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6629999999999999e-06 2024-09-14T09:09:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898774+0000", 2024-09-14T09:09:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6749999999999997e-06 2024-09-14T09:09:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898781+0000", 2024-09-14T09:09:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4640000000000003e-06 2024-09-14T09:09:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973985+0000", 2024-09-14T09:09:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075204101999999995 2024-09-14T09:09:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974063+0000", 2024-09-14T09:09:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7632000000000005e-05 2024-09-14T09:09:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974154+0000", 2024-09-14T09:09:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1309000000000003e-05 2024-09-14T09:09:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2508 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3280896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.14950082, 2024-09-14T09:09:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075576943999999993, 2024-09-14T09:09:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2508 2024-09-14T09:09:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899176+0000", 2024-09-14T09:09:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038340500000000002 2024-09-14T09:09:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899179+0000", 2024-09-14T09:09:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0290000000000001e-06 2024-09-14T09:09:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899186+0000", 2024-09-14T09:09:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8199999999999999e-06 2024-09-14T09:09:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899190+0000", 2024-09-14T09:09:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2050000000000004e-06 2024-09-14T09:09:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974193+0000", 2024-09-14T09:09:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075003632000000001 2024-09-14T09:09:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974276+0000", 2024-09-14T09:09:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2272000000000001e-05 2024-09-14T09:09:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974369+0000", 2024-09-14T09:09:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3580999999999997e-05 2024-09-14T09:09:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2509 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3342336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.149093203, 2024-09-14T09:09:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075356229999999996, 2024-09-14T09:09:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2509 2024-09-14T09:09:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899439+0000", 2024-09-14T09:09:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023958599999999999 2024-09-14T09:09:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899444+0000", 2024-09-14T09:09:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8790000000000002e-06 2024-09-14T09:09:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899455+0000", 2024-09-14T09:09:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0597999999999999e-05 2024-09-14T09:09:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899462+0000", 2024-09-14T09:09:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8179999999999998e-06 2024-09-14T09:09:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974400+0000", 2024-09-14T09:09:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074937999000000005 2024-09-14T09:09:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974465+0000", 2024-09-14T09:09:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5134000000000004e-05 2024-09-14T09:09:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974556+0000", 2024-09-14T09:09:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1216000000000002e-05 2024-09-14T09:09:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2510 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3403776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.148817810000001, 2024-09-14T09:09:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075295775999999995, 2024-09-14T09:09:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2510 2024-09-14T09:09:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899691+0000", 2024-09-14T09:09:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021615999999999999 2024-09-14T09:09:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899696+0000", 2024-09-14T09:09:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3200000000000001e-06 2024-09-14T09:09:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899704+0000", 2024-09-14T09:09:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9440000000000005e-06 2024-09-14T09:09:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899710+0000", 2024-09-14T09:09:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.584e-06 2024-09-14T09:09:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974594+0000", 2024-09-14T09:09:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074883551000000007 2024-09-14T09:09:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974679+0000", 2024-09-14T09:09:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5365999999999995e-05 2024-09-14T09:09:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974771+0000", 2024-09-14T09:09:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1850999999999999e-05 2024-09-14T09:09:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2511 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3465216~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.148571592, 2024-09-14T09:09:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075234668000000005, 2024-09-14T09:09:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2511 2024-09-14T09:09:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899951+0000", 2024-09-14T09:09:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000229569 2024-09-14T09:09:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899955+0000", 2024-09-14T09:09:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1010000000000002e-06 2024-09-14T09:09:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899971+0000", 2024-09-14T09:09:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5648999999999999e-05 2024-09-14T09:09:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899978+0000", 2024-09-14T09:09:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0829999999999998e-06 2024-09-14T09:09:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974806+0000", 2024-09-14T09:09:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074828092999999998 2024-09-14T09:09:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974870+0000", 2024-09-14T09:09:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4492000000000005e-05 2024-09-14T09:09:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974956+0000", 2024-09-14T09:09:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5680999999999995e-05 2024-09-14T09:09:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2512 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3526656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.148304047, 2024-09-14T09:09:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075178812999999997, 2024-09-14T09:09:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2512 2024-09-14T09:09:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904181+0000", 2024-09-14T09:09:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041919399999999999 2024-09-14T09:09:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904186+0000", 2024-09-14T09:09:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2390000000000002e-06 2024-09-14T09:09:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904199+0000", 2024-09-14T09:09:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2709e-05 2024-09-14T09:09:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904207+0000", 2024-09-14T09:09:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8150000000000006e-06 2024-09-14T09:09:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975000+0000", 2024-09-14T09:09:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.070793444999999997 2024-09-14T09:09:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975079+0000", 2024-09-14T09:09:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8480999999999996e-05 2024-09-14T09:09:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975168+0000", 2024-09-14T09:09:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9184000000000005e-05 2024-09-14T09:09:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.139 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:08.141 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:09:08.141 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:08.141+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:08.142 INFO:teuthology.orchestra.run.smithi148.stdout:4887 trunc from 0xd6bcc00 to 0xa0aa000 2024-09-14T09:09:08.142 INFO:teuthology.orchestra.run.smithi148.stdout:4888 write 0xd09d600 thru 0xd0a134e (0x3d4f bytes) 2024-09-14T09:09:08.142 INFO:teuthology.orchestra.run.smithi148.stdout:4892 read 0x57b4600 thru 0x57bbfcd (0x79ce bytes) 2024-09-14T09:09:08.142 INFO:teuthology.orchestra.run.smithi148.stdout:4893 write 0x201fc00 thru 0x2028afa (0x8efb bytes) 2024-09-14T09:09:08.142 INFO:teuthology.orchestra.run.smithi148.stdout:4895 trunc from 0xd0a1400 to 0x4822400 2024-09-14T09:09:08.143 INFO:teuthology.orchestra.run.smithi148.stdout:4897 write 0x313ca00 thru 0x314bfd7 (0xf5d8 bytes) 2024-09-14T09:09:08.143 INFO:teuthology.orchestra.run.smithi148.stdout:4903 punch from 0xe57600 to 0xe57e00, (0x800 bytes) 2024-09-14T09:09:08.143 INFO:teuthology.orchestra.run.smithi148.stdout:4904 trunc from 0x4822400 to 0x4848200 2024-09-14T09:09:08.143 INFO:teuthology.orchestra.run.smithi148.stdout:4905 read 0x3e24200 thru 0x3e2f2cb (0xb0cc bytes) 2024-09-14T09:09:08.143 INFO:teuthology.orchestra.run.smithi148.stdout:4906 punch from 0x241e00 to 0x24a400, (0x8600 bytes) 2024-09-14T09:09:08.143 INFO:teuthology.orchestra.run.smithi148.stdout:4907 read 0x39ca200 thru 0x39d76ce (0xd4cf bytes) 2024-09-14T09:09:08.143 INFO:teuthology.orchestra.run.smithi148.stdout:4908 punch from 0x1f42200 to 0x1f47000, (0x4e00 bytes) 2024-09-14T09:09:08.143 INFO:teuthology.orchestra.run.smithi148.stdout:4909 punch from 0x19a5c00 to 0x19a7800, (0x1c00 bytes) 2024-09-14T09:09:08.143 INFO:teuthology.orchestra.run.smithi148.stdout:4917 write 0x3ec5000 thru 0x3ed30e7 (0xe0e8 bytes) 2024-09-14T09:09:08.143 INFO:teuthology.orchestra.run.smithi148.stdout:4919 write 0x193e800 thru 0x194b1a7 (0xc9a8 bytes) 2024-09-14T09:09:08.143 INFO:teuthology.orchestra.run.smithi148.stdout:4920 read 0xc2a600 thru 0xc38c4b (0xe64c bytes) 2024-09-14T09:09:08.160 INFO:teuthology.orchestra.run.smithi148.stdout:4924 write 0x93bac00 thru 0x93c322c (0x862d bytes) 2024-09-14T09:09:08.172 INFO:teuthology.orchestra.run.smithi148.stdout:4925 trunc from 0x93c3400 to 0x5d85a00 2024-09-14T09:09:08.189 INFO:teuthology.orchestra.run.smithi148.stdout:4926 trunc from 0x5d85a00 to 0x37a3800 2024-09-14T09:09:08.224 INFO:teuthology.orchestra.run.smithi148.stdout:4927 write 0x5f4da00 thru 0x5f57a65 (0xa066 bytes) 2024-09-14T09:09:08.233 INFO:teuthology.orchestra.run.smithi148.stdout:4928 trunc from 0x5f57c00 to 0xaaa6200 2024-09-14T09:09:08.240 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:08.243+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:08.243 INFO:teuthology.orchestra.run.smithi148.stdout:4929 write 0x974ea00 thru 0x975ceb8 (0xe4b9 bytes) 2024-09-14T09:09:08.244 INFO:teuthology.orchestra.run.smithi148.stdout:4930 read 0x6e88600 thru 0x6e8ea55 (0x6456 bytes) 2024-09-14T09:09:08.258 INFO:teuthology.orchestra.run.smithi148.stdout:4931 write 0xdaece00 thru 0xdaf22ac (0x54ad bytes) 2024-09-14T09:09:08.263 INFO:teuthology.orchestra.run.smithi148.stdout:4937 write 0x31dd800 thru 0x31df799 (0x1f9a bytes) 2024-09-14T09:09:08.265 INFO:teuthology.orchestra.run.smithi148.stdout:4940 write 0x1a49000 thru 0x1a4f03a (0x603b bytes) 2024-09-14T09:09:08.266 INFO:teuthology.orchestra.run.smithi148.stdout:4941 read 0x401e400 thru 0x402a747 (0xc348 bytes) 2024-09-14T09:09:08.266 INFO:teuthology.orchestra.run.smithi148.stdout:4944 clone 30 order 18 su 2048 sc 6 2024-09-14T09:09:08.297 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:08.297 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:08.297 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:09:08.297 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:08.306 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:09:08.349 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:08.351+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:08.407 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:08.407 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:08.415 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:09:08.442 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:08.444+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:08.543 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:08.546+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:08.559 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:08.559 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:08.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:08.560 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:08.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.560 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:987 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:08.560 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:08.560 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.7023774790000008, 2024-09-14T09:09:08.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001359466, 2024-09-14T09:09:08.560 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.560 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.560 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:08.560 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.560 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:08.560 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:08.560 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 987 2024-09-14T09:09:08.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.561 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:08.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:08.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858333+0000", 2024-09-14T09:09:08.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.621e-06 2024-09-14T09:09:08.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858349+0000", 2024-09-14T09:09:08.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5758000000000001e-05 2024-09-14T09:09:08.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858366+0000", 2024-09-14T09:09:08.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7368e-05 2024-09-14T09:09:08.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858382+0000", 2024-09-14T09:09:08.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6039e-05 2024-09-14T09:09:08.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858441+0000", 2024-09-14T09:09:08.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8662999999999997e-05 2024-09-14T09:09:08.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858449+0000", 2024-09-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3960000000000006e-06 2024-09-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859682+0000", 2024-09-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001233096 2024-09-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859691+0000", 2024-09-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5250000000000005e-06 2024-09-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.564 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.565 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:988 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:08.565 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:08.565 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.7022496090000008, 2024-09-14T09:09:08.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0012656799999999, 2024-09-14T09:09:08.565 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.565 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.565 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:08.565 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.565 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:08.565 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:08.565 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 988 2024-09-14T09:09:08.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.566 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:08.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:08.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858460+0000", 2024-09-14T09:09:08.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9999999999999997e-07 2024-09-14T09:09:08.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858463+0000", 2024-09-14T09:09:08.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7459999999999998e-06 2024-09-14T09:09:08.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858471+0000", 2024-09-14T09:09:08.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3900000000000004e-06 2024-09-14T09:09:08.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858478+0000", 2024-09-14T09:09:08.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7020000000000004e-06 2024-09-14T09:09:08.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859102+0000", 2024-09-14T09:09:08.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062419699999999995 2024-09-14T09:09:08.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:08.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859109+0000", 2024-09-14T09:09:08.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7419999999999997e-06 2024-09-14T09:09:08.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859718+0000", 2024-09-14T09:09:08.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006085629999999 2024-09-14T09:09:08.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859725+0000", 2024-09-14T09:09:08.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7399999999999998e-06 2024-09-14T09:09:08.569 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.569 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.570 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.570 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:989 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:08.570 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859046+0000", 2024-09-14T09:09:08.570 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.7016629380000001, 2024-09-14T09:09:08.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000708894, 2024-09-14T09:09:08.570 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.570 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.570 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:08.570 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.570 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:08.570 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:08.570 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 989 2024-09-14T09:09:08.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.571 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859046+0000", 2024-09-14T09:09:08.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859046+0000", 2024-09-14T09:09:08.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859046+0000", 2024-09-14T09:09:08.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9599999999999999e-07 2024-09-14T09:09:08.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859050+0000", 2024-09-14T09:09:08.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9380000000000002e-06 2024-09-14T09:09:08.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859062+0000", 2024-09-14T09:09:08.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2103000000000001e-05 2024-09-14T09:09:08.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859072+0000", 2024-09-14T09:09:08.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4870000000000008e-06 2024-09-14T09:09:08.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859320+0000", 2024-09-14T09:09:08.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024821799999999997 2024-09-14T09:09:08.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:08.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859327+0000", 2024-09-14T09:09:08.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0480000000000001e-06 2024-09-14T09:09:08.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859746+0000", 2024-09-14T09:09:08.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0004190479999999 2024-09-14T09:09:08.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859755+0000", 2024-09-14T09:09:08.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3559999999999993e-06 2024-09-14T09:09:08.577 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.577 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.577 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.578 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:990 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:08.578 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859286+0000", 2024-09-14T09:09:08.578 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.7014221959999993, 2024-09-14T09:09:08.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0004942889999999, 2024-09-14T09:09:08.578 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.578 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.578 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:08.578 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.578 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:08.578 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:08.578 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 990 2024-09-14T09:09:08.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859286+0000", 2024-09-14T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859286+0000", 2024-09-14T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859287+0000", 2024-09-14T09:09:08.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1900000000000002e-07 2024-09-14T09:09:08.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859291+0000", 2024-09-14T09:09:08.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1239999999999998e-06 2024-09-14T09:09:08.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859302+0000", 2024-09-14T09:09:08.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0849999999999999e-05 2024-09-14T09:09:08.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859309+0000", 2024-09-14T09:09:08.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2880000000000004e-06 2024-09-14T09:09:08.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859352+0000", 2024-09-14T09:09:08.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2726999999999999e-05 2024-09-14T09:09:08.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:08.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:08.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4689999999999996e-06 2024-09-14T09:09:08.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859774+0000", 2024-09-14T09:09:08.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000416108 2024-09-14T09:09:08.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859781+0000", 2024-09-14T09:09:08.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0040000000000002e-06 2024-09-14T09:09:08.582 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.582 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.582 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.582 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1003 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:08.582 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:08.583 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.701386372, 2024-09-14T09:09:08.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009495209999999, 2024-09-14T09:09:08.583 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.583 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.583 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:08.583 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.583 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:08.583 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:08.583 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1003 2024-09-14T09:09:08.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.583 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:08.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:08.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859323+0000", 2024-09-14T09:09:08.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3099999999999998e-07 2024-09-14T09:09:08.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859326+0000", 2024-09-14T09:09:08.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-06 2024-09-14T09:09:08.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859333+0000", 2024-09-14T09:09:08.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3300000000000001e-06 2024-09-14T09:09:08.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859339+0000", 2024-09-14T09:09:08.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6400000000000002e-06 2024-09-14T09:09:08.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859387+0000", 2024-09-14T09:09:08.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8448000000000001e-05 2024-09-14T09:09:08.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:08.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:09:08.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9540000000000004e-06 2024-09-14T09:09:08.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860260+0000", 2024-09-14T09:09:08.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000864921 2024-09-14T09:09:08.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860272+0000", 2024-09-14T09:09:08.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1993e-05 2024-09-14T09:09:08.587 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.587 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.587 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.588 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1004 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:08.588 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:08.588 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.7013507969999999, 2024-09-14T09:09:08.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000947875, 2024-09-14T09:09:08.588 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.588 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.588 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:08.588 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.588 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:08.588 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:08.588 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1004 2024-09-14T09:09:08.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.588 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:08.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:08.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:08.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7199999999999999e-07 2024-09-14T09:09:08.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859361+0000", 2024-09-14T09:09:08.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.892e-06 2024-09-14T09:09:08.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859368+0000", 2024-09-14T09:09:08.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4370000000000004e-06 2024-09-14T09:09:08.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859373+0000", 2024-09-14T09:09:08.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6690000000000003e-06 2024-09-14T09:09:08.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859430+0000", 2024-09-14T09:09:08.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6456999999999998e-05 2024-09-14T09:09:08.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:08.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859434+0000", 2024-09-14T09:09:08.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8410000000000002e-06 2024-09-14T09:09:08.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860299+0000", 2024-09-14T09:09:08.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008650370000001 2024-09-14T09:09:08.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860306+0000", 2024-09-14T09:09:08.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0700000000000001e-06 2024-09-14T09:09:08.592 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.592 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.592 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.593 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1005 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:08.593 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:08.593 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.7013271240000005, 2024-09-14T09:09:08.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009585480000001, 2024-09-14T09:09:08.593 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.593 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.593 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:08.593 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.593 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:08.593 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:08.593 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1005 2024-09-14T09:09:08.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.594 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:08.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:08.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:08.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9700000000000002e-07 2024-09-14T09:09:08.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859384+0000", 2024-09-14T09:09:08.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.024e-06 2024-09-14T09:09:08.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859390+0000", 2024-09-14T09:09:08.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7080000000000002e-06 2024-09-14T09:09:08.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:09:08.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8980000000000004e-06 2024-09-14T09:09:08.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859527+0000", 2024-09-14T09:09:08.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013228099999999999 2024-09-14T09:09:08.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:08.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859532+0000", 2024-09-14T09:09:08.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5899999999999998e-06 2024-09-14T09:09:08.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860330+0000", 2024-09-14T09:09:08.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0007973509999999 2024-09-14T09:09:08.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860340+0000", 2024-09-14T09:09:08.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0299000000000001e-05 2024-09-14T09:09:08.597 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.597 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.598 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.598 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1006 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:08.598 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:08.598 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.7013039279999997, 2024-09-14T09:09:08.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001032039, 2024-09-14T09:09:08.598 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.598 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.598 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:08.598 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.598 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:08.598 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:08.598 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1006 2024-09-14T09:09:08.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.598 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:08.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:08.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:08.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6499999999999999e-07 2024-09-14T09:09:08.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859407+0000", 2024-09-14T09:09:08.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1160000000000002e-06 2024-09-14T09:09:08.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859413+0000", 2024-09-14T09:09:08.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8880000000000002e-06 2024-09-14T09:09:08.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859419+0000", 2024-09-14T09:09:08.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3550000000000004e-06 2024-09-14T09:09:08.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859558+0000", 2024-09-14T09:09:08.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000138942 2024-09-14T09:09:08.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:08.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859563+0000", 2024-09-14T09:09:08.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.665e-06 2024-09-14T09:09:08.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860427+0000", 2024-09-14T09:09:08.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008635299999999 2024-09-14T09:09:08.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860437+0000", 2024-09-14T09:09:08.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0078000000000001e-05 2024-09-14T09:09:08.602 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.602 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.602 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.602 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1029 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:08.602 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859527+0000", 2024-09-14T09:09:08.602 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.7011813789999994, 2024-09-14T09:09:08.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0002818689999999, 2024-09-14T09:09:08.603 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.603 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.603 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:08.603 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.603 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:08.603 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:08.603 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1029 2024-09-14T09:09:08.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.603 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859527+0000", 2024-09-14T09:09:08.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859527+0000", 2024-09-14T09:09:08.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859528+0000", 2024-09-14T09:09:08.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0200000000000002e-07 2024-09-14T09:09:08.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859530+0000", 2024-09-14T09:09:08.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3810000000000002e-06 2024-09-14T09:09:08.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859536+0000", 2024-09-14T09:09:08.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0000000000000002e-06 2024-09-14T09:09:08.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859541+0000", 2024-09-14T09:09:08.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2159999999999997e-06 2024-09-14T09:09:08.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859580+0000", 2024-09-14T09:09:08.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8432000000000001e-05 2024-09-14T09:09:08.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:08.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859587+0000", 2024-09-14T09:09:08.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7989999999999996e-06 2024-09-14T09:09:08.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859801+0000", 2024-09-14T09:09:08.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000214315 2024-09-14T09:09:08.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859809+0000", 2024-09-14T09:09:08.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2239999999999995e-06 2024-09-14T09:09:08.607 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.607 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.607 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.607 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1030 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:08.607 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859553+0000", 2024-09-14T09:09:08.607 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.7011558519999994, 2024-09-14T09:09:08.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0002901259999999, 2024-09-14T09:09:08.607 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.608 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.608 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:08.608 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.608 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:08.608 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:08.608 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1030 2024-09-14T09:09:08.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.608 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859553+0000", 2024-09-14T09:09:08.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859553+0000", 2024-09-14T09:09:08.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859553+0000", 2024-09-14T09:09:08.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8599999999999999e-07 2024-09-14T09:09:08.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859556+0000", 2024-09-14T09:09:08.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5679999999999998e-06 2024-09-14T09:09:08.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859561+0000", 2024-09-14T09:09:08.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.682e-06 2024-09-14T09:09:08.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859564+0000", 2024-09-14T09:09:08.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8380000000000002e-06 2024-09-14T09:09:08.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859619+0000", 2024-09-14T09:09:08.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4761e-05 2024-09-14T09:09:08.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:08.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859624+0000", 2024-09-14T09:09:08.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3360000000000002e-06 2024-09-14T09:09:08.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859834+0000", 2024-09-14T09:09:08.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0002094290000001 2024-09-14T09:09:08.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859843+0000", 2024-09-14T09:09:08.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1260000000000004e-06 2024-09-14T09:09:08.611 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.612 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.612 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.612 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1031 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:08.612 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859574+0000", 2024-09-14T09:09:08.612 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.7011347350000001, 2024-09-14T09:09:08.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0002981630000001, 2024-09-14T09:09:08.612 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.612 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.612 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:08.612 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.612 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:08.612 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:08.612 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1031 2024-09-14T09:09:08.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.613 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859574+0000", 2024-09-14T09:09:08.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859574+0000", 2024-09-14T09:09:08.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859574+0000", 2024-09-14T09:09:08.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7000000000000001e-07 2024-09-14T09:09:08.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859576+0000", 2024-09-14T09:09:08.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3069999999999999e-06 2024-09-14T09:09:08.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859579+0000", 2024-09-14T09:09:08.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3680000000000002e-06 2024-09-14T09:09:08.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859582+0000", 2024-09-14T09:09:08.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6029999999999999e-06 2024-09-14T09:09:08.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:08.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9903999999999999e-05 2024-09-14T09:09:08.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:08.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859667+0000", 2024-09-14T09:09:08.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.711e-06 2024-09-14T09:09:08.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859862+0000", 2024-09-14T09:09:08.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000194732 2024-09-14T09:09:08.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859872+0000", 2024-09-14T09:09:08.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268000000000001e-05 2024-09-14T09:09:08.616 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.616 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.616 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.617 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1032 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:08.617 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859586+0000", 2024-09-14T09:09:08.617 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.7011226910000001, 2024-09-14T09:09:08.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000315565, 2024-09-14T09:09:08.617 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.617 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.617 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:08.617 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.617 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:08.617 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:08.617 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1032 2024-09-14T09:09:08.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.618 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859586+0000", 2024-09-14T09:09:08.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859586+0000", 2024-09-14T09:09:08.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859586+0000", 2024-09-14T09:09:08.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.05e-07 2024-09-14T09:09:08.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859587+0000", 2024-09-14T09:09:08.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9600000000000008e-07 2024-09-14T09:09:08.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859590+0000", 2024-09-14T09:09:08.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9239999999999999e-06 2024-09-14T09:09:08.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859593+0000", 2024-09-14T09:09:08.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5160000000000001e-06 2024-09-14T09:09:08.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859687+0000", 2024-09-14T09:09:08.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4197000000000006e-05 2024-09-14T09:09:08.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:08.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859692+0000", 2024-09-14T09:09:08.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8960000000000002e-06 2024-09-14T09:09:08.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859895+0000", 2024-09-14T09:09:08.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0002035090000001 2024-09-14T09:09:08.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859902+0000", 2024-09-14T09:09:08.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3219999999999998e-06 2024-09-14T09:09:08.621 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.621 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.621 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.622 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1045 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:08.622 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:08.622 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.7011044480000006, 2024-09-14T09:09:08.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008612990000001, 2024-09-14T09:09:08.622 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.622 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.622 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:08.622 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.622 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:08.623 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:08.623 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1045 2024-09-14T09:09:08.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.623 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:08.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:08.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859605+0000", 2024-09-14T09:09:08.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6e-07 2024-09-14T09:09:08.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859606+0000", 2024-09-14T09:09:08.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8819999999999999e-06 2024-09-14T09:09:08.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859610+0000", 2024-09-14T09:09:08.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4290000000000001e-06 2024-09-14T09:09:08.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859612+0000", 2024-09-14T09:09:08.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6309999999999999e-06 2024-09-14T09:09:08.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859643+0000", 2024-09-14T09:09:08.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0224000000000001e-05 2024-09-14T09:09:08.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:08.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859647+0000", 2024-09-14T09:09:08.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9049999999999999e-06 2024-09-14T09:09:08.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860458+0000", 2024-09-14T09:09:08.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008111180000001 2024-09-14T09:09:08.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860466+0000", 2024-09-14T09:09:08.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:09:08.626 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.627 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.627 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.627 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1046 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:08.627 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:08.627 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.7010909910000009, 2024-09-14T09:09:08.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000874262, 2024-09-14T09:09:08.627 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.627 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.627 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:08.627 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.627 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:08.627 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:08.627 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1046 2024-09-14T09:09:08.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.628 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:08.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:08.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:08.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:09:08.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859619+0000", 2024-09-14T09:09:08.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0559999999999999e-06 2024-09-14T09:09:08.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859622+0000", 2024-09-14T09:09:08.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0170000000000001e-06 2024-09-14T09:09:08.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859625+0000", 2024-09-14T09:09:08.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7209999999999999e-06 2024-09-14T09:09:08.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859666+0000", 2024-09-14T09:09:08.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1677000000000001e-05 2024-09-14T09:09:08.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:08.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859672+0000", 2024-09-14T09:09:08.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4609999999999999e-06 2024-09-14T09:09:08.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860485+0000", 2024-09-14T09:09:08.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000813505 2024-09-14T09:09:08.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860492+0000", 2024-09-14T09:09:08.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6159999999999998e-06 2024-09-14T09:09:08.631 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.631 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.631 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.632 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1047 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:08.632 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:08.632 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.7010796569999993, 2024-09-14T09:09:08.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008950190000001, 2024-09-14T09:09:08.632 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.632 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.632 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:08.632 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.632 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:08.632 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:08.632 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1047 2024-09-14T09:09:08.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.633 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:08.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:08.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:08.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6600000000000003e-07 2024-09-14T09:09:08.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859631+0000", 2024-09-14T09:09:08.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5600000000000001e-06 2024-09-14T09:09:08.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859637+0000", 2024-09-14T09:09:08.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7309999999999998e-06 2024-09-14T09:09:08.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859641+0000", 2024-09-14T09:09:08.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0840000000000002e-06 2024-09-14T09:09:08.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859691+0000", 2024-09-14T09:09:08.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0587999999999997e-05 2024-09-14T09:09:08.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:08.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859696+0000", 2024-09-14T09:09:08.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8940000000000001e-06 2024-09-14T09:09:08.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860516+0000", 2024-09-14T09:09:08.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008200780000001 2024-09-14T09:09:08.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860524+0000", 2024-09-14T09:09:08.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8180000000000004e-06 2024-09-14T09:09:08.636 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.636 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.636 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.636 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1048 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:08.636 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:08.637 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.7010478980000006, 2024-09-14T09:09:08.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008904780000001, 2024-09-14T09:09:08.637 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.637 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.637 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:08.637 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.637 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:08.637 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:08.637 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1048 2024-09-14T09:09:08.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.637 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:08.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:08.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:08.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4700000000000002e-07 2024-09-14T09:09:08.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859663+0000", 2024-09-14T09:09:08.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0420000000000001e-06 2024-09-14T09:09:08.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859669+0000", 2024-09-14T09:09:08.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8989999999999998e-06 2024-09-14T09:09:08.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859673+0000", 2024-09-14T09:09:08.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2209999999999999e-06 2024-09-14T09:09:08.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859719+0000", 2024-09-14T09:09:08.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5788000000000003e-05 2024-09-14T09:09:08.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:08.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859725+0000", 2024-09-14T09:09:08.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4770000000000002e-06 2024-09-14T09:09:08.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860544+0000", 2024-09-14T09:09:08.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008194669999999 2024-09-14T09:09:08.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860551+0000", 2024-09-14T09:09:08.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1369999999999996e-06 2024-09-14T09:09:08.641 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.641 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.641 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.641 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1087 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:08.641 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859865+0000", 2024-09-14T09:09:08.641 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.7008435960000003, 2024-09-14T09:09:08.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000716274, 2024-09-14T09:09:08.641 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.642 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.642 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:08.642 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.642 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:08.642 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:08.642 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1087 2024-09-14T09:09:08.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.642 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859865+0000", 2024-09-14T09:09:08.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859865+0000", 2024-09-14T09:09:08.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859865+0000", 2024-09-14T09:09:08.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4999999999999999e-07 2024-09-14T09:09:08.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859867+0000", 2024-09-14T09:09:08.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2049999999999999e-06 2024-09-14T09:09:08.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859871+0000", 2024-09-14T09:09:08.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0080000000000004e-06 2024-09-14T09:09:08.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859873+0000", 2024-09-14T09:09:08.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9409999999999999e-06 2024-09-14T09:09:08.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859906+0000", 2024-09-14T09:09:08.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2801e-05 2024-09-14T09:09:08.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:08.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859912+0000", 2024-09-14T09:09:08.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3909999999999997e-06 2024-09-14T09:09:08.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860574+0000", 2024-09-14T09:09:08.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006619919999999 2024-09-14T09:09:08.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860581+0000", 2024-09-14T09:09:08.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6860000000000006e-06 2024-09-14T09:09:08.646 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.646 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.646 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.646 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1088 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:08.646 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:08.646 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.7008290610000003, 2024-09-14T09:09:08.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00073166, 2024-09-14T09:09:08.646 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.646 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.646 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:08.646 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.646 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:08.647 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:08.647 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1088 2024-09-14T09:09:08.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.647 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:08.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:08.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:08.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3700000000000001e-07 2024-09-14T09:09:08.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859882+0000", 2024-09-14T09:09:08.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.739e-06 2024-09-14T09:09:08.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859887+0000", 2024-09-14T09:09:08.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:09:08.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859892+0000", 2024-09-14T09:09:08.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7119999999999999e-06 2024-09-14T09:09:08.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859945+0000", 2024-09-14T09:09:08.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2762000000000001e-05 2024-09-14T09:09:08.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:08.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859950+0000", 2024-09-14T09:09:08.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-09-14T09:09:08.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860603+0000", 2024-09-14T09:09:08.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000653263 2024-09-14T09:09:08.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860611+0000", 2024-09-14T09:09:08.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-09-14T09:09:08.650 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.650 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.650 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.651 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1089 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:08.651 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:08.651 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.7008109050000009, 2024-09-14T09:09:08.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000733943, 2024-09-14T09:09:08.651 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.651 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.651 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:08.651 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.651 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:08.651 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:08.651 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1089 2024-09-14T09:09:08.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.651 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:08.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:08.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:08.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3000000000000002e-07 2024-09-14T09:09:08.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859900+0000", 2024-09-14T09:09:08.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9199999999999998e-06 2024-09-14T09:09:08.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859906+0000", 2024-09-14T09:09:08.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0889999999999996e-06 2024-09-14T09:09:08.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859911+0000", 2024-09-14T09:09:08.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6419999999999998e-06 2024-09-14T09:09:08.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860010+0000", 2024-09-14T09:09:08.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8956000000000006e-05 2024-09-14T09:09:08.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:08.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860014+0000", 2024-09-14T09:09:08.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.741e-06 2024-09-14T09:09:08.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860627+0000", 2024-09-14T09:09:08.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00061277 2024-09-14T09:09:08.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860632+0000", 2024-09-14T09:09:08.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:09:08.655 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.655 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.655 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.656 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1090 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:08.656 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:08.656 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.7007912330000003, 2024-09-14T09:09:08.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000740763, 2024-09-14T09:09:08.656 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:08.656 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:08.656 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:08.656 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:08.656 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:08.656 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:08.656 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1090 2024-09-14T09:09:08.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.656 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:08.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:08.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:08.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:08.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:08.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:08.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:08.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859918+0000", 2024-09-14T09:09:08.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5199999999999998e-07 2024-09-14T09:09:08.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:08.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859920+0000", 2024-09-14T09:09:08.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9240000000000001e-06 2024-09-14T09:09:08.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:08.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859925+0000", 2024-09-14T09:09:08.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3929999999999999e-06 2024-09-14T09:09:08.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:08.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859929+0000", 2024-09-14T09:09:08.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4769999999999999e-06 2024-09-14T09:09:08.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860034+0000", 2024-09-14T09:09:08.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010549500000000001 2024-09-14T09:09:08.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:08.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860039+0000", 2024-09-14T09:09:08.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5700000000000003e-06 2024-09-14T09:09:08.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:08.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860650+0000", 2024-09-14T09:09:08.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006116119999999 2024-09-14T09:09:08.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:08.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:08.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:08.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860658+0000", 2024-09-14T09:09:08.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:09:08.660 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.660 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.660 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.660 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:08.660 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:08.660 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:08.661 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:09:08.662 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:08.664+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:08.762 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:08.765+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:08.768 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:08.769 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:08.769 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:09:08.769 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:08.777 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:09:08.808 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is set 2024-09-14T09:09:08.863 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:08.865+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:08.889 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone29 from 0xdaf2400 (overlap 0x37a3800) to 0x590400 2024-09-14T09:09:08.927 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:08.927 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:08.927 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:08.927 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:08.927 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:08.936 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:09:08.980 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:08.982+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:09.024 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 1] out_osds: [] dead_osds: [2] live_osds: [0, 1, 3, 4, 5] 2024-09-14T09:09:09.024 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:09:09.025 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2024-09-14T09:09:09.025 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-14T09:09:09.025 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-14T09:09:09.027 INFO:tasks.ceph.osd.2:Started 2024-09-14T09:09:09.027 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:09:09.044 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:09.044 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:09.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:09.044 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:09.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.044 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:246 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:09.045 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:09:09.045 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.248599128000002, 2024-09-14T09:09:09.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99004581000000003, 2024-09-14T09:09:09.045 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:09.045 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:09.045 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:09.045 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:09.045 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:09.045 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:09.045 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 246 2024-09-14T09:09:09.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.045 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:09.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:09.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:09:09.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:09.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:09:09.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:09.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796750+0000", 2024-09-14T09:09:09.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5519999999999999e-06 2024-09-14T09:09:09.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:09.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796754+0000", 2024-09-14T09:09:09.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2640000000000002e-06 2024-09-14T09:09:09.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:09.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796767+0000", 2024-09-14T09:09:09.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3517e-05 2024-09-14T09:09:09.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:09.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796775+0000", 2024-09-14T09:09:09.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8790000000000003e-06 2024-09-14T09:09:09.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796830+0000", 2024-09-14T09:09:09.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4829e-05 2024-09-14T09:09:09.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:09.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796843+0000", 2024-09-14T09:09:09.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.33e-05 2024-09-14T09:09:09.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786501+0000", 2024-09-14T09:09:09.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98965769299999995 2024-09-14T09:09:09.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:09.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786653+0000", 2024-09-14T09:09:09.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015237200000000001 2024-09-14T09:09:09.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:09.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786794+0000", 2024-09-14T09:09:09.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014040400000000001 2024-09-14T09:09:09.050 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.050 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:09.050 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.050 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:247 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 720896~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:09.050 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:09:09.050 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.248544342000002, 2024-09-14T09:09:09.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99048688100000004, 2024-09-14T09:09:09.050 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:09.050 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:09.050 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:09.051 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:09.051 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:09.051 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:09.051 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 247 2024-09-14T09:09:09.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.051 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:09.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:09.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:09:09.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:09.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:09:09.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:09.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:09:09.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7299999999999995e-07 2024-09-14T09:09:09.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:09.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796807+0000", 2024-09-14T09:09:09.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.106e-06 2024-09-14T09:09:09.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:09.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796815+0000", 2024-09-14T09:09:09.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4740000000000005e-06 2024-09-14T09:09:09.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:09.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796821+0000", 2024-09-14T09:09:09.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0469999999999999e-06 2024-09-14T09:09:09.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796872+0000", 2024-09-14T09:09:09.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0834000000000002e-05 2024-09-14T09:09:09.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:09.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796878+0000", 2024-09-14T09:09:09.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2990000000000002e-06 2024-09-14T09:09:09.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787176+0000", 2024-09-14T09:09:09.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99029817600000003 2024-09-14T09:09:09.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:09.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787225+0000", 2024-09-14T09:09:09.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8953999999999999e-05 2024-09-14T09:09:09.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:09.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787290+0000", 2024-09-14T09:09:09.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4318000000000003e-05 2024-09-14T09:09:09.057 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.057 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:09.057 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.057 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:248 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1179648~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:09.057 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:09:09.057 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.248513823000003, 2024-09-14T09:09:09.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99060754200000001, 2024-09-14T09:09:09.057 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:09.057 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:09.057 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:09.057 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:09.058 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:09.058 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:09.058 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 248 2024-09-14T09:09:09.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.058 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:09.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:09.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:09:09.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:09.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:09:09.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:09.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796834+0000", 2024-09-14T09:09:09.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4099999999999999e-07 2024-09-14T09:09:09.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:09.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796837+0000", 2024-09-14T09:09:09.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8459999999999999e-06 2024-09-14T09:09:09.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:09.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796844+0000", 2024-09-14T09:09:09.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1350000000000003e-06 2024-09-14T09:09:09.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:09.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796850+0000", 2024-09-14T09:09:09.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7139999999999998e-06 2024-09-14T09:09:09.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:09.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3909999999999998e-05 2024-09-14T09:09:09.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:09.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796899+0000", 2024-09-14T09:09:09.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7649999999999999e-06 2024-09-14T09:09:09.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787318+0000", 2024-09-14T09:09:09.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99041848300000002 2024-09-14T09:09:09.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:09.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787365+0000", 2024-09-14T09:09:09.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7086999999999998e-05 2024-09-14T09:09:09.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:09.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787441+0000", 2024-09-14T09:09:09.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6061000000000002e-05 2024-09-14T09:09:09.062 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.062 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:09.062 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.062 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:249 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1638400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:09.062 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:09.062 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.248480053999998, 2024-09-14T09:09:09.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99070346899999995, 2024-09-14T09:09:09.063 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:09.063 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:09.063 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:09.063 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:09.063 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:09.063 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:09.063 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 249 2024-09-14T09:09:09.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.063 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:09.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:09.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:09.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:09.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:09.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:09.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796868+0000", 2024-09-14T09:09:09.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2024-09-14T09:09:09.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:09.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796870+0000", 2024-09-14T09:09:09.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7889999999999999e-06 2024-09-14T09:09:09.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:09.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796877+0000", 2024-09-14T09:09:09.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8549999999999996e-06 2024-09-14T09:09:09.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:09.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796883+0000", 2024-09-14T09:09:09.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.665e-06 2024-09-14T09:09:09.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796915+0000", 2024-09-14T09:09:09.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2215999999999998e-05 2024-09-14T09:09:09.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:09.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796920+0000", 2024-09-14T09:09:09.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.527e-06 2024-09-14T09:09:09.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787468+0000", 2024-09-14T09:09:09.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99054877100000005 2024-09-14T09:09:09.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:09.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787512+0000", 2024-09-14T09:09:09.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3958000000000002e-05 2024-09-14T09:09:09.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:09.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787571+0000", 2024-09-14T09:09:09.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8167000000000001e-05 2024-09-14T09:09:09.067 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.067 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:09.067 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.067 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:250 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2097152~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:09.068 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:09.068 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.248453988000001, 2024-09-14T09:09:09.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99079431100000004, 2024-09-14T09:09:09.068 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:09.068 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:09.068 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:09.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:09.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:09.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:09.068 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 250 2024-09-14T09:09:09.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.068 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:09.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:09.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:09.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:09.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:09.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:09.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796894+0000", 2024-09-14T09:09:09.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2024-09-14T09:09:09.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:09.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796896+0000", 2024-09-14T09:09:09.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5600000000000001e-06 2024-09-14T09:09:09.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:09.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796902+0000", 2024-09-14T09:09:09.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3090000000000001e-06 2024-09-14T09:09:09.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:09.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796909+0000", 2024-09-14T09:09:09.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:09:09.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796942+0000", 2024-09-14T09:09:09.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-05 2024-09-14T09:09:09.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:09.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796948+0000", 2024-09-14T09:09:09.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5910000000000001e-06 2024-09-14T09:09:09.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787596+0000", 2024-09-14T09:09:09.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99064781400000002 2024-09-14T09:09:09.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:09.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787636+0000", 2024-09-14T09:09:09.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9715000000000002e-05 2024-09-14T09:09:09.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:09.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787687+0000", 2024-09-14T09:09:09.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1674e-05 2024-09-14T09:09:09.072 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.072 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:09.072 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.073 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:251 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:09.073 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:09.073 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.248428552999997, 2024-09-14T09:09:09.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99091769600000001, 2024-09-14T09:09:09.073 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:09.073 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:09.073 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:09.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:09.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:09.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:09.073 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 251 2024-09-14T09:09:09.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.073 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:09.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:09.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:09.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:09.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:09.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:09.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:09.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000005e-07 2024-09-14T09:09:09.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:09.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796922+0000", 2024-09-14T09:09:09.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.875e-06 2024-09-14T09:09:09.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:09.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796929+0000", 2024-09-14T09:09:09.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0260000000000002e-06 2024-09-14T09:09:09.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:09.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796935+0000", 2024-09-14T09:09:09.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7030000000000003e-06 2024-09-14T09:09:09.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796963+0000", 2024-09-14T09:09:09.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8368999999999999e-05 2024-09-14T09:09:09.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:09.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796966+0000", 2024-09-14T09:09:09.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4130000000000002e-06 2024-09-14T09:09:09.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787718+0000", 2024-09-14T09:09:09.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99075151100000003 2024-09-14T09:09:09.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:09.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787779+0000", 2024-09-14T09:09:09.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.088e-05 2024-09-14T09:09:09.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:09.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787836+0000", 2024-09-14T09:09:09.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7380000000000003e-05 2024-09-14T09:09:09.078 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.078 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:09.078 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.078 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:252 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:09.078 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:09.078 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.248403099000001, 2024-09-14T09:09:09.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99102491400000003, 2024-09-14T09:09:09.078 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:09.078 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:09.078 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:09.078 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:09.078 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:09.078 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:09.079 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 252 2024-09-14T09:09:09.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.079 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:09.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:09.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:09.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:09.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:09.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:09.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796945+0000", 2024-09-14T09:09:09.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2900000000000003e-07 2024-09-14T09:09:09.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:09.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796947+0000", 2024-09-14T09:09:09.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4279999999999999e-06 2024-09-14T09:09:09.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:09.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796954+0000", 2024-09-14T09:09:09.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5479999999999998e-06 2024-09-14T09:09:09.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:09.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796959+0000", 2024-09-14T09:09:09.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.22e-06 2024-09-14T09:09:09.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796988+0000", 2024-09-14T09:09:09.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9473000000000001e-05 2024-09-14T09:09:09.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:09.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:09.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:09:09.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787850+0000", 2024-09-14T09:09:09.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99085651100000005 2024-09-14T09:09:09.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:09.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787891+0000", 2024-09-14T09:09:09.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602000000000002e-05 2024-09-14T09:09:09.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:09.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787969+0000", 2024-09-14T09:09:09.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8063000000000001e-05 2024-09-14T09:09:09.082 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.083 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:09.083 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.083 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:253 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:09.083 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:09.083 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.248379219, 2024-09-14T09:09:09.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99122695699999996, 2024-09-14T09:09:09.083 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:09.083 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:09.083 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:09.083 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:09.083 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:09.083 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:09.084 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 253 2024-09-14T09:09:09.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.084 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:09.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:09.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:09.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:09.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:09.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:09.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:09.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:09:09.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:09.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:09:09.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:09:09.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:09.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796977+0000", 2024-09-14T09:09:09.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5030000000000002e-06 2024-09-14T09:09:09.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:09.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796982+0000", 2024-09-14T09:09:09.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2024-09-14T09:09:09.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797013+0000", 2024-09-14T09:09:09.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0451e-05 2024-09-14T09:09:09.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:09.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:09:09.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1690000000000001e-06 2024-09-14T09:09:09.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788011+0000", 2024-09-14T09:09:09.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99099490300000004 2024-09-14T09:09:09.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:09.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788102+0000", 2024-09-14T09:09:09.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0730999999999996e-05 2024-09-14T09:09:09.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:09.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788195+0000", 2024-09-14T09:09:09.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3245999999999995e-05 2024-09-14T09:09:09.088 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.088 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:09.088 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.088 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:254 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3932160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:09.088 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:09.088 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.248347660999997, 2024-09-14T09:09:09.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99137410500000001, 2024-09-14T09:09:09.088 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:09.088 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:09.088 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:09.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:09.089 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:09.089 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:09.089 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 254 2024-09-14T09:09:09.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.089 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:09.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:09.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:09.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:09.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:09.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:09.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797000+0000", 2024-09-14T09:09:09.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:09:09.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:09.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797003+0000", 2024-09-14T09:09:09.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7659999999999999e-06 2024-09-14T09:09:09.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:09.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797010+0000", 2024-09-14T09:09:09.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.029e-06 2024-09-14T09:09:09.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:09.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:09.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2024-09-14T09:09:09.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797044+0000", 2024-09-14T09:09:09.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9213e-05 2024-09-14T09:09:09.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:09.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797048+0000", 2024-09-14T09:09:09.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3400000000000002e-06 2024-09-14T09:09:09.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788222+0000", 2024-09-14T09:09:09.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99117407400000002 2024-09-14T09:09:09.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:09.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788306+0000", 2024-09-14T09:09:09.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4512999999999995e-05 2024-09-14T09:09:09.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:09.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788374+0000", 2024-09-14T09:09:09.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7226999999999999e-05 2024-09-14T09:09:09.092 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.093 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:09.093 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.093 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:264 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:09.093 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:09.093 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.248321302999997, 2024-09-14T09:09:09.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99161474699999996, 2024-09-14T09:09:09.093 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:09.093 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:09.093 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:09.093 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:09.093 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:09.094 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:09.094 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 264 2024-09-14T09:09:09.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.094 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:09.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:09.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:09.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:09.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:09.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:09.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:09.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2024-09-14T09:09:09.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:09.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:09:09.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2800000000000002e-06 2024-09-14T09:09:09.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:09.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:09.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0979999999999999e-06 2024-09-14T09:09:09.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:09.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797040+0000", 2024-09-14T09:09:09.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:09:09.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797068+0000", 2024-09-14T09:09:09.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7302999999999999e-05 2024-09-14T09:09:09.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:09.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797071+0000", 2024-09-14T09:09:09.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3610000000000001e-06 2024-09-14T09:09:09.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788436+0000", 2024-09-14T09:09:09.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99136489500000002 2024-09-14T09:09:09.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:09.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788538+0000", 2024-09-14T09:09:09.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101931 2024-09-14T09:09:09.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:09.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788641+0000", 2024-09-14T09:09:09.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010273899999999999 2024-09-14T09:09:09.097 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.097 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:09.098 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.098 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:265 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:09.098 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:09.098 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.248297944000001, 2024-09-14T09:09:09.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99176878199999996, 2024-09-14T09:09:09.098 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:09.098 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:09.098 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:09.098 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:09.098 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:09.098 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:09.099 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 265 2024-09-14T09:09:09.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.099 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:09.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:09.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:09.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:09.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:09.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:09.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:09:09.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.39e-07 2024-09-14T09:09:09.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:09.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797052+0000", 2024-09-14T09:09:09.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.345e-06 2024-09-14T09:09:09.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:09.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797058+0000", 2024-09-14T09:09:09.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5429999999999999e-06 2024-09-14T09:09:09.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:09.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797064+0000", 2024-09-14T09:09:09.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2000000000000002e-06 2024-09-14T09:09:09.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797091+0000", 2024-09-14T09:09:09.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7804e-05 2024-09-14T09:09:09.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:09.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797095+0000", 2024-09-14T09:09:09.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2024-09-14T09:09:09.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788667+0000", 2024-09-14T09:09:09.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157211300000003 2024-09-14T09:09:09.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:09.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788742+0000", 2024-09-14T09:09:09.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5159000000000003e-05 2024-09-14T09:09:09.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:09.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788818+0000", 2024-09-14T09:09:09.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6038000000000006e-05 2024-09-14T09:09:09.102 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.102 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:09.103 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.103 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:266 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:09.103 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:09.103 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.248275112999998, 2024-09-14T09:09:09.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99193390100000001, 2024-09-14T09:09:09.103 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:09.103 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:09.103 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:09.103 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:09.103 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:09.103 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:09.104 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 266 2024-09-14T09:09:09.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.104 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:09.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:09.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:09.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:09.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:09.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:09.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:09.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:09:09.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:09.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797075+0000", 2024-09-14T09:09:09.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2570000000000002e-06 2024-09-14T09:09:09.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:09.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797082+0000", 2024-09-14T09:09:09.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8029999999999997e-06 2024-09-14T09:09:09.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:09.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797088+0000", 2024-09-14T09:09:09.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.468e-06 2024-09-14T09:09:09.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797116+0000", 2024-09-14T09:09:09.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7752000000000001e-05 2024-09-14T09:09:09.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:09.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797121+0000", 2024-09-14T09:09:09.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5960000000000003e-06 2024-09-14T09:09:09.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788846+0000", 2024-09-14T09:09:09.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99172512199999996 2024-09-14T09:09:09.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:09.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788916+0000", 2024-09-14T09:09:09.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9843000000000002e-05 2024-09-14T09:09:09.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:09.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789006+0000", 2024-09-14T09:09:09.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9608e-05 2024-09-14T09:09:09.108 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.108 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:09.108 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.109 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:267 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:09.109 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:09.109 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.248250306000003, 2024-09-14T09:09:09.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99210926799999999, 2024-09-14T09:09:09.109 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:09.109 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:09.109 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:09.109 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:09.109 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:09.109 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:09.109 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 267 2024-09-14T09:09:09.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.110 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:09.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:09.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:09.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:09.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:09.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:09.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:09.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2399999999999999e-07 2024-09-14T09:09:09.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:09.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797099+0000", 2024-09-14T09:09:09.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.091e-06 2024-09-14T09:09:09.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:09.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797105+0000", 2024-09-14T09:09:09.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-09-14T09:09:09.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:09.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797111+0000", 2024-09-14T09:09:09.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5130000000000004e-06 2024-09-14T09:09:09.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797140+0000", 2024-09-14T09:09:09.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9513999999999999e-05 2024-09-14T09:09:09.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:09.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797145+0000", 2024-09-14T09:09:09.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:09:09.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789037+0000", 2024-09-14T09:09:09.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99189253899999996 2024-09-14T09:09:09.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:09.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789110+0000", 2024-09-14T09:09:09.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2848000000000005e-05 2024-09-14T09:09:09.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:09.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789206+0000", 2024-09-14T09:09:09.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5778000000000004e-05 2024-09-14T09:09:09.114 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.114 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:09.114 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.114 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:268 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:09.114 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:09.114 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.248227067000002, 2024-09-14T09:09:09.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992276359, 2024-09-14T09:09:09.114 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:09.114 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:09.114 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:09.114 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:09.115 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:09.115 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:09.115 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 268 2024-09-14T09:09:09.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.115 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:09.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:09.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:09.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:09.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:09.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:09.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:09.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:09:09.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:09.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797123+0000", 2024-09-14T09:09:09.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2740000000000002e-06 2024-09-14T09:09:09.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:09.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797129+0000", 2024-09-14T09:09:09.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-06 2024-09-14T09:09:09.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:09.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797134+0000", 2024-09-14T09:09:09.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9099999999999996e-06 2024-09-14T09:09:09.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797163+0000", 2024-09-14T09:09:09.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9709999999999998e-05 2024-09-14T09:09:09.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:09.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:09.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8709999999999999e-06 2024-09-14T09:09:09.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789231+0000", 2024-09-14T09:09:09.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992063959 2024-09-14T09:09:09.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:09.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789306+0000", 2024-09-14T09:09:09.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5289000000000004e-05 2024-09-14T09:09:09.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:09.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789396+0000", 2024-09-14T09:09:09.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9939999999999996e-05 2024-09-14T09:09:09.119 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.119 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:09.119 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.119 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:269 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2457600~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:09.119 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:09.119 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.248203558, 2024-09-14T09:09:09.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99242174400000005, 2024-09-14T09:09:09.119 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:09.119 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:09.120 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:09.120 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:09.120 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:09.120 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:09.120 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 269 2024-09-14T09:09:09.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.120 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:09.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:09.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:09.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:09.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:09.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:09.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:09.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:09:09.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:09.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797146+0000", 2024-09-14T09:09:09.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5289999999999998e-06 2024-09-14T09:09:09.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:09.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797153+0000", 2024-09-14T09:09:09.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1920000000000002e-06 2024-09-14T09:09:09.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:09.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797158+0000", 2024-09-14T09:09:09.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099999999999998e-06 2024-09-14T09:09:09.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797188+0000", 2024-09-14T09:09:09.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0128e-05 2024-09-14T09:09:09.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:09.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797194+0000", 2024-09-14T09:09:09.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6250000000000004e-06 2024-09-14T09:09:09.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789439+0000", 2024-09-14T09:09:09.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99224531000000005 2024-09-14T09:09:09.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:09.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789489+0000", 2024-09-14T09:09:09.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9830000000000002e-05 2024-09-14T09:09:09.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:09.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789565+0000", 2024-09-14T09:09:09.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6229000000000005e-05 2024-09-14T09:09:09.124 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.124 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:09.124 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.124 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:270 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:09.124 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:09.124 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.248179735999997, 2024-09-14T09:09:09.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99257721899999996, 2024-09-14T09:09:09.124 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:09.125 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:09.125 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:09.125 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:09.125 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:09.125 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:09.125 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 270 2024-09-14T09:09:09.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.125 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:09.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:09.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:09.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:09.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:09.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:09.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797168+0000", 2024-09-14T09:09:09.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2024-09-14T09:09:09.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:09.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797170+0000", 2024-09-14T09:09:09.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3120000000000001e-06 2024-09-14T09:09:09.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:09.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797177+0000", 2024-09-14T09:09:09.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0960000000000003e-06 2024-09-14T09:09:09.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:09.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797183+0000", 2024-09-14T09:09:09.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1669999999999998e-06 2024-09-14T09:09:09.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797213+0000", 2024-09-14T09:09:09.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0494e-05 2024-09-14T09:09:09.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:09.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:09:09.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:09:09.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789586+0000", 2024-09-14T09:09:09.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99236692100000001 2024-09-14T09:09:09.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:09.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789658+0000", 2024-09-14T09:09:09.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2279000000000004e-05 2024-09-14T09:09:09.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:09.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789745+0000", 2024-09-14T09:09:09.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6698000000000002e-05 2024-09-14T09:09:09.129 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.129 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:09.129 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.129 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:271 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3375104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:09.129 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:09.129 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.248154538000001, 2024-09-14T09:09:09.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99274791699999998, 2024-09-14T09:09:09.130 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:09.130 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:09.130 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:09.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:09.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:09.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:09.130 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 271 2024-09-14T09:09:09.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.130 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:09.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:09.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:09.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:09.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:09.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:09.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:09.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:09:09.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:09.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797195+0000", 2024-09-14T09:09:09.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1639999999999999e-06 2024-09-14T09:09:09.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:09.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797201+0000", 2024-09-14T09:09:09.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1290000000000001e-06 2024-09-14T09:09:09.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:09.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797206+0000", 2024-09-14T09:09:09.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9300000000000002e-06 2024-09-14T09:09:09.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797237+0000", 2024-09-14T09:09:09.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1285000000000003e-05 2024-09-14T09:09:09.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:09.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797242+0000", 2024-09-14T09:09:09.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6e-06 2024-09-14T09:09:09.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789768+0000", 2024-09-14T09:09:09.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99252547400000002 2024-09-14T09:09:09.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:09.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789826+0000", 2024-09-14T09:09:09.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8155999999999997e-05 2024-09-14T09:09:09.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:09.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789940+0000", 2024-09-14T09:09:09.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114788 2024-09-14T09:09:09.134 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.134 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:09.134 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.134 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:272 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:09.134 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:09.134 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.248131143999998, 2024-09-14T09:09:09.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99285248800000003, 2024-09-14T09:09:09.135 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:09.135 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:09.135 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:09.135 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:09.135 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:09.135 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:09.135 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 272 2024-09-14T09:09:09.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.135 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:09.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:09.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:09.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:09.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:09.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:09.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:09.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:09:09.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:09.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:09:09.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5129999999999999e-06 2024-09-14T09:09:09.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:09.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797226+0000", 2024-09-14T09:09:09.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4529999999999996e-06 2024-09-14T09:09:09.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:09.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797232+0000", 2024-09-14T09:09:09.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1839999999999998e-06 2024-09-14T09:09:09.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797264+0000", 2024-09-14T09:09:09.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2691999999999998e-05 2024-09-14T09:09:09.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:09.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797270+0000", 2024-09-14T09:09:09.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-06 2024-09-14T09:09:09.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789965+0000", 2024-09-14T09:09:09.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99269526200000002 2024-09-14T09:09:09.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:09.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790021+0000", 2024-09-14T09:09:09.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5297000000000003e-05 2024-09-14T09:09:09.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:09.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790068+0000", 2024-09-14T09:09:09.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7664999999999998e-05 2024-09-14T09:09:09.139 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.139 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:09.139 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.139 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5436.0:2685 3.16 3:6a699842:::rbd_data.1112b1c2f9b0.0000000000000007:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 27291136~65536,write 7396352~11264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-14T09:09:09.139 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:07.657617+0000", 2024-09-14T09:09:09.139 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.3877303190000001, 2024-09-14T09:09:09.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.112300755, 2024-09-14T09:09:09.140 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:09.140 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:09.140 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:09.140 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:09.140 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5436", 2024-09-14T09:09:09.140 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1367139659", 2024-09-14T09:09:09.140 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2685 2024-09-14T09:09:09.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.140 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:09.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:09.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.657617+0000", 2024-09-14T09:09:09.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:09.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.657617+0000", 2024-09-14T09:09:09.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:09.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.657618+0000", 2024-09-14T09:09:09.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1209999999999999e-06 2024-09-14T09:09:09.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:09.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.687135+0000", 2024-09-14T09:09:09.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.029517541000000001 2024-09-14T09:09:09.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:09.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.687154+0000", 2024-09-14T09:09:09.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8958e-05 2024-09-14T09:09:09.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:09.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.687162+0000", 2024-09-14T09:09:09.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5800000000000003e-06 2024-09-14T09:09:09.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.687222+0000", 2024-09-14T09:09:09.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9923000000000002e-05 2024-09-14T09:09:09.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:09.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.687352+0000", 2024-09-14T09:09:09.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013038899999999999 2024-09-14T09:09:09.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 5", 2024-09-14T09:09:09.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.688810+0000", 2024-09-14T09:09:09.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001457582 2024-09-14T09:09:09.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:09:09.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.751213+0000", 2024-09-14T09:09:09.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.062402951999999998 2024-09-14T09:09:09.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:09.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.769842+0000", 2024-09-14T09:09:09.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018628990000000002 2024-09-14T09:09:09.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:09:09.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.769884+0000", 2024-09-14T09:09:09.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2629999999999997e-05 2024-09-14T09:09:09.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:09.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.769918+0000", 2024-09-14T09:09:09.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3089000000000001e-05 2024-09-14T09:09:09.145 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.145 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:09.145 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.145 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.5436.0:3704 3.15 e82/22 3:a9740f09:::rbd_data.1112b1c2f9b0.0000000000000002:head v 82'607, mlcod=82'604)", 2024-09-14T09:09:09.145 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:07.830914+0000", 2024-09-14T09:09:09.146 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.214433436, 2024-09-14T09:09:09.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0544462, 2024-09-14T09:09:09.146 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:09.146 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:09.146 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:09.146 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:09.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:09.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.830914+0000", 2024-09-14T09:09:09.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:09.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.830914+0000", 2024-09-14T09:09:09.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:09.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:09.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.830915+0000", 2024-09-14T09:09:09.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5499999999999996e-07 2024-09-14T09:09:09.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:09.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.854827+0000", 2024-09-14T09:09:09.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023912365000000001 2024-09-14T09:09:09.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:09.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.854875+0000", 2024-09-14T09:09:09.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7621999999999999e-05 2024-09-14T09:09:09.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:09.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.854895+0000", 2024-09-14T09:09:09.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0276e-05 2024-09-14T09:09:09.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:09.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.854987+0000", 2024-09-14T09:09:09.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2089999999999994e-05 2024-09-14T09:09:09.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:09.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.855013+0000", 2024-09-14T09:09:09.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6194999999999999e-05 2024-09-14T09:09:09.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:09:09.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.885308+0000", 2024-09-14T09:09:09.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.030294489000000001 2024-09-14T09:09:09.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:09.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:09.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:09.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.885360+0000", 2024-09-14T09:09:09.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2207999999999999e-05 2024-09-14T09:09:09.150 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.150 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:09.150 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.150 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:09.150 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:09.150 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:09.151 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T09:09:09.152 INFO:teuthology.orchestra.run.smithi116.stderr:no valid command found; 10 closest matches: 2024-09-14T09:09:09.152 INFO:teuthology.orchestra.run.smithi116.stderr:0 2024-09-14T09:09:09.152 INFO:teuthology.orchestra.run.smithi116.stderr:1 2024-09-14T09:09:09.152 INFO:teuthology.orchestra.run.smithi116.stderr:2 2024-09-14T09:09:09.152 INFO:teuthology.orchestra.run.smithi116.stderr:abort 2024-09-14T09:09:09.152 INFO:teuthology.orchestra.run.smithi116.stderr:assert 2024-09-14T09:09:09.152 INFO:teuthology.orchestra.run.smithi116.stderr:config diff 2024-09-14T09:09:09.153 INFO:teuthology.orchestra.run.smithi116.stderr:config diff get 2024-09-14T09:09:09.153 INFO:teuthology.orchestra.run.smithi116.stderr:config get 2024-09-14T09:09:09.153 INFO:teuthology.orchestra.run.smithi116.stderr:config help [] 2024-09-14T09:09:09.153 INFO:teuthology.orchestra.run.smithi116.stderr:config set ... 2024-09-14T09:09:09.153 INFO:teuthology.orchestra.run.smithi116.stderr:admin_socket: invalid command 2024-09-14T09:09:09.153 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:09:09.154 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-14T09:09:09.154 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:09.153+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:09.199 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:09:09.252 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:09.254+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:09.306 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:09.306 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:09.307 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:09:09.307 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:09.317 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:09:09.322 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:09.322 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:09.339 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:09.339 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:09.339 INFO:teuthology.orchestra.run.smithi116.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-14T09:09:09.357 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:09.357 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:09.361 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:09.363+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:09.373 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:09.373 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:09.378 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #28, image image_client.0-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent29 2024-09-14T09:09:09.389 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:09.390 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:09.393 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T09:09:09.393 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T09:09:09.443 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:09.443 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:09.454 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:09.456+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:09.454 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:09:09.554 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:09.556+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:09.641 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:09.642 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:09.654 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:09:09.655 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:09.657+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:09.755 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:09.758+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:09.802 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:09.803 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:09.803 INFO:teuthology.orchestra.run.smithi148.stdout:4945 clone 31 order 21 su 1048576 sc 11 2024-09-14T09:09:09.811 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:09.896 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:09.898+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:09.955 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:09.955 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:09.957 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:09.959+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:09.964 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:09:10.058 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:10.061+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:10.108 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:10.108 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:10.117 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:09:10.159 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:10.162+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:10.220 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:10.220 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:10.229 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:09:10.272 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:10.274+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:10.331 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:10.331 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:10.340 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:09:10.361 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:10.364+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:10.450 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:10.452+0000 7f0df545e640 -1 Falling back to public interface 2024-09-14T09:09:10.462 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:10.464+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:10.483 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:10.483 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:10.493 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:09:10.562 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:10.564+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:10.595 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:10.595 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:10.604 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:09:10.688 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:10.690+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:10.747 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:10.748 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:10.756 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:09:10.763 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:10.766+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:10.825 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T09:09:10.864 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:10.867+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:10.906 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:10.906 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:10.916 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:09:10.921 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone30 from 0xdaf2400 (overlap 0xdaf2400) to 0x0 2024-09-14T09:09:10.965 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:10.967+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:11.047 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:11.047 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:11.056 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:09:11.098 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:11.100+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:11.166 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:11.169+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:11.226 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:11.226 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:11.236 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:09:11.278 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:11.280+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:11.369 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:11.371+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:11.394 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:09:11.395 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:11.396 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:11.405 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:09:11.489 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:11.491+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:11.525 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:11.526 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:11.546 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:11.546 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:11.546 INFO:teuthology.orchestra.run.smithi116.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-14T09:09:11.567 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:11.567 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:11.570 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:11.573+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:11.573 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:11.573 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:11.583 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:09:11.585 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:11.585 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:11.607 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:11.607 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:11.610 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T09:09:11.611 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T09:09:11.672 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:11.673+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:11.730 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:11.730 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:11.730 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:11.730 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:11.730 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:11.739 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:09:11.772 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:11.774+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:11.823 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is set 2024-09-14T09:09:11.862 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:11.862 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:11.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:11.862 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:11.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.862 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5299 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5230592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:11.863 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:09:11.863 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.614352297000003, 2024-09-14T09:09:11.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038972887999999997, 2024-09-14T09:09:11.863 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:11.863 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:11.863 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:11.863 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:11.863 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:11.864 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:11.864 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5299 2024-09-14T09:09:11.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.864 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:11.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:11.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:09:11.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:11.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:09:11.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:11.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249123+0000", 2024-09-14T09:09:11.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1199999999999998e-07 2024-09-14T09:09:11.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:11.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249125+0000", 2024-09-14T09:09:11.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.855e-06 2024-09-14T09:09:11.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:11.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249131+0000", 2024-09-14T09:09:11.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2949999999999999e-06 2024-09-14T09:09:11.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:11.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249136+0000", 2024-09-14T09:09:11.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9779999999999996e-06 2024-09-14T09:09:11.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:11.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287933+0000", 2024-09-14T09:09:11.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038796663000000002 2024-09-14T09:09:11.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:11.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288012+0000", 2024-09-14T09:09:11.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9617999999999996e-05 2024-09-14T09:09:11.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:11.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288095+0000", 2024-09-14T09:09:11.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3066999999999996e-05 2024-09-14T09:09:11.867 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.867 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:11.867 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.868 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5300 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5292032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:11.868 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:09:11.868 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.614332908000002, 2024-09-14T09:09:11.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039068578, 2024-09-14T09:09:11.868 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:11.868 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:11.868 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:11.868 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:11.868 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:11.868 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:11.868 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5300 2024-09-14T09:09:11.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.868 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:11.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:11.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:09:11.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:11.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:09:11.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:11.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254832+0000", 2024-09-14T09:09:11.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056899180000000004 2024-09-14T09:09:11.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:11.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254836+0000", 2024-09-14T09:09:11.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7809999999999999e-06 2024-09-14T09:09:11.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:11.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254845+0000", 2024-09-14T09:09:11.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.516e-06 2024-09-14T09:09:11.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:11.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254851+0000", 2024-09-14T09:09:11.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9109999999999998e-06 2024-09-14T09:09:11.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:11.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288122+0000", 2024-09-14T09:09:11.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.033270776000000002 2024-09-14T09:09:11.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:11.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288163+0000", 2024-09-14T09:09:11.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1700999999999999e-05 2024-09-14T09:09:11.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:11.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288210+0000", 2024-09-14T09:09:11.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6974999999999997e-05 2024-09-14T09:09:11.871 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.872 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:11.872 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.872 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5342 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7872512~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:11.872 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:09:11.872 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.607756723000001, 2024-09-14T09:09:11.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038906217999999999, 2024-09-14T09:09:11.872 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:11.872 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:11.872 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:11.872 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:11.872 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:11.872 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:11.873 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5342 2024-09-14T09:09:11.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.873 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:11.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:11.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:09:11.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:11.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:09:11.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:11.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:09:11.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8700000000000001e-07 2024-09-14T09:09:11.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:11.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255720+0000", 2024-09-14T09:09:11.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.739e-06 2024-09-14T09:09:11.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:11.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255726+0000", 2024-09-14T09:09:11.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.981e-06 2024-09-14T09:09:11.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:11.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255737+0000", 2024-09-14T09:09:11.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0621e-05 2024-09-14T09:09:11.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:11.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294538+0000", 2024-09-14T09:09:11.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038801012000000003 2024-09-14T09:09:11.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:11.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294577+0000", 2024-09-14T09:09:11.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9042000000000003e-05 2024-09-14T09:09:11.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:11.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294624+0000", 2024-09-14T09:09:11.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7435999999999998e-05 2024-09-14T09:09:11.876 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.876 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:11.876 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.876 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5343 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7933952~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:11.876 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:09:11.877 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.607730846999999, 2024-09-14T09:09:11.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039081811000000001, 2024-09-14T09:09:11.877 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:11.877 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:11.877 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:11.877 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:11.877 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:11.877 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:11.877 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5343 2024-09-14T09:09:11.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.877 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:11.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:11.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:09:11.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:11.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:09:11.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:11.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:09:11.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1800000000000001e-07 2024-09-14T09:09:11.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:11.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255746+0000", 2024-09-14T09:09:11.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.103e-06 2024-09-14T09:09:11.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:11.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255753+0000", 2024-09-14T09:09:11.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0929999999999999e-06 2024-09-14T09:09:11.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:11.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255757+0000", 2024-09-14T09:09:11.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9579999999999998e-06 2024-09-14T09:09:11.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:11.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294656+0000", 2024-09-14T09:09:11.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038898508999999998 2024-09-14T09:09:11.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:11.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294738+0000", 2024-09-14T09:09:11.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2423999999999996e-05 2024-09-14T09:09:11.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:11.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294826+0000", 2024-09-14T09:09:11.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7305999999999994e-05 2024-09-14T09:09:11.881 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.881 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:11.881 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.881 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5344 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7995392~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:11.881 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:09:11.881 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.607711414999997, 2024-09-14T09:09:11.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039165567999999998, 2024-09-14T09:09:11.881 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:11.881 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:11.881 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:11.882 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:11.882 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:11.882 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:11.882 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5344 2024-09-14T09:09:11.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.882 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:11.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:11.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:09:11.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:11.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:09:11.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:11.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255764+0000", 2024-09-14T09:09:11.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7899999999999999e-07 2024-09-14T09:09:11.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:11.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255765+0000", 2024-09-14T09:09:11.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.782e-06 2024-09-14T09:09:11.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:11.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255774+0000", 2024-09-14T09:09:11.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8070000000000006e-06 2024-09-14T09:09:11.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:11.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255779+0000", 2024-09-14T09:09:11.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9180000000000002e-06 2024-09-14T09:09:11.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:11.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294841+0000", 2024-09-14T09:09:11.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039061514999999998 2024-09-14T09:09:11.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:11.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294881+0000", 2024-09-14T09:09:11.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0027999999999997e-05 2024-09-14T09:09:11.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:11.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294929+0000", 2024-09-14T09:09:11.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8139000000000001e-05 2024-09-14T09:09:11.886 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.886 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:11.886 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.886 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5345 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8056832~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:11.886 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:09:11.886 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.607689176999997, 2024-09-14T09:09:11.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039340027999999999, 2024-09-14T09:09:11.886 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:11.886 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:11.887 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:11.887 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:11.887 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:11.887 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:11.887 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5345 2024-09-14T09:09:11.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.887 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:11.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:11.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:09:11.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:11.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:09:11.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:11.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:09:11.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8099999999999998e-07 2024-09-14T09:09:11.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:11.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255788+0000", 2024-09-14T09:09:11.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1280000000000002e-06 2024-09-14T09:09:11.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:11.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255794+0000", 2024-09-14T09:09:11.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0020000000000003e-06 2024-09-14T09:09:11.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:11.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255800+0000", 2024-09-14T09:09:11.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2009999999999996e-06 2024-09-14T09:09:11.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:11.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294960+0000", 2024-09-14T09:09:11.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039159674999999998 2024-09-14T09:09:11.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:11.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295041+0000", 2024-09-14T09:09:11.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0648000000000004e-05 2024-09-14T09:09:11.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:11.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295126+0000", 2024-09-14T09:09:11.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4993000000000004e-05 2024-09-14T09:09:11.890 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.890 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:11.890 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.891 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5346 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8118272~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:11.891 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:09:11.891 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.607668183000001, 2024-09-14T09:09:11.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039433228000000001, 2024-09-14T09:09:11.891 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:11.891 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:11.891 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:11.891 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:11.891 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:11.891 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:11.891 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5346 2024-09-14T09:09:11.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.891 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:11.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:11.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:09:11.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:11.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:09:11.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:11.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:09:11.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6899999999999998e-07 2024-09-14T09:09:11.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:11.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255809+0000", 2024-09-14T09:09:11.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9580000000000001e-06 2024-09-14T09:09:11.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:11.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255815+0000", 2024-09-14T09:09:11.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6579999999999999e-06 2024-09-14T09:09:11.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:11.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255819+0000", 2024-09-14T09:09:11.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5839999999999996e-06 2024-09-14T09:09:11.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:11.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295152+0000", 2024-09-14T09:09:11.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039332677000000003 2024-09-14T09:09:11.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:11.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295192+0000", 2024-09-14T09:09:11.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0491999999999998e-05 2024-09-14T09:09:11.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:11.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295240+0000", 2024-09-14T09:09:11.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7490000000000001e-05 2024-09-14T09:09:11.895 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.895 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:11.895 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.895 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5347 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8179712~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:11.895 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:09:11.895 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.607640586000002, 2024-09-14T09:09:11.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039601193999999999, 2024-09-14T09:09:11.895 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:11.895 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:11.895 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:11.895 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:11.896 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:11.896 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:11.896 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5347 2024-09-14T09:09:11.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.896 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:11.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:11.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:09:11.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:11.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:09:11.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:11.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255835+0000", 2024-09-14T09:09:11.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.82e-07 2024-09-14T09:09:11.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:11.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255837+0000", 2024-09-14T09:09:11.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0959999999999999e-06 2024-09-14T09:09:11.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:11.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255843+0000", 2024-09-14T09:09:11.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3779999999999998e-06 2024-09-14T09:09:11.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:11.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255848+0000", 2024-09-14T09:09:11.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7609999999999998e-06 2024-09-14T09:09:11.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:11.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295271+0000", 2024-09-14T09:09:11.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039423079 2024-09-14T09:09:11.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:11.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295350+0000", 2024-09-14T09:09:11.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8623999999999998e-05 2024-09-14T09:09:11.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:11.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295435+0000", 2024-09-14T09:09:11.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5674000000000007e-05 2024-09-14T09:09:11.899 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.899 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:11.899 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.899 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5348 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8241152~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:11.899 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:09:11.899 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.607620377000003, 2024-09-14T09:09:11.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039695057999999998, 2024-09-14T09:09:11.899 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:11.900 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:11.900 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:11.900 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:11.900 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:11.900 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:11.900 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5348 2024-09-14T09:09:11.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.900 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:11.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:11.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:09:11.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:11.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:09:11.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:11.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255855+0000", 2024-09-14T09:09:11.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7599999999999997e-07 2024-09-14T09:09:11.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:11.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255857+0000", 2024-09-14T09:09:11.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.905e-06 2024-09-14T09:09:11.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:11.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255863+0000", 2024-09-14T09:09:11.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0669999999999997e-06 2024-09-14T09:09:11.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:11.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255867+0000", 2024-09-14T09:09:11.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4730000000000002e-06 2024-09-14T09:09:11.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:11.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295461+0000", 2024-09-14T09:09:11.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039594074 2024-09-14T09:09:11.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:11.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295503+0000", 2024-09-14T09:09:11.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1363999999999999e-05 2024-09-14T09:09:11.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:11.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295549+0000", 2024-09-14T09:09:11.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6699000000000001e-05 2024-09-14T09:09:11.903 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.903 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:11.903 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.903 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5349 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8302592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:11.903 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:11.904 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.607601416999998, 2024-09-14T09:09:11.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039875928999999997, 2024-09-14T09:09:11.904 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:11.904 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:11.904 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:11.904 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:11.904 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:11.904 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:11.904 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5349 2024-09-14T09:09:11.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.905 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:11.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:11.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:11.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:11.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:11.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:11.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255874+0000", 2024-09-14T09:09:11.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4900000000000001e-07 2024-09-14T09:09:11.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:11.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255880+0000", 2024-09-14T09:09:11.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9939999999999997e-06 2024-09-14T09:09:11.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:11.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255886+0000", 2024-09-14T09:09:11.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3899999999999998e-06 2024-09-14T09:09:11.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:11.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255891+0000", 2024-09-14T09:09:11.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.938e-06 2024-09-14T09:09:11.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:11.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295580+0000", 2024-09-14T09:09:11.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039688681000000003 2024-09-14T09:09:11.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:11.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295653+0000", 2024-09-14T09:09:11.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3045000000000003e-05 2024-09-14T09:09:11.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:11.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295749+0000", 2024-09-14T09:09:11.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6532000000000003e-05 2024-09-14T09:09:11.908 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.908 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:11.908 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.908 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5350 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8364032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:11.908 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:11.908 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.60757761, 2024-09-14T09:09:11.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039989719, 2024-09-14T09:09:11.908 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:11.908 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:11.908 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:11.908 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:11.908 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:11.909 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:11.909 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5350 2024-09-14T09:09:11.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.909 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:11.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:11.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:11.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:11.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:11.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:11.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255898+0000", 2024-09-14T09:09:11.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2024-09-14T09:09:11.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:11.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255899+0000", 2024-09-14T09:09:11.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9139999999999998e-06 2024-09-14T09:09:11.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:11.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255905+0000", 2024-09-14T09:09:11.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7289999999999997e-06 2024-09-14T09:09:11.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:11.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255910+0000", 2024-09-14T09:09:11.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6210000000000003e-06 2024-09-14T09:09:11.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:11.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295775+0000", 2024-09-14T09:09:11.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039864973999999997 2024-09-14T09:09:11.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:11.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295828+0000", 2024-09-14T09:09:11.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3411000000000001e-05 2024-09-14T09:09:11.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:11.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295887+0000", 2024-09-14T09:09:11.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699000000000002e-05 2024-09-14T09:09:11.912 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.912 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:11.912 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.912 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4639 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1843200~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:11.912 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:11.912 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.663662151, 2024-09-14T09:09:11.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040843672999999997, 2024-09-14T09:09:11.912 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:11.913 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:11.913 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:11.913 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:11.913 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:11.913 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:11.913 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4639 2024-09-14T09:09:11.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.913 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:11.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:11.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:11.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:11.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:11.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:11.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:11.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:09:11.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:11.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199818+0000", 2024-09-14T09:09:11.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1450000000000001e-06 2024-09-14T09:09:11.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:11.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199827+0000", 2024-09-14T09:09:11.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3999999999999998e-06 2024-09-14T09:09:11.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:11.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199834+0000", 2024-09-14T09:09:11.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0809999999999996e-06 2024-09-14T09:09:11.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:11.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240541+0000", 2024-09-14T09:09:11.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040706941000000003 2024-09-14T09:09:11.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:11.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240584+0000", 2024-09-14T09:09:11.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3040999999999997e-05 2024-09-14T09:09:11.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:11.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240656+0000", 2024-09-14T09:09:11.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2200000000000007e-05 2024-09-14T09:09:11.917 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.917 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:11.917 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.917 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4640 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1871872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:11.917 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:11.917 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.663627666, 2024-09-14T09:09:11.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040967601999999999, 2024-09-14T09:09:11.917 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:11.917 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:11.917 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:11.917 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:11.918 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:11.918 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:11.918 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4640 2024-09-14T09:09:11.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.918 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:11.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:11.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:11.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:11.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:11.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:11.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199848+0000", 2024-09-14T09:09:11.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5400000000000002e-07 2024-09-14T09:09:11.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:11.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199850+0000", 2024-09-14T09:09:11.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2479999999999999e-06 2024-09-14T09:09:11.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:11.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199857+0000", 2024-09-14T09:09:11.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.187e-06 2024-09-14T09:09:11.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:11.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199862+0000", 2024-09-14T09:09:11.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5119999999999999e-06 2024-09-14T09:09:11.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:11.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240684+0000", 2024-09-14T09:09:11.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040821245999999999 2024-09-14T09:09:11.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:11.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240739+0000", 2024-09-14T09:09:11.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4991999999999998e-05 2024-09-14T09:09:11.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:11.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240815+0000", 2024-09-14T09:09:11.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5963000000000004e-05 2024-09-14T09:09:11.921 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.921 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:11.921 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.921 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4641 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1900544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:11.921 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:11.921 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.663605336, 2024-09-14T09:09:11.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041205512, 2024-09-14T09:09:11.922 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:11.922 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:11.922 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:11.922 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:11.922 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:11.922 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:11.922 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4641 2024-09-14T09:09:11.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.922 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:11.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:11.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:11.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:11.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:11.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:11.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199870+0000", 2024-09-14T09:09:11.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0600000000000001e-07 2024-09-14T09:09:11.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:11.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199872+0000", 2024-09-14T09:09:11.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.928e-06 2024-09-14T09:09:11.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:11.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199877+0000", 2024-09-14T09:09:11.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6949999999999997e-06 2024-09-14T09:09:11.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:11.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199882+0000", 2024-09-14T09:09:11.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8210000000000001e-06 2024-09-14T09:09:11.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:11.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240847+0000", 2024-09-14T09:09:11.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040965201999999999 2024-09-14T09:09:11.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:11.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240888+0000", 2024-09-14T09:09:11.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0754000000000003e-05 2024-09-14T09:09:11.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:11.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241075+0000", 2024-09-14T09:09:11.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000186706 2024-09-14T09:09:11.925 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.925 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:11.925 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.926 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4642 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1929216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:11.926 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:11.926 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.663586401, 2024-09-14T09:09:11.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041292575999999998, 2024-09-14T09:09:11.926 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:11.926 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:11.927 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:11.927 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:11.927 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:11.928 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:11.928 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4642 2024-09-14T09:09:11.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.928 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:11.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:11.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:11.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:11.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:11.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:11.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199889+0000", 2024-09-14T09:09:11.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2024-09-14T09:09:11.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:11.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199891+0000", 2024-09-14T09:09:11.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9e-06 2024-09-14T09:09:11.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:11.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199896+0000", 2024-09-14T09:09:11.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6960000000000002e-06 2024-09-14T09:09:11.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:11.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199901+0000", 2024-09-14T09:09:11.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6720000000000003e-06 2024-09-14T09:09:11.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:11.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241089+0000", 2024-09-14T09:09:11.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041187594000000001 2024-09-14T09:09:11.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:11.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241126+0000", 2024-09-14T09:09:11.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7490999999999997e-05 2024-09-14T09:09:11.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:11.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241181+0000", 2024-09-14T09:09:11.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4823e-05 2024-09-14T09:09:11.931 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.931 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:11.931 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.931 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4643 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1957888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:11.931 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:11.932 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.663567122, 2024-09-14T09:09:11.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041418333000000002, 2024-09-14T09:09:11.932 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:11.932 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:11.932 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:11.932 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:11.932 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:11.932 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:11.932 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4643 2024-09-14T09:09:11.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.932 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:11.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:11.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:11.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:11.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:11.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:11.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:11.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5699999999999998e-07 2024-09-14T09:09:11.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:11.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199910+0000", 2024-09-14T09:09:11.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.829e-06 2024-09-14T09:09:11.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:11.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199916+0000", 2024-09-14T09:09:11.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8499999999999999e-06 2024-09-14T09:09:11.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:11.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199920+0000", 2024-09-14T09:09:11.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6530000000000002e-06 2024-09-14T09:09:11.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:11.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241211+0000", 2024-09-14T09:09:11.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041290327000000002 2024-09-14T09:09:11.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:11.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241257+0000", 2024-09-14T09:09:11.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6347000000000002e-05 2024-09-14T09:09:11.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:11.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241326+0000", 2024-09-14T09:09:11.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8969999999999999e-05 2024-09-14T09:09:11.935 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.936 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:11.936 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.936 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4644 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1986560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:11.936 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:11.936 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.663548781999999, 2024-09-14T09:09:11.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041596269999999998, 2024-09-14T09:09:11.936 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:11.936 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:11.936 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:11.936 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:11.936 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:11.937 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:11.937 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4644 2024-09-14T09:09:11.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.937 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:11.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:11.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:11.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:11.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:11.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:11.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:11.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.41e-07 2024-09-14T09:09:11.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:11.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199928+0000", 2024-09-14T09:09:11.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8250000000000001e-06 2024-09-14T09:09:11.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:11.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199934+0000", 2024-09-14T09:09:11.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2280000000000003e-06 2024-09-14T09:09:11.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:11.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199939+0000", 2024-09-14T09:09:11.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8010000000000003e-06 2024-09-14T09:09:11.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:11.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241360+0000", 2024-09-14T09:09:11.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041421289 2024-09-14T09:09:11.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:11.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241435+0000", 2024-09-14T09:09:11.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4238000000000003e-05 2024-09-14T09:09:11.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:11.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241522+0000", 2024-09-14T09:09:11.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7547999999999996e-05 2024-09-14T09:09:11.940 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.940 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:11.940 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.940 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4645 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:11.940 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:11.940 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.663529875, 2024-09-14T09:09:11.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041714660000000001, 2024-09-14T09:09:11.940 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:11.941 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:11.941 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:11.941 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:11.941 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:11.941 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:11.941 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4645 2024-09-14T09:09:11.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.941 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:11.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:11.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:11.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:11.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:11.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:11.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:11.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4700000000000002e-07 2024-09-14T09:09:11.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:11.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199947+0000", 2024-09-14T09:09:11.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.801e-06 2024-09-14T09:09:11.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:11.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199953+0000", 2024-09-14T09:09:11.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.694e-06 2024-09-14T09:09:11.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:11.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199957+0000", 2024-09-14T09:09:11.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3069999999999996e-06 2024-09-14T09:09:11.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:11.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241547+0000", 2024-09-14T09:09:11.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041589895000000002 2024-09-14T09:09:11.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:11.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241590+0000", 2024-09-14T09:09:11.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2985000000000003e-05 2024-09-14T09:09:11.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:11.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241660+0000", 2024-09-14T09:09:11.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9630999999999998e-05 2024-09-14T09:09:11.945 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.945 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:11.945 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.945 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4646 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2043904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:11.945 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:11.945 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.663511887, 2024-09-14T09:09:11.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041827171000000003, 2024-09-14T09:09:11.945 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:11.945 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:11.945 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:11.946 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:11.946 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:11.946 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:11.946 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4646 2024-09-14T09:09:11.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.946 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:11.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:11.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:11.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:11.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:11.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:11.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:11.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6300000000000001e-07 2024-09-14T09:09:11.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:11.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199965+0000", 2024-09-14T09:09:11.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.035e-06 2024-09-14T09:09:11.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:11.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199973+0000", 2024-09-14T09:09:11.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9629999999999998e-06 2024-09-14T09:09:11.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:11.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199978+0000", 2024-09-14T09:09:11.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9069999999999998e-06 2024-09-14T09:09:11.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:11.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241677+0000", 2024-09-14T09:09:11.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041698662999999997 2024-09-14T09:09:11.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:11.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241717+0000", 2024-09-14T09:09:11.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602999999999997e-05 2024-09-14T09:09:11.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:11.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241790+0000", 2024-09-14T09:09:11.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2637000000000003e-05 2024-09-14T09:09:11.949 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.949 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:11.949 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.949 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4647 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2072576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:11.949 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:11.949 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.663483296999999, 2024-09-14T09:09:11.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041921189999999997, 2024-09-14T09:09:11.950 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:11.950 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:11.950 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:11.950 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:11.950 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:11.950 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:11.950 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4647 2024-09-14T09:09:11.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.950 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:11.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:11.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:11.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:11.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:11.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:11.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:11.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199992+0000", 2024-09-14T09:09:11.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3799999999999997e-07 2024-09-14T09:09:11.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:11.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199994+0000", 2024-09-14T09:09:11.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3020000000000002e-06 2024-09-14T09:09:11.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:11.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200004+0000", 2024-09-14T09:09:11.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3510000000000008e-06 2024-09-14T09:09:11.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:11.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200008+0000", 2024-09-14T09:09:11.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3329999999999998e-06 2024-09-14T09:09:11.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:11.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241814+0000", 2024-09-14T09:09:11.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041806280000000001 2024-09-14T09:09:11.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:11.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241855+0000", 2024-09-14T09:09:11.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0173999999999999e-05 2024-09-14T09:09:11.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:11.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:11.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:11.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241913+0000", 2024-09-14T09:09:11.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8112000000000002e-05 2024-09-14T09:09:11.953 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.954 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:11.954 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.954 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:11.954 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:11.954 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:11.955 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:09:11.956 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:11.957+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:12.056 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:12.058+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:12.098 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:12.099 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:12.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.099 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10576 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.099 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.079211+0000", 2024-09-14T09:09:12.099 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013625346, 2024-09-14T09:09:12.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013641342000000001, 2024-09-14T09:09:12.099 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.099 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.099 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.099 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.099 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.100 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.100 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10576 2024-09-14T09:09:12.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.100 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079211+0000", 2024-09-14T09:09:12.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079211+0000", 2024-09-14T09:09:12.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079212+0000", 2024-09-14T09:09:12.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5999999999999999e-07 2024-09-14T09:09:12.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079214+0000", 2024-09-14T09:09:12.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9860000000000001e-06 2024-09-14T09:09:12.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079219+0000", 2024-09-14T09:09:12.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6289999999999998e-06 2024-09-14T09:09:12.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079224+0000", 2024-09-14T09:09:12.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4190000000000004e-06 2024-09-14T09:09:12.102 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.102 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.102 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.102 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10638 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.102 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.085219+0000", 2024-09-14T09:09:12.102 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0076173179999999997, 2024-09-14T09:09:12.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076646559999999997, 2024-09-14T09:09:12.103 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.103 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.103 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.103 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.103 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.103 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.103 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10638 2024-09-14T09:09:12.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.103 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.085219+0000", 2024-09-14T09:09:12.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.085219+0000", 2024-09-14T09:09:12.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.085219+0000", 2024-09-14T09:09:12.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1199999999999999e-07 2024-09-14T09:09:12.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.085221+0000", 2024-09-14T09:09:12.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.057e-06 2024-09-14T09:09:12.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.085223+0000", 2024-09-14T09:09:12.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8420000000000001e-06 2024-09-14T09:09:12.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.085226+0000", 2024-09-14T09:09:12.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3329999999999999e-06 2024-09-14T09:09:12.105 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.106 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.106 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.106 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10099 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.106 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090124+0000", 2024-09-14T09:09:12.106 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0027121269999999999, 2024-09-14T09:09:12.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027844549999999999, 2024-09-14T09:09:12.106 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.106 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.106 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.106 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.106 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.107 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.107 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10099 2024-09-14T09:09:12.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.107 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090124+0000", 2024-09-14T09:09:12.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090124+0000", 2024-09-14T09:09:12.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090125+0000", 2024-09-14T09:09:12.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8999999999999997e-07 2024-09-14T09:09:12.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090129+0000", 2024-09-14T09:09:12.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7179999999999998e-06 2024-09-14T09:09:12.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090132+0000", 2024-09-14T09:09:12.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.568e-06 2024-09-14T09:09:12.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090136+0000", 2024-09-14T09:09:12.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3670000000000001e-06 2024-09-14T09:09:12.109 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.109 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.109 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.109 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10257 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.109 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090624+0000", 2024-09-14T09:09:12.109 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0022122159999999999, 2024-09-14T09:09:12.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0023101459999999999, 2024-09-14T09:09:12.109 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.109 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.110 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.110 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.110 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.110 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.110 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10257 2024-09-14T09:09:12.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.110 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090624+0000", 2024-09-14T09:09:12.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090624+0000", 2024-09-14T09:09:12.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090625+0000", 2024-09-14T09:09:12.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2700000000000001e-07 2024-09-14T09:09:12.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090625+0000", 2024-09-14T09:09:12.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8000000000000004e-07 2024-09-14T09:09:12.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090628+0000", 2024-09-14T09:09:12.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7999999999999999e-06 2024-09-14T09:09:12.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090631+0000", 2024-09-14T09:09:12.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5629999999999999e-06 2024-09-14T09:09:12.112 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.112 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.112 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.112 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10316 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.112 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091086+0000", 2024-09-14T09:09:12.112 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0017506119999999999, 2024-09-14T09:09:12.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018719380000000001, 2024-09-14T09:09:12.113 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.113 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.113 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.113 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.113 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.113 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.113 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10316 2024-09-14T09:09:12.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.113 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091086+0000", 2024-09-14T09:09:12.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091086+0000", 2024-09-14T09:09:12.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091086+0000", 2024-09-14T09:09:12.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3700000000000001e-07 2024-09-14T09:09:12.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091090+0000", 2024-09-14T09:09:12.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.523e-06 2024-09-14T09:09:12.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091094+0000", 2024-09-14T09:09:12.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6049999999999998e-06 2024-09-14T09:09:12.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091096+0000", 2024-09-14T09:09:12.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8030000000000001e-06 2024-09-14T09:09:12.115 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.115 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.116 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.116 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10380 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.116 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091564+0000", 2024-09-14T09:09:12.116 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001272874, 2024-09-14T09:09:12.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014187449999999999, 2024-09-14T09:09:12.116 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.116 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.116 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.116 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.116 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.116 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.117 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10380 2024-09-14T09:09:12.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.117 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091564+0000", 2024-09-14T09:09:12.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091564+0000", 2024-09-14T09:09:12.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091564+0000", 2024-09-14T09:09:12.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.29e-07 2024-09-14T09:09:12.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091565+0000", 2024-09-14T09:09:12.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8100000000000001e-07 2024-09-14T09:09:12.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091568+0000", 2024-09-14T09:09:12.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8009999999999999e-06 2024-09-14T09:09:12.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091571+0000", 2024-09-14T09:09:12.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8430000000000001e-06 2024-09-14T09:09:12.119 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.119 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.119 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.119 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10089 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.119 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.092701+0000", 2024-09-14T09:09:12.119 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.000135819, 2024-09-14T09:09:12.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030652799999999998, 2024-09-14T09:09:12.119 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.120 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.120 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.120 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.120 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.120 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.120 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10089 2024-09-14T09:09:12.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.120 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092701+0000", 2024-09-14T09:09:12.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092701+0000", 2024-09-14T09:09:12.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092701+0000", 2024-09-14T09:09:12.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7999999999999995e-07 2024-09-14T09:09:12.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092704+0000", 2024-09-14T09:09:12.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2630000000000002e-06 2024-09-14T09:09:12.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092710+0000", 2024-09-14T09:09:12.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1539999999999999e-06 2024-09-14T09:09:12.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092716+0000", 2024-09-14T09:09:12.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2500000000000003e-06 2024-09-14T09:09:12.122 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.122 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.122 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.122 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10578 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.122 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.079230+0000", 2024-09-14T09:09:12.122 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013606445999999999, 2024-09-14T09:09:12.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013801364999999999, 2024-09-14T09:09:12.123 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.123 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.123 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.123 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.123 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.123 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.123 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10578 2024-09-14T09:09:12.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.123 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079230+0000", 2024-09-14T09:09:12.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079230+0000", 2024-09-14T09:09:12.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079230+0000", 2024-09-14T09:09:12.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7899999999999999e-07 2024-09-14T09:09:12.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079232+0000", 2024-09-14T09:09:12.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6959999999999999e-06 2024-09-14T09:09:12.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079238+0000", 2024-09-14T09:09:12.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7389999999999996e-06 2024-09-14T09:09:12.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079243+0000", 2024-09-14T09:09:12.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9400000000000001e-06 2024-09-14T09:09:12.125 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.125 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.125 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.126 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10640 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.126 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.085229+0000", 2024-09-14T09:09:12.126 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00760803, 2024-09-14T09:09:12.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0078259999999999996, 2024-09-14T09:09:12.126 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.126 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.126 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.126 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.126 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.126 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.126 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10640 2024-09-14T09:09:12.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.127 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.085229+0000", 2024-09-14T09:09:12.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.085229+0000", 2024-09-14T09:09:12.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.085229+0000", 2024-09-14T09:09:12.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1e-07 2024-09-14T09:09:12.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.085230+0000", 2024-09-14T09:09:12.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6300000000000004e-07 2024-09-14T09:09:12.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.085232+0000", 2024-09-14T09:09:12.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.768e-06 2024-09-14T09:09:12.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.085235+0000", 2024-09-14T09:09:12.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2589999999999999e-06 2024-09-14T09:09:12.129 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.129 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.129 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.129 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10101 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.129 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090150+0000", 2024-09-14T09:09:12.129 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002686103, 2024-09-14T09:09:12.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029288349999999999, 2024-09-14T09:09:12.129 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.129 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.130 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.130 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10101 2024-09-14T09:09:12.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.130 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090150+0000", 2024-09-14T09:09:12.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090150+0000", 2024-09-14T09:09:12.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090151+0000", 2024-09-14T09:09:12.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7e-07 2024-09-14T09:09:12.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090152+0000", 2024-09-14T09:09:12.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4360000000000001e-06 2024-09-14T09:09:12.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090156+0000", 2024-09-14T09:09:12.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3550000000000001e-06 2024-09-14T09:09:12.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090159+0000", 2024-09-14T09:09:12.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6150000000000001e-06 2024-09-14T09:09:12.132 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.132 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.132 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.133 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10259 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.133 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090645+0000", 2024-09-14T09:09:12.133 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002191967, 2024-09-14T09:09:12.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024578260000000002, 2024-09-14T09:09:12.133 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.133 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.133 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.133 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10259 2024-09-14T09:09:12.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.134 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090645+0000", 2024-09-14T09:09:12.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090645+0000", 2024-09-14T09:09:12.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090645+0000", 2024-09-14T09:09:12.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2024-09-14T09:09:12.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090646+0000", 2024-09-14T09:09:12.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.22e-06 2024-09-14T09:09:12.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090650+0000", 2024-09-14T09:09:12.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3270000000000001e-06 2024-09-14T09:09:12.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090653+0000", 2024-09-14T09:09:12.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2179999999999999e-06 2024-09-14T09:09:12.136 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.136 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.136 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.136 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10318 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.136 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091106+0000", 2024-09-14T09:09:12.136 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001730606, 2024-09-14T09:09:12.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020196950000000002, 2024-09-14T09:09:12.136 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.137 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.137 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.137 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.137 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.137 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.137 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10318 2024-09-14T09:09:12.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.137 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091106+0000", 2024-09-14T09:09:12.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091106+0000", 2024-09-14T09:09:12.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091106+0000", 2024-09-14T09:09:12.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.82e-07 2024-09-14T09:09:12.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091108+0000", 2024-09-14T09:09:12.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.291e-06 2024-09-14T09:09:12.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091111+0000", 2024-09-14T09:09:12.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4570000000000001e-06 2024-09-14T09:09:12.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091114+0000", 2024-09-14T09:09:12.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.689e-06 2024-09-14T09:09:12.139 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.139 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.139 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.140 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10382 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.140 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091573+0000", 2024-09-14T09:09:12.140 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0012630989999999999, 2024-09-14T09:09:12.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001575295, 2024-09-14T09:09:12.140 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.140 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.140 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.140 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.140 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.140 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.140 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10382 2024-09-14T09:09:12.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.141 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091573+0000", 2024-09-14T09:09:12.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091573+0000", 2024-09-14T09:09:12.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091574+0000", 2024-09-14T09:09:12.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2599999999999998e-07 2024-09-14T09:09:12.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091575+0000", 2024-09-14T09:09:12.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.78e-07 2024-09-14T09:09:12.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091578+0000", 2024-09-14T09:09:12.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9160000000000001e-06 2024-09-14T09:09:12.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091580+0000", 2024-09-14T09:09:12.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5160000000000001e-06 2024-09-14T09:09:12.143 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.143 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.143 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.143 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10091 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.143 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.092760+0000", 2024-09-14T09:09:12.143 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.6470000000000005e-05, 2024-09-14T09:09:12.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00041190200000000001, 2024-09-14T09:09:12.143 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.143 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.143 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.144 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.144 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.144 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.144 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10091 2024-09-14T09:09:12.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.144 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092760+0000", 2024-09-14T09:09:12.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092760+0000", 2024-09-14T09:09:12.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092761+0000", 2024-09-14T09:09:12.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4299999999999998e-07 2024-09-14T09:09:12.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092762+0000", 2024-09-14T09:09:12.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.77e-06 2024-09-14T09:09:12.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092769+0000", 2024-09-14T09:09:12.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7009999999999999e-06 2024-09-14T09:09:12.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092774+0000", 2024-09-14T09:09:12.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4829999999999999e-06 2024-09-14T09:09:12.146 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.146 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.146 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.146 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10580 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.146 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.079249+0000", 2024-09-14T09:09:12.147 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.01358767, 2024-09-14T09:09:12.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013946181, 2024-09-14T09:09:12.147 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.147 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.147 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.147 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.147 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.147 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.147 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10580 2024-09-14T09:09:12.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.147 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079249+0000", 2024-09-14T09:09:12.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079249+0000", 2024-09-14T09:09:12.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079249+0000", 2024-09-14T09:09:12.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.58e-07 2024-09-14T09:09:12.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079251+0000", 2024-09-14T09:09:12.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5230000000000001e-06 2024-09-14T09:09:12.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079254+0000", 2024-09-14T09:09:12.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4419999999999998e-06 2024-09-14T09:09:12.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079257+0000", 2024-09-14T09:09:12.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.57e-06 2024-09-14T09:09:12.150 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.150 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.150 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.150 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10642 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.150 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.085237+0000", 2024-09-14T09:09:12.150 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0075991139999999997, 2024-09-14T09:09:12.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079806500000000006, 2024-09-14T09:09:12.150 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.150 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.150 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.150 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.150 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.150 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.150 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10642 2024-09-14T09:09:12.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.151 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.085237+0000", 2024-09-14T09:09:12.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.085237+0000", 2024-09-14T09:09:12.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.085238+0000", 2024-09-14T09:09:12.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0800000000000001e-07 2024-09-14T09:09:12.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.085245+0000", 2024-09-14T09:09:12.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9609999999999999e-06 2024-09-14T09:09:12.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.085248+0000", 2024-09-14T09:09:12.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2260000000000001e-06 2024-09-14T09:09:12.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.085252+0000", 2024-09-14T09:09:12.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4719999999999997e-06 2024-09-14T09:09:12.153 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.153 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.153 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.153 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10103 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.153 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090172+0000", 2024-09-14T09:09:12.153 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0026648240000000001, 2024-09-14T09:09:12.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030695010000000001, 2024-09-14T09:09:12.154 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.154 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.154 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.154 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.154 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.154 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.154 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10103 2024-09-14T09:09:12.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.154 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090172+0000", 2024-09-14T09:09:12.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090172+0000", 2024-09-14T09:09:12.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090172+0000", 2024-09-14T09:09:12.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3300000000000003e-07 2024-09-14T09:09:12.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090173+0000", 2024-09-14T09:09:12.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3260000000000001e-06 2024-09-14T09:09:12.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090177+0000", 2024-09-14T09:09:12.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3060000000000002e-06 2024-09-14T09:09:12.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090180+0000", 2024-09-14T09:09:12.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8710000000000001e-06 2024-09-14T09:09:12.156 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.156 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.156 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.157 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10261 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.157 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090656+0000", 2024-09-14T09:09:12.157 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0021803700000000001, 2024-09-14T09:09:12.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026119160000000002, 2024-09-14T09:09:12.157 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.157 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.157 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.157 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.157 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.157 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.157 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10261 2024-09-14T09:09:12.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.158 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090656+0000", 2024-09-14T09:09:12.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090656+0000", 2024-09-14T09:09:12.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090656+0000", 2024-09-14T09:09:12.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.22e-07 2024-09-14T09:09:12.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090657+0000", 2024-09-14T09:09:12.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9800000000000002e-07 2024-09-14T09:09:12.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090660+0000", 2024-09-14T09:09:12.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8600000000000001e-06 2024-09-14T09:09:12.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090663+0000", 2024-09-14T09:09:12.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0120000000000001e-06 2024-09-14T09:09:12.160 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.160 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.160 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.160 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10320 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.160 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091117+0000", 2024-09-14T09:09:12.160 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0017192049999999999, 2024-09-14T09:09:12.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002173871, 2024-09-14T09:09:12.160 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.161 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.161 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.161 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.161 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.161 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.161 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10320 2024-09-14T09:09:12.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.161 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091117+0000", 2024-09-14T09:09:12.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091117+0000", 2024-09-14T09:09:12.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091118+0000", 2024-09-14T09:09:12.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4999999999999998e-07 2024-09-14T09:09:12.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091119+0000", 2024-09-14T09:09:12.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.47e-07 2024-09-14T09:09:12.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091121+0000", 2024-09-14T09:09:12.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8499999999999998e-06 2024-09-14T09:09:12.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091124+0000", 2024-09-14T09:09:12.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6529999999999998e-06 2024-09-14T09:09:12.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.163 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.164 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10384 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.164 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091589+0000", 2024-09-14T09:09:12.164 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0012471489999999999, 2024-09-14T09:09:12.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017247040000000001, 2024-09-14T09:09:12.164 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.164 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.164 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.164 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10384 2024-09-14T09:09:12.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.164 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091589+0000", 2024-09-14T09:09:12.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091589+0000", 2024-09-14T09:09:12.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091590+0000", 2024-09-14T09:09:12.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.58e-07 2024-09-14T09:09:12.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091591+0000", 2024-09-14T09:09:12.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.207e-06 2024-09-14T09:09:12.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091595+0000", 2024-09-14T09:09:12.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4350000000000001e-06 2024-09-14T09:09:12.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091597+0000", 2024-09-14T09:09:12.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6639999999999998e-06 2024-09-14T09:09:12.167 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.167 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.167 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.167 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10093 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.167 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.092783+0000", 2024-09-14T09:09:12.167 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.3857000000000003e-05, 2024-09-14T09:09:12.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000554942, 2024-09-14T09:09:12.167 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.167 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.167 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.167 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.167 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.168 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10093 2024-09-14T09:09:12.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.168 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092783+0000", 2024-09-14T09:09:12.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092783+0000", 2024-09-14T09:09:12.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092783+0000", 2024-09-14T09:09:12.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:09:12.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092785+0000", 2024-09-14T09:09:12.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9089999999999998e-06 2024-09-14T09:09:12.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092790+0000", 2024-09-14T09:09:12.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3689999999999998e-06 2024-09-14T09:09:12.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092796+0000", 2024-09-14T09:09:12.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4249999999999997e-06 2024-09-14T09:09:12.170 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.170 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.170 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.170 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10582 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.170 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.079260+0000", 2024-09-14T09:09:12.170 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013576558000000001, 2024-09-14T09:09:12.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014100691, 2024-09-14T09:09:12.170 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.170 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.171 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.171 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.171 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.171 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.171 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10582 2024-09-14T09:09:12.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.171 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079260+0000", 2024-09-14T09:09:12.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079260+0000", 2024-09-14T09:09:12.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079260+0000", 2024-09-14T09:09:12.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3099999999999999e-07 2024-09-14T09:09:12.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079261+0000", 2024-09-14T09:09:12.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8599999999999997e-07 2024-09-14T09:09:12.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079264+0000", 2024-09-14T09:09:12.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0790000000000001e-06 2024-09-14T09:09:12.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.079267+0000", 2024-09-14T09:09:12.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5399999999999998e-06 2024-09-14T09:09:12.173 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.173 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.173 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.174 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10644 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.174 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.085256+0000", 2024-09-14T09:09:12.174 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0075806379999999998, 2024-09-14T09:09:12.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0081274260000000001, 2024-09-14T09:09:12.174 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.174 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.174 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.174 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.174 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.174 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.174 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10644 2024-09-14T09:09:12.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.174 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.085256+0000", 2024-09-14T09:09:12.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.085256+0000", 2024-09-14T09:09:12.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088835+0000", 2024-09-14T09:09:12.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035795240000000002 2024-09-14T09:09:12.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088840+0000", 2024-09-14T09:09:12.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1119999999999998e-06 2024-09-14T09:09:12.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088849+0000", 2024-09-14T09:09:12.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3239999999999992e-06 2024-09-14T09:09:12.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088856+0000", 2024-09-14T09:09:12.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9689999999999997e-06 2024-09-14T09:09:12.177 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.177 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.177 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.177 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10105 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.177 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090190+0000", 2024-09-14T09:09:12.177 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0026466609999999998, 2024-09-14T09:09:12.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032168700000000001, 2024-09-14T09:09:12.177 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.177 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.177 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.177 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.178 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.178 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.178 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10105 2024-09-14T09:09:12.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.178 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090190+0000", 2024-09-14T09:09:12.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090190+0000", 2024-09-14T09:09:12.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090190+0000", 2024-09-14T09:09:12.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5600000000000001e-07 2024-09-14T09:09:12.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090192+0000", 2024-09-14T09:09:12.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2160000000000001e-06 2024-09-14T09:09:12.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090195+0000", 2024-09-14T09:09:12.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4340000000000001e-06 2024-09-14T09:09:12.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090198+0000", 2024-09-14T09:09:12.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.74e-06 2024-09-14T09:09:12.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.180 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.180 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10263 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.180 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090674+0000", 2024-09-14T09:09:12.180 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0021622859999999998, 2024-09-14T09:09:12.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002773728, 2024-09-14T09:09:12.180 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10263 2024-09-14T09:09:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090674+0000", 2024-09-14T09:09:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090674+0000", 2024-09-14T09:09:12.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090675+0000", 2024-09-14T09:09:12.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3700000000000001e-07 2024-09-14T09:09:12.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090676+0000", 2024-09-14T09:09:12.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.331e-06 2024-09-14T09:09:12.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090679+0000", 2024-09-14T09:09:12.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3780000000000001e-06 2024-09-14T09:09:12.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090682+0000", 2024-09-14T09:09:12.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5409999999999999e-06 2024-09-14T09:09:12.183 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.183 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.183 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.183 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10322 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.184 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091127+0000", 2024-09-14T09:09:12.184 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0017095179999999999, 2024-09-14T09:09:12.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0023537200000000001, 2024-09-14T09:09:12.184 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.184 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.184 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.184 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.184 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.184 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.184 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10322 2024-09-14T09:09:12.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.184 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091127+0000", 2024-09-14T09:09:12.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091127+0000", 2024-09-14T09:09:12.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091127+0000", 2024-09-14T09:09:12.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-07 2024-09-14T09:09:12.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091128+0000", 2024-09-14T09:09:12.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2299999999999999e-07 2024-09-14T09:09:12.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091131+0000", 2024-09-14T09:09:12.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7839999999999999e-06 2024-09-14T09:09:12.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091134+0000", 2024-09-14T09:09:12.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7549999999999999e-06 2024-09-14T09:09:12.187 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.187 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.187 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.187 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10386 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.187 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091605+0000", 2024-09-14T09:09:12.187 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001231172, 2024-09-14T09:09:12.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018989199999999999, 2024-09-14T09:09:12.187 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.187 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.187 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.188 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10386 2024-09-14T09:09:12.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.188 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091605+0000", 2024-09-14T09:09:12.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091605+0000", 2024-09-14T09:09:12.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091606+0000", 2024-09-14T09:09:12.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4600000000000001e-07 2024-09-14T09:09:12.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091607+0000", 2024-09-14T09:09:12.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1939999999999999e-06 2024-09-14T09:09:12.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091610+0000", 2024-09-14T09:09:12.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3179999999999998e-06 2024-09-14T09:09:12.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091613+0000", 2024-09-14T09:09:12.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0620000000000001e-06 2024-09-14T09:09:12.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.190 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.190 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10095 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.190 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.092802+0000", 2024-09-14T09:09:12.190 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.4248999999999997e-05, 2024-09-14T09:09:12.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00072508900000000005, 2024-09-14T09:09:12.190 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.190 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.190 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.190 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.191 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10095 2024-09-14T09:09:12.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.191 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092802+0000", 2024-09-14T09:09:12.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092802+0000", 2024-09-14T09:09:12.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092803+0000", 2024-09-14T09:09:12.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4900000000000001e-07 2024-09-14T09:09:12.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092804+0000", 2024-09-14T09:09:12.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8390000000000001e-06 2024-09-14T09:09:12.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092810+0000", 2024-09-14T09:09:12.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9610000000000002e-06 2024-09-14T09:09:12.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092815+0000", 2024-09-14T09:09:12.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7489999999999998e-06 2024-09-14T09:09:12.193 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.193 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.193 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.193 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10646 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.193 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.088868+0000", 2024-09-14T09:09:12.193 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003968699, 2024-09-14T09:09:12.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046837659999999998, 2024-09-14T09:09:12.193 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.194 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.194 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.194 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.194 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.194 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.194 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10646 2024-09-14T09:09:12.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.194 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088868+0000", 2024-09-14T09:09:12.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088868+0000", 2024-09-14T09:09:12.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088868+0000", 2024-09-14T09:09:12.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7599999999999997e-07 2024-09-14T09:09:12.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088871+0000", 2024-09-14T09:09:12.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3410000000000001e-06 2024-09-14T09:09:12.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088877+0000", 2024-09-14T09:09:12.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3219999999999998e-06 2024-09-14T09:09:12.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088882+0000", 2024-09-14T09:09:12.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8579999999999999e-06 2024-09-14T09:09:12.196 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.196 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.196 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.196 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10108 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.196 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090217+0000", 2024-09-14T09:09:12.196 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0026199610000000001, 2024-09-14T09:09:12.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033580580000000001, 2024-09-14T09:09:12.196 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.196 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.197 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.197 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.197 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.197 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.197 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10108 2024-09-14T09:09:12.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.197 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090217+0000", 2024-09-14T09:09:12.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090217+0000", 2024-09-14T09:09:12.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090217+0000", 2024-09-14T09:09:12.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4900000000000001e-07 2024-09-14T09:09:12.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090218+0000", 2024-09-14T09:09:12.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.277e-06 2024-09-14T09:09:12.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090222+0000", 2024-09-14T09:09:12.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3119999999999998e-06 2024-09-14T09:09:12.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090224+0000", 2024-09-14T09:09:12.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6390000000000001e-06 2024-09-14T09:09:12.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.199 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.199 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10265 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.199 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090685+0000", 2024-09-14T09:09:12.199 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002151146, 2024-09-14T09:09:12.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029123370000000001, 2024-09-14T09:09:12.200 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.200 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.200 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.200 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10265 2024-09-14T09:09:12.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.200 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090685+0000", 2024-09-14T09:09:12.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090685+0000", 2024-09-14T09:09:12.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090686+0000", 2024-09-14T09:09:12.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:09:12.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090687+0000", 2024-09-14T09:09:12.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0210000000000001e-06 2024-09-14T09:09:12.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090690+0000", 2024-09-14T09:09:12.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.853e-06 2024-09-14T09:09:12.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090692+0000", 2024-09-14T09:09:12.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.339e-06 2024-09-14T09:09:12.202 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.203 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.203 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.203 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10324 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.203 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091137+0000", 2024-09-14T09:09:12.203 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0016999820000000001, 2024-09-14T09:09:12.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002484216, 2024-09-14T09:09:12.203 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.203 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.203 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.203 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.203 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.204 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.204 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10324 2024-09-14T09:09:12.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.204 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091137+0000", 2024-09-14T09:09:12.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091137+0000", 2024-09-14T09:09:12.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091137+0000", 2024-09-14T09:09:12.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8299999999999998e-07 2024-09-14T09:09:12.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091138+0000", 2024-09-14T09:09:12.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4e-07 2024-09-14T09:09:12.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091141+0000", 2024-09-14T09:09:12.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8009999999999999e-06 2024-09-14T09:09:12.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091143+0000", 2024-09-14T09:09:12.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.543e-06 2024-09-14T09:09:12.206 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.206 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.206 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.206 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10388 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.206 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091616+0000", 2024-09-14T09:09:12.206 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001220152, 2024-09-14T09:09:12.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002027549, 2024-09-14T09:09:12.207 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.207 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.207 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.207 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.207 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.207 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.207 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10388 2024-09-14T09:09:12.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.207 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091616+0000", 2024-09-14T09:09:12.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091616+0000", 2024-09-14T09:09:12.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091617+0000", 2024-09-14T09:09:12.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0699999999999999e-07 2024-09-14T09:09:12.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091620+0000", 2024-09-14T09:09:12.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0740000000000001e-06 2024-09-14T09:09:12.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091623+0000", 2024-09-14T09:09:12.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2160000000000002e-06 2024-09-14T09:09:12.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091626+0000", 2024-09-14T09:09:12.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.971e-06 2024-09-14T09:09:12.209 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.209 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.209 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.210 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10097 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.210 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.092821+0000", 2024-09-14T09:09:12.210 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.5350999999999999e-05, 2024-09-14T09:09:12.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00084574599999999998, 2024-09-14T09:09:12.210 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.210 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.210 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.210 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.210 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.210 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.210 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10097 2024-09-14T09:09:12.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.210 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092821+0000", 2024-09-14T09:09:12.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092821+0000", 2024-09-14T09:09:12.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092822+0000", 2024-09-14T09:09:12.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2024-09-14T09:09:12.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092823+0000", 2024-09-14T09:09:12.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7379999999999999e-06 2024-09-14T09:09:12.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092829+0000", 2024-09-14T09:09:12.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3720000000000004e-06 2024-09-14T09:09:12.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092835+0000", 2024-09-14T09:09:12.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6760000000000004e-06 2024-09-14T09:09:12.213 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.213 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.213 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.213 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10648 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.213 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.088889+0000", 2024-09-14T09:09:12.213 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0039477119999999999, 2024-09-14T09:09:12.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004833492, 2024-09-14T09:09:12.213 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.213 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.213 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.213 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.214 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.214 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.214 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10648 2024-09-14T09:09:12.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.214 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088889+0000", 2024-09-14T09:09:12.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088889+0000", 2024-09-14T09:09:12.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088889+0000", 2024-09-14T09:09:12.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8299999999999998e-07 2024-09-14T09:09:12.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088891+0000", 2024-09-14T09:09:12.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9290000000000001e-06 2024-09-14T09:09:12.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088898+0000", 2024-09-14T09:09:12.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.708e-06 2024-09-14T09:09:12.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088903+0000", 2024-09-14T09:09:12.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2920000000000003e-06 2024-09-14T09:09:12.216 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.216 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.216 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.216 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10110 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.216 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090228+0000", 2024-09-14T09:09:12.216 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0026086909999999998, 2024-09-14T09:09:12.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035252690000000001, 2024-09-14T09:09:12.217 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.217 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.217 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.217 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.217 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.217 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.217 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10110 2024-09-14T09:09:12.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.217 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090228+0000", 2024-09-14T09:09:12.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090228+0000", 2024-09-14T09:09:12.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090228+0000", 2024-09-14T09:09:12.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5699999999999998e-07 2024-09-14T09:09:12.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090234+0000", 2024-09-14T09:09:12.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9009999999999999e-06 2024-09-14T09:09:12.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090238+0000", 2024-09-14T09:09:12.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5480000000000002e-06 2024-09-14T09:09:12.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090240+0000", 2024-09-14T09:09:12.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7800000000000001e-06 2024-09-14T09:09:12.219 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.219 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.219 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.220 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10267 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.220 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090695+0000", 2024-09-14T09:09:12.220 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0021416690000000001, 2024-09-14T09:09:12.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030842209999999998, 2024-09-14T09:09:12.220 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.220 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.220 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.220 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.220 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.220 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.220 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10267 2024-09-14T09:09:12.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.220 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090695+0000", 2024-09-14T09:09:12.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090695+0000", 2024-09-14T09:09:12.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090695+0000", 2024-09-14T09:09:12.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1299999999999999e-07 2024-09-14T09:09:12.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090696+0000", 2024-09-14T09:09:12.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2600000000000001e-07 2024-09-14T09:09:12.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090699+0000", 2024-09-14T09:09:12.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5590000000000001e-06 2024-09-14T09:09:12.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090702+0000", 2024-09-14T09:09:12.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4789999999999999e-06 2024-09-14T09:09:12.222 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.223 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.223 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.223 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10326 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.223 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091158+0000", 2024-09-14T09:09:12.223 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001678244, 2024-09-14T09:09:12.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026445510000000002, 2024-09-14T09:09:12.223 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.223 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.223 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.223 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.223 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.223 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.223 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10326 2024-09-14T09:09:12.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.224 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091158+0000", 2024-09-14T09:09:12.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091158+0000", 2024-09-14T09:09:12.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091159+0000", 2024-09-14T09:09:12.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5699999999999998e-07 2024-09-14T09:09:12.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091160+0000", 2024-09-14T09:09:12.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2330000000000001e-06 2024-09-14T09:09:12.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091163+0000", 2024-09-14T09:09:12.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3950000000000001e-06 2024-09-14T09:09:12.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091166+0000", 2024-09-14T09:09:12.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5720000000000001e-06 2024-09-14T09:09:12.226 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.226 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.226 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.226 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10390 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.226 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091644+0000", 2024-09-14T09:09:12.226 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0011929359999999999, 2024-09-14T09:09:12.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021821319999999998, 2024-09-14T09:09:12.226 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.226 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.227 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.227 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.227 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.227 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.227 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10390 2024-09-14T09:09:12.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.227 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091644+0000", 2024-09-14T09:09:12.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091644+0000", 2024-09-14T09:09:12.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091644+0000", 2024-09-14T09:09:12.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.75e-07 2024-09-14T09:09:12.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091645+0000", 2024-09-14T09:09:12.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3459999999999999e-06 2024-09-14T09:09:12.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091649+0000", 2024-09-14T09:09:12.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.331e-06 2024-09-14T09:09:12.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091651+0000", 2024-09-14T09:09:12.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6180000000000002e-06 2024-09-14T09:09:12.229 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.229 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.230 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10099 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.230 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.092869+0000", 2024-09-14T09:09:12.230 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9999676, 2024-09-14T09:09:12.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0009827010000000001, 2024-09-14T09:09:12.230 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.230 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.230 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.230 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.230 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.230 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.230 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10099 2024-09-14T09:09:12.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.231 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092869+0000", 2024-09-14T09:09:12.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092869+0000", 2024-09-14T09:09:12.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092869+0000", 2024-09-14T09:09:12.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0100000000000005e-07 2024-09-14T09:09:12.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092872+0000", 2024-09-14T09:09:12.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1390000000000002e-06 2024-09-14T09:09:12.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092879+0000", 2024-09-14T09:09:12.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1779999999999997e-06 2024-09-14T09:09:12.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092884+0000", 2024-09-14T09:09:12.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1789999999999999e-06 2024-09-14T09:09:12.233 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.233 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.233 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.233 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10655 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.233 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.088910+0000", 2024-09-14T09:09:12.233 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0039262710000000003, 2024-09-14T09:09:12.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049644540000000001, 2024-09-14T09:09:12.233 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.233 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.234 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.234 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.234 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.234 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.234 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10655 2024-09-14T09:09:12.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.234 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088910+0000", 2024-09-14T09:09:12.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088910+0000", 2024-09-14T09:09:12.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088911+0000", 2024-09-14T09:09:12.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-07 2024-09-14T09:09:12.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088912+0000", 2024-09-14T09:09:12.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8250000000000001e-06 2024-09-14T09:09:12.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088920+0000", 2024-09-14T09:09:12.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0740000000000004e-06 2024-09-14T09:09:12.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088925+0000", 2024-09-14T09:09:12.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0050000000000004e-06 2024-09-14T09:09:12.236 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.236 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.236 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.236 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10112 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.237 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090244+0000", 2024-09-14T09:09:12.237 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002592582, 2024-09-14T09:09:12.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0036568630000000002, 2024-09-14T09:09:12.237 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.237 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.237 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.237 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.237 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.237 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.237 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10112 2024-09-14T09:09:12.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.237 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090244+0000", 2024-09-14T09:09:12.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090244+0000", 2024-09-14T09:09:12.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090244+0000", 2024-09-14T09:09:12.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3000000000000001e-07 2024-09-14T09:09:12.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090245+0000", 2024-09-14T09:09:12.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0219999999999999e-06 2024-09-14T09:09:12.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090248+0000", 2024-09-14T09:09:12.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8499999999999998e-06 2024-09-14T09:09:12.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090251+0000", 2024-09-14T09:09:12.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4839999999999998e-06 2024-09-14T09:09:12.240 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.240 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.240 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.240 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10269 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.240 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090715+0000", 2024-09-14T09:09:12.240 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0021211289999999998, 2024-09-14T09:09:12.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032082730000000002, 2024-09-14T09:09:12.240 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.240 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.240 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.240 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.240 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.241 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.241 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10269 2024-09-14T09:09:12.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.241 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090715+0000", 2024-09-14T09:09:12.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090715+0000", 2024-09-14T09:09:12.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090716+0000", 2024-09-14T09:09:12.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3099999999999998e-07 2024-09-14T09:09:12.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090717+0000", 2024-09-14T09:09:12.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.237e-06 2024-09-14T09:09:12.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090720+0000", 2024-09-14T09:09:12.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2789999999999999e-06 2024-09-14T09:09:12.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090723+0000", 2024-09-14T09:09:12.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.526e-06 2024-09-14T09:09:12.243 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.243 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.243 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.243 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10328 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.244 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091169+0000", 2024-09-14T09:09:12.244 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0016672060000000001, 2024-09-14T09:09:12.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027788679999999999, 2024-09-14T09:09:12.244 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.244 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.244 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.244 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.244 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.244 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.244 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10328 2024-09-14T09:09:12.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.244 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091169+0000", 2024-09-14T09:09:12.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091169+0000", 2024-09-14T09:09:12.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091170+0000", 2024-09-14T09:09:12.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0699999999999999e-07 2024-09-14T09:09:12.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091171+0000", 2024-09-14T09:09:12.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7000000000000003e-07 2024-09-14T09:09:12.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091173+0000", 2024-09-14T09:09:12.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7870000000000002e-06 2024-09-14T09:09:12.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091176+0000", 2024-09-14T09:09:12.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9639999999999999e-06 2024-09-14T09:09:12.247 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.247 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.247 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.247 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10392 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.247 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091655+0000", 2024-09-14T09:09:12.247 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0011817500000000001, 2024-09-14T09:09:12.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0023162840000000001, 2024-09-14T09:09:12.247 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.247 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.247 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.248 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10392 2024-09-14T09:09:12.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.248 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091655+0000", 2024-09-14T09:09:12.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091655+0000", 2024-09-14T09:09:12.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091655+0000", 2024-09-14T09:09:12.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-07 2024-09-14T09:09:12.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091656+0000", 2024-09-14T09:09:12.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4399999999999998e-07 2024-09-14T09:09:12.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091659+0000", 2024-09-14T09:09:12.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8169999999999999e-06 2024-09-14T09:09:12.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091661+0000", 2024-09-14T09:09:12.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.508e-06 2024-09-14T09:09:12.250 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.250 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.250 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.250 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10101 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.250 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.092904+0000", 2024-09-14T09:09:12.251 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9999328, 2024-09-14T09:09:12.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00109245, 2024-09-14T09:09:12.251 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.251 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.251 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.251 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.251 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.251 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.251 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10101 2024-09-14T09:09:12.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.251 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092904+0000", 2024-09-14T09:09:12.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092904+0000", 2024-09-14T09:09:12.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092904+0000", 2024-09-14T09:09:12.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:09:12.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092906+0000", 2024-09-14T09:09:12.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0090000000000002e-06 2024-09-14T09:09:12.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092912+0000", 2024-09-14T09:09:12.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.297e-06 2024-09-14T09:09:12.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092917+0000", 2024-09-14T09:09:12.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7840000000000003e-06 2024-09-14T09:09:12.253 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.253 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.253 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.254 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10657 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.254 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.088931+0000", 2024-09-14T09:09:12.254 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0039050859999999999, 2024-09-14T09:09:12.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050894570000000004, 2024-09-14T09:09:12.254 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.254 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.254 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.254 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.254 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.254 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.254 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10657 2024-09-14T09:09:12.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.255 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088931+0000", 2024-09-14T09:09:12.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088931+0000", 2024-09-14T09:09:12.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088932+0000", 2024-09-14T09:09:12.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2300000000000002e-07 2024-09-14T09:09:12.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088933+0000", 2024-09-14T09:09:12.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.502e-06 2024-09-14T09:09:12.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088937+0000", 2024-09-14T09:09:12.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6500000000000002e-06 2024-09-14T09:09:12.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.088940+0000", 2024-09-14T09:09:12.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8420000000000001e-06 2024-09-14T09:09:12.257 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.257 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.257 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.257 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10114 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.257 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090254+0000", 2024-09-14T09:09:12.257 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0025825589999999999, 2024-09-14T09:09:12.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037914870000000001, 2024-09-14T09:09:12.257 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.257 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.257 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.257 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.258 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.258 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.258 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10114 2024-09-14T09:09:12.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.258 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090254+0000", 2024-09-14T09:09:12.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090254+0000", 2024-09-14T09:09:12.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090254+0000", 2024-09-14T09:09:12.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0699999999999999e-07 2024-09-14T09:09:12.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090255+0000", 2024-09-14T09:09:12.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9800000000000002e-07 2024-09-14T09:09:12.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090258+0000", 2024-09-14T09:09:12.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8420000000000001e-06 2024-09-14T09:09:12.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090261+0000", 2024-09-14T09:09:12.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5600000000000001e-06 2024-09-14T09:09:12.260 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.260 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.260 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.260 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10271 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090727+0000", 2024-09-14T09:09:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00210998, 2024-09-14T09:09:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033420899999999998, 2024-09-14T09:09:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10271 2024-09-14T09:09:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090727+0000", 2024-09-14T09:09:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090727+0000", 2024-09-14T09:09:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090727+0000", 2024-09-14T09:09:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5199999999999998e-07 2024-09-14T09:09:12.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090728+0000", 2024-09-14T09:09:12.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9900000000000009e-07 2024-09-14T09:09:12.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090738+0000", 2024-09-14T09:09:12.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6169999999999996e-06 2024-09-14T09:09:12.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090741+0000", 2024-09-14T09:09:12.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0120000000000001e-06 2024-09-14T09:09:12.264 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.264 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.264 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.264 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10330 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.264 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091180+0000", 2024-09-14T09:09:12.264 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001656713, 2024-09-14T09:09:12.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029132429999999998, 2024-09-14T09:09:12.264 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.264 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.264 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.265 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.265 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.265 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.265 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10330 2024-09-14T09:09:12.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.265 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091180+0000", 2024-09-14T09:09:12.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091180+0000", 2024-09-14T09:09:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091180+0000", 2024-09-14T09:09:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7899999999999999e-07 2024-09-14T09:09:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091181+0000", 2024-09-14T09:09:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6600000000000005e-07 2024-09-14T09:09:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091184+0000", 2024-09-14T09:09:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.802e-06 2024-09-14T09:09:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091186+0000", 2024-09-14T09:09:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4609999999999998e-06 2024-09-14T09:09:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10394 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091665+0000", 2024-09-14T09:09:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0011720319999999999, 2024-09-14T09:09:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024514739999999999, 2024-09-14T09:09:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10394 2024-09-14T09:09:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091665+0000", 2024-09-14T09:09:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091665+0000", 2024-09-14T09:09:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091665+0000", 2024-09-14T09:09:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.77e-07 2024-09-14T09:09:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091666+0000", 2024-09-14T09:09:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4900000000000004e-07 2024-09-14T09:09:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091669+0000", 2024-09-14T09:09:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7999999999999999e-06 2024-09-14T09:09:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091671+0000", 2024-09-14T09:09:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5450000000000002e-06 2024-09-14T09:09:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10103 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.092935+0000", 2024-09-14T09:09:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9999013, 2024-09-14T09:09:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001206312, 2024-09-14T09:09:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10103 2024-09-14T09:09:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092935+0000", 2024-09-14T09:09:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092935+0000", 2024-09-14T09:09:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092936+0000", 2024-09-14T09:09:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2024-09-14T09:09:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092938+0000", 2024-09-14T09:09:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.903e-06 2024-09-14T09:09:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092944+0000", 2024-09-14T09:09:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.139e-06 2024-09-14T09:09:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092949+0000", 2024-09-14T09:09:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6299999999999997e-06 2024-09-14T09:09:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10116 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090276+0000", 2024-09-14T09:09:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0025609930000000001, 2024-09-14T09:09:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038906430000000001, 2024-09-14T09:09:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10116 2024-09-14T09:09:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090276+0000", 2024-09-14T09:09:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090276+0000", 2024-09-14T09:09:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090276+0000", 2024-09-14T09:09:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8800000000000003e-07 2024-09-14T09:09:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090277+0000", 2024-09-14T09:09:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.37e-06 2024-09-14T09:09:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090281+0000", 2024-09-14T09:09:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3359999999999999e-06 2024-09-14T09:09:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090284+0000", 2024-09-14T09:09:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8040000000000002e-06 2024-09-14T09:09:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10273 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090745+0000", 2024-09-14T09:09:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0020920000000000001, 2024-09-14T09:09:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003446162, 2024-09-14T09:09:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10273 2024-09-14T09:09:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090745+0000", 2024-09-14T09:09:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090745+0000", 2024-09-14T09:09:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090745+0000", 2024-09-14T09:09:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8699999999999995e-07 2024-09-14T09:09:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090751+0000", 2024-09-14T09:09:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8930000000000002e-06 2024-09-14T09:09:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090754+0000", 2024-09-14T09:09:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.478e-06 2024-09-14T09:09:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090757+0000", 2024-09-14T09:09:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5359999999999999e-06 2024-09-14T09:09:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10332 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091192+0000", 2024-09-14T09:09:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0016444459999999999, 2024-09-14T09:09:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030218060000000001, 2024-09-14T09:09:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10332 2024-09-14T09:09:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091192+0000", 2024-09-14T09:09:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091192+0000", 2024-09-14T09:09:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091192+0000", 2024-09-14T09:09:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0800000000000001e-07 2024-09-14T09:09:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091193+0000", 2024-09-14T09:09:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9300000000000006e-07 2024-09-14T09:09:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091196+0000", 2024-09-14T09:09:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0589999999999998e-06 2024-09-14T09:09:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091199+0000", 2024-09-14T09:09:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6180000000000002e-06 2024-09-14T09:09:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10396 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091675+0000", 2024-09-14T09:09:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0011615239999999999, 2024-09-14T09:09:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025617299999999999, 2024-09-14T09:09:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10396 2024-09-14T09:09:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091675+0000", 2024-09-14T09:09:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091675+0000", 2024-09-14T09:09:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091675+0000", 2024-09-14T09:09:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2000000000000001e-07 2024-09-14T09:09:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091676+0000", 2024-09-14T09:09:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2200000000000002e-07 2024-09-14T09:09:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091679+0000", 2024-09-14T09:09:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7460000000000001e-06 2024-09-14T09:09:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091682+0000", 2024-09-14T09:09:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6529999999999998e-06 2024-09-14T09:09:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10105 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.092967+0000", 2024-09-14T09:09:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9998693, 2024-09-14T09:09:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0012944670000000001, 2024-09-14T09:09:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10105 2024-09-14T09:09:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092967+0000", 2024-09-14T09:09:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092967+0000", 2024-09-14T09:09:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092968+0000", 2024-09-14T09:09:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3499999999999996e-07 2024-09-14T09:09:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092970+0000", 2024-09-14T09:09:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8169999999999999e-06 2024-09-14T09:09:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092975+0000", 2024-09-14T09:09:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2700000000000004e-06 2024-09-14T09:09:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092981+0000", 2024-09-14T09:09:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-09-14T09:09:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10118 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090301+0000", 2024-09-14T09:09:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002535696, 2024-09-14T09:09:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039847169999999996, 2024-09-14T09:09:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10118 2024-09-14T09:09:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090301+0000", 2024-09-14T09:09:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090301+0000", 2024-09-14T09:09:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090301+0000", 2024-09-14T09:09:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4400000000000001e-07 2024-09-14T09:09:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090303+0000", 2024-09-14T09:09:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.288e-06 2024-09-14T09:09:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090306+0000", 2024-09-14T09:09:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3139999999999999e-06 2024-09-14T09:09:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090309+0000", 2024-09-14T09:09:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6450000000000001e-06 2024-09-14T09:09:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10275 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090761+0000", 2024-09-14T09:09:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0020755719999999999, 2024-09-14T09:09:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035490410000000002, 2024-09-14T09:09:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10275 2024-09-14T09:09:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090761+0000", 2024-09-14T09:09:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090761+0000", 2024-09-14T09:09:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090761+0000", 2024-09-14T09:09:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3099999999999999e-07 2024-09-14T09:09:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090769+0000", 2024-09-14T09:09:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0390000000000005e-06 2024-09-14T09:09:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090772+0000", 2024-09-14T09:09:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2320000000000001e-06 2024-09-14T09:09:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090775+0000", 2024-09-14T09:09:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5909999999999998e-06 2024-09-14T09:09:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10334 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091208+0000", 2024-09-14T09:09:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001629028, 2024-09-14T09:09:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031254120000000002, 2024-09-14T09:09:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10334 2024-09-14T09:09:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091208+0000", 2024-09-14T09:09:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091208+0000", 2024-09-14T09:09:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091208+0000", 2024-09-14T09:09:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6800000000000001e-07 2024-09-14T09:09:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091209+0000", 2024-09-14T09:09:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.271e-06 2024-09-14T09:09:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091213+0000", 2024-09-14T09:09:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2509999999999999e-06 2024-09-14T09:09:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091215+0000", 2024-09-14T09:09:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5679999999999998e-06 2024-09-14T09:09:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10397 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091692+0000", 2024-09-14T09:09:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0011444300000000001, 2024-09-14T09:09:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026656499999999999, 2024-09-14T09:09:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10397 2024-09-14T09:09:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091692+0000", 2024-09-14T09:09:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091692+0000", 2024-09-14T09:09:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091693+0000", 2024-09-14T09:09:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5600000000000001e-07 2024-09-14T09:09:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091694+0000", 2024-09-14T09:09:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.181e-06 2024-09-14T09:09:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091697+0000", 2024-09-14T09:09:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3699999999999999e-06 2024-09-14T09:09:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091700+0000", 2024-09-14T09:09:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5380000000000001e-06 2024-09-14T09:09:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10108 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093014+0000", 2024-09-14T09:09:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9998231, 2024-09-14T09:09:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013682189999999999, 2024-09-14T09:09:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10108 2024-09-14T09:09:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093014+0000", 2024-09-14T09:09:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093014+0000", 2024-09-14T09:09:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093014+0000", 2024-09-14T09:09:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2024-09-14T09:09:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093016+0000", 2024-09-14T09:09:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.08e-06 2024-09-14T09:09:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093024+0000", 2024-09-14T09:09:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0399999999999993e-06 2024-09-14T09:09:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093029+0000", 2024-09-14T09:09:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9540000000000003e-06 2024-09-14T09:09:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10120 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090312+0000", 2024-09-14T09:09:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0025246560000000001, 2024-09-14T09:09:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040960939999999998, 2024-09-14T09:09:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10120 2024-09-14T09:09:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090312+0000", 2024-09-14T09:09:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090312+0000", 2024-09-14T09:09:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090312+0000", 2024-09-14T09:09:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4499999999999998e-07 2024-09-14T09:09:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090313+0000", 2024-09-14T09:09:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5999999999999991e-07 2024-09-14T09:09:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090317+0000", 2024-09-14T09:09:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6569999999999999e-06 2024-09-14T09:09:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090319+0000", 2024-09-14T09:09:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6079999999999998e-06 2024-09-14T09:09:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10277 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090794+0000", 2024-09-14T09:09:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0020427269999999998, 2024-09-14T09:09:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0036374110000000001, 2024-09-14T09:09:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10277 2024-09-14T09:09:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090794+0000", 2024-09-14T09:09:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090794+0000", 2024-09-14T09:09:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090794+0000", 2024-09-14T09:09:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7999999999999996e-07 2024-09-14T09:09:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090796+0000", 2024-09-14T09:09:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4470000000000001e-06 2024-09-14T09:09:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090799+0000", 2024-09-14T09:09:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4680000000000001e-06 2024-09-14T09:09:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090802+0000", 2024-09-14T09:09:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4590000000000001e-06 2024-09-14T09:09:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10336 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091218+0000", 2024-09-14T09:09:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001618123, 2024-09-14T09:09:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032376480000000001, 2024-09-14T09:09:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10336 2024-09-14T09:09:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091218+0000", 2024-09-14T09:09:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091218+0000", 2024-09-14T09:09:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091219+0000", 2024-09-14T09:09:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4700000000000002e-07 2024-09-14T09:09:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091220+0000", 2024-09-14T09:09:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3099999999999996e-07 2024-09-14T09:09:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091223+0000", 2024-09-14T09:09:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8550000000000002e-06 2024-09-14T09:09:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091225+0000", 2024-09-14T09:09:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4729999999999999e-06 2024-09-14T09:09:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10398 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091703+0000", 2024-09-14T09:09:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0011335340000000001, 2024-09-14T09:09:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027762220000000001, 2024-09-14T09:09:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10398 2024-09-14T09:09:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091703+0000", 2024-09-14T09:09:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091703+0000", 2024-09-14T09:09:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091703+0000", 2024-09-14T09:09:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:09:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091704+0000", 2024-09-14T09:09:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4099999999999997e-07 2024-09-14T09:09:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091707+0000", 2024-09-14T09:09:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.914e-06 2024-09-14T09:09:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091710+0000", 2024-09-14T09:09:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4739999999999999e-06 2024-09-14T09:09:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10110 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093038+0000", 2024-09-14T09:09:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9997993, 2024-09-14T09:09:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014676660000000001, 2024-09-14T09:09:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10110 2024-09-14T09:09:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093038+0000", 2024-09-14T09:09:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093038+0000", 2024-09-14T09:09:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093038+0000", 2024-09-14T09:09:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9900000000000001e-07 2024-09-14T09:09:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093046+0000", 2024-09-14T09:09:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0309999999999998e-06 2024-09-14T09:09:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093055+0000", 2024-09-14T09:09:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5690000000000005e-06 2024-09-14T09:09:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093060+0000", 2024-09-14T09:09:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3040000000000004e-06 2024-09-14T09:09:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10122 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090322+0000", 2024-09-14T09:09:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0025141769999999998, 2024-09-14T09:09:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004222918, 2024-09-14T09:09:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10122 2024-09-14T09:09:12.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.323 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090322+0000", 2024-09-14T09:09:12.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090322+0000", 2024-09-14T09:09:12.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090323+0000", 2024-09-14T09:09:12.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.16e-07 2024-09-14T09:09:12.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090324+0000", 2024-09-14T09:09:12.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.009e-06 2024-09-14T09:09:12.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090326+0000", 2024-09-14T09:09:12.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8049999999999998e-06 2024-09-14T09:09:12.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090329+0000", 2024-09-14T09:09:12.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5050000000000002e-06 2024-09-14T09:09:12.325 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.325 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.325 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.325 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10279 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.325 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090806+0000", 2024-09-14T09:09:12.325 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0020305079999999999, 2024-09-14T09:09:12.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038327840000000001, 2024-09-14T09:09:12.325 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.325 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.325 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.325 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.326 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.326 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.326 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10279 2024-09-14T09:09:12.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.326 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090806+0000", 2024-09-14T09:09:12.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090806+0000", 2024-09-14T09:09:12.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090806+0000", 2024-09-14T09:09:12.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7e-07 2024-09-14T09:09:12.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090807+0000", 2024-09-14T09:09:12.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.95e-07 2024-09-14T09:09:12.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090810+0000", 2024-09-14T09:09:12.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8619999999999999e-06 2024-09-14T09:09:12.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090813+0000", 2024-09-14T09:09:12.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4499999999999998e-06 2024-09-14T09:09:12.328 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.328 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.328 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.328 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10338 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.328 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091228+0000", 2024-09-14T09:09:12.328 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0016085400000000001, 2024-09-14T09:09:12.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034349710000000002, 2024-09-14T09:09:12.328 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.329 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.329 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.329 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.329 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.329 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.329 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10338 2024-09-14T09:09:12.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.329 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091228+0000", 2024-09-14T09:09:12.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091228+0000", 2024-09-14T09:09:12.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091228+0000", 2024-09-14T09:09:12.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.84e-07 2024-09-14T09:09:12.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091229+0000", 2024-09-14T09:09:12.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2200000000000002e-07 2024-09-14T09:09:12.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091232+0000", 2024-09-14T09:09:12.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.745e-06 2024-09-14T09:09:12.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091235+0000", 2024-09-14T09:09:12.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8310000000000001e-06 2024-09-14T09:09:12.331 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.331 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.331 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.331 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10399 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.331 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091712+0000", 2024-09-14T09:09:12.331 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0011242120000000001, 2024-09-14T09:09:12.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029763509999999999, 2024-09-14T09:09:12.332 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.332 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.332 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.332 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10399 2024-09-14T09:09:12.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.332 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091712+0000", 2024-09-14T09:09:12.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091712+0000", 2024-09-14T09:09:12.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091713+0000", 2024-09-14T09:09:12.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5100000000000001e-07 2024-09-14T09:09:12.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091714+0000", 2024-09-14T09:09:12.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4e-07 2024-09-14T09:09:12.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091717+0000", 2024-09-14T09:09:12.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9079999999999999e-06 2024-09-14T09:09:12.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091719+0000", 2024-09-14T09:09:12.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5170000000000002e-06 2024-09-14T09:09:12.334 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.334 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.334 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.335 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10112 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.335 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093097+0000", 2024-09-14T09:09:12.335 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9997392, 2024-09-14T09:09:12.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001615224, 2024-09-14T09:09:12.335 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.335 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.335 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.335 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.335 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.335 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.335 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10112 2024-09-14T09:09:12.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.335 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093097+0000", 2024-09-14T09:09:12.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093097+0000", 2024-09-14T09:09:12.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093098+0000", 2024-09-14T09:09:12.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.99e-07 2024-09-14T09:09:12.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093100+0000", 2024-09-14T09:09:12.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2749999999999998e-06 2024-09-14T09:09:12.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093115+0000", 2024-09-14T09:09:12.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4569999999999999e-05 2024-09-14T09:09:12.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093120+0000", 2024-09-14T09:09:12.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9139999999999999e-06 2024-09-14T09:09:12.337 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.338 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.338 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.338 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10124 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.338 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090332+0000", 2024-09-14T09:09:12.338 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0025047450000000001, 2024-09-14T09:09:12.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044133030000000004, 2024-09-14T09:09:12.338 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.338 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.338 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.338 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.338 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.339 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10124 2024-09-14T09:09:12.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.339 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090332+0000", 2024-09-14T09:09:12.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090332+0000", 2024-09-14T09:09:12.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090332+0000", 2024-09-14T09:09:12.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0800000000000001e-07 2024-09-14T09:09:12.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090333+0000", 2024-09-14T09:09:12.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0249999999999999e-06 2024-09-14T09:09:12.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090336+0000", 2024-09-14T09:09:12.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7489999999999999e-06 2024-09-14T09:09:12.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090339+0000", 2024-09-14T09:09:12.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3529999999999999e-06 2024-09-14T09:09:12.341 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.341 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.341 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.341 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10281 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.341 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090816+0000", 2024-09-14T09:09:12.341 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0020207710000000002, 2024-09-14T09:09:12.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039551689999999997, 2024-09-14T09:09:12.342 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.342 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.342 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.342 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.342 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.342 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.342 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10281 2024-09-14T09:09:12.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.342 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090816+0000", 2024-09-14T09:09:12.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090816+0000", 2024-09-14T09:09:12.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090816+0000", 2024-09-14T09:09:12.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-07 2024-09-14T09:09:12.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090817+0000", 2024-09-14T09:09:12.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2249999999999999e-06 2024-09-14T09:09:12.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090820+0000", 2024-09-14T09:09:12.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.881e-06 2024-09-14T09:09:12.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090823+0000", 2024-09-14T09:09:12.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4260000000000002e-06 2024-09-14T09:09:12.344 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.344 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.344 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.344 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10340 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.344 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091238+0000", 2024-09-14T09:09:12.345 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001598824, 2024-09-14T09:09:12.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035561770000000002, 2024-09-14T09:09:12.345 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.345 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.345 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.345 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10340 2024-09-14T09:09:12.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.345 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091238+0000", 2024-09-14T09:09:12.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091238+0000", 2024-09-14T09:09:12.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091238+0000", 2024-09-14T09:09:12.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9400000000000001e-07 2024-09-14T09:09:12.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091242+0000", 2024-09-14T09:09:12.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2119999999999997e-06 2024-09-14T09:09:12.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091246+0000", 2024-09-14T09:09:12.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9319999999999998e-06 2024-09-14T09:09:12.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091249+0000", 2024-09-14T09:09:12.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6359999999999998e-06 2024-09-14T09:09:12.347 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.347 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.347 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.347 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10400 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.348 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091726+0000", 2024-09-14T09:09:12.348 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001110092, 2024-09-14T09:09:12.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030935239999999998, 2024-09-14T09:09:12.348 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.348 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.348 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.348 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.348 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.348 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.348 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10400 2024-09-14T09:09:12.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.348 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091726+0000", 2024-09-14T09:09:12.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091726+0000", 2024-09-14T09:09:12.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091727+0000", 2024-09-14T09:09:12.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7700000000000005e-07 2024-09-14T09:09:12.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091728+0000", 2024-09-14T09:09:12.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.494e-06 2024-09-14T09:09:12.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091738+0000", 2024-09-14T09:09:12.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2e-06 2024-09-14T09:09:12.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091740+0000", 2024-09-14T09:09:12.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6649999999999999e-06 2024-09-14T09:09:12.351 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.351 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.351 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.351 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10114 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.351 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093127+0000", 2024-09-14T09:09:12.351 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9997091, 2024-09-14T09:09:12.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001716338, 2024-09-14T09:09:12.351 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.351 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.351 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.351 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.352 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.352 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.352 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10114 2024-09-14T09:09:12.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.352 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093127+0000", 2024-09-14T09:09:12.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093127+0000", 2024-09-14T09:09:12.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093128+0000", 2024-09-14T09:09:12.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3599999999999999e-07 2024-09-14T09:09:12.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093130+0000", 2024-09-14T09:09:12.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1679999999999998e-06 2024-09-14T09:09:12.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093137+0000", 2024-09-14T09:09:12.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4810000000000003e-06 2024-09-14T09:09:12.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093141+0000", 2024-09-14T09:09:12.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9200000000000003e-06 2024-09-14T09:09:12.354 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.354 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.354 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.354 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10126 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.354 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090349+0000", 2024-09-14T09:09:12.355 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0024874620000000002, 2024-09-14T09:09:12.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045200709999999996, 2024-09-14T09:09:12.355 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.355 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.355 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.355 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.355 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.355 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.355 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10126 2024-09-14T09:09:12.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.355 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090349+0000", 2024-09-14T09:09:12.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090349+0000", 2024-09-14T09:09:12.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090350+0000", 2024-09-14T09:09:12.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4700000000000002e-07 2024-09-14T09:09:12.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090351+0000", 2024-09-14T09:09:12.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3480000000000001e-06 2024-09-14T09:09:12.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090354+0000", 2024-09-14T09:09:12.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.292e-06 2024-09-14T09:09:12.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090357+0000", 2024-09-14T09:09:12.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.582e-06 2024-09-14T09:09:12.357 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.358 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.358 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.358 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10283 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.358 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090827+0000", 2024-09-14T09:09:12.358 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0020098920000000001, 2024-09-14T09:09:12.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040655329999999996, 2024-09-14T09:09:12.358 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.358 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.358 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.358 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.358 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.358 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.359 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10283 2024-09-14T09:09:12.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.359 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090827+0000", 2024-09-14T09:09:12.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090827+0000", 2024-09-14T09:09:12.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090827+0000", 2024-09-14T09:09:12.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.72e-07 2024-09-14T09:09:12.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090828+0000", 2024-09-14T09:09:12.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.879999999999999e-07 2024-09-14T09:09:12.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090831+0000", 2024-09-14T09:09:12.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.841e-06 2024-09-14T09:09:12.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090833+0000", 2024-09-14T09:09:12.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3379999999999999e-06 2024-09-14T09:09:12.361 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.361 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.361 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.361 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10342 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.361 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091270+0000", 2024-09-14T09:09:12.361 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001566745, 2024-09-14T09:09:12.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003646931, 2024-09-14T09:09:12.362 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.362 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.362 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.362 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10342 2024-09-14T09:09:12.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.362 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091270+0000", 2024-09-14T09:09:12.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091270+0000", 2024-09-14T09:09:12.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091270+0000", 2024-09-14T09:09:12.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8699999999999995e-07 2024-09-14T09:09:12.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091272+0000", 2024-09-14T09:09:12.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3379999999999999e-06 2024-09-14T09:09:12.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091275+0000", 2024-09-14T09:09:12.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3299999999999999e-06 2024-09-14T09:09:12.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091278+0000", 2024-09-14T09:09:12.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6419999999999999e-06 2024-09-14T09:09:12.364 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.364 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.365 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.365 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10401 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.365 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091744+0000", 2024-09-14T09:09:12.365 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001092148, 2024-09-14T09:09:12.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031953039999999999, 2024-09-14T09:09:12.365 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.365 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.365 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.365 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10401 2024-09-14T09:09:12.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.366 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091744+0000", 2024-09-14T09:09:12.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091744+0000", 2024-09-14T09:09:12.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091745+0000", 2024-09-14T09:09:12.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4299999999999999e-07 2024-09-14T09:09:12.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091746+0000", 2024-09-14T09:09:12.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2839999999999999e-06 2024-09-14T09:09:12.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091749+0000", 2024-09-14T09:09:12.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0079999999999998e-06 2024-09-14T09:09:12.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091751+0000", 2024-09-14T09:09:12.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4480000000000001e-06 2024-09-14T09:09:12.367 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.368 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.368 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.368 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10116 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.368 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093148+0000", 2024-09-14T09:09:12.368 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9996881, 2024-09-14T09:09:12.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00181595, 2024-09-14T09:09:12.368 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.368 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.368 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.368 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.368 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.368 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.369 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10116 2024-09-14T09:09:12.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.369 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093148+0000", 2024-09-14T09:09:12.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093148+0000", 2024-09-14T09:09:12.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093149+0000", 2024-09-14T09:09:12.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5000000000000003e-07 2024-09-14T09:09:12.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093151+0000", 2024-09-14T09:09:12.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8390000000000001e-06 2024-09-14T09:09:12.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093156+0000", 2024-09-14T09:09:12.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6350000000000003e-06 2024-09-14T09:09:12.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093161+0000", 2024-09-14T09:09:12.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4089999999999996e-06 2024-09-14T09:09:12.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.371 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.371 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10285 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.371 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090836+0000", 2024-09-14T09:09:12.371 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002000393, 2024-09-14T09:09:12.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0041525720000000002, 2024-09-14T09:09:12.371 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.371 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.371 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.372 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10285 2024-09-14T09:09:12.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.372 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090836+0000", 2024-09-14T09:09:12.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090836+0000", 2024-09-14T09:09:12.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090836+0000", 2024-09-14T09:09:12.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-07 2024-09-14T09:09:12.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090837+0000", 2024-09-14T09:09:12.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7699999999999992e-07 2024-09-14T09:09:12.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090840+0000", 2024-09-14T09:09:12.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8789999999999999e-06 2024-09-14T09:09:12.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090843+0000", 2024-09-14T09:09:12.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3999999999999999e-06 2024-09-14T09:09:12.374 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.374 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.374 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.374 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10344 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.374 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091288+0000", 2024-09-14T09:09:12.374 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0015481449999999999, 2024-09-14T09:09:12.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037251939999999998, 2024-09-14T09:09:12.374 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.375 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.375 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.375 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.375 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.375 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.375 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10344 2024-09-14T09:09:12.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.375 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091288+0000", 2024-09-14T09:09:12.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091288+0000", 2024-09-14T09:09:12.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091289+0000", 2024-09-14T09:09:12.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.58e-07 2024-09-14T09:09:12.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091290+0000", 2024-09-14T09:09:12.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2860000000000001e-06 2024-09-14T09:09:12.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091293+0000", 2024-09-14T09:09:12.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.247e-06 2024-09-14T09:09:12.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091296+0000", 2024-09-14T09:09:12.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5830000000000001e-06 2024-09-14T09:09:12.377 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.377 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.377 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.377 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10402 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.377 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091767+0000", 2024-09-14T09:09:12.377 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0010691940000000001, 2024-09-14T09:09:12.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032694579999999998, 2024-09-14T09:09:12.378 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.378 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.378 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.378 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.378 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.378 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.378 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10402 2024-09-14T09:09:12.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.378 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091767+0000", 2024-09-14T09:09:12.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091767+0000", 2024-09-14T09:09:12.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091768+0000", 2024-09-14T09:09:12.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7300000000000001e-07 2024-09-14T09:09:12.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091769+0000", 2024-09-14T09:09:12.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.198e-06 2024-09-14T09:09:12.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091772+0000", 2024-09-14T09:09:12.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4580000000000002e-06 2024-09-14T09:09:12.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091775+0000", 2024-09-14T09:09:12.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5639999999999999e-06 2024-09-14T09:09:12.380 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.380 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.380 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.380 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10118 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.380 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093168+0000", 2024-09-14T09:09:12.380 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9996691, 2024-09-14T09:09:12.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001893893, 2024-09-14T09:09:12.381 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.381 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.381 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.381 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.381 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.381 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.381 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10118 2024-09-14T09:09:12.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.381 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093168+0000", 2024-09-14T09:09:12.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093168+0000", 2024-09-14T09:09:12.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093168+0000", 2024-09-14T09:09:12.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-07 2024-09-14T09:09:12.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093170+0000", 2024-09-14T09:09:12.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6729999999999999e-06 2024-09-14T09:09:12.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093176+0000", 2024-09-14T09:09:12.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5649999999999998e-06 2024-09-14T09:09:12.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093181+0000", 2024-09-14T09:09:12.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0810000000000001e-06 2024-09-14T09:09:12.383 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.383 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.383 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.384 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10287 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.384 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090856+0000", 2024-09-14T09:09:12.384 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0019804129999999999, 2024-09-14T09:09:12.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042300419999999998, 2024-09-14T09:09:12.384 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.384 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.384 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.384 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.384 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.384 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.384 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10287 2024-09-14T09:09:12.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.384 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090856+0000", 2024-09-14T09:09:12.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090856+0000", 2024-09-14T09:09:12.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090857+0000", 2024-09-14T09:09:12.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7e-07 2024-09-14T09:09:12.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090858+0000", 2024-09-14T09:09:12.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.308e-06 2024-09-14T09:09:12.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090861+0000", 2024-09-14T09:09:12.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2799999999999999e-06 2024-09-14T09:09:12.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090864+0000", 2024-09-14T09:09:12.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.435e-06 2024-09-14T09:09:12.387 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.387 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.387 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.387 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10346 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.387 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091299+0000", 2024-09-14T09:09:12.387 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001537198, 2024-09-14T09:09:12.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003811741, 2024-09-14T09:09:12.387 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.387 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.388 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.388 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10346 2024-09-14T09:09:12.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.388 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091299+0000", 2024-09-14T09:09:12.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091299+0000", 2024-09-14T09:09:12.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091300+0000", 2024-09-14T09:09:12.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1299999999999999e-07 2024-09-14T09:09:12.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091301+0000", 2024-09-14T09:09:12.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9099999999999991e-07 2024-09-14T09:09:12.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091303+0000", 2024-09-14T09:09:12.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7640000000000001e-06 2024-09-14T09:09:12.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091306+0000", 2024-09-14T09:09:12.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4830000000000002e-06 2024-09-14T09:09:12.390 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.390 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.390 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.391 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10403 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.391 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091779+0000", 2024-09-14T09:09:12.391 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001057735, 2024-09-14T09:09:12.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033553400000000001, 2024-09-14T09:09:12.391 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.391 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.391 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.391 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.391 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.391 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.391 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10403 2024-09-14T09:09:12.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.391 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091779+0000", 2024-09-14T09:09:12.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091779+0000", 2024-09-14T09:09:12.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091779+0000", 2024-09-14T09:09:12.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5999999999999999e-07 2024-09-14T09:09:12.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091780+0000", 2024-09-14T09:09:12.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1699999999999997e-07 2024-09-14T09:09:12.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091783+0000", 2024-09-14T09:09:12.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7640000000000001e-06 2024-09-14T09:09:12.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091785+0000", 2024-09-14T09:09:12.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3870000000000002e-06 2024-09-14T09:09:12.394 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.394 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.394 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.394 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10120 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.394 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093195+0000", 2024-09-14T09:09:12.394 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9996414, 2024-09-14T09:09:12.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00196232, 2024-09-14T09:09:12.394 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.395 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.395 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.395 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.395 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.395 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.395 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10120 2024-09-14T09:09:12.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.395 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093195+0000", 2024-09-14T09:09:12.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093195+0000", 2024-09-14T09:09:12.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093196+0000", 2024-09-14T09:09:12.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9100000000000004e-07 2024-09-14T09:09:12.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093198+0000", 2024-09-14T09:09:12.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8050000000000001e-06 2024-09-14T09:09:12.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093205+0000", 2024-09-14T09:09:12.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5349999999999999e-06 2024-09-14T09:09:12.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093210+0000", 2024-09-14T09:09:12.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5349999999999998e-06 2024-09-14T09:09:12.397 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.397 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.397 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.398 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10289 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.398 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090867+0000", 2024-09-14T09:09:12.398 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001969485, 2024-09-14T09:09:12.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043158620000000002, 2024-09-14T09:09:12.398 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.398 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.398 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.398 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.398 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.398 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.398 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10289 2024-09-14T09:09:12.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.399 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090867+0000", 2024-09-14T09:09:12.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090867+0000", 2024-09-14T09:09:12.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090867+0000", 2024-09-14T09:09:12.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5699999999999998e-07 2024-09-14T09:09:12.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090868+0000", 2024-09-14T09:09:12.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.850000000000001e-07 2024-09-14T09:09:12.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090871+0000", 2024-09-14T09:09:12.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7429999999999998e-06 2024-09-14T09:09:12.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090873+0000", 2024-09-14T09:09:12.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3020000000000002e-06 2024-09-14T09:09:12.401 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.401 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.401 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.401 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10348 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.401 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091322+0000", 2024-09-14T09:09:12.401 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001514736, 2024-09-14T09:09:12.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038849470000000001, 2024-09-14T09:09:12.401 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.402 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.402 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.402 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.402 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.402 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.402 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10348 2024-09-14T09:09:12.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.402 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091322+0000", 2024-09-14T09:09:12.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091322+0000", 2024-09-14T09:09:12.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091322+0000", 2024-09-14T09:09:12.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.58e-07 2024-09-14T09:09:12.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091324+0000", 2024-09-14T09:09:12.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.266e-06 2024-09-14T09:09:12.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091327+0000", 2024-09-14T09:09:12.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6260000000000001e-06 2024-09-14T09:09:12.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091330+0000", 2024-09-14T09:09:12.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.571e-06 2024-09-14T09:09:12.404 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.404 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.404 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.405 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10404 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.405 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091788+0000", 2024-09-14T09:09:12.405 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0010484349999999999, 2024-09-14T09:09:12.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034437180000000001, 2024-09-14T09:09:12.405 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.405 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.405 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.405 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.405 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.405 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.405 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10404 2024-09-14T09:09:12.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.405 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091788+0000", 2024-09-14T09:09:12.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091788+0000", 2024-09-14T09:09:12.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091788+0000", 2024-09-14T09:09:12.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0699999999999999e-07 2024-09-14T09:09:12.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091792+0000", 2024-09-14T09:09:12.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3900000000000002e-06 2024-09-14T09:09:12.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091795+0000", 2024-09-14T09:09:12.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.354e-06 2024-09-14T09:09:12.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091798+0000", 2024-09-14T09:09:12.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.695e-06 2024-09-14T09:09:12.408 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.408 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.408 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.408 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10122 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.408 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093217+0000", 2024-09-14T09:09:12.408 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9996195, 2024-09-14T09:09:12.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020385479999999998, 2024-09-14T09:09:12.408 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.408 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.408 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.408 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.409 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10122 2024-09-14T09:09:12.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.409 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093217+0000", 2024-09-14T09:09:12.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093217+0000", 2024-09-14T09:09:12.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093217+0000", 2024-09-14T09:09:12.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7800000000000002e-07 2024-09-14T09:09:12.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093219+0000", 2024-09-14T09:09:12.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.72e-06 2024-09-14T09:09:12.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093225+0000", 2024-09-14T09:09:12.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6710000000000004e-06 2024-09-14T09:09:12.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093229+0000", 2024-09-14T09:09:12.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7180000000000004e-06 2024-09-14T09:09:12.411 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.411 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.411 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.411 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10291 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.411 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090876+0000", 2024-09-14T09:09:12.412 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0019603049999999999, 2024-09-14T09:09:12.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004404715, 2024-09-14T09:09:12.412 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.412 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.412 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.412 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.412 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.412 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.412 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10291 2024-09-14T09:09:12.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.412 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090876+0000", 2024-09-14T09:09:12.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090876+0000", 2024-09-14T09:09:12.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090876+0000", 2024-09-14T09:09:12.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-07 2024-09-14T09:09:12.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090877+0000", 2024-09-14T09:09:12.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.64e-07 2024-09-14T09:09:12.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090880+0000", 2024-09-14T09:09:12.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8480000000000001e-06 2024-09-14T09:09:12.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090883+0000", 2024-09-14T09:09:12.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.497e-06 2024-09-14T09:09:12.414 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.414 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.415 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.415 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10350 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.415 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091333+0000", 2024-09-14T09:09:12.415 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0015033609999999999, 2024-09-14T09:09:12.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039707650000000002, 2024-09-14T09:09:12.415 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.415 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.415 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.415 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.415 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.415 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.415 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10350 2024-09-14T09:09:12.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.416 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091333+0000", 2024-09-14T09:09:12.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091333+0000", 2024-09-14T09:09:12.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091333+0000", 2024-09-14T09:09:12.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1299999999999999e-07 2024-09-14T09:09:12.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091334+0000", 2024-09-14T09:09:12.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1699999999999997e-07 2024-09-14T09:09:12.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091337+0000", 2024-09-14T09:09:12.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.791e-06 2024-09-14T09:09:12.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091340+0000", 2024-09-14T09:09:12.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.531e-06 2024-09-14T09:09:12.418 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.418 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.418 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.418 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10405 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.418 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091808+0000", 2024-09-14T09:09:12.418 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0010286029999999999, 2024-09-14T09:09:12.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035204939999999999, 2024-09-14T09:09:12.418 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.418 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.418 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.418 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.419 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.419 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.419 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10405 2024-09-14T09:09:12.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.419 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091808+0000", 2024-09-14T09:09:12.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091808+0000", 2024-09-14T09:09:12.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091808+0000", 2024-09-14T09:09:12.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.58e-07 2024-09-14T09:09:12.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091810+0000", 2024-09-14T09:09:12.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3859999999999999e-06 2024-09-14T09:09:12.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091813+0000", 2024-09-14T09:09:12.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3850000000000002e-06 2024-09-14T09:09:12.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091816+0000", 2024-09-14T09:09:12.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1990000000000002e-06 2024-09-14T09:09:12.421 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.421 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.421 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.421 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10124 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.421 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093242+0000", 2024-09-14T09:09:12.421 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9995942, 2024-09-14T09:09:12.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021097849999999999, 2024-09-14T09:09:12.421 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.422 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.422 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.422 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.422 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.422 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.422 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10124 2024-09-14T09:09:12.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.422 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093242+0000", 2024-09-14T09:09:12.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093242+0000", 2024-09-14T09:09:12.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093243+0000", 2024-09-14T09:09:12.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7700000000000004e-07 2024-09-14T09:09:12.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093245+0000", 2024-09-14T09:09:12.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.776e-06 2024-09-14T09:09:12.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093251+0000", 2024-09-14T09:09:12.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.878e-06 2024-09-14T09:09:12.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093256+0000", 2024-09-14T09:09:12.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8300000000000003e-06 2024-09-14T09:09:12.424 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.424 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.424 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.425 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10293 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.425 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090897+0000", 2024-09-14T09:09:12.425 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0019399930000000001, 2024-09-14T09:09:12.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044818169999999999, 2024-09-14T09:09:12.425 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.425 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.425 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.425 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.425 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.425 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.425 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10293 2024-09-14T09:09:12.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.426 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090897+0000", 2024-09-14T09:09:12.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090897+0000", 2024-09-14T09:09:12.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090897+0000", 2024-09-14T09:09:12.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8800000000000003e-07 2024-09-14T09:09:12.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090898+0000", 2024-09-14T09:09:12.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.407e-06 2024-09-14T09:09:12.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090902+0000", 2024-09-14T09:09:12.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.32e-06 2024-09-14T09:09:12.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090904+0000", 2024-09-14T09:09:12.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.384e-06 2024-09-14T09:09:12.428 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.428 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.428 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.428 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10352 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.428 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091355+0000", 2024-09-14T09:09:12.428 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0014812, 2024-09-14T09:09:12.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040467000000000003, 2024-09-14T09:09:12.428 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.428 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.428 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.429 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.429 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.429 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.429 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10352 2024-09-14T09:09:12.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.429 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091355+0000", 2024-09-14T09:09:12.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091355+0000", 2024-09-14T09:09:12.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091356+0000", 2024-09-14T09:09:12.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.51e-07 2024-09-14T09:09:12.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091357+0000", 2024-09-14T09:09:12.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1999999999999999e-06 2024-09-14T09:09:12.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091360+0000", 2024-09-14T09:09:12.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2990000000000001e-06 2024-09-14T09:09:12.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091363+0000", 2024-09-14T09:09:12.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.553e-06 2024-09-14T09:09:12.431 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.431 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.431 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.431 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10406 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.431 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091820+0000", 2024-09-14T09:09:12.432 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001016954, 2024-09-14T09:09:12.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0036092580000000002, 2024-09-14T09:09:12.432 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.432 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.432 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.432 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.432 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.432 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.432 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10406 2024-09-14T09:09:12.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.432 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091820+0000", 2024-09-14T09:09:12.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091820+0000", 2024-09-14T09:09:12.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091820+0000", 2024-09-14T09:09:12.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0200000000000003e-07 2024-09-14T09:09:12.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091821+0000", 2024-09-14T09:09:12.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.47e-07 2024-09-14T09:09:12.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091824+0000", 2024-09-14T09:09:12.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8700000000000001e-06 2024-09-14T09:09:12.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091826+0000", 2024-09-14T09:09:12.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5390000000000002e-06 2024-09-14T09:09:12.434 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.434 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.434 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.435 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10126 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.435 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093276+0000", 2024-09-14T09:09:12.435 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9995608, 2024-09-14T09:09:12.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021767050000000001, 2024-09-14T09:09:12.435 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.435 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.435 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.435 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.435 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.435 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.435 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10126 2024-09-14T09:09:12.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.436 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093276+0000", 2024-09-14T09:09:12.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093276+0000", 2024-09-14T09:09:12.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093277+0000", 2024-09-14T09:09:12.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4470000000000001e-06 2024-09-14T09:09:12.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093279+0000", 2024-09-14T09:09:12.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0229999999999999e-06 2024-09-14T09:09:12.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093291+0000", 2024-09-14T09:09:12.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1569000000000001e-05 2024-09-14T09:09:12.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093297+0000", 2024-09-14T09:09:12.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:09:12.438 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.438 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.438 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.438 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10295 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.438 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090908+0000", 2024-09-14T09:09:12.438 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0019288809999999999, 2024-09-14T09:09:12.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045701889999999997, 2024-09-14T09:09:12.438 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.438 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.439 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.439 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.439 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.439 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.439 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10295 2024-09-14T09:09:12.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.439 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090908+0000", 2024-09-14T09:09:12.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090908+0000", 2024-09-14T09:09:12.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090908+0000", 2024-09-14T09:09:12.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6199999999999999e-07 2024-09-14T09:09:12.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090909+0000", 2024-09-14T09:09:12.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7900000000000007e-07 2024-09-14T09:09:12.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090912+0000", 2024-09-14T09:09:12.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8210000000000002e-06 2024-09-14T09:09:12.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090914+0000", 2024-09-14T09:09:12.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3e-06 2024-09-14T09:09:12.441 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.441 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.441 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.441 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10354 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.441 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091366+0000", 2024-09-14T09:09:12.442 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001470248, 2024-09-14T09:09:12.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0041349769999999997, 2024-09-14T09:09:12.442 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.442 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.442 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.442 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.442 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.442 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.442 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10354 2024-09-14T09:09:12.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.442 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091366+0000", 2024-09-14T09:09:12.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091366+0000", 2024-09-14T09:09:12.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091367+0000", 2024-09-14T09:09:12.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8700000000000001e-07 2024-09-14T09:09:12.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091368+0000", 2024-09-14T09:09:12.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:09:12.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091371+0000", 2024-09-14T09:09:12.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4800000000000001e-06 2024-09-14T09:09:12.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091373+0000", 2024-09-14T09:09:12.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4250000000000001e-06 2024-09-14T09:09:12.444 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.444 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.444 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.444 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10407 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.445 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091843+0000", 2024-09-14T09:09:12.445 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00099382799999999999, 2024-09-14T09:09:12.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0036827890000000001, 2024-09-14T09:09:12.445 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.445 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.445 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.445 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.445 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.445 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.445 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10407 2024-09-14T09:09:12.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.445 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091843+0000", 2024-09-14T09:09:12.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091843+0000", 2024-09-14T09:09:12.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091843+0000", 2024-09-14T09:09:12.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5900000000000002e-07 2024-09-14T09:09:12.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091844+0000", 2024-09-14T09:09:12.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3060000000000001e-06 2024-09-14T09:09:12.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091848+0000", 2024-09-14T09:09:12.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3160000000000001e-06 2024-09-14T09:09:12.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091850+0000", 2024-09-14T09:09:12.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6019999999999998e-06 2024-09-14T09:09:12.447 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.448 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.448 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.448 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10128 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.448 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093311+0000", 2024-09-14T09:09:12.448 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9995251, 2024-09-14T09:09:12.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022377999999999999, 2024-09-14T09:09:12.448 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.448 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.448 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.448 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.448 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.448 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.449 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10128 2024-09-14T09:09:12.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.449 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093311+0000", 2024-09-14T09:09:12.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093311+0000", 2024-09-14T09:09:12.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093312+0000", 2024-09-14T09:09:12.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6899999999999997e-07 2024-09-14T09:09:12.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093314+0000", 2024-09-14T09:09:12.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8309999999999999e-06 2024-09-14T09:09:12.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093321+0000", 2024-09-14T09:09:12.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.593e-06 2024-09-14T09:09:12.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093326+0000", 2024-09-14T09:09:12.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6639999999999997e-06 2024-09-14T09:09:12.451 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.451 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.451 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.451 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10297 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.451 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090917+0000", 2024-09-14T09:09:12.451 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001919413, 2024-09-14T09:09:12.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046558809999999997, 2024-09-14T09:09:12.452 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.452 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.452 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.452 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.452 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.452 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.452 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10297 2024-09-14T09:09:12.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.452 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090917+0000", 2024-09-14T09:09:12.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090917+0000", 2024-09-14T09:09:12.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090917+0000", 2024-09-14T09:09:12.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2399999999999999e-07 2024-09-14T09:09:12.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090921+0000", 2024-09-14T09:09:12.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3270000000000001e-06 2024-09-14T09:09:12.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090924+0000", 2024-09-14T09:09:12.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1420000000000002e-06 2024-09-14T09:09:12.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090926+0000", 2024-09-14T09:09:12.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5270000000000001e-06 2024-09-14T09:09:12.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.455 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.455 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10356 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.455 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091376+0000", 2024-09-14T09:09:12.455 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0014601869999999999, 2024-09-14T09:09:12.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042212780000000002, 2024-09-14T09:09:12.455 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.455 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.455 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.456 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10356 2024-09-14T09:09:12.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.456 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091376+0000", 2024-09-14T09:09:12.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091376+0000", 2024-09-14T09:09:12.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091377+0000", 2024-09-14T09:09:12.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1199999999999999e-07 2024-09-14T09:09:12.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091377+0000", 2024-09-14T09:09:12.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9599999999999998e-07 2024-09-14T09:09:12.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091380+0000", 2024-09-14T09:09:12.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.897e-06 2024-09-14T09:09:12.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091383+0000", 2024-09-14T09:09:12.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0359999999999998e-06 2024-09-14T09:09:12.458 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.458 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.458 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.459 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10408 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.459 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091854+0000", 2024-09-14T09:09:12.459 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00098273499999999999, 2024-09-14T09:09:12.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037752200000000001, 2024-09-14T09:09:12.459 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.459 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.459 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.459 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.459 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.459 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.459 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10408 2024-09-14T09:09:12.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.459 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091854+0000", 2024-09-14T09:09:12.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091854+0000", 2024-09-14T09:09:12.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091854+0000", 2024-09-14T09:09:12.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.01e-07 2024-09-14T09:09:12.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091855+0000", 2024-09-14T09:09:12.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9900000000000009e-07 2024-09-14T09:09:12.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091858+0000", 2024-09-14T09:09:12.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.852e-06 2024-09-14T09:09:12.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091861+0000", 2024-09-14T09:09:12.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4669999999999998e-06 2024-09-14T09:09:12.462 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.462 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.462 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.462 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10130 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.462 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093342+0000", 2024-09-14T09:09:12.462 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.999495, 2024-09-14T09:09:12.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002327722, 2024-09-14T09:09:12.462 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.462 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.462 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.462 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.462 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.463 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.463 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10130 2024-09-14T09:09:12.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.463 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093342+0000", 2024-09-14T09:09:12.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093342+0000", 2024-09-14T09:09:12.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093342+0000", 2024-09-14T09:09:12.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7199999999999999e-07 2024-09-14T09:09:12.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093344+0000", 2024-09-14T09:09:12.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.906e-06 2024-09-14T09:09:12.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093350+0000", 2024-09-14T09:09:12.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6300000000000003e-06 2024-09-14T09:09:12.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093355+0000", 2024-09-14T09:09:12.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0849999999999996e-06 2024-09-14T09:09:12.465 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.465 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.465 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.465 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10299 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.465 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090937+0000", 2024-09-14T09:09:12.465 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0018994859999999999, 2024-09-14T09:09:12.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0047575300000000003, 2024-09-14T09:09:12.466 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.466 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.466 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.466 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.466 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.466 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.466 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10299 2024-09-14T09:09:12.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.466 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090937+0000", 2024-09-14T09:09:12.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090937+0000", 2024-09-14T09:09:12.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090938+0000", 2024-09-14T09:09:12.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6600000000000002e-07 2024-09-14T09:09:12.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090939+0000", 2024-09-14T09:09:12.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.249e-06 2024-09-14T09:09:12.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090942+0000", 2024-09-14T09:09:12.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4419999999999998e-06 2024-09-14T09:09:12.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090945+0000", 2024-09-14T09:09:12.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6029999999999999e-06 2024-09-14T09:09:12.468 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.468 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.468 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.469 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10358 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.469 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091386+0000", 2024-09-14T09:09:12.469 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001450139, 2024-09-14T09:09:12.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043330840000000001, 2024-09-14T09:09:12.469 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.469 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.469 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.469 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.469 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.469 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.469 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10358 2024-09-14T09:09:12.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.469 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091386+0000", 2024-09-14T09:09:12.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091386+0000", 2024-09-14T09:09:12.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091387+0000", 2024-09-14T09:09:12.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.89e-07 2024-09-14T09:09:12.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091388+0000", 2024-09-14T09:09:12.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.018e-06 2024-09-14T09:09:12.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091391+0000", 2024-09-14T09:09:12.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5659999999999998e-06 2024-09-14T09:09:12.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091394+0000", 2024-09-14T09:09:12.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4099999999999998e-06 2024-09-14T09:09:12.471 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.471 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.471 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.472 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10409 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.472 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091864+0000", 2024-09-14T09:09:12.472 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00097298999999999997, 2024-09-14T09:09:12.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003883605, 2024-09-14T09:09:12.472 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.472 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.472 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.472 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.472 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.472 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.472 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10409 2024-09-14T09:09:12.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.472 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091864+0000", 2024-09-14T09:09:12.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091864+0000", 2024-09-14T09:09:12.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091870+0000", 2024-09-14T09:09:12.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4930000000000003e-06 2024-09-14T09:09:12.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091871+0000", 2024-09-14T09:09:12.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.119e-06 2024-09-14T09:09:12.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091874+0000", 2024-09-14T09:09:12.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0630000000000002e-06 2024-09-14T09:09:12.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091877+0000", 2024-09-14T09:09:12.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5689999999999999e-06 2024-09-14T09:09:12.475 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.475 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.475 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.475 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10132 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.475 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093361+0000", 2024-09-14T09:09:12.475 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9994755, 2024-09-14T09:09:12.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024124960000000001, 2024-09-14T09:09:12.475 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.475 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.475 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.476 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.476 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10132 2024-09-14T09:09:12.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.476 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093361+0000", 2024-09-14T09:09:12.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093361+0000", 2024-09-14T09:09:12.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093362+0000", 2024-09-14T09:09:12.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6399999999999998e-07 2024-09-14T09:09:12.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093364+0000", 2024-09-14T09:09:12.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.057e-06 2024-09-14T09:09:12.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093370+0000", 2024-09-14T09:09:12.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5390000000000004e-06 2024-09-14T09:09:12.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093374+0000", 2024-09-14T09:09:12.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0679999999999998e-06 2024-09-14T09:09:12.478 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.478 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.478 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.478 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10301 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.478 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.090948+0000", 2024-09-14T09:09:12.478 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0018883610000000001, 2024-09-14T09:09:12.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00484974, 2024-09-14T09:09:12.478 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.478 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.478 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.478 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.479 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.479 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.479 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10301 2024-09-14T09:09:12.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.479 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090948+0000", 2024-09-14T09:09:12.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090948+0000", 2024-09-14T09:09:12.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090949+0000", 2024-09-14T09:09:12.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7800000000000002e-07 2024-09-14T09:09:12.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090950+0000", 2024-09-14T09:09:12.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8700000000000004e-07 2024-09-14T09:09:12.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090953+0000", 2024-09-14T09:09:12.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.67e-06 2024-09-14T09:09:12.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.090956+0000", 2024-09-14T09:09:12.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8609999999999998e-06 2024-09-14T09:09:12.481 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.481 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.481 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.481 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10360 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.481 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091397+0000", 2024-09-14T09:09:12.481 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0014398270000000001, 2024-09-14T09:09:12.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044261209999999999, 2024-09-14T09:09:12.481 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.481 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.481 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.482 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.482 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10360 2024-09-14T09:09:12.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.482 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091397+0000", 2024-09-14T09:09:12.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091397+0000", 2024-09-14T09:09:12.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091397+0000", 2024-09-14T09:09:12.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2600000000000001e-07 2024-09-14T09:09:12.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091398+0000", 2024-09-14T09:09:12.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7399999999999991e-07 2024-09-14T09:09:12.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091401+0000", 2024-09-14T09:09:12.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8059999999999999e-06 2024-09-14T09:09:12.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091403+0000", 2024-09-14T09:09:12.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.57e-06 2024-09-14T09:09:12.484 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.484 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.484 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.484 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10410 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.484 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091908+0000", 2024-09-14T09:09:12.484 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00092871900000000005, 2024-09-14T09:09:12.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039382200000000001, 2024-09-14T09:09:12.484 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.485 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.485 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.485 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.485 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.485 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.485 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10410 2024-09-14T09:09:12.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.485 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091908+0000", 2024-09-14T09:09:12.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091908+0000", 2024-09-14T09:09:12.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091908+0000", 2024-09-14T09:09:12.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8299999999999997e-07 2024-09-14T09:09:12.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091910+0000", 2024-09-14T09:09:12.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3069999999999999e-06 2024-09-14T09:09:12.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091913+0000", 2024-09-14T09:09:12.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1420000000000002e-06 2024-09-14T09:09:12.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091915+0000", 2024-09-14T09:09:12.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6199999999999999e-06 2024-09-14T09:09:12.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.487 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.487 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10134 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.487 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093386+0000", 2024-09-14T09:09:12.487 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9994502, 2024-09-14T09:09:12.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024852429999999998, 2024-09-14T09:09:12.488 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.488 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.488 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.488 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.488 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.488 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.488 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10134 2024-09-14T09:09:12.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.488 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093386+0000", 2024-09-14T09:09:12.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093386+0000", 2024-09-14T09:09:12.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093387+0000", 2024-09-14T09:09:12.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2899999999999999e-07 2024-09-14T09:09:12.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093389+0000", 2024-09-14T09:09:12.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.21e-06 2024-09-14T09:09:12.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093398+0000", 2024-09-14T09:09:12.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8119999999999997e-06 2024-09-14T09:09:12.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093403+0000", 2024-09-14T09:09:12.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8459999999999999e-06 2024-09-14T09:09:12.490 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.490 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.490 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.490 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10362 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.490 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091417+0000", 2024-09-14T09:09:12.490 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0014198220000000001, 2024-09-14T09:09:12.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044792349999999998, 2024-09-14T09:09:12.491 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.491 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.491 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.491 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.491 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.491 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.491 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10362 2024-09-14T09:09:12.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.491 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091417+0000", 2024-09-14T09:09:12.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091417+0000", 2024-09-14T09:09:12.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091417+0000", 2024-09-14T09:09:12.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6600000000000002e-07 2024-09-14T09:09:12.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091418+0000", 2024-09-14T09:09:12.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.246e-06 2024-09-14T09:09:12.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091422+0000", 2024-09-14T09:09:12.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0819999999999999e-06 2024-09-14T09:09:12.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091424+0000", 2024-09-14T09:09:12.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6869999999999999e-06 2024-09-14T09:09:12.493 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.493 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.493 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.493 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10411 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.493 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091919+0000", 2024-09-14T09:09:12.493 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00091773400000000002, 2024-09-14T09:09:12.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040021249999999996, 2024-09-14T09:09:12.494 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.494 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.494 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.494 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.494 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.494 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.494 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10411 2024-09-14T09:09:12.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.494 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091919+0000", 2024-09-14T09:09:12.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091919+0000", 2024-09-14T09:09:12.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091919+0000", 2024-09-14T09:09:12.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5499999999999999e-07 2024-09-14T09:09:12.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091920+0000", 2024-09-14T09:09:12.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.02e-06 2024-09-14T09:09:12.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091923+0000", 2024-09-14T09:09:12.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7800000000000001e-06 2024-09-14T09:09:12.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091925+0000", 2024-09-14T09:09:12.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.514e-06 2024-09-14T09:09:12.496 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.496 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.496 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.497 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10229 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.497 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093410+0000", 2024-09-14T09:09:12.497 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9994268, 2024-09-14T09:09:12.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025357600000000002, 2024-09-14T09:09:12.497 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.497 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.497 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.497 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.497 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.497 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.497 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10229 2024-09-14T09:09:12.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.498 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093410+0000", 2024-09-14T09:09:12.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093410+0000", 2024-09-14T09:09:12.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093410+0000", 2024-09-14T09:09:12.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4000000000000002e-07 2024-09-14T09:09:12.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093412+0000", 2024-09-14T09:09:12.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1950000000000002e-06 2024-09-14T09:09:12.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093418+0000", 2024-09-14T09:09:12.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0209999999999996e-06 2024-09-14T09:09:12.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093430+0000", 2024-09-14T09:09:12.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1654000000000001e-05 2024-09-14T09:09:12.500 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.500 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.500 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.500 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10364 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.500 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091428+0000", 2024-09-14T09:09:12.500 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0014090210000000001, 2024-09-14T09:09:12.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045441509999999997, 2024-09-14T09:09:12.500 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.500 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.500 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.501 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.501 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.501 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.501 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10364 2024-09-14T09:09:12.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.501 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091428+0000", 2024-09-14T09:09:12.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091428+0000", 2024-09-14T09:09:12.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091428+0000", 2024-09-14T09:09:12.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2024-09-14T09:09:12.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091431+0000", 2024-09-14T09:09:12.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.18e-06 2024-09-14T09:09:12.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091434+0000", 2024-09-14T09:09:12.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0879999999999999e-06 2024-09-14T09:09:12.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091437+0000", 2024-09-14T09:09:12.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5519999999999999e-06 2024-09-14T09:09:12.503 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.503 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.503 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.504 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10412 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.504 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091929+0000", 2024-09-14T09:09:12.504 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00090728800000000002, 2024-09-14T09:09:12.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040661719999999998, 2024-09-14T09:09:12.504 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.504 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.504 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.504 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.504 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.504 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.504 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10412 2024-09-14T09:09:12.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.504 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091929+0000", 2024-09-14T09:09:12.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091929+0000", 2024-09-14T09:09:12.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091929+0000", 2024-09-14T09:09:12.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1e-07 2024-09-14T09:09:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091930+0000", 2024-09-14T09:09:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012e-06 2024-09-14T09:09:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091933+0000", 2024-09-14T09:09:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.83e-06 2024-09-14T09:09:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091936+0000", 2024-09-14T09:09:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.695e-06 2024-09-14T09:09:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10231 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093446+0000", 2024-09-14T09:09:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9993911, 2024-09-14T09:09:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025734070000000002, 2024-09-14T09:09:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10231 2024-09-14T09:09:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093446+0000", 2024-09-14T09:09:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093446+0000", 2024-09-14T09:09:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093446+0000", 2024-09-14T09:09:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4700000000000001e-07 2024-09-14T09:09:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093448+0000", 2024-09-14T09:09:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1490000000000001e-06 2024-09-14T09:09:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093455+0000", 2024-09-14T09:09:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6150000000000002e-06 2024-09-14T09:09:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093460+0000", 2024-09-14T09:09:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9660000000000004e-06 2024-09-14T09:09:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10366 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091440+0000", 2024-09-14T09:09:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0013967020000000001, 2024-09-14T09:09:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046045340000000004, 2024-09-14T09:09:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10366 2024-09-14T09:09:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091440+0000", 2024-09-14T09:09:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091440+0000", 2024-09-14T09:09:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091440+0000", 2024-09-14T09:09:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4200000000000002e-07 2024-09-14T09:09:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091441+0000", 2024-09-14T09:09:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8100000000000001e-07 2024-09-14T09:09:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091444+0000", 2024-09-14T09:09:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8590000000000001e-06 2024-09-14T09:09:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091447+0000", 2024-09-14T09:09:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7e-06 2024-09-14T09:09:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10413 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091939+0000", 2024-09-14T09:09:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00089755599999999998, 2024-09-14T09:09:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0041284909999999998, 2024-09-14T09:09:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10413 2024-09-14T09:09:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091939+0000", 2024-09-14T09:09:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091939+0000", 2024-09-14T09:09:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091939+0000", 2024-09-14T09:09:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4900000000000001e-07 2024-09-14T09:09:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091940+0000", 2024-09-14T09:09:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.003e-06 2024-09-14T09:09:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091944+0000", 2024-09-14T09:09:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2380000000000002e-06 2024-09-14T09:09:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091946+0000", 2024-09-14T09:09:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.48e-06 2024-09-14T09:09:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10233 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093474+0000", 2024-09-14T09:09:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9993629, 2024-09-14T09:09:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026186920000000002, 2024-09-14T09:09:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.518 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.518 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.518 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.518 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10233 2024-09-14T09:09:12.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.518 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093474+0000", 2024-09-14T09:09:12.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093474+0000", 2024-09-14T09:09:12.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093474+0000", 2024-09-14T09:09:12.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0399999999999996e-07 2024-09-14T09:09:12.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093476+0000", 2024-09-14T09:09:12.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.764e-06 2024-09-14T09:09:12.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093483+0000", 2024-09-14T09:09:12.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4070000000000004e-06 2024-09-14T09:09:12.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093488+0000", 2024-09-14T09:09:12.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8760000000000004e-06 2024-09-14T09:09:12.520 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.520 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.520 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.520 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10368 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.520 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091458+0000", 2024-09-14T09:09:12.520 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0013787719999999999, 2024-09-14T09:09:12.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046584590000000002, 2024-09-14T09:09:12.520 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.520 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.521 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.521 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.521 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.521 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.521 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10368 2024-09-14T09:09:12.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.521 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091458+0000", 2024-09-14T09:09:12.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091458+0000", 2024-09-14T09:09:12.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091458+0000", 2024-09-14T09:09:12.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5499999999999998e-07 2024-09-14T09:09:12.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091459+0000", 2024-09-14T09:09:12.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.136e-06 2024-09-14T09:09:12.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091463+0000", 2024-09-14T09:09:12.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3409999999999999e-06 2024-09-14T09:09:12.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091465+0000", 2024-09-14T09:09:12.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5830000000000001e-06 2024-09-14T09:09:12.523 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.523 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.523 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.523 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10077 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.524 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.092393+0000", 2024-09-14T09:09:12.524 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00044396700000000003, 2024-09-14T09:09:12.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037480170000000002, 2024-09-14T09:09:12.524 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.524 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.524 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.524 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.524 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.524 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.524 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10077 2024-09-14T09:09:12.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.524 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092393+0000", 2024-09-14T09:09:12.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092393+0000", 2024-09-14T09:09:12.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092394+0000", 2024-09-14T09:09:12.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5099999999999998e-07 2024-09-14T09:09:12.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092397+0000", 2024-09-14T09:09:12.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3809999999999999e-06 2024-09-14T09:09:12.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092414+0000", 2024-09-14T09:09:12.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.698e-05 2024-09-14T09:09:12.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092420+0000", 2024-09-14T09:09:12.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1399999999999997e-06 2024-09-14T09:09:12.526 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.526 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.526 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.527 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10235 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.527 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093502+0000", 2024-09-14T09:09:12.527 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9993343, 2024-09-14T09:09:12.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026617390000000002, 2024-09-14T09:09:12.527 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.527 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.527 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.527 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10235 2024-09-14T09:09:12.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.527 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093502+0000", 2024-09-14T09:09:12.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093502+0000", 2024-09-14T09:09:12.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093503+0000", 2024-09-14T09:09:12.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7599999999999997e-07 2024-09-14T09:09:12.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093504+0000", 2024-09-14T09:09:12.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6360000000000001e-06 2024-09-14T09:09:12.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093511+0000", 2024-09-14T09:09:12.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8469999999999998e-06 2024-09-14T09:09:12.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093516+0000", 2024-09-14T09:09:12.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7389999999999999e-06 2024-09-14T09:09:12.529 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.529 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.530 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.530 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10370 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.530 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091499+0000", 2024-09-14T09:09:12.530 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001337642, 2024-09-14T09:09:12.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046904750000000004, 2024-09-14T09:09:12.530 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.530 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.530 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.530 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.530 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.530 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.530 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10370 2024-09-14T09:09:12.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.531 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091499+0000", 2024-09-14T09:09:12.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091499+0000", 2024-09-14T09:09:12.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091499+0000", 2024-09-14T09:09:12.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.84e-07 2024-09-14T09:09:12.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091501+0000", 2024-09-14T09:09:12.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5039999999999999e-06 2024-09-14T09:09:12.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091504+0000", 2024-09-14T09:09:12.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0469999999999998e-06 2024-09-14T09:09:12.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091506+0000", 2024-09-14T09:09:12.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5950000000000001e-06 2024-09-14T09:09:12.533 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.533 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.533 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.533 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10079 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.533 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.092455+0000", 2024-09-14T09:09:12.533 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00038118800000000002, 2024-09-14T09:09:12.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037570360000000001, 2024-09-14T09:09:12.533 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.533 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.533 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.533 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.534 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.534 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.534 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10079 2024-09-14T09:09:12.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.534 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092455+0000", 2024-09-14T09:09:12.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092455+0000", 2024-09-14T09:09:12.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092464+0000", 2024-09-14T09:09:12.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4149999999999999e-06 2024-09-14T09:09:12.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092467+0000", 2024-09-14T09:09:12.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.14e-06 2024-09-14T09:09:12.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092475+0000", 2024-09-14T09:09:12.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5299999999999996e-06 2024-09-14T09:09:12.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092480+0000", 2024-09-14T09:09:12.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.921e-06 2024-09-14T09:09:12.536 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.536 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.536 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.536 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10237 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.536 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093530+0000", 2024-09-14T09:09:12.536 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9993072, 2024-09-14T09:09:12.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027095690000000002, 2024-09-14T09:09:12.537 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.537 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.537 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.537 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.537 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.537 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.537 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10237 2024-09-14T09:09:12.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.537 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093530+0000", 2024-09-14T09:09:12.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093530+0000", 2024-09-14T09:09:12.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093530+0000", 2024-09-14T09:09:12.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4099999999999999e-07 2024-09-14T09:09:12.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093532+0000", 2024-09-14T09:09:12.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.649e-06 2024-09-14T09:09:12.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093538+0000", 2024-09-14T09:09:12.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9050000000000002e-06 2024-09-14T09:09:12.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093542+0000", 2024-09-14T09:09:12.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6609999999999999e-06 2024-09-14T09:09:12.539 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10372 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091511+0000", 2024-09-14T09:09:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0013255910000000001, 2024-09-14T09:09:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0047521459999999996, 2024-09-14T09:09:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.541 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.541 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10372 2024-09-14T09:09:12.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.541 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091511+0000", 2024-09-14T09:09:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091511+0000", 2024-09-14T09:09:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091511+0000", 2024-09-14T09:09:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4799999999999999e-07 2024-09-14T09:09:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091512+0000", 2024-09-14T09:09:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5000000000000001e-07 2024-09-14T09:09:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091515+0000", 2024-09-14T09:09:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.033e-06 2024-09-14T09:09:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091518+0000", 2024-09-14T09:09:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.48e-06 2024-09-14T09:09:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10081 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.092504+0000", 2024-09-14T09:09:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00033288799999999999, 2024-09-14T09:09:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037843849999999999, 2024-09-14T09:09:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10081 2024-09-14T09:09:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092504+0000", 2024-09-14T09:09:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092504+0000", 2024-09-14T09:09:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092504+0000", 2024-09-14T09:09:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3600000000000004e-07 2024-09-14T09:09:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092507+0000", 2024-09-14T09:09:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3640000000000002e-06 2024-09-14T09:09:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092527+0000", 2024-09-14T09:09:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.056e-05 2024-09-14T09:09:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092532+0000", 2024-09-14T09:09:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1340000000000003e-06 2024-09-14T09:09:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10239 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093557+0000", 2024-09-14T09:09:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.99928, 2024-09-14T09:09:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027552789999999998, 2024-09-14T09:09:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10239 2024-09-14T09:09:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093557+0000", 2024-09-14T09:09:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093557+0000", 2024-09-14T09:09:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093557+0000", 2024-09-14T09:09:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1e-07 2024-09-14T09:09:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093559+0000", 2024-09-14T09:09:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6759999999999999e-06 2024-09-14T09:09:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093564+0000", 2024-09-14T09:09:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5509999999999999e-06 2024-09-14T09:09:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093569+0000", 2024-09-14T09:09:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7999999999999998e-06 2024-09-14T09:09:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10374 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091521+0000", 2024-09-14T09:09:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0013157220000000001, 2024-09-14T09:09:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049097589999999997, 2024-09-14T09:09:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10374 2024-09-14T09:09:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091521+0000", 2024-09-14T09:09:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091521+0000", 2024-09-14T09:09:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091521+0000", 2024-09-14T09:09:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:09:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091522+0000", 2024-09-14T09:09:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6099999999999999e-07 2024-09-14T09:09:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091525+0000", 2024-09-14T09:09:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9340000000000002e-06 2024-09-14T09:09:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091527+0000", 2024-09-14T09:09:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5390000000000002e-06 2024-09-14T09:09:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10083 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.092582+0000", 2024-09-14T09:09:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00025496900000000002, 2024-09-14T09:09:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038733579999999999, 2024-09-14T09:09:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10083 2024-09-14T09:09:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092582+0000", 2024-09-14T09:09:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092582+0000", 2024-09-14T09:09:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092582+0000", 2024-09-14T09:09:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5199999999999996e-07 2024-09-14T09:09:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092585+0000", 2024-09-14T09:09:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5409999999999999e-06 2024-09-14T09:09:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092602+0000", 2024-09-14T09:09:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7289e-05 2024-09-14T09:09:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092607+0000", 2024-09-14T09:09:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.412e-06 2024-09-14T09:09:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10241 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093582+0000", 2024-09-14T09:09:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9992542, 2024-09-14T09:09:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028978010000000002, 2024-09-14T09:09:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10241 2024-09-14T09:09:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093582+0000", 2024-09-14T09:09:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093582+0000", 2024-09-14T09:09:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093583+0000", 2024-09-14T09:09:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8100000000000003e-07 2024-09-14T09:09:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093585+0000", 2024-09-14T09:09:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.812e-06 2024-09-14T09:09:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093590+0000", 2024-09-14T09:09:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4890000000000003e-06 2024-09-14T09:09:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093594+0000", 2024-09-14T09:09:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8800000000000001e-06 2024-09-14T09:09:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10376 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091542+0000", 2024-09-14T09:09:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0012942540000000001, 2024-09-14T09:09:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049617359999999996, 2024-09-14T09:09:12.567 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.567 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.567 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.567 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.567 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.567 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.567 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10376 2024-09-14T09:09:12.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.567 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091542+0000", 2024-09-14T09:09:12.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091542+0000", 2024-09-14T09:09:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091543+0000", 2024-09-14T09:09:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7199999999999999e-07 2024-09-14T09:09:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091544+0000", 2024-09-14T09:09:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.26e-06 2024-09-14T09:09:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091547+0000", 2024-09-14T09:09:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3799999999999998e-06 2024-09-14T09:09:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091550+0000", 2024-09-14T09:09:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6510000000000001e-06 2024-09-14T09:09:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10085 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.092624+0000", 2024-09-14T09:09:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00021258599999999999, 2024-09-14T09:09:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039031420000000001, 2024-09-14T09:09:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10085 2024-09-14T09:09:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092624+0000", 2024-09-14T09:09:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092624+0000", 2024-09-14T09:09:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092625+0000", 2024-09-14T09:09:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1099999999999995e-07 2024-09-14T09:09:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092634+0000", 2024-09-14T09:09:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6579999999999997e-06 2024-09-14T09:09:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092641+0000", 2024-09-14T09:09:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6669999999999999e-06 2024-09-14T09:09:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092646+0000", 2024-09-14T09:09:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4519999999999996e-06 2024-09-14T09:09:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10243 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093623+0000", 2024-09-14T09:09:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9992137, 2024-09-14T09:09:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029296529999999999, 2024-09-14T09:09:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10243 2024-09-14T09:09:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093623+0000", 2024-09-14T09:09:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093623+0000", 2024-09-14T09:09:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093624+0000", 2024-09-14T09:09:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6899999999999997e-07 2024-09-14T09:09:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093625+0000", 2024-09-14T09:09:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9400000000000001e-06 2024-09-14T09:09:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093632+0000", 2024-09-14T09:09:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.139e-06 2024-09-14T09:09:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093636+0000", 2024-09-14T09:09:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3309999999999997e-06 2024-09-14T09:09:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10378 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.091553+0000", 2024-09-14T09:09:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001283188, 2024-09-14T09:09:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050232150000000001, 2024-09-14T09:09:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10378 2024-09-14T09:09:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091553+0000", 2024-09-14T09:09:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091553+0000", 2024-09-14T09:09:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091554+0000", 2024-09-14T09:09:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6699999999999999e-07 2024-09-14T09:09:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091555+0000", 2024-09-14T09:09:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.78e-07 2024-09-14T09:09:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091558+0000", 2024-09-14T09:09:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.58e-06 2024-09-14T09:09:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.091561+0000", 2024-09-14T09:09:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5050000000000002e-06 2024-09-14T09:09:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10087 3.17 3.f2109257 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.092659+0000", 2024-09-14T09:09:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00017733899999999999, 2024-09-14T09:09:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003942002, 2024-09-14T09:09:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10087 2024-09-14T09:09:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092659+0000", 2024-09-14T09:09:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092659+0000", 2024-09-14T09:09:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092660+0000", 2024-09-14T09:09:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9200000000000001e-07 2024-09-14T09:09:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092662+0000", 2024-09-14T09:09:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2560000000000001e-06 2024-09-14T09:09:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092668+0000", 2024-09-14T09:09:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.755e-06 2024-09-14T09:09:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.092678+0000", 2024-09-14T09:09:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9960000000000005e-06 2024-09-14T09:09:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:10245 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.093654+0000", 2024-09-14T09:09:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9991827, 2024-09-14T09:09:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029709350000000001, 2024-09-14T09:09:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 10245 2024-09-14T09:09:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093654+0000", 2024-09-14T09:09:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093654+0000", 2024-09-14T09:09:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093654+0000", 2024-09-14T09:09:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6800000000000002e-07 2024-09-14T09:09:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093656+0000", 2024-09-14T09:09:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4610000000000001e-06 2024-09-14T09:09:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093661+0000", 2024-09-14T09:09:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.011e-06 2024-09-14T09:09:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.093664+0000", 2024-09-14T09:09:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.794e-06 2024-09-14T09:09:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-14T09:09:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 145 2024-09-14T09:09:12.587 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:12.588 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:12.590+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:12.589 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:12.689 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:12.691+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:12.714 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:12.714 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:12.714 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:12.714 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:12.714 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:12.723 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:09:12.808 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:12.810+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:12.891 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:12.893+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:12.907 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:12.907 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:12.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:12.907 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:12.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.908 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:228 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 360448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:12.908 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:12.908 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.111002063999997, 2024-09-14T09:09:12.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99234476999999999, 2024-09-14T09:09:12.908 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.908 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.908 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:12.908 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.908 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:12.908 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:12.908 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 228 2024-09-14T09:09:12.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.909 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:12.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:12.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796906+0000", 2024-09-14T09:09:12.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9399999999999995e-07 2024-09-14T09:09:12.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796917+0000", 2024-09-14T09:09:12.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0801e-05 2024-09-14T09:09:12.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796924+0000", 2024-09-14T09:09:12.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7750000000000004e-06 2024-09-14T09:09:12.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:12.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9972000000000001e-05 2024-09-14T09:09:12.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798671+0000", 2024-09-14T09:09:12.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017271330000000001 2024-09-14T09:09:12.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:12.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798675+0000", 2024-09-14T09:09:12.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.194e-06 2024-09-14T09:09:12.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789003+0000", 2024-09-14T09:09:12.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99032768400000004 2024-09-14T09:09:12.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:12.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789115+0000", 2024-09-14T09:09:12.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112236 2024-09-14T09:09:12.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:12.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789250+0000", 2024-09-14T09:09:12.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013548100000000001 2024-09-14T09:09:12.913 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.913 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.913 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.913 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:229 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 819200~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:12.913 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:12.913 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.110949841, 2024-09-14T09:09:12.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99287024599999996, 2024-09-14T09:09:12.913 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.913 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.914 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:12.914 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.914 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:12.914 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:12.914 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 229 2024-09-14T09:09:12.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.914 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:12.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:12.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:12.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999999e-07 2024-09-14T09:09:12.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796962+0000", 2024-09-14T09:09:12.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1479999999999999e-06 2024-09-14T09:09:12.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796967+0000", 2024-09-14T09:09:12.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1499999999999998e-06 2024-09-14T09:09:12.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:09:12.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-06 2024-09-14T09:09:12.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798688+0000", 2024-09-14T09:09:12.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017172660000000001 2024-09-14T09:09:12.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:12.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798691+0000", 2024-09-14T09:09:12.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:09:12.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789599+0000", 2024-09-14T09:09:12.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99090839399999997 2024-09-14T09:09:12.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:12.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789716+0000", 2024-09-14T09:09:12.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116474 2024-09-14T09:09:12.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:12.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789828+0000", 2024-09-14T09:09:12.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112293 2024-09-14T09:09:12.918 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.918 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.918 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.918 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:230 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1277952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:12.919 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:12.919 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.110929192999997, 2024-09-14T09:09:12.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99307501600000003, 2024-09-14T09:09:12.919 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.919 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.919 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:12.919 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.919 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:12.919 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:12.919 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 230 2024-09-14T09:09:12.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.919 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:12.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:12.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796979+0000", 2024-09-14T09:09:12.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.34e-07 2024-09-14T09:09:12.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796980+0000", 2024-09-14T09:09:12.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.53e-06 2024-09-14T09:09:12.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796986+0000", 2024-09-14T09:09:12.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9989999999999997e-06 2024-09-14T09:09:12.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796989+0000", 2024-09-14T09:09:12.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0340000000000001e-06 2024-09-14T09:09:12.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798702+0000", 2024-09-14T09:09:12.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001712756 2024-09-14T09:09:12.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:12.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798705+0000", 2024-09-14T09:09:12.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7750000000000001e-06 2024-09-14T09:09:12.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789870+0000", 2024-09-14T09:09:12.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991165026 2024-09-14T09:09:12.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:12.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789955+0000", 2024-09-14T09:09:12.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4839999999999994e-05 2024-09-14T09:09:12.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:12.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790053+0000", 2024-09-14T09:09:12.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8721999999999994e-05 2024-09-14T09:09:12.923 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.923 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.923 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.924 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:231 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:12.924 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:12.924 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.110913865000001, 2024-09-14T09:09:12.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99319130300000003, 2024-09-14T09:09:12.924 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.924 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.924 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:12.924 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.924 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:12.924 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:12.924 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 231 2024-09-14T09:09:12.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.925 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:12.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:12.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:12.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2024-09-14T09:09:12.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796995+0000", 2024-09-14T09:09:12.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2500000000000001e-06 2024-09-14T09:09:12.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796998+0000", 2024-09-14T09:09:12.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3230000000000002e-06 2024-09-14T09:09:12.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797001+0000", 2024-09-14T09:09:12.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7099999999999999e-06 2024-09-14T09:09:12.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798718+0000", 2024-09-14T09:09:12.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017168070000000001 2024-09-14T09:09:12.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:12.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798721+0000", 2024-09-14T09:09:12.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.853e-06 2024-09-14T09:09:12.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790077+0000", 2024-09-14T09:09:12.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991356393 2024-09-14T09:09:12.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:12.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790129+0000", 2024-09-14T09:09:12.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2240999999999997e-05 2024-09-14T09:09:12.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:12.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790185+0000", 2024-09-14T09:09:12.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5515e-05 2024-09-14T09:09:12.929 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.929 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.929 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.929 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:232 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2195456~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:12.929 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:12.929 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.110903209, 2024-09-14T09:09:12.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99329117899999997, 2024-09-14T09:09:12.929 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.929 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.930 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:12.930 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.930 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:12.930 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:12.930 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 232 2024-09-14T09:09:12.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.930 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:12.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:12.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797005+0000", 2024-09-14T09:09:12.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2024-09-14T09:09:12.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797006+0000", 2024-09-14T09:09:12.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3200000000000001e-06 2024-09-14T09:09:12.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797009+0000", 2024-09-14T09:09:12.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4680000000000001e-06 2024-09-14T09:09:12.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797012+0000", 2024-09-14T09:09:12.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4770000000000002e-06 2024-09-14T09:09:12.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798743+0000", 2024-09-14T09:09:12.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017312 2024-09-14T09:09:12.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:12.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798747+0000", 2024-09-14T09:09:12.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.484e-06 2024-09-14T09:09:12.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790201+0000", 2024-09-14T09:09:12.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99145419499999998 2024-09-14T09:09:12.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:12.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790241+0000", 2024-09-14T09:09:12.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0587999999999998e-05 2024-09-14T09:09:12.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:12.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790296+0000", 2024-09-14T09:09:12.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4212000000000002e-05 2024-09-14T09:09:12.934 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.934 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.934 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.934 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:233 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2654208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:12.935 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:12.935 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.110892585999999, 2024-09-14T09:09:12.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99337220100000001, 2024-09-14T09:09:12.935 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.935 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.935 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:12.935 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.935 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:12.935 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:12.935 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 233 2024-09-14T09:09:12.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.935 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:12.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:12.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:12.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:09:12.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:09:12.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.269e-06 2024-09-14T09:09:12.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797019+0000", 2024-09-14T09:09:12.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9519999999999999e-06 2024-09-14T09:09:12.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797022+0000", 2024-09-14T09:09:12.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6079999999999998e-06 2024-09-14T09:09:12.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798759+0000", 2024-09-14T09:09:12.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001737342 2024-09-14T09:09:12.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:12.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798762+0000", 2024-09-14T09:09:12.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:09:12.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790310+0000", 2024-09-14T09:09:12.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99154738799999997 2024-09-14T09:09:12.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:12.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790349+0000", 2024-09-14T09:09:12.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9573000000000002e-05 2024-09-14T09:09:12.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:12.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790387+0000", 2024-09-14T09:09:12.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7985999999999998e-05 2024-09-14T09:09:12.939 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.939 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.940 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.940 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:234 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3112960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:12.940 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:12.940 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.110882541000002, 2024-09-14T09:09:12.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99345674500000003, 2024-09-14T09:09:12.940 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.940 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.940 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:12.940 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.940 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:12.940 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:12.941 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 234 2024-09-14T09:09:12.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.941 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:12.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:12.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:12.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0100000000000001e-07 2024-09-14T09:09:12.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:12.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0699999999999999e-06 2024-09-14T09:09:12.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:09:12.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.886e-06 2024-09-14T09:09:12.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797032+0000", 2024-09-14T09:09:12.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7149999999999998e-06 2024-09-14T09:09:12.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798778+0000", 2024-09-14T09:09:12.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017460329999999999 2024-09-14T09:09:12.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:12.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798783+0000", 2024-09-14T09:09:12.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0760000000000002e-06 2024-09-14T09:09:12.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790408+0000", 2024-09-14T09:09:12.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99162473299999998 2024-09-14T09:09:12.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:12.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790446+0000", 2024-09-14T09:09:12.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8389000000000001e-05 2024-09-14T09:09:12.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:12.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790482+0000", 2024-09-14T09:09:12.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5642000000000002e-05 2024-09-14T09:09:12.945 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.945 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.945 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.945 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:235 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3571712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:12.945 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:12.945 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.110872643, 2024-09-14T09:09:12.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993539477, 2024-09-14T09:09:12.945 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.946 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.946 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:12.946 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.946 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:12.946 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:12.946 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 235 2024-09-14T09:09:12.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.946 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:12.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:12.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:12.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9999999999999999e-07 2024-09-14T09:09:12.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797036+0000", 2024-09-14T09:09:12.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.051e-06 2024-09-14T09:09:12.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797039+0000", 2024-09-14T09:09:12.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:09:12.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797042+0000", 2024-09-14T09:09:12.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5280000000000002e-06 2024-09-14T09:09:12.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798809+0000", 2024-09-14T09:09:12.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001767394 2024-09-14T09:09:12.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:12.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798815+0000", 2024-09-14T09:09:12.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0859999999999998e-06 2024-09-14T09:09:12.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790502+0000", 2024-09-14T09:09:12.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99168652300000004 2024-09-14T09:09:12.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:12.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790539+0000", 2024-09-14T09:09:12.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7471000000000001e-05 2024-09-14T09:09:12.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:12.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790574+0000", 2024-09-14T09:09:12.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5292e-05 2024-09-14T09:09:12.950 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.950 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.950 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.950 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:236 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 4030464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:12.950 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:12.950 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.110862410000003, 2024-09-14T09:09:12.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993619743, 2024-09-14T09:09:12.951 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.951 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.951 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:12.951 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.951 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:12.951 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:12.951 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 236 2024-09-14T09:09:12.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.951 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:12.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:12.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:12.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1400000000000001e-07 2024-09-14T09:09:12.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797047+0000", 2024-09-14T09:09:12.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3400000000000001e-06 2024-09-14T09:09:12.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:09:12.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0699999999999998e-06 2024-09-14T09:09:12.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797053+0000", 2024-09-14T09:09:12.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7310000000000002e-06 2024-09-14T09:09:12.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798839+0000", 2024-09-14T09:09:12.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001786403 2024-09-14T09:09:12.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:12.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798844+0000", 2024-09-14T09:09:12.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3730000000000001e-06 2024-09-14T09:09:12.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790592+0000", 2024-09-14T09:09:12.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99174818099999995 2024-09-14T09:09:12.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:12.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790628+0000", 2024-09-14T09:09:12.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5831000000000003e-05 2024-09-14T09:09:12.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:12.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790665+0000", 2024-09-14T09:09:12.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-05 2024-09-14T09:09:12.957 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.957 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.957 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.957 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:365 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:12.957 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:12.957 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.108675382000001, 2024-09-14T09:09:12.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157278400000004, 2024-09-14T09:09:12.957 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.957 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.958 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:12.958 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.958 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:12.958 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:12.958 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 365 2024-09-14T09:09:12.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.958 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:12.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:12.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:12.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:09:12.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799233+0000", 2024-09-14T09:09:12.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.057e-06 2024-09-14T09:09:12.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799236+0000", 2024-09-14T09:09:12.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0249999999999998e-06 2024-09-14T09:09:12.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799239+0000", 2024-09-14T09:09:12.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.481e-06 2024-09-14T09:09:12.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800963+0000", 2024-09-14T09:09:12.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017240440000000001 2024-09-14T09:09:12.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:12.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800969+0000", 2024-09-14T09:09:12.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1410000000000002e-06 2024-09-14T09:09:12.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790682+0000", 2024-09-14T09:09:12.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98971330300000004 2024-09-14T09:09:12.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:12.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790753+0000", 2024-09-14T09:09:12.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0548000000000003e-05 2024-09-14T09:09:12.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:12.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790805+0000", 2024-09-14T09:09:12.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1981999999999998e-05 2024-09-14T09:09:12.962 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.962 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.962 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.962 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:366 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:12.962 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:12.962 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.108665289000001, 2024-09-14T09:09:12.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99173757299999998, 2024-09-14T09:09:12.963 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.963 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.963 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:12.963 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.963 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:12.963 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:12.963 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 366 2024-09-14T09:09:12.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.963 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:12.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:12.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:12.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-07 2024-09-14T09:09:12.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799244+0000", 2024-09-14T09:09:12.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.359e-06 2024-09-14T09:09:12.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799247+0000", 2024-09-14T09:09:12.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4929999999999998e-06 2024-09-14T09:09:12.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799250+0000", 2024-09-14T09:09:12.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:09:12.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800991+0000", 2024-09-14T09:09:12.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017412809999999999 2024-09-14T09:09:12.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:12.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800997+0000", 2024-09-14T09:09:12.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:09:12.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790824+0000", 2024-09-14T09:09:12.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98982735399999999 2024-09-14T09:09:12.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:12.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790891+0000", 2024-09-14T09:09:12.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7243999999999995e-05 2024-09-14T09:09:12.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:12.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790980+0000", 2024-09-14T09:09:12.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8608000000000003e-05 2024-09-14T09:09:12.967 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.967 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.967 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.967 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:367 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:12.967 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:12.967 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.108653916999998, 2024-09-14T09:09:12.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99188259999999995, 2024-09-14T09:09:12.968 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.968 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.968 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:12.968 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.968 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:12.968 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:12.968 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 367 2024-09-14T09:09:12.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.968 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:12.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:12.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:12.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-07 2024-09-14T09:09:12.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799255+0000", 2024-09-14T09:09:12.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.111e-06 2024-09-14T09:09:12.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799259+0000", 2024-09-14T09:09:12.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8650000000000003e-06 2024-09-14T09:09:12.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799262+0000", 2024-09-14T09:09:12.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.128e-06 2024-09-14T09:09:12.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801029+0000", 2024-09-14T09:09:12.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017668460000000001 2024-09-14T09:09:12.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:12.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801032+0000", 2024-09-14T09:09:12.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3179999999999998e-06 2024-09-14T09:09:12.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791011+0000", 2024-09-14T09:09:12.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98997920399999995 2024-09-14T09:09:12.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:12.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791077+0000", 2024-09-14T09:09:12.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5214000000000003e-05 2024-09-14T09:09:12.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:12.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791136+0000", 2024-09-14T09:09:12.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9710000000000003e-05 2024-09-14T09:09:12.972 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.972 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.972 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.972 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:368 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:12.973 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:12.973 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.108642373999999, 2024-09-14T09:09:12.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99201753800000003, 2024-09-14T09:09:12.973 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.973 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.973 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:12.973 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.973 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:12.973 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:12.973 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 368 2024-09-14T09:09:12.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.973 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:12.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:12.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:12.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4900000000000002e-07 2024-09-14T09:09:12.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799267+0000", 2024-09-14T09:09:12.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.079e-06 2024-09-14T09:09:12.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799270+0000", 2024-09-14T09:09:12.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.993e-06 2024-09-14T09:09:12.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799272+0000", 2024-09-14T09:09:12.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.695e-06 2024-09-14T09:09:12.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801043+0000", 2024-09-14T09:09:12.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001771105 2024-09-14T09:09:12.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:12.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801046+0000", 2024-09-14T09:09:12.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7999999999999999e-06 2024-09-14T09:09:12.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791150+0000", 2024-09-14T09:09:12.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99010348699999995 2024-09-14T09:09:12.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:12.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791193+0000", 2024-09-14T09:09:12.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3615999999999997e-05 2024-09-14T09:09:12.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:12.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791283+0000", 2024-09-14T09:09:12.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9513999999999997e-05 2024-09-14T09:09:12.977 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.978 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.978 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.978 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:369 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:12.978 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:12.978 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.108632036000003, 2024-09-14T09:09:12.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99213433600000001, 2024-09-14T09:09:12.978 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.978 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.978 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:12.978 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.978 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:12.978 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:12.979 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 369 2024-09-14T09:09:12.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.979 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:12.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:12.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:12.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:09:12.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799277+0000", 2024-09-14T09:09:12.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.108e-06 2024-09-14T09:09:12.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799280+0000", 2024-09-14T09:09:12.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:09:12.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799283+0000", 2024-09-14T09:09:12.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.531e-06 2024-09-14T09:09:12.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801058+0000", 2024-09-14T09:09:12.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001775085 2024-09-14T09:09:12.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:12.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801060+0000", 2024-09-14T09:09:12.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8260000000000001e-06 2024-09-14T09:09:12.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791299+0000", 2024-09-14T09:09:12.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99023856799999999 2024-09-14T09:09:12.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:12.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791352+0000", 2024-09-14T09:09:12.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2528000000000003e-05 2024-09-14T09:09:12.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:12.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791410+0000", 2024-09-14T09:09:12.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8298000000000003e-05 2024-09-14T09:09:12.983 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.983 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.983 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.983 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:370 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2457600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:12.983 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:12.983 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.108607268999997, 2024-09-14T09:09:12.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99220795399999995, 2024-09-14T09:09:12.983 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.983 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.983 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:12.984 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.984 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:12.984 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:12.984 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 370 2024-09-14T09:09:12.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.984 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:12.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:12.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799301+0000", 2024-09-14T09:09:12.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2024-09-14T09:09:12.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799303+0000", 2024-09-14T09:09:12.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9319999999999999e-06 2024-09-14T09:09:12.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799310+0000", 2024-09-14T09:09:12.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8680000000000001e-06 2024-09-14T09:09:12.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799315+0000", 2024-09-14T09:09:12.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.921e-06 2024-09-14T09:09:12.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801071+0000", 2024-09-14T09:09:12.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001756678 2024-09-14T09:09:12.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:12.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801080+0000", 2024-09-14T09:09:12.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6060000000000003e-06 2024-09-14T09:09:12.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791429+0000", 2024-09-14T09:09:12.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99034944599999997 2024-09-14T09:09:12.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:12.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791471+0000", 2024-09-14T09:09:12.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1279999999999998e-05 2024-09-14T09:09:12.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:12.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791508+0000", 2024-09-14T09:09:12.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7663999999999997e-05 2024-09-14T09:09:12.988 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.988 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.988 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.988 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:371 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2916352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:12.988 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:12.989 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.108586097, 2024-09-14T09:09:12.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99228692299999999, 2024-09-14T09:09:12.989 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.989 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.989 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:12.989 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.989 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:12.989 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:12.989 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 371 2024-09-14T09:09:12.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.989 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:12.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:12.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799322+0000", 2024-09-14T09:09:12.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:09:12.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799333+0000", 2024-09-14T09:09:12.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1044e-05 2024-09-14T09:09:12.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799341+0000", 2024-09-14T09:09:12.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8439999999999998e-06 2024-09-14T09:09:12.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799354+0000", 2024-09-14T09:09:12.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3114e-05 2024-09-14T09:09:12.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801093+0000", 2024-09-14T09:09:12.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017385910000000001 2024-09-14T09:09:12.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:12.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801096+0000", 2024-09-14T09:09:12.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0680000000000001e-06 2024-09-14T09:09:12.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791528+0000", 2024-09-14T09:09:12.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99043264200000003 2024-09-14T09:09:12.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:12.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791570+0000", 2024-09-14T09:09:12.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2144999999999997e-05 2024-09-14T09:09:12.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:12.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791608+0000", 2024-09-14T09:09:12.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7966000000000002e-05 2024-09-14T09:09:12.994 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.994 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.994 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.994 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:372 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3375104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:12.994 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:12.994 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.108545548999999, 2024-09-14T09:09:12.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992342897, 2024-09-14T09:09:12.994 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:12.994 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:12.994 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:12.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:12.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:12.995 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:12.995 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 372 2024-09-14T09:09:12.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.995 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:12.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:12.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:12.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:12.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:12.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:12.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:12.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799363+0000", 2024-09-14T09:09:12.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2024-09-14T09:09:12.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:12.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799365+0000", 2024-09-14T09:09:12.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5500000000000001e-06 2024-09-14T09:09:12.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:12.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799371+0000", 2024-09-14T09:09:12.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2500000000000003e-06 2024-09-14T09:09:12.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:12.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799377+0000", 2024-09-14T09:09:12.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7509999999999997e-06 2024-09-14T09:09:12.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801107+0000", 2024-09-14T09:09:12.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017298019999999999 2024-09-14T09:09:12.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:12.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801111+0000", 2024-09-14T09:09:12.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8619999999999996e-06 2024-09-14T09:09:12.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:12.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791626+0000", 2024-09-14T09:09:12.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99051563300000001 2024-09-14T09:09:12.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:12.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791668+0000", 2024-09-14T09:09:12.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1424000000000002e-05 2024-09-14T09:09:12.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:12.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791705+0000", 2024-09-14T09:09:12.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7035e-05 2024-09-14T09:09:12.999 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.999 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:12.999 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:12.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:12.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:12.999 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:373 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:12.999 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:12.999 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.108523603999998, 2024-09-14T09:09:13.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99253589399999997, 2024-09-14T09:09:13.000 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:13.000 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:13.000 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:13.000 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:13.000 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:13.000 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:13.000 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 373 2024-09-14T09:09:13.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.000 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:13.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:13.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:13.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:13.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:13.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:13.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:13.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:13.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:13.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2024-09-14T09:09:13.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:13.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799387+0000", 2024-09-14T09:09:13.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1019999999999999e-06 2024-09-14T09:09:13.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:13.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799393+0000", 2024-09-14T09:09:13.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0190000000000003e-06 2024-09-14T09:09:13.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799398+0000", 2024-09-14T09:09:13.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:09:13.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:13.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801123+0000", 2024-09-14T09:09:13.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017251949999999999 2024-09-14T09:09:13.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:13.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801126+0000", 2024-09-14T09:09:13.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9280000000000002e-06 2024-09-14T09:09:13.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:13.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791746+0000", 2024-09-14T09:09:13.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99062036899999995 2024-09-14T09:09:13.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:13.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791835+0000", 2024-09-14T09:09:13.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9004000000000004e-05 2024-09-14T09:09:13.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:13.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791920+0000", 2024-09-14T09:09:13.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4524000000000006e-05 2024-09-14T09:09:13.004 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:13.004 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:13.005 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:13.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.005 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5436.0:2686 3.17 3:ea49084f:::rbd_data.1112b1c2f9b0.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 26669056~44032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-14T09:09:13.005 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:07.660251+0000", 2024-09-14T09:09:13.005 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.24765616, 2024-09-14T09:09:13.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.108286928, 2024-09-14T09:09:13.005 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:13.005 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:13.005 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:13.005 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:13.005 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5436", 2024-09-14T09:09:13.005 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1367139659", 2024-09-14T09:09:13.006 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 2686 2024-09-14T09:09:13.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.006 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:13.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:13.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.660251+0000", 2024-09-14T09:09:13.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:13.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:13.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.660251+0000", 2024-09-14T09:09:13.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:13.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:13.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.660253+0000", 2024-09-14T09:09:13.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.26e-06 2024-09-14T09:09:13.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:13.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.686995+0000", 2024-09-14T09:09:13.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026742366 2024-09-14T09:09:13.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:13.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.687025+0000", 2024-09-14T09:09:13.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0196999999999999e-05 2024-09-14T09:09:13.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.687036+0000", 2024-09-14T09:09:13.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1263e-05 2024-09-14T09:09:13.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:13.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.687109+0000", 2024-09-14T09:09:13.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2755000000000004e-05 2024-09-14T09:09:13.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:13.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.687297+0000", 2024-09-14T09:09:13.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018775399999999999 2024-09-14T09:09:13.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-09-14T09:09:13.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.688487+0000", 2024-09-14T09:09:13.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0011903560000000001 2024-09-14T09:09:13.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:13.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.736094+0000", 2024-09-14T09:09:13.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.047606948000000003 2024-09-14T09:09:13.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-09-14T09:09:13.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.768413+0000", 2024-09-14T09:09:13.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.032318446000000001 2024-09-14T09:09:13.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-09-14T09:09:13.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.768474+0000", 2024-09-14T09:09:13.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1464999999999995e-05 2024-09-14T09:09:13.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:13.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:07.768538+0000", 2024-09-14T09:09:13.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4117999999999998e-05 2024-09-14T09:09:13.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:13.011 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:13.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:13.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.011 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:11560 3.17 3:ea80107c:::rbd_data.1112b1c2f9b0.0000000000000001:20 [read 1908736~2048] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.011 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:12.202687+0000", 2024-09-14T09:09:13.011 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.70522038499999995, 2024-09-14T09:09:13.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.087688631000000003, 2024-09-14T09:09:13.011 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:13.011 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:13.012 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:13.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:13.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:13.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.012 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 11560 2024-09-14T09:09:13.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.012 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:13.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:13.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.202687+0000", 2024-09-14T09:09:13.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:13.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:13.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.202687+0000", 2024-09-14T09:09:13.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:13.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:13.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.207912+0000", 2024-09-14T09:09:13.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052248429999999998 2024-09-14T09:09:13.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:13.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.207917+0000", 2024-09-14T09:09:13.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7809999999999996e-06 2024-09-14T09:09:13.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:13.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.207926+0000", 2024-09-14T09:09:13.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3780000000000007e-06 2024-09-14T09:09:13.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.207933+0000", 2024-09-14T09:09:13.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5019999999999998e-06 2024-09-14T09:09:13.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:13.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.290174+0000", 2024-09-14T09:09:13.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.082241438 2024-09-14T09:09:13.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:13.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.290216+0000", 2024-09-14T09:09:13.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2213999999999999e-05 2024-09-14T09:09:13.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:13.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:13.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:13.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:12.290376+0000", 2024-09-14T09:09:13.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015947499999999999 2024-09-14T09:09:13.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:13.015 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:13.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:13.016 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:13.016 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:13.016 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:13.017 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:13.019+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:13.017 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:09:13.118 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:13.120+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:13.148 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:13.148 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:13.148 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:09:13.148 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:13.157 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:09:13.219 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:13.221+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:13.274 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:13.274 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:13.274 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:13.275 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:13.275 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:13.283 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:09:13.320 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:13.323+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:13.421 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:13.423+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:13.430 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:13.430 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:13.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:13.430 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:13.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.430 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2265 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4034560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:13.431 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:13.431 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.568956466000003, 2024-09-14T09:09:13.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073974829000000006, 2024-09-14T09:09:13.431 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.431 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.431 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:13.431 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.431 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:13.431 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:13.431 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2265 2024-09-14T09:09:13.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.431 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:13.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:13.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862542+0000", 2024-09-14T09:09:13.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:09:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862543+0000", 2024-09-14T09:09:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.81e-06 2024-09-14T09:09:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862549+0000", 2024-09-14T09:09:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8850000000000004e-06 2024-09-14T09:09:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862554+0000", 2024-09-14T09:09:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5279999999999997e-06 2024-09-14T09:09:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936318+0000", 2024-09-14T09:09:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073764422999999996 2024-09-14T09:09:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936412+0000", 2024-09-14T09:09:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3801000000000005e-05 2024-09-14T09:09:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936516+0000", 2024-09-14T09:09:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000104007 2024-09-14T09:09:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2266 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4096000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.568938602000003, 2024-09-14T09:09:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074208332000000002, 2024-09-14T09:09:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2266 2024-09-14T09:09:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862738+0000", 2024-09-14T09:09:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017920300000000001 2024-09-14T09:09:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862744+0000", 2024-09-14T09:09:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3000000000000001e-06 2024-09-14T09:09:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862753+0000", 2024-09-14T09:09:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8179999999999999e-06 2024-09-14T09:09:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862785+0000", 2024-09-14T09:09:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1949000000000002e-05 2024-09-14T09:09:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936556+0000", 2024-09-14T09:09:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073770268999999999 2024-09-14T09:09:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936657+0000", 2024-09-14T09:09:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101387 2024-09-14T09:09:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936767+0000", 2024-09-14T09:09:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110406 2024-09-14T09:09:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2267 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4157440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.568700020000001, 2024-09-14T09:09:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074200918000000005, 2024-09-14T09:09:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2267 2024-09-14T09:09:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863416+0000", 2024-09-14T09:09:13.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000618492 2024-09-14T09:09:13.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863421+0000", 2024-09-14T09:09:13.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1359999999999996e-06 2024-09-14T09:09:13.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863434+0000", 2024-09-14T09:09:13.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2291e-05 2024-09-14T09:09:13.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863444+0000", 2024-09-14T09:09:13.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9769999999999995e-06 2024-09-14T09:09:13.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:13.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936808+0000", 2024-09-14T09:09:13.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073364051999999999 2024-09-14T09:09:13.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:13.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936892+0000", 2024-09-14T09:09:13.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4641999999999994e-05 2024-09-14T09:09:13.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:13.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936999+0000", 2024-09-14T09:09:13.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106328 2024-09-14T09:09:13.444 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.444 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.444 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.444 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2328 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 45056~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:13.444 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.863458+0000", 2024-09-14T09:09:13.444 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.568039781000003, 2024-09-14T09:09:13.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073931949999999996, 2024-09-14T09:09:13.444 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.445 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.445 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:13.445 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.445 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:13.445 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:13.445 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2328 2024-09-14T09:09:13.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.445 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863458+0000", 2024-09-14T09:09:13.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863458+0000", 2024-09-14T09:09:13.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863489+0000", 2024-09-14T09:09:13.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1270999999999999e-05 2024-09-14T09:09:13.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863500+0000", 2024-09-14T09:09:13.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0969e-05 2024-09-14T09:09:13.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863509+0000", 2024-09-14T09:09:13.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5210000000000002e-06 2024-09-14T09:09:13.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863515+0000", 2024-09-14T09:09:13.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-09-14T09:09:13.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:13.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937038+0000", 2024-09-14T09:09:13.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073522901000000002 2024-09-14T09:09:13.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:13.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937131+0000", 2024-09-14T09:09:13.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.276e-05 2024-09-14T09:09:13.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:13.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937390+0000", 2024-09-14T09:09:13.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025917099999999999 2024-09-14T09:09:13.449 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.449 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.449 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.449 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2329 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 106496~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:13.449 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:13.449 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.567971411000002, 2024-09-14T09:09:13.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074180251000000003, 2024-09-14T09:09:13.449 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.449 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.449 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:13.449 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.449 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:13.450 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:13.450 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2329 2024-09-14T09:09:13.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.450 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:13.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:13.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864203+0000", 2024-09-14T09:09:13.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000677015 2024-09-14T09:09:13.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864208+0000", 2024-09-14T09:09:13.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.972e-06 2024-09-14T09:09:13.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864221+0000", 2024-09-14T09:09:13.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2683e-05 2024-09-14T09:09:13.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864229+0000", 2024-09-14T09:09:13.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0809999999999994e-06 2024-09-14T09:09:13.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:13.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937430+0000", 2024-09-14T09:09:13.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073201231000000005 2024-09-14T09:09:13.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:13.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937513+0000", 2024-09-14T09:09:13.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2652999999999996e-05 2024-09-14T09:09:13.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:13.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937707+0000", 2024-09-14T09:09:13.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000193616 2024-09-14T09:09:13.453 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.453 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.453 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.453 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2331 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 229376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:13.453 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:13.454 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.567153914000002, 2024-09-14T09:09:13.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.07400843, 2024-09-14T09:09:13.454 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.454 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.454 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:13.454 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.454 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:13.454 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:13.454 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2331 2024-09-14T09:09:13.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.454 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:13.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:13.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868104+0000", 2024-09-14T09:09:13.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003760453 2024-09-14T09:09:13.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868109+0000", 2024-09-14T09:09:13.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9339999999999997e-06 2024-09-14T09:09:13.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868119+0000", 2024-09-14T09:09:13.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5389999999999996e-06 2024-09-14T09:09:13.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868126+0000", 2024-09-14T09:09:13.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4499999999999998e-06 2024-09-14T09:09:13.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:13.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938065+0000", 2024-09-14T09:09:13.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069938809000000005 2024-09-14T09:09:13.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:13.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938148+0000", 2024-09-14T09:09:13.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3171999999999996e-05 2024-09-14T09:09:13.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:13.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938352+0000", 2024-09-14T09:09:13.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020407300000000001 2024-09-14T09:09:13.458 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.458 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.458 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.458 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2380 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3239936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:13.458 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:13.458 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.552128885999998, 2024-09-14T09:09:13.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073985913, 2024-09-14T09:09:13.458 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.458 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.458 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:13.458 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.459 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:13.459 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:13.459 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2380 2024-09-14T09:09:13.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.459 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:13.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:13.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879697+0000", 2024-09-14T09:09:13.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032864100000000001 2024-09-14T09:09:13.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879702+0000", 2024-09-14T09:09:13.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.578e-06 2024-09-14T09:09:13.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879716+0000", 2024-09-14T09:09:13.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.413e-05 2024-09-14T09:09:13.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879724+0000", 2024-09-14T09:09:13.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.559e-06 2024-09-14T09:09:13.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:13.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953155+0000", 2024-09-14T09:09:13.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073431221000000005 2024-09-14T09:09:13.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:13.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953247+0000", 2024-09-14T09:09:13.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1662000000000004e-05 2024-09-14T09:09:13.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:13.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953355+0000", 2024-09-14T09:09:13.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010812200000000001 2024-09-14T09:09:13.462 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.462 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.462 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.463 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2500 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2789376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:13.463 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:09:13.463 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.533597841000002, 2024-09-14T09:09:13.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073867281000000007, 2024-09-14T09:09:13.463 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.463 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.463 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:13.463 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.463 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:13.463 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:13.463 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2500 2024-09-14T09:09:13.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.463 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:09:13.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:09:13.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897900+0000", 2024-09-14T09:09:13.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1e-07 2024-09-14T09:09:13.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897901+0000", 2024-09-14T09:09:13.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1650000000000001e-06 2024-09-14T09:09:13.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897905+0000", 2024-09-14T09:09:13.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.755e-06 2024-09-14T09:09:13.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897908+0000", 2024-09-14T09:09:13.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7480000000000002e-06 2024-09-14T09:09:13.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:13.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971448+0000", 2024-09-14T09:09:13.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073539801000000002 2024-09-14T09:09:13.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:13.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971535+0000", 2024-09-14T09:09:13.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7085999999999999e-05 2024-09-14T09:09:13.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:13.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971767+0000", 2024-09-14T09:09:13.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023251599999999999 2024-09-14T09:09:13.467 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.467 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.467 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.467 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2501 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2850816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:13.467 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:13.467 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.533586581999998, 2024-09-14T09:09:13.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074288858999999999, 2024-09-14T09:09:13.467 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.467 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.467 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:13.468 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.468 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:13.468 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:13.468 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2501 2024-09-14T09:09:13.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.468 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:13.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:13.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:13.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.41e-07 2024-09-14T09:09:13.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897913+0000", 2024-09-14T09:09:13.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3090000000000001e-06 2024-09-14T09:09:13.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897918+0000", 2024-09-14T09:09:13.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8470000000000003e-06 2024-09-14T09:09:13.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897922+0000", 2024-09-14T09:09:13.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5549999999999996e-06 2024-09-14T09:09:13.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:13.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971872+0000", 2024-09-14T09:09:13.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073950057999999999 2024-09-14T09:09:13.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:13.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971958+0000", 2024-09-14T09:09:13.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5941999999999998e-05 2024-09-14T09:09:13.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:13.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972200+0000", 2024-09-14T09:09:13.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000241907 2024-09-14T09:09:13.471 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.471 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.471 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.471 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2502 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2912256~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:13.471 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:13.471 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.533547401999996, 2024-09-14T09:09:13.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074614080999999999, 2024-09-14T09:09:13.472 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.472 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.472 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:13.472 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.472 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:13.472 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:13.472 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2502 2024-09-14T09:09:13.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.472 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:13.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:13.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897951+0000", 2024-09-14T09:09:13.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:09:13.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897953+0000", 2024-09-14T09:09:13.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5670000000000002e-06 2024-09-14T09:09:13.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897970+0000", 2024-09-14T09:09:13.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6319000000000001e-05 2024-09-14T09:09:13.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897976+0000", 2024-09-14T09:09:13.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8760000000000002e-06 2024-09-14T09:09:13.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:13.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972245+0000", 2024-09-14T09:09:13.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074269186000000001 2024-09-14T09:09:13.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:13.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972333+0000", 2024-09-14T09:09:13.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7800999999999995e-05 2024-09-14T09:09:13.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:13.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972564+0000", 2024-09-14T09:09:13.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000231833 2024-09-14T09:09:13.475 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.476 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.476 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.476 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2503 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2973696~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:13.476 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:13.476 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.533513384999999, 2024-09-14T09:09:13.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074944286999999998, 2024-09-14T09:09:13.476 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.476 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.476 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:13.476 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.476 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:13.476 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:13.477 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2503 2024-09-14T09:09:13.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.477 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:13.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:13.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897985+0000", 2024-09-14T09:09:13.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999998e-07 2024-09-14T09:09:13.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897987+0000", 2024-09-14T09:09:13.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.401e-06 2024-09-14T09:09:13.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897999+0000", 2024-09-14T09:09:13.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1851999999999999e-05 2024-09-14T09:09:13.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898005+0000", 2024-09-14T09:09:13.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9789999999999998e-06 2024-09-14T09:09:13.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:13.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972609+0000", 2024-09-14T09:09:13.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074604217 2024-09-14T09:09:13.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:13.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972684+0000", 2024-09-14T09:09:13.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4777999999999995e-05 2024-09-14T09:09:13.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:13.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972929+0000", 2024-09-14T09:09:13.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024448100000000001 2024-09-14T09:09:13.480 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.480 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.480 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.480 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2504 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3035136~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:13.481 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:13.481 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.533485292999998, 2024-09-14T09:09:13.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075285131000000005, 2024-09-14T09:09:13.481 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.481 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.481 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:13.481 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.481 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:13.481 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:13.481 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2504 2024-09-14T09:09:13.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.481 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:13.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:13.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898078+0000", 2024-09-14T09:09:13.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5775e-05 2024-09-14T09:09:13.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898082+0000", 2024-09-14T09:09:13.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.49e-06 2024-09-14T09:09:13.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898092+0000", 2024-09-14T09:09:13.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0509999999999999e-05 2024-09-14T09:09:13.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898099+0000", 2024-09-14T09:09:13.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.81e-06 2024-09-14T09:09:13.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:13.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972971+0000", 2024-09-14T09:09:13.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074871788999999994 2024-09-14T09:09:13.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:13.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973055+0000", 2024-09-14T09:09:13.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3980000000000006e-05 2024-09-14T09:09:13.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:13.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973298+0000", 2024-09-14T09:09:13.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024277700000000001 2024-09-14T09:09:13.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.485 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.486 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2505 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3096576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:13.486 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:13.486 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.533389038000003, 2024-09-14T09:09:13.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075506668999999998, 2024-09-14T09:09:13.486 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.486 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.486 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:13.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:13.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:13.486 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2505 2024-09-14T09:09:13.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.486 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:13.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:13.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898370+0000", 2024-09-14T09:09:13.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026128799999999998 2024-09-14T09:09:13.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898374+0000", 2024-09-14T09:09:13.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8070000000000001e-06 2024-09-14T09:09:13.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898383+0000", 2024-09-14T09:09:13.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0520000000000007e-06 2024-09-14T09:09:13.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898389+0000", 2024-09-14T09:09:13.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2639999999999997e-06 2024-09-14T09:09:13.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:13.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973330+0000", 2024-09-14T09:09:13.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074940548999999995 2024-09-14T09:09:13.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:13.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973402+0000", 2024-09-14T09:09:13.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2556000000000001e-05 2024-09-14T09:09:13.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:13.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973615+0000", 2024-09-14T09:09:13.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000213153 2024-09-14T09:09:13.490 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.490 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.490 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.490 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2506 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3158016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:13.490 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:13.490 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.533095793999998, 2024-09-14T09:09:13.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075556110999999995, 2024-09-14T09:09:13.490 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.490 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.490 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:13.491 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.491 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:13.491 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:13.491 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2506 2024-09-14T09:09:13.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.491 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:13.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:13.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898497+0000", 2024-09-14T09:09:13.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4806e-05 2024-09-14T09:09:13.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898500+0000", 2024-09-14T09:09:13.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.54e-06 2024-09-14T09:09:13.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898507+0000", 2024-09-14T09:09:13.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1590000000000004e-06 2024-09-14T09:09:13.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898513+0000", 2024-09-14T09:09:13.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.015e-06 2024-09-14T09:09:13.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:13.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973656+0000", 2024-09-14T09:09:13.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075142929999999997 2024-09-14T09:09:13.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:13.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973742+0000", 2024-09-14T09:09:13.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5535e-05 2024-09-14T09:09:13.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:13.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973958+0000", 2024-09-14T09:09:13.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000216126 2024-09-14T09:09:13.494 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.494 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.494 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.495 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2507 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3219456~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:13.495 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:13.495 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.532967210000002, 2024-09-14T09:09:13.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075623459000000004, 2024-09-14T09:09:13.495 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.495 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.495 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:13.495 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.495 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:13.495 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:13.495 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2507 2024-09-14T09:09:13.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.495 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:13.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:13.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898761+0000", 2024-09-14T09:09:13.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000230614 2024-09-14T09:09:13.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898765+0000", 2024-09-14T09:09:13.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6629999999999999e-06 2024-09-14T09:09:13.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898774+0000", 2024-09-14T09:09:13.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6749999999999997e-06 2024-09-14T09:09:13.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898781+0000", 2024-09-14T09:09:13.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4640000000000003e-06 2024-09-14T09:09:13.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:13.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973985+0000", 2024-09-14T09:09:13.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075204101999999995 2024-09-14T09:09:13.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:13.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974063+0000", 2024-09-14T09:09:13.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7632000000000005e-05 2024-09-14T09:09:13.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:13.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974154+0000", 2024-09-14T09:09:13.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1309000000000003e-05 2024-09-14T09:09:13.499 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.499 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.499 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.499 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2508 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3280896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:13.499 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:13.499 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.532705446999998, 2024-09-14T09:09:13.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075576943999999993, 2024-09-14T09:09:13.499 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.499 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.500 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:13.500 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.500 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:13.500 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:13.500 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2508 2024-09-14T09:09:13.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.500 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:13.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:13.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899176+0000", 2024-09-14T09:09:13.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038340500000000002 2024-09-14T09:09:13.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899179+0000", 2024-09-14T09:09:13.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0290000000000001e-06 2024-09-14T09:09:13.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899186+0000", 2024-09-14T09:09:13.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8199999999999999e-06 2024-09-14T09:09:13.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899190+0000", 2024-09-14T09:09:13.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2050000000000004e-06 2024-09-14T09:09:13.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:13.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974193+0000", 2024-09-14T09:09:13.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075003632000000001 2024-09-14T09:09:13.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:13.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974276+0000", 2024-09-14T09:09:13.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2272000000000001e-05 2024-09-14T09:09:13.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:13.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974369+0000", 2024-09-14T09:09:13.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3580999999999997e-05 2024-09-14T09:09:13.503 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.503 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.503 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.504 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2509 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3342336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:13.504 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:13.504 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.532297829999997, 2024-09-14T09:09:13.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075356229999999996, 2024-09-14T09:09:13.504 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.504 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.504 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:13.504 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.504 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:13.504 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:13.504 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2509 2024-09-14T09:09:13.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.505 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:13.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:13.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899439+0000", 2024-09-14T09:09:13.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023958599999999999 2024-09-14T09:09:13.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899444+0000", 2024-09-14T09:09:13.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8790000000000002e-06 2024-09-14T09:09:13.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899455+0000", 2024-09-14T09:09:13.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0597999999999999e-05 2024-09-14T09:09:13.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899462+0000", 2024-09-14T09:09:13.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8179999999999998e-06 2024-09-14T09:09:13.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:13.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974400+0000", 2024-09-14T09:09:13.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074937999000000005 2024-09-14T09:09:13.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:13.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974465+0000", 2024-09-14T09:09:13.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5134000000000004e-05 2024-09-14T09:09:13.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:13.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974556+0000", 2024-09-14T09:09:13.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1216000000000002e-05 2024-09-14T09:09:13.508 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.508 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.508 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.508 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2510 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3403776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:13.508 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:13.508 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.532022437000002, 2024-09-14T09:09:13.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075295775999999995, 2024-09-14T09:09:13.508 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.508 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.509 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:13.509 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.509 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:13.509 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:13.509 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2510 2024-09-14T09:09:13.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.509 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:13.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:13.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899691+0000", 2024-09-14T09:09:13.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021615999999999999 2024-09-14T09:09:13.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899696+0000", 2024-09-14T09:09:13.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3200000000000001e-06 2024-09-14T09:09:13.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899704+0000", 2024-09-14T09:09:13.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9440000000000005e-06 2024-09-14T09:09:13.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899710+0000", 2024-09-14T09:09:13.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.584e-06 2024-09-14T09:09:13.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:13.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974594+0000", 2024-09-14T09:09:13.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074883551000000007 2024-09-14T09:09:13.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:13.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974679+0000", 2024-09-14T09:09:13.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5365999999999995e-05 2024-09-14T09:09:13.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:13.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974771+0000", 2024-09-14T09:09:13.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1850999999999999e-05 2024-09-14T09:09:13.512 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.512 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.512 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.513 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2511 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3465216~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:13.513 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:13.513 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.531776219000001, 2024-09-14T09:09:13.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075234668000000005, 2024-09-14T09:09:13.513 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.513 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.513 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:13.513 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.513 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:13.513 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:13.513 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2511 2024-09-14T09:09:13.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.514 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:13.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:13.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899951+0000", 2024-09-14T09:09:13.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000229569 2024-09-14T09:09:13.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899955+0000", 2024-09-14T09:09:13.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1010000000000002e-06 2024-09-14T09:09:13.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899971+0000", 2024-09-14T09:09:13.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5648999999999999e-05 2024-09-14T09:09:13.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899978+0000", 2024-09-14T09:09:13.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0829999999999998e-06 2024-09-14T09:09:13.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:13.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974806+0000", 2024-09-14T09:09:13.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074828092999999998 2024-09-14T09:09:13.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:13.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974870+0000", 2024-09-14T09:09:13.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4492000000000005e-05 2024-09-14T09:09:13.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:13.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974956+0000", 2024-09-14T09:09:13.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5680999999999995e-05 2024-09-14T09:09:13.517 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.517 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.517 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.517 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2512 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3526656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:13.517 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:13.517 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.531508674000001, 2024-09-14T09:09:13.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075178812999999997, 2024-09-14T09:09:13.518 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.518 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.518 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:13.518 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.518 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:13.518 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:13.518 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2512 2024-09-14T09:09:13.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.518 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:13.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:13.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904181+0000", 2024-09-14T09:09:13.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041919399999999999 2024-09-14T09:09:13.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904186+0000", 2024-09-14T09:09:13.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2390000000000002e-06 2024-09-14T09:09:13.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904199+0000", 2024-09-14T09:09:13.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2709e-05 2024-09-14T09:09:13.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904207+0000", 2024-09-14T09:09:13.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8150000000000006e-06 2024-09-14T09:09:13.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:13.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975000+0000", 2024-09-14T09:09:13.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.070793444999999997 2024-09-14T09:09:13.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:13.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975079+0000", 2024-09-14T09:09:13.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8480999999999996e-05 2024-09-14T09:09:13.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:13.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975168+0000", 2024-09-14T09:09:13.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9184000000000005e-05 2024-09-14T09:09:13.521 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.521 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.522 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.522 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.522 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.522 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:13.523 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:09:13.524 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:13.526+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:13.612 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:09:13.623 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:13.626+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:13.690 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24471 3.1a 3.b46513a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.689111+0000", 2024-09-14T09:09:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.001862816, 2024-09-14T09:09:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001882559, 2024-09-14T09:09:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24471 2024-09-14T09:09:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689111+0000", 2024-09-14T09:09:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689111+0000", 2024-09-14T09:09:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689112+0000", 2024-09-14T09:09:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9800000000000002e-07 2024-09-14T09:09:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689116+0000", 2024-09-14T09:09:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7529999999999999e-06 2024-09-14T09:09:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689127+0000", 2024-09-14T09:09:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1199000000000001e-05 2024-09-14T09:09:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689134+0000", 2024-09-14T09:09:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9630000000000001e-06 2024-09-14T09:09:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24473 3.1a 3.b46513a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.689168+0000", 2024-09-14T09:09:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00180555, 2024-09-14T09:09:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001879672, 2024-09-14T09:09:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24473 2024-09-14T09:09:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689168+0000", 2024-09-14T09:09:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689168+0000", 2024-09-14T09:09:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689169+0000", 2024-09-14T09:09:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8500000000000001e-07 2024-09-14T09:09:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689172+0000", 2024-09-14T09:09:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7879999999999998e-06 2024-09-14T09:09:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689182+0000", 2024-09-14T09:09:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6590000000000002e-06 2024-09-14T09:09:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689187+0000", 2024-09-14T09:09:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4280000000000004e-06 2024-09-14T09:09:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24475 3.1a 3.b46513a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.689350+0000", 2024-09-14T09:09:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0016240390000000001, 2024-09-14T09:09:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001746491, 2024-09-14T09:09:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24475 2024-09-14T09:09:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689350+0000", 2024-09-14T09:09:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689350+0000", 2024-09-14T09:09:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689351+0000", 2024-09-14T09:09:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.92e-07 2024-09-14T09:09:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689355+0000", 2024-09-14T09:09:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9600000000000002e-06 2024-09-14T09:09:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689366+0000", 2024-09-14T09:09:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1287999999999999e-05 2024-09-14T09:09:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689373+0000", 2024-09-14T09:09:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0049999999999998e-06 2024-09-14T09:09:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24477 3.1a 3.b46513a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.689564+0000", 2024-09-14T09:09:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0014103029999999999, 2024-09-14T09:09:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0015770650000000001, 2024-09-14T09:09:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24477 2024-09-14T09:09:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689564+0000", 2024-09-14T09:09:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689564+0000", 2024-09-14T09:09:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689565+0000", 2024-09-14T09:09:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7700000000000003e-07 2024-09-14T09:09:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689569+0000", 2024-09-14T09:09:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3810000000000001e-06 2024-09-14T09:09:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689582+0000", 2024-09-14T09:09:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2965e-05 2024-09-14T09:09:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689590+0000", 2024-09-14T09:09:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7060000000000004e-06 2024-09-14T09:09:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24479 3.1a 3.b46513a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.689722+0000", 2024-09-14T09:09:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.001252485, 2024-09-14T09:09:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001466991, 2024-09-14T09:09:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24479 2024-09-14T09:09:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689722+0000", 2024-09-14T09:09:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689722+0000", 2024-09-14T09:09:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689722+0000", 2024-09-14T09:09:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9100000000000002e-07 2024-09-14T09:09:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689726+0000", 2024-09-14T09:09:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0609999999999997e-06 2024-09-14T09:09:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689739+0000", 2024-09-14T09:09:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2746e-05 2024-09-14T09:09:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689746+0000", 2024-09-14T09:09:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7240000000000003e-06 2024-09-14T09:09:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24480 3.1a 3.b46513a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.689759+0000", 2024-09-14T09:09:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0012148129999999999, 2024-09-14T09:09:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001476062, 2024-09-14T09:09:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24480 2024-09-14T09:09:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689759+0000", 2024-09-14T09:09:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689759+0000", 2024-09-14T09:09:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689760+0000", 2024-09-14T09:09:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9599999999999999e-07 2024-09-14T09:09:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689762+0000", 2024-09-14T09:09:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6989999999999999e-06 2024-09-14T09:09:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689770+0000", 2024-09-14T09:09:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0010000000000001e-06 2024-09-14T09:09:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.689777+0000", 2024-09-14T09:09:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8519999999999998e-06 2024-09-14T09:09:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24481 3.1a 3.b46513a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.690052+0000", 2024-09-14T09:09:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00092236800000000002, 2024-09-14T09:09:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0012248820000000001, 2024-09-14T09:09:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24481 2024-09-14T09:09:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690052+0000", 2024-09-14T09:09:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690052+0000", 2024-09-14T09:09:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690053+0000", 2024-09-14T09:09:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.09e-07 2024-09-14T09:09:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690058+0000", 2024-09-14T09:09:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0749999999999997e-06 2024-09-14T09:09:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690071+0000", 2024-09-14T09:09:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3689999999999999e-05 2024-09-14T09:09:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690079+0000", 2024-09-14T09:09:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0800000000000006e-06 2024-09-14T09:09:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24482 3.1a 3.b46513a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.690094+0000", 2024-09-14T09:09:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00088042299999999997, 2024-09-14T09:09:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0012251160000000001, 2024-09-14T09:09:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24482 2024-09-14T09:09:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690094+0000", 2024-09-14T09:09:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690094+0000", 2024-09-14T09:09:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690094+0000", 2024-09-14T09:09:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2099999999999997e-07 2024-09-14T09:09:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690097+0000", 2024-09-14T09:09:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.508e-06 2024-09-14T09:09:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690106+0000", 2024-09-14T09:09:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2299999999999997e-06 2024-09-14T09:09:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690112+0000", 2024-09-14T09:09:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.285e-06 2024-09-14T09:09:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24483 3.1a 3.b46513a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.690121+0000", 2024-09-14T09:09:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00085317100000000001, 2024-09-14T09:09:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0012432739999999999, 2024-09-14T09:09:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24483 2024-09-14T09:09:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690121+0000", 2024-09-14T09:09:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690121+0000", 2024-09-14T09:09:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690121+0000", 2024-09-14T09:09:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7300000000000001e-07 2024-09-14T09:09:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690124+0000", 2024-09-14T09:09:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2979999999999999e-06 2024-09-14T09:09:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690130+0000", 2024-09-14T09:09:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8299999999999998e-06 2024-09-14T09:09:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690136+0000", 2024-09-14T09:09:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5400000000000003e-06 2024-09-14T09:09:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24484 3.1a 3.b46513a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.690165+0000", 2024-09-14T09:09:13.719 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00080929899999999998, 2024-09-14T09:09:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0012501249999999999, 2024-09-14T09:09:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24484 2024-09-14T09:09:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690165+0000", 2024-09-14T09:09:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690165+0000", 2024-09-14T09:09:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690165+0000", 2024-09-14T09:09:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9400000000000005e-07 2024-09-14T09:09:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690168+0000", 2024-09-14T09:09:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.514e-06 2024-09-14T09:09:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690176+0000", 2024-09-14T09:09:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9289999999999998e-06 2024-09-14T09:09:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690182+0000", 2024-09-14T09:09:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8259999999999998e-06 2024-09-14T09:09:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.722 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24485 3.1a 3.b46513a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.690288+0000", 2024-09-14T09:09:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00068638200000000003, 2024-09-14T09:09:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0011655789999999999, 2024-09-14T09:09:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24485 2024-09-14T09:09:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690288+0000", 2024-09-14T09:09:13.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690288+0000", 2024-09-14T09:09:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690288+0000", 2024-09-14T09:09:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0100000000000004e-07 2024-09-14T09:09:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690292+0000", 2024-09-14T09:09:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4209999999999999e-06 2024-09-14T09:09:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690306+0000", 2024-09-14T09:09:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3903999999999999e-05 2024-09-14T09:09:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690315+0000", 2024-09-14T09:09:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9600000000000006e-06 2024-09-14T09:09:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24486 3.1a 3.b46513a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.690343+0000", 2024-09-14T09:09:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00063071100000000005, 2024-09-14T09:09:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0011359580000000001, 2024-09-14T09:09:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24486 2024-09-14T09:09:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690343+0000", 2024-09-14T09:09:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690343+0000", 2024-09-14T09:09:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690344+0000", 2024-09-14T09:09:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5000000000000003e-07 2024-09-14T09:09:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690347+0000", 2024-09-14T09:09:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.999e-06 2024-09-14T09:09:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690358+0000", 2024-09-14T09:09:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0815999999999999e-05 2024-09-14T09:09:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690364+0000", 2024-09-14T09:09:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1380000000000004e-06 2024-09-14T09:09:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.728 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24487 3.1a 3.b46513a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.690497+0000", 2024-09-14T09:09:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00047685700000000002, 2024-09-14T09:09:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0010256390000000001, 2024-09-14T09:09:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24487 2024-09-14T09:09:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.729 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690497+0000", 2024-09-14T09:09:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690497+0000", 2024-09-14T09:09:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690498+0000", 2024-09-14T09:09:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6799999999999999e-07 2024-09-14T09:09:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690501+0000", 2024-09-14T09:09:13.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2789999999999999e-06 2024-09-14T09:09:13.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690511+0000", 2024-09-14T09:09:13.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6739999999999992e-06 2024-09-14T09:09:13.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690517+0000", 2024-09-14T09:09:13.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9989999999999997e-06 2024-09-14T09:09:13.731 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.731 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.732 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.732 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24488 3.1a 3.b46513a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.732 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.690533+0000", 2024-09-14T09:09:13.732 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00044128800000000002, 2024-09-14T09:09:13.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0010150650000000001, 2024-09-14T09:09:13.732 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.732 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.732 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.733 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.733 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.733 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.733 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24488 2024-09-14T09:09:13.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.733 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690533+0000", 2024-09-14T09:09:13.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690533+0000", 2024-09-14T09:09:13.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690533+0000", 2024-09-14T09:09:13.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0200000000000002e-07 2024-09-14T09:09:13.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690536+0000", 2024-09-14T09:09:13.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.689e-06 2024-09-14T09:09:13.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690546+0000", 2024-09-14T09:09:13.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9420000000000007e-06 2024-09-14T09:09:13.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690551+0000", 2024-09-14T09:09:13.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0969999999999996e-06 2024-09-14T09:09:13.735 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.735 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.735 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.735 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24489 3.1a 3.b46513a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.735 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.690653+0000", 2024-09-14T09:09:13.736 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00032133599999999997, 2024-09-14T09:09:13.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00092967199999999999, 2024-09-14T09:09:13.736 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.736 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.736 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.736 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.736 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.736 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.736 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24489 2024-09-14T09:09:13.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.736 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690653+0000", 2024-09-14T09:09:13.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690653+0000", 2024-09-14T09:09:13.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690653+0000", 2024-09-14T09:09:13.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4799999999999997e-07 2024-09-14T09:09:13.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690657+0000", 2024-09-14T09:09:13.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.579e-06 2024-09-14T09:09:13.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690670+0000", 2024-09-14T09:09:13.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2516e-05 2024-09-14T09:09:13.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690676+0000", 2024-09-14T09:09:13.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3470000000000004e-06 2024-09-14T09:09:13.738 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.738 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.738 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.739 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24490 3.1a 3.b46513a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.739 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.690692+0000", 2024-09-14T09:09:13.739 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00028158099999999999, 2024-09-14T09:09:13.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00092417499999999995, 2024-09-14T09:09:13.739 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.739 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.739 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.739 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.739 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.739 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.739 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24490 2024-09-14T09:09:13.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.739 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690692+0000", 2024-09-14T09:09:13.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690692+0000", 2024-09-14T09:09:13.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690693+0000", 2024-09-14T09:09:13.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2300000000000001e-07 2024-09-14T09:09:13.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690696+0000", 2024-09-14T09:09:13.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5399999999999998e-06 2024-09-14T09:09:13.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690703+0000", 2024-09-14T09:09:13.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5750000000000003e-06 2024-09-14T09:09:13.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.690709+0000", 2024-09-14T09:09:13.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7610000000000004e-06 2024-09-14T09:09:13.741 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.741 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.741 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.742 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24462 3.1a 3.b46513a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.742 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.691531+0000", 2024-09-14T09:09:13.742 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9994426, 2024-09-14T09:09:13.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000113458, 2024-09-14T09:09:13.742 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.742 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.742 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.742 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.742 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.742 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.742 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24462 2024-09-14T09:09:13.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.742 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691531+0000", 2024-09-14T09:09:13.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691531+0000", 2024-09-14T09:09:13.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691532+0000", 2024-09-14T09:09:13.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.78e-07 2024-09-14T09:09:13.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691537+0000", 2024-09-14T09:09:13.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5499999999999996e-06 2024-09-14T09:09:13.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691546+0000", 2024-09-14T09:09:13.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6270000000000006e-06 2024-09-14T09:09:13.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691551+0000", 2024-09-14T09:09:13.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0950000000000003e-06 2024-09-14T09:09:13.745 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.745 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.745 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.745 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24465 3.1a 3.b46513a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.745 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.691580+0000", 2024-09-14T09:09:13.745 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9993935, 2024-09-14T09:09:13.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000112176, 2024-09-14T09:09:13.745 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.745 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.745 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.745 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.746 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.746 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.746 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24465 2024-09-14T09:09:13.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.746 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691580+0000", 2024-09-14T09:09:13.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691580+0000", 2024-09-14T09:09:13.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691581+0000", 2024-09-14T09:09:13.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4000000000000002e-07 2024-09-14T09:09:13.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691583+0000", 2024-09-14T09:09:13.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4480000000000001e-06 2024-09-14T09:09:13.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691588+0000", 2024-09-14T09:09:13.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4739999999999999e-06 2024-09-14T09:09:13.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691592+0000", 2024-09-14T09:09:13.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2089999999999999e-06 2024-09-14T09:09:13.748 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.748 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.748 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.748 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24467 3.1a 3.b46513a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.748 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.691622+0000", 2024-09-14T09:09:13.748 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.999352, 2024-09-14T09:09:13.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8857999999999994e-05, 2024-09-14T09:09:13.749 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.749 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.749 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.749 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.749 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.749 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.749 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24467 2024-09-14T09:09:13.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.749 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691622+0000", 2024-09-14T09:09:13.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691622+0000", 2024-09-14T09:09:13.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691623+0000", 2024-09-14T09:09:13.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8699999999999995e-07 2024-09-14T09:09:13.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691625+0000", 2024-09-14T09:09:13.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0470000000000001e-06 2024-09-14T09:09:13.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691629+0000", 2024-09-14T09:09:13.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.143e-06 2024-09-14T09:09:13.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691632+0000", 2024-09-14T09:09:13.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9639999999999999e-06 2024-09-14T09:09:13.751 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.751 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.751 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.752 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24469 3.1a 3.b46513a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.752 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.691659+0000", 2024-09-14T09:09:13.752 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9993153, 2024-09-14T09:09:13.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010705900000000001, 2024-09-14T09:09:13.752 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.752 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.752 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.752 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.752 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.752 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.752 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24469 2024-09-14T09:09:13.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.753 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691659+0000", 2024-09-14T09:09:13.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691659+0000", 2024-09-14T09:09:13.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691659+0000", 2024-09-14T09:09:13.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4700000000000002e-07 2024-09-14T09:09:13.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691661+0000", 2024-09-14T09:09:13.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4959999999999999e-06 2024-09-14T09:09:13.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691665+0000", 2024-09-14T09:09:13.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1479999999999999e-06 2024-09-14T09:09:13.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691667+0000", 2024-09-14T09:09:13.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7099999999999999e-06 2024-09-14T09:09:13.755 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.755 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.755 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.755 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24471 3.1a 3.b46513a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.755 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.691671+0000", 2024-09-14T09:09:13.755 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9993024, 2024-09-14T09:09:13.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014184199999999999, 2024-09-14T09:09:13.755 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.755 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.755 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.755 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.756 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.756 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.756 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24471 2024-09-14T09:09:13.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.756 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691671+0000", 2024-09-14T09:09:13.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691671+0000", 2024-09-14T09:09:13.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691672+0000", 2024-09-14T09:09:13.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1e-07 2024-09-14T09:09:13.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691673+0000", 2024-09-14T09:09:13.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.083e-06 2024-09-14T09:09:13.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691680+0000", 2024-09-14T09:09:13.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2359999999999998e-06 2024-09-14T09:09:13.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691684+0000", 2024-09-14T09:09:13.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9750000000000001e-06 2024-09-14T09:09:13.758 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.759 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.759 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.759 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24473 3.1a 3.b46513a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.759 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.691688+0000", 2024-09-14T09:09:13.759 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9992857, 2024-09-14T09:09:13.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017180799999999999, 2024-09-14T09:09:13.759 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.759 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.759 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.759 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.759 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.759 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.760 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24473 2024-09-14T09:09:13.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.760 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691688+0000", 2024-09-14T09:09:13.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691688+0000", 2024-09-14T09:09:13.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691689+0000", 2024-09-14T09:09:13.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1100000000000001e-07 2024-09-14T09:09:13.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691690+0000", 2024-09-14T09:09:13.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3030000000000001e-06 2024-09-14T09:09:13.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691693+0000", 2024-09-14T09:09:13.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.281e-06 2024-09-14T09:09:13.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691696+0000", 2024-09-14T09:09:13.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6879999999999999e-06 2024-09-14T09:09:13.762 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.762 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.762 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.762 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24475 3.1a 3.b46513a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.762 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.691702+0000", 2024-09-14T09:09:13.763 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9992723, 2024-09-14T09:09:13.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000204737, 2024-09-14T09:09:13.763 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.763 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.763 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.763 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.763 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.763 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.763 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24475 2024-09-14T09:09:13.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.763 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691702+0000", 2024-09-14T09:09:13.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691702+0000", 2024-09-14T09:09:13.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691702+0000", 2024-09-14T09:09:13.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7300000000000002e-07 2024-09-14T09:09:13.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691703+0000", 2024-09-14T09:09:13.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3e-06 2024-09-14T09:09:13.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691707+0000", 2024-09-14T09:09:13.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.208e-06 2024-09-14T09:09:13.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691709+0000", 2024-09-14T09:09:13.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7779999999999999e-06 2024-09-14T09:09:13.765 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.766 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.766 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.766 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24477 3.1a 3.b46513a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.766 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.691722+0000", 2024-09-14T09:09:13.766 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9992523, 2024-09-14T09:09:13.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022661, 2024-09-14T09:09:13.766 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.766 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.766 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.766 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.766 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.767 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.767 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24477 2024-09-14T09:09:13.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.767 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691722+0000", 2024-09-14T09:09:13.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691722+0000", 2024-09-14T09:09:13.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691722+0000", 2024-09-14T09:09:13.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.65e-07 2024-09-14T09:09:13.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691724+0000", 2024-09-14T09:09:13.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.424e-06 2024-09-14T09:09:13.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691731+0000", 2024-09-14T09:09:13.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7360000000000001e-06 2024-09-14T09:09:13.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691735+0000", 2024-09-14T09:09:13.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0080000000000004e-06 2024-09-14T09:09:13.769 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.769 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.769 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.769 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24479 3.1a 3.b46513a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.769 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.691750+0000", 2024-09-14T09:09:13.769 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9992242, 2024-09-14T09:09:13.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022862100000000001, 2024-09-14T09:09:13.770 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.770 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.770 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.770 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.770 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.770 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.770 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24479 2024-09-14T09:09:13.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.770 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691750+0000", 2024-09-14T09:09:13.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691750+0000", 2024-09-14T09:09:13.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691750+0000", 2024-09-14T09:09:13.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8000000000000002e-07 2024-09-14T09:09:13.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691752+0000", 2024-09-14T09:09:13.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.328e-06 2024-09-14T09:09:13.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691755+0000", 2024-09-14T09:09:13.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6009999999999999e-06 2024-09-14T09:09:13.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691758+0000", 2024-09-14T09:09:13.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7819999999999998e-06 2024-09-14T09:09:13.772 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.772 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.773 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.773 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24480 3.1a 3.b46513a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.773 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.691762+0000", 2024-09-14T09:09:13.773 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9992123, 2024-09-14T09:09:13.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024091299999999999, 2024-09-14T09:09:13.773 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.773 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.773 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.773 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.773 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.773 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.774 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24480 2024-09-14T09:09:13.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.774 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691762+0000", 2024-09-14T09:09:13.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691762+0000", 2024-09-14T09:09:13.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691762+0000", 2024-09-14T09:09:13.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9499999999999998e-07 2024-09-14T09:09:13.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691763+0000", 2024-09-14T09:09:13.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.094e-06 2024-09-14T09:09:13.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691766+0000", 2024-09-14T09:09:13.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.96e-06 2024-09-14T09:09:13.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691769+0000", 2024-09-14T09:09:13.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4710000000000001e-06 2024-09-14T09:09:13.776 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.776 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.776 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.776 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24481 3.1a 3.b46513a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.776 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.691772+0000", 2024-09-14T09:09:13.776 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9992023, 2024-09-14T09:09:13.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025418000000000001, 2024-09-14T09:09:13.777 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.777 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.777 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.777 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.777 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.777 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.777 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24481 2024-09-14T09:09:13.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.777 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691772+0000", 2024-09-14T09:09:13.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691772+0000", 2024-09-14T09:09:13.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691772+0000", 2024-09-14T09:09:13.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.05e-07 2024-09-14T09:09:13.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691773+0000", 2024-09-14T09:09:13.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0860000000000001e-06 2024-09-14T09:09:13.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691776+0000", 2024-09-14T09:09:13.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9079999999999999e-06 2024-09-14T09:09:13.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691779+0000", 2024-09-14T09:09:13.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5009999999999999e-06 2024-09-14T09:09:13.779 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.779 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.779 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.780 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24482 3.1a 3.b46513a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.780 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.691782+0000", 2024-09-14T09:09:13.780 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9991922, 2024-09-14T09:09:13.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026859399999999998, 2024-09-14T09:09:13.780 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.780 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.780 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.780 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.780 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.780 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.780 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24482 2024-09-14T09:09:13.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.781 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691782+0000", 2024-09-14T09:09:13.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691782+0000", 2024-09-14T09:09:13.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691782+0000", 2024-09-14T09:09:13.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1400000000000001e-07 2024-09-14T09:09:13.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691783+0000", 2024-09-14T09:09:13.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0729999999999999e-06 2024-09-14T09:09:13.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691786+0000", 2024-09-14T09:09:13.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8219999999999998e-06 2024-09-14T09:09:13.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691788+0000", 2024-09-14T09:09:13.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5670000000000002e-06 2024-09-14T09:09:13.783 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.783 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.783 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.783 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24483 3.1a 3.b46513a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.783 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.691791+0000", 2024-09-14T09:09:13.783 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9991827, 2024-09-14T09:09:13.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00028344500000000001, 2024-09-14T09:09:13.783 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.783 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.783 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.783 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.784 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.784 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.784 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24483 2024-09-14T09:09:13.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.784 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691791+0000", 2024-09-14T09:09:13.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691791+0000", 2024-09-14T09:09:13.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691791+0000", 2024-09-14T09:09:13.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1500000000000001e-07 2024-09-14T09:09:13.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691793+0000", 2024-09-14T09:09:13.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.052e-06 2024-09-14T09:09:13.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691795+0000", 2024-09-14T09:09:13.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.79e-06 2024-09-14T09:09:13.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691798+0000", 2024-09-14T09:09:13.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5519999999999999e-06 2024-09-14T09:09:13.786 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.786 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.786 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.786 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24484 3.1a 3.b46513a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.786 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.691801+0000", 2024-09-14T09:09:13.786 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9991732, 2024-09-14T09:09:13.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00029709000000000002, 2024-09-14T09:09:13.787 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.787 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.787 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.787 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.787 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.787 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.787 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24484 2024-09-14T09:09:13.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.787 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691801+0000", 2024-09-14T09:09:13.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691801+0000", 2024-09-14T09:09:13.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691801+0000", 2024-09-14T09:09:13.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1500000000000001e-07 2024-09-14T09:09:13.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691802+0000", 2024-09-14T09:09:13.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.116e-06 2024-09-14T09:09:13.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691805+0000", 2024-09-14T09:09:13.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8559999999999998e-06 2024-09-14T09:09:13.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691808+0000", 2024-09-14T09:09:13.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5129999999999999e-06 2024-09-14T09:09:13.789 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.789 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.789 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.790 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24485 3.1a 3.b46513a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.790 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.691811+0000", 2024-09-14T09:09:13.790 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9991632, 2024-09-14T09:09:13.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00031032299999999999, 2024-09-14T09:09:13.790 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.790 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.790 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.790 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.790 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.790 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.790 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24485 2024-09-14T09:09:13.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.790 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691811+0000", 2024-09-14T09:09:13.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691811+0000", 2024-09-14T09:09:13.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691811+0000", 2024-09-14T09:09:13.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.11e-07 2024-09-14T09:09:13.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691812+0000", 2024-09-14T09:09:13.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.009e-06 2024-09-14T09:09:13.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691816+0000", 2024-09-14T09:09:13.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7910000000000002e-06 2024-09-14T09:09:13.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691818+0000", 2024-09-14T09:09:13.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6309999999999999e-06 2024-09-14T09:09:13.792 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.792 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.793 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.793 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:24486 3.1a 3.b46513a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e85)", 2024-09-14T09:09:13.793 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:13.691822+0000", 2024-09-14T09:09:13.793 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9991522, 2024-09-14T09:09:13.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032236299999999999, 2024-09-14T09:09:13.793 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:13.793 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:13.793 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:13.793 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:13.793 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:13.793 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:13.793 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24486 2024-09-14T09:09:13.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.794 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:13.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:13.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691822+0000", 2024-09-14T09:09:13.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:13.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691822+0000", 2024-09-14T09:09:13.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:13.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:13.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691822+0000", 2024-09-14T09:09:13.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.28e-07 2024-09-14T09:09:13.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:13.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691823+0000", 2024-09-14T09:09:13.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0809999999999999e-06 2024-09-14T09:09:13.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:13.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691826+0000", 2024-09-14T09:09:13.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8880000000000001e-06 2024-09-14T09:09:13.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:13.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:13.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:13.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:13.691828+0000", 2024-09-14T09:09:13.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.463e-06 2024-09-14T09:09:13.796 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.796 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:13.796 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.796 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:13.796 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:13.796 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 32 2024-09-14T09:09:13.796 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:13.797 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:13.799+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:13.798 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:09:13.798 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:13.799 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:13.799 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:13.799 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:13.800 INFO:teuthology.orchestra.run.smithi116.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-14T09:09:13.820 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:13.820 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:13.840 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T09:09:13.847 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:13.847 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:13.898 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:13.901+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:13.932 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:13.932 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:13.942 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:09:13.999 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:14.000+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:14.071 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:14.071 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:14.074 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T09:09:14.075 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T09:09:14.100 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:14.102+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:14.112 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:14.112 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:14.121 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:09:14.155 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:09:14.206 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:14.208+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:14.246 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:14.246 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:14.256 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:09:14.287 INFO:teuthology.orchestra.run.smithi116.stderr:no valid command found; 10 closest matches: 2024-09-14T09:09:14.288 INFO:teuthology.orchestra.run.smithi116.stderr:0 2024-09-14T09:09:14.288 INFO:teuthology.orchestra.run.smithi116.stderr:1 2024-09-14T09:09:14.288 INFO:teuthology.orchestra.run.smithi116.stderr:2 2024-09-14T09:09:14.288 INFO:teuthology.orchestra.run.smithi116.stderr:abort 2024-09-14T09:09:14.288 INFO:teuthology.orchestra.run.smithi116.stderr:assert 2024-09-14T09:09:14.288 INFO:teuthology.orchestra.run.smithi116.stderr:config diff 2024-09-14T09:09:14.289 INFO:teuthology.orchestra.run.smithi116.stderr:config diff get 2024-09-14T09:09:14.289 INFO:teuthology.orchestra.run.smithi116.stderr:config get 2024-09-14T09:09:14.289 INFO:teuthology.orchestra.run.smithi116.stderr:config help [] 2024-09-14T09:09:14.289 INFO:teuthology.orchestra.run.smithi116.stderr:config set ... 2024-09-14T09:09:14.289 INFO:teuthology.orchestra.run.smithi116.stderr:admin_socket: invalid command 2024-09-14T09:09:14.290 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T09:09:14.291 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-14T09:09:14.332 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:14.334+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:14.366 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:14.366 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:14.376 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:09:14.420 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:14.421+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:14.500 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:14.500 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:14.503 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:14.505+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:14.510 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:09:14.604 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:14.606+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:14.679 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:14.679 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:14.690 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:09:14.705 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:14.707+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:14.800 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:14.802+0000 7f0df545e640 -1 osd.2 67 log_to_monitors true 2024-09-14T09:09:14.805 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:14.807+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:14.840 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is unset 2024-09-14T09:09:14.846 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:14.848+0000 7f0de920c640 -1 osd.2 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T09:09:14.863 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:14.863 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:14.875 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:09:14.907 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:14.908+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:15.008 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:15.009+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:15.033 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:15.033 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:15.042 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:09:15.109 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:15.110+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:15.188 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:15.188 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:15.198 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:15.243 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:15.244+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:15.310 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:15.311+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:15.329 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:15.329 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:15.339 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:09:15.423 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:15.424+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:15.512 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:15.513+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:15.513 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:15.513 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:15.523 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:09:15.613 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:15.614+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:15.675 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:15.675 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:15.686 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:09:15.714 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:15.715+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:15.814 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:15.816+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:15.837 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:15.837 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:15.848 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:09:15.916 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:15.917+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:15.992 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:15.992 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:16.003 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:09:16.017 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:16.018+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:16.075 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:09:16.118 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:16.119+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:16.124 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:16.124 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:16.138 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:09:16.220 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:16.222+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:16.244 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:16.244 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:16.269 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:16.269 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:16.287 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:16.287 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:16.287 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:16.287 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:16.287 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:16.294 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:09:16.295 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-09-14T09:09:16.297 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:09:16.322 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:16.322 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:16.323 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:16.323+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:16.349 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:16.350 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:16.379 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:16.379 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:16.425 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:16.426+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:16.475 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:16.475 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:16.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:16.475 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:16.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:987 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.617287506, 2024-09-14T09:09:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001359466, 2024-09-14T09:09:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 987 2024-09-14T09:09:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858333+0000", 2024-09-14T09:09:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.621e-06 2024-09-14T09:09:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858349+0000", 2024-09-14T09:09:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5758000000000001e-05 2024-09-14T09:09:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858366+0000", 2024-09-14T09:09:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7368e-05 2024-09-14T09:09:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858382+0000", 2024-09-14T09:09:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6039e-05 2024-09-14T09:09:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858441+0000", 2024-09-14T09:09:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8662999999999997e-05 2024-09-14T09:09:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858449+0000", 2024-09-14T09:09:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3960000000000006e-06 2024-09-14T09:09:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859682+0000", 2024-09-14T09:09:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001233096 2024-09-14T09:09:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859691+0000", 2024-09-14T09:09:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5250000000000005e-06 2024-09-14T09:09:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:988 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.617159636, 2024-09-14T09:09:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0012656799999999, 2024-09-14T09:09:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 988 2024-09-14T09:09:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858460+0000", 2024-09-14T09:09:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9999999999999997e-07 2024-09-14T09:09:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858463+0000", 2024-09-14T09:09:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7459999999999998e-06 2024-09-14T09:09:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858471+0000", 2024-09-14T09:09:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3900000000000004e-06 2024-09-14T09:09:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858478+0000", 2024-09-14T09:09:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7020000000000004e-06 2024-09-14T09:09:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859102+0000", 2024-09-14T09:09:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062419699999999995 2024-09-14T09:09:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859109+0000", 2024-09-14T09:09:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7419999999999997e-06 2024-09-14T09:09:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859718+0000", 2024-09-14T09:09:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006085629999999 2024-09-14T09:09:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859725+0000", 2024-09-14T09:09:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7399999999999998e-06 2024-09-14T09:09:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:989 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859046+0000", 2024-09-14T09:09:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.616572965, 2024-09-14T09:09:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000708894, 2024-09-14T09:09:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 989 2024-09-14T09:09:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859046+0000", 2024-09-14T09:09:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859046+0000", 2024-09-14T09:09:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859046+0000", 2024-09-14T09:09:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9599999999999999e-07 2024-09-14T09:09:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859050+0000", 2024-09-14T09:09:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9380000000000002e-06 2024-09-14T09:09:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859062+0000", 2024-09-14T09:09:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2103000000000001e-05 2024-09-14T09:09:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859072+0000", 2024-09-14T09:09:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4870000000000008e-06 2024-09-14T09:09:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859320+0000", 2024-09-14T09:09:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024821799999999997 2024-09-14T09:09:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859327+0000", 2024-09-14T09:09:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0480000000000001e-06 2024-09-14T09:09:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859746+0000", 2024-09-14T09:09:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0004190479999999 2024-09-14T09:09:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859755+0000", 2024-09-14T09:09:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3559999999999993e-06 2024-09-14T09:09:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:990 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859286+0000", 2024-09-14T09:09:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.616332223000001, 2024-09-14T09:09:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0004942889999999, 2024-09-14T09:09:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 990 2024-09-14T09:09:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859286+0000", 2024-09-14T09:09:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859286+0000", 2024-09-14T09:09:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859287+0000", 2024-09-14T09:09:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1900000000000002e-07 2024-09-14T09:09:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859291+0000", 2024-09-14T09:09:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1239999999999998e-06 2024-09-14T09:09:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859302+0000", 2024-09-14T09:09:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0849999999999999e-05 2024-09-14T09:09:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859309+0000", 2024-09-14T09:09:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2880000000000004e-06 2024-09-14T09:09:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859352+0000", 2024-09-14T09:09:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2726999999999999e-05 2024-09-14T09:09:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4689999999999996e-06 2024-09-14T09:09:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859774+0000", 2024-09-14T09:09:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000416108 2024-09-14T09:09:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859781+0000", 2024-09-14T09:09:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0040000000000002e-06 2024-09-14T09:09:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1003 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.616296398999999, 2024-09-14T09:09:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009495209999999, 2024-09-14T09:09:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1003 2024-09-14T09:09:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859323+0000", 2024-09-14T09:09:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3099999999999998e-07 2024-09-14T09:09:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859326+0000", 2024-09-14T09:09:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-06 2024-09-14T09:09:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859333+0000", 2024-09-14T09:09:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3300000000000001e-06 2024-09-14T09:09:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859339+0000", 2024-09-14T09:09:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6400000000000002e-06 2024-09-14T09:09:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859387+0000", 2024-09-14T09:09:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8448000000000001e-05 2024-09-14T09:09:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:09:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9540000000000004e-06 2024-09-14T09:09:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860260+0000", 2024-09-14T09:09:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000864921 2024-09-14T09:09:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860272+0000", 2024-09-14T09:09:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1993e-05 2024-09-14T09:09:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1004 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.616260824000001, 2024-09-14T09:09:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000947875, 2024-09-14T09:09:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1004 2024-09-14T09:09:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7199999999999999e-07 2024-09-14T09:09:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859361+0000", 2024-09-14T09:09:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.892e-06 2024-09-14T09:09:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859368+0000", 2024-09-14T09:09:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4370000000000004e-06 2024-09-14T09:09:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859373+0000", 2024-09-14T09:09:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6690000000000003e-06 2024-09-14T09:09:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859430+0000", 2024-09-14T09:09:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6456999999999998e-05 2024-09-14T09:09:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859434+0000", 2024-09-14T09:09:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8410000000000002e-06 2024-09-14T09:09:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860299+0000", 2024-09-14T09:09:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008650370000001 2024-09-14T09:09:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860306+0000", 2024-09-14T09:09:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0700000000000001e-06 2024-09-14T09:09:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1005 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.616237151, 2024-09-14T09:09:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009585480000001, 2024-09-14T09:09:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1005 2024-09-14T09:09:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9700000000000002e-07 2024-09-14T09:09:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859384+0000", 2024-09-14T09:09:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.024e-06 2024-09-14T09:09:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859390+0000", 2024-09-14T09:09:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7080000000000002e-06 2024-09-14T09:09:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:09:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8980000000000004e-06 2024-09-14T09:09:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859527+0000", 2024-09-14T09:09:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013228099999999999 2024-09-14T09:09:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859532+0000", 2024-09-14T09:09:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5899999999999998e-06 2024-09-14T09:09:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860330+0000", 2024-09-14T09:09:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0007973509999999 2024-09-14T09:09:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860340+0000", 2024-09-14T09:09:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0299000000000001e-05 2024-09-14T09:09:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1006 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.616213954999999, 2024-09-14T09:09:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001032039, 2024-09-14T09:09:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1006 2024-09-14T09:09:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6499999999999999e-07 2024-09-14T09:09:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859407+0000", 2024-09-14T09:09:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1160000000000002e-06 2024-09-14T09:09:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859413+0000", 2024-09-14T09:09:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8880000000000002e-06 2024-09-14T09:09:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859419+0000", 2024-09-14T09:09:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3550000000000004e-06 2024-09-14T09:09:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859558+0000", 2024-09-14T09:09:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000138942 2024-09-14T09:09:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859563+0000", 2024-09-14T09:09:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.665e-06 2024-09-14T09:09:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860427+0000", 2024-09-14T09:09:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008635299999999 2024-09-14T09:09:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860437+0000", 2024-09-14T09:09:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0078000000000001e-05 2024-09-14T09:09:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1029 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859527+0000", 2024-09-14T09:09:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.616091405999999, 2024-09-14T09:09:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0002818689999999, 2024-09-14T09:09:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1029 2024-09-14T09:09:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859527+0000", 2024-09-14T09:09:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859527+0000", 2024-09-14T09:09:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859528+0000", 2024-09-14T09:09:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0200000000000002e-07 2024-09-14T09:09:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859530+0000", 2024-09-14T09:09:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3810000000000002e-06 2024-09-14T09:09:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859536+0000", 2024-09-14T09:09:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0000000000000002e-06 2024-09-14T09:09:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859541+0000", 2024-09-14T09:09:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2159999999999997e-06 2024-09-14T09:09:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859580+0000", 2024-09-14T09:09:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8432000000000001e-05 2024-09-14T09:09:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859587+0000", 2024-09-14T09:09:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7989999999999996e-06 2024-09-14T09:09:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859801+0000", 2024-09-14T09:09:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000214315 2024-09-14T09:09:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859809+0000", 2024-09-14T09:09:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2239999999999995e-06 2024-09-14T09:09:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1030 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859553+0000", 2024-09-14T09:09:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.616065879000001, 2024-09-14T09:09:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0002901259999999, 2024-09-14T09:09:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1030 2024-09-14T09:09:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859553+0000", 2024-09-14T09:09:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859553+0000", 2024-09-14T09:09:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859553+0000", 2024-09-14T09:09:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8599999999999999e-07 2024-09-14T09:09:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859556+0000", 2024-09-14T09:09:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5679999999999998e-06 2024-09-14T09:09:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859561+0000", 2024-09-14T09:09:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.682e-06 2024-09-14T09:09:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859564+0000", 2024-09-14T09:09:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8380000000000002e-06 2024-09-14T09:09:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859619+0000", 2024-09-14T09:09:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4761e-05 2024-09-14T09:09:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859624+0000", 2024-09-14T09:09:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3360000000000002e-06 2024-09-14T09:09:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859834+0000", 2024-09-14T09:09:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0002094290000001 2024-09-14T09:09:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859843+0000", 2024-09-14T09:09:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1260000000000004e-06 2024-09-14T09:09:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1031 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859574+0000", 2024-09-14T09:09:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.616044762000001, 2024-09-14T09:09:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0002981630000001, 2024-09-14T09:09:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1031 2024-09-14T09:09:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859574+0000", 2024-09-14T09:09:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859574+0000", 2024-09-14T09:09:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859574+0000", 2024-09-14T09:09:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7000000000000001e-07 2024-09-14T09:09:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859576+0000", 2024-09-14T09:09:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3069999999999999e-06 2024-09-14T09:09:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859579+0000", 2024-09-14T09:09:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3680000000000002e-06 2024-09-14T09:09:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859582+0000", 2024-09-14T09:09:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6029999999999999e-06 2024-09-14T09:09:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9903999999999999e-05 2024-09-14T09:09:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859667+0000", 2024-09-14T09:09:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.711e-06 2024-09-14T09:09:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859862+0000", 2024-09-14T09:09:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000194732 2024-09-14T09:09:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859872+0000", 2024-09-14T09:09:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268000000000001e-05 2024-09-14T09:09:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1032 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859586+0000", 2024-09-14T09:09:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.616032718, 2024-09-14T09:09:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000315565, 2024-09-14T09:09:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1032 2024-09-14T09:09:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859586+0000", 2024-09-14T09:09:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859586+0000", 2024-09-14T09:09:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859586+0000", 2024-09-14T09:09:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.05e-07 2024-09-14T09:09:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859587+0000", 2024-09-14T09:09:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9600000000000008e-07 2024-09-14T09:09:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859590+0000", 2024-09-14T09:09:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9239999999999999e-06 2024-09-14T09:09:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859593+0000", 2024-09-14T09:09:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5160000000000001e-06 2024-09-14T09:09:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859687+0000", 2024-09-14T09:09:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4197000000000006e-05 2024-09-14T09:09:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859692+0000", 2024-09-14T09:09:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8960000000000002e-06 2024-09-14T09:09:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859895+0000", 2024-09-14T09:09:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0002035090000001 2024-09-14T09:09:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859902+0000", 2024-09-14T09:09:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3219999999999998e-06 2024-09-14T09:09:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1045 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.616014475, 2024-09-14T09:09:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008612990000001, 2024-09-14T09:09:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1045 2024-09-14T09:09:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859605+0000", 2024-09-14T09:09:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6e-07 2024-09-14T09:09:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859606+0000", 2024-09-14T09:09:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8819999999999999e-06 2024-09-14T09:09:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859610+0000", 2024-09-14T09:09:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4290000000000001e-06 2024-09-14T09:09:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859612+0000", 2024-09-14T09:09:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6309999999999999e-06 2024-09-14T09:09:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859643+0000", 2024-09-14T09:09:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0224000000000001e-05 2024-09-14T09:09:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859647+0000", 2024-09-14T09:09:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9049999999999999e-06 2024-09-14T09:09:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860458+0000", 2024-09-14T09:09:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008111180000001 2024-09-14T09:09:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860466+0000", 2024-09-14T09:09:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:09:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1046 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.616001017999999, 2024-09-14T09:09:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000874262, 2024-09-14T09:09:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1046 2024-09-14T09:09:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:09:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859619+0000", 2024-09-14T09:09:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0559999999999999e-06 2024-09-14T09:09:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859622+0000", 2024-09-14T09:09:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0170000000000001e-06 2024-09-14T09:09:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859625+0000", 2024-09-14T09:09:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7209999999999999e-06 2024-09-14T09:09:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859666+0000", 2024-09-14T09:09:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1677000000000001e-05 2024-09-14T09:09:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859672+0000", 2024-09-14T09:09:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4609999999999999e-06 2024-09-14T09:09:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860485+0000", 2024-09-14T09:09:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000813505 2024-09-14T09:09:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860492+0000", 2024-09-14T09:09:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6159999999999998e-06 2024-09-14T09:09:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1047 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.615989683999999, 2024-09-14T09:09:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008950190000001, 2024-09-14T09:09:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1047 2024-09-14T09:09:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6600000000000003e-07 2024-09-14T09:09:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859631+0000", 2024-09-14T09:09:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5600000000000001e-06 2024-09-14T09:09:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859637+0000", 2024-09-14T09:09:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7309999999999998e-06 2024-09-14T09:09:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859641+0000", 2024-09-14T09:09:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0840000000000002e-06 2024-09-14T09:09:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859691+0000", 2024-09-14T09:09:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0587999999999997e-05 2024-09-14T09:09:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859696+0000", 2024-09-14T09:09:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8940000000000001e-06 2024-09-14T09:09:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860516+0000", 2024-09-14T09:09:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008200780000001 2024-09-14T09:09:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860524+0000", 2024-09-14T09:09:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8180000000000004e-06 2024-09-14T09:09:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1048 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.615957925, 2024-09-14T09:09:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008904780000001, 2024-09-14T09:09:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1048 2024-09-14T09:09:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4700000000000002e-07 2024-09-14T09:09:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859663+0000", 2024-09-14T09:09:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0420000000000001e-06 2024-09-14T09:09:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859669+0000", 2024-09-14T09:09:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8989999999999998e-06 2024-09-14T09:09:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859673+0000", 2024-09-14T09:09:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2209999999999999e-06 2024-09-14T09:09:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859719+0000", 2024-09-14T09:09:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5788000000000003e-05 2024-09-14T09:09:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859725+0000", 2024-09-14T09:09:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4770000000000002e-06 2024-09-14T09:09:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860544+0000", 2024-09-14T09:09:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008194669999999 2024-09-14T09:09:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860551+0000", 2024-09-14T09:09:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1369999999999996e-06 2024-09-14T09:09:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1087 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859865+0000", 2024-09-14T09:09:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.615753623, 2024-09-14T09:09:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000716274, 2024-09-14T09:09:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1087 2024-09-14T09:09:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859865+0000", 2024-09-14T09:09:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859865+0000", 2024-09-14T09:09:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859865+0000", 2024-09-14T09:09:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4999999999999999e-07 2024-09-14T09:09:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859867+0000", 2024-09-14T09:09:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2049999999999999e-06 2024-09-14T09:09:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859871+0000", 2024-09-14T09:09:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0080000000000004e-06 2024-09-14T09:09:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859873+0000", 2024-09-14T09:09:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9409999999999999e-06 2024-09-14T09:09:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859906+0000", 2024-09-14T09:09:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2801e-05 2024-09-14T09:09:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859912+0000", 2024-09-14T09:09:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3909999999999997e-06 2024-09-14T09:09:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860574+0000", 2024-09-14T09:09:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006619919999999 2024-09-14T09:09:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860581+0000", 2024-09-14T09:09:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6860000000000006e-06 2024-09-14T09:09:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1088 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.615739088000002, 2024-09-14T09:09:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00073166, 2024-09-14T09:09:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1088 2024-09-14T09:09:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3700000000000001e-07 2024-09-14T09:09:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859882+0000", 2024-09-14T09:09:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.739e-06 2024-09-14T09:09:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859887+0000", 2024-09-14T09:09:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:09:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859892+0000", 2024-09-14T09:09:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7119999999999999e-06 2024-09-14T09:09:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859945+0000", 2024-09-14T09:09:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2762000000000001e-05 2024-09-14T09:09:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859950+0000", 2024-09-14T09:09:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-09-14T09:09:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860603+0000", 2024-09-14T09:09:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000653263 2024-09-14T09:09:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860611+0000", 2024-09-14T09:09:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-09-14T09:09:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1089 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.615720931999999, 2024-09-14T09:09:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000733943, 2024-09-14T09:09:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1089 2024-09-14T09:09:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3000000000000002e-07 2024-09-14T09:09:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859900+0000", 2024-09-14T09:09:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9199999999999998e-06 2024-09-14T09:09:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859906+0000", 2024-09-14T09:09:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0889999999999996e-06 2024-09-14T09:09:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859911+0000", 2024-09-14T09:09:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6419999999999998e-06 2024-09-14T09:09:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860010+0000", 2024-09-14T09:09:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8956000000000006e-05 2024-09-14T09:09:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860014+0000", 2024-09-14T09:09:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.741e-06 2024-09-14T09:09:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860627+0000", 2024-09-14T09:09:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00061277 2024-09-14T09:09:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860632+0000", 2024-09-14T09:09:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:09:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1090 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.615701260000002, 2024-09-14T09:09:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000740763, 2024-09-14T09:09:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1090 2024-09-14T09:09:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859918+0000", 2024-09-14T09:09:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5199999999999998e-07 2024-09-14T09:09:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859920+0000", 2024-09-14T09:09:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9240000000000001e-06 2024-09-14T09:09:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859925+0000", 2024-09-14T09:09:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3929999999999999e-06 2024-09-14T09:09:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859929+0000", 2024-09-14T09:09:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4769999999999999e-06 2024-09-14T09:09:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860034+0000", 2024-09-14T09:09:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010549500000000001 2024-09-14T09:09:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860039+0000", 2024-09-14T09:09:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5700000000000003e-06 2024-09-14T09:09:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860650+0000", 2024-09-14T09:09:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006116119999999 2024-09-14T09:09:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860658+0000", 2024-09-14T09:09:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:09:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:16.575 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.575 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:16.575 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:16.575 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:16.576 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:16.577+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:16.577 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:09:16.677 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:16.679+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:16.723 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:16.724 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:16.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.724 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72064 3.16 3.42199656 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:16.724 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.722515+0000", 2024-09-14T09:09:16.724 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0027521860000000002, 2024-09-14T09:09:16.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027653600000000001, 2024-09-14T09:09:16.724 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:16.724 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:16.724 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:16.724 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:16.724 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:16.725 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:16.725 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72064 2024-09-14T09:09:16.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.725 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:16.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:16.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722515+0000", 2024-09-14T09:09:16.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:16.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722515+0000", 2024-09-14T09:09:16.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:16.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722515+0000", 2024-09-14T09:09:16.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4499999999999997e-07 2024-09-14T09:09:16.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:16.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722518+0000", 2024-09-14T09:09:16.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9239999999999999e-06 2024-09-14T09:09:16.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:16.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722525+0000", 2024-09-14T09:09:16.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2870000000000001e-06 2024-09-14T09:09:16.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722530+0000", 2024-09-14T09:09:16.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4269999999999999e-06 2024-09-14T09:09:16.728 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.728 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:16.729 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.729 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72066 3.16 3.42199656 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:16.729 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.722536+0000", 2024-09-14T09:09:16.729 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0027307220000000001, 2024-09-14T09:09:16.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027774000000000002, 2024-09-14T09:09:16.729 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:16.729 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:16.729 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:16.730 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:16.730 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:16.730 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:16.730 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72066 2024-09-14T09:09:16.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.730 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:16.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:16.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722536+0000", 2024-09-14T09:09:16.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:16.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722536+0000", 2024-09-14T09:09:16.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:16.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722537+0000", 2024-09-14T09:09:16.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3099999999999999e-07 2024-09-14T09:09:16.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:16.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722538+0000", 2024-09-14T09:09:16.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.641e-06 2024-09-14T09:09:16.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:16.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722544+0000", 2024-09-14T09:09:16.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8499999999999999e-06 2024-09-14T09:09:16.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722549+0000", 2024-09-14T09:09:16.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5859999999999998e-06 2024-09-14T09:09:16.734 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.734 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:16.734 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.734 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:65840 3.9 3.94cda6a9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:16.734 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.412988+0000", 2024-09-14T09:09:16.734 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.31227867100000001, 2024-09-14T09:09:16.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.312359094, 2024-09-14T09:09:16.734 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:16.734 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:16.735 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:16.735 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:16.735 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:16.735 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:16.735 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 65840 2024-09-14T09:09:16.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.735 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:16.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:16.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.412988+0000", 2024-09-14T09:09:16.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:16.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.412988+0000", 2024-09-14T09:09:16.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:16.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.412989+0000", 2024-09-14T09:09:16.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.006e-06 2024-09-14T09:09:16.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:16.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.412994+0000", 2024-09-14T09:09:16.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4399999999999998e-06 2024-09-14T09:09:16.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:16.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.413005+0000", 2024-09-14T09:09:16.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1369000000000001e-05 2024-09-14T09:09:16.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.413013+0000", 2024-09-14T09:09:16.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6739999999999997e-06 2024-09-14T09:09:16.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:16.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.413071+0000", 2024-09-14T09:09:16.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7738999999999997e-05 2024-09-14T09:09:16.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:16.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.413080+0000", 2024-09-14T09:09:16.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7289999999999995e-06 2024-09-14T09:09:16.738 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.738 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:16.738 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.739 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72068 3.16 3.42199656 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:16.739 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.722706+0000", 2024-09-14T09:09:16.739 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0025615289999999999, 2024-09-14T09:09:16.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002670623, 2024-09-14T09:09:16.739 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:16.739 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:16.739 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:16.739 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:16.739 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:16.739 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:16.739 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72068 2024-09-14T09:09:16.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.740 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:16.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:16.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722706+0000", 2024-09-14T09:09:16.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:16.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722706+0000", 2024-09-14T09:09:16.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:16.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722706+0000", 2024-09-14T09:09:16.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9999999999999997e-07 2024-09-14T09:09:16.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:16.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722710+0000", 2024-09-14T09:09:16.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2720000000000002e-06 2024-09-14T09:09:16.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:16.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722717+0000", 2024-09-14T09:09:16.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3980000000000002e-06 2024-09-14T09:09:16.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722772+0000", 2024-09-14T09:09:16.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4589000000000002e-05 2024-09-14T09:09:16.742 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.742 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:16.742 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.743 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72070 3.16 3.42199656 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:16.743 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.722784+0000", 2024-09-14T09:09:16.743 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0024832270000000002, 2024-09-14T09:09:16.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026163879999999999, 2024-09-14T09:09:16.743 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:16.743 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:16.743 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:16.743 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:16.743 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:16.743 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:16.743 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72070 2024-09-14T09:09:16.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.743 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:16.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:16.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722784+0000", 2024-09-14T09:09:16.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:16.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722784+0000", 2024-09-14T09:09:16.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:16.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722784+0000", 2024-09-14T09:09:16.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0800000000000004e-07 2024-09-14T09:09:16.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:16.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722788+0000", 2024-09-14T09:09:16.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2629999999999999e-06 2024-09-14T09:09:16.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:16.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722795+0000", 2024-09-14T09:09:16.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4959999999999999e-06 2024-09-14T09:09:16.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722801+0000", 2024-09-14T09:09:16.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7799999999999997e-06 2024-09-14T09:09:16.745 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.746 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:16.746 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.746 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72072 3.16 3.42199656 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:16.746 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.722821+0000", 2024-09-14T09:09:16.746 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0024461750000000001, 2024-09-14T09:09:16.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026016590000000001, 2024-09-14T09:09:16.746 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:16.746 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:16.746 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:16.746 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:16.746 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:16.746 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:16.747 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72072 2024-09-14T09:09:16.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.747 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:16.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:16.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722821+0000", 2024-09-14T09:09:16.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:16.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722821+0000", 2024-09-14T09:09:16.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:16.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722822+0000", 2024-09-14T09:09:16.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-07 2024-09-14T09:09:16.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:16.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722833+0000", 2024-09-14T09:09:16.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1328000000000001e-05 2024-09-14T09:09:16.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:16.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722868+0000", 2024-09-14T09:09:16.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5014000000000001e-05 2024-09-14T09:09:16.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722874+0000", 2024-09-14T09:09:16.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5309999999999998e-06 2024-09-14T09:09:16.749 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.749 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:16.749 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.749 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72074 3.16 3.42199656 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:16.749 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.722960+0000", 2024-09-14T09:09:16.750 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002307108, 2024-09-14T09:09:16.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024869750000000002, 2024-09-14T09:09:16.750 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:16.750 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:16.750 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:16.750 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:16.750 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:16.750 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:16.750 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72074 2024-09-14T09:09:16.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.750 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:16.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:16.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722960+0000", 2024-09-14T09:09:16.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:16.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722960+0000", 2024-09-14T09:09:16.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:16.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722961+0000", 2024-09-14T09:09:16.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000001e-07 2024-09-14T09:09:16.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:16.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722972+0000", 2024-09-14T09:09:16.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1481000000000001e-05 2024-09-14T09:09:16.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:16.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722982+0000", 2024-09-14T09:09:16.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9979999999999998e-06 2024-09-14T09:09:16.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.723172+0000", 2024-09-14T09:09:16.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018978500000000001 2024-09-14T09:09:16.752 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.753 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:16.753 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.753 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72076 3.16 3.42199656 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:16.753 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.723257+0000", 2024-09-14T09:09:16.753 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002010436, 2024-09-14T09:09:16.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002213422, 2024-09-14T09:09:16.753 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:16.753 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:16.753 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:16.753 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:16.753 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:16.753 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:16.753 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72076 2024-09-14T09:09:16.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.754 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:16.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:16.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.723257+0000", 2024-09-14T09:09:16.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:16.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.723257+0000", 2024-09-14T09:09:16.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:16.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.723257+0000", 2024-09-14T09:09:16.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9500000000000001e-07 2024-09-14T09:09:16.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:16.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.723265+0000", 2024-09-14T09:09:16.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.058e-06 2024-09-14T09:09:16.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:16.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.723309+0000", 2024-09-14T09:09:16.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4345999999999999e-05 2024-09-14T09:09:16.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.723316+0000", 2024-09-14T09:09:16.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8229999999999997e-06 2024-09-14T09:09:16.756 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.756 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:16.756 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.756 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72078 3.16 3.42199656 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:16.756 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.723327+0000", 2024-09-14T09:09:16.756 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001939879, 2024-09-14T09:09:16.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021657989999999999, 2024-09-14T09:09:16.757 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:16.757 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:16.757 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:16.757 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:16.757 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:16.757 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:16.757 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72078 2024-09-14T09:09:16.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.757 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:16.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:16.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.723327+0000", 2024-09-14T09:09:16.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:16.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.723327+0000", 2024-09-14T09:09:16.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:16.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.723328+0000", 2024-09-14T09:09:16.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9299999999999998e-07 2024-09-14T09:09:16.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:16.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.723331+0000", 2024-09-14T09:09:16.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4640000000000002e-06 2024-09-14T09:09:16.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:16.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.723339+0000", 2024-09-14T09:09:16.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.61e-06 2024-09-14T09:09:16.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.723356+0000", 2024-09-14T09:09:16.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6997e-05 2024-09-14T09:09:16.759 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.759 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:16.760 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.760 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:68694 3.9 3.824eee69 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:16.760 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.540582+0000", 2024-09-14T09:09:16.760 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.18468517300000001, 2024-09-14T09:09:16.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.184936248, 2024-09-14T09:09:16.760 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:16.760 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:16.760 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:16.760 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:16.760 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:16.760 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:16.760 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 68694 2024-09-14T09:09:16.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.761 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:16.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:16.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.540582+0000", 2024-09-14T09:09:16.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:16.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.540582+0000", 2024-09-14T09:09:16.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:16.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.540583+0000", 2024-09-14T09:09:16.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.15e-06 2024-09-14T09:09:16.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:16.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.540588+0000", 2024-09-14T09:09:16.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.271e-06 2024-09-14T09:09:16.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:16.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.540600+0000", 2024-09-14T09:09:16.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1734e-05 2024-09-14T09:09:16.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.540608+0000", 2024-09-14T09:09:16.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3399999999999998e-06 2024-09-14T09:09:16.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:16.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.540676+0000", 2024-09-14T09:09:16.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7625000000000004e-05 2024-09-14T09:09:16.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:16.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.540685+0000", 2024-09-14T09:09:16.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2250000000000006e-06 2024-09-14T09:09:16.764 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.764 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:16.764 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.764 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72046 3.16 3:6a699842:::rbd_data.1112b1c2f9b0.0000000000000007:20 [read 13443072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:16.764 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.722075+0000", 2024-09-14T09:09:16.764 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0031924029999999999, 2024-09-14T09:09:16.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034576350000000001, 2024-09-14T09:09:16.764 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:16.764 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:16.764 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:16.765 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:16.765 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:16.765 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:16.765 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72046 2024-09-14T09:09:16.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.765 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:16.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:16.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722075+0000", 2024-09-14T09:09:16.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:16.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722075+0000", 2024-09-14T09:09:16.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:16.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722075+0000", 2024-09-14T09:09:16.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6400000000000003e-07 2024-09-14T09:09:16.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:16.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722077+0000", 2024-09-14T09:09:16.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2730000000000001e-06 2024-09-14T09:09:16.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:16.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722084+0000", 2024-09-14T09:09:16.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7309999999999996e-06 2024-09-14T09:09:16.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722089+0000", 2024-09-14T09:09:16.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2079999999999999e-06 2024-09-14T09:09:16.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:16.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.725361+0000", 2024-09-14T09:09:16.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032711630000000001 2024-09-14T09:09:16.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:16.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.725452+0000", 2024-09-14T09:09:16.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1325999999999999e-05 2024-09-14T09:09:16.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:16.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.725532+0000", 2024-09-14T09:09:16.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0469999999999994e-05 2024-09-14T09:09:16.769 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.769 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:16.769 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.769 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72048 3.16 3:6a699842:::rbd_data.1112b1c2f9b0.0000000000000007:20 [read 13455360~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:16.770 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.722096+0000", 2024-09-14T09:09:16.770 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0031711589999999998, 2024-09-14T09:09:16.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003508803, 2024-09-14T09:09:16.770 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:16.770 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:16.770 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:16.770 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:16.770 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:16.770 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:16.770 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72048 2024-09-14T09:09:16.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.770 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:16.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:16.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722096+0000", 2024-09-14T09:09:16.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:16.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722096+0000", 2024-09-14T09:09:16.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:16.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722096+0000", 2024-09-14T09:09:16.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9900000000000001e-07 2024-09-14T09:09:16.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:16.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722098+0000", 2024-09-14T09:09:16.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.84e-06 2024-09-14T09:09:16.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:16.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722104+0000", 2024-09-14T09:09:16.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0929999999999999e-06 2024-09-14T09:09:16.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722111+0000", 2024-09-14T09:09:16.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8260000000000004e-06 2024-09-14T09:09:16.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:16.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.725556+0000", 2024-09-14T09:09:16.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034450399999999999 2024-09-14T09:09:16.773 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.773 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:16.774 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.774 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72050 3.16 3.42199656 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:16.774 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.722118+0000", 2024-09-14T09:09:16.774 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003148961, 2024-09-14T09:09:16.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035120989999999999, 2024-09-14T09:09:16.774 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:16.774 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:16.774 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:16.774 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:16.774 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:16.774 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:16.775 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72050 2024-09-14T09:09:16.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.775 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:16.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:16.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722118+0000", 2024-09-14T09:09:16.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:16.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722118+0000", 2024-09-14T09:09:16.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:16.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722119+0000", 2024-09-14T09:09:16.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.72e-07 2024-09-14T09:09:16.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:16.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722121+0000", 2024-09-14T09:09:16.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.193e-06 2024-09-14T09:09:16.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:16.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722128+0000", 2024-09-14T09:09:16.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5349999999999999e-06 2024-09-14T09:09:16.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722134+0000", 2024-09-14T09:09:16.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2639999999999999e-06 2024-09-14T09:09:16.777 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.777 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:16.777 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.777 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72052 3.16 3.42199656 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:16.777 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.722140+0000", 2024-09-14T09:09:16.777 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0031271150000000002, 2024-09-14T09:09:16.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003512837, 2024-09-14T09:09:16.777 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:16.778 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:16.778 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:16.778 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:16.778 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:16.778 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:16.778 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72052 2024-09-14T09:09:16.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.778 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:16.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:16.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722140+0000", 2024-09-14T09:09:16.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:16.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722140+0000", 2024-09-14T09:09:16.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:16.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722140+0000", 2024-09-14T09:09:16.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4700000000000002e-07 2024-09-14T09:09:16.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:16.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722142+0000", 2024-09-14T09:09:16.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9980000000000002e-06 2024-09-14T09:09:16.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:16.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722150+0000", 2024-09-14T09:09:16.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.481e-06 2024-09-14T09:09:16.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722155+0000", 2024-09-14T09:09:16.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2739999999999998e-06 2024-09-14T09:09:16.780 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.780 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:16.780 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.781 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72054 3.16 3.42199656 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:16.781 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.722162+0000", 2024-09-14T09:09:16.781 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0031054049999999999, 2024-09-14T09:09:16.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035154240000000001, 2024-09-14T09:09:16.781 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:16.781 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:16.781 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:16.781 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:16.781 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:16.781 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:16.781 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72054 2024-09-14T09:09:16.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.782 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:16.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:16.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722162+0000", 2024-09-14T09:09:16.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:16.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722162+0000", 2024-09-14T09:09:16.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:16.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722162+0000", 2024-09-14T09:09:16.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8700000000000001e-07 2024-09-14T09:09:16.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:16.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722164+0000", 2024-09-14T09:09:16.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8670000000000001e-06 2024-09-14T09:09:16.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:16.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722171+0000", 2024-09-14T09:09:16.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1330000000000001e-06 2024-09-14T09:09:16.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722177+0000", 2024-09-14T09:09:16.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.417e-06 2024-09-14T09:09:16.784 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.784 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:16.784 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.784 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72056 3.16 3.42199656 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:16.784 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.722187+0000", 2024-09-14T09:09:16.784 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003080129, 2024-09-14T09:09:16.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035214970000000002, 2024-09-14T09:09:16.784 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:16.784 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:16.784 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:16.785 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:16.785 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:16.785 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:16.785 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72056 2024-09-14T09:09:16.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.785 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:16.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:16.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722187+0000", 2024-09-14T09:09:16.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:16.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722187+0000", 2024-09-14T09:09:16.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:16.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722187+0000", 2024-09-14T09:09:16.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0999999999999999e-07 2024-09-14T09:09:16.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:16.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722190+0000", 2024-09-14T09:09:16.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3140000000000002e-06 2024-09-14T09:09:16.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:16.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722199+0000", 2024-09-14T09:09:16.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9060000000000008e-06 2024-09-14T09:09:16.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722204+0000", 2024-09-14T09:09:16.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3310000000000003e-06 2024-09-14T09:09:16.787 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.787 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:16.787 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.787 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72059 3.16 3.42199656 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:16.787 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.722261+0000", 2024-09-14T09:09:16.787 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003006112, 2024-09-14T09:09:16.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034834219999999999, 2024-09-14T09:09:16.788 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:16.788 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:16.788 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:16.788 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:16.788 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:16.788 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:16.788 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72059 2024-09-14T09:09:16.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.788 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:16.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:16.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722261+0000", 2024-09-14T09:09:16.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:16.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722261+0000", 2024-09-14T09:09:16.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:16.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722262+0000", 2024-09-14T09:09:16.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1200000000000003e-07 2024-09-14T09:09:16.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:16.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722265+0000", 2024-09-14T09:09:16.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2600000000000001e-06 2024-09-14T09:09:16.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:16.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722273+0000", 2024-09-14T09:09:16.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4619999999999996e-06 2024-09-14T09:09:16.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722280+0000", 2024-09-14T09:09:16.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2219999999999999e-06 2024-09-14T09:09:16.790 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.791 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:16.791 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.791 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72062 3.16 3.42199656 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:16.791 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.722470+0000", 2024-09-14T09:09:16.791 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0027971649999999999, 2024-09-14T09:09:16.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032980829999999998, 2024-09-14T09:09:16.791 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:16.791 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:16.791 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:16.791 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:16.791 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:16.791 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:16.792 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72062 2024-09-14T09:09:16.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.792 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:16.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:16.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722470+0000", 2024-09-14T09:09:16.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:16.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722470+0000", 2024-09-14T09:09:16.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:16.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:16.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722471+0000", 2024-09-14T09:09:16.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.09e-07 2024-09-14T09:09:16.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:16.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722478+0000", 2024-09-14T09:09:16.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999998e-06 2024-09-14T09:09:16.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:16.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722488+0000", 2024-09-14T09:09:16.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9960000000000005e-06 2024-09-14T09:09:16.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:16.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:16.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:16.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.722501+0000", 2024-09-14T09:09:16.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3171e-05 2024-09-14T09:09:16.795 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.795 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:16.795 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.795 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:16.795 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-14T09:09:16.795 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 18 2024-09-14T09:09:16.795 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:16.797 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:09:16.798 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:16.798+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:16.859 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T09:09:16.897 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:16.899+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:16.976 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:16.976 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:16.976 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:16.976 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:16.977 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:16.988 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:09:17.029 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:17.030+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:17.099 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:17.101+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:17.166 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:246 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:09:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.370014333, 2024-09-14T09:09:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99004581000000003, 2024-09-14T09:09:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 246 2024-09-14T09:09:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:09:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796748+0000", 2024-09-14T09:09:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796750+0000", 2024-09-14T09:09:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5519999999999999e-06 2024-09-14T09:09:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796754+0000", 2024-09-14T09:09:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2640000000000002e-06 2024-09-14T09:09:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796767+0000", 2024-09-14T09:09:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3517e-05 2024-09-14T09:09:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796775+0000", 2024-09-14T09:09:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8790000000000003e-06 2024-09-14T09:09:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796830+0000", 2024-09-14T09:09:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4829e-05 2024-09-14T09:09:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796843+0000", 2024-09-14T09:09:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.33e-05 2024-09-14T09:09:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786501+0000", 2024-09-14T09:09:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98965769299999995 2024-09-14T09:09:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786653+0000", 2024-09-14T09:09:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015237200000000001 2024-09-14T09:09:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.786794+0000", 2024-09-14T09:09:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014040400000000001 2024-09-14T09:09:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.172 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:247 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 720896~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:17.172 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:09:17.172 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.369959547000001, 2024-09-14T09:09:17.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99048688100000004, 2024-09-14T09:09:17.172 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.172 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.172 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.172 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.172 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:17.172 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:17.172 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 247 2024-09-14T09:09:17.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.173 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:09:17.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:09:17.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796803+0000", 2024-09-14T09:09:17.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7299999999999995e-07 2024-09-14T09:09:17.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796807+0000", 2024-09-14T09:09:17.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.106e-06 2024-09-14T09:09:17.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796815+0000", 2024-09-14T09:09:17.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4740000000000005e-06 2024-09-14T09:09:17.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796821+0000", 2024-09-14T09:09:17.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0469999999999999e-06 2024-09-14T09:09:17.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796872+0000", 2024-09-14T09:09:17.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0834000000000002e-05 2024-09-14T09:09:17.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796878+0000", 2024-09-14T09:09:17.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2990000000000002e-06 2024-09-14T09:09:17.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787176+0000", 2024-09-14T09:09:17.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99029817600000003 2024-09-14T09:09:17.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787225+0000", 2024-09-14T09:09:17.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8953999999999999e-05 2024-09-14T09:09:17.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787290+0000", 2024-09-14T09:09:17.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4318000000000003e-05 2024-09-14T09:09:17.177 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.177 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.177 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.177 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:248 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1179648~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:17.177 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:09:17.177 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.369929028000001, 2024-09-14T09:09:17.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99060754200000001, 2024-09-14T09:09:17.177 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.177 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.177 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.177 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.178 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:17.178 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:17.178 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 248 2024-09-14T09:09:17.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.178 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:09:17.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796833+0000", 2024-09-14T09:09:17.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796834+0000", 2024-09-14T09:09:17.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4099999999999999e-07 2024-09-14T09:09:17.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796837+0000", 2024-09-14T09:09:17.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8459999999999999e-06 2024-09-14T09:09:17.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796844+0000", 2024-09-14T09:09:17.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1350000000000003e-06 2024-09-14T09:09:17.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796850+0000", 2024-09-14T09:09:17.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7139999999999998e-06 2024-09-14T09:09:17.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:17.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3909999999999998e-05 2024-09-14T09:09:17.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796899+0000", 2024-09-14T09:09:17.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7649999999999999e-06 2024-09-14T09:09:17.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787318+0000", 2024-09-14T09:09:17.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99041848300000002 2024-09-14T09:09:17.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787365+0000", 2024-09-14T09:09:17.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7086999999999998e-05 2024-09-14T09:09:17.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787441+0000", 2024-09-14T09:09:17.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6061000000000002e-05 2024-09-14T09:09:17.182 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.182 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.182 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.182 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:249 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1638400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:17.182 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:17.182 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.369895259000003, 2024-09-14T09:09:17.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99070346899999995, 2024-09-14T09:09:17.182 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.183 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.183 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.183 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.183 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:17.183 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:17.183 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 249 2024-09-14T09:09:17.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.183 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:17.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:17.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796868+0000", 2024-09-14T09:09:17.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2024-09-14T09:09:17.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796870+0000", 2024-09-14T09:09:17.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7889999999999999e-06 2024-09-14T09:09:17.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796877+0000", 2024-09-14T09:09:17.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8549999999999996e-06 2024-09-14T09:09:17.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796883+0000", 2024-09-14T09:09:17.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.665e-06 2024-09-14T09:09:17.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796915+0000", 2024-09-14T09:09:17.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2215999999999998e-05 2024-09-14T09:09:17.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796920+0000", 2024-09-14T09:09:17.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.527e-06 2024-09-14T09:09:17.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787468+0000", 2024-09-14T09:09:17.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99054877100000005 2024-09-14T09:09:17.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787512+0000", 2024-09-14T09:09:17.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3958000000000002e-05 2024-09-14T09:09:17.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787571+0000", 2024-09-14T09:09:17.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8167000000000001e-05 2024-09-14T09:09:17.187 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.187 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.187 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.187 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:250 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2097152~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:17.187 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:17.188 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.369869193, 2024-09-14T09:09:17.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99079431100000004, 2024-09-14T09:09:17.188 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.188 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.188 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.188 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.188 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:17.188 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:17.188 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 250 2024-09-14T09:09:17.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.188 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:17.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:17.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796894+0000", 2024-09-14T09:09:17.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2024-09-14T09:09:17.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796896+0000", 2024-09-14T09:09:17.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5600000000000001e-06 2024-09-14T09:09:17.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796902+0000", 2024-09-14T09:09:17.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3090000000000001e-06 2024-09-14T09:09:17.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796909+0000", 2024-09-14T09:09:17.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:09:17.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796942+0000", 2024-09-14T09:09:17.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-05 2024-09-14T09:09:17.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796948+0000", 2024-09-14T09:09:17.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5910000000000001e-06 2024-09-14T09:09:17.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787596+0000", 2024-09-14T09:09:17.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99064781400000002 2024-09-14T09:09:17.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787636+0000", 2024-09-14T09:09:17.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9715000000000002e-05 2024-09-14T09:09:17.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787687+0000", 2024-09-14T09:09:17.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1674e-05 2024-09-14T09:09:17.192 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.192 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.192 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.193 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:251 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:17.193 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:17.193 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.369843758000002, 2024-09-14T09:09:17.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99091769600000001, 2024-09-14T09:09:17.193 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.193 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.193 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.193 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.193 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:17.193 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:17.193 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 251 2024-09-14T09:09:17.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.193 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:17.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:17.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:17.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000005e-07 2024-09-14T09:09:17.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796922+0000", 2024-09-14T09:09:17.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.875e-06 2024-09-14T09:09:17.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796929+0000", 2024-09-14T09:09:17.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0260000000000002e-06 2024-09-14T09:09:17.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796935+0000", 2024-09-14T09:09:17.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7030000000000003e-06 2024-09-14T09:09:17.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796963+0000", 2024-09-14T09:09:17.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8368999999999999e-05 2024-09-14T09:09:17.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796966+0000", 2024-09-14T09:09:17.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4130000000000002e-06 2024-09-14T09:09:17.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787718+0000", 2024-09-14T09:09:17.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99075151100000003 2024-09-14T09:09:17.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787779+0000", 2024-09-14T09:09:17.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.088e-05 2024-09-14T09:09:17.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787836+0000", 2024-09-14T09:09:17.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7380000000000003e-05 2024-09-14T09:09:17.198 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.198 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.198 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.198 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:252 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:17.198 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:17.198 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.369818303999999, 2024-09-14T09:09:17.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99102491400000003, 2024-09-14T09:09:17.198 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.198 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.198 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.199 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.199 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:17.199 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:17.199 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 252 2024-09-14T09:09:17.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.199 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:17.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:17.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796945+0000", 2024-09-14T09:09:17.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2900000000000003e-07 2024-09-14T09:09:17.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796947+0000", 2024-09-14T09:09:17.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4279999999999999e-06 2024-09-14T09:09:17.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796954+0000", 2024-09-14T09:09:17.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5479999999999998e-06 2024-09-14T09:09:17.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796959+0000", 2024-09-14T09:09:17.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.22e-06 2024-09-14T09:09:17.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796988+0000", 2024-09-14T09:09:17.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9473000000000001e-05 2024-09-14T09:09:17.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:17.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:09:17.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787850+0000", 2024-09-14T09:09:17.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99085651100000005 2024-09-14T09:09:17.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787891+0000", 2024-09-14T09:09:17.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602000000000002e-05 2024-09-14T09:09:17.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787969+0000", 2024-09-14T09:09:17.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8063000000000001e-05 2024-09-14T09:09:17.203 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.203 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.203 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.203 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:253 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:17.204 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:17.204 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.369794423999998, 2024-09-14T09:09:17.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99122695699999996, 2024-09-14T09:09:17.204 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.204 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.204 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.204 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.204 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:17.204 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:17.204 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 253 2024-09-14T09:09:17.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.204 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:17.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:17.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:17.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:09:17.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:09:17.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:09:17.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796977+0000", 2024-09-14T09:09:17.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5030000000000002e-06 2024-09-14T09:09:17.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796982+0000", 2024-09-14T09:09:17.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2024-09-14T09:09:17.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797013+0000", 2024-09-14T09:09:17.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0451e-05 2024-09-14T09:09:17.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:09:17.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1690000000000001e-06 2024-09-14T09:09:17.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788011+0000", 2024-09-14T09:09:17.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99099490300000004 2024-09-14T09:09:17.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788102+0000", 2024-09-14T09:09:17.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0730999999999996e-05 2024-09-14T09:09:17.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788195+0000", 2024-09-14T09:09:17.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3245999999999995e-05 2024-09-14T09:09:17.208 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.208 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.208 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.209 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:254 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3932160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:17.209 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:17.209 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.369762866000002, 2024-09-14T09:09:17.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99137410500000001, 2024-09-14T09:09:17.209 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.209 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.209 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.209 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.209 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:17.209 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:17.209 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 254 2024-09-14T09:09:17.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.209 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:17.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:17.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797000+0000", 2024-09-14T09:09:17.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:09:17.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797003+0000", 2024-09-14T09:09:17.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7659999999999999e-06 2024-09-14T09:09:17.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797010+0000", 2024-09-14T09:09:17.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.029e-06 2024-09-14T09:09:17.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:17.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2024-09-14T09:09:17.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797044+0000", 2024-09-14T09:09:17.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9213e-05 2024-09-14T09:09:17.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797048+0000", 2024-09-14T09:09:17.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3400000000000002e-06 2024-09-14T09:09:17.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788222+0000", 2024-09-14T09:09:17.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99117407400000002 2024-09-14T09:09:17.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788306+0000", 2024-09-14T09:09:17.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4512999999999995e-05 2024-09-14T09:09:17.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788374+0000", 2024-09-14T09:09:17.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7226999999999999e-05 2024-09-14T09:09:17.214 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.214 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.214 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.214 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:264 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:17.214 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:17.214 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.369736508000003, 2024-09-14T09:09:17.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99161474699999996, 2024-09-14T09:09:17.214 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.214 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.214 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.214 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.214 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:17.214 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:17.215 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 264 2024-09-14T09:09:17.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.215 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:17.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:17.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:17.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2024-09-14T09:09:17.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:09:17.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2800000000000002e-06 2024-09-14T09:09:17.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:17.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0979999999999999e-06 2024-09-14T09:09:17.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797040+0000", 2024-09-14T09:09:17.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:09:17.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797068+0000", 2024-09-14T09:09:17.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7302999999999999e-05 2024-09-14T09:09:17.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797071+0000", 2024-09-14T09:09:17.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3610000000000001e-06 2024-09-14T09:09:17.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788436+0000", 2024-09-14T09:09:17.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99136489500000002 2024-09-14T09:09:17.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788538+0000", 2024-09-14T09:09:17.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101931 2024-09-14T09:09:17.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788641+0000", 2024-09-14T09:09:17.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010273899999999999 2024-09-14T09:09:17.219 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.219 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.219 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.219 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:265 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:17.219 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:17.219 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.369713148999999, 2024-09-14T09:09:17.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99176878199999996, 2024-09-14T09:09:17.219 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.219 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.219 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.219 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.219 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:17.220 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:17.220 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 265 2024-09-14T09:09:17.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.220 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:17.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:17.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:09:17.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.39e-07 2024-09-14T09:09:17.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797052+0000", 2024-09-14T09:09:17.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.345e-06 2024-09-14T09:09:17.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797058+0000", 2024-09-14T09:09:17.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5429999999999999e-06 2024-09-14T09:09:17.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797064+0000", 2024-09-14T09:09:17.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2000000000000002e-06 2024-09-14T09:09:17.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797091+0000", 2024-09-14T09:09:17.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7804e-05 2024-09-14T09:09:17.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797095+0000", 2024-09-14T09:09:17.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2024-09-14T09:09:17.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788667+0000", 2024-09-14T09:09:17.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157211300000003 2024-09-14T09:09:17.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788742+0000", 2024-09-14T09:09:17.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5159000000000003e-05 2024-09-14T09:09:17.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788818+0000", 2024-09-14T09:09:17.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6038000000000006e-05 2024-09-14T09:09:17.224 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.224 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.224 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.224 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:266 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:17.224 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:17.224 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.369690318000004, 2024-09-14T09:09:17.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99193390100000001, 2024-09-14T09:09:17.224 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.225 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.225 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.225 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.225 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:17.225 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:17.225 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 266 2024-09-14T09:09:17.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.225 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:17.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:17.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:17.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:09:17.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797075+0000", 2024-09-14T09:09:17.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2570000000000002e-06 2024-09-14T09:09:17.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797082+0000", 2024-09-14T09:09:17.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8029999999999997e-06 2024-09-14T09:09:17.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797088+0000", 2024-09-14T09:09:17.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.468e-06 2024-09-14T09:09:17.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797116+0000", 2024-09-14T09:09:17.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7752000000000001e-05 2024-09-14T09:09:17.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797121+0000", 2024-09-14T09:09:17.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5960000000000003e-06 2024-09-14T09:09:17.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788846+0000", 2024-09-14T09:09:17.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99172512199999996 2024-09-14T09:09:17.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788916+0000", 2024-09-14T09:09:17.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9843000000000002e-05 2024-09-14T09:09:17.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789006+0000", 2024-09-14T09:09:17.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9608e-05 2024-09-14T09:09:17.229 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.229 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.229 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.229 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:267 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:17.230 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:17.230 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.369665511000001, 2024-09-14T09:09:17.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99210926799999999, 2024-09-14T09:09:17.230 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.230 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.230 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.230 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.230 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:17.230 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:17.230 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 267 2024-09-14T09:09:17.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.230 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:17.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:17.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:17.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2399999999999999e-07 2024-09-14T09:09:17.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797099+0000", 2024-09-14T09:09:17.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.091e-06 2024-09-14T09:09:17.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797105+0000", 2024-09-14T09:09:17.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-09-14T09:09:17.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797111+0000", 2024-09-14T09:09:17.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5130000000000004e-06 2024-09-14T09:09:17.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797140+0000", 2024-09-14T09:09:17.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9513999999999999e-05 2024-09-14T09:09:17.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797145+0000", 2024-09-14T09:09:17.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:09:17.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789037+0000", 2024-09-14T09:09:17.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99189253899999996 2024-09-14T09:09:17.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789110+0000", 2024-09-14T09:09:17.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2848000000000005e-05 2024-09-14T09:09:17.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789206+0000", 2024-09-14T09:09:17.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5778000000000004e-05 2024-09-14T09:09:17.234 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.234 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.234 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.235 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:268 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:17.235 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:17.235 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.369642272, 2024-09-14T09:09:17.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992276359, 2024-09-14T09:09:17.235 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.235 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.235 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.235 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.235 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:17.235 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:17.235 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 268 2024-09-14T09:09:17.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.235 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:17.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:17.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:17.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:09:17.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797123+0000", 2024-09-14T09:09:17.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2740000000000002e-06 2024-09-14T09:09:17.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797129+0000", 2024-09-14T09:09:17.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-06 2024-09-14T09:09:17.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797134+0000", 2024-09-14T09:09:17.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9099999999999996e-06 2024-09-14T09:09:17.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797163+0000", 2024-09-14T09:09:17.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9709999999999998e-05 2024-09-14T09:09:17.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:17.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8709999999999999e-06 2024-09-14T09:09:17.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789231+0000", 2024-09-14T09:09:17.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992063959 2024-09-14T09:09:17.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789306+0000", 2024-09-14T09:09:17.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5289000000000004e-05 2024-09-14T09:09:17.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789396+0000", 2024-09-14T09:09:17.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9939999999999996e-05 2024-09-14T09:09:17.240 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.240 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.240 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.240 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:269 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2457600~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:17.240 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:17.240 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.369618762999998, 2024-09-14T09:09:17.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99242174400000005, 2024-09-14T09:09:17.240 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.241 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.241 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.241 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.241 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:17.241 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:17.241 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 269 2024-09-14T09:09:17.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.241 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:17.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:17.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:17.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:09:17.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797146+0000", 2024-09-14T09:09:17.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5289999999999998e-06 2024-09-14T09:09:17.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797153+0000", 2024-09-14T09:09:17.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1920000000000002e-06 2024-09-14T09:09:17.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797158+0000", 2024-09-14T09:09:17.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099999999999998e-06 2024-09-14T09:09:17.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797188+0000", 2024-09-14T09:09:17.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0128e-05 2024-09-14T09:09:17.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797194+0000", 2024-09-14T09:09:17.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6250000000000004e-06 2024-09-14T09:09:17.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789439+0000", 2024-09-14T09:09:17.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99224531000000005 2024-09-14T09:09:17.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789489+0000", 2024-09-14T09:09:17.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9830000000000002e-05 2024-09-14T09:09:17.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789565+0000", 2024-09-14T09:09:17.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6229000000000005e-05 2024-09-14T09:09:17.245 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.245 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.245 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.245 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:270 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:17.245 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:17.246 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.369594941000003, 2024-09-14T09:09:17.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99257721899999996, 2024-09-14T09:09:17.246 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.246 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.246 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.246 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.246 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:17.246 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:17.246 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 270 2024-09-14T09:09:17.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.246 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:17.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:17.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797168+0000", 2024-09-14T09:09:17.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2024-09-14T09:09:17.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797170+0000", 2024-09-14T09:09:17.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3120000000000001e-06 2024-09-14T09:09:17.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797177+0000", 2024-09-14T09:09:17.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0960000000000003e-06 2024-09-14T09:09:17.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797183+0000", 2024-09-14T09:09:17.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1669999999999998e-06 2024-09-14T09:09:17.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797213+0000", 2024-09-14T09:09:17.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0494e-05 2024-09-14T09:09:17.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:09:17.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:09:17.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789586+0000", 2024-09-14T09:09:17.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99236692100000001 2024-09-14T09:09:17.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789658+0000", 2024-09-14T09:09:17.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2279000000000004e-05 2024-09-14T09:09:17.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789745+0000", 2024-09-14T09:09:17.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6698000000000002e-05 2024-09-14T09:09:17.250 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.250 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.250 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.251 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:271 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3375104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:17.251 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:17.251 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.369569743, 2024-09-14T09:09:17.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99274791699999998, 2024-09-14T09:09:17.251 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.251 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.251 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.251 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.251 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:17.251 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:17.251 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 271 2024-09-14T09:09:17.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.251 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:17.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:17.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:17.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:09:17.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797195+0000", 2024-09-14T09:09:17.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1639999999999999e-06 2024-09-14T09:09:17.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797201+0000", 2024-09-14T09:09:17.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1290000000000001e-06 2024-09-14T09:09:17.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797206+0000", 2024-09-14T09:09:17.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9300000000000002e-06 2024-09-14T09:09:17.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797237+0000", 2024-09-14T09:09:17.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1285000000000003e-05 2024-09-14T09:09:17.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797242+0000", 2024-09-14T09:09:17.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6e-06 2024-09-14T09:09:17.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789768+0000", 2024-09-14T09:09:17.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99252547400000002 2024-09-14T09:09:17.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789826+0000", 2024-09-14T09:09:17.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8155999999999997e-05 2024-09-14T09:09:17.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789940+0000", 2024-09-14T09:09:17.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114788 2024-09-14T09:09:17.255 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.256 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.256 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.256 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:272 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:17.256 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:17.256 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.369546348999997, 2024-09-14T09:09:17.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99285248800000003, 2024-09-14T09:09:17.256 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.256 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.256 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.256 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.256 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:17.257 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:17.257 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 272 2024-09-14T09:09:17.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.257 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:17.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:17.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:17.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:09:17.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:09:17.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5129999999999999e-06 2024-09-14T09:09:17.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797226+0000", 2024-09-14T09:09:17.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4529999999999996e-06 2024-09-14T09:09:17.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797232+0000", 2024-09-14T09:09:17.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1839999999999998e-06 2024-09-14T09:09:17.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797264+0000", 2024-09-14T09:09:17.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2691999999999998e-05 2024-09-14T09:09:17.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797270+0000", 2024-09-14T09:09:17.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-06 2024-09-14T09:09:17.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789965+0000", 2024-09-14T09:09:17.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99269526200000002 2024-09-14T09:09:17.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790021+0000", 2024-09-14T09:09:17.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5297000000000003e-05 2024-09-14T09:09:17.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790068+0000", 2024-09-14T09:09:17.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7664999999999998e-05 2024-09-14T09:09:17.261 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.261 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.261 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.261 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:65840 3.9 3:9565b329:::rbd_data.1112a10502fe.00000000000001ba:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:17.261 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.412988+0000", 2024-09-14T09:09:17.261 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.75377386599999996, 2024-09-14T09:09:17.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.39438324000000002, 2024-09-14T09:09:17.261 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.261 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.262 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.262 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.262 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:17.262 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:17.262 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 65840 2024-09-14T09:09:17.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.262 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.412988+0000", 2024-09-14T09:09:17.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.412988+0000", 2024-09-14T09:09:17.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.412989+0000", 2024-09-14T09:09:17.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.006e-06 2024-09-14T09:09:17.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.412994+0000", 2024-09-14T09:09:17.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4399999999999998e-06 2024-09-14T09:09:17.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.413005+0000", 2024-09-14T09:09:17.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1369000000000001e-05 2024-09-14T09:09:17.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.413013+0000", 2024-09-14T09:09:17.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6739999999999997e-06 2024-09-14T09:09:17.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.413071+0000", 2024-09-14T09:09:17.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7738999999999997e-05 2024-09-14T09:09:17.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.413080+0000", 2024-09-14T09:09:17.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7289999999999995e-06 2024-09-14T09:09:17.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.803701+0000", 2024-09-14T09:09:17.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.39062077899999997 2024-09-14T09:09:17.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.803847+0000", 2024-09-14T09:09:17.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014616299999999999 2024-09-14T09:09:17.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.807372+0000", 2024-09-14T09:09:17.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035243409999999998 2024-09-14T09:09:17.266 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.266 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.266 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.266 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:68694 3.9 3:96777241:::rbd_data.1112a10502fe.00000000000001c8:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:17.266 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.540582+0000", 2024-09-14T09:09:17.266 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.62618036799999999, 2024-09-14T09:09:17.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.26697969700000002, 2024-09-14T09:09:17.267 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.267 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.267 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.267 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.267 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:17.267 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:17.267 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 68694 2024-09-14T09:09:17.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.267 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.540582+0000", 2024-09-14T09:09:17.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.540582+0000", 2024-09-14T09:09:17.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.540583+0000", 2024-09-14T09:09:17.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.15e-06 2024-09-14T09:09:17.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.540588+0000", 2024-09-14T09:09:17.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.271e-06 2024-09-14T09:09:17.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.540600+0000", 2024-09-14T09:09:17.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1734e-05 2024-09-14T09:09:17.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.540608+0000", 2024-09-14T09:09:17.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3399999999999998e-06 2024-09-14T09:09:17.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.540676+0000", 2024-09-14T09:09:17.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7625000000000004e-05 2024-09-14T09:09:17.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.540685+0000", 2024-09-14T09:09:17.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2250000000000006e-06 2024-09-14T09:09:17.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.804157+0000", 2024-09-14T09:09:17.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.26347124700000002 2024-09-14T09:09:17.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.804267+0000", 2024-09-14T09:09:17.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011024899999999999 2024-09-14T09:09:17.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.807562+0000", 2024-09-14T09:09:17.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032948560000000001 2024-09-14T09:09:17.271 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.271 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.271 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.271 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.271 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.271 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:17.273 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:09:17.273 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:17.274+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:17.373 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:17.374+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:17.421 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:17.421 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:17.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.421 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:59017 3.3 3.6b81fb83 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:17.421 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:09:17.421 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.63617154099999995, 2024-09-14T09:09:17.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.63618806999999999, 2024-09-14T09:09:17.421 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.421 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.421 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:17.421 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59017 2024-09-14T09:09:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:09:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:09:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787284+0000", 2024-09-14T09:09:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3879999999999998e-06 2024-09-14T09:09:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787297+0000", 2024-09-14T09:09:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2184999999999999e-05 2024-09-14T09:09:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787317+0000", 2024-09-14T09:09:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0054000000000001e-05 2024-09-14T09:09:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787327+0000", 2024-09-14T09:09:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0335e-05 2024-09-14T09:09:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787412+0000", 2024-09-14T09:09:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4691000000000006e-05 2024-09-14T09:09:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:09:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787422+0000", 2024-09-14T09:09:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0718e-05 2024-09-14T09:09:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790539+0000", 2024-09-14T09:09:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031164600000000002 2024-09-14T09:09:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790552+0000", 2024-09-14T09:09:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2736e-05 2024-09-14T09:09:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:63586 3.3 3.d4e49b03 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.63610005800000002, 2024-09-14T09:09:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.636156481, 2024-09-14T09:09:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 63586 2024-09-14T09:09:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2024-09-14T09:09:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787357+0000", 2024-09-14T09:09:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8720000000000002e-06 2024-09-14T09:09:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787365+0000", 2024-09-14T09:09:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9270000000000005e-06 2024-09-14T09:09:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787372+0000", 2024-09-14T09:09:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6810000000000001e-06 2024-09-14T09:09:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787479+0000", 2024-09-14T09:09:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010736800000000001 2024-09-14T09:09:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787485+0000", 2024-09-14T09:09:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.054e-06 2024-09-14T09:09:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790580+0000", 2024-09-14T09:09:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030949929999999999 2024-09-14T09:09:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790589+0000", 2024-09-14T09:09:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7600000000000008e-06 2024-09-14T09:09:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:65817 3.3 3.7f92343 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:09:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.63601025600000005, 2024-09-14T09:09:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.63610194200000003, 2024-09-14T09:09:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 65817 2024-09-14T09:09:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:09:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:09:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787444+0000", 2024-09-14T09:09:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999995e-07 2024-09-14T09:09:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787448+0000", 2024-09-14T09:09:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1420000000000003e-06 2024-09-14T09:09:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787497+0000", 2024-09-14T09:09:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8507999999999997e-05 2024-09-14T09:09:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787503+0000", 2024-09-14T09:09:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1319999999999999e-06 2024-09-14T09:09:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787595+0000", 2024-09-14T09:09:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1748000000000003e-05 2024-09-14T09:09:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787601+0000", 2024-09-14T09:09:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6150000000000002e-06 2024-09-14T09:09:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790613+0000", 2024-09-14T09:09:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003012228 2024-09-14T09:09:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790621+0000", 2024-09-14T09:09:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9219999999999997e-06 2024-09-14T09:09:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:68709 3.3 3.bd569923 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:09:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.63583931000000005, 2024-09-14T09:09:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.63596268700000003, 2024-09-14T09:09:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 68709 2024-09-14T09:09:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:09:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:09:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787615+0000", 2024-09-14T09:09:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4000000000000001e-07 2024-09-14T09:09:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787618+0000", 2024-09-14T09:09:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2780000000000002e-06 2024-09-14T09:09:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787626+0000", 2024-09-14T09:09:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0250000000000002e-06 2024-09-14T09:09:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787633+0000", 2024-09-14T09:09:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5660000000000003e-06 2024-09-14T09:09:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787714+0000", 2024-09-14T09:09:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1695999999999998e-05 2024-09-14T09:09:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787721+0000", 2024-09-14T09:09:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1109999999999996e-06 2024-09-14T09:09:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790646+0000", 2024-09-14T09:09:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029251730000000001 2024-09-14T09:09:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790653+0000", 2024-09-14T09:09:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4379999999999998e-06 2024-09-14T09:09:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:74823 3.3 3.91f359a3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:09:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.61500483800000005, 2024-09-14T09:09:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.61515988200000005, 2024-09-14T09:09:17.441 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.441 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.441 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2024-09-14T09:09:17.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:17.443 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74823 2024-09-14T09:09:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:09:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:09:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808450+0000", 2024-09-14T09:09:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.92e-07 2024-09-14T09:09:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808454+0000", 2024-09-14T09:09:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3660000000000002e-06 2024-09-14T09:09:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808463+0000", 2024-09-14T09:09:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1579999999999994e-06 2024-09-14T09:09:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808470+0000", 2024-09-14T09:09:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7599999999999997e-06 2024-09-14T09:09:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808540+0000", 2024-09-14T09:09:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9991000000000001e-05 2024-09-14T09:09:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:17.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808550+0000", 2024-09-14T09:09:17.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0282000000000001e-05 2024-09-14T09:09:17.447 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.447 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.447 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.447 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.447 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-14T09:09:17.447 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 5 2024-09-14T09:09:17.447 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:17.448 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:09:17.490 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:17.491+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:17.574 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:17.576+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:17.611 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:17.611 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:17.611 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:17.611 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:17.611 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:17.622 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:09:17.675 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:17.677+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:17.776 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:17.778+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:17.790 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is unset 2024-09-14T09:09:17.802 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:17.802 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:17.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:17.802 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:17.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.803 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5299 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5230592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:17.803 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:09:17.803 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.554030769999997, 2024-09-14T09:09:17.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038972887999999997, 2024-09-14T09:09:17.803 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.803 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.803 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.803 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.803 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:17.803 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:17.804 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5299 2024-09-14T09:09:17.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.804 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:09:17.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249122+0000", 2024-09-14T09:09:17.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249123+0000", 2024-09-14T09:09:17.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1199999999999998e-07 2024-09-14T09:09:17.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249125+0000", 2024-09-14T09:09:17.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.855e-06 2024-09-14T09:09:17.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249131+0000", 2024-09-14T09:09:17.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2949999999999999e-06 2024-09-14T09:09:17.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249136+0000", 2024-09-14T09:09:17.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9779999999999996e-06 2024-09-14T09:09:17.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.287933+0000", 2024-09-14T09:09:17.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038796663000000002 2024-09-14T09:09:17.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288012+0000", 2024-09-14T09:09:17.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9617999999999996e-05 2024-09-14T09:09:17.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288095+0000", 2024-09-14T09:09:17.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3066999999999996e-05 2024-09-14T09:09:17.807 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.807 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.807 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.808 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5300 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 5292032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:17.808 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:09:17.808 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.554011381000002, 2024-09-14T09:09:17.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039068578, 2024-09-14T09:09:17.808 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.808 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.808 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.808 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.808 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:17.808 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:17.808 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5300 2024-09-14T09:09:17.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.808 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:09:17.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.249142+0000", 2024-09-14T09:09:17.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254832+0000", 2024-09-14T09:09:17.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056899180000000004 2024-09-14T09:09:17.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254836+0000", 2024-09-14T09:09:17.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7809999999999999e-06 2024-09-14T09:09:17.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254845+0000", 2024-09-14T09:09:17.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.516e-06 2024-09-14T09:09:17.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.254851+0000", 2024-09-14T09:09:17.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9109999999999998e-06 2024-09-14T09:09:17.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288122+0000", 2024-09-14T09:09:17.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.033270776000000002 2024-09-14T09:09:17.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288163+0000", 2024-09-14T09:09:17.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1700999999999999e-05 2024-09-14T09:09:17.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.288210+0000", 2024-09-14T09:09:17.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6974999999999997e-05 2024-09-14T09:09:17.812 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.812 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.812 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.812 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5342 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7872512~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:17.812 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:09:17.812 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.547435196000002, 2024-09-14T09:09:17.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038906217999999999, 2024-09-14T09:09:17.813 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.813 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.813 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.813 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.813 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:17.813 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:17.813 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5342 2024-09-14T09:09:17.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.813 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:09:17.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:09:17.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255718+0000", 2024-09-14T09:09:17.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8700000000000001e-07 2024-09-14T09:09:17.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255720+0000", 2024-09-14T09:09:17.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.739e-06 2024-09-14T09:09:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255726+0000", 2024-09-14T09:09:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.981e-06 2024-09-14T09:09:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255737+0000", 2024-09-14T09:09:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0621e-05 2024-09-14T09:09:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294538+0000", 2024-09-14T09:09:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038801012000000003 2024-09-14T09:09:17.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294577+0000", 2024-09-14T09:09:17.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9042000000000003e-05 2024-09-14T09:09:17.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294624+0000", 2024-09-14T09:09:17.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7435999999999998e-05 2024-09-14T09:09:17.816 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.816 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.816 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.817 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5343 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7933952~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:17.817 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:09:17.817 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.54740932, 2024-09-14T09:09:17.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039081811000000001, 2024-09-14T09:09:17.817 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.817 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.817 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.817 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.817 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:17.817 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:17.817 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5343 2024-09-14T09:09:17.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.818 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:09:17.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:09:17.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255744+0000", 2024-09-14T09:09:17.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1800000000000001e-07 2024-09-14T09:09:17.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255746+0000", 2024-09-14T09:09:17.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.103e-06 2024-09-14T09:09:17.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255753+0000", 2024-09-14T09:09:17.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0929999999999999e-06 2024-09-14T09:09:17.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255757+0000", 2024-09-14T09:09:17.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9579999999999998e-06 2024-09-14T09:09:17.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294656+0000", 2024-09-14T09:09:17.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038898508999999998 2024-09-14T09:09:17.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294738+0000", 2024-09-14T09:09:17.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2423999999999996e-05 2024-09-14T09:09:17.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294826+0000", 2024-09-14T09:09:17.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7305999999999994e-05 2024-09-14T09:09:17.821 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.821 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.821 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.821 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5344 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 7995392~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:17.821 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:09:17.821 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.547389887999998, 2024-09-14T09:09:17.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039165567999999998, 2024-09-14T09:09:17.822 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.822 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.822 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.822 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.822 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:17.822 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:17.822 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5344 2024-09-14T09:09:17.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.822 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:09:17.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255763+0000", 2024-09-14T09:09:17.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255764+0000", 2024-09-14T09:09:17.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7899999999999999e-07 2024-09-14T09:09:17.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255765+0000", 2024-09-14T09:09:17.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.782e-06 2024-09-14T09:09:17.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255774+0000", 2024-09-14T09:09:17.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8070000000000006e-06 2024-09-14T09:09:17.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255779+0000", 2024-09-14T09:09:17.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9180000000000002e-06 2024-09-14T09:09:17.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294841+0000", 2024-09-14T09:09:17.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039061514999999998 2024-09-14T09:09:17.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294881+0000", 2024-09-14T09:09:17.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0027999999999997e-05 2024-09-14T09:09:17.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294929+0000", 2024-09-14T09:09:17.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8139000000000001e-05 2024-09-14T09:09:17.826 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.826 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.826 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.826 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5345 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8056832~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:17.826 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:09:17.826 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.547367649999998, 2024-09-14T09:09:17.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039340027999999999, 2024-09-14T09:09:17.826 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.826 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.826 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.826 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.827 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:17.827 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:17.827 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5345 2024-09-14T09:09:17.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.827 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:09:17.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:09:17.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255786+0000", 2024-09-14T09:09:17.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8099999999999998e-07 2024-09-14T09:09:17.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255788+0000", 2024-09-14T09:09:17.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1280000000000002e-06 2024-09-14T09:09:17.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255794+0000", 2024-09-14T09:09:17.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0020000000000003e-06 2024-09-14T09:09:17.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255800+0000", 2024-09-14T09:09:17.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2009999999999996e-06 2024-09-14T09:09:17.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.294960+0000", 2024-09-14T09:09:17.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039159674999999998 2024-09-14T09:09:17.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295041+0000", 2024-09-14T09:09:17.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0648000000000004e-05 2024-09-14T09:09:17.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295126+0000", 2024-09-14T09:09:17.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4993000000000004e-05 2024-09-14T09:09:17.830 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.830 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.830 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.830 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5346 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8118272~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:17.831 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:09:17.831 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.547346656000002, 2024-09-14T09:09:17.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039433228000000001, 2024-09-14T09:09:17.831 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.831 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.831 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.831 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.831 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:17.831 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:17.831 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5346 2024-09-14T09:09:17.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.831 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:09:17.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:09:17.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255807+0000", 2024-09-14T09:09:17.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6899999999999998e-07 2024-09-14T09:09:17.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255809+0000", 2024-09-14T09:09:17.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9580000000000001e-06 2024-09-14T09:09:17.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255815+0000", 2024-09-14T09:09:17.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6579999999999999e-06 2024-09-14T09:09:17.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255819+0000", 2024-09-14T09:09:17.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5839999999999996e-06 2024-09-14T09:09:17.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295152+0000", 2024-09-14T09:09:17.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039332677000000003 2024-09-14T09:09:17.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295192+0000", 2024-09-14T09:09:17.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0491999999999998e-05 2024-09-14T09:09:17.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295240+0000", 2024-09-14T09:09:17.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7490000000000001e-05 2024-09-14T09:09:17.835 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.835 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.835 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.835 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5347 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8179712~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:17.835 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:09:17.835 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.547319059000003, 2024-09-14T09:09:17.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039601193999999999, 2024-09-14T09:09:17.835 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.836 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.836 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.836 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.836 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:17.836 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:17.836 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5347 2024-09-14T09:09:17.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.836 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:09:17.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255834+0000", 2024-09-14T09:09:17.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255835+0000", 2024-09-14T09:09:17.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.82e-07 2024-09-14T09:09:17.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255837+0000", 2024-09-14T09:09:17.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0959999999999999e-06 2024-09-14T09:09:17.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255843+0000", 2024-09-14T09:09:17.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3779999999999998e-06 2024-09-14T09:09:17.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255848+0000", 2024-09-14T09:09:17.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7609999999999998e-06 2024-09-14T09:09:17.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295271+0000", 2024-09-14T09:09:17.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039423079 2024-09-14T09:09:17.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295350+0000", 2024-09-14T09:09:17.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8623999999999998e-05 2024-09-14T09:09:17.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295435+0000", 2024-09-14T09:09:17.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5674000000000007e-05 2024-09-14T09:09:17.840 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.840 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.840 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.840 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5348 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8241152~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:17.840 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:09:17.840 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.547298849999997, 2024-09-14T09:09:17.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039695057999999998, 2024-09-14T09:09:17.840 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.840 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.840 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.841 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.841 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:17.841 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:17.841 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5348 2024-09-14T09:09:17.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.841 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:09:17.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255854+0000", 2024-09-14T09:09:17.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255855+0000", 2024-09-14T09:09:17.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7599999999999997e-07 2024-09-14T09:09:17.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255857+0000", 2024-09-14T09:09:17.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.905e-06 2024-09-14T09:09:17.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255863+0000", 2024-09-14T09:09:17.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0669999999999997e-06 2024-09-14T09:09:17.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255867+0000", 2024-09-14T09:09:17.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4730000000000002e-06 2024-09-14T09:09:17.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295461+0000", 2024-09-14T09:09:17.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039594074 2024-09-14T09:09:17.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295503+0000", 2024-09-14T09:09:17.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1363999999999999e-05 2024-09-14T09:09:17.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295549+0000", 2024-09-14T09:09:17.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6699000000000001e-05 2024-09-14T09:09:17.844 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.844 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.844 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.845 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5349 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8302592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:17.845 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:17.845 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.547279889999999, 2024-09-14T09:09:17.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039875928999999997, 2024-09-14T09:09:17.845 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.845 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.845 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.845 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.845 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:17.845 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:17.845 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5349 2024-09-14T09:09:17.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.846 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:17.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:17.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255874+0000", 2024-09-14T09:09:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4900000000000001e-07 2024-09-14T09:09:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255880+0000", 2024-09-14T09:09:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9939999999999997e-06 2024-09-14T09:09:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255886+0000", 2024-09-14T09:09:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3899999999999998e-06 2024-09-14T09:09:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255891+0000", 2024-09-14T09:09:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.938e-06 2024-09-14T09:09:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295580+0000", 2024-09-14T09:09:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039688681000000003 2024-09-14T09:09:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295653+0000", 2024-09-14T09:09:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3045000000000003e-05 2024-09-14T09:09:17.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295749+0000", 2024-09-14T09:09:17.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6532000000000003e-05 2024-09-14T09:09:17.849 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.849 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.849 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.849 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5350 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8364032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:17.849 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:17.849 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.547256083000001, 2024-09-14T09:09:17.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039989719, 2024-09-14T09:09:17.850 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.850 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.850 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.850 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.850 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:17.850 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:17.850 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5350 2024-09-14T09:09:17.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.850 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:17.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:17.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255898+0000", 2024-09-14T09:09:17.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2024-09-14T09:09:17.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255899+0000", 2024-09-14T09:09:17.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9139999999999998e-06 2024-09-14T09:09:17.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255905+0000", 2024-09-14T09:09:17.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7289999999999997e-06 2024-09-14T09:09:17.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255910+0000", 2024-09-14T09:09:17.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6210000000000003e-06 2024-09-14T09:09:17.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295775+0000", 2024-09-14T09:09:17.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039864973999999997 2024-09-14T09:09:17.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295828+0000", 2024-09-14T09:09:17.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3411000000000001e-05 2024-09-14T09:09:17.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295887+0000", 2024-09-14T09:09:17.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699000000000002e-05 2024-09-14T09:09:17.853 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.853 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.854 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.854 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4639 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1843200~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:17.854 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:17.854 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.603340624000001, 2024-09-14T09:09:17.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040843672999999997, 2024-09-14T09:09:17.854 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.854 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.854 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.854 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.854 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:17.855 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:17.855 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4639 2024-09-14T09:09:17.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.855 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:17.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:17.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:17.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:09:17.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199818+0000", 2024-09-14T09:09:17.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1450000000000001e-06 2024-09-14T09:09:17.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199827+0000", 2024-09-14T09:09:17.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3999999999999998e-06 2024-09-14T09:09:17.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199834+0000", 2024-09-14T09:09:17.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0809999999999996e-06 2024-09-14T09:09:17.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240541+0000", 2024-09-14T09:09:17.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040706941000000003 2024-09-14T09:09:17.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240584+0000", 2024-09-14T09:09:17.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3040999999999997e-05 2024-09-14T09:09:17.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240656+0000", 2024-09-14T09:09:17.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2200000000000007e-05 2024-09-14T09:09:17.858 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.858 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.858 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.858 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4640 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1871872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:17.859 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:17.859 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.603306139000001, 2024-09-14T09:09:17.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040967601999999999, 2024-09-14T09:09:17.859 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.859 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.859 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.859 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.859 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:17.859 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:17.859 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4640 2024-09-14T09:09:17.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.859 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:17.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:17.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199848+0000", 2024-09-14T09:09:17.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5400000000000002e-07 2024-09-14T09:09:17.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199850+0000", 2024-09-14T09:09:17.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2479999999999999e-06 2024-09-14T09:09:17.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199857+0000", 2024-09-14T09:09:17.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.187e-06 2024-09-14T09:09:17.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199862+0000", 2024-09-14T09:09:17.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5119999999999999e-06 2024-09-14T09:09:17.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240684+0000", 2024-09-14T09:09:17.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040821245999999999 2024-09-14T09:09:17.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240739+0000", 2024-09-14T09:09:17.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4991999999999998e-05 2024-09-14T09:09:17.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240815+0000", 2024-09-14T09:09:17.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5963000000000004e-05 2024-09-14T09:09:17.863 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.863 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.863 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.863 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4641 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1900544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:17.863 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:17.863 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.603283809000001, 2024-09-14T09:09:17.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041205512, 2024-09-14T09:09:17.863 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.863 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.864 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.864 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.864 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:17.864 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:17.864 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4641 2024-09-14T09:09:17.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.864 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:17.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:17.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199870+0000", 2024-09-14T09:09:17.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0600000000000001e-07 2024-09-14T09:09:17.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199872+0000", 2024-09-14T09:09:17.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.928e-06 2024-09-14T09:09:17.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199877+0000", 2024-09-14T09:09:17.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6949999999999997e-06 2024-09-14T09:09:17.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199882+0000", 2024-09-14T09:09:17.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8210000000000001e-06 2024-09-14T09:09:17.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240847+0000", 2024-09-14T09:09:17.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040965201999999999 2024-09-14T09:09:17.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240888+0000", 2024-09-14T09:09:17.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0754000000000003e-05 2024-09-14T09:09:17.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241075+0000", 2024-09-14T09:09:17.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000186706 2024-09-14T09:09:17.867 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.867 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.867 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.868 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4642 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1929216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:17.868 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:17.868 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.603264874000001, 2024-09-14T09:09:17.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041292575999999998, 2024-09-14T09:09:17.868 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.868 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.868 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.868 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.868 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:17.868 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:17.868 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4642 2024-09-14T09:09:17.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.869 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:17.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:17.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199889+0000", 2024-09-14T09:09:17.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2024-09-14T09:09:17.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199891+0000", 2024-09-14T09:09:17.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9e-06 2024-09-14T09:09:17.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199896+0000", 2024-09-14T09:09:17.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6960000000000002e-06 2024-09-14T09:09:17.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199901+0000", 2024-09-14T09:09:17.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6720000000000003e-06 2024-09-14T09:09:17.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241089+0000", 2024-09-14T09:09:17.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041187594000000001 2024-09-14T09:09:17.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241126+0000", 2024-09-14T09:09:17.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7490999999999997e-05 2024-09-14T09:09:17.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241181+0000", 2024-09-14T09:09:17.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4823e-05 2024-09-14T09:09:17.872 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.872 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.872 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.872 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4643 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1957888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:17.872 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:17.872 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.603245595000001, 2024-09-14T09:09:17.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041418333000000002, 2024-09-14T09:09:17.873 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.873 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.873 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.873 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.873 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:17.873 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:17.873 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4643 2024-09-14T09:09:17.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.873 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:17.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:17.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:17.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5699999999999998e-07 2024-09-14T09:09:17.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199910+0000", 2024-09-14T09:09:17.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.829e-06 2024-09-14T09:09:17.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199916+0000", 2024-09-14T09:09:17.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8499999999999999e-06 2024-09-14T09:09:17.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199920+0000", 2024-09-14T09:09:17.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6530000000000002e-06 2024-09-14T09:09:17.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241211+0000", 2024-09-14T09:09:17.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041290327000000002 2024-09-14T09:09:17.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241257+0000", 2024-09-14T09:09:17.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6347000000000002e-05 2024-09-14T09:09:17.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241326+0000", 2024-09-14T09:09:17.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8969999999999999e-05 2024-09-14T09:09:17.877 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.877 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.877 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.877 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4644 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1986560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:17.877 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:17.877 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.603227255, 2024-09-14T09:09:17.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041596269999999998, 2024-09-14T09:09:17.877 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.877 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.877 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.877 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.878 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:17.878 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:17.878 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4644 2024-09-14T09:09:17.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.878 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:17.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:17.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:17.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.41e-07 2024-09-14T09:09:17.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199928+0000", 2024-09-14T09:09:17.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8250000000000001e-06 2024-09-14T09:09:17.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199934+0000", 2024-09-14T09:09:17.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2280000000000003e-06 2024-09-14T09:09:17.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199939+0000", 2024-09-14T09:09:17.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8010000000000003e-06 2024-09-14T09:09:17.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241360+0000", 2024-09-14T09:09:17.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041421289 2024-09-14T09:09:17.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241435+0000", 2024-09-14T09:09:17.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4238000000000003e-05 2024-09-14T09:09:17.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241522+0000", 2024-09-14T09:09:17.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7547999999999996e-05 2024-09-14T09:09:17.881 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.881 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.881 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.881 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4645 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:17.882 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:17.882 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.603208347999999, 2024-09-14T09:09:17.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041714660000000001, 2024-09-14T09:09:17.882 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.882 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.882 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.882 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.882 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:17.882 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:17.882 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4645 2024-09-14T09:09:17.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.882 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:17.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:17.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:17.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4700000000000002e-07 2024-09-14T09:09:17.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199947+0000", 2024-09-14T09:09:17.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.801e-06 2024-09-14T09:09:17.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199953+0000", 2024-09-14T09:09:17.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.694e-06 2024-09-14T09:09:17.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199957+0000", 2024-09-14T09:09:17.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3069999999999996e-06 2024-09-14T09:09:17.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241547+0000", 2024-09-14T09:09:17.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041589895000000002 2024-09-14T09:09:17.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241590+0000", 2024-09-14T09:09:17.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2985000000000003e-05 2024-09-14T09:09:17.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241660+0000", 2024-09-14T09:09:17.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9630999999999998e-05 2024-09-14T09:09:17.886 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.886 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.886 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.886 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4646 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2043904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:17.886 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:17.886 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.603190359999999, 2024-09-14T09:09:17.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041827171000000003, 2024-09-14T09:09:17.886 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.886 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.886 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.887 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.887 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:17.887 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:17.887 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4646 2024-09-14T09:09:17.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.887 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:17.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:17.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:17.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6300000000000001e-07 2024-09-14T09:09:17.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199965+0000", 2024-09-14T09:09:17.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.035e-06 2024-09-14T09:09:17.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199973+0000", 2024-09-14T09:09:17.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9629999999999998e-06 2024-09-14T09:09:17.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199978+0000", 2024-09-14T09:09:17.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9069999999999998e-06 2024-09-14T09:09:17.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241677+0000", 2024-09-14T09:09:17.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041698662999999997 2024-09-14T09:09:17.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241717+0000", 2024-09-14T09:09:17.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602999999999997e-05 2024-09-14T09:09:17.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241790+0000", 2024-09-14T09:09:17.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2637000000000003e-05 2024-09-14T09:09:17.890 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.890 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.890 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.890 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4647 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2072576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:17.890 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:17.890 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.60316177, 2024-09-14T09:09:17.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041921189999999997, 2024-09-14T09:09:17.891 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:17.891 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:17.891 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:17.891 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:17.891 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:17.891 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:17.891 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4647 2024-09-14T09:09:17.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.891 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:17.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:17.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:17.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:17.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:17.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:17.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:17.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199992+0000", 2024-09-14T09:09:17.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3799999999999997e-07 2024-09-14T09:09:17.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:17.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199994+0000", 2024-09-14T09:09:17.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3020000000000002e-06 2024-09-14T09:09:17.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:17.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200004+0000", 2024-09-14T09:09:17.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3510000000000008e-06 2024-09-14T09:09:17.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:17.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200008+0000", 2024-09-14T09:09:17.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3329999999999998e-06 2024-09-14T09:09:17.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:17.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241814+0000", 2024-09-14T09:09:17.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041806280000000001 2024-09-14T09:09:17.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:17.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241855+0000", 2024-09-14T09:09:17.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0173999999999999e-05 2024-09-14T09:09:17.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:17.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:17.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:17.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241913+0000", 2024-09-14T09:09:17.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8112000000000002e-05 2024-09-14T09:09:17.895 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.895 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.895 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.895 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:17.895 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:17.895 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:17.897 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:17.898+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:17.897 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:09:17.997 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:17.998+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:18.047 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95083 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.024036+0000", 2024-09-14T09:09:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.014820811, 2024-09-14T09:09:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014837360000000001, 2024-09-14T09:09:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95083 2024-09-14T09:09:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024036+0000", 2024-09-14T09:09:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024036+0000", 2024-09-14T09:09:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024036+0000", 2024-09-14T09:09:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2600000000000002e-07 2024-09-14T09:09:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024038+0000", 2024-09-14T09:09:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.844e-06 2024-09-14T09:09:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024044+0000", 2024-09-14T09:09:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1349999999999997e-06 2024-09-14T09:09:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024049+0000", 2024-09-14T09:09:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8749999999999999e-06 2024-09-14T09:09:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95151 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.024866+0000", 2024-09-14T09:09:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013990373, 2024-09-14T09:09:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014044246999999999, 2024-09-14T09:09:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95151 2024-09-14T09:09:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024866+0000", 2024-09-14T09:09:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024866+0000", 2024-09-14T09:09:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024867+0000", 2024-09-14T09:09:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2024-09-14T09:09:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024869+0000", 2024-09-14T09:09:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0710000000000002e-06 2024-09-14T09:09:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024876+0000", 2024-09-14T09:09:18.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-09-14T09:09:18.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024884+0000", 2024-09-14T09:09:18.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7079999999999997e-06 2024-09-14T09:09:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95183 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025598+0000", 2024-09-14T09:09:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013258903000000001, 2024-09-14T09:09:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013337699, 2024-09-14T09:09:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95183 2024-09-14T09:09:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025598+0000", 2024-09-14T09:09:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025598+0000", 2024-09-14T09:09:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025598+0000", 2024-09-14T09:09:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7999999999999996e-07 2024-09-14T09:09:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025600+0000", 2024-09-14T09:09:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.745e-06 2024-09-14T09:09:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025606+0000", 2024-09-14T09:09:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7989999999999999e-06 2024-09-14T09:09:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025611+0000", 2024-09-14T09:09:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9060000000000001e-06 2024-09-14T09:09:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95231 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026378+0000", 2024-09-14T09:09:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012478438999999999, 2024-09-14T09:09:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012582677, 2024-09-14T09:09:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95231 2024-09-14T09:09:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026378+0000", 2024-09-14T09:09:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026378+0000", 2024-09-14T09:09:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026379+0000", 2024-09-14T09:09:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9800000000000004e-07 2024-09-14T09:09:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026381+0000", 2024-09-14T09:09:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.052e-06 2024-09-14T09:09:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026387+0000", 2024-09-14T09:09:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2299999999999996e-06 2024-09-14T09:09:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026392+0000", 2024-09-14T09:09:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8509999999999998e-06 2024-09-14T09:09:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95293 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027190+0000", 2024-09-14T09:09:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011666862, 2024-09-14T09:09:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011794318, 2024-09-14T09:09:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95293 2024-09-14T09:09:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027190+0000", 2024-09-14T09:09:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027190+0000", 2024-09-14T09:09:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027190+0000", 2024-09-14T09:09:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1200000000000003e-07 2024-09-14T09:09:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027193+0000", 2024-09-14T09:09:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2010000000000002e-06 2024-09-14T09:09:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027200+0000", 2024-09-14T09:09:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0670000000000003e-06 2024-09-14T09:09:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027205+0000", 2024-09-14T09:09:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2639999999999999e-06 2024-09-14T09:09:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95413 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033191+0000", 2024-09-14T09:09:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0056659520000000001, 2024-09-14T09:09:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058177649999999999, 2024-09-14T09:09:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95413 2024-09-14T09:09:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033191+0000", 2024-09-14T09:09:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033191+0000", 2024-09-14T09:09:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033191+0000", 2024-09-14T09:09:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0200000000000003e-07 2024-09-14T09:09:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033193+0000", 2024-09-14T09:09:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9719999999999999e-06 2024-09-14T09:09:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033200+0000", 2024-09-14T09:09:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4699999999999999e-06 2024-09-14T09:09:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033205+0000", 2024-09-14T09:09:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9280000000000001e-06 2024-09-14T09:09:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95502 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034053+0000", 2024-09-14T09:09:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0048038389999999999, 2024-09-14T09:09:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049786810000000004, 2024-09-14T09:09:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95502 2024-09-14T09:09:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034053+0000", 2024-09-14T09:09:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034053+0000", 2024-09-14T09:09:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034054+0000", 2024-09-14T09:09:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4899999999999995e-07 2024-09-14T09:09:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034056+0000", 2024-09-14T09:09:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1799999999999999e-06 2024-09-14T09:09:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034063+0000", 2024-09-14T09:09:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0260000000000002e-06 2024-09-14T09:09:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034068+0000", 2024-09-14T09:09:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5840000000000002e-06 2024-09-14T09:09:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95085 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.024056+0000", 2024-09-14T09:09:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.014801043999999999, 2024-09-14T09:09:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014999495, 2024-09-14T09:09:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95085 2024-09-14T09:09:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024056+0000", 2024-09-14T09:09:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024056+0000", 2024-09-14T09:09:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024056+0000", 2024-09-14T09:09:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1200000000000003e-07 2024-09-14T09:09:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024058+0000", 2024-09-14T09:09:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7859999999999999e-06 2024-09-14T09:09:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024064+0000", 2024-09-14T09:09:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6239999999999999e-06 2024-09-14T09:09:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024068+0000", 2024-09-14T09:09:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5700000000000003e-06 2024-09-14T09:09:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95152 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.024891+0000", 2024-09-14T09:09:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013965574999999999, 2024-09-14T09:09:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014188997, 2024-09-14T09:09:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95152 2024-09-14T09:09:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024891+0000", 2024-09-14T09:09:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024891+0000", 2024-09-14T09:09:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024892+0000", 2024-09-14T09:09:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.33e-06 2024-09-14T09:09:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024895+0000", 2024-09-14T09:09:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.181e-06 2024-09-14T09:09:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024901+0000", 2024-09-14T09:09:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5980000000000002e-06 2024-09-14T09:09:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024907+0000", 2024-09-14T09:09:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6010000000000002e-06 2024-09-14T09:09:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95184 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025616+0000", 2024-09-14T09:09:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013240254, 2024-09-14T09:09:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01348825, 2024-09-14T09:09:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95184 2024-09-14T09:09:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025616+0000", 2024-09-14T09:09:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025616+0000", 2024-09-14T09:09:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025617+0000", 2024-09-14T09:09:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6100000000000001e-07 2024-09-14T09:09:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025619+0000", 2024-09-14T09:09:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.618e-06 2024-09-14T09:09:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025626+0000", 2024-09-14T09:09:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8510000000000001e-06 2024-09-14T09:09:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025631+0000", 2024-09-14T09:09:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0459999999999996e-06 2024-09-14T09:09:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95233 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026398+0000", 2024-09-14T09:09:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012459071, 2024-09-14T09:09:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012730376, 2024-09-14T09:09:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95233 2024-09-14T09:09:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026398+0000", 2024-09-14T09:09:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026398+0000", 2024-09-14T09:09:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026398+0000", 2024-09-14T09:09:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2300000000000002e-07 2024-09-14T09:09:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026400+0000", 2024-09-14T09:09:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.64e-06 2024-09-14T09:09:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026406+0000", 2024-09-14T09:09:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9479999999999996e-06 2024-09-14T09:09:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026411+0000", 2024-09-14T09:09:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9729999999999997e-06 2024-09-14T09:09:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95295 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027213+0000", 2024-09-14T09:09:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011643952000000001, 2024-09-14T09:09:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011938295999999999, 2024-09-14T09:09:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95295 2024-09-14T09:09:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027213+0000", 2024-09-14T09:09:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027213+0000", 2024-09-14T09:09:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027213+0000", 2024-09-14T09:09:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6899999999999998e-07 2024-09-14T09:09:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027215+0000", 2024-09-14T09:09:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1119999999999999e-06 2024-09-14T09:09:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027222+0000", 2024-09-14T09:09:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.409e-06 2024-09-14T09:09:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027227+0000", 2024-09-14T09:09:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8250000000000004e-06 2024-09-14T09:09:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95415 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033226+0000", 2024-09-14T09:09:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0056305299999999999, 2024-09-14T09:09:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059542739999999999, 2024-09-14T09:09:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95415 2024-09-14T09:09:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033226+0000", 2024-09-14T09:09:18.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033226+0000", 2024-09-14T09:09:18.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033227+0000", 2024-09-14T09:09:18.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5899999999999996e-07 2024-09-14T09:09:18.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033234+0000", 2024-09-14T09:09:18.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8040000000000004e-06 2024-09-14T09:09:18.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033241+0000", 2024-09-14T09:09:18.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7409999999999992e-06 2024-09-14T09:09:18.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033247+0000", 2024-09-14T09:09:18.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6890000000000001e-06 2024-09-14T09:09:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95503 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034077+0000", 2024-09-14T09:09:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0047801090000000003, 2024-09-14T09:09:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005126851, 2024-09-14T09:09:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95503 2024-09-14T09:09:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034077+0000", 2024-09-14T09:09:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034077+0000", 2024-09-14T09:09:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034077+0000", 2024-09-14T09:09:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0900000000000002e-07 2024-09-14T09:09:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034079+0000", 2024-09-14T09:09:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7799999999999999e-06 2024-09-14T09:09:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034085+0000", 2024-09-14T09:09:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2310000000000001e-06 2024-09-14T09:09:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034090+0000", 2024-09-14T09:09:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7940000000000002e-06 2024-09-14T09:09:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95087 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.024089+0000", 2024-09-14T09:09:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.014768147000000001, 2024-09-14T09:09:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015137955999999999, 2024-09-14T09:09:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95087 2024-09-14T09:09:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024089+0000", 2024-09-14T09:09:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024089+0000", 2024-09-14T09:09:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024089+0000", 2024-09-14T09:09:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2600000000000002e-07 2024-09-14T09:09:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024091+0000", 2024-09-14T09:09:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2479999999999999e-06 2024-09-14T09:09:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024098+0000", 2024-09-14T09:09:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9970000000000001e-06 2024-09-14T09:09:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024104+0000", 2024-09-14T09:09:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2750000000000003e-06 2024-09-14T09:09:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95153 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.024914+0000", 2024-09-14T09:09:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013942272, 2024-09-14T09:09:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014335273000000001, 2024-09-14T09:09:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95153 2024-09-14T09:09:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024914+0000", 2024-09-14T09:09:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024914+0000", 2024-09-14T09:09:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024915+0000", 2024-09-14T09:09:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9299999999999998e-07 2024-09-14T09:09:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024917+0000", 2024-09-14T09:09:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.857e-06 2024-09-14T09:09:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024923+0000", 2024-09-14T09:09:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2999999999999998e-06 2024-09-14T09:09:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024928+0000", 2024-09-14T09:09:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1950000000000002e-06 2024-09-14T09:09:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95185 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025637+0000", 2024-09-14T09:09:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013219806000000001, 2024-09-14T09:09:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01363753, 2024-09-14T09:09:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95185 2024-09-14T09:09:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025637+0000", 2024-09-14T09:09:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025637+0000", 2024-09-14T09:09:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025637+0000", 2024-09-14T09:09:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6800000000000001e-07 2024-09-14T09:09:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025648+0000", 2024-09-14T09:09:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0198e-05 2024-09-14T09:09:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025654+0000", 2024-09-14T09:09:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4169999999999997e-06 2024-09-14T09:09:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025659+0000", 2024-09-14T09:09:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.164e-06 2024-09-14T09:09:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95235 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026416+0000", 2024-09-14T09:09:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012440411, 2024-09-14T09:09:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012885261, 2024-09-14T09:09:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95235 2024-09-14T09:09:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026416+0000", 2024-09-14T09:09:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026416+0000", 2024-09-14T09:09:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026417+0000", 2024-09-14T09:09:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.46e-07 2024-09-14T09:09:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026419+0000", 2024-09-14T09:09:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.888e-06 2024-09-14T09:09:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026424+0000", 2024-09-14T09:09:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.806e-06 2024-09-14T09:09:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026429+0000", 2024-09-14T09:09:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7929999999999997e-06 2024-09-14T09:09:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95297 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027234+0000", 2024-09-14T09:09:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011623207, 2024-09-14T09:09:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012091186, 2024-09-14T09:09:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95297 2024-09-14T09:09:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027234+0000", 2024-09-14T09:09:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027234+0000", 2024-09-14T09:09:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027234+0000", 2024-09-14T09:09:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4900000000000001e-07 2024-09-14T09:09:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027236+0000", 2024-09-14T09:09:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0590000000000001e-06 2024-09-14T09:09:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027244+0000", 2024-09-14T09:09:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8709999999999997e-06 2024-09-14T09:09:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027249+0000", 2024-09-14T09:09:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2970000000000003e-06 2024-09-14T09:09:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95417 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033258+0000", 2024-09-14T09:09:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0055988490000000004, 2024-09-14T09:09:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060903190000000003, 2024-09-14T09:09:18.113 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95417 2024-09-14T09:09:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033258+0000", 2024-09-14T09:09:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033258+0000", 2024-09-14T09:09:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033258+0000", 2024-09-14T09:09:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.06e-07 2024-09-14T09:09:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033261+0000", 2024-09-14T09:09:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1129999999999999e-06 2024-09-14T09:09:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033267+0000", 2024-09-14T09:09:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.798e-06 2024-09-14T09:09:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033273+0000", 2024-09-14T09:09:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2650000000000004e-06 2024-09-14T09:09:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.116 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95505 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034095+0000", 2024-09-14T09:09:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0047612499999999999, 2024-09-14T09:09:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052776419999999999, 2024-09-14T09:09:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95505 2024-09-14T09:09:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034095+0000", 2024-09-14T09:09:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034095+0000", 2024-09-14T09:09:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034096+0000", 2024-09-14T09:09:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2099999999999998e-07 2024-09-14T09:09:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034097+0000", 2024-09-14T09:09:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.635e-06 2024-09-14T09:09:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034103+0000", 2024-09-14T09:09:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9989999999999997e-06 2024-09-14T09:09:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034108+0000", 2024-09-14T09:09:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7589999999999997e-06 2024-09-14T09:09:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.119 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95089 3.17 3:ed6e13b0:::rbd_data.1112b1c2f9b0.0000000000000000:20 [read 12982272~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.024112+0000", 2024-09-14T09:09:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.014744422, 2024-09-14T09:09:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015292455, 2024-09-14T09:09:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.120 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95089 2024-09-14T09:09:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024112+0000", 2024-09-14T09:09:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024112+0000", 2024-09-14T09:09:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024113+0000", 2024-09-14T09:09:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4799999999999998e-07 2024-09-14T09:09:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024115+0000", 2024-09-14T09:09:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8610000000000001e-06 2024-09-14T09:09:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024120+0000", 2024-09-14T09:09:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5620000000000003e-06 2024-09-14T09:09:18.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024125+0000", 2024-09-14T09:09:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1850000000000003e-06 2024-09-14T09:09:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039364+0000", 2024-09-14T09:09:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015238442 2024-09-14T09:09:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95154 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.024938+0000", 2024-09-14T09:09:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013919034, 2024-09-14T09:09:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01449434, 2024-09-14T09:09:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95154 2024-09-14T09:09:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.124 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024938+0000", 2024-09-14T09:09:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024938+0000", 2024-09-14T09:09:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024938+0000", 2024-09-14T09:09:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7100000000000002e-07 2024-09-14T09:09:18.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024940+0000", 2024-09-14T09:09:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9149999999999999e-06 2024-09-14T09:09:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024948+0000", 2024-09-14T09:09:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0749999999999998e-06 2024-09-14T09:09:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024954+0000", 2024-09-14T09:09:18.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4079999999999997e-06 2024-09-14T09:09:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95186 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025666+0000", 2024-09-14T09:09:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013191026, 2024-09-14T09:09:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013789232, 2024-09-14T09:09:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.127 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95186 2024-09-14T09:09:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025666+0000", 2024-09-14T09:09:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025666+0000", 2024-09-14T09:09:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025666+0000", 2024-09-14T09:09:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5599999999999995e-07 2024-09-14T09:09:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025668+0000", 2024-09-14T09:09:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.655e-06 2024-09-14T09:09:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025676+0000", 2024-09-14T09:09:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.875e-06 2024-09-14T09:09:18.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025681+0000", 2024-09-14T09:09:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8740000000000003e-06 2024-09-14T09:09:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95237 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026450+0000", 2024-09-14T09:09:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012406906000000001, 2024-09-14T09:09:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013030108, 2024-09-14T09:09:18.130 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95237 2024-09-14T09:09:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026450+0000", 2024-09-14T09:09:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026450+0000", 2024-09-14T09:09:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026450+0000", 2024-09-14T09:09:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6700000000000003e-07 2024-09-14T09:09:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026452+0000", 2024-09-14T09:09:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.844e-06 2024-09-14T09:09:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026461+0000", 2024-09-14T09:09:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3480000000000004e-06 2024-09-14T09:09:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026466+0000", 2024-09-14T09:09:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.152e-06 2024-09-14T09:09:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.133 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95299 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027257+0000", 2024-09-14T09:09:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011599784, 2024-09-14T09:09:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012246959999999999, 2024-09-14T09:09:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95299 2024-09-14T09:09:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027257+0000", 2024-09-14T09:09:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027257+0000", 2024-09-14T09:09:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027257+0000", 2024-09-14T09:09:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.27e-07 2024-09-14T09:09:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027259+0000", 2024-09-14T09:09:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.95e-06 2024-09-14T09:09:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027265+0000", 2024-09-14T09:09:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8279999999999999e-06 2024-09-14T09:09:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027278+0000", 2024-09-14T09:09:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2405999999999999e-05 2024-09-14T09:09:18.136 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95419 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033280+0000", 2024-09-14T09:09:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0055769010000000004, 2024-09-14T09:09:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062471469999999998, 2024-09-14T09:09:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.137 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95419 2024-09-14T09:09:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033280+0000", 2024-09-14T09:09:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033280+0000", 2024-09-14T09:09:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033280+0000", 2024-09-14T09:09:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7899999999999999e-07 2024-09-14T09:09:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033282+0000", 2024-09-14T09:09:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-06 2024-09-14T09:09:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033289+0000", 2024-09-14T09:09:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9140000000000002e-06 2024-09-14T09:09:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033294+0000", 2024-09-14T09:09:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9949999999999996e-06 2024-09-14T09:09:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95506 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034115+0000", 2024-09-14T09:09:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.004742011, 2024-09-14T09:09:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054351720000000003, 2024-09-14T09:09:18.140 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95506 2024-09-14T09:09:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034115+0000", 2024-09-14T09:09:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034115+0000", 2024-09-14T09:09:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034115+0000", 2024-09-14T09:09:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0600000000000001e-07 2024-09-14T09:09:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034117+0000", 2024-09-14T09:09:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.824e-06 2024-09-14T09:09:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034123+0000", 2024-09-14T09:09:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0510000000000002e-06 2024-09-14T09:09:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034128+0000", 2024-09-14T09:09:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0010000000000001e-06 2024-09-14T09:09:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95155 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.024960+0000", 2024-09-14T09:09:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013896644999999999, 2024-09-14T09:09:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014615101, 2024-09-14T09:09:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95155 2024-09-14T09:09:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024960+0000", 2024-09-14T09:09:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024960+0000", 2024-09-14T09:09:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024961+0000", 2024-09-14T09:09:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7000000000000005e-07 2024-09-14T09:09:18.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024963+0000", 2024-09-14T09:09:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9290000000000001e-06 2024-09-14T09:09:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024970+0000", 2024-09-14T09:09:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6389999999999992e-06 2024-09-14T09:09:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024976+0000", 2024-09-14T09:09:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4210000000000003e-06 2024-09-14T09:09:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95187 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025703+0000", 2024-09-14T09:09:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013153264, 2024-09-14T09:09:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013895644, 2024-09-14T09:09:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.147 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95187 2024-09-14T09:09:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025703+0000", 2024-09-14T09:09:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025703+0000", 2024-09-14T09:09:18.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025704+0000", 2024-09-14T09:09:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699999999999995e-07 2024-09-14T09:09:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025707+0000", 2024-09-14T09:09:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.441e-06 2024-09-14T09:09:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025714+0000", 2024-09-14T09:09:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0380000000000002e-06 2024-09-14T09:09:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025719+0000", 2024-09-14T09:09:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2024-09-14T09:09:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95239 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026472+0000", 2024-09-14T09:09:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012384330000000001, 2024-09-14T09:09:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013149898, 2024-09-14T09:09:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95239 2024-09-14T09:09:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026472+0000", 2024-09-14T09:09:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026472+0000", 2024-09-14T09:09:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026473+0000", 2024-09-14T09:09:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4499999999999997e-07 2024-09-14T09:09:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026475+0000", 2024-09-14T09:09:18.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8670000000000001e-06 2024-09-14T09:09:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026480+0000", 2024-09-14T09:09:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6289999999999998e-06 2024-09-14T09:09:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026485+0000", 2024-09-14T09:09:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9529999999999998e-06 2024-09-14T09:09:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95301 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027290+0000", 2024-09-14T09:09:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011566247999999999, 2024-09-14T09:09:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012355276, 2024-09-14T09:09:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95301 2024-09-14T09:09:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.154 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027290+0000", 2024-09-14T09:09:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027290+0000", 2024-09-14T09:09:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027291+0000", 2024-09-14T09:09:18.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1999999999999999e-07 2024-09-14T09:09:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027293+0000", 2024-09-14T09:09:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3199999999999998e-06 2024-09-14T09:09:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027303+0000", 2024-09-14T09:09:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2350000000000005e-06 2024-09-14T09:09:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027312+0000", 2024-09-14T09:09:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8209999999999997e-06 2024-09-14T09:09:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95421 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033301+0000", 2024-09-14T09:09:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0055553620000000003, 2024-09-14T09:09:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063741809999999996, 2024-09-14T09:09:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.157 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95421 2024-09-14T09:09:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033301+0000", 2024-09-14T09:09:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033301+0000", 2024-09-14T09:09:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033302+0000", 2024-09-14T09:09:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9200000000000002e-07 2024-09-14T09:09:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033304+0000", 2024-09-14T09:09:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9e-06 2024-09-14T09:09:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033311+0000", 2024-09-14T09:09:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7230000000000004e-06 2024-09-14T09:09:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033317+0000", 2024-09-14T09:09:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6960000000000002e-06 2024-09-14T09:09:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.160 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95508 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034154+0000", 2024-09-14T09:09:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0047024889999999998, 2024-09-14T09:09:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055448909999999997, 2024-09-14T09:09:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95508 2024-09-14T09:09:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034154+0000", 2024-09-14T09:09:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034154+0000", 2024-09-14T09:09:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034155+0000", 2024-09-14T09:09:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0500000000000003e-07 2024-09-14T09:09:18.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034157+0000", 2024-09-14T09:09:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2819999999999999e-06 2024-09-14T09:09:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034165+0000", 2024-09-14T09:09:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5170000000000002e-06 2024-09-14T09:09:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034172+0000", 2024-09-14T09:09:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1330000000000001e-06 2024-09-14T09:09:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95156 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.024982+0000", 2024-09-14T09:09:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013874839, 2024-09-14T09:09:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014758835, 2024-09-14T09:09:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95156 2024-09-14T09:09:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024982+0000", 2024-09-14T09:09:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024982+0000", 2024-09-14T09:09:18.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024982+0000", 2024-09-14T09:09:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4199999999999996e-07 2024-09-14T09:09:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024984+0000", 2024-09-14T09:09:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.838e-06 2024-09-14T09:09:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024990+0000", 2024-09-14T09:09:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9560000000000002e-06 2024-09-14T09:09:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.024995+0000", 2024-09-14T09:09:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0490000000000003e-06 2024-09-14T09:09:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95188 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.167 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025727+0000", 2024-09-14T09:09:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013130146000000001, 2024-09-14T09:09:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014045899000000001, 2024-09-14T09:09:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95188 2024-09-14T09:09:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025727+0000", 2024-09-14T09:09:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025727+0000", 2024-09-14T09:09:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025727+0000", 2024-09-14T09:09:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7700000000000004e-07 2024-09-14T09:09:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025729+0000", 2024-09-14T09:09:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8530000000000001e-06 2024-09-14T09:09:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025741+0000", 2024-09-14T09:09:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1976e-05 2024-09-14T09:09:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025747+0000", 2024-09-14T09:09:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8710000000000002e-06 2024-09-14T09:09:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.170 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95241 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026492+0000", 2024-09-14T09:09:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012364976, 2024-09-14T09:09:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013304766000000001, 2024-09-14T09:09:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95241 2024-09-14T09:09:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026492+0000", 2024-09-14T09:09:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026492+0000", 2024-09-14T09:09:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026492+0000", 2024-09-14T09:09:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9400000000000001e-07 2024-09-14T09:09:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026494+0000", 2024-09-14T09:09:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0829999999999998e-06 2024-09-14T09:09:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026501+0000", 2024-09-14T09:09:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8900000000000001e-06 2024-09-14T09:09:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026506+0000", 2024-09-14T09:09:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9819999999999999e-06 2024-09-14T09:09:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95303 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027322+0000", 2024-09-14T09:09:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011534849999999999, 2024-09-14T09:09:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012497516, 2024-09-14T09:09:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.174 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95303 2024-09-14T09:09:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027322+0000", 2024-09-14T09:09:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027322+0000", 2024-09-14T09:09:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027322+0000", 2024-09-14T09:09:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5600000000000001e-07 2024-09-14T09:09:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027325+0000", 2024-09-14T09:09:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2120000000000002e-06 2024-09-14T09:09:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027331+0000", 2024-09-14T09:09:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.562e-06 2024-09-14T09:09:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027336+0000", 2024-09-14T09:09:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2680000000000002e-06 2024-09-14T09:09:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95423 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033330+0000", 2024-09-14T09:09:18.177 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.005526581, 2024-09-14T09:09:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065120029999999997, 2024-09-14T09:09:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95423 2024-09-14T09:09:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033330+0000", 2024-09-14T09:09:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033330+0000", 2024-09-14T09:09:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033331+0000", 2024-09-14T09:09:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5300000000000004e-07 2024-09-14T09:09:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033333+0000", 2024-09-14T09:09:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2079999999999999e-06 2024-09-14T09:09:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033339+0000", 2024-09-14T09:09:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5629999999999997e-06 2024-09-14T09:09:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033345+0000", 2024-09-14T09:09:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0649999999999998e-06 2024-09-14T09:09:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95510 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034180+0000", 2024-09-14T09:09:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0046769000000000003, 2024-09-14T09:09:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056853119999999997, 2024-09-14T09:09:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95510 2024-09-14T09:09:18.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034180+0000", 2024-09-14T09:09:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034180+0000", 2024-09-14T09:09:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034180+0000", 2024-09-14T09:09:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:09:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034191+0000", 2024-09-14T09:09:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0876000000000001e-05 2024-09-14T09:09:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034200+0000", 2024-09-14T09:09:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5010000000000004e-06 2024-09-14T09:09:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034206+0000", 2024-09-14T09:09:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.268e-06 2024-09-14T09:09:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95157 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025001+0000", 2024-09-14T09:09:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013855548000000001, 2024-09-14T09:09:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014891181999999999, 2024-09-14T09:09:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.184 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95157 2024-09-14T09:09:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025001+0000", 2024-09-14T09:09:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025001+0000", 2024-09-14T09:09:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025002+0000", 2024-09-14T09:09:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1399999999999997e-07 2024-09-14T09:09:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025003+0000", 2024-09-14T09:09:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6950000000000001e-06 2024-09-14T09:09:18.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025011+0000", 2024-09-14T09:09:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8939999999999993e-06 2024-09-14T09:09:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025017+0000", 2024-09-14T09:09:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2460000000000003e-06 2024-09-14T09:09:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.187 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95189 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025764+0000", 2024-09-14T09:09:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013093115000000001, 2024-09-14T09:09:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014153136, 2024-09-14T09:09:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95189 2024-09-14T09:09:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025764+0000", 2024-09-14T09:09:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025764+0000", 2024-09-14T09:09:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025764+0000", 2024-09-14T09:09:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5000000000000002e-07 2024-09-14T09:09:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025766+0000", 2024-09-14T09:09:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1390000000000002e-06 2024-09-14T09:09:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025775+0000", 2024-09-14T09:09:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3690000000000007e-06 2024-09-14T09:09:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025780+0000", 2024-09-14T09:09:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0699999999999997e-06 2024-09-14T09:09:18.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95243 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026512+0000", 2024-09-14T09:09:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012344605999999999, 2024-09-14T09:09:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013427735, 2024-09-14T09:09:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95243 2024-09-14T09:09:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026512+0000", 2024-09-14T09:09:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026512+0000", 2024-09-14T09:09:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026513+0000", 2024-09-14T09:09:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-07 2024-09-14T09:09:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026518+0000", 2024-09-14T09:09:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6239999999999999e-06 2024-09-14T09:09:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026525+0000", 2024-09-14T09:09:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7460000000000003e-06 2024-09-14T09:09:18.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026529+0000", 2024-09-14T09:09:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5700000000000003e-06 2024-09-14T09:09:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95305 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027344+0000", 2024-09-14T09:09:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011513214000000001, 2024-09-14T09:09:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012619896, 2024-09-14T09:09:18.194 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95305 2024-09-14T09:09:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027344+0000", 2024-09-14T09:09:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027344+0000", 2024-09-14T09:09:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027344+0000", 2024-09-14T09:09:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.03e-07 2024-09-14T09:09:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027346+0000", 2024-09-14T09:09:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8390000000000001e-06 2024-09-14T09:09:18.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027352+0000", 2024-09-14T09:09:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0769999999999996e-06 2024-09-14T09:09:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027357+0000", 2024-09-14T09:09:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.48e-06 2024-09-14T09:09:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95425 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033352+0000", 2024-09-14T09:09:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0055044830000000001, 2024-09-14T09:09:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006635597, 2024-09-14T09:09:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95425 2024-09-14T09:09:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033352+0000", 2024-09-14T09:09:18.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033352+0000", 2024-09-14T09:09:18.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033353+0000", 2024-09-14T09:09:18.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2300000000000001e-07 2024-09-14T09:09:18.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033355+0000", 2024-09-14T09:09:18.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2469999999999998e-06 2024-09-14T09:09:18.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033361+0000", 2024-09-14T09:09:18.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.421e-06 2024-09-14T09:09:18.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033367+0000", 2024-09-14T09:09:18.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.152e-06 2024-09-14T09:09:18.200 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.201 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.201 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.201 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95512 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.201 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034214+0000", 2024-09-14T09:09:18.201 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0046426460000000003, 2024-09-14T09:09:18.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0057966900000000002, 2024-09-14T09:09:18.201 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.201 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.201 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.201 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.201 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.201 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.202 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95512 2024-09-14T09:09:18.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.202 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034214+0000", 2024-09-14T09:09:18.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034214+0000", 2024-09-14T09:09:18.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034215+0000", 2024-09-14T09:09:18.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4200000000000001e-07 2024-09-14T09:09:18.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034217+0000", 2024-09-14T09:09:18.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2790000000000001e-06 2024-09-14T09:09:18.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034224+0000", 2024-09-14T09:09:18.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8839999999999997e-06 2024-09-14T09:09:18.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034229+0000", 2024-09-14T09:09:18.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7089999999999999e-06 2024-09-14T09:09:18.204 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.204 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.204 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.204 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95158 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.204 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025028+0000", 2024-09-14T09:09:18.204 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013828339, 2024-09-14T09:09:18.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015006772, 2024-09-14T09:09:18.204 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.204 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.205 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.205 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95158 2024-09-14T09:09:18.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.205 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025028+0000", 2024-09-14T09:09:18.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025028+0000", 2024-09-14T09:09:18.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025029+0000", 2024-09-14T09:09:18.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6499999999999999e-07 2024-09-14T09:09:18.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025031+0000", 2024-09-14T09:09:18.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.787e-06 2024-09-14T09:09:18.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025037+0000", 2024-09-14T09:09:18.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9429999999999997e-06 2024-09-14T09:09:18.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025041+0000", 2024-09-14T09:09:18.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6890000000000003e-06 2024-09-14T09:09:18.207 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.207 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.207 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.207 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95190 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.208 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025801+0000", 2024-09-14T09:09:18.208 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013055720999999999, 2024-09-14T09:09:18.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014257392000000001, 2024-09-14T09:09:18.208 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.208 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.208 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.208 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.208 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.208 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.208 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95190 2024-09-14T09:09:18.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.208 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025801+0000", 2024-09-14T09:09:18.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025801+0000", 2024-09-14T09:09:18.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025802+0000", 2024-09-14T09:09:18.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7000000000000004e-07 2024-09-14T09:09:18.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025804+0000", 2024-09-14T09:09:18.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9740000000000001e-06 2024-09-14T09:09:18.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025810+0000", 2024-09-14T09:09:18.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.37e-06 2024-09-14T09:09:18.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025815+0000", 2024-09-14T09:09:18.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1359999999999996e-06 2024-09-14T09:09:18.210 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.210 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.211 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.211 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95245 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.211 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026550+0000", 2024-09-14T09:09:18.211 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012306263, 2024-09-14T09:09:18.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013531733000000001, 2024-09-14T09:09:18.211 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.211 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.211 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.211 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.211 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.211 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.211 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95245 2024-09-14T09:09:18.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.212 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026550+0000", 2024-09-14T09:09:18.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026550+0000", 2024-09-14T09:09:18.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026551+0000", 2024-09-14T09:09:18.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6300000000000005e-07 2024-09-14T09:09:18.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026553+0000", 2024-09-14T09:09:18.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2400000000000002e-06 2024-09-14T09:09:18.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026560+0000", 2024-09-14T09:09:18.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1219999999999997e-06 2024-09-14T09:09:18.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026568+0000", 2024-09-14T09:09:18.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8679999999999999e-06 2024-09-14T09:09:18.214 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.214 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.214 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.214 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95307 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.214 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027364+0000", 2024-09-14T09:09:18.214 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.01149271, 2024-09-14T09:09:18.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012742178999999999, 2024-09-14T09:09:18.214 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.214 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.215 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.215 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.215 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.215 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.215 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95307 2024-09-14T09:09:18.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.215 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027364+0000", 2024-09-14T09:09:18.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027364+0000", 2024-09-14T09:09:18.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027364+0000", 2024-09-14T09:09:18.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.77e-07 2024-09-14T09:09:18.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027367+0000", 2024-09-14T09:09:18.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0940000000000002e-06 2024-09-14T09:09:18.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027373+0000", 2024-09-14T09:09:18.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2530000000000001e-06 2024-09-14T09:09:18.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027378+0000", 2024-09-14T09:09:18.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0950000000000003e-06 2024-09-14T09:09:18.217 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.217 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.217 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.217 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95427 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.218 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033374+0000", 2024-09-14T09:09:18.218 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0054831080000000004, 2024-09-14T09:09:18.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067555200000000001, 2024-09-14T09:09:18.218 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.218 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.218 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.218 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.218 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.218 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.218 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95427 2024-09-14T09:09:18.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.218 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033374+0000", 2024-09-14T09:09:18.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033374+0000", 2024-09-14T09:09:18.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033374+0000", 2024-09-14T09:09:18.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3700000000000001e-07 2024-09-14T09:09:18.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033376+0000", 2024-09-14T09:09:18.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9010000000000001e-06 2024-09-14T09:09:18.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033382+0000", 2024-09-14T09:09:18.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4590000000000003e-06 2024-09-14T09:09:18.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033387+0000", 2024-09-14T09:09:18.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9389999999999996e-06 2024-09-14T09:09:18.220 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.220 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.220 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.221 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95514 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.221 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034237+0000", 2024-09-14T09:09:18.221 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0046200310000000001, 2024-09-14T09:09:18.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059152470000000002, 2024-09-14T09:09:18.221 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.221 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.221 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.221 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.221 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.221 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.221 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95514 2024-09-14T09:09:18.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.221 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034237+0000", 2024-09-14T09:09:18.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034237+0000", 2024-09-14T09:09:18.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034237+0000", 2024-09-14T09:09:18.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4000000000000002e-07 2024-09-14T09:09:18.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034239+0000", 2024-09-14T09:09:18.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8479999999999999e-06 2024-09-14T09:09:18.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034245+0000", 2024-09-14T09:09:18.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2720000000000003e-06 2024-09-14T09:09:18.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034251+0000", 2024-09-14T09:09:18.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3639999999999998e-06 2024-09-14T09:09:18.223 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.224 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.224 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.224 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95159 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.224 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025048+0000", 2024-09-14T09:09:18.224 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013808288, 2024-09-14T09:09:18.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015127414, 2024-09-14T09:09:18.224 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.224 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.224 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.224 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.224 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.225 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.225 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95159 2024-09-14T09:09:18.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.225 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025048+0000", 2024-09-14T09:09:18.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025048+0000", 2024-09-14T09:09:18.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025049+0000", 2024-09-14T09:09:18.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8299999999999997e-07 2024-09-14T09:09:18.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025051+0000", 2024-09-14T09:09:18.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1550000000000001e-06 2024-09-14T09:09:18.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025057+0000", 2024-09-14T09:09:18.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8340000000000004e-06 2024-09-14T09:09:18.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025064+0000", 2024-09-14T09:09:18.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3760000000000002e-06 2024-09-14T09:09:18.227 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.227 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.227 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.227 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95191 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.227 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025823+0000", 2024-09-14T09:09:18.227 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013033617000000001, 2024-09-14T09:09:18.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014375812, 2024-09-14T09:09:18.227 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.228 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.228 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.228 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.228 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.228 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.228 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95191 2024-09-14T09:09:18.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.228 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025823+0000", 2024-09-14T09:09:18.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025823+0000", 2024-09-14T09:09:18.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025824+0000", 2024-09-14T09:09:18.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.51e-07 2024-09-14T09:09:18.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025826+0000", 2024-09-14T09:09:18.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9769999999999999e-06 2024-09-14T09:09:18.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025832+0000", 2024-09-14T09:09:18.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2319999999999998e-06 2024-09-14T09:09:18.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025837+0000", 2024-09-14T09:09:18.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2290000000000002e-06 2024-09-14T09:09:18.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.230 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.231 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95247 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.231 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026576+0000", 2024-09-14T09:09:18.231 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012280968999999999, 2024-09-14T09:09:18.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01364714, 2024-09-14T09:09:18.231 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.231 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.231 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.231 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.231 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.231 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.231 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95247 2024-09-14T09:09:18.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.231 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026576+0000", 2024-09-14T09:09:18.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026576+0000", 2024-09-14T09:09:18.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026576+0000", 2024-09-14T09:09:18.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3700000000000001e-07 2024-09-14T09:09:18.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026578+0000", 2024-09-14T09:09:18.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.063e-06 2024-09-14T09:09:18.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026585+0000", 2024-09-14T09:09:18.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9569999999999996e-06 2024-09-14T09:09:18.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026590+0000", 2024-09-14T09:09:18.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.135e-06 2024-09-14T09:09:18.234 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.234 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.234 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.234 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95309 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.234 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027386+0000", 2024-09-14T09:09:18.234 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011470943000000001, 2024-09-14T09:09:18.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012860453000000001, 2024-09-14T09:09:18.234 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.234 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.234 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.235 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.235 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.235 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.235 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95309 2024-09-14T09:09:18.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.235 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027386+0000", 2024-09-14T09:09:18.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027386+0000", 2024-09-14T09:09:18.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027386+0000", 2024-09-14T09:09:18.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7100000000000002e-07 2024-09-14T09:09:18.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027388+0000", 2024-09-14T09:09:18.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-06 2024-09-14T09:09:18.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027395+0000", 2024-09-14T09:09:18.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2519999999999996e-06 2024-09-14T09:09:18.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027400+0000", 2024-09-14T09:09:18.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2009999999999998e-06 2024-09-14T09:09:18.237 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.237 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.237 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.237 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95429 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.237 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033394+0000", 2024-09-14T09:09:18.238 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0054624529999999999, 2024-09-14T09:09:18.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0068767519999999999, 2024-09-14T09:09:18.238 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.238 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.238 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.238 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.238 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.238 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.238 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95429 2024-09-14T09:09:18.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.238 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033394+0000", 2024-09-14T09:09:18.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033394+0000", 2024-09-14T09:09:18.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033395+0000", 2024-09-14T09:09:18.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9499999999999998e-07 2024-09-14T09:09:18.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033397+0000", 2024-09-14T09:09:18.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.137e-06 2024-09-14T09:09:18.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033404+0000", 2024-09-14T09:09:18.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8279999999999997e-06 2024-09-14T09:09:18.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033410+0000", 2024-09-14T09:09:18.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8020000000000003e-06 2024-09-14T09:09:18.240 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.240 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.241 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.241 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95516 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.241 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034257+0000", 2024-09-14T09:09:18.241 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0045993739999999998, 2024-09-14T09:09:18.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060361970000000001, 2024-09-14T09:09:18.241 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.241 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.241 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.241 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.241 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.241 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.241 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95516 2024-09-14T09:09:18.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.242 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034257+0000", 2024-09-14T09:09:18.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034257+0000", 2024-09-14T09:09:18.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034258+0000", 2024-09-14T09:09:18.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2024-09-14T09:09:18.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034260+0000", 2024-09-14T09:09:18.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9199999999999998e-06 2024-09-14T09:09:18.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034267+0000", 2024-09-14T09:09:18.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8700000000000003e-06 2024-09-14T09:09:18.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034272+0000", 2024-09-14T09:09:18.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0679999999999996e-06 2024-09-14T09:09:18.244 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.244 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.244 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.244 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95160 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.244 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025071+0000", 2024-09-14T09:09:18.244 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013785446, 2024-09-14T09:09:18.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015246621, 2024-09-14T09:09:18.244 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.244 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.245 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.245 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.245 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.245 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.245 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95160 2024-09-14T09:09:18.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.245 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025071+0000", 2024-09-14T09:09:18.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025071+0000", 2024-09-14T09:09:18.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025072+0000", 2024-09-14T09:09:18.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7599999999999997e-07 2024-09-14T09:09:18.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025074+0000", 2024-09-14T09:09:18.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8929999999999999e-06 2024-09-14T09:09:18.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025080+0000", 2024-09-14T09:09:18.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.959e-06 2024-09-14T09:09:18.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025085+0000", 2024-09-14T09:09:18.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6559999999999997e-06 2024-09-14T09:09:18.247 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.247 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.247 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.247 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95192 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.248 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025843+0000", 2024-09-14T09:09:18.248 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013013382, 2024-09-14T09:09:18.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014498194000000001, 2024-09-14T09:09:18.248 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.248 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.248 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.248 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95192 2024-09-14T09:09:18.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.248 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025843+0000", 2024-09-14T09:09:18.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025843+0000", 2024-09-14T09:09:18.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025844+0000", 2024-09-14T09:09:18.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3600000000000004e-07 2024-09-14T09:09:18.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025846+0000", 2024-09-14T09:09:18.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.885e-06 2024-09-14T09:09:18.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025852+0000", 2024-09-14T09:09:18.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8499999999999999e-06 2024-09-14T09:09:18.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025857+0000", 2024-09-14T09:09:18.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8829999999999997e-06 2024-09-14T09:09:18.250 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.250 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.251 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.251 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95249 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.251 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026597+0000", 2024-09-14T09:09:18.251 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012259870000000001, 2024-09-14T09:09:18.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013767623999999999, 2024-09-14T09:09:18.251 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.251 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.251 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.251 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.251 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.251 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.251 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95249 2024-09-14T09:09:18.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.252 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026597+0000", 2024-09-14T09:09:18.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026597+0000", 2024-09-14T09:09:18.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026597+0000", 2024-09-14T09:09:18.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6100000000000002e-07 2024-09-14T09:09:18.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026599+0000", 2024-09-14T09:09:18.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9870000000000002e-06 2024-09-14T09:09:18.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026605+0000", 2024-09-14T09:09:18.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0079999999999999e-06 2024-09-14T09:09:18.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026611+0000", 2024-09-14T09:09:18.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1859999999999997e-06 2024-09-14T09:09:18.254 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.254 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.254 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.254 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95311 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.254 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027407+0000", 2024-09-14T09:09:18.254 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011450189, 2024-09-14T09:09:18.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012980584, 2024-09-14T09:09:18.254 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.254 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.254 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.255 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.255 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.255 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.255 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95311 2024-09-14T09:09:18.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.255 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027407+0000", 2024-09-14T09:09:18.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027407+0000", 2024-09-14T09:09:18.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027407+0000", 2024-09-14T09:09:18.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9800000000000004e-07 2024-09-14T09:09:18.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027409+0000", 2024-09-14T09:09:18.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-06 2024-09-14T09:09:18.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027416+0000", 2024-09-14T09:09:18.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4119999999999998e-06 2024-09-14T09:09:18.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027421+0000", 2024-09-14T09:09:18.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6250000000000004e-06 2024-09-14T09:09:18.257 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.257 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.257 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.257 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95431 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.258 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033438+0000", 2024-09-14T09:09:18.258 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0054190089999999998, 2024-09-14T09:09:18.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069722070000000002, 2024-09-14T09:09:18.258 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.258 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.258 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.258 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.258 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.258 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.258 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95431 2024-09-14T09:09:18.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.258 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033438+0000", 2024-09-14T09:09:18.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033438+0000", 2024-09-14T09:09:18.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033438+0000", 2024-09-14T09:09:18.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0999999999999999e-07 2024-09-14T09:09:18.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033441+0000", 2024-09-14T09:09:18.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.429e-06 2024-09-14T09:09:18.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033449+0000", 2024-09-14T09:09:18.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8790000000000003e-06 2024-09-14T09:09:18.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033454+0000", 2024-09-14T09:09:18.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5589999999999996e-06 2024-09-14T09:09:18.261 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.261 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.261 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.261 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95518 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.261 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034278+0000", 2024-09-14T09:09:18.261 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0045787659999999997, 2024-09-14T09:09:18.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061561469999999998, 2024-09-14T09:09:18.261 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.261 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.261 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.261 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.261 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.262 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.262 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95518 2024-09-14T09:09:18.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.262 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034278+0000", 2024-09-14T09:09:18.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034278+0000", 2024-09-14T09:09:18.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034278+0000", 2024-09-14T09:09:18.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2024-09-14T09:09:18.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034280+0000", 2024-09-14T09:09:18.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.81e-06 2024-09-14T09:09:18.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034286+0000", 2024-09-14T09:09:18.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2530000000000001e-06 2024-09-14T09:09:18.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034291+0000", 2024-09-14T09:09:18.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8910000000000003e-06 2024-09-14T09:09:18.264 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.264 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.264 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.264 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95161 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.264 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025091+0000", 2024-09-14T09:09:18.264 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013765438, 2024-09-14T09:09:18.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015367528, 2024-09-14T09:09:18.265 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.265 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.265 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.265 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.265 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.265 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.265 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95161 2024-09-14T09:09:18.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.265 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025091+0000", 2024-09-14T09:09:18.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025091+0000", 2024-09-14T09:09:18.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025092+0000", 2024-09-14T09:09:18.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4199999999999996e-07 2024-09-14T09:09:18.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025098+0000", 2024-09-14T09:09:18.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6980000000000003e-06 2024-09-14T09:09:18.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025104+0000", 2024-09-14T09:09:18.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0090000000000004e-06 2024-09-14T09:09:18.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025109+0000", 2024-09-14T09:09:18.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4700000000000001e-06 2024-09-14T09:09:18.267 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.267 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.267 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.268 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95193 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.268 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025862+0000", 2024-09-14T09:09:18.268 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012994489999999999, 2024-09-14T09:09:18.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014619592000000001, 2024-09-14T09:09:18.268 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.268 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.268 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.268 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.268 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.268 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.268 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95193 2024-09-14T09:09:18.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.269 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025862+0000", 2024-09-14T09:09:18.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025862+0000", 2024-09-14T09:09:18.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025863+0000", 2024-09-14T09:09:18.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2e-07 2024-09-14T09:09:18.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025865+0000", 2024-09-14T09:09:18.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9489999999999999e-06 2024-09-14T09:09:18.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025873+0000", 2024-09-14T09:09:18.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1000000000000004e-06 2024-09-14T09:09:18.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025878+0000", 2024-09-14T09:09:18.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2730000000000002e-06 2024-09-14T09:09:18.271 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.271 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.271 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.271 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95251 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.271 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026618+0000", 2024-09-14T09:09:18.271 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012238272999999999, 2024-09-14T09:09:18.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013886478000000001, 2024-09-14T09:09:18.271 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.271 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.271 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.271 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.272 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.272 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.272 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95251 2024-09-14T09:09:18.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.272 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026618+0000", 2024-09-14T09:09:18.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026618+0000", 2024-09-14T09:09:18.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026619+0000", 2024-09-14T09:09:18.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7899999999999999e-07 2024-09-14T09:09:18.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026621+0000", 2024-09-14T09:09:18.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1909999999999999e-06 2024-09-14T09:09:18.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026628+0000", 2024-09-14T09:09:18.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.182e-06 2024-09-14T09:09:18.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026633+0000", 2024-09-14T09:09:18.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8590000000000004e-06 2024-09-14T09:09:18.274 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.274 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.274 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.274 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95312 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.274 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027428+0000", 2024-09-14T09:09:18.275 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011428262, 2024-09-14T09:09:18.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013099184999999999, 2024-09-14T09:09:18.275 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.275 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.275 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.275 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.275 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.275 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.275 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95312 2024-09-14T09:09:18.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.275 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027428+0000", 2024-09-14T09:09:18.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027428+0000", 2024-09-14T09:09:18.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027429+0000", 2024-09-14T09:09:18.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1600000000000002e-07 2024-09-14T09:09:18.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027438+0000", 2024-09-14T09:09:18.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0799999999999995e-06 2024-09-14T09:09:18.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027445+0000", 2024-09-14T09:09:18.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.951e-06 2024-09-14T09:09:18.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027450+0000", 2024-09-14T09:09:18.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2399999999999998e-06 2024-09-14T09:09:18.277 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.278 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.278 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.278 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95434 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.278 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033463+0000", 2024-09-14T09:09:18.278 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0053939649999999997, 2024-09-14T09:09:18.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0071103340000000003, 2024-09-14T09:09:18.278 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.278 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.278 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.278 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.278 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.278 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.278 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95434 2024-09-14T09:09:18.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.279 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033463+0000", 2024-09-14T09:09:18.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033463+0000", 2024-09-14T09:09:18.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033463+0000", 2024-09-14T09:09:18.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7899999999999999e-07 2024-09-14T09:09:18.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033465+0000", 2024-09-14T09:09:18.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1320000000000001e-06 2024-09-14T09:09:18.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033472+0000", 2024-09-14T09:09:18.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0400000000000004e-06 2024-09-14T09:09:18.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033478+0000", 2024-09-14T09:09:18.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1200000000000001e-06 2024-09-14T09:09:18.281 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.281 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.281 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.281 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95520 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.281 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034298+0000", 2024-09-14T09:09:18.281 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0045591629999999998, 2024-09-14T09:09:18.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062999379999999997, 2024-09-14T09:09:18.281 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.282 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.282 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.282 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.282 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.282 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.282 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95520 2024-09-14T09:09:18.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.282 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034298+0000", 2024-09-14T09:09:18.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034298+0000", 2024-09-14T09:09:18.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034298+0000", 2024-09-14T09:09:18.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8099999999999998e-07 2024-09-14T09:09:18.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034300+0000", 2024-09-14T09:09:18.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0480000000000001e-06 2024-09-14T09:09:18.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034307+0000", 2024-09-14T09:09:18.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5259999999999999e-06 2024-09-14T09:09:18.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034312+0000", 2024-09-14T09:09:18.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2109999999999997e-06 2024-09-14T09:09:18.284 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.284 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.284 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.285 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95162 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.285 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025116+0000", 2024-09-14T09:09:18.285 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013741155, 2024-09-14T09:09:18.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015506074999999999, 2024-09-14T09:09:18.285 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.285 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.285 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.285 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.285 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.285 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.285 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95162 2024-09-14T09:09:18.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.286 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025116+0000", 2024-09-14T09:09:18.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025116+0000", 2024-09-14T09:09:18.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025116+0000", 2024-09-14T09:09:18.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2499999999999995e-07 2024-09-14T09:09:18.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025118+0000", 2024-09-14T09:09:18.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8449999999999999e-06 2024-09-14T09:09:18.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025124+0000", 2024-09-14T09:09:18.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.348e-06 2024-09-14T09:09:18.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025134+0000", 2024-09-14T09:09:18.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7410000000000004e-06 2024-09-14T09:09:18.288 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.288 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.288 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.288 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95194 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.288 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025886+0000", 2024-09-14T09:09:18.288 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012971017, 2024-09-14T09:09:18.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014759800999999999, 2024-09-14T09:09:18.288 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.288 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.288 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.288 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.289 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.289 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.289 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95194 2024-09-14T09:09:18.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.289 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025886+0000", 2024-09-14T09:09:18.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025886+0000", 2024-09-14T09:09:18.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025886+0000", 2024-09-14T09:09:18.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.37e-07 2024-09-14T09:09:18.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025888+0000", 2024-09-14T09:09:18.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8309999999999999e-06 2024-09-14T09:09:18.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025895+0000", 2024-09-14T09:09:18.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.126e-06 2024-09-14T09:09:18.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025900+0000", 2024-09-14T09:09:18.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1800000000000004e-06 2024-09-14T09:09:18.291 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.291 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.291 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.291 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95253 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.291 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026659+0000", 2024-09-14T09:09:18.291 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.01219784, 2024-09-14T09:09:18.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014009581, 2024-09-14T09:09:18.292 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.292 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.292 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.292 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.292 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.292 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.292 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95253 2024-09-14T09:09:18.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.292 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026659+0000", 2024-09-14T09:09:18.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026659+0000", 2024-09-14T09:09:18.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026660+0000", 2024-09-14T09:09:18.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4899999999999995e-07 2024-09-14T09:09:18.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026662+0000", 2024-09-14T09:09:18.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3020000000000002e-06 2024-09-14T09:09:18.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026671+0000", 2024-09-14T09:09:18.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0140000000000004e-06 2024-09-14T09:09:18.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026676+0000", 2024-09-14T09:09:18.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.356e-06 2024-09-14T09:09:18.294 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.294 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.294 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.295 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95314 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.295 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027457+0000", 2024-09-14T09:09:18.295 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011399415, 2024-09-14T09:09:18.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013234166, 2024-09-14T09:09:18.295 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.295 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.295 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.295 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.295 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.295 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.295 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95314 2024-09-14T09:09:18.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.295 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027457+0000", 2024-09-14T09:09:18.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027457+0000", 2024-09-14T09:09:18.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027458+0000", 2024-09-14T09:09:18.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.63e-07 2024-09-14T09:09:18.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027460+0000", 2024-09-14T09:09:18.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0209999999999998e-06 2024-09-14T09:09:18.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027466+0000", 2024-09-14T09:09:18.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3910000000000003e-06 2024-09-14T09:09:18.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027471+0000", 2024-09-14T09:09:18.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1070000000000004e-06 2024-09-14T09:09:18.298 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.298 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.298 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.298 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95437 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.298 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033485+0000", 2024-09-14T09:09:18.298 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.005371781, 2024-09-14T09:09:18.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0072294200000000003, 2024-09-14T09:09:18.298 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.298 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.298 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.299 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.299 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.299 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95437 2024-09-14T09:09:18.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.299 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033485+0000", 2024-09-14T09:09:18.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033485+0000", 2024-09-14T09:09:18.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033485+0000", 2024-09-14T09:09:18.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4700000000000002e-07 2024-09-14T09:09:18.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033488+0000", 2024-09-14T09:09:18.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1789999999999998e-06 2024-09-14T09:09:18.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033494+0000", 2024-09-14T09:09:18.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.742e-06 2024-09-14T09:09:18.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033499+0000", 2024-09-14T09:09:18.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1320000000000002e-06 2024-09-14T09:09:18.301 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.301 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.301 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.301 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95522 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.301 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034318+0000", 2024-09-14T09:09:18.301 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0045388340000000003, 2024-09-14T09:09:18.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0064270100000000004, 2024-09-14T09:09:18.302 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.302 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.302 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.302 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.302 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.302 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.302 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95522 2024-09-14T09:09:18.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.302 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034318+0000", 2024-09-14T09:09:18.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034318+0000", 2024-09-14T09:09:18.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034318+0000", 2024-09-14T09:09:18.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5699999999999998e-07 2024-09-14T09:09:18.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034320+0000", 2024-09-14T09:09:18.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.849e-06 2024-09-14T09:09:18.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034328+0000", 2024-09-14T09:09:18.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.52e-06 2024-09-14T09:09:18.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034333+0000", 2024-09-14T09:09:18.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5049999999999998e-06 2024-09-14T09:09:18.304 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.304 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.304 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.305 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95163 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.305 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025141+0000", 2024-09-14T09:09:18.305 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013716067, 2024-09-14T09:09:18.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015628563000000002, 2024-09-14T09:09:18.305 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.305 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.305 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.305 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.305 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.305 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.305 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95163 2024-09-14T09:09:18.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.306 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025141+0000", 2024-09-14T09:09:18.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025141+0000", 2024-09-14T09:09:18.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025142+0000", 2024-09-14T09:09:18.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.657e-06 2024-09-14T09:09:18.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025144+0000", 2024-09-14T09:09:18.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8729999999999999e-06 2024-09-14T09:09:18.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025150+0000", 2024-09-14T09:09:18.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0680000000000002e-06 2024-09-14T09:09:18.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025156+0000", 2024-09-14T09:09:18.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1670000000000004e-06 2024-09-14T09:09:18.308 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.308 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.308 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.308 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95195 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.308 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025906+0000", 2024-09-14T09:09:18.308 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012950512000000001, 2024-09-14T09:09:18.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014886318000000001, 2024-09-14T09:09:18.308 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.308 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.309 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.309 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.309 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.309 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.309 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95195 2024-09-14T09:09:18.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.309 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025906+0000", 2024-09-14T09:09:18.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025906+0000", 2024-09-14T09:09:18.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025907+0000", 2024-09-14T09:09:18.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6499999999999999e-07 2024-09-14T09:09:18.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025909+0000", 2024-09-14T09:09:18.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7889999999999999e-06 2024-09-14T09:09:18.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025914+0000", 2024-09-14T09:09:18.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6980000000000003e-06 2024-09-14T09:09:18.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025919+0000", 2024-09-14T09:09:18.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6959999999999996e-06 2024-09-14T09:09:18.311 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.311 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.311 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.311 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95255 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.312 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026685+0000", 2024-09-14T09:09:18.312 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012171433000000001, 2024-09-14T09:09:18.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014140424, 2024-09-14T09:09:18.312 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.312 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.312 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.312 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95255 2024-09-14T09:09:18.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.312 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026685+0000", 2024-09-14T09:09:18.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026685+0000", 2024-09-14T09:09:18.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026686+0000", 2024-09-14T09:09:18.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:09:18.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026688+0000", 2024-09-14T09:09:18.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2450000000000001e-06 2024-09-14T09:09:18.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026695+0000", 2024-09-14T09:09:18.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7499999999999997e-06 2024-09-14T09:09:18.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026700+0000", 2024-09-14T09:09:18.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8640000000000004e-06 2024-09-14T09:09:18.314 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.315 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.315 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.315 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95315 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.315 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027483+0000", 2024-09-14T09:09:18.315 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011373282, 2024-09-14T09:09:18.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013366838000000001, 2024-09-14T09:09:18.315 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.315 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.315 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.315 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.315 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.315 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.316 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95315 2024-09-14T09:09:18.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.316 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027483+0000", 2024-09-14T09:09:18.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027483+0000", 2024-09-14T09:09:18.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027484+0000", 2024-09-14T09:09:18.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7599999999999997e-07 2024-09-14T09:09:18.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027486+0000", 2024-09-14T09:09:18.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1059999999999998e-06 2024-09-14T09:09:18.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027494+0000", 2024-09-14T09:09:18.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3880000000000002e-06 2024-09-14T09:09:18.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027499+0000", 2024-09-14T09:09:18.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4670000000000003e-06 2024-09-14T09:09:18.318 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.318 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.318 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.318 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95439 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.318 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033506+0000", 2024-09-14T09:09:18.318 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0053509710000000004, 2024-09-14T09:09:18.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0073679269999999998, 2024-09-14T09:09:18.318 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.318 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.319 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.319 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.319 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.319 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.319 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95439 2024-09-14T09:09:18.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.319 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033506+0000", 2024-09-14T09:09:18.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033506+0000", 2024-09-14T09:09:18.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033506+0000", 2024-09-14T09:09:18.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.15e-07 2024-09-14T09:09:18.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033508+0000", 2024-09-14T09:09:18.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.911e-06 2024-09-14T09:09:18.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033517+0000", 2024-09-14T09:09:18.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5420000000000005e-06 2024-09-14T09:09:18.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033522+0000", 2024-09-14T09:09:18.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3190000000000002e-06 2024-09-14T09:09:18.321 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.321 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.321 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.322 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95524 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.322 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034340+0000", 2024-09-14T09:09:18.322 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0045168659999999996, 2024-09-14T09:09:18.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065566260000000003, 2024-09-14T09:09:18.322 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.322 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.322 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.322 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.322 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.322 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.322 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95524 2024-09-14T09:09:18.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.322 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034340+0000", 2024-09-14T09:09:18.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034340+0000", 2024-09-14T09:09:18.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034340+0000", 2024-09-14T09:09:18.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2024-09-14T09:09:18.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034342+0000", 2024-09-14T09:09:18.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.978e-06 2024-09-14T09:09:18.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034351+0000", 2024-09-14T09:09:18.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4300000000000006e-06 2024-09-14T09:09:18.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034356+0000", 2024-09-14T09:09:18.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.062e-06 2024-09-14T09:09:18.325 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.325 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.325 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.325 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95164 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.325 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025162+0000", 2024-09-14T09:09:18.325 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013694257, 2024-09-14T09:09:18.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015758373999999999, 2024-09-14T09:09:18.325 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.325 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.326 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.326 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.326 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.326 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.326 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95164 2024-09-14T09:09:18.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.326 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025162+0000", 2024-09-14T09:09:18.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025162+0000", 2024-09-14T09:09:18.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025163+0000", 2024-09-14T09:09:18.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.68e-07 2024-09-14T09:09:18.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025165+0000", 2024-09-14T09:09:18.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7680000000000001e-06 2024-09-14T09:09:18.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025172+0000", 2024-09-14T09:09:18.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8109999999999997e-06 2024-09-14T09:09:18.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025177+0000", 2024-09-14T09:09:18.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9429999999999999e-06 2024-09-14T09:09:18.328 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.328 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.328 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.328 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95196 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.328 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025930+0000", 2024-09-14T09:09:18.329 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012926711, 2024-09-14T09:09:18.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015014181, 2024-09-14T09:09:18.329 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.329 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.329 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.329 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.329 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.329 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.329 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95196 2024-09-14T09:09:18.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.329 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025930+0000", 2024-09-14T09:09:18.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025930+0000", 2024-09-14T09:09:18.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025931+0000", 2024-09-14T09:09:18.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:09:18.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025932+0000", 2024-09-14T09:09:18.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.951e-06 2024-09-14T09:09:18.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025940+0000", 2024-09-14T09:09:18.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0469999999999996e-06 2024-09-14T09:09:18.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025945+0000", 2024-09-14T09:09:18.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1699999999999996e-06 2024-09-14T09:09:18.331 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.332 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.332 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.332 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95257 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.332 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026706+0000", 2024-09-14T09:09:18.332 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012150301000000001, 2024-09-14T09:09:18.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014260640999999999, 2024-09-14T09:09:18.332 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.332 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.332 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.333 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.333 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95257 2024-09-14T09:09:18.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.333 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026706+0000", 2024-09-14T09:09:18.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026706+0000", 2024-09-14T09:09:18.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026707+0000", 2024-09-14T09:09:18.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9200000000000002e-07 2024-09-14T09:09:18.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026709+0000", 2024-09-14T09:09:18.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0980000000000001e-06 2024-09-14T09:09:18.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026715+0000", 2024-09-14T09:09:18.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4309999999999999e-06 2024-09-14T09:09:18.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026721+0000", 2024-09-14T09:09:18.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6949999999999997e-06 2024-09-14T09:09:18.335 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.335 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.335 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.335 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95375 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.335 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027506+0000", 2024-09-14T09:09:18.335 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011350707, 2024-09-14T09:09:18.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013483866000000001, 2024-09-14T09:09:18.336 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.336 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.336 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.336 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.336 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.336 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.336 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95375 2024-09-14T09:09:18.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.336 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027506+0000", 2024-09-14T09:09:18.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027506+0000", 2024-09-14T09:09:18.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027507+0000", 2024-09-14T09:09:18.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7e-07 2024-09-14T09:09:18.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027508+0000", 2024-09-14T09:09:18.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9460000000000001e-06 2024-09-14T09:09:18.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027519+0000", 2024-09-14T09:09:18.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0356e-05 2024-09-14T09:09:18.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027528+0000", 2024-09-14T09:09:18.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1379999999999996e-06 2024-09-14T09:09:18.338 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.338 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.338 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.339 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95441 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.339 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033535+0000", 2024-09-14T09:09:18.339 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0053219119999999998, 2024-09-14T09:09:18.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074791479999999997, 2024-09-14T09:09:18.339 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.339 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.339 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.339 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95441 2024-09-14T09:09:18.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.339 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033535+0000", 2024-09-14T09:09:18.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033535+0000", 2024-09-14T09:09:18.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033535+0000", 2024-09-14T09:09:18.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6000000000000004e-07 2024-09-14T09:09:18.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033541+0000", 2024-09-14T09:09:18.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0569999999999998e-06 2024-09-14T09:09:18.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033550+0000", 2024-09-14T09:09:18.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5599999999999994e-06 2024-09-14T09:09:18.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033558+0000", 2024-09-14T09:09:18.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2290000000000003e-06 2024-09-14T09:09:18.342 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.342 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.342 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.342 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95526 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.342 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034362+0000", 2024-09-14T09:09:18.342 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0044946090000000001, 2024-09-14T09:09:18.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0066748229999999999, 2024-09-14T09:09:18.342 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.342 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.343 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.343 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.343 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.343 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.343 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95526 2024-09-14T09:09:18.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.343 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034362+0000", 2024-09-14T09:09:18.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034362+0000", 2024-09-14T09:09:18.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034363+0000", 2024-09-14T09:09:18.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4299999999999998e-07 2024-09-14T09:09:18.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034364+0000", 2024-09-14T09:09:18.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.779e-06 2024-09-14T09:09:18.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034370+0000", 2024-09-14T09:09:18.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8440000000000003e-06 2024-09-14T09:09:18.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034377+0000", 2024-09-14T09:09:18.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7429999999999996e-06 2024-09-14T09:09:18.345 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.345 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.345 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.345 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95165 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.346 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025185+0000", 2024-09-14T09:09:18.346 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013671423, 2024-09-14T09:09:18.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015875265999999999, 2024-09-14T09:09:18.346 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.346 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.346 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.346 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.346 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.346 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.346 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95165 2024-09-14T09:09:18.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.346 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025185+0000", 2024-09-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025185+0000", 2024-09-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025186+0000", 2024-09-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7700000000000004e-07 2024-09-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025188+0000", 2024-09-14T09:09:18.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9690000000000001e-06 2024-09-14T09:09:18.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025195+0000", 2024-09-14T09:09:18.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2099999999999996e-06 2024-09-14T09:09:18.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025201+0000", 2024-09-14T09:09:18.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6590000000000004e-06 2024-09-14T09:09:18.348 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.348 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.348 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.349 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95197 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.349 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025951+0000", 2024-09-14T09:09:18.349 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012905361000000001, 2024-09-14T09:09:18.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015132202000000001, 2024-09-14T09:09:18.349 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.349 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.349 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.349 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.349 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.349 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.349 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95197 2024-09-14T09:09:18.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.349 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025951+0000", 2024-09-14T09:09:18.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025951+0000", 2024-09-14T09:09:18.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025952+0000", 2024-09-14T09:09:18.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5299999999999999e-07 2024-09-14T09:09:18.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025961+0000", 2024-09-14T09:09:18.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0969999999999995e-06 2024-09-14T09:09:18.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025969+0000", 2024-09-14T09:09:18.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6569999999999997e-06 2024-09-14T09:09:18.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025974+0000", 2024-09-14T09:09:18.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3630000000000002e-06 2024-09-14T09:09:18.351 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.352 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.352 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.352 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95259 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.352 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026728+0000", 2024-09-14T09:09:18.352 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012128633, 2024-09-14T09:09:18.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014378558, 2024-09-14T09:09:18.352 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.352 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.352 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.352 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.352 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.352 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.352 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95259 2024-09-14T09:09:18.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.353 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026728+0000", 2024-09-14T09:09:18.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026728+0000", 2024-09-14T09:09:18.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026729+0000", 2024-09-14T09:09:18.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.01e-07 2024-09-14T09:09:18.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026739+0000", 2024-09-14T09:09:18.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0078000000000001e-05 2024-09-14T09:09:18.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026746+0000", 2024-09-14T09:09:18.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0249999999999997e-06 2024-09-14T09:09:18.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026751+0000", 2024-09-14T09:09:18.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3990000000000003e-06 2024-09-14T09:09:18.355 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.355 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.355 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.355 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95377 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.355 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027535+0000", 2024-09-14T09:09:18.355 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011321416000000001, 2024-09-14T09:09:18.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01359485, 2024-09-14T09:09:18.355 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.356 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.356 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.356 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.356 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.356 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.356 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95377 2024-09-14T09:09:18.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.356 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027535+0000", 2024-09-14T09:09:18.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027535+0000", 2024-09-14T09:09:18.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027536+0000", 2024-09-14T09:09:18.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5499999999999998e-07 2024-09-14T09:09:18.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027538+0000", 2024-09-14T09:09:18.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.187e-06 2024-09-14T09:09:18.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027545+0000", 2024-09-14T09:09:18.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1520000000000003e-06 2024-09-14T09:09:18.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027550+0000", 2024-09-14T09:09:18.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0649999999999998e-06 2024-09-14T09:09:18.358 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.358 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.358 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.359 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95443 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.359 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033572+0000", 2024-09-14T09:09:18.359 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0052842510000000002, 2024-09-14T09:09:18.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0075815049999999997, 2024-09-14T09:09:18.359 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.359 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.359 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.359 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.359 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.359 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.359 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95443 2024-09-14T09:09:18.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.359 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033572+0000", 2024-09-14T09:09:18.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033572+0000", 2024-09-14T09:09:18.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033573+0000", 2024-09-14T09:09:18.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:09:18.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033575+0000", 2024-09-14T09:09:18.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1840000000000002e-06 2024-09-14T09:09:18.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033584+0000", 2024-09-14T09:09:18.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4630000000000001e-06 2024-09-14T09:09:18.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033589+0000", 2024-09-14T09:09:18.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4539999999999998e-06 2024-09-14T09:09:18.362 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.362 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.362 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.362 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95528 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.362 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034382+0000", 2024-09-14T09:09:18.362 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0044742660000000002, 2024-09-14T09:09:18.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067941360000000001, 2024-09-14T09:09:18.362 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.362 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.362 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.363 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95528 2024-09-14T09:09:18.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.363 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034382+0000", 2024-09-14T09:09:18.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034382+0000", 2024-09-14T09:09:18.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034383+0000", 2024-09-14T09:09:18.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4700000000000002e-07 2024-09-14T09:09:18.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034384+0000", 2024-09-14T09:09:18.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5799999999999999e-06 2024-09-14T09:09:18.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034391+0000", 2024-09-14T09:09:18.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3799999999999999e-06 2024-09-14T09:09:18.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034396+0000", 2024-09-14T09:09:18.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1359999999999996e-06 2024-09-14T09:09:18.365 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.365 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.365 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.365 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95166 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.365 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025221+0000", 2024-09-14T09:09:18.365 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013635662, 2024-09-14T09:09:18.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015979203000000001, 2024-09-14T09:09:18.366 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.366 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.366 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.366 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.366 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.366 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.366 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95166 2024-09-14T09:09:18.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.366 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025221+0000", 2024-09-14T09:09:18.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025221+0000", 2024-09-14T09:09:18.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025222+0000", 2024-09-14T09:09:18.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0100000000000005e-07 2024-09-14T09:09:18.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025224+0000", 2024-09-14T09:09:18.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.441e-06 2024-09-14T09:09:18.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025232+0000", 2024-09-14T09:09:18.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6499999999999996e-06 2024-09-14T09:09:18.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025238+0000", 2024-09-14T09:09:18.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4930000000000003e-06 2024-09-14T09:09:18.368 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.368 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.368 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.369 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95198 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.369 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025981+0000", 2024-09-14T09:09:18.369 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012875384, 2024-09-14T09:09:18.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01524203, 2024-09-14T09:09:18.369 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.369 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.369 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.369 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.369 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.369 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.369 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95198 2024-09-14T09:09:18.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.370 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025981+0000", 2024-09-14T09:09:18.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025981+0000", 2024-09-14T09:09:18.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025982+0000", 2024-09-14T09:09:18.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1399999999999997e-07 2024-09-14T09:09:18.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025984+0000", 2024-09-14T09:09:18.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.238e-06 2024-09-14T09:09:18.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025990+0000", 2024-09-14T09:09:18.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7030000000000003e-06 2024-09-14T09:09:18.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025995+0000", 2024-09-14T09:09:18.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8570000000000003e-06 2024-09-14T09:09:18.372 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.372 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.372 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.372 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95261 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.372 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026758+0000", 2024-09-14T09:09:18.372 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012098595, 2024-09-14T09:09:18.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01448839, 2024-09-14T09:09:18.372 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.372 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.372 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.373 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.373 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95261 2024-09-14T09:09:18.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.373 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026758+0000", 2024-09-14T09:09:18.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026758+0000", 2024-09-14T09:09:18.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026759+0000", 2024-09-14T09:09:18.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.75e-07 2024-09-14T09:09:18.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026761+0000", 2024-09-14T09:09:18.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.278e-06 2024-09-14T09:09:18.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026767+0000", 2024-09-14T09:09:18.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1650000000000003e-06 2024-09-14T09:09:18.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026778+0000", 2024-09-14T09:09:18.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1326e-05 2024-09-14T09:09:18.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.375 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.375 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95379 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.375 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027556+0000", 2024-09-14T09:09:18.375 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011300306, 2024-09-14T09:09:18.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013713238000000001, 2024-09-14T09:09:18.376 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.376 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.376 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.376 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95379 2024-09-14T09:09:18.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.376 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027556+0000", 2024-09-14T09:09:18.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027556+0000", 2024-09-14T09:09:18.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027646+0000", 2024-09-14T09:09:18.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9399000000000002e-05 2024-09-14T09:09:18.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027649+0000", 2024-09-14T09:09:18.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3019999999999999e-06 2024-09-14T09:09:18.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027658+0000", 2024-09-14T09:09:18.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9099999999999994e-06 2024-09-14T09:09:18.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027664+0000", 2024-09-14T09:09:18.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3300000000000004e-06 2024-09-14T09:09:18.378 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.378 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.378 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.379 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95445 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.379 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033597+0000", 2024-09-14T09:09:18.379 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0052598460000000003, 2024-09-14T09:09:18.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076956610000000003, 2024-09-14T09:09:18.379 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.379 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.379 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.379 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.379 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.379 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.379 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95445 2024-09-14T09:09:18.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.379 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033597+0000", 2024-09-14T09:09:18.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033597+0000", 2024-09-14T09:09:18.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033597+0000", 2024-09-14T09:09:18.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1100000000000001e-07 2024-09-14T09:09:18.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033599+0000", 2024-09-14T09:09:18.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0990000000000001e-06 2024-09-14T09:09:18.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033606+0000", 2024-09-14T09:09:18.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0119999999999999e-06 2024-09-14T09:09:18.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033612+0000", 2024-09-14T09:09:18.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7470000000000002e-06 2024-09-14T09:09:18.382 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.382 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.382 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.382 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95530 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.382 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034402+0000", 2024-09-14T09:09:18.382 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0044549890000000003, 2024-09-14T09:09:18.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069135580000000002, 2024-09-14T09:09:18.382 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.382 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.382 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.383 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95530 2024-09-14T09:09:18.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.383 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034402+0000", 2024-09-14T09:09:18.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034402+0000", 2024-09-14T09:09:18.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034402+0000", 2024-09-14T09:09:18.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.22e-07 2024-09-14T09:09:18.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034404+0000", 2024-09-14T09:09:18.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.858e-06 2024-09-14T09:09:18.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034409+0000", 2024-09-14T09:09:18.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2920000000000003e-06 2024-09-14T09:09:18.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034414+0000", 2024-09-14T09:09:18.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1610000000000002e-06 2024-09-14T09:09:18.385 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.385 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.385 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.386 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95167 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.386 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025246+0000", 2024-09-14T09:09:18.386 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013611129, 2024-09-14T09:09:18.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016093639, 2024-09-14T09:09:18.386 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.386 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.386 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.386 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.386 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.386 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.386 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95167 2024-09-14T09:09:18.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.386 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025246+0000", 2024-09-14T09:09:18.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025246+0000", 2024-09-14T09:09:18.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025246+0000", 2024-09-14T09:09:18.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3799999999999997e-07 2024-09-14T09:09:18.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025248+0000", 2024-09-14T09:09:18.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.08e-06 2024-09-14T09:09:18.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025255+0000", 2024-09-14T09:09:18.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3790000000000003e-06 2024-09-14T09:09:18.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025260+0000", 2024-09-14T09:09:18.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2340000000000002e-06 2024-09-14T09:09:18.389 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.389 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.389 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.389 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95200 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.389 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026001+0000", 2024-09-14T09:09:18.389 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.01285594, 2024-09-14T09:09:18.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015362673, 2024-09-14T09:09:18.389 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.389 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.389 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.389 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.390 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.390 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.390 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95200 2024-09-14T09:09:18.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.390 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026001+0000", 2024-09-14T09:09:18.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026001+0000", 2024-09-14T09:09:18.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026001+0000", 2024-09-14T09:09:18.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.39e-07 2024-09-14T09:09:18.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026003+0000", 2024-09-14T09:09:18.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0669999999999999e-06 2024-09-14T09:09:18.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026009+0000", 2024-09-14T09:09:18.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0900000000000001e-06 2024-09-14T09:09:18.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026016+0000", 2024-09-14T09:09:18.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1290000000000001e-06 2024-09-14T09:09:18.392 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.392 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.392 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.392 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95263 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.392 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026786+0000", 2024-09-14T09:09:18.392 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012070434999999999, 2024-09-14T09:09:18.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014600444000000001, 2024-09-14T09:09:18.393 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.393 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.393 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.393 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95263 2024-09-14T09:09:18.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.393 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026786+0000", 2024-09-14T09:09:18.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026786+0000", 2024-09-14T09:09:18.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026787+0000", 2024-09-14T09:09:18.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2e-07 2024-09-14T09:09:18.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026789+0000", 2024-09-14T09:09:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3029999999999998e-06 2024-09-14T09:09:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026796+0000", 2024-09-14T09:09:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7649999999999996e-06 2024-09-14T09:09:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026802+0000", 2024-09-14T09:09:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2859999999999996e-06 2024-09-14T09:09:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95381 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027674+0000", 2024-09-14T09:09:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011183220000000001, 2024-09-14T09:09:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013736323, 2024-09-14T09:09:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95381 2024-09-14T09:09:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027674+0000", 2024-09-14T09:09:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027674+0000", 2024-09-14T09:09:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032801+0000", 2024-09-14T09:09:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051277359999999999 2024-09-14T09:09:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032806+0000", 2024-09-14T09:09:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4129999999999999e-06 2024-09-14T09:09:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032818+0000", 2024-09-14T09:09:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1846e-05 2024-09-14T09:09:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032825+0000", 2024-09-14T09:09:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1740000000000003e-06 2024-09-14T09:09:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95447 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033639+0000", 2024-09-14T09:09:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0052175049999999999, 2024-09-14T09:09:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0077936460000000004, 2024-09-14T09:09:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95447 2024-09-14T09:09:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033639+0000", 2024-09-14T09:09:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033639+0000", 2024-09-14T09:09:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033640+0000", 2024-09-14T09:09:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4899999999999995e-07 2024-09-14T09:09:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033642+0000", 2024-09-14T09:09:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.407e-06 2024-09-14T09:09:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033650+0000", 2024-09-14T09:09:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8900000000000007e-06 2024-09-14T09:09:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033656+0000", 2024-09-14T09:09:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4670000000000003e-06 2024-09-14T09:09:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95532 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034442+0000", 2024-09-14T09:09:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0044149860000000001, 2024-09-14T09:09:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070140039999999999, 2024-09-14T09:09:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95532 2024-09-14T09:09:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034442+0000", 2024-09-14T09:09:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034442+0000", 2024-09-14T09:09:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034442+0000", 2024-09-14T09:09:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1900000000000002e-07 2024-09-14T09:09:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034445+0000", 2024-09-14T09:09:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3199999999999998e-06 2024-09-14T09:09:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034454+0000", 2024-09-14T09:09:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2059999999999996e-06 2024-09-14T09:09:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034459+0000", 2024-09-14T09:09:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5260000000000001e-06 2024-09-14T09:09:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95168 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025266+0000", 2024-09-14T09:09:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.01359052, 2024-09-14T09:09:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016213638999999998, 2024-09-14T09:09:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95168 2024-09-14T09:09:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025266+0000", 2024-09-14T09:09:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025266+0000", 2024-09-14T09:09:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025267+0000", 2024-09-14T09:09:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7199999999999999e-07 2024-09-14T09:09:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025269+0000", 2024-09-14T09:09:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0700000000000001e-06 2024-09-14T09:09:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025275+0000", 2024-09-14T09:09:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4099999999999996e-06 2024-09-14T09:09:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025280+0000", 2024-09-14T09:09:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1780000000000002e-06 2024-09-14T09:09:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95202 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026039+0000", 2024-09-14T09:09:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012817319000000001, 2024-09-14T09:09:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015464036, 2024-09-14T09:09:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95202 2024-09-14T09:09:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026039+0000", 2024-09-14T09:09:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026039+0000", 2024-09-14T09:09:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026040+0000", 2024-09-14T09:09:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8599999999999998e-07 2024-09-14T09:09:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026042+0000", 2024-09-14T09:09:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.058e-06 2024-09-14T09:09:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026049+0000", 2024-09-14T09:09:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3849999999999996e-06 2024-09-14T09:09:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026054+0000", 2024-09-14T09:09:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0359999999999997e-06 2024-09-14T09:09:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95264 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026810+0000", 2024-09-14T09:09:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012047191, 2024-09-14T09:09:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014717297000000001, 2024-09-14T09:09:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95264 2024-09-14T09:09:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026810+0000", 2024-09-14T09:09:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026810+0000", 2024-09-14T09:09:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026810+0000", 2024-09-14T09:09:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.06e-07 2024-09-14T09:09:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026812+0000", 2024-09-14T09:09:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0250000000000001e-06 2024-09-14T09:09:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026818+0000", 2024-09-14T09:09:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3860000000000004e-06 2024-09-14T09:09:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026823+0000", 2024-09-14T09:09:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7530000000000001e-06 2024-09-14T09:09:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95383 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.032838+0000", 2024-09-14T09:09:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0060182730000000002, 2024-09-14T09:09:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087113409999999992, 2024-09-14T09:09:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95383 2024-09-14T09:09:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032838+0000", 2024-09-14T09:09:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032838+0000", 2024-09-14T09:09:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032839+0000", 2024-09-14T09:09:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1099999999999996e-07 2024-09-14T09:09:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032841+0000", 2024-09-14T09:09:18.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2089999999999999e-06 2024-09-14T09:09:18.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032848+0000", 2024-09-14T09:09:18.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8809999999999998e-06 2024-09-14T09:09:18.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032853+0000", 2024-09-14T09:09:18.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4219999999999999e-06 2024-09-14T09:09:18.419 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.419 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.419 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95449 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033665+0000", 2024-09-14T09:09:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0051920359999999997, 2024-09-14T09:09:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.007907687, 2024-09-14T09:09:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95449 2024-09-14T09:09:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033665+0000", 2024-09-14T09:09:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033665+0000", 2024-09-14T09:09:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033665+0000", 2024-09-14T09:09:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0800000000000005e-07 2024-09-14T09:09:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033667+0000", 2024-09-14T09:09:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1830000000000001e-06 2024-09-14T09:09:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033674+0000", 2024-09-14T09:09:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8569999999999997e-06 2024-09-14T09:09:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033680+0000", 2024-09-14T09:09:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3120000000000001e-06 2024-09-14T09:09:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95534 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034470+0000", 2024-09-14T09:09:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0043868609999999997, 2024-09-14T09:09:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0071251980000000001, 2024-09-14T09:09:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95534 2024-09-14T09:09:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034470+0000", 2024-09-14T09:09:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034470+0000", 2024-09-14T09:09:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034470+0000", 2024-09-14T09:09:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2300000000000001e-07 2024-09-14T09:09:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034479+0000", 2024-09-14T09:09:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9530000000000005e-06 2024-09-14T09:09:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034487+0000", 2024-09-14T09:09:18.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8359999999999992e-06 2024-09-14T09:09:18.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034493+0000", 2024-09-14T09:09:18.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4009999999999996e-06 2024-09-14T09:09:18.426 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.426 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.426 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.426 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95169 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.426 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025287+0000", 2024-09-14T09:09:18.427 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013569968999999999, 2024-09-14T09:09:18.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016332518000000001, 2024-09-14T09:09:18.427 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.427 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.427 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.427 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.427 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.427 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.427 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95169 2024-09-14T09:09:18.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.427 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025287+0000", 2024-09-14T09:09:18.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025287+0000", 2024-09-14T09:09:18.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025287+0000", 2024-09-14T09:09:18.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.68e-07 2024-09-14T09:09:18.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025289+0000", 2024-09-14T09:09:18.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.821e-06 2024-09-14T09:09:18.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025295+0000", 2024-09-14T09:09:18.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8089999999999998e-06 2024-09-14T09:09:18.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025300+0000", 2024-09-14T09:09:18.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6589999999999998e-06 2024-09-14T09:09:18.429 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.429 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.429 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.430 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95203 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.430 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026061+0000", 2024-09-14T09:09:18.430 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012796034, 2024-09-14T09:09:18.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01558183, 2024-09-14T09:09:18.430 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.430 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.430 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.430 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.430 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.430 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.430 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95203 2024-09-14T09:09:18.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.431 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026061+0000", 2024-09-14T09:09:18.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026061+0000", 2024-09-14T09:09:18.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026061+0000", 2024-09-14T09:09:18.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3099999999999998e-07 2024-09-14T09:09:18.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026063+0000", 2024-09-14T09:09:18.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9640000000000002e-06 2024-09-14T09:09:18.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026070+0000", 2024-09-14T09:09:18.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7089999999999996e-06 2024-09-14T09:09:18.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026075+0000", 2024-09-14T09:09:18.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8470000000000003e-06 2024-09-14T09:09:18.433 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.433 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.433 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.433 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95266 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.433 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026830+0000", 2024-09-14T09:09:18.433 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012027154999999999, 2024-09-14T09:09:18.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014835754, 2024-09-14T09:09:18.433 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.433 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.433 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.434 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.434 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.434 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.434 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95266 2024-09-14T09:09:18.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.434 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026830+0000", 2024-09-14T09:09:18.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026830+0000", 2024-09-14T09:09:18.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026830+0000", 2024-09-14T09:09:18.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9400000000000001e-07 2024-09-14T09:09:18.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026836+0000", 2024-09-14T09:09:18.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.173e-06 2024-09-14T09:09:18.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026843+0000", 2024-09-14T09:09:18.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4300000000000003e-06 2024-09-14T09:09:18.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026848+0000", 2024-09-14T09:09:18.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000004e-06 2024-09-14T09:09:18.436 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.436 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.436 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.436 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95385 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.436 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.032862+0000", 2024-09-14T09:09:18.437 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0059945040000000003, 2024-09-14T09:09:18.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0088259970000000004, 2024-09-14T09:09:18.437 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.437 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.437 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.437 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.437 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.437 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.437 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95385 2024-09-14T09:09:18.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.437 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032862+0000", 2024-09-14T09:09:18.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032862+0000", 2024-09-14T09:09:18.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032863+0000", 2024-09-14T09:09:18.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8200000000000001e-07 2024-09-14T09:09:18.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032865+0000", 2024-09-14T09:09:18.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1349999999999999e-06 2024-09-14T09:09:18.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032872+0000", 2024-09-14T09:09:18.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7340000000000008e-06 2024-09-14T09:09:18.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032878+0000", 2024-09-14T09:09:18.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4389999999999999e-06 2024-09-14T09:09:18.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.440 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.440 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95451 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.440 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033686+0000", 2024-09-14T09:09:18.440 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0051707480000000002, 2024-09-14T09:09:18.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080253619999999994, 2024-09-14T09:09:18.440 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.440 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.440 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.440 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.440 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.441 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95451 2024-09-14T09:09:18.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.441 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033686+0000", 2024-09-14T09:09:18.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033686+0000", 2024-09-14T09:09:18.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033686+0000", 2024-09-14T09:09:18.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2e-07 2024-09-14T09:09:18.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033688+0000", 2024-09-14T09:09:18.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7940000000000001e-06 2024-09-14T09:09:18.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033695+0000", 2024-09-14T09:09:18.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4099999999999996e-06 2024-09-14T09:09:18.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033700+0000", 2024-09-14T09:09:18.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9880000000000004e-06 2024-09-14T09:09:18.443 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.443 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.443 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.443 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95535 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.443 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034501+0000", 2024-09-14T09:09:18.444 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0043555010000000003, 2024-09-14T09:09:18.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0072375340000000003, 2024-09-14T09:09:18.444 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.444 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.444 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.444 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.444 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.444 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.444 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95535 2024-09-14T09:09:18.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.444 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034501+0000", 2024-09-14T09:09:18.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034501+0000", 2024-09-14T09:09:18.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034502+0000", 2024-09-14T09:09:18.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9999999999999998e-07 2024-09-14T09:09:18.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034504+0000", 2024-09-14T09:09:18.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1909999999999999e-06 2024-09-14T09:09:18.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034510+0000", 2024-09-14T09:09:18.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1120000000000001e-06 2024-09-14T09:09:18.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034516+0000", 2024-09-14T09:09:18.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6459999999999998e-06 2024-09-14T09:09:18.446 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.446 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.447 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.447 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95170 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.447 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025307+0000", 2024-09-14T09:09:18.447 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013550135, 2024-09-14T09:09:18.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016456565999999999, 2024-09-14T09:09:18.447 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.447 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.447 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.447 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.447 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.447 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.447 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95170 2024-09-14T09:09:18.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.448 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025307+0000", 2024-09-14T09:09:18.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025307+0000", 2024-09-14T09:09:18.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025307+0000", 2024-09-14T09:09:18.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6499999999999999e-07 2024-09-14T09:09:18.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025309+0000", 2024-09-14T09:09:18.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9400000000000001e-06 2024-09-14T09:09:18.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025315+0000", 2024-09-14T09:09:18.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0249999999999999e-06 2024-09-14T09:09:18.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025321+0000", 2024-09-14T09:09:18.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0260000000000004e-06 2024-09-14T09:09:18.450 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.450 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.450 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.450 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95205 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.450 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026081+0000", 2024-09-14T09:09:18.450 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012775794, 2024-09-14T09:09:18.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015705956, 2024-09-14T09:09:18.450 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.450 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.451 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.451 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.451 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.451 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.451 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95205 2024-09-14T09:09:18.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.451 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026081+0000", 2024-09-14T09:09:18.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026081+0000", 2024-09-14T09:09:18.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026081+0000", 2024-09-14T09:09:18.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9200000000000002e-07 2024-09-14T09:09:18.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026083+0000", 2024-09-14T09:09:18.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-06 2024-09-14T09:09:18.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026090+0000", 2024-09-14T09:09:18.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7689999999999999e-06 2024-09-14T09:09:18.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026096+0000", 2024-09-14T09:09:18.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6119999999999998e-06 2024-09-14T09:09:18.453 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.453 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.453 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.453 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95268 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.453 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026858+0000", 2024-09-14T09:09:18.453 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011998665, 2024-09-14T09:09:18.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014951885, 2024-09-14T09:09:18.454 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.454 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.454 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.454 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.454 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.454 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.454 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95268 2024-09-14T09:09:18.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.454 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026858+0000", 2024-09-14T09:09:18.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026858+0000", 2024-09-14T09:09:18.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026859+0000", 2024-09-14T09:09:18.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5299999999999999e-07 2024-09-14T09:09:18.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026861+0000", 2024-09-14T09:09:18.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2390000000000001e-06 2024-09-14T09:09:18.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026867+0000", 2024-09-14T09:09:18.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6900000000000003e-06 2024-09-14T09:09:18.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026881+0000", 2024-09-14T09:09:18.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3865e-05 2024-09-14T09:09:18.456 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.456 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.456 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.457 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95387 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.457 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.032886+0000", 2024-09-14T09:09:18.457 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0059702760000000001, 2024-09-14T09:09:18.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0089464360000000003, 2024-09-14T09:09:18.457 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.457 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.457 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.457 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.457 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.457 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.457 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95387 2024-09-14T09:09:18.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.458 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032886+0000", 2024-09-14T09:09:18.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032886+0000", 2024-09-14T09:09:18.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032887+0000", 2024-09-14T09:09:18.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8100000000000003e-07 2024-09-14T09:09:18.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032889+0000", 2024-09-14T09:09:18.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.024e-06 2024-09-14T09:09:18.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032896+0000", 2024-09-14T09:09:18.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8140000000000003e-06 2024-09-14T09:09:18.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032904+0000", 2024-09-14T09:09:18.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0960000000000001e-06 2024-09-14T09:09:18.460 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.460 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.460 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.460 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95453 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.460 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033706+0000", 2024-09-14T09:09:18.460 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0051504000000000003, 2024-09-14T09:09:18.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.008149412, 2024-09-14T09:09:18.460 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.460 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.460 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.461 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.461 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.461 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.461 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95453 2024-09-14T09:09:18.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.461 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033706+0000", 2024-09-14T09:09:18.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033706+0000", 2024-09-14T09:09:18.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033707+0000", 2024-09-14T09:09:18.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3300000000000003e-07 2024-09-14T09:09:18.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033709+0000", 2024-09-14T09:09:18.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0329999999999998e-06 2024-09-14T09:09:18.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033717+0000", 2024-09-14T09:09:18.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1289999999999996e-06 2024-09-14T09:09:18.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033722+0000", 2024-09-14T09:09:18.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2750000000000003e-06 2024-09-14T09:09:18.464 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.464 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.464 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.465 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95537 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.465 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034541+0000", 2024-09-14T09:09:18.465 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0043153849999999997, 2024-09-14T09:09:18.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.007345168, 2024-09-14T09:09:18.465 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.465 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.465 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.465 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.465 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.465 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.465 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95537 2024-09-14T09:09:18.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.466 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034541+0000", 2024-09-14T09:09:18.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034541+0000", 2024-09-14T09:09:18.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034542+0000", 2024-09-14T09:09:18.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8800000000000002e-07 2024-09-14T09:09:18.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034544+0000", 2024-09-14T09:09:18.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3360000000000002e-06 2024-09-14T09:09:18.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034552+0000", 2024-09-14T09:09:18.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.661e-06 2024-09-14T09:09:18.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034559+0000", 2024-09-14T09:09:18.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5910000000000001e-06 2024-09-14T09:09:18.468 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.468 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.468 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.468 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95171 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.468 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025328+0000", 2024-09-14T09:09:18.468 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013528975, 2024-09-14T09:09:18.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016584847999999999, 2024-09-14T09:09:18.468 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.468 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.468 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.469 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.469 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.469 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.469 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95171 2024-09-14T09:09:18.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.469 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025328+0000", 2024-09-14T09:09:18.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025328+0000", 2024-09-14T09:09:18.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025328+0000", 2024-09-14T09:09:18.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7700000000000004e-07 2024-09-14T09:09:18.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025330+0000", 2024-09-14T09:09:18.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.934e-06 2024-09-14T09:09:18.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025336+0000", 2024-09-14T09:09:18.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8950000000000003e-06 2024-09-14T09:09:18.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025341+0000", 2024-09-14T09:09:18.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.848e-06 2024-09-14T09:09:18.471 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.471 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.471 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.471 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95207 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.471 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026102+0000", 2024-09-14T09:09:18.471 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012754842000000001, 2024-09-14T09:09:18.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015834925, 2024-09-14T09:09:18.472 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.472 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.472 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.472 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.472 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.472 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.472 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95207 2024-09-14T09:09:18.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.472 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026102+0000", 2024-09-14T09:09:18.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026102+0000", 2024-09-14T09:09:18.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026102+0000", 2024-09-14T09:09:18.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5600000000000001e-07 2024-09-14T09:09:18.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026104+0000", 2024-09-14T09:09:18.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9429999999999999e-06 2024-09-14T09:09:18.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026115+0000", 2024-09-14T09:09:18.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0886999999999999e-05 2024-09-14T09:09:18.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026122+0000", 2024-09-14T09:09:18.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.092e-06 2024-09-14T09:09:18.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.474 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.475 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95270 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.475 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026890+0000", 2024-09-14T09:09:18.475 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011966888, 2024-09-14T09:09:18.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015070708, 2024-09-14T09:09:18.475 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.475 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.475 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.475 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95270 2024-09-14T09:09:18.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.476 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026890+0000", 2024-09-14T09:09:18.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026890+0000", 2024-09-14T09:09:18.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026890+0000", 2024-09-14T09:09:18.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1399999999999997e-07 2024-09-14T09:09:18.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026893+0000", 2024-09-14T09:09:18.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.148e-06 2024-09-14T09:09:18.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026899+0000", 2024-09-14T09:09:18.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6789999999999999e-06 2024-09-14T09:09:18.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026904+0000", 2024-09-14T09:09:18.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1039999999999998e-06 2024-09-14T09:09:18.478 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.478 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.478 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.478 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95389 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.478 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.032913+0000", 2024-09-14T09:09:18.478 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0059437229999999997, 2024-09-14T09:09:18.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0090703169999999996, 2024-09-14T09:09:18.478 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.478 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.478 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.479 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.479 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.479 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.479 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95389 2024-09-14T09:09:18.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.479 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032913+0000", 2024-09-14T09:09:18.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032913+0000", 2024-09-14T09:09:18.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032914+0000", 2024-09-14T09:09:18.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2900000000000003e-07 2024-09-14T09:09:18.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032916+0000", 2024-09-14T09:09:18.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.057e-06 2024-09-14T09:09:18.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032922+0000", 2024-09-14T09:09:18.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6390000000000003e-06 2024-09-14T09:09:18.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032927+0000", 2024-09-14T09:09:18.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9830000000000004e-06 2024-09-14T09:09:18.481 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.481 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.481 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.481 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95455 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.481 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033729+0000", 2024-09-14T09:09:18.481 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0051276430000000003, 2024-09-14T09:09:18.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082770910000000003, 2024-09-14T09:09:18.482 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.482 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.482 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.482 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.482 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.482 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.482 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95455 2024-09-14T09:09:18.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.482 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033729+0000", 2024-09-14T09:09:18.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033729+0000", 2024-09-14T09:09:18.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033730+0000", 2024-09-14T09:09:18.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.37e-07 2024-09-14T09:09:18.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033736+0000", 2024-09-14T09:09:18.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9560000000000002e-06 2024-09-14T09:09:18.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033742+0000", 2024-09-14T09:09:18.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6270000000000002e-06 2024-09-14T09:09:18.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033748+0000", 2024-09-14T09:09:18.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1179999999999997e-06 2024-09-14T09:09:18.484 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.484 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.484 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.485 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95539 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.485 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034566+0000", 2024-09-14T09:09:18.485 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0042909669999999997, 2024-09-14T09:09:18.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074632500000000003, 2024-09-14T09:09:18.485 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.485 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.485 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.485 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.485 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.485 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.485 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95539 2024-09-14T09:09:18.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.486 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034566+0000", 2024-09-14T09:09:18.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034566+0000", 2024-09-14T09:09:18.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034651+0000", 2024-09-14T09:09:18.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4913999999999994e-05 2024-09-14T09:09:18.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034654+0000", 2024-09-14T09:09:18.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.881e-06 2024-09-14T09:09:18.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034663+0000", 2024-09-14T09:09:18.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9010000000000006e-06 2024-09-14T09:09:18.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034669+0000", 2024-09-14T09:09:18.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0009999999999998e-06 2024-09-14T09:09:18.488 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.488 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.488 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.488 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95172 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.488 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025348+0000", 2024-09-14T09:09:18.488 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013508423, 2024-09-14T09:09:18.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016704784, 2024-09-14T09:09:18.488 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.488 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.489 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.489 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.489 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.489 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.489 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95172 2024-09-14T09:09:18.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.489 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025348+0000", 2024-09-14T09:09:18.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025348+0000", 2024-09-14T09:09:18.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025349+0000", 2024-09-14T09:09:18.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.51e-07 2024-09-14T09:09:18.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025351+0000", 2024-09-14T09:09:18.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8419999999999999e-06 2024-09-14T09:09:18.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025357+0000", 2024-09-14T09:09:18.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8409999999999996e-06 2024-09-14T09:09:18.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025361+0000", 2024-09-14T09:09:18.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8679999999999998e-06 2024-09-14T09:09:18.491 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.491 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.491 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.491 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95209 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.492 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026146+0000", 2024-09-14T09:09:18.492 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012710776999999999, 2024-09-14T09:09:18.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015930613999999999, 2024-09-14T09:09:18.492 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.492 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.492 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.492 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.492 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.492 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.492 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95209 2024-09-14T09:09:18.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.492 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026146+0000", 2024-09-14T09:09:18.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026146+0000", 2024-09-14T09:09:18.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026147+0000", 2024-09-14T09:09:18.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4199999999999996e-07 2024-09-14T09:09:18.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026149+0000", 2024-09-14T09:09:18.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.092e-06 2024-09-14T09:09:18.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026157+0000", 2024-09-14T09:09:18.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6920000000000008e-06 2024-09-14T09:09:18.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026163+0000", 2024-09-14T09:09:18.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9549999999999997e-06 2024-09-14T09:09:18.495 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.495 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.495 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.495 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95272 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.495 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026912+0000", 2024-09-14T09:09:18.495 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011944875000000001, 2024-09-14T09:09:18.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015188803000000001, 2024-09-14T09:09:18.495 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.495 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.495 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.495 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.495 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.496 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.496 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95272 2024-09-14T09:09:18.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.496 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026912+0000", 2024-09-14T09:09:18.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026912+0000", 2024-09-14T09:09:18.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026912+0000", 2024-09-14T09:09:18.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7899999999999999e-07 2024-09-14T09:09:18.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026915+0000", 2024-09-14T09:09:18.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1830000000000001e-06 2024-09-14T09:09:18.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026921+0000", 2024-09-14T09:09:18.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5150000000000003e-06 2024-09-14T09:09:18.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026926+0000", 2024-09-14T09:09:18.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8940000000000001e-06 2024-09-14T09:09:18.498 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.498 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.498 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.498 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95391 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.498 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.032934+0000", 2024-09-14T09:09:18.498 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.005922643, 2024-09-14T09:09:18.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0091898919999999999, 2024-09-14T09:09:18.498 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.499 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.499 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.499 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.499 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.499 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.499 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95391 2024-09-14T09:09:18.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.499 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032934+0000", 2024-09-14T09:09:18.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032934+0000", 2024-09-14T09:09:18.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032935+0000", 2024-09-14T09:09:18.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1699999999999998e-07 2024-09-14T09:09:18.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032937+0000", 2024-09-14T09:09:18.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9850000000000001e-06 2024-09-14T09:09:18.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032943+0000", 2024-09-14T09:09:18.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4649999999999999e-06 2024-09-14T09:09:18.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032948+0000", 2024-09-14T09:09:18.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1089999999999997e-06 2024-09-14T09:09:18.501 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.501 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.501 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.502 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95457 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.502 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033756+0000", 2024-09-14T09:09:18.502 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0051010960000000003, 2024-09-14T09:09:18.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0083913110000000003, 2024-09-14T09:09:18.502 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.502 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.502 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.502 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.502 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.502 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.502 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95457 2024-09-14T09:09:18.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.502 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033756+0000", 2024-09-14T09:09:18.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033756+0000", 2024-09-14T09:09:18.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033756+0000", 2024-09-14T09:09:18.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5300000000000004e-07 2024-09-14T09:09:18.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033758+0000", 2024-09-14T09:09:18.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.097e-06 2024-09-14T09:09:18.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033772+0000", 2024-09-14T09:09:18.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3295000000000001e-05 2024-09-14T09:09:18.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033777+0000", 2024-09-14T09:09:18.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5260000000000001e-06 2024-09-14T09:09:18.505 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.505 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.505 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.505 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95541 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.505 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034679+0000", 2024-09-14T09:09:18.505 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0041775529999999996, 2024-09-14T09:09:18.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074905589999999999, 2024-09-14T09:09:18.505 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.505 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.505 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.506 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.506 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.506 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.506 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95541 2024-09-14T09:09:18.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.506 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034679+0000", 2024-09-14T09:09:18.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034679+0000", 2024-09-14T09:09:18.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039766+0000", 2024-09-14T09:09:18.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050869740000000002 2024-09-14T09:09:18.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039770+0000", 2024-09-14T09:09:18.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8349999999999997e-06 2024-09-14T09:09:18.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039779+0000", 2024-09-14T09:09:18.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8769999999999999e-06 2024-09-14T09:09:18.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039784+0000", 2024-09-14T09:09:18.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-09-14T09:09:18.508 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.508 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.508 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.508 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95173 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.508 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025367+0000", 2024-09-14T09:09:18.508 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013489645999999999, 2024-09-14T09:09:18.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016922875, 2024-09-14T09:09:18.508 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.508 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.509 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.509 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.509 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.509 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.509 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95173 2024-09-14T09:09:18.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.509 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025367+0000", 2024-09-14T09:09:18.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025367+0000", 2024-09-14T09:09:18.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025367+0000", 2024-09-14T09:09:18.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4700000000000002e-07 2024-09-14T09:09:18.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025373+0000", 2024-09-14T09:09:18.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.507e-06 2024-09-14T09:09:18.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025384+0000", 2024-09-14T09:09:18.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0626e-05 2024-09-14T09:09:18.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025389+0000", 2024-09-14T09:09:18.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0520000000000001e-06 2024-09-14T09:09:18.511 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.511 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.511 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.512 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95211 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.512 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026169+0000", 2024-09-14T09:09:18.512 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012687357, 2024-09-14T09:09:18.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016144825000000002, 2024-09-14T09:09:18.512 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.512 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.512 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.512 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.512 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.512 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.512 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95211 2024-09-14T09:09:18.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.512 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026169+0000", 2024-09-14T09:09:18.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026169+0000", 2024-09-14T09:09:18.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026170+0000", 2024-09-14T09:09:18.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999999e-07 2024-09-14T09:09:18.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026172+0000", 2024-09-14T09:09:18.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9630000000000001e-06 2024-09-14T09:09:18.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026178+0000", 2024-09-14T09:09:18.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3570000000000003e-06 2024-09-14T09:09:18.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026183+0000", 2024-09-14T09:09:18.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6909999999999996e-06 2024-09-14T09:09:18.515 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.515 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.515 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.515 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95274 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.515 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026932+0000", 2024-09-14T09:09:18.515 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011924564, 2024-09-14T09:09:18.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015408793, 2024-09-14T09:09:18.515 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.515 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.515 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.516 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.516 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.516 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.516 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95274 2024-09-14T09:09:18.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.516 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026932+0000", 2024-09-14T09:09:18.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026932+0000", 2024-09-14T09:09:18.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026933+0000", 2024-09-14T09:09:18.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.65e-07 2024-09-14T09:09:18.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026934+0000", 2024-09-14T09:09:18.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9010000000000001e-06 2024-09-14T09:09:18.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026942+0000", 2024-09-14T09:09:18.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.126e-06 2024-09-14T09:09:18.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026947+0000", 2024-09-14T09:09:18.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0370000000000002e-06 2024-09-14T09:09:18.518 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.518 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.518 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.518 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95393 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.518 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.032959+0000", 2024-09-14T09:09:18.519 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.005897612, 2024-09-14T09:09:18.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0094055079999999999, 2024-09-14T09:09:18.519 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.519 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.519 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.519 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.519 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.519 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.519 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95393 2024-09-14T09:09:18.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.519 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032959+0000", 2024-09-14T09:09:18.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032959+0000", 2024-09-14T09:09:18.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032960+0000", 2024-09-14T09:09:18.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8599999999999999e-07 2024-09-14T09:09:18.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032962+0000", 2024-09-14T09:09:18.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0320000000000002e-06 2024-09-14T09:09:18.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032968+0000", 2024-09-14T09:09:18.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5760000000000002e-06 2024-09-14T09:09:18.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032974+0000", 2024-09-14T09:09:18.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9340000000000003e-06 2024-09-14T09:09:18.521 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.521 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.521 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.522 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95459 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.522 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033785+0000", 2024-09-14T09:09:18.522 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0050718450000000002, 2024-09-14T09:09:18.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.008603042, 2024-09-14T09:09:18.522 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.522 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.522 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.522 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.522 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.522 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.522 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95459 2024-09-14T09:09:18.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.523 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033785+0000", 2024-09-14T09:09:18.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033785+0000", 2024-09-14T09:09:18.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033785+0000", 2024-09-14T09:09:18.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2024-09-14T09:09:18.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033787+0000", 2024-09-14T09:09:18.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1670000000000002e-06 2024-09-14T09:09:18.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033794+0000", 2024-09-14T09:09:18.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4150000000000004e-06 2024-09-14T09:09:18.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033799+0000", 2024-09-14T09:09:18.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0679999999999996e-06 2024-09-14T09:09:18.525 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.525 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.525 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.525 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95543 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.525 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.039793+0000", 2024-09-14T09:09:18.525 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.999064, 2024-09-14T09:09:18.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002620444, 2024-09-14T09:09:18.525 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.525 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.526 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.526 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.526 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.526 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.526 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95543 2024-09-14T09:09:18.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.526 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039793+0000", 2024-09-14T09:09:18.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039793+0000", 2024-09-14T09:09:18.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039793+0000", 2024-09-14T09:09:18.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.01e-07 2024-09-14T09:09:18.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039795+0000", 2024-09-14T09:09:18.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.432e-06 2024-09-14T09:09:18.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039798+0000", 2024-09-14T09:09:18.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6399999999999999e-06 2024-09-14T09:09:18.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039803+0000", 2024-09-14T09:09:18.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5179999999999998e-06 2024-09-14T09:09:18.528 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.528 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.528 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.528 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95174 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.528 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025410+0000", 2024-09-14T09:09:18.529 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013447219999999999, 2024-09-14T09:09:18.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017028494000000002, 2024-09-14T09:09:18.529 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.529 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.529 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.529 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.529 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.529 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.529 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95174 2024-09-14T09:09:18.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.529 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025410+0000", 2024-09-14T09:09:18.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025410+0000", 2024-09-14T09:09:18.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025410+0000", 2024-09-14T09:09:18.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5400000000000001e-07 2024-09-14T09:09:18.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025412+0000", 2024-09-14T09:09:18.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3549999999999999e-06 2024-09-14T09:09:18.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025420+0000", 2024-09-14T09:09:18.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2570000000000001e-06 2024-09-14T09:09:18.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025425+0000", 2024-09-14T09:09:18.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4530000000000001e-06 2024-09-14T09:09:18.531 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.531 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.531 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.532 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95213 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.532 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026188+0000", 2024-09-14T09:09:18.532 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012668633, 2024-09-14T09:09:18.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016274710000000001, 2024-09-14T09:09:18.532 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.532 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.532 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.532 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.532 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.532 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.532 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95213 2024-09-14T09:09:18.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.533 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026188+0000", 2024-09-14T09:09:18.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026188+0000", 2024-09-14T09:09:18.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026188+0000", 2024-09-14T09:09:18.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2500000000000001e-07 2024-09-14T09:09:18.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026190+0000", 2024-09-14T09:09:18.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7910000000000001e-06 2024-09-14T09:09:18.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026196+0000", 2024-09-14T09:09:18.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5609999999999998e-06 2024-09-14T09:09:18.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026201+0000", 2024-09-14T09:09:18.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3310000000000003e-06 2024-09-14T09:09:18.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.535 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.535 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95276 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.535 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026954+0000", 2024-09-14T09:09:18.535 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011903106, 2024-09-14T09:09:18.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015532059000000001, 2024-09-14T09:09:18.535 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.535 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.535 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.535 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.536 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95276 2024-09-14T09:09:18.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.536 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026954+0000", 2024-09-14T09:09:18.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026954+0000", 2024-09-14T09:09:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026954+0000", 2024-09-14T09:09:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0999999999999999e-07 2024-09-14T09:09:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026956+0000", 2024-09-14T09:09:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2079999999999999e-06 2024-09-14T09:09:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026965+0000", 2024-09-14T09:09:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.098e-06 2024-09-14T09:09:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026972+0000", 2024-09-14T09:09:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3119999999999999e-06 2024-09-14T09:09:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95395 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.032980+0000", 2024-09-14T09:09:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0058768040000000002, 2024-09-14T09:09:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0095300149999999993, 2024-09-14T09:09:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95395 2024-09-14T09:09:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032980+0000", 2024-09-14T09:09:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032980+0000", 2024-09-14T09:09:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032980+0000", 2024-09-14T09:09:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.46e-07 2024-09-14T09:09:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032982+0000", 2024-09-14T09:09:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7549999999999999e-06 2024-09-14T09:09:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032988+0000", 2024-09-14T09:09:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7679999999999997e-06 2024-09-14T09:09:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032993+0000", 2024-09-14T09:09:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7330000000000003e-06 2024-09-14T09:09:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95461 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033805+0000", 2024-09-14T09:09:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0050521860000000002, 2024-09-14T09:09:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087283169999999993, 2024-09-14T09:09:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95461 2024-09-14T09:09:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033805+0000", 2024-09-14T09:09:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033805+0000", 2024-09-14T09:09:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033805+0000", 2024-09-14T09:09:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-07 2024-09-14T09:09:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033807+0000", 2024-09-14T09:09:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.795e-06 2024-09-14T09:09:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033812+0000", 2024-09-14T09:09:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6810000000000003e-06 2024-09-14T09:09:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033817+0000", 2024-09-14T09:09:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8570000000000003e-06 2024-09-14T09:09:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95545 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.039808+0000", 2024-09-14T09:09:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9990492, 2024-09-14T09:09:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027502080000000001, 2024-09-14T09:09:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95545 2024-09-14T09:09:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039808+0000", 2024-09-14T09:09:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039808+0000", 2024-09-14T09:09:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039808+0000", 2024-09-14T09:09:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.15e-07 2024-09-14T09:09:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039809+0000", 2024-09-14T09:09:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.167e-06 2024-09-14T09:09:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039813+0000", 2024-09-14T09:09:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5250000000000001e-06 2024-09-14T09:09:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039815+0000", 2024-09-14T09:09:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7590000000000002e-06 2024-09-14T09:09:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95175 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025432+0000", 2024-09-14T09:09:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013424401000000001, 2024-09-14T09:09:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017149540000000001, 2024-09-14T09:09:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95175 2024-09-14T09:09:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025432+0000", 2024-09-14T09:09:18.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025432+0000", 2024-09-14T09:09:18.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025433+0000", 2024-09-14T09:09:18.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7800000000000001e-07 2024-09-14T09:09:18.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025435+0000", 2024-09-14T09:09:18.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9269999999999999e-06 2024-09-14T09:09:18.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025441+0000", 2024-09-14T09:09:18.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8660000000000002e-06 2024-09-14T09:09:18.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025446+0000", 2024-09-14T09:09:18.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9350000000000002e-06 2024-09-14T09:09:18.551 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.551 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.551 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.552 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95215 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.552 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026208+0000", 2024-09-14T09:09:18.552 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012648456000000001, 2024-09-14T09:09:18.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016398638, 2024-09-14T09:09:18.552 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.552 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.552 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.552 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.552 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.552 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.552 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95215 2024-09-14T09:09:18.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.552 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026208+0000", 2024-09-14T09:09:18.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026208+0000", 2024-09-14T09:09:18.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026209+0000", 2024-09-14T09:09:18.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5900000000000003e-07 2024-09-14T09:09:18.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026211+0000", 2024-09-14T09:09:18.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.046e-06 2024-09-14T09:09:18.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026217+0000", 2024-09-14T09:09:18.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2949999999999999e-06 2024-09-14T09:09:18.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026222+0000", 2024-09-14T09:09:18.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9880000000000004e-06 2024-09-14T09:09:18.555 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.555 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.555 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.555 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95278 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.555 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026978+0000", 2024-09-14T09:09:18.555 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011878603, 2024-09-14T09:09:18.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015651880999999999, 2024-09-14T09:09:18.555 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.555 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.555 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.555 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.556 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.556 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.556 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95278 2024-09-14T09:09:18.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.556 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026978+0000", 2024-09-14T09:09:18.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026978+0000", 2024-09-14T09:09:18.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026979+0000", 2024-09-14T09:09:18.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5799999999999999e-07 2024-09-14T09:09:18.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026981+0000", 2024-09-14T09:09:18.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.029e-06 2024-09-14T09:09:18.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026987+0000", 2024-09-14T09:09:18.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3929999999999996e-06 2024-09-14T09:09:18.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026992+0000", 2024-09-14T09:09:18.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2440000000000001e-06 2024-09-14T09:09:18.558 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.558 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.558 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.558 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95397 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.558 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.032998+0000", 2024-09-14T09:09:18.559 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0058587689999999998, 2024-09-14T09:09:18.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0096564779999999996, 2024-09-14T09:09:18.559 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.559 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.559 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.559 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.559 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.559 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.559 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95397 2024-09-14T09:09:18.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.559 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032998+0000", 2024-09-14T09:09:18.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032998+0000", 2024-09-14T09:09:18.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.032999+0000", 2024-09-14T09:09:18.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3000000000000001e-07 2024-09-14T09:09:18.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033000+0000", 2024-09-14T09:09:18.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7409999999999999e-06 2024-09-14T09:09:18.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033006+0000", 2024-09-14T09:09:18.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6130000000000003e-06 2024-09-14T09:09:18.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033013+0000", 2024-09-14T09:09:18.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9770000000000003e-06 2024-09-14T09:09:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95486 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033843+0000", 2024-09-14T09:09:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0050137150000000002, 2024-09-14T09:09:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0088353070000000006, 2024-09-14T09:09:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.562 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95486 2024-09-14T09:09:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033843+0000", 2024-09-14T09:09:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033843+0000", 2024-09-14T09:09:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033844+0000", 2024-09-14T09:09:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3600000000000003e-07 2024-09-14T09:09:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033846+0000", 2024-09-14T09:09:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9769999999999999e-06 2024-09-14T09:09:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033852+0000", 2024-09-14T09:09:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.392e-06 2024-09-14T09:09:18.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033858+0000", 2024-09-14T09:09:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4879999999999998e-06 2024-09-14T09:09:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95547 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.039819+0000", 2024-09-14T09:09:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9990377, 2024-09-14T09:09:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002884223, 2024-09-14T09:09:18.565 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95547 2024-09-14T09:09:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039819+0000", 2024-09-14T09:09:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039819+0000", 2024-09-14T09:09:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039819+0000", 2024-09-14T09:09:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2000000000000001e-07 2024-09-14T09:09:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039820+0000", 2024-09-14T09:09:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0809999999999999e-06 2024-09-14T09:09:18.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039823+0000", 2024-09-14T09:09:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.055e-06 2024-09-14T09:09:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039826+0000", 2024-09-14T09:09:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7590000000000002e-06 2024-09-14T09:09:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95176 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025452+0000", 2024-09-14T09:09:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013405136, 2024-09-14T09:09:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017275644, 2024-09-14T09:09:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95176 2024-09-14T09:09:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.569 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025452+0000", 2024-09-14T09:09:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025452+0000", 2024-09-14T09:09:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025452+0000", 2024-09-14T09:09:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2499999999999995e-07 2024-09-14T09:09:18.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025454+0000", 2024-09-14T09:09:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8509999999999999e-06 2024-09-14T09:09:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025460+0000", 2024-09-14T09:09:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-09-14T09:09:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025465+0000", 2024-09-14T09:09:18.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9409999999999998e-06 2024-09-14T09:09:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95217 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026228+0000", 2024-09-14T09:09:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012628545999999999, 2024-09-14T09:09:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016528675, 2024-09-14T09:09:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.572 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95217 2024-09-14T09:09:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026228+0000", 2024-09-14T09:09:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026228+0000", 2024-09-14T09:09:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026229+0000", 2024-09-14T09:09:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.53e-07 2024-09-14T09:09:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026231+0000", 2024-09-14T09:09:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9850000000000001e-06 2024-09-14T09:09:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026236+0000", 2024-09-14T09:09:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8019999999999997e-06 2024-09-14T09:09:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026241+0000", 2024-09-14T09:09:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7129999999999996e-06 2024-09-14T09:09:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95279 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027006+0000", 2024-09-14T09:09:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011850823, 2024-09-14T09:09:18.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015774443999999999, 2024-09-14T09:09:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95279 2024-09-14T09:09:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027006+0000", 2024-09-14T09:09:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027006+0000", 2024-09-14T09:09:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027006+0000", 2024-09-14T09:09:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8999999999999997e-07 2024-09-14T09:09:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027009+0000", 2024-09-14T09:09:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.34e-06 2024-09-14T09:09:18.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027020+0000", 2024-09-14T09:09:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1688999999999999e-05 2024-09-14T09:09:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027026+0000", 2024-09-14T09:09:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0090000000000004e-06 2024-09-14T09:09:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95399 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033019+0000", 2024-09-14T09:09:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0058376390000000004, 2024-09-14T09:09:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097841360000000006, 2024-09-14T09:09:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95399 2024-09-14T09:09:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033019+0000", 2024-09-14T09:09:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033019+0000", 2024-09-14T09:09:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033020+0000", 2024-09-14T09:09:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.96e-07 2024-09-14T09:09:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033022+0000", 2024-09-14T09:09:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0250000000000001e-06 2024-09-14T09:09:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033029+0000", 2024-09-14T09:09:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2620000000000001e-06 2024-09-14T09:09:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033034+0000", 2024-09-14T09:09:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1399999999999999e-06 2024-09-14T09:09:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95488 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033872+0000", 2024-09-14T09:09:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0049847490000000001, 2024-09-14T09:09:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0089555550000000005, 2024-09-14T09:09:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.582 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95488 2024-09-14T09:09:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033872+0000", 2024-09-14T09:09:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033872+0000", 2024-09-14T09:09:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033872+0000", 2024-09-14T09:09:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9999999999999998e-07 2024-09-14T09:09:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033879+0000", 2024-09-14T09:09:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.409e-06 2024-09-14T09:09:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033887+0000", 2024-09-14T09:09:18.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7009999999999996e-06 2024-09-14T09:09:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033893+0000", 2024-09-14T09:09:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6869999999999997e-06 2024-09-14T09:09:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95548 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.039829+0000", 2024-09-14T09:09:18.585 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9990273, 2024-09-14T09:09:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003022332, 2024-09-14T09:09:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95548 2024-09-14T09:09:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039829+0000", 2024-09-14T09:09:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039829+0000", 2024-09-14T09:09:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039830+0000", 2024-09-14T09:09:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-07 2024-09-14T09:09:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039831+0000", 2024-09-14T09:09:18.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1000000000000001e-06 2024-09-14T09:09:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039834+0000", 2024-09-14T09:09:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.926e-06 2024-09-14T09:09:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039836+0000", 2024-09-14T09:09:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6249999999999999e-06 2024-09-14T09:09:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95177 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025471+0000", 2024-09-14T09:09:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013386103, 2024-09-14T09:09:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017406909000000002, 2024-09-14T09:09:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95177 2024-09-14T09:09:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025471+0000", 2024-09-14T09:09:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025471+0000", 2024-09-14T09:09:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025471+0000", 2024-09-14T09:09:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5599999999999995e-07 2024-09-14T09:09:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025473+0000", 2024-09-14T09:09:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.846e-06 2024-09-14T09:09:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025479+0000", 2024-09-14T09:09:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7989999999999999e-06 2024-09-14T09:09:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025484+0000", 2024-09-14T09:09:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8940000000000001e-06 2024-09-14T09:09:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.591 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95219 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026247+0000", 2024-09-14T09:09:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012609956, 2024-09-14T09:09:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016654267, 2024-09-14T09:09:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95219 2024-09-14T09:09:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.592 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026247+0000", 2024-09-14T09:09:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026247+0000", 2024-09-14T09:09:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026247+0000", 2024-09-14T09:09:18.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699999999999995e-07 2024-09-14T09:09:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026253+0000", 2024-09-14T09:09:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8159999999999999e-06 2024-09-14T09:09:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026260+0000", 2024-09-14T09:09:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2350000000000002e-06 2024-09-14T09:09:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026265+0000", 2024-09-14T09:09:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8949999999999997e-06 2024-09-14T09:09:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95281 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027034+0000", 2024-09-14T09:09:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011822841000000001, 2024-09-14T09:09:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015891417000000001, 2024-09-14T09:09:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.595 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95281 2024-09-14T09:09:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027034+0000", 2024-09-14T09:09:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027034+0000", 2024-09-14T09:09:18.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027034+0000", 2024-09-14T09:09:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2e-07 2024-09-14T09:09:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027036+0000", 2024-09-14T09:09:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1459999999999999e-06 2024-09-14T09:09:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027044+0000", 2024-09-14T09:09:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1779999999999997e-06 2024-09-14T09:09:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027049+0000", 2024-09-14T09:09:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2660000000000001e-06 2024-09-14T09:09:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95401 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033041+0000", 2024-09-14T09:09:18.598 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0058158869999999996, 2024-09-14T09:09:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0099166519999999998, 2024-09-14T09:09:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95401 2024-09-14T09:09:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033041+0000", 2024-09-14T09:09:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033041+0000", 2024-09-14T09:09:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033041+0000", 2024-09-14T09:09:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0299999999999999e-07 2024-09-14T09:09:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033043+0000", 2024-09-14T09:09:18.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0370000000000001e-06 2024-09-14T09:09:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033050+0000", 2024-09-14T09:09:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4740000000000002e-06 2024-09-14T09:09:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033055+0000", 2024-09-14T09:09:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0660000000000003e-06 2024-09-14T09:09:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95490 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033901+0000", 2024-09-14T09:09:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0049555190000000002, 2024-09-14T09:09:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0090818819999999995, 2024-09-14T09:09:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95490 2024-09-14T09:09:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.602 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033901+0000", 2024-09-14T09:09:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033901+0000", 2024-09-14T09:09:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033902+0000", 2024-09-14T09:09:18.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.63e-07 2024-09-14T09:09:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033904+0000", 2024-09-14T09:09:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0999999999999998e-06 2024-09-14T09:09:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033911+0000", 2024-09-14T09:09:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.148e-06 2024-09-14T09:09:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033916+0000", 2024-09-14T09:09:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4009999999999996e-06 2024-09-14T09:09:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95550 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.039839+0000", 2024-09-14T09:09:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9990172, 2024-09-14T09:09:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031686459999999998, 2024-09-14T09:09:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.605 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95550 2024-09-14T09:09:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039839+0000", 2024-09-14T09:09:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039839+0000", 2024-09-14T09:09:18.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039840+0000", 2024-09-14T09:09:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1799999999999999e-07 2024-09-14T09:09:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039841+0000", 2024-09-14T09:09:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.065e-06 2024-09-14T09:09:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039844+0000", 2024-09-14T09:09:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2799999999999999e-06 2024-09-14T09:09:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039846+0000", 2024-09-14T09:09:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.559e-06 2024-09-14T09:09:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95178 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.608 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025490+0000", 2024-09-14T09:09:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013367205, 2024-09-14T09:09:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017544299999999999, 2024-09-14T09:09:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95178 2024-09-14T09:09:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025490+0000", 2024-09-14T09:09:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025490+0000", 2024-09-14T09:09:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025490+0000", 2024-09-14T09:09:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5799999999999999e-07 2024-09-14T09:09:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025492+0000", 2024-09-14T09:09:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8250000000000001e-06 2024-09-14T09:09:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025498+0000", 2024-09-14T09:09:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7570000000000001e-06 2024-09-14T09:09:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025503+0000", 2024-09-14T09:09:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8289999999999998e-06 2024-09-14T09:09:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.611 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95221 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026274+0000", 2024-09-14T09:09:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012582744, 2024-09-14T09:09:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016783619, 2024-09-14T09:09:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.612 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95221 2024-09-14T09:09:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026274+0000", 2024-09-14T09:09:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026274+0000", 2024-09-14T09:09:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026274+0000", 2024-09-14T09:09:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7999999999999996e-07 2024-09-14T09:09:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026276+0000", 2024-09-14T09:09:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.792e-06 2024-09-14T09:09:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026282+0000", 2024-09-14T09:09:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7729999999999996e-06 2024-09-14T09:09:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026287+0000", 2024-09-14T09:09:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2340000000000002e-06 2024-09-14T09:09:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95283 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027056+0000", 2024-09-14T09:09:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011800645, 2024-09-14T09:09:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016025727, 2024-09-14T09:09:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95283 2024-09-14T09:09:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027056+0000", 2024-09-14T09:09:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027056+0000", 2024-09-14T09:09:18.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027057+0000", 2024-09-14T09:09:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9599999999999999e-07 2024-09-14T09:09:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027059+0000", 2024-09-14T09:09:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1440000000000001e-06 2024-09-14T09:09:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027065+0000", 2024-09-14T09:09:18.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6540000000000002e-06 2024-09-14T09:09:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027072+0000", 2024-09-14T09:09:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5060000000000001e-06 2024-09-14T09:09:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95403 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033071+0000", 2024-09-14T09:09:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0057853499999999999, 2024-09-14T09:09:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010033412, 2024-09-14T09:09:18.618 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95403 2024-09-14T09:09:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033071+0000", 2024-09-14T09:09:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033071+0000", 2024-09-14T09:09:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033072+0000", 2024-09-14T09:09:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:09:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033074+0000", 2024-09-14T09:09:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1560000000000002e-06 2024-09-14T09:09:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033081+0000", 2024-09-14T09:09:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7349999999999999e-06 2024-09-14T09:09:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033086+0000", 2024-09-14T09:09:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2490000000000001e-06 2024-09-14T09:09:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95492 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.621 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033924+0000", 2024-09-14T09:09:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0049330279999999999, 2024-09-14T09:09:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0092063939999999997, 2024-09-14T09:09:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95492 2024-09-14T09:09:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033924+0000", 2024-09-14T09:09:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033924+0000", 2024-09-14T09:09:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033924+0000", 2024-09-14T09:09:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2800000000000002e-07 2024-09-14T09:09:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033926+0000", 2024-09-14T09:09:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0999999999999998e-06 2024-09-14T09:09:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033933+0000", 2024-09-14T09:09:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8900000000000001e-06 2024-09-14T09:09:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033939+0000", 2024-09-14T09:09:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4179999999999996e-06 2024-09-14T09:09:18.624 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95552 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.039849+0000", 2024-09-14T09:09:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9990072, 2024-09-14T09:09:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033042359999999999, 2024-09-14T09:09:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.625 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95552 2024-09-14T09:09:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039849+0000", 2024-09-14T09:09:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039849+0000", 2024-09-14T09:09:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039850+0000", 2024-09-14T09:09:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2600000000000001e-07 2024-09-14T09:09:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039851+0000", 2024-09-14T09:09:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9800000000000002e-07 2024-09-14T09:09:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039853+0000", 2024-09-14T09:09:18.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8729999999999999e-06 2024-09-14T09:09:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039856+0000", 2024-09-14T09:09:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4870000000000001e-06 2024-09-14T09:09:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95179 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025510+0000", 2024-09-14T09:09:18.628 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013347184, 2024-09-14T09:09:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017669364999999999, 2024-09-14T09:09:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95179 2024-09-14T09:09:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025510+0000", 2024-09-14T09:09:18.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025510+0000", 2024-09-14T09:09:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025510+0000", 2024-09-14T09:09:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6899999999999998e-07 2024-09-14T09:09:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025512+0000", 2024-09-14T09:09:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7209999999999999e-06 2024-09-14T09:09:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025517+0000", 2024-09-14T09:09:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7189999999999998e-06 2024-09-14T09:09:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025522+0000", 2024-09-14T09:09:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7700000000000001e-06 2024-09-14T09:09:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.631 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95223 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026293+0000", 2024-09-14T09:09:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012563804, 2024-09-14T09:09:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016909459000000002, 2024-09-14T09:09:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.632 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95223 2024-09-14T09:09:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026293+0000", 2024-09-14T09:09:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026293+0000", 2024-09-14T09:09:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026293+0000", 2024-09-14T09:09:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.46e-07 2024-09-14T09:09:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026295+0000", 2024-09-14T09:09:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8610000000000001e-06 2024-09-14T09:09:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026301+0000", 2024-09-14T09:09:18.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7139999999999998e-06 2024-09-14T09:09:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026306+0000", 2024-09-14T09:09:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6990000000000002e-06 2024-09-14T09:09:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95285 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027079+0000", 2024-09-14T09:09:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011778204, 2024-09-14T09:09:18.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016147726000000001, 2024-09-14T09:09:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95285 2024-09-14T09:09:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027079+0000", 2024-09-14T09:09:18.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027079+0000", 2024-09-14T09:09:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027079+0000", 2024-09-14T09:09:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4600000000000005e-07 2024-09-14T09:09:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027081+0000", 2024-09-14T09:09:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8109999999999999e-06 2024-09-14T09:09:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027088+0000", 2024-09-14T09:09:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.737e-06 2024-09-14T09:09:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027093+0000", 2024-09-14T09:09:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6149999999999996e-06 2024-09-14T09:09:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.638 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95405 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033093+0000", 2024-09-14T09:09:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0057635949999999998, 2024-09-14T09:09:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010158386, 2024-09-14T09:09:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.639 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95405 2024-09-14T09:09:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033093+0000", 2024-09-14T09:09:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033093+0000", 2024-09-14T09:09:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033094+0000", 2024-09-14T09:09:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.01e-07 2024-09-14T09:09:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033096+0000", 2024-09-14T09:09:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9860000000000001e-06 2024-09-14T09:09:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033103+0000", 2024-09-14T09:09:18.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3000000000000004e-06 2024-09-14T09:09:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033108+0000", 2024-09-14T09:09:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1410000000000004e-06 2024-09-14T09:09:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95494 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033945+0000", 2024-09-14T09:09:18.642 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0049115110000000003, 2024-09-14T09:09:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0093290560000000005, 2024-09-14T09:09:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95494 2024-09-14T09:09:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033945+0000", 2024-09-14T09:09:18.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033945+0000", 2024-09-14T09:09:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033946+0000", 2024-09-14T09:09:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6400000000000002e-07 2024-09-14T09:09:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033948+0000", 2024-09-14T09:09:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9069999999999999e-06 2024-09-14T09:09:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033954+0000", 2024-09-14T09:09:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2840000000000003e-06 2024-09-14T09:09:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033961+0000", 2024-09-14T09:09:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4569999999999999e-06 2024-09-14T09:09:18.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95553 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.039859+0000", 2024-09-14T09:09:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9989977, 2024-09-14T09:09:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034410500000000002, 2024-09-14T09:09:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.646 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95553 2024-09-14T09:09:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039859+0000", 2024-09-14T09:09:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039859+0000", 2024-09-14T09:09:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039859+0000", 2024-09-14T09:09:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2600000000000001e-07 2024-09-14T09:09:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039860+0000", 2024-09-14T09:09:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.054e-06 2024-09-14T09:09:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039863+0000", 2024-09-14T09:09:18.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7970000000000001e-06 2024-09-14T09:09:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039866+0000", 2024-09-14T09:09:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.582e-06 2024-09-14T09:09:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95180 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025528+0000", 2024-09-14T09:09:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013328563, 2024-09-14T09:09:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017796816, 2024-09-14T09:09:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95180 2024-09-14T09:09:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025528+0000", 2024-09-14T09:09:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025528+0000", 2024-09-14T09:09:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025529+0000", 2024-09-14T09:09:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1699999999999998e-07 2024-09-14T09:09:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025531+0000", 2024-09-14T09:09:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8390000000000001e-06 2024-09-14T09:09:18.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025541+0000", 2024-09-14T09:09:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0832999999999999e-05 2024-09-14T09:09:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025547+0000", 2024-09-14T09:09:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0589999999999999e-06 2024-09-14T09:09:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95225 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026311+0000", 2024-09-14T09:09:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.01254568, 2024-09-14T09:09:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017039179000000002, 2024-09-14T09:09:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95225 2024-09-14T09:09:18.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026311+0000", 2024-09-14T09:09:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026311+0000", 2024-09-14T09:09:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026311+0000", 2024-09-14T09:09:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3599999999999999e-07 2024-09-14T09:09:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026313+0000", 2024-09-14T09:09:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.75e-06 2024-09-14T09:09:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026319+0000", 2024-09-14T09:09:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.336e-06 2024-09-14T09:09:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026324+0000", 2024-09-14T09:09:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6619999999999996e-06 2024-09-14T09:09:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95287 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027102+0000", 2024-09-14T09:09:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011754929000000001, 2024-09-14T09:09:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016271932999999999, 2024-09-14T09:09:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.656 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95287 2024-09-14T09:09:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027102+0000", 2024-09-14T09:09:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027102+0000", 2024-09-14T09:09:18.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027102+0000", 2024-09-14T09:09:18.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0399999999999996e-07 2024-09-14T09:09:18.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027105+0000", 2024-09-14T09:09:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.199e-06 2024-09-14T09:09:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027111+0000", 2024-09-14T09:09:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.776e-06 2024-09-14T09:09:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027116+0000", 2024-09-14T09:09:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.164e-06 2024-09-14T09:09:18.660 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95407 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033120+0000", 2024-09-14T09:09:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.005736349, 2024-09-14T09:09:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010277391, 2024-09-14T09:09:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.661 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95407 2024-09-14T09:09:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033120+0000", 2024-09-14T09:09:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033120+0000", 2024-09-14T09:09:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033121+0000", 2024-09-14T09:09:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2399999999999998e-07 2024-09-14T09:09:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033123+0000", 2024-09-14T09:09:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.187e-06 2024-09-14T09:09:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033132+0000", 2024-09-14T09:09:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2590000000000006e-06 2024-09-14T09:09:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033139+0000", 2024-09-14T09:09:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8539999999999999e-06 2024-09-14T09:09:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95496 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.664 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033970+0000", 2024-09-14T09:09:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.004886311, 2024-09-14T09:09:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0094513119999999999, 2024-09-14T09:09:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95496 2024-09-14T09:09:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033970+0000", 2024-09-14T09:09:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033970+0000", 2024-09-14T09:09:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033971+0000", 2024-09-14T09:09:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1200000000000003e-07 2024-09-14T09:09:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033973+0000", 2024-09-14T09:09:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1509999999999998e-06 2024-09-14T09:09:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033980+0000", 2024-09-14T09:09:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8959999999999997e-06 2024-09-14T09:09:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033985+0000", 2024-09-14T09:09:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4489999999999998e-06 2024-09-14T09:09:18.667 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95554 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.039882+0000", 2024-09-14T09:09:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9989743, 2024-09-14T09:09:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035643390000000001, 2024-09-14T09:09:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.668 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95554 2024-09-14T09:09:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039882+0000", 2024-09-14T09:09:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039882+0000", 2024-09-14T09:09:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039883+0000", 2024-09-14T09:09:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1099999999999996e-07 2024-09-14T09:09:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039887+0000", 2024-09-14T09:09:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4920000000000004e-06 2024-09-14T09:09:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039891+0000", 2024-09-14T09:09:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.557e-06 2024-09-14T09:09:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039896+0000", 2024-09-14T09:09:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2000000000000002e-06 2024-09-14T09:09:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95181 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025555+0000", 2024-09-14T09:09:18.671 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013301792999999999, 2024-09-14T09:09:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017915823000000001, 2024-09-14T09:09:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95181 2024-09-14T09:09:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025555+0000", 2024-09-14T09:09:18.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025555+0000", 2024-09-14T09:09:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025556+0000", 2024-09-14T09:09:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7100000000000002e-07 2024-09-14T09:09:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025558+0000", 2024-09-14T09:09:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.046e-06 2024-09-14T09:09:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025566+0000", 2024-09-14T09:09:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7520000000000002e-06 2024-09-14T09:09:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025572+0000", 2024-09-14T09:09:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3789999999999997e-06 2024-09-14T09:09:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.674 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95227 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026330+0000", 2024-09-14T09:09:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.01252707, 2024-09-14T09:09:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017165809000000001, 2024-09-14T09:09:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95227 2024-09-14T09:09:18.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026330+0000", 2024-09-14T09:09:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026330+0000", 2024-09-14T09:09:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026330+0000", 2024-09-14T09:09:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5000000000000003e-07 2024-09-14T09:09:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026332+0000", 2024-09-14T09:09:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7439999999999999e-06 2024-09-14T09:09:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026338+0000", 2024-09-14T09:09:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.998e-06 2024-09-14T09:09:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026348+0000", 2024-09-14T09:09:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0271e-05 2024-09-14T09:09:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95289 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027123+0000", 2024-09-14T09:09:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011733597, 2024-09-14T09:09:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016395933000000001, 2024-09-14T09:09:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.678 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95289 2024-09-14T09:09:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027123+0000", 2024-09-14T09:09:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027123+0000", 2024-09-14T09:09:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027124+0000", 2024-09-14T09:09:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8500000000000002e-07 2024-09-14T09:09:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027135+0000", 2024-09-14T09:09:18.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1002000000000001e-05 2024-09-14T09:09:18.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027143+0000", 2024-09-14T09:09:18.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1310000000000006e-06 2024-09-14T09:09:18.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027148+0000", 2024-09-14T09:09:18.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0799999999999996e-06 2024-09-14T09:09:18.681 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.681 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.682 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.682 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95409 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.682 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033147+0000", 2024-09-14T09:09:18.682 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0057097479999999997, 2024-09-14T09:09:18.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010396499, 2024-09-14T09:09:18.682 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.682 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.682 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.682 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.682 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.682 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.682 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95409 2024-09-14T09:09:18.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.683 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033147+0000", 2024-09-14T09:09:18.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033147+0000", 2024-09-14T09:09:18.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033148+0000", 2024-09-14T09:09:18.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2399999999999998e-07 2024-09-14T09:09:18.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033150+0000", 2024-09-14T09:09:18.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0140000000000001e-06 2024-09-14T09:09:18.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033156+0000", 2024-09-14T09:09:18.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3319999999999997e-06 2024-09-14T09:09:18.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033162+0000", 2024-09-14T09:09:18.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.297e-06 2024-09-14T09:09:18.685 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.685 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.685 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.685 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95498 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.685 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033992+0000", 2024-09-14T09:09:18.685 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0048644500000000002, 2024-09-14T09:09:18.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0095745980000000001, 2024-09-14T09:09:18.685 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.685 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.685 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.686 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.686 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.686 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.686 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95498 2024-09-14T09:09:18.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.686 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033992+0000", 2024-09-14T09:09:18.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033992+0000", 2024-09-14T09:09:18.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033993+0000", 2024-09-14T09:09:18.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2024-09-14T09:09:18.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033995+0000", 2024-09-14T09:09:18.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.889e-06 2024-09-14T09:09:18.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034001+0000", 2024-09-14T09:09:18.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3300000000000004e-06 2024-09-14T09:09:18.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034006+0000", 2024-09-14T09:09:18.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.322e-06 2024-09-14T09:09:18.688 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.688 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.688 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.688 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95555 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.688 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.039900+0000", 2024-09-14T09:09:18.688 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9989567, 2024-09-14T09:09:18.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003690053, 2024-09-14T09:09:18.689 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.689 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.689 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.689 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.689 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.689 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.689 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95555 2024-09-14T09:09:18.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.689 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039900+0000", 2024-09-14T09:09:18.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039900+0000", 2024-09-14T09:09:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039901+0000", 2024-09-14T09:09:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6100000000000002e-07 2024-09-14T09:09:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039902+0000", 2024-09-14T09:09:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.023e-06 2024-09-14T09:09:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039904+0000", 2024-09-14T09:09:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.96e-06 2024-09-14T09:09:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039907+0000", 2024-09-14T09:09:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6259999999999999e-06 2024-09-14T09:09:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95182 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.025579+0000", 2024-09-14T09:09:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013278237, 2024-09-14T09:09:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018037416000000001, 2024-09-14T09:09:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95182 2024-09-14T09:09:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025579+0000", 2024-09-14T09:09:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025579+0000", 2024-09-14T09:09:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025579+0000", 2024-09-14T09:09:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7300000000000001e-07 2024-09-14T09:09:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025581+0000", 2024-09-14T09:09:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9190000000000002e-06 2024-09-14T09:09:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025587+0000", 2024-09-14T09:09:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.959e-06 2024-09-14T09:09:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.025592+0000", 2024-09-14T09:09:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0440000000000003e-06 2024-09-14T09:09:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95229 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.026356+0000", 2024-09-14T09:09:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012500928999999999, 2024-09-14T09:09:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017283636000000002, 2024-09-14T09:09:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95229 2024-09-14T09:09:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026356+0000", 2024-09-14T09:09:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026356+0000", 2024-09-14T09:09:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026356+0000", 2024-09-14T09:09:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0900000000000002e-07 2024-09-14T09:09:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026358+0000", 2024-09-14T09:09:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1090000000000001e-06 2024-09-14T09:09:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026365+0000", 2024-09-14T09:09:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8940000000000004e-06 2024-09-14T09:09:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.026371+0000", 2024-09-14T09:09:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0680000000000002e-06 2024-09-14T09:09:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95291 3.17 3.3e080157 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.027156+0000", 2024-09-14T09:09:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011700976, 2024-09-14T09:09:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016508202, 2024-09-14T09:09:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95291 2024-09-14T09:09:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027156+0000", 2024-09-14T09:09:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027156+0000", 2024-09-14T09:09:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027156+0000", 2024-09-14T09:09:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7899999999999999e-07 2024-09-14T09:09:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027159+0000", 2024-09-14T09:09:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:09:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027166+0000", 2024-09-14T09:09:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2200000000000003e-06 2024-09-14T09:09:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.027172+0000", 2024-09-14T09:09:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4359999999999999e-06 2024-09-14T09:09:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95411 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.033169+0000", 2024-09-14T09:09:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0056877760000000003, 2024-09-14T09:09:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010518374, 2024-09-14T09:09:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95411 2024-09-14T09:09:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033169+0000", 2024-09-14T09:09:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033169+0000", 2024-09-14T09:09:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033169+0000", 2024-09-14T09:09:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2e-07 2024-09-14T09:09:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033171+0000", 2024-09-14T09:09:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0549999999999998e-06 2024-09-14T09:09:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033178+0000", 2024-09-14T09:09:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4010000000000002e-06 2024-09-14T09:09:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.033184+0000", 2024-09-14T09:09:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8039999999999998e-06 2024-09-14T09:09:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95500 3.17 3.c210e397 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.034013+0000", 2024-09-14T09:09:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0048437369999999999, 2024-09-14T09:09:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0096986009999999994, 2024-09-14T09:09:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95500 2024-09-14T09:09:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034013+0000", 2024-09-14T09:09:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034013+0000", 2024-09-14T09:09:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034013+0000", 2024-09-14T09:09:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2e-07 2024-09-14T09:09:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034015+0000", 2024-09-14T09:09:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9149999999999999e-06 2024-09-14T09:09:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034022+0000", 2024-09-14T09:09:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3600000000000001e-06 2024-09-14T09:09:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.034027+0000", 2024-09-14T09:09:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0209999999999999e-06 2024-09-14T09:09:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:95556 3.17 3.dc876b7 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-14T09:09:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:18.039910+0000", 2024-09-14T09:09:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9989467, 2024-09-14T09:09:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038314080000000001, 2024-09-14T09:09:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-09-14T09:09:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 95556 2024-09-14T09:09:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039910+0000", 2024-09-14T09:09:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039910+0000", 2024-09-14T09:09:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039910+0000", 2024-09-14T09:09:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0699999999999999e-07 2024-09-14T09:09:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039911+0000", 2024-09-14T09:09:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.54e-07 2024-09-14T09:09:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039914+0000", 2024-09-14T09:09:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8870000000000001e-06 2024-09-14T09:09:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:18.039918+0000", 2024-09-14T09:09:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4479999999999999e-06 2024-09-14T09:09:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-14T09:09:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 196 2024-09-14T09:09:18.711 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:18.712 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:09:18.714 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:18.714 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:18.714+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:18.814 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:18.815+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:18.885 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:18.886 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:18.889 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:18.889 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:18.889 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:18.889 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:18.889 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:18.900 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:09:18.911 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:18.912 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:18.933 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:09:18.933 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:09:18.942 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:18.943+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:18.957 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:18.957 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:18.978 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:18.978 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:19.003 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:19.003 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:19.015 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:19.017+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:19.072 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:19.073 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:19.084 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:09:19.125 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:19.126+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:19.208 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:19.208 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:19.217 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:19.219+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:19.220 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:09:19.292 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:09:19.318 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:19.319+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:19.419 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:19.420+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:19.428 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:19.428 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:19.441 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:09:19.462 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:19.462 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:19.520 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:19.522+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:19.619 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:19.620 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:19.621 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:19.622+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:19.630 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:09:19.722 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:19.724+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:19.823 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:19.824+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:19.866 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:19.866 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:19.866 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:09:19.898 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T09:09:19.924 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:19.925+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:20.011 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:20.011 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:20.023 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:09:20.025 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:20.027+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:20.125 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:20.127+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:20.192 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:20.192 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:20.205 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:09:20.225 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:20.227+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:20.315 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:20.316 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:20.325 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:09:20.326 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:20.327+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:20.426 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:20.428+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:20.433 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:20.433 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:20.442 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:09:20.527 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:20.529+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:20.594 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:20.595 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:20.605 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:09:20.649 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:20.650+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:20.729 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:20.730+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:20.743 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:20.743 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:20.752 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:09:20.830 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:20.832+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:20.885 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is set 2024-09-14T09:09:20.909 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:20.909 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:20.918 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:09:20.939 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:20.941+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:21.015 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:09:21.024 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:21.024 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:21.033 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:09:21.059 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:21.061+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:21.133 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:21.135+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:21.136 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:21.136 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:21.145 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:21.158 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:21.158 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:21.175 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:21.175 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:21.200 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:09:21.200 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:09:21.218 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:21.219 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:21.234 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:21.236+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:21.237 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:21.237 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:21.252 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:21.252 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:21.256 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:21.257 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:21.261 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:09:21.334 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:21.336+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:21.365 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:21.366 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:21.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:21.366 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:21.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.366 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:228 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 360448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:21.366 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:21.366 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.570082999, 2024-09-14T09:09:21.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99234476999999999, 2024-09-14T09:09:21.366 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:21.366 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:21.366 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:21.366 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:21.366 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:21.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:21.367 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 228 2024-09-14T09:09:21.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.367 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:21.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:21.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:21.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:21.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:21.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:21.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796906+0000", 2024-09-14T09:09:21.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9399999999999995e-07 2024-09-14T09:09:21.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:21.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796917+0000", 2024-09-14T09:09:21.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0801e-05 2024-09-14T09:09:21.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:21.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796924+0000", 2024-09-14T09:09:21.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7750000000000004e-06 2024-09-14T09:09:21.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:21.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9972000000000001e-05 2024-09-14T09:09:21.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798671+0000", 2024-09-14T09:09:21.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017271330000000001 2024-09-14T09:09:21.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798675+0000", 2024-09-14T09:09:21.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.194e-06 2024-09-14T09:09:21.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789003+0000", 2024-09-14T09:09:21.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99032768400000004 2024-09-14T09:09:21.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:21.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789115+0000", 2024-09-14T09:09:21.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112236 2024-09-14T09:09:21.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:21.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789250+0000", 2024-09-14T09:09:21.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013548100000000001 2024-09-14T09:09:21.370 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.371 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:21.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.371 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:229 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 819200~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:21.371 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:21.371 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.570030776000003, 2024-09-14T09:09:21.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99287024599999996, 2024-09-14T09:09:21.371 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:21.371 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:21.371 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:21.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:21.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:21.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:21.372 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 229 2024-09-14T09:09:21.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.372 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:21.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:21.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:21.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:21.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:21.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:21.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:21.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999999e-07 2024-09-14T09:09:21.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:21.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796962+0000", 2024-09-14T09:09:21.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1479999999999999e-06 2024-09-14T09:09:21.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:21.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796967+0000", 2024-09-14T09:09:21.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1499999999999998e-06 2024-09-14T09:09:21.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:09:21.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-06 2024-09-14T09:09:21.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798688+0000", 2024-09-14T09:09:21.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017172660000000001 2024-09-14T09:09:21.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798691+0000", 2024-09-14T09:09:21.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:09:21.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789599+0000", 2024-09-14T09:09:21.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99090839399999997 2024-09-14T09:09:21.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:21.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789716+0000", 2024-09-14T09:09:21.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116474 2024-09-14T09:09:21.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:21.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789828+0000", 2024-09-14T09:09:21.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112293 2024-09-14T09:09:21.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.375 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:21.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.376 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:230 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1277952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:21.376 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:21.376 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.570010128, 2024-09-14T09:09:21.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99307501600000003, 2024-09-14T09:09:21.376 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:21.376 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:21.376 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:21.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:21.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:21.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:21.376 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 230 2024-09-14T09:09:21.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.377 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:21.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:21.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:21.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:21.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:21.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:21.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796979+0000", 2024-09-14T09:09:21.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.34e-07 2024-09-14T09:09:21.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:21.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796980+0000", 2024-09-14T09:09:21.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.53e-06 2024-09-14T09:09:21.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:21.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796986+0000", 2024-09-14T09:09:21.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9989999999999997e-06 2024-09-14T09:09:21.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796989+0000", 2024-09-14T09:09:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0340000000000001e-06 2024-09-14T09:09:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798702+0000", 2024-09-14T09:09:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001712756 2024-09-14T09:09:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798705+0000", 2024-09-14T09:09:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7750000000000001e-06 2024-09-14T09:09:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789870+0000", 2024-09-14T09:09:21.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991165026 2024-09-14T09:09:21.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:21.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789955+0000", 2024-09-14T09:09:21.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4839999999999994e-05 2024-09-14T09:09:21.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:21.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790053+0000", 2024-09-14T09:09:21.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8721999999999994e-05 2024-09-14T09:09:21.380 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.380 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:21.381 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.381 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:231 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:21.381 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:21.381 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.569994800000003, 2024-09-14T09:09:21.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99319130300000003, 2024-09-14T09:09:21.381 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:21.381 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:21.381 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:21.381 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:21.381 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:21.381 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:21.381 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 231 2024-09-14T09:09:21.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2024-09-14T09:09:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796995+0000", 2024-09-14T09:09:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2500000000000001e-06 2024-09-14T09:09:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796998+0000", 2024-09-14T09:09:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3230000000000002e-06 2024-09-14T09:09:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797001+0000", 2024-09-14T09:09:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7099999999999999e-06 2024-09-14T09:09:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798718+0000", 2024-09-14T09:09:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017168070000000001 2024-09-14T09:09:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798721+0000", 2024-09-14T09:09:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.853e-06 2024-09-14T09:09:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790077+0000", 2024-09-14T09:09:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991356393 2024-09-14T09:09:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790129+0000", 2024-09-14T09:09:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2240999999999997e-05 2024-09-14T09:09:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790185+0000", 2024-09-14T09:09:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5515e-05 2024-09-14T09:09:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:232 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2195456~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.569984144000003, 2024-09-14T09:09:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99329117899999997, 2024-09-14T09:09:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 232 2024-09-14T09:09:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797005+0000", 2024-09-14T09:09:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2024-09-14T09:09:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797006+0000", 2024-09-14T09:09:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3200000000000001e-06 2024-09-14T09:09:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797009+0000", 2024-09-14T09:09:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4680000000000001e-06 2024-09-14T09:09:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797012+0000", 2024-09-14T09:09:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4770000000000002e-06 2024-09-14T09:09:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798743+0000", 2024-09-14T09:09:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017312 2024-09-14T09:09:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798747+0000", 2024-09-14T09:09:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.484e-06 2024-09-14T09:09:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790201+0000", 2024-09-14T09:09:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99145419499999998 2024-09-14T09:09:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790241+0000", 2024-09-14T09:09:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0587999999999998e-05 2024-09-14T09:09:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790296+0000", 2024-09-14T09:09:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4212000000000002e-05 2024-09-14T09:09:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:233 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2654208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.569973521000001, 2024-09-14T09:09:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99337220100000001, 2024-09-14T09:09:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 233 2024-09-14T09:09:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:09:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:09:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.269e-06 2024-09-14T09:09:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797019+0000", 2024-09-14T09:09:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9519999999999999e-06 2024-09-14T09:09:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797022+0000", 2024-09-14T09:09:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6079999999999998e-06 2024-09-14T09:09:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798759+0000", 2024-09-14T09:09:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001737342 2024-09-14T09:09:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798762+0000", 2024-09-14T09:09:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:09:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790310+0000", 2024-09-14T09:09:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99154738799999997 2024-09-14T09:09:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790349+0000", 2024-09-14T09:09:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9573000000000002e-05 2024-09-14T09:09:21.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:21.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790387+0000", 2024-09-14T09:09:21.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7985999999999998e-05 2024-09-14T09:09:21.395 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.395 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:21.395 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.395 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:234 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3112960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:21.395 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:21.395 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.569963475999998, 2024-09-14T09:09:21.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99345674500000003, 2024-09-14T09:09:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 234 2024-09-14T09:09:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0100000000000001e-07 2024-09-14T09:09:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0699999999999999e-06 2024-09-14T09:09:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:09:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.886e-06 2024-09-14T09:09:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797032+0000", 2024-09-14T09:09:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7149999999999998e-06 2024-09-14T09:09:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798778+0000", 2024-09-14T09:09:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017460329999999999 2024-09-14T09:09:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798783+0000", 2024-09-14T09:09:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0760000000000002e-06 2024-09-14T09:09:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790408+0000", 2024-09-14T09:09:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99162473299999998 2024-09-14T09:09:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790446+0000", 2024-09-14T09:09:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8389000000000001e-05 2024-09-14T09:09:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790482+0000", 2024-09-14T09:09:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5642000000000002e-05 2024-09-14T09:09:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:235 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3571712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.569953578000003, 2024-09-14T09:09:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993539477, 2024-09-14T09:09:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 235 2024-09-14T09:09:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9999999999999999e-07 2024-09-14T09:09:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797036+0000", 2024-09-14T09:09:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.051e-06 2024-09-14T09:09:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797039+0000", 2024-09-14T09:09:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:09:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797042+0000", 2024-09-14T09:09:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5280000000000002e-06 2024-09-14T09:09:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798809+0000", 2024-09-14T09:09:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001767394 2024-09-14T09:09:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798815+0000", 2024-09-14T09:09:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0859999999999998e-06 2024-09-14T09:09:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790502+0000", 2024-09-14T09:09:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99168652300000004 2024-09-14T09:09:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790539+0000", 2024-09-14T09:09:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7471000000000001e-05 2024-09-14T09:09:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790574+0000", 2024-09-14T09:09:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5292e-05 2024-09-14T09:09:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:236 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 4030464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.569943344999999, 2024-09-14T09:09:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993619743, 2024-09-14T09:09:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 236 2024-09-14T09:09:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1400000000000001e-07 2024-09-14T09:09:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797047+0000", 2024-09-14T09:09:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3400000000000001e-06 2024-09-14T09:09:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:09:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0699999999999998e-06 2024-09-14T09:09:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797053+0000", 2024-09-14T09:09:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7310000000000002e-06 2024-09-14T09:09:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798839+0000", 2024-09-14T09:09:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001786403 2024-09-14T09:09:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798844+0000", 2024-09-14T09:09:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3730000000000001e-06 2024-09-14T09:09:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790592+0000", 2024-09-14T09:09:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99174818099999995 2024-09-14T09:09:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790628+0000", 2024-09-14T09:09:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5831000000000003e-05 2024-09-14T09:09:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790665+0000", 2024-09-14T09:09:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-05 2024-09-14T09:09:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:365 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.567756316999997, 2024-09-14T09:09:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157278400000004, 2024-09-14T09:09:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 365 2024-09-14T09:09:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:09:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799233+0000", 2024-09-14T09:09:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.057e-06 2024-09-14T09:09:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799236+0000", 2024-09-14T09:09:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0249999999999998e-06 2024-09-14T09:09:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799239+0000", 2024-09-14T09:09:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.481e-06 2024-09-14T09:09:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800963+0000", 2024-09-14T09:09:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017240440000000001 2024-09-14T09:09:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800969+0000", 2024-09-14T09:09:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1410000000000002e-06 2024-09-14T09:09:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790682+0000", 2024-09-14T09:09:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98971330300000004 2024-09-14T09:09:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790753+0000", 2024-09-14T09:09:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0548000000000003e-05 2024-09-14T09:09:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790805+0000", 2024-09-14T09:09:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1981999999999998e-05 2024-09-14T09:09:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:366 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.567746223999997, 2024-09-14T09:09:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99173757299999998, 2024-09-14T09:09:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 366 2024-09-14T09:09:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-07 2024-09-14T09:09:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799244+0000", 2024-09-14T09:09:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.359e-06 2024-09-14T09:09:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799247+0000", 2024-09-14T09:09:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4929999999999998e-06 2024-09-14T09:09:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799250+0000", 2024-09-14T09:09:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:09:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800991+0000", 2024-09-14T09:09:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017412809999999999 2024-09-14T09:09:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800997+0000", 2024-09-14T09:09:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:09:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790824+0000", 2024-09-14T09:09:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98982735399999999 2024-09-14T09:09:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790891+0000", 2024-09-14T09:09:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7243999999999995e-05 2024-09-14T09:09:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790980+0000", 2024-09-14T09:09:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8608000000000003e-05 2024-09-14T09:09:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:367 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.567734852000001, 2024-09-14T09:09:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99188259999999995, 2024-09-14T09:09:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 367 2024-09-14T09:09:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-07 2024-09-14T09:09:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799255+0000", 2024-09-14T09:09:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.111e-06 2024-09-14T09:09:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799259+0000", 2024-09-14T09:09:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8650000000000003e-06 2024-09-14T09:09:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799262+0000", 2024-09-14T09:09:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.128e-06 2024-09-14T09:09:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801029+0000", 2024-09-14T09:09:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017668460000000001 2024-09-14T09:09:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801032+0000", 2024-09-14T09:09:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3179999999999998e-06 2024-09-14T09:09:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791011+0000", 2024-09-14T09:09:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98997920399999995 2024-09-14T09:09:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791077+0000", 2024-09-14T09:09:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5214000000000003e-05 2024-09-14T09:09:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791136+0000", 2024-09-14T09:09:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9710000000000003e-05 2024-09-14T09:09:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:368 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.567723309000002, 2024-09-14T09:09:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99201753800000003, 2024-09-14T09:09:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 368 2024-09-14T09:09:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4900000000000002e-07 2024-09-14T09:09:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799267+0000", 2024-09-14T09:09:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.079e-06 2024-09-14T09:09:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799270+0000", 2024-09-14T09:09:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.993e-06 2024-09-14T09:09:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799272+0000", 2024-09-14T09:09:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.695e-06 2024-09-14T09:09:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801043+0000", 2024-09-14T09:09:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001771105 2024-09-14T09:09:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801046+0000", 2024-09-14T09:09:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7999999999999999e-06 2024-09-14T09:09:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791150+0000", 2024-09-14T09:09:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99010348699999995 2024-09-14T09:09:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791193+0000", 2024-09-14T09:09:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3615999999999997e-05 2024-09-14T09:09:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791283+0000", 2024-09-14T09:09:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9513999999999997e-05 2024-09-14T09:09:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:369 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.567712970999999, 2024-09-14T09:09:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99213433600000001, 2024-09-14T09:09:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 369 2024-09-14T09:09:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:09:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799277+0000", 2024-09-14T09:09:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.108e-06 2024-09-14T09:09:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799280+0000", 2024-09-14T09:09:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:09:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799283+0000", 2024-09-14T09:09:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.531e-06 2024-09-14T09:09:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801058+0000", 2024-09-14T09:09:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001775085 2024-09-14T09:09:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801060+0000", 2024-09-14T09:09:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8260000000000001e-06 2024-09-14T09:09:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791299+0000", 2024-09-14T09:09:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99023856799999999 2024-09-14T09:09:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791352+0000", 2024-09-14T09:09:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2528000000000003e-05 2024-09-14T09:09:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791410+0000", 2024-09-14T09:09:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8298000000000003e-05 2024-09-14T09:09:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:370 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2457600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.567688204, 2024-09-14T09:09:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99220795399999995, 2024-09-14T09:09:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 370 2024-09-14T09:09:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799301+0000", 2024-09-14T09:09:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2024-09-14T09:09:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799303+0000", 2024-09-14T09:09:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9319999999999999e-06 2024-09-14T09:09:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799310+0000", 2024-09-14T09:09:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8680000000000001e-06 2024-09-14T09:09:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799315+0000", 2024-09-14T09:09:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.921e-06 2024-09-14T09:09:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801071+0000", 2024-09-14T09:09:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001756678 2024-09-14T09:09:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801080+0000", 2024-09-14T09:09:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6060000000000003e-06 2024-09-14T09:09:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791429+0000", 2024-09-14T09:09:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99034944599999997 2024-09-14T09:09:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791471+0000", 2024-09-14T09:09:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1279999999999998e-05 2024-09-14T09:09:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791508+0000", 2024-09-14T09:09:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7663999999999997e-05 2024-09-14T09:09:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:371 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2916352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.567667032000003, 2024-09-14T09:09:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99228692299999999, 2024-09-14T09:09:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 371 2024-09-14T09:09:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799322+0000", 2024-09-14T09:09:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:09:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799333+0000", 2024-09-14T09:09:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1044e-05 2024-09-14T09:09:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799341+0000", 2024-09-14T09:09:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8439999999999998e-06 2024-09-14T09:09:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799354+0000", 2024-09-14T09:09:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3114e-05 2024-09-14T09:09:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801093+0000", 2024-09-14T09:09:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017385910000000001 2024-09-14T09:09:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801096+0000", 2024-09-14T09:09:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0680000000000001e-06 2024-09-14T09:09:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791528+0000", 2024-09-14T09:09:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99043264200000003 2024-09-14T09:09:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791570+0000", 2024-09-14T09:09:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2144999999999997e-05 2024-09-14T09:09:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791608+0000", 2024-09-14T09:09:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7966000000000002e-05 2024-09-14T09:09:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:372 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3375104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.567626484000002, 2024-09-14T09:09:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992342897, 2024-09-14T09:09:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 372 2024-09-14T09:09:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799363+0000", 2024-09-14T09:09:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2024-09-14T09:09:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799365+0000", 2024-09-14T09:09:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5500000000000001e-06 2024-09-14T09:09:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799371+0000", 2024-09-14T09:09:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2500000000000003e-06 2024-09-14T09:09:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799377+0000", 2024-09-14T09:09:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7509999999999997e-06 2024-09-14T09:09:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801107+0000", 2024-09-14T09:09:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017298019999999999 2024-09-14T09:09:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801111+0000", 2024-09-14T09:09:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8619999999999996e-06 2024-09-14T09:09:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791626+0000", 2024-09-14T09:09:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99051563300000001 2024-09-14T09:09:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791668+0000", 2024-09-14T09:09:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1424000000000002e-05 2024-09-14T09:09:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791705+0000", 2024-09-14T09:09:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7035e-05 2024-09-14T09:09:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:373 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.567604539000001, 2024-09-14T09:09:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99253589399999997, 2024-09-14T09:09:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 373 2024-09-14T09:09:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2024-09-14T09:09:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799387+0000", 2024-09-14T09:09:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1019999999999999e-06 2024-09-14T09:09:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799393+0000", 2024-09-14T09:09:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0190000000000003e-06 2024-09-14T09:09:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799398+0000", 2024-09-14T09:09:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:09:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801123+0000", 2024-09-14T09:09:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017251949999999999 2024-09-14T09:09:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801126+0000", 2024-09-14T09:09:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9280000000000002e-06 2024-09-14T09:09:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791746+0000", 2024-09-14T09:09:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99062036899999995 2024-09-14T09:09:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791835+0000", 2024-09-14T09:09:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9004000000000004e-05 2024-09-14T09:09:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791920+0000", 2024-09-14T09:09:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4524000000000006e-05 2024-09-14T09:09:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:60352 3.0 3.6d62a5c0 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:09:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.9849687009999997, 2024-09-14T09:09:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41710537399999997, 2024-09-14T09:09:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 60352 2024-09-14T09:09:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:09:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:09:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382044+0000", 2024-09-14T09:09:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4640000000000001e-05 2024-09-14T09:09:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382048+0000", 2024-09-14T09:09:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4690000000000002e-06 2024-09-14T09:09:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382053+0000", 2024-09-14T09:09:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:09:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382068+0000", 2024-09-14T09:09:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4399000000000001e-05 2024-09-14T09:09:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382121+0000", 2024-09-14T09:09:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3578000000000001e-05 2024-09-14T09:09:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382127+0000", 2024-09-14T09:09:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2024-09-14T09:09:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799116+0000", 2024-09-14T09:09:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.416988566 2024-09-14T09:09:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799125+0000", 2024-09-14T09:09:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3100000000000006e-06 2024-09-14T09:09:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:63559 3.0 3.95b285c0 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.9791373280000002, 2024-09-14T09:09:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.411301215, 2024-09-14T09:09:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 63559 2024-09-14T09:09:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2499999999999999e-07 2024-09-14T09:09:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387853+0000", 2024-09-14T09:09:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.477e-06 2024-09-14T09:09:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387856+0000", 2024-09-14T09:09:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1429999999999998e-06 2024-09-14T09:09:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387859+0000", 2024-09-14T09:09:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.582e-06 2024-09-14T09:09:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387888+0000", 2024-09-14T09:09:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9609000000000001e-05 2024-09-14T09:09:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387893+0000", 2024-09-14T09:09:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6779999999999999e-06 2024-09-14T09:09:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799143+0000", 2024-09-14T09:09:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41124997099999999 2024-09-14T09:09:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:21.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:21.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799152+0000", 2024-09-14T09:09:21.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5300000000000002e-06 2024-09-14T09:09:21.466 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.466 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:21.466 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.466 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:21.466 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:21.466 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:21.468 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:09:21.468 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:21.469+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:21.569 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:21.570+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:21.578 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:21.578 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:21.579 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:09:21.579 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:21.588 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:09:21.672 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:21.674+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:21.735 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:21.735 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:21.735 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:21.736 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:21.736 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:21.744 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:09:21.785 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:21.787+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:21.871 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:21.872+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:21.895 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:21.895 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:21.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:21.895 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:21.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.896 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55979 3.e 3:740d1568:::rbd_data.1112a10502fe.0000000000000133:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:21.896 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:21.896 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 6.045204483, 2024-09-14T09:09:21.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.95211669700000001, 2024-09-14T09:09:21.896 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:21.896 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:21.896 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:21.896 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:21.896 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:21.896 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:21.896 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55979 2024-09-14T09:09:21.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.896 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:21.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:21.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:21.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:21.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:21.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:21.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850380+0000", 2024-09-14T09:09:21.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.615e-06 2024-09-14T09:09:21.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:21.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850386+0000", 2024-09-14T09:09:21.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8000000000000001e-06 2024-09-14T09:09:21.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:21.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850403+0000", 2024-09-14T09:09:21.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6339999999999999e-05 2024-09-14T09:09:21.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850413+0000", 2024-09-14T09:09:21.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8609999999999993e-06 2024-09-14T09:09:21.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851033+0000", 2024-09-14T09:09:21.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062034700000000004 2024-09-14T09:09:21.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:09:21.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851042+0000", 2024-09-14T09:09:21.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8340000000000005e-06 2024-09-14T09:09:21.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853175+0000", 2024-09-14T09:09:21.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0021332809999999999 2024-09-14T09:09:21.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853183+0000", 2024-09-14T09:09:21.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:09:21.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795232+0000", 2024-09-14T09:09:21.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94204854900000001 2024-09-14T09:09:21.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:21.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795413+0000", 2024-09-14T09:09:21.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018059200000000001 2024-09-14T09:09:21.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:09:21.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795717+0000", 2024-09-14T09:09:21.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000304636 2024-09-14T09:09:21.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:21.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799631+0000", 2024-09-14T09:09:21.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136910000000004 2024-09-14T09:09:21.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:21.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802290+0000", 2024-09-14T09:09:21.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026588010000000001 2024-09-14T09:09:21.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:21.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802362+0000", 2024-09-14T09:09:21.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2018000000000001e-05 2024-09-14T09:09:21.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:21.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802495+0000", 2024-09-14T09:09:21.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000132967 2024-09-14T09:09:21.903 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.903 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:21.903 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.903 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55990 3.e 3:72d6260e:::rbd_data.1112a10502fe.000000000000016c:head [stat,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:21.903 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:21.903 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 6.0451431759999998, 2024-09-14T09:09:21.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.952433164, 2024-09-14T09:09:21.903 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:21.903 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:21.903 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:21.903 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:21.903 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:21.903 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:21.904 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55990 2024-09-14T09:09:21.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.904 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:21.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:21.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:21.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:21.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:21.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:21.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850440+0000", 2024-09-14T09:09:21.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5199999999999996e-07 2024-09-14T09:09:21.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:21.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850444+0000", 2024-09-14T09:09:21.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.019e-06 2024-09-14T09:09:21.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:21.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850452+0000", 2024-09-14T09:09:21.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0209999999999999e-06 2024-09-14T09:09:21.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850457+0000", 2024-09-14T09:09:21.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9529999999999998e-06 2024-09-14T09:09:21.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851100+0000", 2024-09-14T09:09:21.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00064299699999999997 2024-09-14T09:09:21.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:21.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851108+0000", 2024-09-14T09:09:21.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2279999999999998e-06 2024-09-14T09:09:21.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853208+0000", 2024-09-14T09:09:21.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020996579999999999 2024-09-14T09:09:21.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853213+0000", 2024-09-14T09:09:21.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4029999999999998e-06 2024-09-14T09:09:21.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796098+0000", 2024-09-14T09:09:21.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94288483700000003 2024-09-14T09:09:21.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:21.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796247+0000", 2024-09-14T09:09:21.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014925800000000001 2024-09-14T09:09:21.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:21.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802872+0000", 2024-09-14T09:09:21.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006625138 2024-09-14T09:09:21.909 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.909 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:21.909 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.909 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.909 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.909 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:21.909 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:21.909 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.8809044029999997, 2024-09-14T09:09:21.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77465830800000002, 2024-09-14T09:09:21.909 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:21.909 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:21.909 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:21.910 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:21.910 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:21.910 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:21.910 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 58987 2024-09-14T09:09:21.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.910 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:21.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.910 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:21.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:21.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.910 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:21.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:21.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:21.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014680+0000", 2024-09-14T09:09:21.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9250000000000002e-06 2024-09-14T09:09:21.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:21.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014689+0000", 2024-09-14T09:09:21.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9730000000000003e-06 2024-09-14T09:09:21.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:21.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014709+0000", 2024-09-14T09:09:21.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9641999999999999e-05 2024-09-14T09:09:21.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014720+0000", 2024-09-14T09:09:21.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-09-14T09:09:21.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014796+0000", 2024-09-14T09:09:21.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6567000000000001e-05 2024-09-14T09:09:21.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014808+0000", 2024-09-14T09:09:21.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1435e-05 2024-09-14T09:09:21.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789325+0000", 2024-09-14T09:09:21.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77451705999999998 2024-09-14T09:09:21.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:21.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789336+0000", 2024-09-14T09:09:21.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1466e-05 2024-09-14T09:09:21.914 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.914 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:21.914 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.914 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:59017 3.3 3.6b81fb83 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:21.914 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:21.914 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.8792519990000001, 2024-09-14T09:09:21.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77253447099999994, 2024-09-14T09:09:21.914 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:21.914 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:21.914 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:21.915 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:21.915 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:21.915 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:21.915 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 59017 2024-09-14T09:09:21.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.915 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:21.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:21.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:21.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:21.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:21.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:21.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016332+0000", 2024-09-14T09:09:21.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3459999999999999e-06 2024-09-14T09:09:21.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:21.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016337+0000", 2024-09-14T09:09:21.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.48e-06 2024-09-14T09:09:21.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:21.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016355+0000", 2024-09-14T09:09:21.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7955e-05 2024-09-14T09:09:21.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016364+0000", 2024-09-14T09:09:21.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.02e-06 2024-09-14T09:09:21.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016433+0000", 2024-09-14T09:09:21.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8398000000000005e-05 2024-09-14T09:09:21.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016442+0000", 2024-09-14T09:09:21.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1819999999999995e-06 2024-09-14T09:09:21.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.919 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.919 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788855+0000", 2024-09-14T09:09:21.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77241356299999997 2024-09-14T09:09:21.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.919 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:21.919 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788865+0000", 2024-09-14T09:09:21.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5270000000000004e-06 2024-09-14T09:09:21.919 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.919 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:21.919 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.919 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60343 3.e 3:721b16e6:::rbd_data.1112a10502fe.000000000000014b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:21.919 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:21.920 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.7752823969999998, 2024-09-14T09:09:21.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68876920900000005, 2024-09-14T09:09:21.920 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:21.920 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:21.920 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:21.921 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:21.921 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:21.921 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:21.921 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60343 2024-09-14T09:09:21.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.921 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:21.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.921 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:21.921 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:21.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:21.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:21.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:21.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120302+0000", 2024-09-14T09:09:21.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0279999999999999e-06 2024-09-14T09:09:21.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:21.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120310+0000", 2024-09-14T09:09:21.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4330000000000004e-06 2024-09-14T09:09:21.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:21.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120333+0000", 2024-09-14T09:09:21.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2200000000000001e-05 2024-09-14T09:09:21.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120343+0000", 2024-09-14T09:09:21.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0560000000000001e-05 2024-09-14T09:09:21.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120414+0000", 2024-09-14T09:09:21.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0493000000000004e-05 2024-09-14T09:09:21.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120424+0000", 2024-09-14T09:09:21.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.059e-05 2024-09-14T09:09:21.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796679+0000", 2024-09-14T09:09:21.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67625512700000001 2024-09-14T09:09:21.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:21.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796833+0000", 2024-09-14T09:09:21.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015403500000000001 2024-09-14T09:09:21.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:09:21.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797239+0000", 2024-09-14T09:09:21.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040503000000000002 2024-09-14T09:09:21.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:21.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802918+0000", 2024-09-14T09:09:21.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056796199999999998 2024-09-14T09:09:21.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:21.926 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808655+0000", 2024-09-14T09:09:21.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057365089999999999 2024-09-14T09:09:21.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.926 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:21.926 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808850+0000", 2024-09-14T09:09:21.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000194904 2024-09-14T09:09:21.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.926 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:21.926 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809069+0000", 2024-09-14T09:09:21.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021968000000000001 2024-09-14T09:09:21.926 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.926 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:21.927 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.927 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60356 3.2 3:40f9e9e7:::rbd_data.1112a10502fe.0000000000000160:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:21.927 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:21.927 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.7742198839999999, 2024-09-14T09:09:21.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68053790800000002, 2024-09-14T09:09:21.927 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:21.927 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:21.927 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:21.927 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:21.927 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:21.927 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:21.928 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60356 2024-09-14T09:09:21.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.928 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:21.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:21.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:21.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:21.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:21.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:21.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121364+0000", 2024-09-14T09:09:21.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.173e-06 2024-09-14T09:09:21.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:21.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121371+0000", 2024-09-14T09:09:21.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-09-14T09:09:21.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:21.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121386+0000", 2024-09-14T09:09:21.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4925e-05 2024-09-14T09:09:21.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121395+0000", 2024-09-14T09:09:21.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8190000000000003e-06 2024-09-14T09:09:21.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121464+0000", 2024-09-14T09:09:21.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8149000000000001e-05 2024-09-14T09:09:21.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121474+0000", 2024-09-14T09:09:21.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0927999999999999e-05 2024-09-14T09:09:21.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.931 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.931 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795901+0000", 2024-09-14T09:09:21.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67442645499999998 2024-09-14T09:09:21.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.931 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:21.931 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796068+0000", 2024-09-14T09:09:21.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016655700000000001 2024-09-14T09:09:21.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.931 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 3", 2024-09-14T09:09:21.931 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796354+0000", 2024-09-14T09:09:21.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00028646999999999999 2024-09-14T09:09:21.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:21.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.800348+0000", 2024-09-14T09:09:21.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039943119999999999 2024-09-14T09:09:21.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:21.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801690+0000", 2024-09-14T09:09:21.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013415090000000001 2024-09-14T09:09:21.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:21.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801771+0000", 2024-09-14T09:09:21.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1678e-05 2024-09-14T09:09:21.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:21.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801900+0000", 2024-09-14T09:09:21.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000128978 2024-09-14T09:09:21.934 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.934 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:21.934 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.934 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62163 3.e 3:713ab431:::rbd_data.1112a10502fe.0000000000000198:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:21.934 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:21.934 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.6838496769999995, 2024-09-14T09:09:21.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.597552682, 2024-09-14T09:09:21.934 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:21.934 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:21.934 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:21.935 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:21.935 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:21.935 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:21.935 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62163 2024-09-14T09:09:21.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.935 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:21.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:21.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:21.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:21.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:21.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:21.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211735+0000", 2024-09-14T09:09:21.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1110000000000002e-06 2024-09-14T09:09:21.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:21.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211744+0000", 2024-09-14T09:09:21.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0790000000000007e-06 2024-09-14T09:09:21.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:21.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211765+0000", 2024-09-14T09:09:21.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1114000000000001e-05 2024-09-14T09:09:21.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211775+0000", 2024-09-14T09:09:21.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0033e-05 2024-09-14T09:09:21.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211847+0000", 2024-09-14T09:09:21.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1503999999999998e-05 2024-09-14T09:09:21.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211857+0000", 2024-09-14T09:09:21.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0378e-05 2024-09-14T09:09:21.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799140+0000", 2024-09-14T09:09:21.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.58728279100000003 2024-09-14T09:09:21.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:21.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799289+0000", 2024-09-14T09:09:21.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000148966 2024-09-14T09:09:21.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:21.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809285+0000", 2024-09-14T09:09:21.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099967059999999993 2024-09-14T09:09:21.941 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.941 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:21.941 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.941 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63582 3.2 3:467f2009:::rbd_data.1112a10502fe.00000000000001a1:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:21.941 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:21.941 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.60865656, 2024-09-14T09:09:21.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51869012999999997, 2024-09-14T09:09:21.941 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:21.941 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:21.941 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:21.941 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:21.942 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:21.942 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:21.942 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63582 2024-09-14T09:09:21.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.942 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:21.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:21.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:21.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:21.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:21.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:21.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286928+0000", 2024-09-14T09:09:21.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.812e-06 2024-09-14T09:09:21.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:21.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286936+0000", 2024-09-14T09:09:21.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2390000000000002e-06 2024-09-14T09:09:21.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:21.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286955+0000", 2024-09-14T09:09:21.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8853000000000001e-05 2024-09-14T09:09:21.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286972+0000", 2024-09-14T09:09:21.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7365000000000001e-05 2024-09-14T09:09:21.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287052+0000", 2024-09-14T09:09:21.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9491000000000002e-05 2024-09-14T09:09:21.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287063+0000", 2024-09-14T09:09:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1620999999999999e-05 2024-09-14T09:09:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796696+0000", 2024-09-14T09:09:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50963256999999995 2024-09-14T09:09:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796847+0000", 2024-09-14T09:09:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015126899999999999 2024-09-14T09:09:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.805616+0000", 2024-09-14T09:09:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087689099999999996 2024-09-14T09:09:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63586 3.3 3.d4e49b03 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.6085721790000003, 2024-09-14T09:09:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50188935099999998, 2024-09-14T09:09:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63586 2024-09-14T09:09:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:21.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:21.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:21.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287011+0000", 2024-09-14T09:09:21.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.61e-07 2024-09-14T09:09:21.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:21.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287014+0000", 2024-09-14T09:09:21.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3900000000000002e-06 2024-09-14T09:09:21.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:21.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287023+0000", 2024-09-14T09:09:21.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3380000000000005e-06 2024-09-14T09:09:21.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287029+0000", 2024-09-14T09:09:21.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0079999999999999e-06 2024-09-14T09:09:21.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287087+0000", 2024-09-14T09:09:21.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8322000000000002e-05 2024-09-14T09:09:21.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287096+0000", 2024-09-14T09:09:21.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8580000000000006e-06 2024-09-14T09:09:21.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788891+0000", 2024-09-14T09:09:21.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50179498499999997 2024-09-14T09:09:21.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:21.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788900+0000", 2024-09-14T09:09:21.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.789e-06 2024-09-14T09:09:21.951 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.951 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:21.951 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.951 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60363 3.1d 3:b8b44067:::rbd_data.1112a10502fe.000000000000018b:head [stat,delete] snapc 21=[21] RETRY=12 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:21.951 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:21.951 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.1078504410000001, 2024-09-14T09:09:21.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268612690000001, 2024-09-14T09:09:21.952 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:21.952 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:21.952 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:21.952 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:21.952 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:21.952 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:21.952 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60363 2024-09-14T09:09:21.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.952 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:21.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:21.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:21.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:21.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:21.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:21.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787733+0000", 2024-09-14T09:09:21.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.314e-06 2024-09-14T09:09:21.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:21.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787739+0000", 2024-09-14T09:09:21.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5300000000000004e-06 2024-09-14T09:09:21.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:21.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787750+0000", 2024-09-14T09:09:21.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1251e-05 2024-09-14T09:09:21.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:21.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0739999999999993e-06 2024-09-14T09:09:21.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787827+0000", 2024-09-14T09:09:21.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8861000000000004e-05 2024-09-14T09:09:21.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:09:21.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787836+0000", 2024-09-14T09:09:21.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1339999999999993e-06 2024-09-14T09:09:21.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789335+0000", 2024-09-14T09:09:21.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014988289999999999 2024-09-14T09:09:21.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789343+0000", 2024-09-14T09:09:21.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6639999999999998e-06 2024-09-14T09:09:21.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799170+0000", 2024-09-14T09:09:21.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098272500000001 2024-09-14T09:09:21.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:21.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799377+0000", 2024-09-14T09:09:21.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000207126 2024-09-14T09:09:21.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:21.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814593+0000", 2024-09-14T09:09:21.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015216235999999999 2024-09-14T09:09:21.957 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.957 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:21.957 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.957 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63565 3.1d 3:bdc63b28:::rbd_data.1112a10502fe.000000000000016d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=9 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:21.958 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:21.958 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.1078046500000003, 2024-09-14T09:09:21.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0271114539999999, 2024-09-14T09:09:21.958 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:21.958 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:21.958 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:21.958 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:21.958 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:21.958 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:21.958 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63565 2024-09-14T09:09:21.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.958 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:21.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:21.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:21.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:21.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:21.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:21.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:21.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6899999999999998e-07 2024-09-14T09:09:21.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:21.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787781+0000", 2024-09-14T09:09:21.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8909999999999999e-06 2024-09-14T09:09:21.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:21.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787787+0000", 2024-09-14T09:09:21.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3230000000000003e-06 2024-09-14T09:09:21.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787793+0000", 2024-09-14T09:09:21.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-09-14T09:09:21.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789455+0000", 2024-09-14T09:09:21.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001661596 2024-09-14T09:09:21.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789463+0000", 2024-09-14T09:09:21.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4889999999999995e-06 2024-09-14T09:09:21.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800115+0000", 2024-09-14T09:09:21.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0106512670000001 2024-09-14T09:09:21.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:21.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800334+0000", 2024-09-14T09:09:21.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000219213 2024-09-14T09:09:21.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:09:21.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800651+0000", 2024-09-14T09:09:21.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00031765500000000002 2024-09-14T09:09:21.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:21.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.811875+0000", 2024-09-14T09:09:21.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011224032 2024-09-14T09:09:21.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:21.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814665+0000", 2024-09-14T09:09:21.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002789606 2024-09-14T09:09:21.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:21.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814742+0000", 2024-09-14T09:09:21.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6916999999999996e-05 2024-09-14T09:09:21.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:21.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814889+0000", 2024-09-14T09:09:21.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014725799999999999 2024-09-14T09:09:21.964 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.964 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:21.964 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.964 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:67113 3.1d 3:bba7fe0d:::rbd_data.1112a10502fe.00000000000001bf:head [stat,delete] snapc 21=[21] RETRY=4 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:21.964 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:21.964 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.1070437919999998, 2024-09-14T09:09:21.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0265995649999999, 2024-09-14T09:09:21.965 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:21.965 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:21.965 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:21.965 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:21.965 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:21.965 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:21.965 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 67113 2024-09-14T09:09:21.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.965 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:21.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:21.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:21.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:21.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:21.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:21.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:21.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:09:21.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:21.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788543+0000", 2024-09-14T09:09:21.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-09-14T09:09:21.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:21.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788552+0000", 2024-09-14T09:09:21.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:09:21.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788559+0000", 2024-09-14T09:09:21.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:09:21.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789489+0000", 2024-09-14T09:09:21.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00092982199999999996 2024-09-14T09:09:21.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789497+0000", 2024-09-14T09:09:21.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6299999999999998e-06 2024-09-14T09:09:21.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801068+0000", 2024-09-14T09:09:21.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0115709530000001 2024-09-14T09:09:21.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:21.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801240+0000", 2024-09-14T09:09:21.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017276600000000001 2024-09-14T09:09:21.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:21.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815138+0000", 2024-09-14T09:09:21.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013897856 2024-09-14T09:09:21.969 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.969 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:21.969 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.970 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73412 3.1d 3:be4606c3:::rbd_data.1112a10502fe.00000000000001f2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:21.970 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:21.970 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.1070126800000004, 2024-09-14T09:09:21.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026815928, 2024-09-14T09:09:21.970 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:21.970 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:21.970 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:21.970 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:21.970 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:21.970 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:21.970 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73412 2024-09-14T09:09:21.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.970 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:21.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:21.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:21.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:21.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:21.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:21.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:21.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5699999999999998e-07 2024-09-14T09:09:21.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:21.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788572+0000", 2024-09-14T09:09:21.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2809999999999998e-06 2024-09-14T09:09:21.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:21.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788579+0000", 2024-09-14T09:09:21.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5629999999999997e-06 2024-09-14T09:09:21.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788584+0000", 2024-09-14T09:09:21.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1710000000000001e-06 2024-09-14T09:09:21.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789521+0000", 2024-09-14T09:09:21.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00093657400000000002 2024-09-14T09:09:21.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789528+0000", 2024-09-14T09:09:21.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5719999999999997e-06 2024-09-14T09:09:21.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801631+0000", 2024-09-14T09:09:21.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0121023229999999 2024-09-14T09:09:21.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:21.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801792+0000", 2024-09-14T09:09:21.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016174000000000001 2024-09-14T09:09:21.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:21.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815386+0000", 2024-09-14T09:09:21.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013593246999999999 2024-09-14T09:09:21.974 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.975 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:21.975 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.975 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:77244 3.1d 3:b801be19:::rbd_data.1112a10502fe.0000000000000204:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:21.975 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:21.975 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.9251484340000005, 2024-09-14T09:09:21.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.84519277100000001, 2024-09-14T09:09:21.975 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:21.975 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:21.975 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:21.975 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:21.975 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:21.975 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:21.976 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 77244 2024-09-14T09:09:21.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.976 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:21.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:21.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:21.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:21.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:21.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:21.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970436+0000", 2024-09-14T09:09:21.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.511e-06 2024-09-14T09:09:21.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:21.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970441+0000", 2024-09-14T09:09:21.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0470000000000001e-06 2024-09-14T09:09:21.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:21.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970453+0000", 2024-09-14T09:09:21.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2629999999999999e-05 2024-09-14T09:09:21.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970461+0000", 2024-09-14T09:09:21.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6850000000000001e-06 2024-09-14T09:09:21.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970524+0000", 2024-09-14T09:09:21.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3332999999999998e-05 2024-09-14T09:09:21.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970544+0000", 2024-09-14T09:09:21.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9731000000000001e-05 2024-09-14T09:09:21.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802188+0000", 2024-09-14T09:09:21.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.83164380000000004 2024-09-14T09:09:21.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:21.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:09:21.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015411999999999999 2024-09-14T09:09:21.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:21.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815627+0000", 2024-09-14T09:09:21.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013284914 2024-09-14T09:09:21.980 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.980 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:21.980 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.980 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:79796 3.1d 3:bc22caaf:::rbd_data.1112a10502fe.000000000000020c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:21.980 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:21.980 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.8038397479999997, 2024-09-14T09:09:21.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72411694299999996, 2024-09-14T09:09:21.980 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:21.980 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:21.980 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:21.980 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:21.980 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:21.981 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:21.981 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 79796 2024-09-14T09:09:21.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.981 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:21.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:21.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:21.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:21.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:21.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:21.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091745+0000", 2024-09-14T09:09:21.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2000000000000001e-06 2024-09-14T09:09:21.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:21.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091752+0000", 2024-09-14T09:09:21.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-09-14T09:09:21.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:21.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091772+0000", 2024-09-14T09:09:21.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9822000000000001e-05 2024-09-14T09:09:21.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091791+0000", 2024-09-14T09:09:21.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9236e-05 2024-09-14T09:09:21.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091882+0000", 2024-09-14T09:09:21.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0783000000000001e-05 2024-09-14T09:09:21.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091892+0000", 2024-09-14T09:09:21.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7999999999999993e-06 2024-09-14T09:09:21.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802744+0000", 2024-09-14T09:09:21.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.710851868 2024-09-14T09:09:21.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:21.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802902+0000", 2024-09-14T09:09:21.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015814900000000001 2024-09-14T09:09:21.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:21.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815860+0000", 2024-09-14T09:09:21.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012957605000000001 2024-09-14T09:09:21.985 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.985 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:21.985 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.985 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80904 3.1d 3:be0e7f3d:::rbd_data.1112a10502fe.0000000000000214:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:21.985 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:21.985 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.7237539010000003, 2024-09-14T09:09:21.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64435178100000001, 2024-09-14T09:09:21.985 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:21.986 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:21.986 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:21.986 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:21.986 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:21.986 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:21.986 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80904 2024-09-14T09:09:21.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.986 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:21.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:21.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:21.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:21.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:21.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:21.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171831+0000", 2024-09-14T09:09:21.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0729999999999999e-06 2024-09-14T09:09:21.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:21.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171839+0000", 2024-09-14T09:09:21.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9179999999999994e-06 2024-09-14T09:09:21.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:21.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171857+0000", 2024-09-14T09:09:21.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8957000000000002e-05 2024-09-14T09:09:21.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171867+0000", 2024-09-14T09:09:21.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7100000000000002e-06 2024-09-14T09:09:21.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171957+0000", 2024-09-14T09:09:21.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9932999999999994e-05 2024-09-14T09:09:21.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171974+0000", 2024-09-14T09:09:21.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6988999999999999e-05 2024-09-14T09:09:21.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803301+0000", 2024-09-14T09:09:21.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63132648599999996 2024-09-14T09:09:21.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:21.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803482+0000", 2024-09-14T09:09:21.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000181607 2024-09-14T09:09:21.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:21.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816180+0000", 2024-09-14T09:09:21.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012698108 2024-09-14T09:09:21.990 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.990 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:21.990 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.990 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80964 3.1d 3:be42e20f:::rbd_data.1112a10502fe.0000000000000219:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:21.990 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:21.990 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.7181183339999997, 2024-09-14T09:09:21.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63896829799999999, 2024-09-14T09:09:21.991 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:21.991 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:21.991 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:21.991 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:21.991 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:21.991 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:21.991 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80964 2024-09-14T09:09:21.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.991 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:21.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:21.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:21.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:21.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:21.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:21.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177466+0000", 2024-09-14T09:09:21.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6610000000000001e-06 2024-09-14T09:09:21.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:21.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177472+0000", 2024-09-14T09:09:21.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3029999999999996e-06 2024-09-14T09:09:21.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:21.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177490+0000", 2024-09-14T09:09:21.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8099000000000001e-05 2024-09-14T09:09:21.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177499+0000", 2024-09-14T09:09:21.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:09:21.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177560+0000", 2024-09-14T09:09:21.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1334000000000006e-05 2024-09-14T09:09:21.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177578+0000", 2024-09-14T09:09:21.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8434999999999999e-05 2024-09-14T09:09:21.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803910+0000", 2024-09-14T09:09:21.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62633190699999997 2024-09-14T09:09:21.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:21.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.806612+0000", 2024-09-14T09:09:21.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002702257 2024-09-14T09:09:21.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:21.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816432+0000", 2024-09-14T09:09:21.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098199370000000008 2024-09-14T09:09:21.995 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.996 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:21.996 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:21.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.996 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83321 3.1d 3:bb24b47b:::rbd_data.1112a10502fe.0000000000000223:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:21.996 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:21.996 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.6036646599999997, 2024-09-14T09:09:21.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52477628799999998, 2024-09-14T09:09:21.996 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:21.996 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:21.996 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:21.996 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:21.996 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:21.996 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:21.996 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83321 2024-09-14T09:09:21.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.997 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:21.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:21.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:21.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:21.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:21.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:21.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:21.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291920+0000", 2024-09-14T09:09:21.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.888e-06 2024-09-14T09:09:21.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:21.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291926+0000", 2024-09-14T09:09:21.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6059999999999999e-06 2024-09-14T09:09:21.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:21.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291943+0000", 2024-09-14T09:09:21.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6813e-05 2024-09-14T09:09:21.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:21.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291952+0000", 2024-09-14T09:09:21.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7439999999999996e-06 2024-09-14T09:09:21.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:21.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292023+0000", 2024-09-14T09:09:21.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1320000000000002e-05 2024-09-14T09:09:21.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:21.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:21.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:21.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292030+0000", 2024-09-14T09:09:21.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4219999999999997e-06 2024-09-14T09:09:22.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807221+0000", 2024-09-14T09:09:22.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51519140699999999 2024-09-14T09:09:22.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807406+0000", 2024-09-14T09:09:22.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018532800000000001 2024-09-14T09:09:22.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816694+0000", 2024-09-14T09:09:22.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092877600000000008 2024-09-14T09:09:22.001 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.001 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.001 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.001 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83358 3.1d 3:bb230e23:::rbd_data.1112a10502fe.000000000000022b:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:22.001 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:22.001 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.6021447699999998, 2024-09-14T09:09:22.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52374808900000003, 2024-09-14T09:09:22.001 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:22.001 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:22.001 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:22.002 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:22.002 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:22.002 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:22.002 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83358 2024-09-14T09:09:22.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.002 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:22.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:22.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:22.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:22.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:22.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:22.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293439+0000", 2024-09-14T09:09:22.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5899999999999995e-07 2024-09-14T09:09:22.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:22.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293443+0000", 2024-09-14T09:09:22.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9309999999999999e-06 2024-09-14T09:09:22.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:22.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293457+0000", 2024-09-14T09:09:22.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3944999999999999e-05 2024-09-14T09:09:22.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:22.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293466+0000", 2024-09-14T09:09:22.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4319999999999999e-06 2024-09-14T09:09:22.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293530+0000", 2024-09-14T09:09:22.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3860000000000002e-05 2024-09-14T09:09:22.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:22.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293540+0000", 2024-09-14T09:09:22.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0107e-05 2024-09-14T09:09:22.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809096+0000", 2024-09-14T09:09:22.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51555587800000002 2024-09-14T09:09:22.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809265+0000", 2024-09-14T09:09:22.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000169092 2024-09-14T09:09:22.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817186+0000", 2024-09-14T09:09:22.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079209850000000002 2024-09-14T09:09:22.006 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.006 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.006 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.006 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83361 3.1d 3:bd571564:::rbd_data.1112a10502fe.000000000000022c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:22.006 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:22.007 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.6018266939999997, 2024-09-14T09:09:22.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52373873100000001, 2024-09-14T09:09:22.007 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:22.007 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:22.007 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:22.007 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:22.007 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:22.007 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:22.007 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83361 2024-09-14T09:09:22.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.007 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:22.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:22.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:22.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:22.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:22.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:22.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293757+0000", 2024-09-14T09:09:22.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8000000000000004e-07 2024-09-14T09:09:22.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:22.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293762+0000", 2024-09-14T09:09:22.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8019999999999997e-06 2024-09-14T09:09:22.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:22.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293775+0000", 2024-09-14T09:09:22.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2884000000000001e-05 2024-09-14T09:09:22.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:22.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293783+0000", 2024-09-14T09:09:22.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:09:22.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293849+0000", 2024-09-14T09:09:22.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5859999999999996e-05 2024-09-14T09:09:22.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:22.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293861+0000", 2024-09-14T09:09:22.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2238999999999999e-05 2024-09-14T09:09:22.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809680+0000", 2024-09-14T09:09:22.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51581856800000003 2024-09-14T09:09:22.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809844+0000", 2024-09-14T09:09:22.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016441200000000001 2024-09-14T09:09:22.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817494+0000", 2024-09-14T09:09:22.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076502360000000004 2024-09-14T09:09:22.011 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.012 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.012 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.012 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.012 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.012 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:22.013 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #29, image image_client.0-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent30 2024-09-14T09:09:22.014 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:22.015+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:22.014 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:09:22.024 INFO:teuthology.orchestra.run.smithi148.stdout:4946 write 0x9e32200 thru 0x9e36218 (0x4019 bytes) 2024-09-14T09:09:22.026 INFO:teuthology.orchestra.run.smithi148.stdout:4947 read 0xb7a0e00 thru 0xb7aa895 (0x9a96 bytes) 2024-09-14T09:09:22.029 INFO:teuthology.orchestra.run.smithi148.stdout:4948 read 0x2344200 thru 0x234f4c4 (0xb2c5 bytes) 2024-09-14T09:09:22.033 INFO:teuthology.orchestra.run.smithi148.stdout:4949 read 0x1d35800 thru 0x1d392a4 (0x3aa5 bytes) 2024-09-14T09:09:22.034 INFO:teuthology.orchestra.run.smithi148.stdout:4951 write 0x9568e00 thru 0x957581c (0xca1d bytes) 2024-09-14T09:09:22.036 INFO:teuthology.orchestra.run.smithi148.stdout:4955 write 0x875c400 thru 0x8760835 (0x4436 bytes) 2024-09-14T09:09:22.037 INFO:teuthology.orchestra.run.smithi148.stdout:4958 punch from 0x5a5e800 to 0x5a67000, (0x8800 bytes) 2024-09-14T09:09:22.114 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:22.116+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:22.170 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:22.170 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:22.170 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:09:22.170 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:22.179 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:09:22.220 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:22.222+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:22.316 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:22.318+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:22.333 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:22.333 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:22.342 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:09:22.388 INFO:teuthology.orchestra.run.smithi148.stdout:4959 read 0x22f000 thru 0x230776 (0x1777 bytes) 2024-09-14T09:09:22.389 INFO:teuthology.orchestra.run.smithi148.stdout:4962 read 0x3928a00 thru 0x3934d47 (0xc348 bytes) 2024-09-14T09:09:22.394 INFO:teuthology.orchestra.run.smithi148.stdout:4965 trunc from 0xdaf2400 to 0xc694a00 2024-09-14T09:09:22.416 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:22.418+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:22.489 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:22.489 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:22.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:22.489 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:22.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.489 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2265 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4034560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:22.489 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:22.489 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.627568144000001, 2024-09-14T09:09:22.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073974829000000006, 2024-09-14T09:09:22.489 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2265 2024-09-14T09:09:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862542+0000", 2024-09-14T09:09:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:09:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862543+0000", 2024-09-14T09:09:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.81e-06 2024-09-14T09:09:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862549+0000", 2024-09-14T09:09:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8850000000000004e-06 2024-09-14T09:09:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862554+0000", 2024-09-14T09:09:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5279999999999997e-06 2024-09-14T09:09:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936318+0000", 2024-09-14T09:09:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073764422999999996 2024-09-14T09:09:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936412+0000", 2024-09-14T09:09:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3801000000000005e-05 2024-09-14T09:09:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936516+0000", 2024-09-14T09:09:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000104007 2024-09-14T09:09:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2266 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4096000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.627550280000001, 2024-09-14T09:09:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074208332000000002, 2024-09-14T09:09:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2266 2024-09-14T09:09:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862738+0000", 2024-09-14T09:09:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017920300000000001 2024-09-14T09:09:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862744+0000", 2024-09-14T09:09:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3000000000000001e-06 2024-09-14T09:09:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862753+0000", 2024-09-14T09:09:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8179999999999999e-06 2024-09-14T09:09:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862785+0000", 2024-09-14T09:09:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1949000000000002e-05 2024-09-14T09:09:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936556+0000", 2024-09-14T09:09:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073770268999999999 2024-09-14T09:09:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936657+0000", 2024-09-14T09:09:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101387 2024-09-14T09:09:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936767+0000", 2024-09-14T09:09:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110406 2024-09-14T09:09:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2267 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4157440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.627311698, 2024-09-14T09:09:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074200918000000005, 2024-09-14T09:09:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2267 2024-09-14T09:09:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863416+0000", 2024-09-14T09:09:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000618492 2024-09-14T09:09:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863421+0000", 2024-09-14T09:09:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1359999999999996e-06 2024-09-14T09:09:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863434+0000", 2024-09-14T09:09:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2291e-05 2024-09-14T09:09:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863444+0000", 2024-09-14T09:09:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9769999999999995e-06 2024-09-14T09:09:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936808+0000", 2024-09-14T09:09:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073364051999999999 2024-09-14T09:09:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936892+0000", 2024-09-14T09:09:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4641999999999994e-05 2024-09-14T09:09:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936999+0000", 2024-09-14T09:09:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106328 2024-09-14T09:09:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2329 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 106496~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.626583089, 2024-09-14T09:09:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074180251000000003, 2024-09-14T09:09:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2329 2024-09-14T09:09:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864203+0000", 2024-09-14T09:09:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000677015 2024-09-14T09:09:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864208+0000", 2024-09-14T09:09:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.972e-06 2024-09-14T09:09:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864221+0000", 2024-09-14T09:09:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2683e-05 2024-09-14T09:09:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864229+0000", 2024-09-14T09:09:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0809999999999994e-06 2024-09-14T09:09:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937430+0000", 2024-09-14T09:09:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073201231000000005 2024-09-14T09:09:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937513+0000", 2024-09-14T09:09:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2652999999999996e-05 2024-09-14T09:09:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937707+0000", 2024-09-14T09:09:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000193616 2024-09-14T09:09:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2331 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 229376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.625765592, 2024-09-14T09:09:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.07400843, 2024-09-14T09:09:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2331 2024-09-14T09:09:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868104+0000", 2024-09-14T09:09:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003760453 2024-09-14T09:09:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868109+0000", 2024-09-14T09:09:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9339999999999997e-06 2024-09-14T09:09:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868119+0000", 2024-09-14T09:09:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5389999999999996e-06 2024-09-14T09:09:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868126+0000", 2024-09-14T09:09:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4499999999999998e-06 2024-09-14T09:09:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938065+0000", 2024-09-14T09:09:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069938809000000005 2024-09-14T09:09:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938148+0000", 2024-09-14T09:09:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3171999999999996e-05 2024-09-14T09:09:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938352+0000", 2024-09-14T09:09:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020407300000000001 2024-09-14T09:09:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2380 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3239936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.610740563999997, 2024-09-14T09:09:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073985913, 2024-09-14T09:09:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2380 2024-09-14T09:09:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879697+0000", 2024-09-14T09:09:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032864100000000001 2024-09-14T09:09:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879702+0000", 2024-09-14T09:09:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.578e-06 2024-09-14T09:09:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879716+0000", 2024-09-14T09:09:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.413e-05 2024-09-14T09:09:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879724+0000", 2024-09-14T09:09:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.559e-06 2024-09-14T09:09:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953155+0000", 2024-09-14T09:09:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073431221000000005 2024-09-14T09:09:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953247+0000", 2024-09-14T09:09:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1662000000000004e-05 2024-09-14T09:09:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953355+0000", 2024-09-14T09:09:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010812200000000001 2024-09-14T09:09:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2501 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2850816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.592198260000004, 2024-09-14T09:09:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074288858999999999, 2024-09-14T09:09:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2501 2024-09-14T09:09:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.41e-07 2024-09-14T09:09:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897913+0000", 2024-09-14T09:09:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3090000000000001e-06 2024-09-14T09:09:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897918+0000", 2024-09-14T09:09:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8470000000000003e-06 2024-09-14T09:09:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897922+0000", 2024-09-14T09:09:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5549999999999996e-06 2024-09-14T09:09:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971872+0000", 2024-09-14T09:09:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073950057999999999 2024-09-14T09:09:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971958+0000", 2024-09-14T09:09:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5941999999999998e-05 2024-09-14T09:09:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972200+0000", 2024-09-14T09:09:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000241907 2024-09-14T09:09:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2502 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2912256~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.592159080000002, 2024-09-14T09:09:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074614080999999999, 2024-09-14T09:09:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2502 2024-09-14T09:09:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897951+0000", 2024-09-14T09:09:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:09:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897953+0000", 2024-09-14T09:09:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5670000000000002e-06 2024-09-14T09:09:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897970+0000", 2024-09-14T09:09:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6319000000000001e-05 2024-09-14T09:09:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897976+0000", 2024-09-14T09:09:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8760000000000002e-06 2024-09-14T09:09:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972245+0000", 2024-09-14T09:09:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074269186000000001 2024-09-14T09:09:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972333+0000", 2024-09-14T09:09:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7800999999999995e-05 2024-09-14T09:09:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972564+0000", 2024-09-14T09:09:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000231833 2024-09-14T09:09:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2503 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2973696~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.592125062999997, 2024-09-14T09:09:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074944286999999998, 2024-09-14T09:09:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2503 2024-09-14T09:09:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897985+0000", 2024-09-14T09:09:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999998e-07 2024-09-14T09:09:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897987+0000", 2024-09-14T09:09:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.401e-06 2024-09-14T09:09:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897999+0000", 2024-09-14T09:09:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1851999999999999e-05 2024-09-14T09:09:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898005+0000", 2024-09-14T09:09:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9789999999999998e-06 2024-09-14T09:09:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972609+0000", 2024-09-14T09:09:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074604217 2024-09-14T09:09:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972684+0000", 2024-09-14T09:09:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4777999999999995e-05 2024-09-14T09:09:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972929+0000", 2024-09-14T09:09:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024448100000000001 2024-09-14T09:09:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2504 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3035136~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.592096970999997, 2024-09-14T09:09:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075285131000000005, 2024-09-14T09:09:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2504 2024-09-14T09:09:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898078+0000", 2024-09-14T09:09:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5775e-05 2024-09-14T09:09:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898082+0000", 2024-09-14T09:09:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.49e-06 2024-09-14T09:09:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898092+0000", 2024-09-14T09:09:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0509999999999999e-05 2024-09-14T09:09:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898099+0000", 2024-09-14T09:09:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.81e-06 2024-09-14T09:09:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972971+0000", 2024-09-14T09:09:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074871788999999994 2024-09-14T09:09:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973055+0000", 2024-09-14T09:09:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3980000000000006e-05 2024-09-14T09:09:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973298+0000", 2024-09-14T09:09:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024277700000000001 2024-09-14T09:09:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2505 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3096576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.592000716000001, 2024-09-14T09:09:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075506668999999998, 2024-09-14T09:09:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2505 2024-09-14T09:09:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898370+0000", 2024-09-14T09:09:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026128799999999998 2024-09-14T09:09:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898374+0000", 2024-09-14T09:09:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8070000000000001e-06 2024-09-14T09:09:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898383+0000", 2024-09-14T09:09:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0520000000000007e-06 2024-09-14T09:09:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898389+0000", 2024-09-14T09:09:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2639999999999997e-06 2024-09-14T09:09:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973330+0000", 2024-09-14T09:09:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074940548999999995 2024-09-14T09:09:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973402+0000", 2024-09-14T09:09:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2556000000000001e-05 2024-09-14T09:09:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973615+0000", 2024-09-14T09:09:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000213153 2024-09-14T09:09:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2506 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3158016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.591707472000003, 2024-09-14T09:09:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075556110999999995, 2024-09-14T09:09:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2506 2024-09-14T09:09:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898497+0000", 2024-09-14T09:09:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4806e-05 2024-09-14T09:09:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898500+0000", 2024-09-14T09:09:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.54e-06 2024-09-14T09:09:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898507+0000", 2024-09-14T09:09:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1590000000000004e-06 2024-09-14T09:09:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898513+0000", 2024-09-14T09:09:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.015e-06 2024-09-14T09:09:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973656+0000", 2024-09-14T09:09:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075142929999999997 2024-09-14T09:09:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973742+0000", 2024-09-14T09:09:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5535e-05 2024-09-14T09:09:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973958+0000", 2024-09-14T09:09:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000216126 2024-09-14T09:09:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2507 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3219456~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.591578888000001, 2024-09-14T09:09:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075623459000000004, 2024-09-14T09:09:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2507 2024-09-14T09:09:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898761+0000", 2024-09-14T09:09:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000230614 2024-09-14T09:09:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898765+0000", 2024-09-14T09:09:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6629999999999999e-06 2024-09-14T09:09:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898774+0000", 2024-09-14T09:09:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6749999999999997e-06 2024-09-14T09:09:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898781+0000", 2024-09-14T09:09:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4640000000000003e-06 2024-09-14T09:09:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973985+0000", 2024-09-14T09:09:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075204101999999995 2024-09-14T09:09:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974063+0000", 2024-09-14T09:09:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7632000000000005e-05 2024-09-14T09:09:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974154+0000", 2024-09-14T09:09:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1309000000000003e-05 2024-09-14T09:09:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2508 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3280896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.591317125000003, 2024-09-14T09:09:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075576943999999993, 2024-09-14T09:09:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2508 2024-09-14T09:09:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899176+0000", 2024-09-14T09:09:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038340500000000002 2024-09-14T09:09:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899179+0000", 2024-09-14T09:09:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0290000000000001e-06 2024-09-14T09:09:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899186+0000", 2024-09-14T09:09:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8199999999999999e-06 2024-09-14T09:09:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899190+0000", 2024-09-14T09:09:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2050000000000004e-06 2024-09-14T09:09:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974193+0000", 2024-09-14T09:09:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075003632000000001 2024-09-14T09:09:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974276+0000", 2024-09-14T09:09:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2272000000000001e-05 2024-09-14T09:09:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974369+0000", 2024-09-14T09:09:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3580999999999997e-05 2024-09-14T09:09:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2509 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3342336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.590909508000003, 2024-09-14T09:09:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075356229999999996, 2024-09-14T09:09:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2509 2024-09-14T09:09:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:22.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899439+0000", 2024-09-14T09:09:22.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023958599999999999 2024-09-14T09:09:22.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:22.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899444+0000", 2024-09-14T09:09:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8790000000000002e-06 2024-09-14T09:09:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899455+0000", 2024-09-14T09:09:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0597999999999999e-05 2024-09-14T09:09:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899462+0000", 2024-09-14T09:09:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8179999999999998e-06 2024-09-14T09:09:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974400+0000", 2024-09-14T09:09:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074937999000000005 2024-09-14T09:09:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974465+0000", 2024-09-14T09:09:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5134000000000004e-05 2024-09-14T09:09:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974556+0000", 2024-09-14T09:09:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1216000000000002e-05 2024-09-14T09:09:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2510 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3403776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.590634115, 2024-09-14T09:09:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075295775999999995, 2024-09-14T09:09:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2510 2024-09-14T09:09:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899691+0000", 2024-09-14T09:09:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021615999999999999 2024-09-14T09:09:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899696+0000", 2024-09-14T09:09:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3200000000000001e-06 2024-09-14T09:09:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899704+0000", 2024-09-14T09:09:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9440000000000005e-06 2024-09-14T09:09:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899710+0000", 2024-09-14T09:09:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.584e-06 2024-09-14T09:09:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974594+0000", 2024-09-14T09:09:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074883551000000007 2024-09-14T09:09:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974679+0000", 2024-09-14T09:09:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5365999999999995e-05 2024-09-14T09:09:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974771+0000", 2024-09-14T09:09:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1850999999999999e-05 2024-09-14T09:09:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2511 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3465216~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.590387896999999, 2024-09-14T09:09:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075234668000000005, 2024-09-14T09:09:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2511 2024-09-14T09:09:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899951+0000", 2024-09-14T09:09:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000229569 2024-09-14T09:09:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899955+0000", 2024-09-14T09:09:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1010000000000002e-06 2024-09-14T09:09:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899971+0000", 2024-09-14T09:09:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5648999999999999e-05 2024-09-14T09:09:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899978+0000", 2024-09-14T09:09:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0829999999999998e-06 2024-09-14T09:09:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974806+0000", 2024-09-14T09:09:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074828092999999998 2024-09-14T09:09:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974870+0000", 2024-09-14T09:09:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4492000000000005e-05 2024-09-14T09:09:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974956+0000", 2024-09-14T09:09:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5680999999999995e-05 2024-09-14T09:09:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2512 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3526656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.590120352, 2024-09-14T09:09:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075178812999999997, 2024-09-14T09:09:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2512 2024-09-14T09:09:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904181+0000", 2024-09-14T09:09:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041919399999999999 2024-09-14T09:09:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904186+0000", 2024-09-14T09:09:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2390000000000002e-06 2024-09-14T09:09:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904199+0000", 2024-09-14T09:09:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2709e-05 2024-09-14T09:09:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904207+0000", 2024-09-14T09:09:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8150000000000006e-06 2024-09-14T09:09:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975000+0000", 2024-09-14T09:09:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.070793444999999997 2024-09-14T09:09:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975079+0000", 2024-09-14T09:09:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8480999999999996e-05 2024-09-14T09:09:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975168+0000", 2024-09-14T09:09:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9184000000000005e-05 2024-09-14T09:09:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:22840 3.15 3:a8cf3dc2:::rbd_header.1112a10502fe:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:09:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.9305473299999996, 2024-09-14T09:09:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.119998785, 2024-09-14T09:09:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:09:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:09:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 22840 2024-09-14T09:09:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:09:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:09:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642492+0000", 2024-09-14T09:09:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.082930276999999997 2024-09-14T09:09:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642495+0000", 2024-09-14T09:09:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9809999999999999e-06 2024-09-14T09:09:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642501+0000", 2024-09-14T09:09:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-09-14T09:09:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642506+0000", 2024-09-14T09:09:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6650000000000002e-06 2024-09-14T09:09:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679483+0000", 2024-09-14T09:09:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036977777000000003 2024-09-14T09:09:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679517+0000", 2024-09-14T09:09:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.345e-05 2024-09-14T09:09:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679561+0000", 2024-09-14T09:09:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3930999999999997e-05 2024-09-14T09:09:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:22857 3.15 3:a8cf3dc2:::rbd_header.1112a10502fe:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:09:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.7806534049999998, 2024-09-14T09:09:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.088427917999999994, 2024-09-14T09:09:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:09:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:09:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 22857 2024-09-14T09:09:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:09:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:09:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777685+0000", 2024-09-14T09:09:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.068229181999999999 2024-09-14T09:09:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777688+0000", 2024-09-14T09:09:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1980000000000001e-06 2024-09-14T09:09:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777695+0000", 2024-09-14T09:09:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:09:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777700+0000", 2024-09-14T09:09:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0919999999999997e-06 2024-09-14T09:09:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797735+0000", 2024-09-14T09:09:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0200351 2024-09-14T09:09:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797800+0000", 2024-09-14T09:09:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4305000000000002e-05 2024-09-14T09:09:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:22.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797884+0000", 2024-09-14T09:09:22.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4344000000000004e-05 2024-09-14T09:09:22.579 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.579 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.579 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.579 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:22.579 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:22.579 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:22.581 INFO:teuthology.orchestra.run.smithi148.stdout:4966 read 0x5e24200 thru 0x5e2cc74 (0x8a75 bytes) 2024-09-14T09:09:22.581 INFO:teuthology.orchestra.run.smithi148.stdout:4967 write 0x958ca00 thru 0x958ff89 (0x358a bytes) 2024-09-14T09:09:22.581 INFO:teuthology.orchestra.run.smithi148.stdout:4969 trunc from 0xc694a00 to 0x1747a00 2024-09-14T09:09:22.581 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:09:22.582 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:22.582+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:22.682 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:22.683+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:22.728 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:22.729 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:22.729 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:09:22.729 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:22.737 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:09:22.764 INFO:teuthology.orchestra.run.smithi148.stdout:4970 read 0xfda400 thru 0xfddcb4 (0x38b5 bytes) 2024-09-14T09:09:22.777 INFO:teuthology.orchestra.run.smithi148.stdout:4971 trunc from 0x1747a00 to 0x9b63c00 2024-09-14T09:09:22.782 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:22.784+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:22.787 INFO:teuthology.orchestra.run.smithi148.stdout:4972 write 0x1f1e600 thru 0x1f2b421 (0xce22 bytes) 2024-09-14T09:09:22.788 INFO:teuthology.orchestra.run.smithi148.stdout:4973 punch from 0x9af1400 to 0x9afc800, (0xb400 bytes) 2024-09-14T09:09:22.791 INFO:teuthology.orchestra.run.smithi148.stdout:4974 trunc from 0x9b63c00 to 0xc166600 2024-09-14T09:09:22.809 INFO:teuthology.orchestra.run.smithi148.stdout:4975 trunc from 0xc166600 to 0x8c32800 2024-09-14T09:09:22.852 INFO:teuthology.orchestra.run.smithi148.stdout:4977 write 0xe957200 thru 0xe958af5 (0x18f6 bytes) 2024-09-14T09:09:22.852 INFO:teuthology.orchestra.run.smithi148.stdout:4981 write 0xb7a1c00 thru 0xb7a802c (0x642d bytes) 2024-09-14T09:09:22.852 INFO:teuthology.orchestra.run.smithi148.stdout:4982 punch from 0x366a200 to 0x3677a00, (0xd800 bytes) 2024-09-14T09:09:22.852 INFO:teuthology.orchestra.run.smithi148.stdout:4983 write 0x140dc00 thru 0x1418e6f (0xb270 bytes) 2024-09-14T09:09:22.852 INFO:teuthology.orchestra.run.smithi148.stdout:4984 read 0x514dc00 thru 0x5156fc5 (0x93c6 bytes) 2024-09-14T09:09:22.852 INFO:teuthology.orchestra.run.smithi148.stdout:4985 write 0xab19a00 thru 0xab21f35 (0x8536 bytes) 2024-09-14T09:09:22.862 INFO:teuthology.orchestra.run.smithi148.stdout:4986 trunc from 0xe958c00 to 0x5f3d400 2024-09-14T09:09:22.884 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:22.885+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:22.894 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:22.894 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:22.894 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:22.894 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:22.894 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:22.899 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T09:09:22.903 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:09:22.989 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:22.991+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:23.053 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:23.053 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:23.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:23.053 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:23.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.053 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:987 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:23.053 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:23.053 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.194898027000001, 2024-09-14T09:09:23.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001359466, 2024-09-14T09:09:23.054 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:23.054 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:23.054 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:23.054 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:23.054 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:23.054 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:23.054 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 987 2024-09-14T09:09:23.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.054 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:23.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:23.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:23.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:23.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:23.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:23.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858333+0000", 2024-09-14T09:09:23.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.621e-06 2024-09-14T09:09:23.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:23.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858349+0000", 2024-09-14T09:09:23.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5758000000000001e-05 2024-09-14T09:09:23.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:23.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858366+0000", 2024-09-14T09:09:23.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7368e-05 2024-09-14T09:09:23.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:23.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858382+0000", 2024-09-14T09:09:23.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6039e-05 2024-09-14T09:09:23.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858441+0000", 2024-09-14T09:09:23.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8662999999999997e-05 2024-09-14T09:09:23.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858449+0000", 2024-09-14T09:09:23.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3960000000000006e-06 2024-09-14T09:09:23.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859682+0000", 2024-09-14T09:09:23.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001233096 2024-09-14T09:09:23.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:23.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859691+0000", 2024-09-14T09:09:23.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5250000000000005e-06 2024-09-14T09:09:23.058 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.058 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:23.058 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.058 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:988 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:23.058 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:23.058 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.194770157000001, 2024-09-14T09:09:23.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0012656799999999, 2024-09-14T09:09:23.059 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:23.059 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:23.059 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:23.059 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:23.059 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:23.059 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:23.059 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 988 2024-09-14T09:09:23.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.059 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:23.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:23.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:23.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:23.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:23.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:23.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858460+0000", 2024-09-14T09:09:23.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9999999999999997e-07 2024-09-14T09:09:23.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:23.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858463+0000", 2024-09-14T09:09:23.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7459999999999998e-06 2024-09-14T09:09:23.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:23.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858471+0000", 2024-09-14T09:09:23.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3900000000000004e-06 2024-09-14T09:09:23.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:23.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858478+0000", 2024-09-14T09:09:23.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7020000000000004e-06 2024-09-14T09:09:23.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859102+0000", 2024-09-14T09:09:23.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062419699999999995 2024-09-14T09:09:23.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859109+0000", 2024-09-14T09:09:23.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7419999999999997e-06 2024-09-14T09:09:23.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859718+0000", 2024-09-14T09:09:23.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006085629999999 2024-09-14T09:09:23.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:23.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859725+0000", 2024-09-14T09:09:23.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7399999999999998e-06 2024-09-14T09:09:23.063 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.063 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:23.063 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.063 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1003 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:23.063 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:23.063 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.19390692, 2024-09-14T09:09:23.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009495209999999, 2024-09-14T09:09:23.063 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:23.063 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:23.063 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:23.064 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:23.064 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:23.064 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:23.064 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1003 2024-09-14T09:09:23.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.064 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:23.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:23.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:23.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:23.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:23.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:23.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859323+0000", 2024-09-14T09:09:23.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3099999999999998e-07 2024-09-14T09:09:23.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:23.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859326+0000", 2024-09-14T09:09:23.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-06 2024-09-14T09:09:23.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:23.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859333+0000", 2024-09-14T09:09:23.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3300000000000001e-06 2024-09-14T09:09:23.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:23.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859339+0000", 2024-09-14T09:09:23.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6400000000000002e-06 2024-09-14T09:09:23.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859387+0000", 2024-09-14T09:09:23.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8448000000000001e-05 2024-09-14T09:09:23.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:09:23.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9540000000000004e-06 2024-09-14T09:09:23.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860260+0000", 2024-09-14T09:09:23.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000864921 2024-09-14T09:09:23.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:23.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860272+0000", 2024-09-14T09:09:23.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1993e-05 2024-09-14T09:09:23.067 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.067 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:23.067 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.067 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1004 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:23.068 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:23.068 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.193871345000002, 2024-09-14T09:09:23.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000947875, 2024-09-14T09:09:23.068 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:23.068 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:23.068 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:23.068 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:23.068 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:23.068 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:23.068 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1004 2024-09-14T09:09:23.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.068 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:23.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:23.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:23.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:23.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:23.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:23.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:23.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7199999999999999e-07 2024-09-14T09:09:23.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:23.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859361+0000", 2024-09-14T09:09:23.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.892e-06 2024-09-14T09:09:23.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:23.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859368+0000", 2024-09-14T09:09:23.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4370000000000004e-06 2024-09-14T09:09:23.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:23.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859373+0000", 2024-09-14T09:09:23.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6690000000000003e-06 2024-09-14T09:09:23.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859430+0000", 2024-09-14T09:09:23.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6456999999999998e-05 2024-09-14T09:09:23.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859434+0000", 2024-09-14T09:09:23.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8410000000000002e-06 2024-09-14T09:09:23.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860299+0000", 2024-09-14T09:09:23.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008650370000001 2024-09-14T09:09:23.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:23.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860306+0000", 2024-09-14T09:09:23.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0700000000000001e-06 2024-09-14T09:09:23.072 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.072 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:23.072 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.072 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1005 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:23.072 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:23.072 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.193847672, 2024-09-14T09:09:23.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009585480000001, 2024-09-14T09:09:23.072 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:23.073 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:23.073 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:23.073 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:23.073 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:23.073 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:23.073 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1005 2024-09-14T09:09:23.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.073 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:23.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:23.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:23.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:23.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:23.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:23.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:23.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9700000000000002e-07 2024-09-14T09:09:23.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:23.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859384+0000", 2024-09-14T09:09:23.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.024e-06 2024-09-14T09:09:23.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:23.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859390+0000", 2024-09-14T09:09:23.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7080000000000002e-06 2024-09-14T09:09:23.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:23.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:09:23.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8980000000000004e-06 2024-09-14T09:09:23.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859527+0000", 2024-09-14T09:09:23.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013228099999999999 2024-09-14T09:09:23.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859532+0000", 2024-09-14T09:09:23.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5899999999999998e-06 2024-09-14T09:09:23.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860330+0000", 2024-09-14T09:09:23.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0007973509999999 2024-09-14T09:09:23.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:23.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860340+0000", 2024-09-14T09:09:23.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0299000000000001e-05 2024-09-14T09:09:23.076 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.077 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:23.077 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.077 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1006 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:23.077 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:23.077 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.193824476, 2024-09-14T09:09:23.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001032039, 2024-09-14T09:09:23.077 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:23.077 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:23.077 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:23.077 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:23.077 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:23.077 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:23.078 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1006 2024-09-14T09:09:23.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.078 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:23.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:23.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:23.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:23.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:23.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:23.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:23.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6499999999999999e-07 2024-09-14T09:09:23.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:23.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859407+0000", 2024-09-14T09:09:23.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1160000000000002e-06 2024-09-14T09:09:23.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:23.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859413+0000", 2024-09-14T09:09:23.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8880000000000002e-06 2024-09-14T09:09:23.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:23.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859419+0000", 2024-09-14T09:09:23.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3550000000000004e-06 2024-09-14T09:09:23.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859558+0000", 2024-09-14T09:09:23.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000138942 2024-09-14T09:09:23.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859563+0000", 2024-09-14T09:09:23.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.665e-06 2024-09-14T09:09:23.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860427+0000", 2024-09-14T09:09:23.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008635299999999 2024-09-14T09:09:23.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:23.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860437+0000", 2024-09-14T09:09:23.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0078000000000001e-05 2024-09-14T09:09:23.081 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.081 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:23.082 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.082 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1045 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:23.082 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:23.082 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.193624996, 2024-09-14T09:09:23.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008612990000001, 2024-09-14T09:09:23.082 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:23.082 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:23.082 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:23.082 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:23.082 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:23.082 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:23.082 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1045 2024-09-14T09:09:23.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.083 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:23.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:23.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:23.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:23.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:23.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:23.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859605+0000", 2024-09-14T09:09:23.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6e-07 2024-09-14T09:09:23.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:23.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859606+0000", 2024-09-14T09:09:23.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8819999999999999e-06 2024-09-14T09:09:23.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:23.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859610+0000", 2024-09-14T09:09:23.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4290000000000001e-06 2024-09-14T09:09:23.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:23.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859612+0000", 2024-09-14T09:09:23.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6309999999999999e-06 2024-09-14T09:09:23.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859643+0000", 2024-09-14T09:09:23.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0224000000000001e-05 2024-09-14T09:09:23.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859647+0000", 2024-09-14T09:09:23.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9049999999999999e-06 2024-09-14T09:09:23.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860458+0000", 2024-09-14T09:09:23.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008111180000001 2024-09-14T09:09:23.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:23.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860466+0000", 2024-09-14T09:09:23.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:09:23.086 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.086 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:23.086 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.086 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1046 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:23.086 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:23.087 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.193611538999999, 2024-09-14T09:09:23.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000874262, 2024-09-14T09:09:23.087 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:23.087 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:23.087 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:23.087 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:23.087 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:23.087 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:23.087 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1046 2024-09-14T09:09:23.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.087 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:23.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:23.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:23.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:23.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:23.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:23.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:23.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:09:23.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:23.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859619+0000", 2024-09-14T09:09:23.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0559999999999999e-06 2024-09-14T09:09:23.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:23.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859622+0000", 2024-09-14T09:09:23.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0170000000000001e-06 2024-09-14T09:09:23.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:23.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859625+0000", 2024-09-14T09:09:23.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7209999999999999e-06 2024-09-14T09:09:23.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859666+0000", 2024-09-14T09:09:23.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1677000000000001e-05 2024-09-14T09:09:23.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859672+0000", 2024-09-14T09:09:23.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4609999999999999e-06 2024-09-14T09:09:23.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860485+0000", 2024-09-14T09:09:23.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000813505 2024-09-14T09:09:23.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:23.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860492+0000", 2024-09-14T09:09:23.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6159999999999998e-06 2024-09-14T09:09:23.091 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.091 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:23.091 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.091 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1047 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:23.091 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:23.091 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.193600204999999, 2024-09-14T09:09:23.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008950190000001, 2024-09-14T09:09:23.091 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:23.091 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:23.091 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:23.091 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:23.092 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:23.092 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:23.092 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1047 2024-09-14T09:09:23.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.092 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:23.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:23.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:23.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:23.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:23.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:23.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:23.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6600000000000003e-07 2024-09-14T09:09:23.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:23.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859631+0000", 2024-09-14T09:09:23.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5600000000000001e-06 2024-09-14T09:09:23.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:23.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859637+0000", 2024-09-14T09:09:23.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7309999999999998e-06 2024-09-14T09:09:23.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:23.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859641+0000", 2024-09-14T09:09:23.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0840000000000002e-06 2024-09-14T09:09:23.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859691+0000", 2024-09-14T09:09:23.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0587999999999997e-05 2024-09-14T09:09:23.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859696+0000", 2024-09-14T09:09:23.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8940000000000001e-06 2024-09-14T09:09:23.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860516+0000", 2024-09-14T09:09:23.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008200780000001 2024-09-14T09:09:23.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:23.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860524+0000", 2024-09-14T09:09:23.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8180000000000004e-06 2024-09-14T09:09:23.095 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.096 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:23.096 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.096 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1048 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:23.096 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:23.096 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.193568446, 2024-09-14T09:09:23.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008904780000001, 2024-09-14T09:09:23.096 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:23.096 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:23.096 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:23.096 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:23.096 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:23.096 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:23.097 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1048 2024-09-14T09:09:23.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.097 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:23.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:23.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:23.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:23.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:23.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:23.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:23.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4700000000000002e-07 2024-09-14T09:09:23.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:23.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859663+0000", 2024-09-14T09:09:23.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0420000000000001e-06 2024-09-14T09:09:23.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:23.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859669+0000", 2024-09-14T09:09:23.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8989999999999998e-06 2024-09-14T09:09:23.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:23.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859673+0000", 2024-09-14T09:09:23.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2209999999999999e-06 2024-09-14T09:09:23.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859719+0000", 2024-09-14T09:09:23.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5788000000000003e-05 2024-09-14T09:09:23.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859725+0000", 2024-09-14T09:09:23.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4770000000000002e-06 2024-09-14T09:09:23.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860544+0000", 2024-09-14T09:09:23.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008194669999999 2024-09-14T09:09:23.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:23.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860551+0000", 2024-09-14T09:09:23.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1369999999999996e-06 2024-09-14T09:09:23.100 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.100 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:23.101 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.101 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1088 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:23.101 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:23.101 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.193349608999998, 2024-09-14T09:09:23.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00073166, 2024-09-14T09:09:23.101 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:23.101 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:23.101 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:23.101 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:23.101 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:23.101 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:23.101 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1088 2024-09-14T09:09:23.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.102 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:23.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:23.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:23.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:23.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:23.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:23.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:23.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3700000000000001e-07 2024-09-14T09:09:23.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:23.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859882+0000", 2024-09-14T09:09:23.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.739e-06 2024-09-14T09:09:23.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:23.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859887+0000", 2024-09-14T09:09:23.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:09:23.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:23.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859892+0000", 2024-09-14T09:09:23.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7119999999999999e-06 2024-09-14T09:09:23.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859945+0000", 2024-09-14T09:09:23.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2762000000000001e-05 2024-09-14T09:09:23.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859950+0000", 2024-09-14T09:09:23.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-09-14T09:09:23.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860603+0000", 2024-09-14T09:09:23.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000653263 2024-09-14T09:09:23.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:23.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860611+0000", 2024-09-14T09:09:23.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-09-14T09:09:23.105 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.105 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:23.105 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.106 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1089 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:23.106 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:23.106 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.193331452999999, 2024-09-14T09:09:23.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000733943, 2024-09-14T09:09:23.106 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:23.106 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:23.106 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:23.106 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:23.106 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:23.106 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:23.106 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1089 2024-09-14T09:09:23.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.106 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:23.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:23.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:23.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:23.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:23.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:23.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:23.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3000000000000002e-07 2024-09-14T09:09:23.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:23.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859900+0000", 2024-09-14T09:09:23.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9199999999999998e-06 2024-09-14T09:09:23.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:23.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859906+0000", 2024-09-14T09:09:23.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0889999999999996e-06 2024-09-14T09:09:23.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:23.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859911+0000", 2024-09-14T09:09:23.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6419999999999998e-06 2024-09-14T09:09:23.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860010+0000", 2024-09-14T09:09:23.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8956000000000006e-05 2024-09-14T09:09:23.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860014+0000", 2024-09-14T09:09:23.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.741e-06 2024-09-14T09:09:23.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860627+0000", 2024-09-14T09:09:23.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00061277 2024-09-14T09:09:23.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:23.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860632+0000", 2024-09-14T09:09:23.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:09:23.110 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.110 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:23.110 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.110 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1090 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:23.110 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:23.110 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.193311780999998, 2024-09-14T09:09:23.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000740763, 2024-09-14T09:09:23.111 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:23.111 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:23.111 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:23.111 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:23.111 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:23.111 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:23.111 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1090 2024-09-14T09:09:23.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.111 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:23.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:23.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:23.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:23.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:23.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:23.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859918+0000", 2024-09-14T09:09:23.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5199999999999998e-07 2024-09-14T09:09:23.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:23.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859920+0000", 2024-09-14T09:09:23.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9240000000000001e-06 2024-09-14T09:09:23.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:23.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859925+0000", 2024-09-14T09:09:23.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3929999999999999e-06 2024-09-14T09:09:23.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:23.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859929+0000", 2024-09-14T09:09:23.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4769999999999999e-06 2024-09-14T09:09:23.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860034+0000", 2024-09-14T09:09:23.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010549500000000001 2024-09-14T09:09:23.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860039+0000", 2024-09-14T09:09:23.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5700000000000003e-06 2024-09-14T09:09:23.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860650+0000", 2024-09-14T09:09:23.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006116119999999 2024-09-14T09:09:23.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:23.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860658+0000", 2024-09-14T09:09:23.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:09:23.115 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.115 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:23.115 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.115 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60374 3.14 3.6e2cd654 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:23.115 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:23.115 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 6.5634334709999997, 2024-09-14T09:09:23.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3129433100000001, 2024-09-14T09:09:23.116 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:23.116 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:23.116 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:23.116 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:23.116 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:23.116 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:23.116 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60374 2024-09-14T09:09:23.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.116 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:23.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:23.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:23.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:23.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:23.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:23.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:23.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2100000000000002e-07 2024-09-14T09:09:23.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:23.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489799+0000", 2024-09-14T09:09:23.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3530000000000002e-06 2024-09-14T09:09:23.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:23.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489808+0000", 2024-09-14T09:09:23.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2e-06 2024-09-14T09:09:23.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:23.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489813+0000", 2024-09-14T09:09:23.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3249999999999998e-06 2024-09-14T09:09:23.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489866+0000", 2024-09-14T09:09:23.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3074e-05 2024-09-14T09:09:23.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489875+0000", 2024-09-14T09:09:23.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2760000000000006e-06 2024-09-14T09:09:23.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801379+0000", 2024-09-14T09:09:23.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.31150346200000001 2024-09-14T09:09:23.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801387+0000", 2024-09-14T09:09:23.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.038e-06 2024-09-14T09:09:23.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802728+0000", 2024-09-14T09:09:23.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013415569999999 2024-09-14T09:09:23.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:23.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802739+0000", 2024-09-14T09:09:23.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0604e-05 2024-09-14T09:09:23.120 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.120 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:23.120 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.120 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62179 3.14 3.78cf1974 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:23.121 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:09:23.121 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 6.5634028420000003, 2024-09-14T09:09:23.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3129429109999999, 2024-09-14T09:09:23.121 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:23.121 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:23.121 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:23.121 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:23.121 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:23.121 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:23.121 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62179 2024-09-14T09:09:23.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.121 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:23.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:23.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:09:23.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:23.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:09:23.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:23.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489827+0000", 2024-09-14T09:09:23.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4300000000000003e-07 2024-09-14T09:09:23.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:23.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489829+0000", 2024-09-14T09:09:23.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2129999999999998e-06 2024-09-14T09:09:23.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:23.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489836+0000", 2024-09-14T09:09:23.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0360000000000001e-06 2024-09-14T09:09:23.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:23.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489841+0000", 2024-09-14T09:09:23.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0710000000000002e-06 2024-09-14T09:09:23.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489905+0000", 2024-09-14T09:09:23.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3578999999999996e-05 2024-09-14T09:09:23.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489913+0000", 2024-09-14T09:09:23.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2269999999999993e-06 2024-09-14T09:09:23.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801412+0000", 2024-09-14T09:09:23.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.311498989 2024-09-14T09:09:23.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801419+0000", 2024-09-14T09:09:23.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1400000000000002e-06 2024-09-14T09:09:23.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802761+0000", 2024-09-14T09:09:23.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013414620000001 2024-09-14T09:09:23.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:23.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802769+0000", 2024-09-14T09:09:23.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6510000000000007e-06 2024-09-14T09:09:23.125 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.126 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:23.126 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.126 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63551 3.14 3.88ccb734 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:23.126 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:09:23.126 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 6.5633712119999998, 2024-09-14T09:09:23.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.312941181, 2024-09-14T09:09:23.126 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:23.126 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:23.126 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:23.126 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:23.126 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:23.126 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:23.126 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63551 2024-09-14T09:09:23.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.127 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:23.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:23.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:09:23.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:23.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:09:23.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:23.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489859+0000", 2024-09-14T09:09:23.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9200000000000001e-07 2024-09-14T09:09:23.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:23.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489862+0000", 2024-09-14T09:09:23.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9629999999999998e-06 2024-09-14T09:09:23.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:23.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489868+0000", 2024-09-14T09:09:23.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3890000000000002e-06 2024-09-14T09:09:23.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:23.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489875+0000", 2024-09-14T09:09:23.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7950000000000002e-06 2024-09-14T09:09:23.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489939+0000", 2024-09-14T09:09:23.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4704999999999998e-05 2024-09-14T09:09:23.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489949+0000", 2024-09-14T09:09:23.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7799999999999995e-06 2024-09-14T09:09:23.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801447+0000", 2024-09-14T09:09:23.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.311497527 2024-09-14T09:09:23.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801454+0000", 2024-09-14T09:09:23.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1080000000000004e-06 2024-09-14T09:09:23.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802790+0000", 2024-09-14T09:09:23.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013364330000001 2024-09-14T09:09:23.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:23.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802799+0000", 2024-09-14T09:09:23.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8890000000000008e-06 2024-09-14T09:09:23.130 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.131 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:23.131 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.131 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:68716 3.14 3.96fe1934 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:23.131 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:09:23.131 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 6.5118007450000004, 2024-09-14T09:09:23.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2614012569999999, 2024-09-14T09:09:23.131 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:23.131 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:23.131 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:23.131 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:23.131 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:23.132 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:23.132 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 68716 2024-09-14T09:09:23.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.132 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:23.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:23.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:09:23.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:23.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:09:23.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:23.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541429+0000", 2024-09-14T09:09:23.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8899999999999998e-07 2024-09-14T09:09:23.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:23.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541433+0000", 2024-09-14T09:09:23.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7330000000000001e-06 2024-09-14T09:09:23.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:23.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541442+0000", 2024-09-14T09:09:23.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.346e-06 2024-09-14T09:09:23.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:23.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541449+0000", 2024-09-14T09:09:23.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.579e-06 2024-09-14T09:09:23.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541839+0000", 2024-09-14T09:09:23.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038993699999999998 2024-09-14T09:09:23.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541849+0000", 2024-09-14T09:09:23.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0217999999999999e-05 2024-09-14T09:09:23.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801480+0000", 2024-09-14T09:09:23.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.25963061399999998 2024-09-14T09:09:23.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801486+0000", 2024-09-14T09:09:23.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.776e-06 2024-09-14T09:09:23.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802821+0000", 2024-09-14T09:09:23.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00133435 2024-09-14T09:09:23.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:23.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802830+0000", 2024-09-14T09:09:23.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9150000000000002e-06 2024-09-14T09:09:23.136 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.136 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:23.136 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.136 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:69492 3.14 3.4a93714 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:23.136 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:09:23.137 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 6.4512610490000002, 2024-09-14T09:09:23.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2008910690000001, 2024-09-14T09:09:23.137 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:23.137 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:23.137 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:23.137 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:23.137 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:23.137 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:23.137 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 69492 2024-09-14T09:09:23.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.137 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:23.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:23.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:09:23.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:23.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:09:23.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:23.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601969+0000", 2024-09-14T09:09:23.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3099999999999996e-07 2024-09-14T09:09:23.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:23.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601973+0000", 2024-09-14T09:09:23.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5899999999999999e-06 2024-09-14T09:09:23.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:23.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601983+0000", 2024-09-14T09:09:23.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098999999999999e-05 2024-09-14T09:09:23.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:23.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601989+0000", 2024-09-14T09:09:23.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0209999999999996e-06 2024-09-14T09:09:23.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.602066+0000", 2024-09-14T09:09:23.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7075000000000003e-05 2024-09-14T09:09:23.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.602075+0000", 2024-09-14T09:09:23.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8389999999999996e-06 2024-09-14T09:09:23.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801512+0000", 2024-09-14T09:09:23.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.199437225 2024-09-14T09:09:23.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801519+0000", 2024-09-14T09:09:23.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9970000000000001e-06 2024-09-14T09:09:23.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802851+0000", 2024-09-14T09:09:23.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001331711 2024-09-14T09:09:23.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:23.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802859+0000", 2024-09-14T09:09:23.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6810000000000004e-06 2024-09-14T09:09:23.141 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.141 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:23.141 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.142 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:72035 3.14 3.1cba9a34 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:23.142 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:09:23.142 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 6.3319331610000003, 2024-09-14T09:09:23.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0815917340000001, 2024-09-14T09:09:23.142 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:23.142 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:23.142 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:23.142 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:23.142 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:23.142 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:23.142 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 72035 2024-09-14T09:09:23.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.143 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:23.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:23.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:09:23.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:23.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:09:23.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:23.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721297+0000", 2024-09-14T09:09:23.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5199999999999996e-07 2024-09-14T09:09:23.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:23.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721301+0000", 2024-09-14T09:09:23.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7790000000000002e-06 2024-09-14T09:09:23.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:23.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721309+0000", 2024-09-14T09:09:23.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8019999999999998e-06 2024-09-14T09:09:23.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:23.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721315+0000", 2024-09-14T09:09:23.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:09:23.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721367+0000", 2024-09-14T09:09:23.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2280000000000001e-05 2024-09-14T09:09:23.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721376+0000", 2024-09-14T09:09:23.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5439999999999999e-06 2024-09-14T09:09:23.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801545+0000", 2024-09-14T09:09:23.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.080169952000000003 2024-09-14T09:09:23.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801552+0000", 2024-09-14T09:09:23.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8390000000000001e-06 2024-09-14T09:09:23.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802879+0000", 2024-09-14T09:09:23.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001326846 2024-09-14T09:09:23.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:23.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802888+0000", 2024-09-14T09:09:23.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6330000000000002e-06 2024-09-14T09:09:23.147 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.147 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:23.148 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.148 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73403 3.14 3.87b99f94 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:23.148 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:23.148 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 6.2896584999999998, 2024-09-14T09:09:23.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0393459899999999, 2024-09-14T09:09:23.148 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:23.148 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:23.148 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:23.148 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:23.149 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:23.149 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:23.149 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73403 2024-09-14T09:09:23.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.149 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:23.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:23.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:23.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:23.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:23.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:23.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:23.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:23.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9200000000000001e-07 2024-09-14T09:09:23.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:23.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763574+0000", 2024-09-14T09:09:23.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6510000000000001e-06 2024-09-14T09:09:23.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:23.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763582+0000", 2024-09-14T09:09:23.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2579999999999995e-06 2024-09-14T09:09:23.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:23.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763592+0000", 2024-09-14T09:09:23.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0193e-05 2024-09-14T09:09:23.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763643+0000", 2024-09-14T09:09:23.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0862000000000002e-05 2024-09-14T09:09:23.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763654+0000", 2024-09-14T09:09:23.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0890000000000001e-05 2024-09-14T09:09:23.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801577+0000", 2024-09-14T09:09:23.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037923074000000001 2024-09-14T09:09:23.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:23.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801584+0000", 2024-09-14T09:09:23.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0060000000000003e-06 2024-09-14T09:09:23.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:23.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802908+0000", 2024-09-14T09:09:23.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013235149999999 2024-09-14T09:09:23.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:23.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:23.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:23.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802917+0000", 2024-09-14T09:09:23.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9490000000000002e-06 2024-09-14T09:09:23.153 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.154 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:23.154 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.154 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:23.154 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:23.154 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:23.156 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:09:23.157 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:23.157+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:23.157 INFO:teuthology.orchestra.run.smithi148.stdout:4988 write 0xa6a6200 thru 0xa6aaa78 (0x4879 bytes) 2024-09-14T09:09:23.157 INFO:teuthology.orchestra.run.smithi148.stdout:4991 read 0x727b200 thru 0x727e54a (0x334b bytes) 2024-09-14T09:09:23.157 INFO:teuthology.orchestra.run.smithi148.stdout:4992 trunc from 0xa6aac00 to 0xcd9d000 2024-09-14T09:09:23.158 INFO:teuthology.orchestra.run.smithi148.stdout:4993 write 0x7a2c00 thru 0x7ac63c (0x9a3d bytes) 2024-09-14T09:09:23.158 INFO:teuthology.orchestra.run.smithi148.stdout:4994 punch from 0xaeaf800 to 0xaebc200, (0xca00 bytes) 2024-09-14T09:09:23.158 INFO:teuthology.orchestra.run.smithi148.stdout:4995 read 0x2d0400 thru 0x2d218d (0x1d8e bytes) 2024-09-14T09:09:23.158 INFO:teuthology.orchestra.run.smithi148.stdout:4996 read 0xcc77800 thru 0xcc80d8b (0x958c bytes) 2024-09-14T09:09:23.158 INFO:teuthology.orchestra.run.smithi148.stdout:4997 trunc from 0xcd9d000 to 0x2409a00 2024-09-14T09:09:23.158 INFO:teuthology.orchestra.run.smithi148.stdout:4999 read 0x2374e00 thru 0x237cdcd (0x7fce bytes) 2024-09-14T09:09:23.158 INFO:teuthology.orchestra.run.smithi148.stdout:5001 write 0x500c000 thru 0x501aa7d (0xea7e bytes) 2024-09-14T09:09:23.158 INFO:teuthology.orchestra.run.smithi148.stdout:5002 read 0x6ee00 thru 0x7dae8 (0xece9 bytes) 2024-09-14T09:09:23.158 INFO:teuthology.orchestra.run.smithi148.stdout:5003 read 0x25dac00 thru 0x25dd669 (0x2a6a bytes) 2024-09-14T09:09:23.169 INFO:teuthology.orchestra.run.smithi148.stdout:5006 write 0xa15aa00 thru 0xa15e33d (0x393e bytes) 2024-09-14T09:09:23.170 INFO:teuthology.orchestra.run.smithi148.stdout:5007 write 0x24b4000 thru 0x24bcc41 (0x8c42 bytes) 2024-09-14T09:09:23.170 INFO:teuthology.orchestra.run.smithi148.stdout:5008 punch from 0x2e20a00 to 0x2e26c00, (0x6200 bytes) 2024-09-14T09:09:23.170 INFO:teuthology.orchestra.run.smithi148.stdout:5009 write 0x814d600 thru 0x815a3dc (0xcddd bytes) 2024-09-14T09:09:23.174 INFO:teuthology.orchestra.run.smithi148.stdout:5010 trunc from 0xa15e400 to 0x7068600 2024-09-14T09:09:23.198 INFO:teuthology.orchestra.run.smithi148.stdout:5011 write 0x615e00 thru 0x616758 (0x959 bytes) 2024-09-14T09:09:23.200 INFO:teuthology.orchestra.run.smithi148.stdout:5015 read 0x3d15800 thru 0x3d203c2 (0xabc3 bytes) 2024-09-14T09:09:23.200 INFO:teuthology.orchestra.run.smithi148.stdout:5017 punch from 0x1715c00 to 0x1717800, (0x1c00 bytes) 2024-09-14T09:09:23.200 INFO:teuthology.orchestra.run.smithi148.stdout:5019 read 0x54c0e00 thru 0x54ce24f (0xd450 bytes) 2024-09-14T09:09:23.227 INFO:teuthology.orchestra.run.smithi148.stdout:5020 write 0xb8bf400 thru 0xb8cdb76 (0xe777 bytes) 2024-09-14T09:09:23.228 INFO:teuthology.orchestra.run.smithi148.stdout:5021 write 0x96e0e00 thru 0x96e8cfb (0x7efc bytes) 2024-09-14T09:09:23.228 INFO:teuthology.orchestra.run.smithi148.stdout:5022 read 0x234c800 thru 0x235bfaa (0xf7ab bytes) 2024-09-14T09:09:23.228 INFO:teuthology.orchestra.run.smithi148.stdout:5023 punch from 0xa625e00 to 0xa629e00, (0x4000 bytes) 2024-09-14T09:09:23.229 INFO:teuthology.orchestra.run.smithi148.stdout:5024 read 0xcdbe00 thru 0xcdd4b5 (0x16b6 bytes) 2024-09-14T09:09:23.240 INFO:teuthology.orchestra.run.smithi148.stdout:5027 trunc from 0xb8cdc00 to 0x467fa00 2024-09-14T09:09:23.256 INFO:teuthology.orchestra.run.smithi148.stdout:5029 trunc from 0x467fa00 to 0x49d5200 2024-09-14T09:09:23.256 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:23.258+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:23.269 INFO:teuthology.orchestra.run.smithi148.stdout:5031 read 0x221a800 thru 0x221c252 (0x1a53 bytes) 2024-09-14T09:09:23.270 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:09:23.274 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:23.274 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:23.274 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:09:23.275 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:23.275 INFO:teuthology.orchestra.run.smithi148.stdout:5032 punch from 0x2ea2400 to 0x2ea3600, (0x1200 bytes) 2024-09-14T09:09:23.284 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:09:23.294 INFO:teuthology.orchestra.run.smithi148.stdout:5033 write 0xc27e200 thru 0xc28cafc (0xe8fd bytes) 2024-09-14T09:09:23.299 INFO:teuthology.orchestra.run.smithi148.stdout:5034 punch from 0x4784200 to 0x478d600, (0x9400 bytes) 2024-09-14T09:09:23.300 INFO:teuthology.orchestra.run.smithi148.stdout:5036 write 0x6638a00 thru 0x663cca2 (0x42a3 bytes) 2024-09-14T09:09:23.307 INFO:teuthology.orchestra.run.smithi148.stdout:5037 trunc from 0xc28cc00 to 0x6308800 2024-09-14T09:09:23.324 INFO:teuthology.orchestra.run.smithi148.stdout:5038 clone 32 order 20 su 524288 sc 13 2024-09-14T09:09:23.357 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:23.358+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:23.391 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:23.391 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:23.391 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:23.391 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:23.391 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:23.393 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:23.393 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:23.400 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:09:23.410 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:23.410 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:23.426 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:09:23.426 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:09:23.442 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:23.442 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:23.459 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:23.459 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:23.475 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:23.475 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:23.484 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:23.485+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:23.543 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:23.543 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:23.551 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:09:23.593 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:23.594+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:23.660 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:23.663+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:23.695 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:23.695 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:23.703 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:09:23.761 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:23.762+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:23.807 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:23.807 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:23.815 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:09:23.891 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is set 2024-09-14T09:09:23.900 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:23.901+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:23.962 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:23.964+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:23.963 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:23.964 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:23.973 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:09:23.996 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone31 from 0x6308800 (overlap 0x1747a00) to 0xdf7c00 2024-09-14T09:09:24.062 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:24.063+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:24.134 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:24.134 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:24.143 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:24.185 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:24.186+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:24.264 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:24.265+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:24.308 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:24.308 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:24.317 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:09:24.403 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:24.404+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:24.466 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:24.468+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:24.469 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:24.470 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:24.474 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 1] out_osds: [] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 2] 2024-09-14T09:09:24.474 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:09:24.474 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-14T09:09:24.475 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T09:09:24.479 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:09:24.566 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:24.568+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:24.625 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:24.626 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:24.635 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:09:24.679 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:24.681+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:24.744 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:24.744 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:24.753 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:09:24.766 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #30, image image_client.0-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent31 2024-09-14T09:09:24.781 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:09:24.782 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:24.782 INFO:teuthology.orchestra.run.smithi116.stdout: "epoch": 93, 2024-09-14T09:09:24.782 INFO:teuthology.orchestra.run.smithi116.stdout: "fsid": "c991ac1c-978d-48b3-a540-4d3d4755e125", 2024-09-14T09:09:24.782 INFO:teuthology.orchestra.run.smithi116.stdout: "created": "2024-09-14T09:07:16.982473+0000", 2024-09-14T09:09:24.782 INFO:teuthology.orchestra.run.smithi116.stdout: "modified": "2024-09-14T09:09:23.881744+0000", 2024-09-14T09:09:24.782 INFO:teuthology.orchestra.run.smithi116.stdout: "last_up_change": "2024-09-14T09:09:15.843683+0000", 2024-09-14T09:09:24.782 INFO:teuthology.orchestra.run.smithi116.stdout: "last_in_change": "2024-09-14T09:08:58.845087+0000", 2024-09-14T09:09:24.782 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T09:09:24.782 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_num": 5806080, 2024-09-14T09:09:24.782 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_set": [ 2024-09-14T09:09:24.783 INFO:teuthology.orchestra.run.smithi116.stdout: "nodeep-scrub", 2024-09-14T09:09:24.783 INFO:teuthology.orchestra.run.smithi116.stdout: "noscrub", 2024-09-14T09:09:24.783 INFO:teuthology.orchestra.run.smithi116.stdout: "pglog_hardlimit", 2024-09-14T09:09:24.783 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snapdirs", 2024-09-14T09:09:24.783 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_deletes", 2024-09-14T09:09:24.783 INFO:teuthology.orchestra.run.smithi116.stdout: "sortbitwise" 2024-09-14T09:09:24.783 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:24.783 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_version": 6, 2024-09-14T09:09:24.783 INFO:teuthology.orchestra.run.smithi116.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T09:09:24.783 INFO:teuthology.orchestra.run.smithi116.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T09:09:24.783 INFO:teuthology.orchestra.run.smithi116.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T09:09:24.784 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_snapshot": "", 2024-09-14T09:09:24.784 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_max": 3, 2024-09-14T09:09:24.784 INFO:teuthology.orchestra.run.smithi116.stdout: "max_osd": 6, 2024-09-14T09:09:24.784 INFO:teuthology.orchestra.run.smithi116.stdout: "require_min_compat_client": "luminous", 2024-09-14T09:09:24.784 INFO:teuthology.orchestra.run.smithi116.stdout: "min_compat_client": "jewel", 2024-09-14T09:09:24.784 INFO:teuthology.orchestra.run.smithi116.stdout: "require_osd_release": "squid", 2024-09-14T09:09:24.784 INFO:teuthology.orchestra.run.smithi116.stdout: "allow_crimson": false, 2024-09-14T09:09:24.784 INFO:teuthology.orchestra.run.smithi116.stdout: "pools": [ 2024-09-14T09:09:24.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.784 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 1, 2024-09-14T09:09:24.784 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": ".mgr", 2024-09-14T09:09:24.784 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:29.194849+0000", 2024-09-14T09:09:24.785 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 1, 2024-09-14T09:09:24.785 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool", 2024-09-14T09:09:24.785 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:09:24.785 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:09:24.785 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:09:24.785 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:09:24.785 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:09:24.785 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:09:24.785 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:09:24.785 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:09:24.785 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:09:24.785 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:09:24.786 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:09:24.786 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 1, 2024-09-14T09:09:24.786 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 1, 2024-09-14T09:09:24.786 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 1, 2024-09-14T09:09:24.786 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 1, 2024-09-14T09:09:24.786 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 1, 2024-09-14T09:09:24.786 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:09:24.786 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:09:24.786 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:09:24.786 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:09:24.786 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:09:24.786 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:09:24.786 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:09:24.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.787 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "16", 2024-09-14T09:09:24.787 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:09:24.787 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:09:24.787 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:09:24.787 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:09:24.787 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:09:24.787 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 0, 2024-09-14T09:09:24.787 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 0, 2024-09-14T09:09:24.787 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:09:24.787 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:09:24.787 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:09:24.787 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:09:24.788 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:09:24.788 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:09:24.788 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:09:24.788 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:09:24.788 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:09:24.788 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:09:24.788 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:09:24.788 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:09:24.788 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:09:24.788 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:09:24.788 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:09:24.788 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:09:24.789 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:09:24.789 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:09:24.789 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:09:24.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.789 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:09:24.789 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:09:24.789 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:09:24.789 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:09:24.789 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:09:24.789 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:09:24.789 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:09:24.790 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:09:24.790 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:09:24.790 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:09:24.790 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:09:24.790 INFO:teuthology.orchestra.run.smithi116.stdout: "options": { 2024-09-14T09:09:24.790 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_max": 32, 2024-09-14T09:09:24.790 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_min": 1 2024-09-14T09:09:24.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.790 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:09:24.790 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": {} 2024-09-14T09:09:24.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.790 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:09:24.791 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:09:24.791 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 6.059999942779541, 2024-09-14T09:09:24.791 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 6.059999942779541, 2024-09-14T09:09:24.791 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 0.33000001311302185, 2024-09-14T09:09:24.791 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 2, 2024-09-14T09:09:24.791 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 2, 2024-09-14T09:09:24.791 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:09:24.791 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:09:24.791 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:09:24.791 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.792 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 2, 2024-09-14T09:09:24.792 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": "rbd", 2024-09-14T09:09:24.792 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:33.684592+0000", 2024-09-14T09:09:24.792 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 8193, 2024-09-14T09:09:24.792 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T09:09:24.792 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:09:24.792 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:09:24.792 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:09:24.792 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:09:24.792 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:09:24.793 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:09:24.793 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:09:24.793 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:09:24.793 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:09:24.793 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:09:24.793 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:09:24.793 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 8, 2024-09-14T09:09:24.793 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 8, 2024-09-14T09:09:24.793 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 8, 2024-09-14T09:09:24.793 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 8, 2024-09-14T09:09:24.793 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 8, 2024-09-14T09:09:24.794 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:09:24.794 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:09:24.794 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:09:24.794 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:09:24.794 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:09:24.794 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:09:24.794 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:09:24.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.794 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "20", 2024-09-14T09:09:24.794 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:09:24.794 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:09:24.795 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:09:24.795 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:09:24.795 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:09:24.795 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 2, 2024-09-14T09:09:24.795 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 20, 2024-09-14T09:09:24.795 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:09:24.795 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:09:24.795 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:09:24.795 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:09:24.795 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:09:24.795 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:09:24.795 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:09:24.795 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:09:24.796 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:09:24.796 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:09:24.796 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:09:24.796 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:09:24.796 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:09:24.796 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:09:24.796 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:09:24.796 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:09:24.796 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:09:24.796 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:09:24.797 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:09:24.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.797 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:09:24.797 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:09:24.797 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:09:24.797 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:09:24.797 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:09:24.797 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:09:24.797 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:09:24.797 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:09:24.797 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:09:24.797 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:09:24.798 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:09:24.798 INFO:teuthology.orchestra.run.smithi116.stdout: "options": {}, 2024-09-14T09:09:24.798 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:09:24.798 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd": {} 2024-09-14T09:09:24.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.798 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:09:24.798 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:09:24.798 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 2.25, 2024-09-14T09:09:24.798 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 2.25, 2024-09-14T09:09:24.798 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 1, 2024-09-14T09:09:24.798 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 2.25, 2024-09-14T09:09:24.799 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 2.25, 2024-09-14T09:09:24.799 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:09:24.799 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:09:24.799 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:09:24.799 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.799 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 3, 2024-09-14T09:09:24.799 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": "pool_client.0", 2024-09-14T09:09:24.799 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:43.363542+0000", 2024-09-14T09:09:24.799 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 8193, 2024-09-14T09:09:24.800 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T09:09:24.800 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:09:24.800 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:09:24.800 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:09:24.800 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:09:24.800 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:09:24.800 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:09:24.800 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:09:24.800 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:09:24.800 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:09:24.800 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:09:24.800 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:09:24.801 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 32, 2024-09-14T09:09:24.801 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 32, 2024-09-14T09:09:24.801 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 32, 2024-09-14T09:09:24.801 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 32, 2024-09-14T09:09:24.801 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 32, 2024-09-14T09:09:24.801 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:09:24.801 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:09:24.801 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:09:24.801 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:09:24.801 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:09:24.801 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:09:24.802 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:09:24.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.802 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "93", 2024-09-14T09:09:24.802 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:09:24.802 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:09:24.802 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:09:24.802 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:09:24.802 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:09:24.802 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 34, 2024-09-14T09:09:24.802 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 93, 2024-09-14T09:09:24.802 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:09:24.802 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:09:24.802 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:09:24.803 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:09:24.803 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:09:24.803 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:09:24.803 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:09:24.803 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:09:24.803 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:09:24.803 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:09:24.803 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:09:24.803 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:09:24.803 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:09:24.803 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:09:24.804 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:09:24.804 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:09:24.804 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:09:24.804 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:09:24.804 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:09:24.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.804 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:09:24.804 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:09:24.804 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:09:24.804 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:09:24.804 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:09:24.805 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:09:24.805 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:09:24.805 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:09:24.805 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:09:24.805 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:09:24.805 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:09:24.805 INFO:teuthology.orchestra.run.smithi116.stdout: "options": {}, 2024-09-14T09:09:24.805 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:09:24.805 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd": {} 2024-09-14T09:09:24.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.805 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:09:24.806 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:09:24.806 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 1.8799999952316284, 2024-09-14T09:09:24.806 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 1.8799999952316284, 2024-09-14T09:09:24.806 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 1, 2024-09-14T09:09:24.806 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 1.8799999952316284, 2024-09-14T09:09:24.806 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 1.8799999952316284, 2024-09-14T09:09:24.806 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:09:24.806 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:09:24.806 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:09:24.806 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.806 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.806 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:24.807 INFO:teuthology.orchestra.run.smithi116.stdout: "osds": [ 2024-09-14T09:09:24.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.807 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 0, 2024-09-14T09:09:24.807 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "b3c13086-1183-454b-8e62-3aec9b69cdf5", 2024-09-14T09:09:24.807 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:24.807 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:24.807 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 0.3199462890625, 2024-09-14T09:09:24.807 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:09:24.807 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:09:24.807 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:09:24.807 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 11, 2024-09-14T09:09:24.807 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 78, 2024-09-14T09:09:24.808 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:09:24.808 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:24.808 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:24.808 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.808 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.808 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6816", 2024-09-14T09:09:24.808 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:24.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.808 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.808 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6817", 2024-09-14T09:09:24.809 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:24.809 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.809 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.809 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:24.809 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.809 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.809 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6818", 2024-09-14T09:09:24.809 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:24.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.810 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.810 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6819", 2024-09-14T09:09:24.810 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:24.810 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.810 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.810 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:24.810 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.810 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.810 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6822", 2024-09-14T09:09:24.810 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:24.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.811 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.811 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6823", 2024-09-14T09:09:24.811 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:24.811 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.811 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.811 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:24.811 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.811 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.812 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6820", 2024-09-14T09:09:24.812 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:24.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.812 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.812 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6821", 2024-09-14T09:09:24.812 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:24.812 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.812 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.812 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6817/1856142608", 2024-09-14T09:09:24.812 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6819/1856142608", 2024-09-14T09:09:24.813 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6823/1856142608", 2024-09-14T09:09:24.813 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6821/1856142608", 2024-09-14T09:09:24.813 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:24.813 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:24.813 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:24.813 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.813 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 1, 2024-09-14T09:09:24.813 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "8ee6a373-9d0d-4cd2-96f4-9673de96f546", 2024-09-14T09:09:24.813 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:24.814 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:24.814 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:09:24.814 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:09:24.814 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:09:24.814 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:09:24.814 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 13, 2024-09-14T09:09:24.814 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 90, 2024-09-14T09:09:24.814 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:09:24.814 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:24.814 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:24.814 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.815 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.815 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6800", 2024-09-14T09:09:24.815 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:24.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.815 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.815 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6801", 2024-09-14T09:09:24.815 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:24.815 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.815 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.816 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:24.816 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.816 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.816 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6802", 2024-09-14T09:09:24.816 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:24.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.816 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.816 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6803", 2024-09-14T09:09:24.816 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:24.816 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.816 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.817 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:24.817 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.817 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.817 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6806", 2024-09-14T09:09:24.817 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:24.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.817 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.817 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6807", 2024-09-14T09:09:24.817 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:24.818 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.818 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.818 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:24.818 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.818 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.818 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6804", 2024-09-14T09:09:24.818 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:24.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.818 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.818 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6805", 2024-09-14T09:09:24.819 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:24.819 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.819 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.819 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6801/3469105275", 2024-09-14T09:09:24.819 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6803/3469105275", 2024-09-14T09:09:24.819 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6807/3469105275", 2024-09-14T09:09:24.819 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6805/3469105275", 2024-09-14T09:09:24.819 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:24.819 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:24.819 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:24.819 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.820 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 2, 2024-09-14T09:09:24.820 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "958a9363-d751-49c3-9ec7-7330d377ee53", 2024-09-14T09:09:24.820 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:24.820 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:24.820 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 0.59710693359375, 2024-09-14T09:09:24.820 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:09:24.820 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 13, 2024-09-14T09:09:24.820 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 67, 2024-09-14T09:09:24.820 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 87, 2024-09-14T09:09:24.820 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 90, 2024-09-14T09:09:24.820 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 68, 2024-09-14T09:09:24.820 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:24.820 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:24.821 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.821 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.821 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6808", 2024-09-14T09:09:24.821 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:24.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.821 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.821 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6809", 2024-09-14T09:09:24.821 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:24.821 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.821 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.822 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:24.822 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.822 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.822 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6810", 2024-09-14T09:09:24.822 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:24.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.822 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.822 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6811", 2024-09-14T09:09:24.822 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:24.822 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.822 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.823 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:24.823 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.823 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.823 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6814", 2024-09-14T09:09:24.823 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:24.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.823 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.823 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6815", 2024-09-14T09:09:24.824 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:24.824 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.824 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.824 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:24.824 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.824 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.824 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6812", 2024-09-14T09:09:24.824 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:24.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.825 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.825 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6813", 2024-09-14T09:09:24.825 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:24.825 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.825 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.825 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6809/2050490698", 2024-09-14T09:09:24.825 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6811/2050490698", 2024-09-14T09:09:24.825 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6815/2050490698", 2024-09-14T09:09:24.825 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6813/2050490698", 2024-09-14T09:09:24.826 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:24.826 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:24.826 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:24.826 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.826 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 3, 2024-09-14T09:09:24.826 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "7fafd519-b2e9-498c-a409-f55cfe45a51a", 2024-09-14T09:09:24.826 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:24.826 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:24.826 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:09:24.827 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 0.2435760498046875, 2024-09-14T09:09:24.827 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:09:24.827 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:09:24.827 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:09:24.827 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 89, 2024-09-14T09:09:24.827 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:09:24.827 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:24.827 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:24.827 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.827 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.827 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6816", 2024-09-14T09:09:24.828 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:24.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.828 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.828 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6817", 2024-09-14T09:09:24.828 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:24.828 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.828 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.828 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:24.828 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.829 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.829 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6818", 2024-09-14T09:09:24.829 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:24.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.829 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.829 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6819", 2024-09-14T09:09:24.829 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:24.829 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.830 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.830 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:24.830 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.830 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.830 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6822", 2024-09-14T09:09:24.830 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:24.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.830 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.831 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6823", 2024-09-14T09:09:24.831 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:24.831 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.831 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.831 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:24.831 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.831 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.831 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6820", 2024-09-14T09:09:24.831 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:24.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.832 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.832 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6821", 2024-09-14T09:09:24.832 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:24.832 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.832 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.832 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6817/2855061278", 2024-09-14T09:09:24.832 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6819/2855061278", 2024-09-14T09:09:24.832 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6823/2855061278", 2024-09-14T09:09:24.833 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6821/2855061278", 2024-09-14T09:09:24.833 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:24.833 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:24.833 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:24.833 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.833 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 4, 2024-09-14T09:09:24.833 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "63d99552-5fea-4367-bf86-0addc8cceb98", 2024-09-14T09:09:24.833 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:24.834 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:24.834 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:09:24.834 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:09:24.834 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:09:24.834 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:09:24.834 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:09:24.834 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 89, 2024-09-14T09:09:24.834 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:09:24.834 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:24.834 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:24.834 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.835 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.835 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6808", 2024-09-14T09:09:24.835 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:24.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.835 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.835 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6809", 2024-09-14T09:09:24.835 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:24.835 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.835 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.836 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:24.836 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.836 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.836 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6810", 2024-09-14T09:09:24.836 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:24.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.836 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.836 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6811", 2024-09-14T09:09:24.836 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:24.837 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.837 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.837 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:24.837 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.837 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.837 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6814", 2024-09-14T09:09:24.837 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:24.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.837 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.838 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6815", 2024-09-14T09:09:24.838 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:24.838 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.838 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.838 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:24.838 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.838 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.838 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6812", 2024-09-14T09:09:24.838 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:24.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.839 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.839 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6813", 2024-09-14T09:09:24.839 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:24.839 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.839 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.839 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6809/369903047", 2024-09-14T09:09:24.839 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6811/369903047", 2024-09-14T09:09:24.839 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6815/369903047", 2024-09-14T09:09:24.839 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6813/369903047", 2024-09-14T09:09:24.839 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:24.840 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:24.840 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:24.840 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.840 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 5, 2024-09-14T09:09:24.840 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "e4bcb224-662f-4530-b477-c0dd9c4ddbf4", 2024-09-14T09:09:24.840 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:24.840 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:24.840 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:09:24.840 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:09:24.841 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:09:24.841 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:09:24.841 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:09:24.841 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 87, 2024-09-14T09:09:24.841 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:09:24.841 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:24.841 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:24.841 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.841 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.841 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6800", 2024-09-14T09:09:24.841 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:24.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.842 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.842 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6801", 2024-09-14T09:09:24.842 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:24.842 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.842 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.842 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:24.842 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.842 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.843 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6802", 2024-09-14T09:09:24.843 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:24.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.843 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.843 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6803", 2024-09-14T09:09:24.843 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:24.843 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.843 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.843 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:24.843 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.844 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.844 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6806", 2024-09-14T09:09:24.844 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:24.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.844 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.844 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6807", 2024-09-14T09:09:24.844 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:24.844 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.844 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.845 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:24.845 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:24.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.845 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:24.845 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6804", 2024-09-14T09:09:24.845 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:24.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.845 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:24.845 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6805", 2024-09-14T09:09:24.845 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:24.846 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.846 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.846 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6801/2878111293", 2024-09-14T09:09:24.846 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6803/2878111293", 2024-09-14T09:09:24.846 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6807/2878111293", 2024-09-14T09:09:24.846 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6805/2878111293", 2024-09-14T09:09:24.846 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:24.846 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:24.846 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:24.846 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:24.847 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.847 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:24.847 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_xinfo": [ 2024-09-14T09:09:24.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.847 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 0, 2024-09-14T09:09:24.847 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:24.847 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:24.847 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:24.847 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:24.847 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:24.847 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:24.757990+0000", 2024-09-14T09:09:24.847 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:09:24.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.848 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 1, 2024-09-14T09:09:24.848 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:24.848 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:24.848 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:24.848 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:24.848 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:24.848 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.277795+0000", 2024-09-14T09:09:24.848 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:09:24.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.849 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 2, 2024-09-14T09:09:24.849 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:24.849 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:24.849 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:24.849 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:24.849 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:24.849 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.290172+0000", 2024-09-14T09:09:24.849 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 68 2024-09-14T09:09:24.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.849 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 3, 2024-09-14T09:09:24.850 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:24.850 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:24.850 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:24.850 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:24.850 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:24.850 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.324594+0000", 2024-09-14T09:09:24.850 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:09:24.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.850 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 4, 2024-09-14T09:09:24.850 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:24.850 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:24.851 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:24.851 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:24.851 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:24.851 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:24.865136+0000", 2024-09-14T09:09:24.851 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:09:24.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:24.851 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 5, 2024-09-14T09:09:24.851 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:24.851 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:24.851 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:24.851 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:24.851 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:24.852 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.020572+0000", 2024-09-14T09:09:24.852 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:09:24.852 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.852 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:24.852 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap": [], 2024-09-14T09:09:24.852 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap_items": [], 2024-09-14T09:09:24.852 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap_primaries": [], 2024-09-14T09:09:24.852 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_temp": [], 2024-09-14T09:09:24.852 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_temp": [], 2024-09-14T09:09:24.852 INFO:teuthology.orchestra.run.smithi116.stdout: "blocklist": {}, 2024-09-14T09:09:24.852 INFO:teuthology.orchestra.run.smithi116.stdout: "range_blocklist": {}, 2024-09-14T09:09:24.852 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profiles": { 2024-09-14T09:09:24.853 INFO:teuthology.orchestra.run.smithi116.stdout: "default": { 2024-09-14T09:09:24.853 INFO:teuthology.orchestra.run.smithi116.stdout: "crush-failure-domain": "osd", 2024-09-14T09:09:24.853 INFO:teuthology.orchestra.run.smithi116.stdout: "k": "2", 2024-09-14T09:09:24.853 INFO:teuthology.orchestra.run.smithi116.stdout: "m": "1", 2024-09-14T09:09:24.853 INFO:teuthology.orchestra.run.smithi116.stdout: "plugin": "jerasure", 2024-09-14T09:09:24.853 INFO:teuthology.orchestra.run.smithi116.stdout: "technique": "reed_sol_van" 2024-09-14T09:09:24.853 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:24.853 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps_queue": [], 2024-09-14T09:09:24.853 INFO:teuthology.orchestra.run.smithi116.stdout: "new_removed_snaps": [], 2024-09-14T09:09:24.853 INFO:teuthology.orchestra.run.smithi116.stdout: "new_purged_snaps": [], 2024-09-14T09:09:24.854 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_node_flags": {}, 2024-09-14T09:09:24.854 INFO:teuthology.orchestra.run.smithi116.stdout: "device_class_flags": {}, 2024-09-14T09:09:24.854 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode": { 2024-09-14T09:09:24.854 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode_enabled": false, 2024-09-14T09:09:24.854 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_bucket_count": 0, 2024-09-14T09:09:24.854 INFO:teuthology.orchestra.run.smithi116.stdout: "degraded_stretch_mode": 0, 2024-09-14T09:09:24.854 INFO:teuthology.orchestra.run.smithi116.stdout: "recovering_stretch_mode": 0, 2024-09-14T09:09:24.854 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode_bucket": 0 2024-09-14T09:09:24.854 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:24.854 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:24.855 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:24.783+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:24.856 INFO:tasks.thrashosds.thrasher:j is {'epoch': 93, 'fsid': 'c991ac1c-978d-48b3-a540-4d3d4755e125', 'created': '2024-09-14T09:07:16.982473+0000', 'modified': '2024-09-14T09:09:23.881744+0000', 'last_up_change': '2024-09-14T09:09:15.843683+0000', 'last_in_change': '2024-09-14T09:08:58.845087+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T09:07:29.194849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T09:07:33.684592+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-14T09:07:43.363542+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 34, 'snap_epoch': 93, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}], 'osds': [{'osd': 0, 'uuid': 'b3c13086-1183-454b-8e62-3aec9b69cdf5', 'up': 1, 'in': 1, 'weight': 0.3199462890625, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 78, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6816', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6817', 'nonce': 1856142608}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6818', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6819', 'nonce': 1856142608}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6822', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6823', 'nonce': 1856142608}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6820', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6821', 'nonce': 1856142608}]}, 'public_addr': '172.21.15.116:6817/1856142608', 'cluster_addr': '172.21.15.116:6819/1856142608', 'heartbeat_back_addr': '172.21.15.116:6823/1856142608', 'heartbeat_front_addr': '172.21.15.116:6821/1856142608', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '8ee6a373-9d0d-4cd2-96f4-9673de96f546', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 90, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6800', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6801', 'nonce': 3469105275}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6802', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6803', 'nonce': 3469105275}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6806', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6807', 'nonce': 3469105275}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6804', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6805', 'nonce': 3469105275}]}, 'public_addr': '172.21.15.116:6801/3469105275', 'cluster_addr': '172.21.15.116:6803/3469105275', 'heartbeat_back_addr': '172.21.15.116:6807/3469105275', 'heartbeat_front_addr': '172.21.15.116:6805/3469105275', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '958a9363-d751-49c3-9ec7-7330d377ee53', 'up': 1, 'in': 1, 'weight': 0.59710693359375, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 67, 'up_from': 87, 'up_thru': 90, 'down_at': 68, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6808', 'nonce': 2050490698}, {'type': 'v1', 'addr': '172.21.15.116:6809', 'nonce': 2050490698}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6810', 'nonce': 2050490698}, {'type': 'v1', 'addr': '172.21.15.116:6811', 'nonce': 2050490698}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6814', 'nonce': 2050490698}, {'type': 'v1', 'addr': '172.21.15.116:6815', 'nonce': 2050490698}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6812', 'nonce': 2050490698}, {'type': 'v1', 'addr': '172.21.15.116:6813', 'nonce': 2050490698}]}, 'public_addr': '172.21.15.116:6809/2050490698', 'cluster_addr': '172.21.15.116:6811/2050490698', 'heartbeat_back_addr': '172.21.15.116:6815/2050490698', 'heartbeat_front_addr': '172.21.15.116:6813/2050490698', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '7fafd519-b2e9-498c-a409-f55cfe45a51a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.2435760498046875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 89, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6816', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6817', 'nonce': 2855061278}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6818', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6819', 'nonce': 2855061278}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6822', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6823', 'nonce': 2855061278}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6820', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6821', 'nonce': 2855061278}]}, 'public_addr': '172.21.15.144:6817/2855061278', 'cluster_addr': '172.21.15.144:6819/2855061278', 'heartbeat_back_addr': '172.21.15.144:6823/2855061278', 'heartbeat_front_addr': '172.21.15.144:6821/2855061278', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '63d99552-5fea-4367-bf86-0addc8cceb98', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 89, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6808', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6809', 'nonce': 369903047}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6810', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6811', 'nonce': 369903047}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6814', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6815', 'nonce': 369903047}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6812', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6813', 'nonce': 369903047}]}, 'public_addr': '172.21.15.144:6809/369903047', 'cluster_addr': '172.21.15.144:6811/369903047', 'heartbeat_back_addr': '172.21.15.144:6815/369903047', 'heartbeat_front_addr': '172.21.15.144:6813/369903047', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e4bcb224-662f-4530-b477-c0dd9c4ddbf4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 87, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6800', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6801', 'nonce': 2878111293}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6802', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6803', 'nonce': 2878111293}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6806', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6807', 'nonce': 2878111293}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6804', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6805', 'nonce': 2878111293}]}, 'public_addr': '172.21.15.144:6801/2878111293', 'cluster_addr': '172.21.15.144:6803/2878111293', 'heartbeat_back_addr': '172.21.15.144:6807/2878111293', 'heartbeat_front_addr': '172.21.15.144:6805/2878111293', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:24.757990+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.277795+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.290172+0000', 'dead_epoch': 68}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.324594+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:24.865136+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.020572+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T09:09:24.856 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-14T09:09:24.857 INFO:teuthology.orchestra.run.smithi148.stdout:5039 read 0x37bc00 thru 0x383be1 (0x7fe2 bytes) 2024-09-14T09:09:24.857 INFO:teuthology.orchestra.run.smithi148.stdout:5040 punch from 0xcee200 to 0xcfd400, (0xf200 bytes) 2024-09-14T09:09:24.860 INFO:teuthology.orchestra.run.smithi148.stdout:5041 read 0x3bcc200 thru 0x3bdbc88 (0xfa89 bytes) 2024-09-14T09:09:24.860 INFO:teuthology.orchestra.run.smithi148.stdout:5043 write 0x34cbc00 thru 0x34d601c (0xa41d bytes) 2024-09-14T09:09:24.860 INFO:teuthology.orchestra.run.smithi148.stdout:5044 punch from 0x3da5a00 to 0x3dae200, (0x8800 bytes) 2024-09-14T09:09:24.867 INFO:teuthology.orchestra.run.smithi148.stdout:5045 read 0x23c0a00 thru 0x23c7056 (0x6657 bytes) 2024-09-14T09:09:24.869 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:24.870+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:24.872 INFO:teuthology.orchestra.run.smithi148.stdout:5046 trunc from 0x6308800 to 0xa209600 2024-09-14T09:09:24.889 INFO:teuthology.orchestra.run.smithi148.stdout:5047 read 0x7367200 thru 0x7375660 (0xe461 bytes) 2024-09-14T09:09:24.889 INFO:teuthology.orchestra.run.smithi148.stdout:5050 read 0x306c000 thru 0x306ef69 (0x2f6a bytes) 2024-09-14T09:09:24.906 INFO:teuthology.orchestra.run.smithi148.stdout:5053 write 0xadf7400 thru 0xadfc3dc (0x4fdd bytes) 2024-09-14T09:09:24.906 INFO:teuthology.orchestra.run.smithi148.stdout:5055 punch from 0x4120e00 to 0x4127e00, (0x7000 bytes) 2024-09-14T09:09:24.906 INFO:teuthology.orchestra.run.smithi148.stdout:5056 punch from 0x87e00 to 0x8e400, (0x6600 bytes) 2024-09-14T09:09:24.906 INFO:teuthology.orchestra.run.smithi148.stdout:5057 write 0x5dad400 thru 0x5db2dc2 (0x59c3 bytes) 2024-09-14T09:09:24.906 INFO:teuthology.orchestra.run.smithi148.stdout:5059 write 0x1be9000 thru 0x1bf3ac6 (0xaac7 bytes) 2024-09-14T09:09:24.906 INFO:teuthology.orchestra.run.smithi148.stdout:5060 read 0x1e2ce00 thru 0x1e31f2a (0x512b bytes) 2024-09-14T09:09:24.916 INFO:teuthology.orchestra.run.smithi148.stdout:5061 trunc from 0xadfc400 to 0x2784a00 2024-09-14T09:09:24.965 INFO:teuthology.orchestra.run.smithi148.stdout:5063 write 0x8633a00 thru 0x863b45e (0x7a5f bytes) 2024-09-14T09:09:24.965 INFO:teuthology.orchestra.run.smithi148.stdout:5064 read 0xac1c00 thru 0xaceead (0xd2ae bytes) 2024-09-14T09:09:24.966 INFO:teuthology.orchestra.run.smithi148.stdout:5065 read 0x633ec00 thru 0x634d024 (0xe425 bytes) 2024-09-14T09:09:24.966 INFO:teuthology.orchestra.run.smithi148.stdout:5066 read 0x74a1000 thru 0x74b0dae (0xfdaf bytes) 2024-09-14T09:09:24.966 INFO:teuthology.orchestra.run.smithi148.stdout:5067 read 0x26c9600 thru 0x26ca8c9 (0x12ca bytes) 2024-09-14T09:09:24.969 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:24.971+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:24.971 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:24.972 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:24.974 INFO:teuthology.orchestra.run.smithi148.stdout:5070 trunc from 0x863b600 to 0x1fd2e00 2024-09-14T09:09:24.981 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:09:25.008 INFO:teuthology.orchestra.run.smithi148.stdout:5072 read 0xdb1400 thru 0xdbc8f1 (0xb4f2 bytes) 2024-09-14T09:09:25.018 INFO:teuthology.orchestra.run.smithi148.stdout:5073 trunc from 0x1fd2e00 to 0x7801800 2024-09-14T09:09:25.032 INFO:teuthology.orchestra.run.smithi148.stdout:5075 write 0x1036600 thru 0x10455c7 (0xefc8 bytes) 2024-09-14T09:09:25.034 INFO:teuthology.orchestra.run.smithi148.stdout:5076 read 0xb7c000 thru 0xb80155 (0x4156 bytes) 2024-09-14T09:09:25.035 INFO:teuthology.orchestra.run.smithi148.stdout:5081 write 0x7111600 thru 0x7120497 (0xee98 bytes) 2024-09-14T09:09:25.035 INFO:teuthology.orchestra.run.smithi148.stdout:5082 read 0x45bc200 thru 0x45c3834 (0x7635 bytes) 2024-09-14T09:09:25.036 INFO:teuthology.orchestra.run.smithi148.stdout:5084 trunc from 0x7801800 to 0x677d800 2024-09-14T09:09:25.062 INFO:teuthology.orchestra.run.smithi148.stdout:5086 trunc from 0x677d800 to 0x54c1800 2024-09-14T09:09:25.070 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:25.071+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:25.090 INFO:teuthology.orchestra.run.smithi148.stdout:5087 write 0x7e33c00 thru 0x7e3fcc9 (0xc0ca bytes) 2024-09-14T09:09:25.091 INFO:teuthology.orchestra.run.smithi148.stdout:5088 punch from 0x7e26c00 to 0x7e30200, (0x9600 bytes) 2024-09-14T09:09:25.096 INFO:teuthology.orchestra.run.smithi148.stdout:5089 trunc from 0x7e3fe00 to 0x4605400 2024-09-14T09:09:25.114 INFO:teuthology.orchestra.run.smithi148.stdout:5090 read 0x13b2600 thru 0x13bdf2f (0xb930 bytes) 2024-09-14T09:09:25.116 INFO:teuthology.orchestra.run.smithi148.stdout:5093 read 0x1406800 thru 0x1415ed6 (0xf6d7 bytes) 2024-09-14T09:09:25.117 INFO:teuthology.orchestra.run.smithi148.stdout:5095 read 0x14ffa00 thru 0x15052a8 (0x58a9 bytes) 2024-09-14T09:09:25.118 INFO:teuthology.orchestra.run.smithi148.stdout:5096 read 0x2c7000 thru 0x2d64d6 (0xf4d7 bytes) 2024-09-14T09:09:25.119 INFO:teuthology.orchestra.run.smithi148.stdout:5097 clone 33 order 24 su 1048576 sc 10 2024-09-14T09:09:25.140 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:25.140 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:25.149 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:09:25.193 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:25.195+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:25.251 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:25.251 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:25.259 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:09:25.272 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:25.274+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:25.373 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:25.375+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:25.402 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:25.402 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:25.411 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:09:25.486 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:09:25.495 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:25.497+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:25.556 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:25.556 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:25.565 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:09:25.610 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:25.612+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:25.614 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:25.615 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:25.633 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:25.633 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:25.650 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:09:25.650 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:09:25.666 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:25.667 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:25.672 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:25.672 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:25.672 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:25.672 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:25.673 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:25.676 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:25.677+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:25.681 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:09:25.684 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:25.684 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:25.701 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:25.701 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:25.776 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:25.778+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:25.788 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:25.788 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:25.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:25.788 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:25.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.788 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:987 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:25.789 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:25.789 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.931343544000001, 2024-09-14T09:09:25.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001359466, 2024-09-14T09:09:25.789 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:25.789 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:25.789 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:25.789 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:25.789 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:25.789 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:25.789 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 987 2024-09-14T09:09:25.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.789 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:25.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:25.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:25.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:25.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:25.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:25.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858333+0000", 2024-09-14T09:09:25.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.621e-06 2024-09-14T09:09:25.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:25.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858349+0000", 2024-09-14T09:09:25.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5758000000000001e-05 2024-09-14T09:09:25.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:25.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858366+0000", 2024-09-14T09:09:25.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7368e-05 2024-09-14T09:09:25.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:25.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858382+0000", 2024-09-14T09:09:25.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6039e-05 2024-09-14T09:09:25.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858441+0000", 2024-09-14T09:09:25.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8662999999999997e-05 2024-09-14T09:09:25.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858449+0000", 2024-09-14T09:09:25.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3960000000000006e-06 2024-09-14T09:09:25.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859682+0000", 2024-09-14T09:09:25.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001233096 2024-09-14T09:09:25.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:25.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859691+0000", 2024-09-14T09:09:25.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5250000000000005e-06 2024-09-14T09:09:25.793 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.793 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:25.793 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.793 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:988 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:25.794 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:25.794 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.931215674000001, 2024-09-14T09:09:25.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0012656799999999, 2024-09-14T09:09:25.794 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:25.794 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:25.794 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:25.794 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:25.794 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:25.794 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:25.794 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 988 2024-09-14T09:09:25.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.794 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:25.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:25.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:25.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:25.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:25.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:25.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858460+0000", 2024-09-14T09:09:25.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9999999999999997e-07 2024-09-14T09:09:25.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:25.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858463+0000", 2024-09-14T09:09:25.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7459999999999998e-06 2024-09-14T09:09:25.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:25.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858471+0000", 2024-09-14T09:09:25.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3900000000000004e-06 2024-09-14T09:09:25.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:25.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858478+0000", 2024-09-14T09:09:25.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7020000000000004e-06 2024-09-14T09:09:25.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859102+0000", 2024-09-14T09:09:25.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062419699999999995 2024-09-14T09:09:25.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859109+0000", 2024-09-14T09:09:25.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7419999999999997e-06 2024-09-14T09:09:25.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859718+0000", 2024-09-14T09:09:25.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006085629999999 2024-09-14T09:09:25.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:25.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859725+0000", 2024-09-14T09:09:25.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7399999999999998e-06 2024-09-14T09:09:25.798 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.798 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:25.798 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.798 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1003 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:25.798 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:25.798 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.930352437, 2024-09-14T09:09:25.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009495209999999, 2024-09-14T09:09:25.798 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:25.799 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:25.799 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:25.799 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:25.799 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:25.799 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:25.799 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1003 2024-09-14T09:09:25.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.799 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:25.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:25.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:25.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:25.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:25.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:25.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859323+0000", 2024-09-14T09:09:25.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3099999999999998e-07 2024-09-14T09:09:25.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:25.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859326+0000", 2024-09-14T09:09:25.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-06 2024-09-14T09:09:25.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:25.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859333+0000", 2024-09-14T09:09:25.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3300000000000001e-06 2024-09-14T09:09:25.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:25.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859339+0000", 2024-09-14T09:09:25.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6400000000000002e-06 2024-09-14T09:09:25.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859387+0000", 2024-09-14T09:09:25.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8448000000000001e-05 2024-09-14T09:09:25.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:09:25.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9540000000000004e-06 2024-09-14T09:09:25.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860260+0000", 2024-09-14T09:09:25.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000864921 2024-09-14T09:09:25.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:25.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860272+0000", 2024-09-14T09:09:25.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1993e-05 2024-09-14T09:09:25.803 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.803 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:25.803 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.803 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1004 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:25.803 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:25.803 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.930316862000002, 2024-09-14T09:09:25.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000947875, 2024-09-14T09:09:25.804 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:25.804 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:25.804 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:25.804 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:25.804 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:25.804 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:25.804 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1004 2024-09-14T09:09:25.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.804 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:25.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:25.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:25.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:25.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:25.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:25.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:25.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7199999999999999e-07 2024-09-14T09:09:25.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:25.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859361+0000", 2024-09-14T09:09:25.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.892e-06 2024-09-14T09:09:25.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:25.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859368+0000", 2024-09-14T09:09:25.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4370000000000004e-06 2024-09-14T09:09:25.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:25.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859373+0000", 2024-09-14T09:09:25.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6690000000000003e-06 2024-09-14T09:09:25.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859430+0000", 2024-09-14T09:09:25.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6456999999999998e-05 2024-09-14T09:09:25.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859434+0000", 2024-09-14T09:09:25.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8410000000000002e-06 2024-09-14T09:09:25.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860299+0000", 2024-09-14T09:09:25.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008650370000001 2024-09-14T09:09:25.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:25.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860306+0000", 2024-09-14T09:09:25.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0700000000000001e-06 2024-09-14T09:09:25.808 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.808 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:25.808 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.808 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1005 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:25.808 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:25.809 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.930293189, 2024-09-14T09:09:25.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009585480000001, 2024-09-14T09:09:25.809 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:25.809 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:25.809 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:25.809 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:25.809 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:25.809 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:25.809 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1005 2024-09-14T09:09:25.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.809 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:25.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:25.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:25.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:25.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:25.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:25.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:25.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9700000000000002e-07 2024-09-14T09:09:25.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:25.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859384+0000", 2024-09-14T09:09:25.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.024e-06 2024-09-14T09:09:25.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:25.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859390+0000", 2024-09-14T09:09:25.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7080000000000002e-06 2024-09-14T09:09:25.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:25.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:09:25.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8980000000000004e-06 2024-09-14T09:09:25.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859527+0000", 2024-09-14T09:09:25.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013228099999999999 2024-09-14T09:09:25.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859532+0000", 2024-09-14T09:09:25.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5899999999999998e-06 2024-09-14T09:09:25.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860330+0000", 2024-09-14T09:09:25.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0007973509999999 2024-09-14T09:09:25.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:25.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860340+0000", 2024-09-14T09:09:25.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0299000000000001e-05 2024-09-14T09:09:25.814 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.814 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:25.814 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.814 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1006 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:25.814 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:25.814 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.930269993, 2024-09-14T09:09:25.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001032039, 2024-09-14T09:09:25.814 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:25.814 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:25.815 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:25.815 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:25.815 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:25.815 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:25.815 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1006 2024-09-14T09:09:25.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.815 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:25.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:25.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:25.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:25.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:25.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:25.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:25.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6499999999999999e-07 2024-09-14T09:09:25.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:25.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859407+0000", 2024-09-14T09:09:25.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1160000000000002e-06 2024-09-14T09:09:25.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:25.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859413+0000", 2024-09-14T09:09:25.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8880000000000002e-06 2024-09-14T09:09:25.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:25.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859419+0000", 2024-09-14T09:09:25.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3550000000000004e-06 2024-09-14T09:09:25.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859558+0000", 2024-09-14T09:09:25.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000138942 2024-09-14T09:09:25.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859563+0000", 2024-09-14T09:09:25.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.665e-06 2024-09-14T09:09:25.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860427+0000", 2024-09-14T09:09:25.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008635299999999 2024-09-14T09:09:25.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:25.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860437+0000", 2024-09-14T09:09:25.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0078000000000001e-05 2024-09-14T09:09:25.818 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.818 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:25.818 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.819 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1045 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:25.819 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:25.819 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.930070513, 2024-09-14T09:09:25.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008612990000001, 2024-09-14T09:09:25.819 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:25.819 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:25.819 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:25.819 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:25.819 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:25.819 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:25.819 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1045 2024-09-14T09:09:25.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.819 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:25.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:25.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:25.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:25.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:25.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:25.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859605+0000", 2024-09-14T09:09:25.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6e-07 2024-09-14T09:09:25.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:25.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859606+0000", 2024-09-14T09:09:25.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8819999999999999e-06 2024-09-14T09:09:25.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:25.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859610+0000", 2024-09-14T09:09:25.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4290000000000001e-06 2024-09-14T09:09:25.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:25.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859612+0000", 2024-09-14T09:09:25.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6309999999999999e-06 2024-09-14T09:09:25.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859643+0000", 2024-09-14T09:09:25.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0224000000000001e-05 2024-09-14T09:09:25.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859647+0000", 2024-09-14T09:09:25.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9049999999999999e-06 2024-09-14T09:09:25.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860458+0000", 2024-09-14T09:09:25.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008111180000001 2024-09-14T09:09:25.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:25.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860466+0000", 2024-09-14T09:09:25.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:09:25.823 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.823 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:25.823 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.823 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1046 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:25.823 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:25.824 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.930057055999999, 2024-09-14T09:09:25.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000874262, 2024-09-14T09:09:25.824 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:25.824 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:25.824 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:25.824 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:25.824 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:25.824 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:25.824 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1046 2024-09-14T09:09:25.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.824 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:25.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:25.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:25.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:25.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:25.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:25.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:25.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:09:25.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:25.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859619+0000", 2024-09-14T09:09:25.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0559999999999999e-06 2024-09-14T09:09:25.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:25.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859622+0000", 2024-09-14T09:09:25.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0170000000000001e-06 2024-09-14T09:09:25.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:25.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859625+0000", 2024-09-14T09:09:25.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7209999999999999e-06 2024-09-14T09:09:25.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859666+0000", 2024-09-14T09:09:25.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1677000000000001e-05 2024-09-14T09:09:25.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859672+0000", 2024-09-14T09:09:25.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4609999999999999e-06 2024-09-14T09:09:25.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860485+0000", 2024-09-14T09:09:25.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000813505 2024-09-14T09:09:25.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:25.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860492+0000", 2024-09-14T09:09:25.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6159999999999998e-06 2024-09-14T09:09:25.828 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.828 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:25.828 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.828 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1047 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:25.829 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:25.829 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.930045721999999, 2024-09-14T09:09:25.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008950190000001, 2024-09-14T09:09:25.829 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:25.829 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:25.829 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:25.829 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:25.829 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:25.829 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:25.829 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1047 2024-09-14T09:09:25.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.830 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:25.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:25.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:25.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:25.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:25.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:25.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:25.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6600000000000003e-07 2024-09-14T09:09:25.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:25.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859631+0000", 2024-09-14T09:09:25.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5600000000000001e-06 2024-09-14T09:09:25.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:25.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859637+0000", 2024-09-14T09:09:25.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7309999999999998e-06 2024-09-14T09:09:25.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:25.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859641+0000", 2024-09-14T09:09:25.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0840000000000002e-06 2024-09-14T09:09:25.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859691+0000", 2024-09-14T09:09:25.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0587999999999997e-05 2024-09-14T09:09:25.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859696+0000", 2024-09-14T09:09:25.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8940000000000001e-06 2024-09-14T09:09:25.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860516+0000", 2024-09-14T09:09:25.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008200780000001 2024-09-14T09:09:25.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:25.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860524+0000", 2024-09-14T09:09:25.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8180000000000004e-06 2024-09-14T09:09:25.834 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.834 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:25.834 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.834 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1048 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:25.834 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:25.834 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.930013963, 2024-09-14T09:09:25.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008904780000001, 2024-09-14T09:09:25.834 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:25.834 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:25.834 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:25.834 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:25.835 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:25.835 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:25.835 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1048 2024-09-14T09:09:25.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.835 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:25.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:25.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:25.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:25.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:25.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:25.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:25.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4700000000000002e-07 2024-09-14T09:09:25.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:25.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859663+0000", 2024-09-14T09:09:25.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0420000000000001e-06 2024-09-14T09:09:25.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:25.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859669+0000", 2024-09-14T09:09:25.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8989999999999998e-06 2024-09-14T09:09:25.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:25.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859673+0000", 2024-09-14T09:09:25.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2209999999999999e-06 2024-09-14T09:09:25.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859719+0000", 2024-09-14T09:09:25.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5788000000000003e-05 2024-09-14T09:09:25.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859725+0000", 2024-09-14T09:09:25.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4770000000000002e-06 2024-09-14T09:09:25.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860544+0000", 2024-09-14T09:09:25.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008194669999999 2024-09-14T09:09:25.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:25.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860551+0000", 2024-09-14T09:09:25.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1369999999999996e-06 2024-09-14T09:09:25.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.840 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:25.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.841 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1088 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:25.841 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:25.841 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.929795125999998, 2024-09-14T09:09:25.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00073166, 2024-09-14T09:09:25.841 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:25.841 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:25.842 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:25.842 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:25.842 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:25.842 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:25.842 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1088 2024-09-14T09:09:25.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.843 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:25.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:25.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:25.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:25.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:25.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:25.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:25.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3700000000000001e-07 2024-09-14T09:09:25.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:25.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859882+0000", 2024-09-14T09:09:25.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.739e-06 2024-09-14T09:09:25.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:25.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859887+0000", 2024-09-14T09:09:25.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:09:25.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:25.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859892+0000", 2024-09-14T09:09:25.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7119999999999999e-06 2024-09-14T09:09:25.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859945+0000", 2024-09-14T09:09:25.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2762000000000001e-05 2024-09-14T09:09:25.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859950+0000", 2024-09-14T09:09:25.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-09-14T09:09:25.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860603+0000", 2024-09-14T09:09:25.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000653263 2024-09-14T09:09:25.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:25.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860611+0000", 2024-09-14T09:09:25.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-09-14T09:09:25.846 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.847 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:25.847 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.847 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1089 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:25.847 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:25.847 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.929776969999999, 2024-09-14T09:09:25.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000733943, 2024-09-14T09:09:25.847 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:25.847 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:25.847 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:25.847 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:25.847 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:25.847 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:25.848 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1089 2024-09-14T09:09:25.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.848 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:25.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:25.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:25.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:25.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:25.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:25.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:25.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3000000000000002e-07 2024-09-14T09:09:25.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:25.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859900+0000", 2024-09-14T09:09:25.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9199999999999998e-06 2024-09-14T09:09:25.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:25.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859906+0000", 2024-09-14T09:09:25.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0889999999999996e-06 2024-09-14T09:09:25.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:25.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859911+0000", 2024-09-14T09:09:25.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6419999999999998e-06 2024-09-14T09:09:25.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860010+0000", 2024-09-14T09:09:25.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8956000000000006e-05 2024-09-14T09:09:25.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860014+0000", 2024-09-14T09:09:25.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.741e-06 2024-09-14T09:09:25.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860627+0000", 2024-09-14T09:09:25.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00061277 2024-09-14T09:09:25.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:25.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860632+0000", 2024-09-14T09:09:25.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:09:25.851 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.852 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:25.852 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.852 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1090 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:25.852 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:25.852 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.929757297999998, 2024-09-14T09:09:25.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000740763, 2024-09-14T09:09:25.852 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:25.852 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:25.852 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:25.852 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:25.852 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:25.852 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:25.853 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1090 2024-09-14T09:09:25.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.853 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:25.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:25.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:25.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:25.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:25.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:25.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859918+0000", 2024-09-14T09:09:25.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5199999999999998e-07 2024-09-14T09:09:25.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:25.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859920+0000", 2024-09-14T09:09:25.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9240000000000001e-06 2024-09-14T09:09:25.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:25.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859925+0000", 2024-09-14T09:09:25.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3929999999999999e-06 2024-09-14T09:09:25.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:25.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859929+0000", 2024-09-14T09:09:25.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4769999999999999e-06 2024-09-14T09:09:25.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860034+0000", 2024-09-14T09:09:25.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010549500000000001 2024-09-14T09:09:25.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860039+0000", 2024-09-14T09:09:25.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5700000000000003e-06 2024-09-14T09:09:25.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860650+0000", 2024-09-14T09:09:25.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006116119999999 2024-09-14T09:09:25.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:25.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860658+0000", 2024-09-14T09:09:25.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:09:25.857 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.857 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:25.857 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.857 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60374 3.14 3.6e2cd654 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:25.857 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:25.857 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2998789879999997, 2024-09-14T09:09:25.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3129433100000001, 2024-09-14T09:09:25.857 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:25.857 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:25.857 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:25.857 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60374 2024-09-14T09:09:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2100000000000002e-07 2024-09-14T09:09:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489799+0000", 2024-09-14T09:09:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3530000000000002e-06 2024-09-14T09:09:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489808+0000", 2024-09-14T09:09:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2e-06 2024-09-14T09:09:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489813+0000", 2024-09-14T09:09:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3249999999999998e-06 2024-09-14T09:09:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489866+0000", 2024-09-14T09:09:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3074e-05 2024-09-14T09:09:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489875+0000", 2024-09-14T09:09:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2760000000000006e-06 2024-09-14T09:09:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801379+0000", 2024-09-14T09:09:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.31150346200000001 2024-09-14T09:09:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801387+0000", 2024-09-14T09:09:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.038e-06 2024-09-14T09:09:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802728+0000", 2024-09-14T09:09:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013415569999999 2024-09-14T09:09:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802739+0000", 2024-09-14T09:09:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0604e-05 2024-09-14T09:09:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62179 3.14 3.78cf1974 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:09:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2998483590000003, 2024-09-14T09:09:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3129429109999999, 2024-09-14T09:09:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62179 2024-09-14T09:09:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:25.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:25.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:09:25.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:25.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:09:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489827+0000", 2024-09-14T09:09:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4300000000000003e-07 2024-09-14T09:09:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489829+0000", 2024-09-14T09:09:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2129999999999998e-06 2024-09-14T09:09:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489836+0000", 2024-09-14T09:09:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0360000000000001e-06 2024-09-14T09:09:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489841+0000", 2024-09-14T09:09:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0710000000000002e-06 2024-09-14T09:09:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489905+0000", 2024-09-14T09:09:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3578999999999996e-05 2024-09-14T09:09:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489913+0000", 2024-09-14T09:09:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2269999999999993e-06 2024-09-14T09:09:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801412+0000", 2024-09-14T09:09:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.311498989 2024-09-14T09:09:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801419+0000", 2024-09-14T09:09:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1400000000000002e-06 2024-09-14T09:09:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802761+0000", 2024-09-14T09:09:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013414620000001 2024-09-14T09:09:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802769+0000", 2024-09-14T09:09:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6510000000000007e-06 2024-09-14T09:09:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63551 3.14 3.88ccb734 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:09:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2998167289999998, 2024-09-14T09:09:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.312941181, 2024-09-14T09:09:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63551 2024-09-14T09:09:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:09:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:09:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:25.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489859+0000", 2024-09-14T09:09:25.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9200000000000001e-07 2024-09-14T09:09:25.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:25.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489862+0000", 2024-09-14T09:09:25.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9629999999999998e-06 2024-09-14T09:09:25.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:25.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489868+0000", 2024-09-14T09:09:25.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3890000000000002e-06 2024-09-14T09:09:25.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:25.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489875+0000", 2024-09-14T09:09:25.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7950000000000002e-06 2024-09-14T09:09:25.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489939+0000", 2024-09-14T09:09:25.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4704999999999998e-05 2024-09-14T09:09:25.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489949+0000", 2024-09-14T09:09:25.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7799999999999995e-06 2024-09-14T09:09:25.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801447+0000", 2024-09-14T09:09:25.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.311497527 2024-09-14T09:09:25.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801454+0000", 2024-09-14T09:09:25.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1080000000000004e-06 2024-09-14T09:09:25.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802790+0000", 2024-09-14T09:09:25.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013364330000001 2024-09-14T09:09:25.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:25.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802799+0000", 2024-09-14T09:09:25.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8890000000000008e-06 2024-09-14T09:09:25.876 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.876 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:25.876 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.877 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:68716 3.14 3.96fe1934 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:25.877 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:09:25.877 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.2482462620000003, 2024-09-14T09:09:25.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2614012569999999, 2024-09-14T09:09:25.877 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:25.877 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:25.877 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:25.877 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:25.877 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:25.877 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:25.877 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 68716 2024-09-14T09:09:25.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.877 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:25.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:25.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:09:25.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:25.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:09:25.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:25.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541429+0000", 2024-09-14T09:09:25.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8899999999999998e-07 2024-09-14T09:09:25.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:25.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541433+0000", 2024-09-14T09:09:25.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7330000000000001e-06 2024-09-14T09:09:25.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:25.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541442+0000", 2024-09-14T09:09:25.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.346e-06 2024-09-14T09:09:25.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:25.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541449+0000", 2024-09-14T09:09:25.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.579e-06 2024-09-14T09:09:25.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541839+0000", 2024-09-14T09:09:25.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038993699999999998 2024-09-14T09:09:25.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541849+0000", 2024-09-14T09:09:25.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0217999999999999e-05 2024-09-14T09:09:25.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801480+0000", 2024-09-14T09:09:25.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.25963061399999998 2024-09-14T09:09:25.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801486+0000", 2024-09-14T09:09:25.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.776e-06 2024-09-14T09:09:25.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802821+0000", 2024-09-14T09:09:25.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00133435 2024-09-14T09:09:25.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:25.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802830+0000", 2024-09-14T09:09:25.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9150000000000002e-06 2024-09-14T09:09:25.882 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.882 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:25.882 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.882 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:69492 3.14 3.4a93714 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:25.882 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:09:25.883 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.1877065659999992, 2024-09-14T09:09:25.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2008910690000001, 2024-09-14T09:09:25.883 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:25.883 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:25.883 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:25.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:25.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:25.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:25.883 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 69492 2024-09-14T09:09:25.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.883 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:25.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:25.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:09:25.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:25.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:09:25.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:25.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601969+0000", 2024-09-14T09:09:25.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3099999999999996e-07 2024-09-14T09:09:25.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:25.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601973+0000", 2024-09-14T09:09:25.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5899999999999999e-06 2024-09-14T09:09:25.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:25.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601983+0000", 2024-09-14T09:09:25.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098999999999999e-05 2024-09-14T09:09:25.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:25.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601989+0000", 2024-09-14T09:09:25.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0209999999999996e-06 2024-09-14T09:09:25.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.602066+0000", 2024-09-14T09:09:25.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7075000000000003e-05 2024-09-14T09:09:25.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.602075+0000", 2024-09-14T09:09:25.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8389999999999996e-06 2024-09-14T09:09:25.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801512+0000", 2024-09-14T09:09:25.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.199437225 2024-09-14T09:09:25.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801519+0000", 2024-09-14T09:09:25.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9970000000000001e-06 2024-09-14T09:09:25.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802851+0000", 2024-09-14T09:09:25.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001331711 2024-09-14T09:09:25.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:25.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802859+0000", 2024-09-14T09:09:25.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6810000000000004e-06 2024-09-14T09:09:25.888 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.888 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:25.888 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.888 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:72035 3.14 3.1cba9a34 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:25.888 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:09:25.889 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.0683786780000002, 2024-09-14T09:09:25.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0815917340000001, 2024-09-14T09:09:25.889 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:25.889 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:25.889 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:25.889 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:25.889 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:25.889 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:25.889 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 72035 2024-09-14T09:09:25.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.889 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:25.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:25.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:09:25.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:25.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:09:25.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:25.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721297+0000", 2024-09-14T09:09:25.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5199999999999996e-07 2024-09-14T09:09:25.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:25.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721301+0000", 2024-09-14T09:09:25.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7790000000000002e-06 2024-09-14T09:09:25.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:25.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721309+0000", 2024-09-14T09:09:25.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8019999999999998e-06 2024-09-14T09:09:25.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:25.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721315+0000", 2024-09-14T09:09:25.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:09:25.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721367+0000", 2024-09-14T09:09:25.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2280000000000001e-05 2024-09-14T09:09:25.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721376+0000", 2024-09-14T09:09:25.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5439999999999999e-06 2024-09-14T09:09:25.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801545+0000", 2024-09-14T09:09:25.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.080169952000000003 2024-09-14T09:09:25.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801552+0000", 2024-09-14T09:09:25.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8390000000000001e-06 2024-09-14T09:09:25.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802879+0000", 2024-09-14T09:09:25.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001326846 2024-09-14T09:09:25.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:25.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802888+0000", 2024-09-14T09:09:25.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6330000000000002e-06 2024-09-14T09:09:25.894 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.894 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:25.894 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.894 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73403 3.14 3.87b99f94 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:25.894 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:25.894 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.0261040169999998, 2024-09-14T09:09:25.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0393459899999999, 2024-09-14T09:09:25.894 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:25.894 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:25.894 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:25.895 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:25.895 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:25.895 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:25.895 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73403 2024-09-14T09:09:25.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.895 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:25.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:25.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:25.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:25.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:25.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:25.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:25.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:25.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9200000000000001e-07 2024-09-14T09:09:25.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:25.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763574+0000", 2024-09-14T09:09:25.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6510000000000001e-06 2024-09-14T09:09:25.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:25.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763582+0000", 2024-09-14T09:09:25.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2579999999999995e-06 2024-09-14T09:09:25.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:25.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763592+0000", 2024-09-14T09:09:25.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0193e-05 2024-09-14T09:09:25.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763643+0000", 2024-09-14T09:09:25.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0862000000000002e-05 2024-09-14T09:09:25.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763654+0000", 2024-09-14T09:09:25.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0890000000000001e-05 2024-09-14T09:09:25.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801577+0000", 2024-09-14T09:09:25.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037923074000000001 2024-09-14T09:09:25.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:25.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801584+0000", 2024-09-14T09:09:25.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0060000000000003e-06 2024-09-14T09:09:25.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:25.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802908+0000", 2024-09-14T09:09:25.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013235149999999 2024-09-14T09:09:25.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:25.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:25.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:25.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802917+0000", 2024-09-14T09:09:25.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9490000000000002e-06 2024-09-14T09:09:25.899 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.899 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:25.899 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.899 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:25.899 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:25.899 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:25.901 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:09:25.901 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:25.902+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:25.905 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T09:09:26.002 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:26.003+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:26.011 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone32 from 0x4605400 (overlap 0x1fd2e00) to 0x0 2024-09-14T09:09:26.021 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:26.021 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:26.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.021 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing(3.5 epoch 94/90 rep_tid 305 entries 94'633 (0'0) error 3:a263d21f:::rbd_data.1112cbfa8a2e.000000000000000e:head by client.5551.0:1538 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 93'631)", 2024-09-14T09:09:26.021 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:26.022830+0000", 2024-09-14T09:09:26.022 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001116162, 2024-09-14T09:09:26.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001152244, 2024-09-14T09:09:26.022 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.022 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.022 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:26.022 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:26.022830+0000", 2024-09-14T09:09:26.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:26.022830+0000", 2024-09-14T09:09:26.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:26.022830+0000", 2024-09-14T09:09:26.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2200000000000004e-07 2024-09-14T09:09:26.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:26.022839+0000", 2024-09-14T09:09:26.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2190000000000004e-06 2024-09-14T09:09:26.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:26.022856+0000", 2024-09-14T09:09:26.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6976000000000001e-05 2024-09-14T09:09:26.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:26.022869+0000", 2024-09-14T09:09:26.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3294e-05 2024-09-14T09:09:26.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:26.022967+0000", 2024-09-14T09:09:26.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8265999999999997e-05 2024-09-14T09:09:26.024 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.024 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.024 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing(3.b epoch 94/55 rep_tid 4752 entries 94'369 (0'0) error 3:d7e447e8:::rbd_data.1112cbfa8a2e.0000000000000018:head by client.5551.0:1570 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 93'366)", 2024-09-14T09:09:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:26.023778+0000", 2024-09-14T09:09:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00016815999999999999, 2024-09-14T09:09:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00026681799999999999, 2024-09-14T09:09:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:26.023778+0000", 2024-09-14T09:09:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:26.023778+0000", 2024-09-14T09:09:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:26.023778+0000", 2024-09-14T09:09:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8200000000000001e-07 2024-09-14T09:09:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:26.023784+0000", 2024-09-14T09:09:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2129999999999996e-06 2024-09-14T09:09:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:26.023801+0000", 2024-09-14T09:09:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6319000000000001e-05 2024-09-14T09:09:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:26.023814+0000", 2024-09-14T09:09:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2883e-05 2024-09-14T09:09:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:26.023880+0000", 2024-09-14T09:09:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6276e-05 2024-09-14T09:09:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.028 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.028 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.028 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.028 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-14T09:09:26.028 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 2 2024-09-14T09:09:26.028 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:26.035 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:09:26.103 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:26.105+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:26.185 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:26.186 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:26.186 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:26.186 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:26.186 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:26.195 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:09:26.239 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:26.240+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:26.306 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:26.306 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:26.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:26.306 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:26.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.306 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:249 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1638400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:26.306 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:26.306 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.510079884, 2024-09-14T09:09:26.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99070346899999995, 2024-09-14T09:09:26.307 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.307 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.307 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:26.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:26.307 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 249 2024-09-14T09:09:26.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.307 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:26.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:26.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796868+0000", 2024-09-14T09:09:26.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2024-09-14T09:09:26.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796870+0000", 2024-09-14T09:09:26.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7889999999999999e-06 2024-09-14T09:09:26.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796877+0000", 2024-09-14T09:09:26.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8549999999999996e-06 2024-09-14T09:09:26.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796883+0000", 2024-09-14T09:09:26.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.665e-06 2024-09-14T09:09:26.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796915+0000", 2024-09-14T09:09:26.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2215999999999998e-05 2024-09-14T09:09:26.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796920+0000", 2024-09-14T09:09:26.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.527e-06 2024-09-14T09:09:26.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787468+0000", 2024-09-14T09:09:26.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99054877100000005 2024-09-14T09:09:26.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787512+0000", 2024-09-14T09:09:26.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3958000000000002e-05 2024-09-14T09:09:26.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787571+0000", 2024-09-14T09:09:26.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8167000000000001e-05 2024-09-14T09:09:26.311 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.311 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.311 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.312 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:250 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2097152~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:26.312 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:26.312 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.510053818000003, 2024-09-14T09:09:26.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99079431100000004, 2024-09-14T09:09:26.312 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.312 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.312 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:26.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:26.312 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 250 2024-09-14T09:09:26.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.312 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:26.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:26.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796894+0000", 2024-09-14T09:09:26.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2024-09-14T09:09:26.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796896+0000", 2024-09-14T09:09:26.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5600000000000001e-06 2024-09-14T09:09:26.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796902+0000", 2024-09-14T09:09:26.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3090000000000001e-06 2024-09-14T09:09:26.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796909+0000", 2024-09-14T09:09:26.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:09:26.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796942+0000", 2024-09-14T09:09:26.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-05 2024-09-14T09:09:26.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796948+0000", 2024-09-14T09:09:26.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5910000000000001e-06 2024-09-14T09:09:26.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787596+0000", 2024-09-14T09:09:26.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99064781400000002 2024-09-14T09:09:26.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787636+0000", 2024-09-14T09:09:26.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9715000000000002e-05 2024-09-14T09:09:26.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787687+0000", 2024-09-14T09:09:26.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1674e-05 2024-09-14T09:09:26.316 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.317 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.317 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.317 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:251 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:26.317 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:26.317 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.510028382999998, 2024-09-14T09:09:26.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99091769600000001, 2024-09-14T09:09:26.317 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.317 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.317 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.317 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.318 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:26.318 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:26.318 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 251 2024-09-14T09:09:26.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.318 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:26.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:26.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:26.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000005e-07 2024-09-14T09:09:26.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796922+0000", 2024-09-14T09:09:26.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.875e-06 2024-09-14T09:09:26.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796929+0000", 2024-09-14T09:09:26.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0260000000000002e-06 2024-09-14T09:09:26.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796935+0000", 2024-09-14T09:09:26.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7030000000000003e-06 2024-09-14T09:09:26.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796963+0000", 2024-09-14T09:09:26.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8368999999999999e-05 2024-09-14T09:09:26.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796966+0000", 2024-09-14T09:09:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4130000000000002e-06 2024-09-14T09:09:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787718+0000", 2024-09-14T09:09:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99075151100000003 2024-09-14T09:09:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787779+0000", 2024-09-14T09:09:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.088e-05 2024-09-14T09:09:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787836+0000", 2024-09-14T09:09:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7380000000000003e-05 2024-09-14T09:09:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:252 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.510002929000002, 2024-09-14T09:09:26.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99102491400000003, 2024-09-14T09:09:26.323 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.323 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.323 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:26.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:26.323 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 252 2024-09-14T09:09:26.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.323 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796945+0000", 2024-09-14T09:09:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2900000000000003e-07 2024-09-14T09:09:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796947+0000", 2024-09-14T09:09:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4279999999999999e-06 2024-09-14T09:09:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796954+0000", 2024-09-14T09:09:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5479999999999998e-06 2024-09-14T09:09:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796959+0000", 2024-09-14T09:09:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.22e-06 2024-09-14T09:09:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796988+0000", 2024-09-14T09:09:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9473000000000001e-05 2024-09-14T09:09:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:09:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787850+0000", 2024-09-14T09:09:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99085651100000005 2024-09-14T09:09:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787891+0000", 2024-09-14T09:09:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602000000000002e-05 2024-09-14T09:09:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787969+0000", 2024-09-14T09:09:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8063000000000001e-05 2024-09-14T09:09:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.328 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.328 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.328 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:253 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:26.328 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:26.328 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.509979049000002, 2024-09-14T09:09:26.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99122695699999996, 2024-09-14T09:09:26.328 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.328 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.328 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 253 2024-09-14T09:09:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:09:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:09:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:09:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796977+0000", 2024-09-14T09:09:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5030000000000002e-06 2024-09-14T09:09:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796982+0000", 2024-09-14T09:09:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2024-09-14T09:09:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797013+0000", 2024-09-14T09:09:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0451e-05 2024-09-14T09:09:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:09:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1690000000000001e-06 2024-09-14T09:09:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788011+0000", 2024-09-14T09:09:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99099490300000004 2024-09-14T09:09:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788102+0000", 2024-09-14T09:09:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0730999999999996e-05 2024-09-14T09:09:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788195+0000", 2024-09-14T09:09:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3245999999999995e-05 2024-09-14T09:09:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:254 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3932160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.509947490999998, 2024-09-14T09:09:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99137410500000001, 2024-09-14T09:09:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 254 2024-09-14T09:09:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:26.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:26.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797000+0000", 2024-09-14T09:09:26.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:09:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797003+0000", 2024-09-14T09:09:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7659999999999999e-06 2024-09-14T09:09:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797010+0000", 2024-09-14T09:09:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.029e-06 2024-09-14T09:09:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2024-09-14T09:09:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797044+0000", 2024-09-14T09:09:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9213e-05 2024-09-14T09:09:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797048+0000", 2024-09-14T09:09:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3400000000000002e-06 2024-09-14T09:09:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788222+0000", 2024-09-14T09:09:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99117407400000002 2024-09-14T09:09:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788306+0000", 2024-09-14T09:09:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4512999999999995e-05 2024-09-14T09:09:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788374+0000", 2024-09-14T09:09:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7226999999999999e-05 2024-09-14T09:09:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.339 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.339 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.339 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:264 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:26.339 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:26.339 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.509921132999999, 2024-09-14T09:09:26.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99161474699999996, 2024-09-14T09:09:26.339 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.339 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.339 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:26.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:26.340 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 264 2024-09-14T09:09:26.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.340 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:26.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2024-09-14T09:09:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:09:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2800000000000002e-06 2024-09-14T09:09:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0979999999999999e-06 2024-09-14T09:09:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797040+0000", 2024-09-14T09:09:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:09:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797068+0000", 2024-09-14T09:09:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7302999999999999e-05 2024-09-14T09:09:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797071+0000", 2024-09-14T09:09:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3610000000000001e-06 2024-09-14T09:09:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788436+0000", 2024-09-14T09:09:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99136489500000002 2024-09-14T09:09:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788538+0000", 2024-09-14T09:09:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101931 2024-09-14T09:09:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788641+0000", 2024-09-14T09:09:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010273899999999999 2024-09-14T09:09:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:265 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.509897774000002, 2024-09-14T09:09:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99176878199999996, 2024-09-14T09:09:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 265 2024-09-14T09:09:26.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.346 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:26.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:26.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:09:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.39e-07 2024-09-14T09:09:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797052+0000", 2024-09-14T09:09:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.345e-06 2024-09-14T09:09:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797058+0000", 2024-09-14T09:09:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5429999999999999e-06 2024-09-14T09:09:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797064+0000", 2024-09-14T09:09:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2000000000000002e-06 2024-09-14T09:09:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797091+0000", 2024-09-14T09:09:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7804e-05 2024-09-14T09:09:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797095+0000", 2024-09-14T09:09:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2024-09-14T09:09:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788667+0000", 2024-09-14T09:09:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157211300000003 2024-09-14T09:09:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788742+0000", 2024-09-14T09:09:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5159000000000003e-05 2024-09-14T09:09:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788818+0000", 2024-09-14T09:09:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6038000000000006e-05 2024-09-14T09:09:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.350 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.350 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.350 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:266 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:26.350 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:26.350 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.509874943, 2024-09-14T09:09:26.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99193390100000001, 2024-09-14T09:09:26.350 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.350 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.350 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.350 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 266 2024-09-14T09:09:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:09:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797075+0000", 2024-09-14T09:09:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2570000000000002e-06 2024-09-14T09:09:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797082+0000", 2024-09-14T09:09:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8029999999999997e-06 2024-09-14T09:09:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797088+0000", 2024-09-14T09:09:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.468e-06 2024-09-14T09:09:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797116+0000", 2024-09-14T09:09:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7752000000000001e-05 2024-09-14T09:09:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797121+0000", 2024-09-14T09:09:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5960000000000003e-06 2024-09-14T09:09:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788846+0000", 2024-09-14T09:09:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99172512199999996 2024-09-14T09:09:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788916+0000", 2024-09-14T09:09:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9843000000000002e-05 2024-09-14T09:09:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789006+0000", 2024-09-14T09:09:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9608e-05 2024-09-14T09:09:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:267 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.509850135999997, 2024-09-14T09:09:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99210926799999999, 2024-09-14T09:09:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 267 2024-09-14T09:09:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:26.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:26.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2399999999999999e-07 2024-09-14T09:09:26.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797099+0000", 2024-09-14T09:09:26.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.091e-06 2024-09-14T09:09:26.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797105+0000", 2024-09-14T09:09:26.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-09-14T09:09:26.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797111+0000", 2024-09-14T09:09:26.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5130000000000004e-06 2024-09-14T09:09:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797140+0000", 2024-09-14T09:09:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9513999999999999e-05 2024-09-14T09:09:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797145+0000", 2024-09-14T09:09:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:09:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789037+0000", 2024-09-14T09:09:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99189253899999996 2024-09-14T09:09:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789110+0000", 2024-09-14T09:09:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2848000000000005e-05 2024-09-14T09:09:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789206+0000", 2024-09-14T09:09:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5778000000000004e-05 2024-09-14T09:09:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:268 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.509826896999996, 2024-09-14T09:09:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992276359, 2024-09-14T09:09:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 268 2024-09-14T09:09:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:09:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797123+0000", 2024-09-14T09:09:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2740000000000002e-06 2024-09-14T09:09:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797129+0000", 2024-09-14T09:09:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-06 2024-09-14T09:09:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797134+0000", 2024-09-14T09:09:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9099999999999996e-06 2024-09-14T09:09:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797163+0000", 2024-09-14T09:09:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9709999999999998e-05 2024-09-14T09:09:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8709999999999999e-06 2024-09-14T09:09:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789231+0000", 2024-09-14T09:09:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992063959 2024-09-14T09:09:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789306+0000", 2024-09-14T09:09:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5289000000000004e-05 2024-09-14T09:09:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789396+0000", 2024-09-14T09:09:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9939999999999996e-05 2024-09-14T09:09:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:269 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2457600~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.509803388000002, 2024-09-14T09:09:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99242174400000005, 2024-09-14T09:09:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 269 2024-09-14T09:09:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:09:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797146+0000", 2024-09-14T09:09:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5289999999999998e-06 2024-09-14T09:09:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797153+0000", 2024-09-14T09:09:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1920000000000002e-06 2024-09-14T09:09:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797158+0000", 2024-09-14T09:09:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099999999999998e-06 2024-09-14T09:09:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797188+0000", 2024-09-14T09:09:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0128e-05 2024-09-14T09:09:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797194+0000", 2024-09-14T09:09:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6250000000000004e-06 2024-09-14T09:09:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789439+0000", 2024-09-14T09:09:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99224531000000005 2024-09-14T09:09:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789489+0000", 2024-09-14T09:09:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9830000000000002e-05 2024-09-14T09:09:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789565+0000", 2024-09-14T09:09:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6229000000000005e-05 2024-09-14T09:09:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:270 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.509779565999999, 2024-09-14T09:09:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99257721899999996, 2024-09-14T09:09:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 270 2024-09-14T09:09:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797168+0000", 2024-09-14T09:09:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2024-09-14T09:09:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797170+0000", 2024-09-14T09:09:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3120000000000001e-06 2024-09-14T09:09:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797177+0000", 2024-09-14T09:09:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0960000000000003e-06 2024-09-14T09:09:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797183+0000", 2024-09-14T09:09:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1669999999999998e-06 2024-09-14T09:09:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797213+0000", 2024-09-14T09:09:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0494e-05 2024-09-14T09:09:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:09:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:09:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789586+0000", 2024-09-14T09:09:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99236692100000001 2024-09-14T09:09:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789658+0000", 2024-09-14T09:09:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2279000000000004e-05 2024-09-14T09:09:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789745+0000", 2024-09-14T09:09:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6698000000000002e-05 2024-09-14T09:09:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:271 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3375104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.509754368000003, 2024-09-14T09:09:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99274791699999998, 2024-09-14T09:09:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 271 2024-09-14T09:09:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:09:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797195+0000", 2024-09-14T09:09:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1639999999999999e-06 2024-09-14T09:09:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797201+0000", 2024-09-14T09:09:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1290000000000001e-06 2024-09-14T09:09:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797206+0000", 2024-09-14T09:09:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9300000000000002e-06 2024-09-14T09:09:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797237+0000", 2024-09-14T09:09:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1285000000000003e-05 2024-09-14T09:09:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797242+0000", 2024-09-14T09:09:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6e-06 2024-09-14T09:09:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789768+0000", 2024-09-14T09:09:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99252547400000002 2024-09-14T09:09:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789826+0000", 2024-09-14T09:09:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8155999999999997e-05 2024-09-14T09:09:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789940+0000", 2024-09-14T09:09:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114788 2024-09-14T09:09:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:272 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.509730974, 2024-09-14T09:09:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99285248800000003, 2024-09-14T09:09:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 272 2024-09-14T09:09:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:09:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:09:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5129999999999999e-06 2024-09-14T09:09:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797226+0000", 2024-09-14T09:09:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4529999999999996e-06 2024-09-14T09:09:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797232+0000", 2024-09-14T09:09:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1839999999999998e-06 2024-09-14T09:09:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797264+0000", 2024-09-14T09:09:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2691999999999998e-05 2024-09-14T09:09:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797270+0000", 2024-09-14T09:09:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-06 2024-09-14T09:09:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789965+0000", 2024-09-14T09:09:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99269526200000002 2024-09-14T09:09:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790021+0000", 2024-09-14T09:09:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5297000000000003e-05 2024-09-14T09:09:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790068+0000", 2024-09-14T09:09:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7664999999999998e-05 2024-09-14T09:09:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:09:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.5194745269999999, 2024-09-14T09:09:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146649299999999, 2024-09-14T09:09:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 58987 2024-09-14T09:09:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:09:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:09:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787474+0000", 2024-09-14T09:09:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1799999999999999e-06 2024-09-14T09:09:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787483+0000", 2024-09-14T09:09:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9830000000000002e-06 2024-09-14T09:09:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787494+0000", 2024-09-14T09:09:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1496e-05 2024-09-14T09:09:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787502+0000", 2024-09-14T09:09:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8280000000000003e-06 2024-09-14T09:09:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787563+0000", 2024-09-14T09:09:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1583999999999999e-05 2024-09-14T09:09:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:09:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787571+0000", 2024-09-14T09:09:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.058e-06 2024-09-14T09:09:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.791999+0000", 2024-09-14T09:09:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004428675 2024-09-14T09:09:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792008+0000", 2024-09-14T09:09:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9069999999999996e-06 2024-09-14T09:09:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802124+0000", 2024-09-14T09:09:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0101154619999999 2024-09-14T09:09:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802137+0000", 2024-09-14T09:09:26.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3757000000000001e-05 2024-09-14T09:09:26.394 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.394 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.394 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.394 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:67110 3.5 3.6b6808c5 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:26.394 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:09:26.394 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.5193417119999992, 2024-09-14T09:09:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0147494290000001, 2024-09-14T09:09:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 67110 2024-09-14T09:09:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:09:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:09:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787606+0000", 2024-09-14T09:09:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6300000000000005e-07 2024-09-14T09:09:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787609+0000", 2024-09-14T09:09:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2789999999999999e-06 2024-09-14T09:09:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787616+0000", 2024-09-14T09:09:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8349999999999998e-06 2024-09-14T09:09:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787622+0000", 2024-09-14T09:09:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6999999999999996e-06 2024-09-14T09:09:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787666+0000", 2024-09-14T09:09:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3887000000000002e-05 2024-09-14T09:09:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787672+0000", 2024-09-14T09:09:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-09-14T09:09:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792033+0000", 2024-09-14T09:09:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043614250000000004 2024-09-14T09:09:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792041+0000", 2024-09-14T09:09:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5449999999999998e-06 2024-09-14T09:09:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:09:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0103013569999999 2024-09-14T09:09:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802355+0000", 2024-09-14T09:09:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2717999999999999e-05 2024-09-14T09:09:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72029 3.5 3.3f02ac5 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.519264197, 2024-09-14T09:09:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.014715139, 2024-09-14T09:09:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72029 2024-09-14T09:09:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7599999999999997e-07 2024-09-14T09:09:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787686+0000", 2024-09-14T09:09:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3999999999999999e-06 2024-09-14T09:09:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787692+0000", 2024-09-14T09:09:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3489999999999997e-06 2024-09-14T09:09:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787697+0000", 2024-09-14T09:09:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2320000000000001e-06 2024-09-14T09:09:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787742+0000", 2024-09-14T09:09:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4557e-05 2024-09-14T09:09:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787748+0000", 2024-09-14T09:09:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7810000000000002e-06 2024-09-14T09:09:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792065+0000", 2024-09-14T09:09:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043178679999999999 2024-09-14T09:09:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792073+0000", 2024-09-14T09:09:26.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6329999999999996e-06 2024-09-14T09:09:26.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802388+0000", 2024-09-14T09:09:26.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010315394 2024-09-14T09:09:26.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802398+0000", 2024-09-14T09:09:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4490000000000005e-06 2024-09-14T09:09:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72038 3.5 3.c914e45 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.5191885640000002, 2024-09-14T09:09:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146757740000001, 2024-09-14T09:09:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72038 2024-09-14T09:09:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787759+0000", 2024-09-14T09:09:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0100000000000005e-07 2024-09-14T09:09:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787761+0000", 2024-09-14T09:09:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4049999999999998e-06 2024-09-14T09:09:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787768+0000", 2024-09-14T09:09:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.314e-06 2024-09-14T09:09:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787773+0000", 2024-09-14T09:09:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2789999999999998e-06 2024-09-14T09:09:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787813+0000", 2024-09-14T09:09:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9582000000000002e-05 2024-09-14T09:09:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787818+0000", 2024-09-14T09:09:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7100000000000004e-06 2024-09-14T09:09:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792096+0000", 2024-09-14T09:09:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042776460000000004 2024-09-14T09:09:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792103+0000", 2024-09-14T09:09:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7129999999999999e-06 2024-09-14T09:09:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802427+0000", 2024-09-14T09:09:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010324805 2024-09-14T09:09:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802434+0000", 2024-09-14T09:09:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:09:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:74840 3.5 3.ab2c8d25 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:09:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.4971366790000005, 2024-09-14T09:09:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99271963600000002, 2024-09-14T09:09:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74840 2024-09-14T09:09:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:09:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:09:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809812+0000", 2024-09-14T09:09:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2899999999999999e-06 2024-09-14T09:09:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809817+0000", 2024-09-14T09:09:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0139999999999998e-06 2024-09-14T09:09:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809834+0000", 2024-09-14T09:09:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7643e-05 2024-09-14T09:09:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809842+0000", 2024-09-14T09:09:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2970000000000004e-06 2024-09-14T09:09:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809902+0000", 2024-09-14T09:09:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9106e-05 2024-09-14T09:09:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809912+0000", 2024-09-14T09:09:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0101e-05 2024-09-14T09:09:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802520+0000", 2024-09-14T09:09:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99260828599999995 2024-09-14T09:09:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802530+0000", 2024-09-14T09:09:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8989999999999996e-06 2024-09-14T09:09:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.417 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:26.417 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:26.306+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:26.418 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:09:26.459 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:26.460+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:26.519 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:26.521+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:26.565 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:26.565 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:26.566 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:09:26.566 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:26.574 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:09:26.621 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:26.622+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:26.650 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #31, image image_client.0-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent32 2024-09-14T09:09:26.684 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:26.684 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:26.685 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:26.685 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:26.685 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:26.694 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:09:26.737 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:26.738+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:26.810 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:26.810 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:26.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:26.810 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:26.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.810 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5349 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8302592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:26.810 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:26.810 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.555442390000003, 2024-09-14T09:09:26.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039875928999999997, 2024-09-14T09:09:26.810 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.811 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.811 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.811 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.811 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:26.811 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:26.811 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5349 2024-09-14T09:09:26.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.811 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:26.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:26.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255874+0000", 2024-09-14T09:09:26.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4900000000000001e-07 2024-09-14T09:09:26.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255880+0000", 2024-09-14T09:09:26.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9939999999999997e-06 2024-09-14T09:09:26.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255886+0000", 2024-09-14T09:09:26.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3899999999999998e-06 2024-09-14T09:09:26.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255891+0000", 2024-09-14T09:09:26.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.938e-06 2024-09-14T09:09:26.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295580+0000", 2024-09-14T09:09:26.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039688681000000003 2024-09-14T09:09:26.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295653+0000", 2024-09-14T09:09:26.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3045000000000003e-05 2024-09-14T09:09:26.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295749+0000", 2024-09-14T09:09:26.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6532000000000003e-05 2024-09-14T09:09:26.814 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.814 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.815 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.815 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5350 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8364032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:26.815 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:26.815 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.555418582999998, 2024-09-14T09:09:26.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039989719, 2024-09-14T09:09:26.815 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.815 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.815 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.815 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.815 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:26.815 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:26.816 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5350 2024-09-14T09:09:26.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.816 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:26.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:26.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255898+0000", 2024-09-14T09:09:26.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2024-09-14T09:09:26.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255899+0000", 2024-09-14T09:09:26.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9139999999999998e-06 2024-09-14T09:09:26.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255905+0000", 2024-09-14T09:09:26.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7289999999999997e-06 2024-09-14T09:09:26.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255910+0000", 2024-09-14T09:09:26.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6210000000000003e-06 2024-09-14T09:09:26.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295775+0000", 2024-09-14T09:09:26.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039864973999999997 2024-09-14T09:09:26.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295828+0000", 2024-09-14T09:09:26.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3411000000000001e-05 2024-09-14T09:09:26.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295887+0000", 2024-09-14T09:09:26.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699000000000002e-05 2024-09-14T09:09:26.819 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.819 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.819 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.819 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4639 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1843200~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:26.819 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:26.819 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.611503123999999, 2024-09-14T09:09:26.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040843672999999997, 2024-09-14T09:09:26.819 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.820 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.820 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.820 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.820 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:26.820 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:26.820 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4639 2024-09-14T09:09:26.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.820 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:26.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:26.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:26.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:09:26.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199818+0000", 2024-09-14T09:09:26.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1450000000000001e-06 2024-09-14T09:09:26.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199827+0000", 2024-09-14T09:09:26.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3999999999999998e-06 2024-09-14T09:09:26.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199834+0000", 2024-09-14T09:09:26.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0809999999999996e-06 2024-09-14T09:09:26.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240541+0000", 2024-09-14T09:09:26.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040706941000000003 2024-09-14T09:09:26.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240584+0000", 2024-09-14T09:09:26.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3040999999999997e-05 2024-09-14T09:09:26.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240656+0000", 2024-09-14T09:09:26.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2200000000000007e-05 2024-09-14T09:09:26.824 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.824 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.824 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.824 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4640 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1871872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:26.824 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:26.825 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.611468639000002, 2024-09-14T09:09:26.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040967601999999999, 2024-09-14T09:09:26.825 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.825 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.825 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.825 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.825 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:26.825 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:26.825 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4640 2024-09-14T09:09:26.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.825 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:26.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:26.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199848+0000", 2024-09-14T09:09:26.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5400000000000002e-07 2024-09-14T09:09:26.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199850+0000", 2024-09-14T09:09:26.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2479999999999999e-06 2024-09-14T09:09:26.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199857+0000", 2024-09-14T09:09:26.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.187e-06 2024-09-14T09:09:26.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199862+0000", 2024-09-14T09:09:26.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5119999999999999e-06 2024-09-14T09:09:26.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240684+0000", 2024-09-14T09:09:26.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040821245999999999 2024-09-14T09:09:26.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240739+0000", 2024-09-14T09:09:26.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4991999999999998e-05 2024-09-14T09:09:26.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240815+0000", 2024-09-14T09:09:26.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5963000000000004e-05 2024-09-14T09:09:26.828 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.828 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.828 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.829 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4641 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1900544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:26.829 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:26.829 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.611446309000002, 2024-09-14T09:09:26.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041205512, 2024-09-14T09:09:26.829 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.829 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.829 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.829 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.829 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:26.829 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:26.830 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4641 2024-09-14T09:09:26.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.830 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:26.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:26.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199870+0000", 2024-09-14T09:09:26.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0600000000000001e-07 2024-09-14T09:09:26.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199872+0000", 2024-09-14T09:09:26.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.928e-06 2024-09-14T09:09:26.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199877+0000", 2024-09-14T09:09:26.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6949999999999997e-06 2024-09-14T09:09:26.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199882+0000", 2024-09-14T09:09:26.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8210000000000001e-06 2024-09-14T09:09:26.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240847+0000", 2024-09-14T09:09:26.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040965201999999999 2024-09-14T09:09:26.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240888+0000", 2024-09-14T09:09:26.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0754000000000003e-05 2024-09-14T09:09:26.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241075+0000", 2024-09-14T09:09:26.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000186706 2024-09-14T09:09:26.833 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.833 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.833 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.834 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4642 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1929216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:26.834 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:26.834 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.611427374000002, 2024-09-14T09:09:26.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041292575999999998, 2024-09-14T09:09:26.834 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.834 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.834 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.834 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.834 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:26.834 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:26.834 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4642 2024-09-14T09:09:26.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.835 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:26.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:26.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199889+0000", 2024-09-14T09:09:26.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2024-09-14T09:09:26.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199891+0000", 2024-09-14T09:09:26.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9e-06 2024-09-14T09:09:26.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199896+0000", 2024-09-14T09:09:26.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6960000000000002e-06 2024-09-14T09:09:26.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199901+0000", 2024-09-14T09:09:26.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6720000000000003e-06 2024-09-14T09:09:26.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241089+0000", 2024-09-14T09:09:26.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041187594000000001 2024-09-14T09:09:26.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241126+0000", 2024-09-14T09:09:26.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7490999999999997e-05 2024-09-14T09:09:26.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241181+0000", 2024-09-14T09:09:26.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4823e-05 2024-09-14T09:09:26.838 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.838 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.838 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.838 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4643 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1957888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:26.838 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:26.838 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.611408095000002, 2024-09-14T09:09:26.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041418333000000002, 2024-09-14T09:09:26.838 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.838 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.838 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.838 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.839 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:26.839 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:26.839 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4643 2024-09-14T09:09:26.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.839 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:26.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:26.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:26.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5699999999999998e-07 2024-09-14T09:09:26.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199910+0000", 2024-09-14T09:09:26.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.829e-06 2024-09-14T09:09:26.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199916+0000", 2024-09-14T09:09:26.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8499999999999999e-06 2024-09-14T09:09:26.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199920+0000", 2024-09-14T09:09:26.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6530000000000002e-06 2024-09-14T09:09:26.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241211+0000", 2024-09-14T09:09:26.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041290327000000002 2024-09-14T09:09:26.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241257+0000", 2024-09-14T09:09:26.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6347000000000002e-05 2024-09-14T09:09:26.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241326+0000", 2024-09-14T09:09:26.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8969999999999999e-05 2024-09-14T09:09:26.842 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.842 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.843 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.843 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4644 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1986560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:26.843 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:26.843 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.611389755000001, 2024-09-14T09:09:26.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041596269999999998, 2024-09-14T09:09:26.843 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.843 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.843 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.843 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.843 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:26.843 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:26.844 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4644 2024-09-14T09:09:26.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.844 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:26.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:26.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:26.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.41e-07 2024-09-14T09:09:26.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199928+0000", 2024-09-14T09:09:26.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8250000000000001e-06 2024-09-14T09:09:26.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199934+0000", 2024-09-14T09:09:26.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2280000000000003e-06 2024-09-14T09:09:26.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199939+0000", 2024-09-14T09:09:26.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8010000000000003e-06 2024-09-14T09:09:26.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241360+0000", 2024-09-14T09:09:26.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041421289 2024-09-14T09:09:26.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241435+0000", 2024-09-14T09:09:26.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4238000000000003e-05 2024-09-14T09:09:26.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241522+0000", 2024-09-14T09:09:26.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7547999999999996e-05 2024-09-14T09:09:26.847 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.847 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.847 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.848 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4645 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:26.848 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:26.848 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.611370848, 2024-09-14T09:09:26.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041714660000000001, 2024-09-14T09:09:26.848 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.848 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.848 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.848 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.848 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:26.848 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:26.848 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4645 2024-09-14T09:09:26.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.849 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:26.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:26.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:26.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4700000000000002e-07 2024-09-14T09:09:26.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199947+0000", 2024-09-14T09:09:26.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.801e-06 2024-09-14T09:09:26.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199953+0000", 2024-09-14T09:09:26.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.694e-06 2024-09-14T09:09:26.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199957+0000", 2024-09-14T09:09:26.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3069999999999996e-06 2024-09-14T09:09:26.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241547+0000", 2024-09-14T09:09:26.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041589895000000002 2024-09-14T09:09:26.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241590+0000", 2024-09-14T09:09:26.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2985000000000003e-05 2024-09-14T09:09:26.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241660+0000", 2024-09-14T09:09:26.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9630999999999998e-05 2024-09-14T09:09:26.852 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.852 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.852 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.852 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4646 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2043904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:26.852 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:26.852 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.61135286, 2024-09-14T09:09:26.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041827171000000003, 2024-09-14T09:09:26.853 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.853 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.853 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.853 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.853 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:26.853 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:26.853 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4646 2024-09-14T09:09:26.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.853 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:26.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:26.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:26.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6300000000000001e-07 2024-09-14T09:09:26.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199965+0000", 2024-09-14T09:09:26.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.035e-06 2024-09-14T09:09:26.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199973+0000", 2024-09-14T09:09:26.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9629999999999998e-06 2024-09-14T09:09:26.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199978+0000", 2024-09-14T09:09:26.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9069999999999998e-06 2024-09-14T09:09:26.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241677+0000", 2024-09-14T09:09:26.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041698662999999997 2024-09-14T09:09:26.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241717+0000", 2024-09-14T09:09:26.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602999999999997e-05 2024-09-14T09:09:26.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241790+0000", 2024-09-14T09:09:26.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2637000000000003e-05 2024-09-14T09:09:26.856 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.857 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.857 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.857 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4647 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2072576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:26.857 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:26.857 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.611324270000001, 2024-09-14T09:09:26.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041921189999999997, 2024-09-14T09:09:26.857 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.857 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.857 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.857 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.857 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:26.857 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:26.858 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4647 2024-09-14T09:09:26.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.858 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:26.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:26.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199992+0000", 2024-09-14T09:09:26.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3799999999999997e-07 2024-09-14T09:09:26.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199994+0000", 2024-09-14T09:09:26.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3020000000000002e-06 2024-09-14T09:09:26.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200004+0000", 2024-09-14T09:09:26.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3510000000000008e-06 2024-09-14T09:09:26.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200008+0000", 2024-09-14T09:09:26.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3329999999999998e-06 2024-09-14T09:09:26.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241814+0000", 2024-09-14T09:09:26.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041806280000000001 2024-09-14T09:09:26.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241855+0000", 2024-09-14T09:09:26.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0173999999999999e-05 2024-09-14T09:09:26.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241913+0000", 2024-09-14T09:09:26.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8112000000000002e-05 2024-09-14T09:09:26.861 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.861 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.861 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.862 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:59017 3.3 3:c1df81d6:::rbd_data.1112a10502fe.0000000000000189:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:26.862 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:09:26.862 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.024033669, 2024-09-14T09:09:26.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.024252111, 2024-09-14T09:09:26.862 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.862 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.862 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.862 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.862 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:26.862 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:26.863 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59017 2024-09-14T09:09:26.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.863 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:09:26.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:09:26.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787284+0000", 2024-09-14T09:09:26.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3879999999999998e-06 2024-09-14T09:09:26.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787297+0000", 2024-09-14T09:09:26.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2184999999999999e-05 2024-09-14T09:09:26.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787317+0000", 2024-09-14T09:09:26.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0054000000000001e-05 2024-09-14T09:09:26.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787327+0000", 2024-09-14T09:09:26.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0335e-05 2024-09-14T09:09:26.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787412+0000", 2024-09-14T09:09:26.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4691000000000006e-05 2024-09-14T09:09:26.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:09:26.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787422+0000", 2024-09-14T09:09:26.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0718e-05 2024-09-14T09:09:26.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790539+0000", 2024-09-14T09:09:26.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031164600000000002 2024-09-14T09:09:26.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790552+0000", 2024-09-14T09:09:26.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2736e-05 2024-09-14T09:09:26.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.798725+0000", 2024-09-14T09:09:26.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0081731860000001 2024-09-14T09:09:26.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.798824+0000", 2024-09-14T09:09:26.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9600999999999997e-05 2024-09-14T09:09:26.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.811534+0000", 2024-09-14T09:09:26.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012709757 2024-09-14T09:09:26.868 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.868 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.868 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.868 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:63586 3.3 3:c0d9272b:::rbd_data.1112a10502fe.00000000000001a2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:26.868 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:26.868 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.023962186, 2024-09-14T09:09:26.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0244069650000001, 2024-09-14T09:09:26.868 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.868 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.868 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.868 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.869 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:26.869 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:26.869 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 63586 2024-09-14T09:09:26.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.869 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:26.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:26.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:26.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2024-09-14T09:09:26.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787357+0000", 2024-09-14T09:09:26.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8720000000000002e-06 2024-09-14T09:09:26.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787365+0000", 2024-09-14T09:09:26.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9270000000000005e-06 2024-09-14T09:09:26.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787372+0000", 2024-09-14T09:09:26.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6810000000000001e-06 2024-09-14T09:09:26.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787479+0000", 2024-09-14T09:09:26.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010736800000000001 2024-09-14T09:09:26.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:26.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787485+0000", 2024-09-14T09:09:26.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.054e-06 2024-09-14T09:09:26.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790580+0000", 2024-09-14T09:09:26.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030949929999999999 2024-09-14T09:09:26.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790589+0000", 2024-09-14T09:09:26.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7600000000000008e-06 2024-09-14T09:09:26.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.799541+0000", 2024-09-14T09:09:26.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0089520110000001 2024-09-14T09:09:26.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.799620+0000", 2024-09-14T09:09:26.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8969999999999998e-05 2024-09-14T09:09:26.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.811760+0000", 2024-09-14T09:09:26.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012140748999999999 2024-09-14T09:09:26.874 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.874 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.874 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.874 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:65817 3.3 3:c2c49fe0:::rbd_data.1112a10502fe.00000000000001b3:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:26.874 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:09:26.874 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.023872384000001, 2024-09-14T09:09:26.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0253660200000001, 2024-09-14T09:09:26.874 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.875 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.875 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.875 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.875 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:26.875 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:26.875 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 65817 2024-09-14T09:09:26.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.875 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:09:26.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:09:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787444+0000", 2024-09-14T09:09:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999995e-07 2024-09-14T09:09:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787448+0000", 2024-09-14T09:09:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1420000000000003e-06 2024-09-14T09:09:26.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787497+0000", 2024-09-14T09:09:26.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8507999999999997e-05 2024-09-14T09:09:26.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787503+0000", 2024-09-14T09:09:26.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1319999999999999e-06 2024-09-14T09:09:26.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787595+0000", 2024-09-14T09:09:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1748000000000003e-05 2024-09-14T09:09:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787601+0000", 2024-09-14T09:09:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6150000000000002e-06 2024-09-14T09:09:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790613+0000", 2024-09-14T09:09:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003012228 2024-09-14T09:09:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790621+0000", 2024-09-14T09:09:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9219999999999997e-06 2024-09-14T09:09:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800130+0000", 2024-09-14T09:09:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.009508474 2024-09-14T09:09:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800257+0000", 2024-09-14T09:09:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012746900000000001 2024-09-14T09:09:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.812809+0000", 2024-09-14T09:09:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012552054 2024-09-14T09:09:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:68709 3.3 3:c4996abd:::rbd_data.1112a10502fe.00000000000001cd:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:09:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.023701438, 2024-09-14T09:09:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0254506109999999, 2024-09-14T09:09:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 68709 2024-09-14T09:09:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:09:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:09:26.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787615+0000", 2024-09-14T09:09:26.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4000000000000001e-07 2024-09-14T09:09:26.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787618+0000", 2024-09-14T09:09:26.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2780000000000002e-06 2024-09-14T09:09:26.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787626+0000", 2024-09-14T09:09:26.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0250000000000002e-06 2024-09-14T09:09:26.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787633+0000", 2024-09-14T09:09:26.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5660000000000003e-06 2024-09-14T09:09:26.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787714+0000", 2024-09-14T09:09:26.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1695999999999998e-05 2024-09-14T09:09:26.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:26.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787721+0000", 2024-09-14T09:09:26.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1109999999999996e-06 2024-09-14T09:09:26.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790646+0000", 2024-09-14T09:09:26.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029251730000000001 2024-09-14T09:09:26.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790653+0000", 2024-09-14T09:09:26.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4379999999999998e-06 2024-09-14T09:09:26.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800750+0000", 2024-09-14T09:09:26.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010097236 2024-09-14T09:09:26.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800883+0000", 2024-09-14T09:09:26.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000132466 2024-09-14T09:09:26.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813065+0000", 2024-09-14T09:09:26.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012181981999999999 2024-09-14T09:09:26.886 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.886 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.886 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.886 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:74823 3.3 3:c59acf89:::rbd_data.1112a10502fe.00000000000001fb:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:26.886 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:09:26.886 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.002866965999999, 2024-09-14T09:09:26.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.004859323, 2024-09-14T09:09:26.886 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.886 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.886 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.886 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.886 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:26.887 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:26.887 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74823 2024-09-14T09:09:26.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.887 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:09:26.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:09:26.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808450+0000", 2024-09-14T09:09:26.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.92e-07 2024-09-14T09:09:26.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808454+0000", 2024-09-14T09:09:26.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3660000000000002e-06 2024-09-14T09:09:26.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808463+0000", 2024-09-14T09:09:26.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1579999999999994e-06 2024-09-14T09:09:26.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808470+0000", 2024-09-14T09:09:26.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7599999999999997e-06 2024-09-14T09:09:26.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808540+0000", 2024-09-14T09:09:26.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9991000000000001e-05 2024-09-14T09:09:26.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808550+0000", 2024-09-14T09:09:26.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0282000000000001e-05 2024-09-14T09:09:26.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801352+0000", 2024-09-14T09:09:26.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99280192700000003 2024-09-14T09:09:26.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801472+0000", 2024-09-14T09:09:26.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120184 2024-09-14T09:09:26.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813308+0000", 2024-09-14T09:09:26.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011835863 2024-09-14T09:09:26.891 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.891 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.891 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.891 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:86789 3.3 3:c3063f19:::rbd_data.1112a10502fe.000000000000023a:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:26.891 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:09:26.891 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.2306442410000002, 2024-09-14T09:09:26.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.23302192099999999, 2024-09-14T09:09:26.891 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.891 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.891 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.891 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.891 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:26.892 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:26.892 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86789 2024-09-14T09:09:26.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.892 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:09:26.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:09:26.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580672+0000", 2024-09-14T09:09:26.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7999999999999993e-07 2024-09-14T09:09:26.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580680+0000", 2024-09-14T09:09:26.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7540000000000006e-06 2024-09-14T09:09:26.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580694+0000", 2024-09-14T09:09:26.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3344e-05 2024-09-14T09:09:26.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580702+0000", 2024-09-14T09:09:26.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9510000000000006e-06 2024-09-14T09:09:26.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580778+0000", 2024-09-14T09:09:26.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6580000000000002e-05 2024-09-14T09:09:26.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580788+0000", 2024-09-14T09:09:26.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0327e-05 2024-09-14T09:09:26.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801980+0000", 2024-09-14T09:09:26.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.22119123900000001 2024-09-14T09:09:26.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802115+0000", 2024-09-14T09:09:26.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013572000000000001 2024-09-14T09:09:26.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813693+0000", 2024-09-14T09:09:26.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011578026 2024-09-14T09:09:26.896 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.896 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.896 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.896 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:89485 3.3 3:c3eae671:::rbd_data.1112a10502fe.0000000000000248:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:26.896 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:09:26.896 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.1257877470000004, 2024-09-14T09:09:26.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.12841583300000001, 2024-09-14T09:09:26.896 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.896 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.897 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.897 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.897 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:26.897 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:26.897 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 89485 2024-09-14T09:09:26.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.897 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:09:26.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:09:26.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685529+0000", 2024-09-14T09:09:26.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.11e-06 2024-09-14T09:09:26.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685534+0000", 2024-09-14T09:09:26.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0289999999999996e-06 2024-09-14T09:09:26.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685546+0000", 2024-09-14T09:09:26.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2062000000000001e-05 2024-09-14T09:09:26.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685554+0000", 2024-09-14T09:09:26.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7889999999999995e-06 2024-09-14T09:09:26.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685618+0000", 2024-09-14T09:09:26.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4487999999999996e-05 2024-09-14T09:09:26.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685628+0000", 2024-09-14T09:09:26.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5840000000000001e-06 2024-09-14T09:09:26.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802613+0000", 2024-09-14T09:09:26.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.116984703 2024-09-14T09:09:26.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802768+0000", 2024-09-14T09:09:26.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015541599999999999 2024-09-14T09:09:26.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813944+0000", 2024-09-14T09:09:26.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011175651999999999 2024-09-14T09:09:26.901 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.901 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.901 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.901 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:90751 3.3 3:c22bfcfe:::rbd_data.1112a10502fe.000000000000024e:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:26.901 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:09:26.901 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.0747169630000002, 2024-09-14T09:09:26.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077582650000000003, 2024-09-14T09:09:26.902 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.902 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.902 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.902 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.902 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:26.902 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:26.902 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 90751 2024-09-14T09:09:26.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.902 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:09:26.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:09:26.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736600+0000", 2024-09-14T09:09:26.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.71e-07 2024-09-14T09:09:26.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736608+0000", 2024-09-14T09:09:26.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2679999999999994e-06 2024-09-14T09:09:26.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736620+0000", 2024-09-14T09:09:26.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2064e-05 2024-09-14T09:09:26.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736627+0000", 2024-09-14T09:09:26.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8129999999999998e-06 2024-09-14T09:09:26.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736676+0000", 2024-09-14T09:09:26.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.901e-05 2024-09-14T09:09:26.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736685+0000", 2024-09-14T09:09:26.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:09:26.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803227+0000", 2024-09-14T09:09:26.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066541874000000001 2024-09-14T09:09:26.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803381+0000", 2024-09-14T09:09:26.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015482500000000001 2024-09-14T09:09:26.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.814181+0000", 2024-09-14T09:09:26.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010799944000000001 2024-09-14T09:09:26.906 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.906 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.906 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.906 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:90760 3.3 3:c116ad26:::rbd_data.1112a10502fe.0000000000000251:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:26.907 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:09:26.907 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.0746146460000006, 2024-09-14T09:09:26.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077694599000000003, 2024-09-14T09:09:26.907 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:26.907 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:26.907 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:26.907 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:26.907 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:26.907 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:26.907 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 90760 2024-09-14T09:09:26.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.907 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:26.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:26.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:09:26.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:26.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:09:26.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:26.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:26.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736702+0000", 2024-09-14T09:09:26.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0999999999999998e-07 2024-09-14T09:09:26.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:26.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736705+0000", 2024-09-14T09:09:26.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0120000000000001e-06 2024-09-14T09:09:26.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:26.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736711+0000", 2024-09-14T09:09:26.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6279999999999999e-06 2024-09-14T09:09:26.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:26.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736717+0000", 2024-09-14T09:09:26.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6200000000000004e-06 2024-09-14T09:09:26.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736765+0000", 2024-09-14T09:09:26.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7688000000000001e-05 2024-09-14T09:09:26.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:26.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736772+0000", 2024-09-14T09:09:26.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6529999999999994e-06 2024-09-14T09:09:26.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:26.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803886+0000", 2024-09-14T09:09:26.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067113795000000004 2024-09-14T09:09:26.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:26.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.804024+0000", 2024-09-14T09:09:26.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013782000000000001 2024-09-14T09:09:26.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:26.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:26.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:26.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.814396+0000", 2024-09-14T09:09:26.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010371773000000001 2024-09-14T09:09:26.911 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.911 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.911 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.911 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:26.911 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:26.911 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:26.912 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is unset 2024-09-14T09:09:26.914 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:09:26.914 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:26.914+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:26.914 INFO:teuthology.orchestra.run.smithi148.stdout:5098 read 0x581200 thru 0x58b640 (0xa441 bytes) 2024-09-14T09:09:26.915 INFO:teuthology.orchestra.run.smithi148.stdout:5108 write 0x3389200 thru 0x3394084 (0xae85 bytes) 2024-09-14T09:09:26.915 INFO:teuthology.orchestra.run.smithi148.stdout:5110 read 0x1482800 thru 0x148c2dc (0x9add bytes) 2024-09-14T09:09:26.915 INFO:teuthology.orchestra.run.smithi148.stdout:5112 punch from 0x9edc00 to 0x9ee200, (0x600 bytes) 2024-09-14T09:09:26.915 INFO:teuthology.orchestra.run.smithi148.stdout:5113 read 0x78ee00 thru 0x78fc93 (0xe94 bytes) 2024-09-14T09:09:26.915 INFO:teuthology.orchestra.run.smithi148.stdout:5115 write 0x6da200 thru 0x6e66a7 (0xc4a8 bytes) 2024-09-14T09:09:26.915 INFO:teuthology.orchestra.run.smithi148.stdout:5117 write 0xa4c3200 thru 0xa4c4d11 (0x1b12 bytes) 2024-09-14T09:09:26.922 INFO:teuthology.orchestra.run.smithi148.stdout:5118 trunc from 0xa4c4e00 to 0x1fc800 2024-09-14T09:09:26.991 INFO:teuthology.orchestra.run.smithi148.stdout:5119 write 0xc3bcc00 thru 0xc3ca489 (0xd88a bytes) 2024-09-14T09:09:27.004 INFO:teuthology.orchestra.run.smithi148.stdout:5125 write 0xd00ea00 thru 0xd01b292 (0xc893 bytes) 2024-09-14T09:09:27.005 INFO:teuthology.orchestra.run.smithi148.stdout:5127 write 0xb7d8e00 thru 0xb7da853 (0x1a54 bytes) 2024-09-14T09:09:27.005 INFO:teuthology.orchestra.run.smithi148.stdout:5128 write 0xb8ee600 thru 0xb8fce54 (0xe855 bytes) 2024-09-14T09:09:27.005 INFO:teuthology.orchestra.run.smithi148.stdout:5129 punch from 0x62dc200 to 0x62de400, (0x2200 bytes) 2024-09-14T09:09:27.005 INFO:teuthology.orchestra.run.smithi148.stdout:5130 write 0x15f200 thru 0x15f9ed (0x7ee bytes) 2024-09-14T09:09:27.006 INFO:teuthology.orchestra.run.smithi148.stdout:5132 read 0x6021c00 thru 0x6023397 (0x1798 bytes) 2024-09-14T09:09:27.013 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:27.015+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:27.019 INFO:teuthology.orchestra.run.smithi148.stdout:5134 trunc from 0xd01b400 to 0x22d2c00 2024-09-14T09:09:27.066 INFO:teuthology.orchestra.run.smithi148.stdout:5136 write 0xdd9cc00 thru 0xdda347e (0x687f bytes) 2024-09-14T09:09:27.066 INFO:teuthology.orchestra.run.smithi148.stdout:5138 write 0x432ac00 thru 0x4333c61 (0x9062 bytes) 2024-09-14T09:09:27.066 INFO:teuthology.orchestra.run.smithi148.stdout:5141 read 0x37f7a00 thru 0x38031f2 (0xb7f3 bytes) 2024-09-14T09:09:27.066 INFO:teuthology.orchestra.run.smithi148.stdout:5142 punch from 0xdd7ee00 to 0xdd8c600, (0xd800 bytes) 2024-09-14T09:09:27.066 INFO:teuthology.orchestra.run.smithi148.stdout:5143 write 0xb1ea200 thru 0xb1f003a (0x5e3b bytes) 2024-09-14T09:09:27.066 INFO:teuthology.orchestra.run.smithi148.stdout:5146 read 0x7fbf000 thru 0x7fc8fdc (0x9fdd bytes) 2024-09-14T09:09:27.066 INFO:teuthology.orchestra.run.smithi148.stdout:5150 read 0x78dba00 thru 0x78ddeb1 (0x24b2 bytes) 2024-09-14T09:09:27.066 INFO:teuthology.orchestra.run.smithi148.stdout:5152 write 0x9eb2000 thru 0x9eb7f0c (0x5f0d bytes) 2024-09-14T09:09:27.066 INFO:teuthology.orchestra.run.smithi148.stdout:5154 write 0x844a400 thru 0x8459595 (0xf196 bytes) 2024-09-14T09:09:27.066 INFO:teuthology.orchestra.run.smithi148.stdout:5157 write 0x2bca00 thru 0x2c2f32 (0x6533 bytes) 2024-09-14T09:09:27.066 INFO:teuthology.orchestra.run.smithi148.stdout:5159 read 0x7e25a00 thru 0x7e2d797 (0x7d98 bytes) 2024-09-14T09:09:27.066 INFO:teuthology.orchestra.run.smithi148.stdout:5160 write 0x95cba00 thru 0x95cd851 (0x1e52 bytes) 2024-09-14T09:09:27.067 INFO:teuthology.orchestra.run.smithi148.stdout:5161 trunc from 0xdda3600 to 0xecf1600 2024-09-14T09:09:27.069 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:27.069 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:27.069 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:09:27.069 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:27.080 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:27.081 INFO:teuthology.orchestra.run.smithi148.stdout:5162 read 0x972ec00 thru 0x973640c (0x780d bytes) 2024-09-14T09:09:27.081 INFO:teuthology.orchestra.run.smithi148.stdout:5164 read 0x28d9000 thru 0x28e5a7e (0xca7f bytes) 2024-09-14T09:09:27.082 INFO:teuthology.orchestra.run.smithi148.stdout:5167 read 0x3c87800 thru 0x3c8bd99 (0x459a bytes) 2024-09-14T09:09:27.082 INFO:teuthology.orchestra.run.smithi148.stdout:5169 read 0xce7800 thru 0xcf579a (0xdf9b bytes) 2024-09-14T09:09:27.083 INFO:teuthology.orchestra.run.smithi148.stdout:5171 write 0x2c2da00 thru 0x2c38d6e (0xb36f bytes) 2024-09-14T09:09:27.099 INFO:teuthology.orchestra.run.smithi148.stdout:5177 trunc from 0xecf1600 to 0x122a200 2024-09-14T09:09:27.121 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:27.122+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:27.126 INFO:teuthology.orchestra.run.smithi148.stdout:5180 punch from 0x306600 to 0x306c00, (0x600 bytes) 2024-09-14T09:09:27.133 INFO:teuthology.orchestra.run.smithi148.stdout:5181 read 0xe44c00 thru 0xe4e00e (0x940f bytes) 2024-09-14T09:09:27.134 INFO:teuthology.orchestra.run.smithi148.stdout:5184 read 0xb8a600 thru 0xb9989d (0xf29e bytes) 2024-09-14T09:09:27.135 INFO:teuthology.orchestra.run.smithi148.stdout:5188 write 0x94de00 thru 0x958dd2 (0xafd3 bytes) 2024-09-14T09:09:27.139 INFO:teuthology.orchestra.run.smithi148.stdout:5190 trunc from 0x122a200 to 0x3f70600 2024-09-14T09:09:27.148 INFO:teuthology.orchestra.run.smithi148.stdout:5191 clone 34 order 23 su 65536 sc 4 2024-09-14T09:09:27.215 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:27.217+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:27.225 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:27.225 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:27.225 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:27.225 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:27.225 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:27.234 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:09:27.316 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:27.317+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:27.339 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:27.339 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:27.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:27.340 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:27.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.340 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:228 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 360448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:27.340 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:27.340 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.543953803999997, 2024-09-14T09:09:27.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99234476999999999, 2024-09-14T09:09:27.340 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:27.340 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:27.340 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:27.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:27.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:27.341 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:27.341 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 228 2024-09-14T09:09:27.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.341 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:27.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:27.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:27.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:27.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:27.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:27.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796906+0000", 2024-09-14T09:09:27.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9399999999999995e-07 2024-09-14T09:09:27.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:27.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796917+0000", 2024-09-14T09:09:27.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0801e-05 2024-09-14T09:09:27.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:27.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796924+0000", 2024-09-14T09:09:27.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7750000000000004e-06 2024-09-14T09:09:27.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:27.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9972000000000001e-05 2024-09-14T09:09:27.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798671+0000", 2024-09-14T09:09:27.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017271330000000001 2024-09-14T09:09:27.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798675+0000", 2024-09-14T09:09:27.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.194e-06 2024-09-14T09:09:27.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789003+0000", 2024-09-14T09:09:27.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99032768400000004 2024-09-14T09:09:27.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:27.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789115+0000", 2024-09-14T09:09:27.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112236 2024-09-14T09:09:27.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:27.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789250+0000", 2024-09-14T09:09:27.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013548100000000001 2024-09-14T09:09:27.345 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.345 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:27.345 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.345 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:229 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 819200~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:27.345 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:27.345 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.543901581, 2024-09-14T09:09:27.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99287024599999996, 2024-09-14T09:09:27.345 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:27.346 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:27.346 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:27.346 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:27.346 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:27.346 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:27.346 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 229 2024-09-14T09:09:27.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.346 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:27.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:27.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:27.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:27.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:27.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:27.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:27.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999999e-07 2024-09-14T09:09:27.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:27.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796962+0000", 2024-09-14T09:09:27.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1479999999999999e-06 2024-09-14T09:09:27.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:27.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796967+0000", 2024-09-14T09:09:27.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1499999999999998e-06 2024-09-14T09:09:27.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:09:27.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-06 2024-09-14T09:09:27.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798688+0000", 2024-09-14T09:09:27.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017172660000000001 2024-09-14T09:09:27.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798691+0000", 2024-09-14T09:09:27.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:09:27.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789599+0000", 2024-09-14T09:09:27.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99090839399999997 2024-09-14T09:09:27.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:27.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789716+0000", 2024-09-14T09:09:27.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116474 2024-09-14T09:09:27.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:27.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789828+0000", 2024-09-14T09:09:27.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112293 2024-09-14T09:09:27.350 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.350 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:27.350 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.351 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:230 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1277952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:27.351 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:27.351 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.543880932999997, 2024-09-14T09:09:27.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99307501600000003, 2024-09-14T09:09:27.351 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:27.351 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:27.351 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:27.351 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:27.351 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:27.351 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:27.351 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 230 2024-09-14T09:09:27.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.352 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:27.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:27.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:27.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:27.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:27.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:27.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796979+0000", 2024-09-14T09:09:27.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.34e-07 2024-09-14T09:09:27.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:27.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796980+0000", 2024-09-14T09:09:27.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.53e-06 2024-09-14T09:09:27.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:27.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796986+0000", 2024-09-14T09:09:27.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9989999999999997e-06 2024-09-14T09:09:27.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796989+0000", 2024-09-14T09:09:27.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0340000000000001e-06 2024-09-14T09:09:27.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798702+0000", 2024-09-14T09:09:27.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001712756 2024-09-14T09:09:27.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798705+0000", 2024-09-14T09:09:27.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7750000000000001e-06 2024-09-14T09:09:27.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789870+0000", 2024-09-14T09:09:27.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991165026 2024-09-14T09:09:27.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:27.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789955+0000", 2024-09-14T09:09:27.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4839999999999994e-05 2024-09-14T09:09:27.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:27.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790053+0000", 2024-09-14T09:09:27.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8721999999999994e-05 2024-09-14T09:09:27.356 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.356 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:27.356 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.356 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:231 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:27.356 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:27.356 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.543865605000001, 2024-09-14T09:09:27.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99319130300000003, 2024-09-14T09:09:27.356 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:27.356 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:27.356 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:27.357 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:27.357 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:27.357 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:27.357 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 231 2024-09-14T09:09:27.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.357 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:27.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:27.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:27.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2024-09-14T09:09:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796995+0000", 2024-09-14T09:09:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2500000000000001e-06 2024-09-14T09:09:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796998+0000", 2024-09-14T09:09:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3230000000000002e-06 2024-09-14T09:09:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797001+0000", 2024-09-14T09:09:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7099999999999999e-06 2024-09-14T09:09:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798718+0000", 2024-09-14T09:09:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017168070000000001 2024-09-14T09:09:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798721+0000", 2024-09-14T09:09:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.853e-06 2024-09-14T09:09:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790077+0000", 2024-09-14T09:09:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991356393 2024-09-14T09:09:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790129+0000", 2024-09-14T09:09:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2240999999999997e-05 2024-09-14T09:09:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790185+0000", 2024-09-14T09:09:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5515e-05 2024-09-14T09:09:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:232 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2195456~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.543854949, 2024-09-14T09:09:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99329117899999997, 2024-09-14T09:09:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 232 2024-09-14T09:09:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797005+0000", 2024-09-14T09:09:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2024-09-14T09:09:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797006+0000", 2024-09-14T09:09:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3200000000000001e-06 2024-09-14T09:09:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797009+0000", 2024-09-14T09:09:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4680000000000001e-06 2024-09-14T09:09:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797012+0000", 2024-09-14T09:09:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4770000000000002e-06 2024-09-14T09:09:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798743+0000", 2024-09-14T09:09:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017312 2024-09-14T09:09:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798747+0000", 2024-09-14T09:09:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.484e-06 2024-09-14T09:09:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790201+0000", 2024-09-14T09:09:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99145419499999998 2024-09-14T09:09:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790241+0000", 2024-09-14T09:09:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0587999999999998e-05 2024-09-14T09:09:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790296+0000", 2024-09-14T09:09:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4212000000000002e-05 2024-09-14T09:09:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:233 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2654208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.543844325999999, 2024-09-14T09:09:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99337220100000001, 2024-09-14T09:09:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 233 2024-09-14T09:09:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:09:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:09:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.269e-06 2024-09-14T09:09:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797019+0000", 2024-09-14T09:09:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9519999999999999e-06 2024-09-14T09:09:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797022+0000", 2024-09-14T09:09:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6079999999999998e-06 2024-09-14T09:09:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798759+0000", 2024-09-14T09:09:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001737342 2024-09-14T09:09:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798762+0000", 2024-09-14T09:09:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:09:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790310+0000", 2024-09-14T09:09:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99154738799999997 2024-09-14T09:09:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790349+0000", 2024-09-14T09:09:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9573000000000002e-05 2024-09-14T09:09:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790387+0000", 2024-09-14T09:09:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7985999999999998e-05 2024-09-14T09:09:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:234 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3112960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.543834281000002, 2024-09-14T09:09:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99345674500000003, 2024-09-14T09:09:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 234 2024-09-14T09:09:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0100000000000001e-07 2024-09-14T09:09:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0699999999999999e-06 2024-09-14T09:09:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:09:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.886e-06 2024-09-14T09:09:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797032+0000", 2024-09-14T09:09:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7149999999999998e-06 2024-09-14T09:09:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798778+0000", 2024-09-14T09:09:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017460329999999999 2024-09-14T09:09:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798783+0000", 2024-09-14T09:09:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0760000000000002e-06 2024-09-14T09:09:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790408+0000", 2024-09-14T09:09:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99162473299999998 2024-09-14T09:09:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790446+0000", 2024-09-14T09:09:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8389000000000001e-05 2024-09-14T09:09:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790482+0000", 2024-09-14T09:09:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5642000000000002e-05 2024-09-14T09:09:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:235 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3571712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.543824383, 2024-09-14T09:09:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993539477, 2024-09-14T09:09:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 235 2024-09-14T09:09:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9999999999999999e-07 2024-09-14T09:09:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797036+0000", 2024-09-14T09:09:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.051e-06 2024-09-14T09:09:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797039+0000", 2024-09-14T09:09:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:09:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797042+0000", 2024-09-14T09:09:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5280000000000002e-06 2024-09-14T09:09:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798809+0000", 2024-09-14T09:09:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001767394 2024-09-14T09:09:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798815+0000", 2024-09-14T09:09:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0859999999999998e-06 2024-09-14T09:09:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790502+0000", 2024-09-14T09:09:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99168652300000004 2024-09-14T09:09:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790539+0000", 2024-09-14T09:09:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7471000000000001e-05 2024-09-14T09:09:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790574+0000", 2024-09-14T09:09:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5292e-05 2024-09-14T09:09:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:236 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 4030464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.543814150000003, 2024-09-14T09:09:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993619743, 2024-09-14T09:09:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 236 2024-09-14T09:09:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1400000000000001e-07 2024-09-14T09:09:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797047+0000", 2024-09-14T09:09:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3400000000000001e-06 2024-09-14T09:09:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:09:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0699999999999998e-06 2024-09-14T09:09:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797053+0000", 2024-09-14T09:09:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7310000000000002e-06 2024-09-14T09:09:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798839+0000", 2024-09-14T09:09:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001786403 2024-09-14T09:09:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798844+0000", 2024-09-14T09:09:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3730000000000001e-06 2024-09-14T09:09:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790592+0000", 2024-09-14T09:09:27.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99174818099999995 2024-09-14T09:09:27.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:27.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790628+0000", 2024-09-14T09:09:27.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5831000000000003e-05 2024-09-14T09:09:27.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:27.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790665+0000", 2024-09-14T09:09:27.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-05 2024-09-14T09:09:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:365 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.541627122000001, 2024-09-14T09:09:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157278400000004, 2024-09-14T09:09:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 365 2024-09-14T09:09:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:09:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799233+0000", 2024-09-14T09:09:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.057e-06 2024-09-14T09:09:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799236+0000", 2024-09-14T09:09:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0249999999999998e-06 2024-09-14T09:09:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799239+0000", 2024-09-14T09:09:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.481e-06 2024-09-14T09:09:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800963+0000", 2024-09-14T09:09:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017240440000000001 2024-09-14T09:09:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800969+0000", 2024-09-14T09:09:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1410000000000002e-06 2024-09-14T09:09:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790682+0000", 2024-09-14T09:09:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98971330300000004 2024-09-14T09:09:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790753+0000", 2024-09-14T09:09:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0548000000000003e-05 2024-09-14T09:09:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790805+0000", 2024-09-14T09:09:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1981999999999998e-05 2024-09-14T09:09:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:366 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.541617029000001, 2024-09-14T09:09:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99173757299999998, 2024-09-14T09:09:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 366 2024-09-14T09:09:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-07 2024-09-14T09:09:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799244+0000", 2024-09-14T09:09:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.359e-06 2024-09-14T09:09:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799247+0000", 2024-09-14T09:09:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4929999999999998e-06 2024-09-14T09:09:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799250+0000", 2024-09-14T09:09:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:09:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800991+0000", 2024-09-14T09:09:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017412809999999999 2024-09-14T09:09:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800997+0000", 2024-09-14T09:09:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:09:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790824+0000", 2024-09-14T09:09:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98982735399999999 2024-09-14T09:09:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790891+0000", 2024-09-14T09:09:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7243999999999995e-05 2024-09-14T09:09:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790980+0000", 2024-09-14T09:09:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8608000000000003e-05 2024-09-14T09:09:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:367 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.541605656999998, 2024-09-14T09:09:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99188259999999995, 2024-09-14T09:09:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 367 2024-09-14T09:09:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-07 2024-09-14T09:09:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799255+0000", 2024-09-14T09:09:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.111e-06 2024-09-14T09:09:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799259+0000", 2024-09-14T09:09:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8650000000000003e-06 2024-09-14T09:09:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799262+0000", 2024-09-14T09:09:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.128e-06 2024-09-14T09:09:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801029+0000", 2024-09-14T09:09:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017668460000000001 2024-09-14T09:09:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801032+0000", 2024-09-14T09:09:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3179999999999998e-06 2024-09-14T09:09:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791011+0000", 2024-09-14T09:09:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98997920399999995 2024-09-14T09:09:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791077+0000", 2024-09-14T09:09:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5214000000000003e-05 2024-09-14T09:09:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791136+0000", 2024-09-14T09:09:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9710000000000003e-05 2024-09-14T09:09:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:368 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.541594113999999, 2024-09-14T09:09:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99201753800000003, 2024-09-14T09:09:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 368 2024-09-14T09:09:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4900000000000002e-07 2024-09-14T09:09:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799267+0000", 2024-09-14T09:09:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.079e-06 2024-09-14T09:09:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799270+0000", 2024-09-14T09:09:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.993e-06 2024-09-14T09:09:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799272+0000", 2024-09-14T09:09:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.695e-06 2024-09-14T09:09:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801043+0000", 2024-09-14T09:09:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001771105 2024-09-14T09:09:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801046+0000", 2024-09-14T09:09:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7999999999999999e-06 2024-09-14T09:09:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791150+0000", 2024-09-14T09:09:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99010348699999995 2024-09-14T09:09:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791193+0000", 2024-09-14T09:09:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3615999999999997e-05 2024-09-14T09:09:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791283+0000", 2024-09-14T09:09:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9513999999999997e-05 2024-09-14T09:09:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:369 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.541583776000003, 2024-09-14T09:09:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99213433600000001, 2024-09-14T09:09:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 369 2024-09-14T09:09:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:09:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799277+0000", 2024-09-14T09:09:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.108e-06 2024-09-14T09:09:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799280+0000", 2024-09-14T09:09:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:09:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799283+0000", 2024-09-14T09:09:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.531e-06 2024-09-14T09:09:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801058+0000", 2024-09-14T09:09:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001775085 2024-09-14T09:09:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801060+0000", 2024-09-14T09:09:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8260000000000001e-06 2024-09-14T09:09:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791299+0000", 2024-09-14T09:09:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99023856799999999 2024-09-14T09:09:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791352+0000", 2024-09-14T09:09:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2528000000000003e-05 2024-09-14T09:09:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791410+0000", 2024-09-14T09:09:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8298000000000003e-05 2024-09-14T09:09:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:370 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2457600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.541559008999997, 2024-09-14T09:09:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99220795399999995, 2024-09-14T09:09:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 370 2024-09-14T09:09:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799301+0000", 2024-09-14T09:09:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2024-09-14T09:09:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799303+0000", 2024-09-14T09:09:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9319999999999999e-06 2024-09-14T09:09:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799310+0000", 2024-09-14T09:09:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8680000000000001e-06 2024-09-14T09:09:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799315+0000", 2024-09-14T09:09:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.921e-06 2024-09-14T09:09:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801071+0000", 2024-09-14T09:09:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001756678 2024-09-14T09:09:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801080+0000", 2024-09-14T09:09:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6060000000000003e-06 2024-09-14T09:09:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791429+0000", 2024-09-14T09:09:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99034944599999997 2024-09-14T09:09:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791471+0000", 2024-09-14T09:09:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1279999999999998e-05 2024-09-14T09:09:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791508+0000", 2024-09-14T09:09:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7663999999999997e-05 2024-09-14T09:09:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:371 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2916352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.541537837, 2024-09-14T09:09:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99228692299999999, 2024-09-14T09:09:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 371 2024-09-14T09:09:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799322+0000", 2024-09-14T09:09:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:09:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799333+0000", 2024-09-14T09:09:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1044e-05 2024-09-14T09:09:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799341+0000", 2024-09-14T09:09:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8439999999999998e-06 2024-09-14T09:09:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799354+0000", 2024-09-14T09:09:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3114e-05 2024-09-14T09:09:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801093+0000", 2024-09-14T09:09:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017385910000000001 2024-09-14T09:09:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801096+0000", 2024-09-14T09:09:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0680000000000001e-06 2024-09-14T09:09:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791528+0000", 2024-09-14T09:09:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99043264200000003 2024-09-14T09:09:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791570+0000", 2024-09-14T09:09:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2144999999999997e-05 2024-09-14T09:09:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791608+0000", 2024-09-14T09:09:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7966000000000002e-05 2024-09-14T09:09:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:372 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3375104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.541497288999999, 2024-09-14T09:09:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992342897, 2024-09-14T09:09:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 372 2024-09-14T09:09:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799363+0000", 2024-09-14T09:09:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2024-09-14T09:09:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799365+0000", 2024-09-14T09:09:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5500000000000001e-06 2024-09-14T09:09:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799371+0000", 2024-09-14T09:09:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2500000000000003e-06 2024-09-14T09:09:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799377+0000", 2024-09-14T09:09:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7509999999999997e-06 2024-09-14T09:09:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801107+0000", 2024-09-14T09:09:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017298019999999999 2024-09-14T09:09:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801111+0000", 2024-09-14T09:09:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8619999999999996e-06 2024-09-14T09:09:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791626+0000", 2024-09-14T09:09:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99051563300000001 2024-09-14T09:09:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791668+0000", 2024-09-14T09:09:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1424000000000002e-05 2024-09-14T09:09:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791705+0000", 2024-09-14T09:09:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7035e-05 2024-09-14T09:09:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:373 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.541475343999998, 2024-09-14T09:09:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99253589399999997, 2024-09-14T09:09:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 373 2024-09-14T09:09:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2024-09-14T09:09:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799387+0000", 2024-09-14T09:09:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1019999999999999e-06 2024-09-14T09:09:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799393+0000", 2024-09-14T09:09:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0190000000000003e-06 2024-09-14T09:09:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799398+0000", 2024-09-14T09:09:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:09:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801123+0000", 2024-09-14T09:09:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017251949999999999 2024-09-14T09:09:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801126+0000", 2024-09-14T09:09:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9280000000000002e-06 2024-09-14T09:09:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791746+0000", 2024-09-14T09:09:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99062036899999995 2024-09-14T09:09:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791835+0000", 2024-09-14T09:09:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9004000000000004e-05 2024-09-14T09:09:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791920+0000", 2024-09-14T09:09:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4524000000000006e-05 2024-09-14T09:09:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:60352 3.0 3.6d62a5c0 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:09:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.958839506, 2024-09-14T09:09:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41710537399999997, 2024-09-14T09:09:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 60352 2024-09-14T09:09:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:09:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:09:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382044+0000", 2024-09-14T09:09:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4640000000000001e-05 2024-09-14T09:09:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382048+0000", 2024-09-14T09:09:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4690000000000002e-06 2024-09-14T09:09:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382053+0000", 2024-09-14T09:09:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:09:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382068+0000", 2024-09-14T09:09:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4399000000000001e-05 2024-09-14T09:09:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382121+0000", 2024-09-14T09:09:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3578000000000001e-05 2024-09-14T09:09:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382127+0000", 2024-09-14T09:09:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2024-09-14T09:09:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799116+0000", 2024-09-14T09:09:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.416988566 2024-09-14T09:09:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799125+0000", 2024-09-14T09:09:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3100000000000006e-06 2024-09-14T09:09:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:63559 3.0 3.95b285c0 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.953008133000001, 2024-09-14T09:09:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.411301215, 2024-09-14T09:09:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 63559 2024-09-14T09:09:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2499999999999999e-07 2024-09-14T09:09:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387853+0000", 2024-09-14T09:09:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.477e-06 2024-09-14T09:09:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387856+0000", 2024-09-14T09:09:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1429999999999998e-06 2024-09-14T09:09:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387859+0000", 2024-09-14T09:09:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.582e-06 2024-09-14T09:09:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387888+0000", 2024-09-14T09:09:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9609000000000001e-05 2024-09-14T09:09:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387893+0000", 2024-09-14T09:09:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6779999999999999e-06 2024-09-14T09:09:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799143+0000", 2024-09-14T09:09:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41124997099999999 2024-09-14T09:09:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799152+0000", 2024-09-14T09:09:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5300000000000002e-06 2024-09-14T09:09:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:27.444 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:27.446 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:09:27.446 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:27.447+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:27.546 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:27.548+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:27.550 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:27.550 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:27.550 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:09:27.551 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:27.559 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:09:27.647 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:27.649+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:27.702 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:27.702 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:27.702 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:27.702 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:27.702 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:27.710 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:09:27.712 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:09:27.748 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:27.750+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:27.848 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:27.850+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:27.860 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:27.860 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:27.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55979 3.e 3:740d1568:::rbd_data.1112a10502fe.0000000000000133:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.010973822, 2024-09-14T09:09:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.95211669700000001, 2024-09-14T09:09:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:27.861 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55979 2024-09-14T09:09:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850380+0000", 2024-09-14T09:09:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.615e-06 2024-09-14T09:09:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850386+0000", 2024-09-14T09:09:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8000000000000001e-06 2024-09-14T09:09:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850403+0000", 2024-09-14T09:09:27.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6339999999999999e-05 2024-09-14T09:09:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850413+0000", 2024-09-14T09:09:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8609999999999993e-06 2024-09-14T09:09:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851033+0000", 2024-09-14T09:09:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062034700000000004 2024-09-14T09:09:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:09:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851042+0000", 2024-09-14T09:09:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8340000000000005e-06 2024-09-14T09:09:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853175+0000", 2024-09-14T09:09:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0021332809999999999 2024-09-14T09:09:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853183+0000", 2024-09-14T09:09:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:09:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795232+0000", 2024-09-14T09:09:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94204854900000001 2024-09-14T09:09:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795413+0000", 2024-09-14T09:09:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018059200000000001 2024-09-14T09:09:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:09:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795717+0000", 2024-09-14T09:09:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000304636 2024-09-14T09:09:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799631+0000", 2024-09-14T09:09:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136910000000004 2024-09-14T09:09:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802290+0000", 2024-09-14T09:09:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026588010000000001 2024-09-14T09:09:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802362+0000", 2024-09-14T09:09:27.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2018000000000001e-05 2024-09-14T09:09:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802495+0000", 2024-09-14T09:09:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000132967 2024-09-14T09:09:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55990 3.e 3:72d6260e:::rbd_data.1112a10502fe.000000000000016c:head [stat,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:27.868 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 12.010912514999999, 2024-09-14T09:09:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.952433164, 2024-09-14T09:09:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55990 2024-09-14T09:09:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:27.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850440+0000", 2024-09-14T09:09:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5199999999999996e-07 2024-09-14T09:09:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850444+0000", 2024-09-14T09:09:27.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.019e-06 2024-09-14T09:09:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850452+0000", 2024-09-14T09:09:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0209999999999999e-06 2024-09-14T09:09:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850457+0000", 2024-09-14T09:09:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9529999999999998e-06 2024-09-14T09:09:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851100+0000", 2024-09-14T09:09:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00064299699999999997 2024-09-14T09:09:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851108+0000", 2024-09-14T09:09:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2279999999999998e-06 2024-09-14T09:09:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853208+0000", 2024-09-14T09:09:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020996579999999999 2024-09-14T09:09:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853213+0000", 2024-09-14T09:09:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4029999999999998e-06 2024-09-14T09:09:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796098+0000", 2024-09-14T09:09:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94288483700000003 2024-09-14T09:09:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796247+0000", 2024-09-14T09:09:27.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014925800000000001 2024-09-14T09:09:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802872+0000", 2024-09-14T09:09:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006625138 2024-09-14T09:09:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 11.846673742, 2024-09-14T09:09:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77465830800000002, 2024-09-14T09:09:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 58987 2024-09-14T09:09:27.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014680+0000", 2024-09-14T09:09:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9250000000000002e-06 2024-09-14T09:09:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014689+0000", 2024-09-14T09:09:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9730000000000003e-06 2024-09-14T09:09:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014709+0000", 2024-09-14T09:09:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9641999999999999e-05 2024-09-14T09:09:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014720+0000", 2024-09-14T09:09:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-09-14T09:09:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014796+0000", 2024-09-14T09:09:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6567000000000001e-05 2024-09-14T09:09:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014808+0000", 2024-09-14T09:09:27.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1435e-05 2024-09-14T09:09:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789325+0000", 2024-09-14T09:09:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77451705999999998 2024-09-14T09:09:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789336+0000", 2024-09-14T09:09:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1466e-05 2024-09-14T09:09:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:59017 3.3 3.6b81fb83 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 11.845021338, 2024-09-14T09:09:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77253447099999994, 2024-09-14T09:09:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 59017 2024-09-14T09:09:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.880 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:27.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016332+0000", 2024-09-14T09:09:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3459999999999999e-06 2024-09-14T09:09:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016337+0000", 2024-09-14T09:09:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.48e-06 2024-09-14T09:09:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016355+0000", 2024-09-14T09:09:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7955e-05 2024-09-14T09:09:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016364+0000", 2024-09-14T09:09:27.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.02e-06 2024-09-14T09:09:27.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016433+0000", 2024-09-14T09:09:27.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8398000000000005e-05 2024-09-14T09:09:27.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016442+0000", 2024-09-14T09:09:27.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1819999999999995e-06 2024-09-14T09:09:27.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788855+0000", 2024-09-14T09:09:27.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77241356299999997 2024-09-14T09:09:27.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:27.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788865+0000", 2024-09-14T09:09:27.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5270000000000004e-06 2024-09-14T09:09:27.884 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.884 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:27.884 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.884 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60343 3.e 3:721b16e6:::rbd_data.1112a10502fe.000000000000014b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:27.885 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:27.885 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 11.741051735999999, 2024-09-14T09:09:27.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68876920900000005, 2024-09-14T09:09:27.885 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:27.885 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:27.885 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:27.885 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:27.885 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:27.885 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:27.885 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60343 2024-09-14T09:09:27.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.885 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:27.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120302+0000", 2024-09-14T09:09:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0279999999999999e-06 2024-09-14T09:09:27.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120310+0000", 2024-09-14T09:09:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4330000000000004e-06 2024-09-14T09:09:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120333+0000", 2024-09-14T09:09:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2200000000000001e-05 2024-09-14T09:09:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120343+0000", 2024-09-14T09:09:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0560000000000001e-05 2024-09-14T09:09:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120414+0000", 2024-09-14T09:09:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0493000000000004e-05 2024-09-14T09:09:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120424+0000", 2024-09-14T09:09:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.059e-05 2024-09-14T09:09:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796679+0000", 2024-09-14T09:09:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67625512700000001 2024-09-14T09:09:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796833+0000", 2024-09-14T09:09:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015403500000000001 2024-09-14T09:09:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:09:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797239+0000", 2024-09-14T09:09:27.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040503000000000002 2024-09-14T09:09:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802918+0000", 2024-09-14T09:09:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056796199999999998 2024-09-14T09:09:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808655+0000", 2024-09-14T09:09:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057365089999999999 2024-09-14T09:09:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:27.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808850+0000", 2024-09-14T09:09:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000194904 2024-09-14T09:09:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809069+0000", 2024-09-14T09:09:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021968000000000001 2024-09-14T09:09:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60356 3.2 3:40f9e9e7:::rbd_data.1112a10502fe.0000000000000160:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:27.891 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 11.739989223, 2024-09-14T09:09:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68053790800000002, 2024-09-14T09:09:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60356 2024-09-14T09:09:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:27.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121364+0000", 2024-09-14T09:09:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.173e-06 2024-09-14T09:09:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121371+0000", 2024-09-14T09:09:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-09-14T09:09:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121386+0000", 2024-09-14T09:09:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4925e-05 2024-09-14T09:09:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121395+0000", 2024-09-14T09:09:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8190000000000003e-06 2024-09-14T09:09:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121464+0000", 2024-09-14T09:09:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8149000000000001e-05 2024-09-14T09:09:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121474+0000", 2024-09-14T09:09:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0927999999999999e-05 2024-09-14T09:09:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795901+0000", 2024-09-14T09:09:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67442645499999998 2024-09-14T09:09:27.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796068+0000", 2024-09-14T09:09:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016655700000000001 2024-09-14T09:09:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 3", 2024-09-14T09:09:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796354+0000", 2024-09-14T09:09:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00028646999999999999 2024-09-14T09:09:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:27.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.800348+0000", 2024-09-14T09:09:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039943119999999999 2024-09-14T09:09:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801690+0000", 2024-09-14T09:09:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013415090000000001 2024-09-14T09:09:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801771+0000", 2024-09-14T09:09:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1678e-05 2024-09-14T09:09:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801900+0000", 2024-09-14T09:09:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000128978 2024-09-14T09:09:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62163 3.e 3:713ab431:::rbd_data.1112a10502fe.0000000000000198:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 11.649619016000001, 2024-09-14T09:09:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.597552682, 2024-09-14T09:09:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:27.898 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62163 2024-09-14T09:09:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211735+0000", 2024-09-14T09:09:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1110000000000002e-06 2024-09-14T09:09:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211744+0000", 2024-09-14T09:09:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0790000000000007e-06 2024-09-14T09:09:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:27.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211765+0000", 2024-09-14T09:09:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1114000000000001e-05 2024-09-14T09:09:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211775+0000", 2024-09-14T09:09:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0033e-05 2024-09-14T09:09:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211847+0000", 2024-09-14T09:09:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1503999999999998e-05 2024-09-14T09:09:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211857+0000", 2024-09-14T09:09:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0378e-05 2024-09-14T09:09:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799140+0000", 2024-09-14T09:09:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.58728279100000003 2024-09-14T09:09:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799289+0000", 2024-09-14T09:09:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000148966 2024-09-14T09:09:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809285+0000", 2024-09-14T09:09:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099967059999999993 2024-09-14T09:09:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63582 3.2 3:467f2009:::rbd_data.1112a10502fe.00000000000001a1:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 11.574425899, 2024-09-14T09:09:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51869012999999997, 2024-09-14T09:09:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:27.903 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63582 2024-09-14T09:09:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286928+0000", 2024-09-14T09:09:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.812e-06 2024-09-14T09:09:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286936+0000", 2024-09-14T09:09:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2390000000000002e-06 2024-09-14T09:09:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286955+0000", 2024-09-14T09:09:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8853000000000001e-05 2024-09-14T09:09:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286972+0000", 2024-09-14T09:09:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7365000000000001e-05 2024-09-14T09:09:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287052+0000", 2024-09-14T09:09:27.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9491000000000002e-05 2024-09-14T09:09:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287063+0000", 2024-09-14T09:09:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1620999999999999e-05 2024-09-14T09:09:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796696+0000", 2024-09-14T09:09:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50963256999999995 2024-09-14T09:09:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:27.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796847+0000", 2024-09-14T09:09:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015126899999999999 2024-09-14T09:09:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.805616+0000", 2024-09-14T09:09:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087689099999999996 2024-09-14T09:09:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:27.908 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63586 3.3 3.d4e49b03 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 11.574341518000001, 2024-09-14T09:09:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50188935099999998, 2024-09-14T09:09:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:27.909 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63586 2024-09-14T09:09:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.910 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287011+0000", 2024-09-14T09:09:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.61e-07 2024-09-14T09:09:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287014+0000", 2024-09-14T09:09:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3900000000000002e-06 2024-09-14T09:09:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287023+0000", 2024-09-14T09:09:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3380000000000005e-06 2024-09-14T09:09:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287029+0000", 2024-09-14T09:09:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0079999999999999e-06 2024-09-14T09:09:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287087+0000", 2024-09-14T09:09:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8322000000000002e-05 2024-09-14T09:09:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287096+0000", 2024-09-14T09:09:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8580000000000006e-06 2024-09-14T09:09:27.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788891+0000", 2024-09-14T09:09:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50179498499999997 2024-09-14T09:09:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788900+0000", 2024-09-14T09:09:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.789e-06 2024-09-14T09:09:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60363 3.1d 3:b8b44067:::rbd_data.1112a10502fe.000000000000018b:head [stat,delete] snapc 21=[21] RETRY=12 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 11.07361978, 2024-09-14T09:09:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268612690000001, 2024-09-14T09:09:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60363 2024-09-14T09:09:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:27.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787733+0000", 2024-09-14T09:09:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.314e-06 2024-09-14T09:09:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787739+0000", 2024-09-14T09:09:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5300000000000004e-06 2024-09-14T09:09:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787750+0000", 2024-09-14T09:09:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1251e-05 2024-09-14T09:09:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0739999999999993e-06 2024-09-14T09:09:27.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787827+0000", 2024-09-14T09:09:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8861000000000004e-05 2024-09-14T09:09:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:09:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787836+0000", 2024-09-14T09:09:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1339999999999993e-06 2024-09-14T09:09:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789335+0000", 2024-09-14T09:09:27.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014988289999999999 2024-09-14T09:09:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789343+0000", 2024-09-14T09:09:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6639999999999998e-06 2024-09-14T09:09:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799170+0000", 2024-09-14T09:09:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098272500000001 2024-09-14T09:09:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:27.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799377+0000", 2024-09-14T09:09:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000207126 2024-09-14T09:09:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814593+0000", 2024-09-14T09:09:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015216235999999999 2024-09-14T09:09:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63565 3.1d 3:bdc63b28:::rbd_data.1112a10502fe.000000000000016d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=9 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:27.919 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 11.073573989, 2024-09-14T09:09:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0271114539999999, 2024-09-14T09:09:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63565 2024-09-14T09:09:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6899999999999998e-07 2024-09-14T09:09:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:27.921 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787781+0000", 2024-09-14T09:09:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8909999999999999e-06 2024-09-14T09:09:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787787+0000", 2024-09-14T09:09:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3230000000000003e-06 2024-09-14T09:09:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787793+0000", 2024-09-14T09:09:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-09-14T09:09:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789455+0000", 2024-09-14T09:09:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001661596 2024-09-14T09:09:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789463+0000", 2024-09-14T09:09:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4889999999999995e-06 2024-09-14T09:09:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800115+0000", 2024-09-14T09:09:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0106512670000001 2024-09-14T09:09:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800334+0000", 2024-09-14T09:09:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000219213 2024-09-14T09:09:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:09:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800651+0000", 2024-09-14T09:09:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00031765500000000002 2024-09-14T09:09:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.811875+0000", 2024-09-14T09:09:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011224032 2024-09-14T09:09:27.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814665+0000", 2024-09-14T09:09:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002789606 2024-09-14T09:09:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814742+0000", 2024-09-14T09:09:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6916999999999996e-05 2024-09-14T09:09:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814889+0000", 2024-09-14T09:09:27.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014725799999999999 2024-09-14T09:09:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:67113 3.1d 3:bba7fe0d:::rbd_data.1112a10502fe.00000000000001bf:head [stat,delete] snapc 21=[21] RETRY=4 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 11.072813131, 2024-09-14T09:09:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0265995649999999, 2024-09-14T09:09:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:27.926 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 67113 2024-09-14T09:09:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.927 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:09:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788543+0000", 2024-09-14T09:09:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-09-14T09:09:27.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788552+0000", 2024-09-14T09:09:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:09:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788559+0000", 2024-09-14T09:09:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:09:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789489+0000", 2024-09-14T09:09:27.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00092982199999999996 2024-09-14T09:09:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789497+0000", 2024-09-14T09:09:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6299999999999998e-06 2024-09-14T09:09:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801068+0000", 2024-09-14T09:09:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0115709530000001 2024-09-14T09:09:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:27.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801240+0000", 2024-09-14T09:09:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017276600000000001 2024-09-14T09:09:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815138+0000", 2024-09-14T09:09:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013897856 2024-09-14T09:09:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73412 3.1d 3:be4606c3:::rbd_data.1112a10502fe.00000000000001f2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:27.931 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 11.072782019, 2024-09-14T09:09:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026815928, 2024-09-14T09:09:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73412 2024-09-14T09:09:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5699999999999998e-07 2024-09-14T09:09:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788572+0000", 2024-09-14T09:09:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2809999999999998e-06 2024-09-14T09:09:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788579+0000", 2024-09-14T09:09:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5629999999999997e-06 2024-09-14T09:09:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788584+0000", 2024-09-14T09:09:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1710000000000001e-06 2024-09-14T09:09:27.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789521+0000", 2024-09-14T09:09:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00093657400000000002 2024-09-14T09:09:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789528+0000", 2024-09-14T09:09:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5719999999999997e-06 2024-09-14T09:09:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801631+0000", 2024-09-14T09:09:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0121023229999999 2024-09-14T09:09:27.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801792+0000", 2024-09-14T09:09:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016174000000000001 2024-09-14T09:09:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815386+0000", 2024-09-14T09:09:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013593246999999999 2024-09-14T09:09:27.936 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.937 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:27.937 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.937 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:77244 3.1d 3:b801be19:::rbd_data.1112a10502fe.0000000000000204:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.890917773, 2024-09-14T09:09:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.84519277100000001, 2024-09-14T09:09:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 77244 2024-09-14T09:09:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970436+0000", 2024-09-14T09:09:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.511e-06 2024-09-14T09:09:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970441+0000", 2024-09-14T09:09:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0470000000000001e-06 2024-09-14T09:09:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970453+0000", 2024-09-14T09:09:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2629999999999999e-05 2024-09-14T09:09:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970461+0000", 2024-09-14T09:09:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6850000000000001e-06 2024-09-14T09:09:27.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970524+0000", 2024-09-14T09:09:27.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3332999999999998e-05 2024-09-14T09:09:27.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970544+0000", 2024-09-14T09:09:27.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9731000000000001e-05 2024-09-14T09:09:27.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802188+0000", 2024-09-14T09:09:27.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.83164380000000004 2024-09-14T09:09:27.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:27.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:09:27.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015411999999999999 2024-09-14T09:09:27.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:27.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815627+0000", 2024-09-14T09:09:27.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013284914 2024-09-14T09:09:27.942 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.942 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:27.942 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.942 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:79796 3.1d 3:bc22caaf:::rbd_data.1112a10502fe.000000000000020c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:27.943 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:27.943 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.769609086999999, 2024-09-14T09:09:27.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72411694299999996, 2024-09-14T09:09:27.943 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:27.943 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:27.943 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:27.943 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:27.943 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:27.943 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:27.943 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 79796 2024-09-14T09:09:27.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.943 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:27.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:27.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:27.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:27.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:27.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:27.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091745+0000", 2024-09-14T09:09:27.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2000000000000001e-06 2024-09-14T09:09:27.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:27.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091752+0000", 2024-09-14T09:09:27.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-09-14T09:09:27.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:27.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091772+0000", 2024-09-14T09:09:27.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9822000000000001e-05 2024-09-14T09:09:27.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091791+0000", 2024-09-14T09:09:27.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9236e-05 2024-09-14T09:09:27.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091882+0000", 2024-09-14T09:09:27.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0783000000000001e-05 2024-09-14T09:09:27.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091892+0000", 2024-09-14T09:09:27.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7999999999999993e-06 2024-09-14T09:09:27.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802744+0000", 2024-09-14T09:09:27.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.710851868 2024-09-14T09:09:27.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:27.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802902+0000", 2024-09-14T09:09:27.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015814900000000001 2024-09-14T09:09:27.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:27.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815860+0000", 2024-09-14T09:09:27.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012957605000000001 2024-09-14T09:09:27.947 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.947 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:27.947 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.948 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80904 3.1d 3:be0e7f3d:::rbd_data.1112a10502fe.0000000000000214:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:27.948 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:27.948 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.68952324, 2024-09-14T09:09:27.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64435178100000001, 2024-09-14T09:09:27.948 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:27.948 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:27.948 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:27.948 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:27.948 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:27.948 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:27.948 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80904 2024-09-14T09:09:27.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.948 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:27.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:27.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:27.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:27.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:27.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:27.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171831+0000", 2024-09-14T09:09:27.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0729999999999999e-06 2024-09-14T09:09:27.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:27.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171839+0000", 2024-09-14T09:09:27.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9179999999999994e-06 2024-09-14T09:09:27.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:27.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171857+0000", 2024-09-14T09:09:27.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8957000000000002e-05 2024-09-14T09:09:27.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171867+0000", 2024-09-14T09:09:27.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7100000000000002e-06 2024-09-14T09:09:27.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171957+0000", 2024-09-14T09:09:27.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9932999999999994e-05 2024-09-14T09:09:27.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171974+0000", 2024-09-14T09:09:27.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6988999999999999e-05 2024-09-14T09:09:27.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803301+0000", 2024-09-14T09:09:27.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63132648599999996 2024-09-14T09:09:27.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:27.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803482+0000", 2024-09-14T09:09:27.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000181607 2024-09-14T09:09:27.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:27.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816180+0000", 2024-09-14T09:09:27.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012698108 2024-09-14T09:09:27.953 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.953 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:27.953 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.953 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80964 3.1d 3:be42e20f:::rbd_data.1112a10502fe.0000000000000219:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:27.953 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:27.953 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.683887672999999, 2024-09-14T09:09:27.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63896829799999999, 2024-09-14T09:09:27.953 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:27.953 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:27.954 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:27.954 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:27.954 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:27.954 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:27.954 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80964 2024-09-14T09:09:27.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.954 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:27.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:27.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:27.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:27.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:27.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:27.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177466+0000", 2024-09-14T09:09:27.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6610000000000001e-06 2024-09-14T09:09:27.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:27.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177472+0000", 2024-09-14T09:09:27.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3029999999999996e-06 2024-09-14T09:09:27.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:27.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177490+0000", 2024-09-14T09:09:27.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8099000000000001e-05 2024-09-14T09:09:27.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177499+0000", 2024-09-14T09:09:27.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:09:27.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177560+0000", 2024-09-14T09:09:27.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1334000000000006e-05 2024-09-14T09:09:27.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177578+0000", 2024-09-14T09:09:27.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8434999999999999e-05 2024-09-14T09:09:27.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803910+0000", 2024-09-14T09:09:27.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62633190699999997 2024-09-14T09:09:27.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:27.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.806612+0000", 2024-09-14T09:09:27.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002702257 2024-09-14T09:09:27.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:27.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816432+0000", 2024-09-14T09:09:27.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098199370000000008 2024-09-14T09:09:27.958 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.958 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:27.958 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.958 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83321 3.1d 3:bb24b47b:::rbd_data.1112a10502fe.0000000000000223:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:27.958 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:27.958 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.569433998999999, 2024-09-14T09:09:27.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52477628799999998, 2024-09-14T09:09:27.958 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:27.959 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:27.959 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:27.959 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:27.959 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:27.959 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:27.959 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83321 2024-09-14T09:09:27.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.959 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:27.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:27.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:27.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:27.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:27.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:27.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291920+0000", 2024-09-14T09:09:27.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.888e-06 2024-09-14T09:09:27.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:27.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291926+0000", 2024-09-14T09:09:27.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6059999999999999e-06 2024-09-14T09:09:27.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:27.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291943+0000", 2024-09-14T09:09:27.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6813e-05 2024-09-14T09:09:27.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291952+0000", 2024-09-14T09:09:27.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7439999999999996e-06 2024-09-14T09:09:27.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292023+0000", 2024-09-14T09:09:27.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1320000000000002e-05 2024-09-14T09:09:27.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292030+0000", 2024-09-14T09:09:27.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4219999999999997e-06 2024-09-14T09:09:27.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807221+0000", 2024-09-14T09:09:27.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51519140699999999 2024-09-14T09:09:27.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:27.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807406+0000", 2024-09-14T09:09:27.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018532800000000001 2024-09-14T09:09:27.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:27.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816694+0000", 2024-09-14T09:09:27.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092877600000000008 2024-09-14T09:09:27.963 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.963 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:27.963 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.963 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83358 3.1d 3:bb230e23:::rbd_data.1112a10502fe.000000000000022b:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:27.963 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:27.964 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.567914109, 2024-09-14T09:09:27.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52374808900000003, 2024-09-14T09:09:27.964 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:27.964 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:27.964 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:27.964 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:27.964 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:27.964 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:27.964 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83358 2024-09-14T09:09:27.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.964 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:27.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:27.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:27.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:27.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:27.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:27.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293439+0000", 2024-09-14T09:09:27.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5899999999999995e-07 2024-09-14T09:09:27.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:27.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293443+0000", 2024-09-14T09:09:27.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9309999999999999e-06 2024-09-14T09:09:27.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:27.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293457+0000", 2024-09-14T09:09:27.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3944999999999999e-05 2024-09-14T09:09:27.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293466+0000", 2024-09-14T09:09:27.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4319999999999999e-06 2024-09-14T09:09:27.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293530+0000", 2024-09-14T09:09:27.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3860000000000002e-05 2024-09-14T09:09:27.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293540+0000", 2024-09-14T09:09:27.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0107e-05 2024-09-14T09:09:27.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809096+0000", 2024-09-14T09:09:27.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51555587800000002 2024-09-14T09:09:27.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:27.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809265+0000", 2024-09-14T09:09:27.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000169092 2024-09-14T09:09:27.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:27.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817186+0000", 2024-09-14T09:09:27.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079209850000000002 2024-09-14T09:09:27.968 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.968 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:27.968 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.969 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83361 3.1d 3:bd571564:::rbd_data.1112a10502fe.000000000000022c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:27.969 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:27.969 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.567596033000001, 2024-09-14T09:09:27.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52373873100000001, 2024-09-14T09:09:27.969 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:27.969 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:27.969 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:27.969 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:27.969 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:27.969 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:27.969 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83361 2024-09-14T09:09:27.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.969 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:27.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:27.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:27.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:27.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:27.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:27.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:27.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293757+0000", 2024-09-14T09:09:27.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8000000000000004e-07 2024-09-14T09:09:27.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:27.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293762+0000", 2024-09-14T09:09:27.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8019999999999997e-06 2024-09-14T09:09:27.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:27.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293775+0000", 2024-09-14T09:09:27.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2884000000000001e-05 2024-09-14T09:09:27.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:27.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293783+0000", 2024-09-14T09:09:27.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:09:27.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293849+0000", 2024-09-14T09:09:27.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5859999999999996e-05 2024-09-14T09:09:27.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:27.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293861+0000", 2024-09-14T09:09:27.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2238999999999999e-05 2024-09-14T09:09:27.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:27.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809680+0000", 2024-09-14T09:09:27.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51581856800000003 2024-09-14T09:09:27.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:27.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809844+0000", 2024-09-14T09:09:27.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016441200000000001 2024-09-14T09:09:27.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:27.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:27.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:27.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817494+0000", 2024-09-14T09:09:27.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076502360000000004 2024-09-14T09:09:27.973 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.973 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:27.973 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.973 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:27.973 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:27.974 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:27.975 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:27.976+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:27.976 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:27.976 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:09:27.977 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:27.977 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:27.977 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:27.977 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:09:27.978 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:09:27.978 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:27.978 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:27.979 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:27.979 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:27.996 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:27.996 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:28.077 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:28.078+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:28.086 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:28.086 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:28.093 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone33 from 0x3f70600 (overlap 0x1fc800) to 0x196c00 2024-09-14T09:09:28.095 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:09:28.178 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:28.179+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:28.201 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:28.201 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:28.210 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:09:28.278 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:28.280+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:28.314 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:28.314 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:28.323 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:09:28.407 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:28.409+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:28.469 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:28.470 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:28.476 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #32, image image_client.0-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent33 2024-09-14T09:09:28.478 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:09:28.519 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:28.521+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:28.527 INFO:teuthology.orchestra.run.smithi148.stdout:5192 trunc from 0x3f70600 to 0x831a200 2024-09-14T09:09:28.545 INFO:teuthology.orchestra.run.smithi148.stdout:5193 read 0x1a0e600 thru 0x1a16ab2 (0x84b3 bytes) 2024-09-14T09:09:28.545 INFO:teuthology.orchestra.run.smithi148.stdout:5194 punch from 0x241f200 to 0x2421400, (0x2200 bytes) 2024-09-14T09:09:28.551 INFO:teuthology.orchestra.run.smithi148.stdout:5195 trunc from 0x831a200 to 0xb3d3400 2024-09-14T09:09:28.580 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:28.582+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:28.589 INFO:teuthology.orchestra.run.smithi148.stdout:5196 write 0xc6fde00 thru 0xc703eb2 (0x60b3 bytes) 2024-09-14T09:09:28.589 INFO:teuthology.orchestra.run.smithi148.stdout:5199 clone 35 order 22 su 2097152 sc 6 2024-09-14T09:09:28.626 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:28.626 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:28.634 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:09:28.681 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:28.683+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:28.777 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:28.777 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:28.782 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:28.784+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:28.786 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:09:28.883 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:28.885+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:28.899 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:28.899 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:28.908 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:09:28.916 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T09:09:28.984 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:28.986+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:29.015 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:29.015 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:29.024 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:09:29.042 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone34 from 0xc704000 (overlap 0x3f70600) to 0x0 2024-09-14T09:09:29.084 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:29.086+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:29.143 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:29.143 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:29.152 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:09:29.186 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:29.188+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:29.286 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:29.288+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:29.299 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:29.299 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:29.307 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:09:29.392 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:29.394+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:29.452 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:29.453 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:29.461 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:09:29.488 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:29.490+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:29.589 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:29.590+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:29.609 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:29.609 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:29.618 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:09:29.689 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:29.690+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:29.723 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:29.723 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:29.732 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:29.744 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #33, image image_client.0-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent34 2024-09-14T09:09:29.790 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:29.792+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:29.809 INFO:teuthology.orchestra.run.smithi148.stdout:5200 read 0x68b8800 thru 0x68be8de (0x60df bytes) 2024-09-14T09:09:29.809 INFO:teuthology.orchestra.run.smithi148.stdout:5201 write 0x2bd600 thru 0x2c2f6b (0x596c bytes) 2024-09-14T09:09:29.811 INFO:teuthology.orchestra.run.smithi148.stdout:5202 read 0x40eb000 thru 0x40f0aae (0x5aaf bytes) 2024-09-14T09:09:29.812 INFO:teuthology.orchestra.run.smithi148.stdout:5204 write 0x3a64c00 thru 0x3a6984e (0x4c4f bytes) 2024-09-14T09:09:29.813 INFO:teuthology.orchestra.run.smithi148.stdout:5205 read 0x7665200 thru 0x766ba26 (0x6827 bytes) 2024-09-14T09:09:29.813 INFO:teuthology.orchestra.run.smithi148.stdout:5208 read 0xb44b000 thru 0xb455afe (0xaaff bytes) 2024-09-14T09:09:29.814 INFO:teuthology.orchestra.run.smithi148.stdout:5209 read 0xa937c00 thru 0xa94431e (0xc71f bytes) 2024-09-14T09:09:29.814 INFO:teuthology.orchestra.run.smithi148.stdout:5210 read 0xbb53600 thru 0xbb5d52b (0x9f2c bytes) 2024-09-14T09:09:29.826 INFO:teuthology.orchestra.run.smithi148.stdout:5211 trunc from 0xc704000 to 0x2a81c00 2024-09-14T09:09:29.857 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 1] out_osds: [] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 2] 2024-09-14T09:09:29.858 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:09:29.858 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-09-14T09:09:29.858 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-09-14T09:09:29.861 INFO:teuthology.orchestra.run.smithi148.stdout:5212 read 0x24f3800 thru 0x24f778e (0x3f8f bytes) 2024-09-14T09:09:29.878 INFO:teuthology.orchestra.run.smithi148.stdout:5213 write 0x3b23600 thru 0x3b2d048 (0x9a49 bytes) 2024-09-14T09:09:29.878 INFO:teuthology.orchestra.run.smithi148.stdout:5214 read 0x335d200 thru 0x3364e00 (0x7c01 bytes) 2024-09-14T09:09:29.878 INFO:teuthology.orchestra.run.smithi148.stdout:5215 write 0x74bc00 thru 0x75884f (0xcc50 bytes) 2024-09-14T09:09:29.885 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:29.885 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:29.896 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:09:29.902 INFO:teuthology.orchestra.run.smithi148.stdout:5216 write 0x76c7600 thru 0x76d5adb (0xe4dc bytes) 2024-09-14T09:09:29.903 INFO:teuthology.orchestra.run.smithi148.stdout:5217 write 0x1255c00 thru 0x125b251 (0x5652 bytes) 2024-09-14T09:09:29.903 INFO:teuthology.orchestra.run.smithi148.stdout:5218 punch from 0x4245000 to 0x4251000, (0xc000 bytes) 2024-09-14T09:09:29.904 INFO:teuthology.orchestra.run.smithi148.stdout:5219 write 0x6bc9800 thru 0x6bd4fb9 (0xb7ba bytes) 2024-09-14T09:09:29.904 INFO:teuthology.orchestra.run.smithi148.stdout:5220 read 0x64fd000 thru 0x64fedc6 (0x1dc7 bytes) 2024-09-14T09:09:29.904 INFO:teuthology.orchestra.run.smithi148.stdout:5221 punch from 0x6627200 to 0x662cc00, (0x5a00 bytes) 2024-09-14T09:09:29.904 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:29.906+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:29.924 INFO:teuthology.orchestra.run.smithi148.stdout:5222 write 0xa678a00 thru 0xa67cbac (0x41ad bytes) 2024-09-14T09:09:29.924 INFO:teuthology.orchestra.run.smithi148.stdout:5223 write 0x9eb0400 thru 0x9eb0bf7 (0x7f8 bytes) 2024-09-14T09:09:29.926 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is unset 2024-09-14T09:09:29.935 INFO:teuthology.orchestra.run.smithi148.stdout:5224 trunc from 0xa67cc00 to 0x10f6600 2024-09-14T09:09:29.965 INFO:teuthology.orchestra.run.smithi148.stdout:5226 read 0x596200 thru 0x5a4187 (0xdf88 bytes) 2024-09-14T09:09:29.966 INFO:teuthology.orchestra.run.smithi148.stdout:5228 read 0xcccc00 thru 0xcd2d94 (0x6195 bytes) 2024-09-14T09:09:29.967 INFO:teuthology.orchestra.run.smithi148.stdout:5229 read 0x1040c00 thru 0x104ccee (0xc0ef bytes) 2024-09-14T09:09:29.992 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:29.993+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:29.999 INFO:teuthology.orchestra.run.smithi148.stdout:5230 write 0xe75b800 thru 0xe765aeb (0xa2ec bytes) 2024-09-14T09:09:30.003 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-09-14T09:09:30.009 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:09:30.012 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:30.012 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:30.014 INFO:teuthology.orchestra.run.smithi148.stdout:5233 trunc from 0xe765c00 to 0x1d38e00 2024-09-14T09:09:30.022 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:09:30.034 INFO:teuthology.orchestra.run.smithi148.stdout:5234 trunc from 0x1d38e00 to 0x6f3400 2024-09-14T09:09:30.077 INFO:teuthology.orchestra.run.smithi148.stdout:5235 write 0x8f57200 thru 0x8f66100 (0xef01 bytes) 2024-09-14T09:09:30.080 INFO:teuthology.orchestra.run.smithi148.stdout:5236 trunc from 0x8f66200 to 0xa749800 2024-09-14T09:09:30.092 INFO:teuthology.orchestra.run.smithi148.stdout:5237 read 0xa47c000 thru 0xa486e7e (0xae7f bytes) 2024-09-14T09:09:30.092 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:30.094+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:30.105 INFO:teuthology.orchestra.run.smithi148.stdout:5242 trunc from 0xa749800 to 0x265400 2024-09-14T09:09:30.125 INFO:teuthology.orchestra.run.smithi148.stdout:5245 read 0x1bd600 thru 0x1c9103 (0xbb04 bytes) 2024-09-14T09:09:30.127 INFO:teuthology.orchestra.run.smithi148.stdout:5246 read 0x165200 thru 0x16a2c9 (0x50ca bytes) 2024-09-14T09:09:30.128 INFO:teuthology.orchestra.run.smithi148.stdout:5247 punch from 0x6e600 to 0x7ca00, (0xe400 bytes) 2024-09-14T09:09:30.128 INFO:teuthology.orchestra.run.smithi148.stdout:5249 read 0x52000 thru 0x60a1c (0xea1d bytes) 2024-09-14T09:09:30.131 INFO:teuthology.orchestra.run.smithi148.stdout:5250 read 0x157c00 thru 0x1641fb (0xc5fc bytes) 2024-09-14T09:09:30.157 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 reset_purged_snaps_last 2024-09-14T09:09:30.158 INFO:teuthology.orchestra.run.smithi148.stdout:5253 write 0x896c800 thru 0x896da5b (0x125c bytes) 2024-09-14T09:09:30.158 INFO:teuthology.orchestra.run.smithi148.stdout:5254 write 0x4626800 thru 0x462d49b (0x6c9c bytes) 2024-09-14T09:09:30.158 INFO:teuthology.orchestra.run.smithi148.stdout:5255 read 0x39a4e00 thru 0x39b1c2c (0xce2d bytes) 2024-09-14T09:09:30.171 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:30.171 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:30.173 INFO:teuthology.orchestra.run.smithi148.stdout:5256 write 0xb644800 thru 0xb64ae79 (0x667a bytes) 2024-09-14T09:09:30.175 INFO:teuthology.orchestra.run.smithi148.stdout:5257 write 0xaf3c00 thru 0xafa729 (0x6b2a bytes) 2024-09-14T09:09:30.175 INFO:teuthology.orchestra.run.smithi148.stdout:5258 read 0xab93800 thru 0xab9fddd (0xc5de bytes) 2024-09-14T09:09:30.175 INFO:teuthology.orchestra.run.smithi148.stdout:5259 write 0x365d200 thru 0x365e75d (0x155e bytes) 2024-09-14T09:09:30.175 INFO:teuthology.orchestra.run.smithi148.stdout:5263 punch from 0xacb9200 to 0xacc8e00, (0xfc00 bytes) 2024-09-14T09:09:30.176 INFO:teuthology.orchestra.run.smithi148.stdout:5266 read 0x8d11200 thru 0x8d1e943 (0xd744 bytes) 2024-09-14T09:09:30.176 INFO:teuthology.orchestra.run.smithi148.stdout:5267 punch from 0x5490600 to 0x549cc00, (0xc600 bytes) 2024-09-14T09:09:30.177 INFO:teuthology.orchestra.run.smithi148.stdout:5268 read 0x7319600 thru 0x732681d (0xd21e bytes) 2024-09-14T09:09:30.177 INFO:teuthology.orchestra.run.smithi148.stdout:5270 read 0x72a9a00 thru 0x72aa1e1 (0x7e2 bytes) 2024-09-14T09:09:30.177 INFO:teuthology.orchestra.run.smithi148.stdout:5271 write 0x2944c00 thru 0x2944cf2 (0xf3 bytes) 2024-09-14T09:09:30.177 INFO:teuthology.orchestra.run.smithi148.stdout:5273 read 0x64de600 thru 0x64e6927 (0x8328 bytes) 2024-09-14T09:09:30.177 INFO:teuthology.orchestra.run.smithi148.stdout:5278 write 0x8b54000 thru 0x8b5f3b4 (0xb3b5 bytes) 2024-09-14T09:09:30.184 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:09:30.193 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:30.194 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:30.194 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:30.195+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:30.195 INFO:teuthology.orchestra.run.smithi148.stdout:5279 write 0xd052000 thru 0xd0535a3 (0x15a4 bytes) 2024-09-14T09:09:30.200 INFO:teuthology.orchestra.run.smithi148.stdout:5281 punch from 0xbfc600 to 0xc05200, (0x8c00 bytes) 2024-09-14T09:09:30.201 INFO:teuthology.orchestra.run.smithi148.stdout:5283 punch from 0xc88ec00 to 0xc89ba00, (0xce00 bytes) 2024-09-14T09:09:30.201 INFO:teuthology.orchestra.run.smithi148.stdout:5285 punch from 0x35fb200 to 0x3603800, (0x8600 bytes) 2024-09-14T09:09:30.201 INFO:teuthology.orchestra.run.smithi148.stdout:5287 read 0x245b000 thru 0x2462095 (0x7096 bytes) 2024-09-14T09:09:30.202 INFO:teuthology.orchestra.run.smithi148.stdout:5288 read 0x9533800 thru 0x9534caf (0x14b0 bytes) 2024-09-14T09:09:30.202 INFO:teuthology.orchestra.run.smithi148.stdout:5290 punch from 0x5b7ca00 to 0x5b8ac00, (0xe200 bytes) 2024-09-14T09:09:30.206 INFO:teuthology.orchestra.run.smithi148.stdout:5291 trunc from 0xd053600 to 0x9573200 2024-09-14T09:09:30.217 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:30.217 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:30.236 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:09:30.236 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:09:30.238 INFO:teuthology.orchestra.run.smithi148.stdout:5292 write 0xa24be00 thru 0xa25b705 (0xf906 bytes) 2024-09-14T09:09:30.244 INFO:teuthology.orchestra.run.smithi148.stdout:5293 read 0x6a6a200 thru 0x6a760a6 (0xbea7 bytes) 2024-09-14T09:09:30.254 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:30.255 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:30.257 INFO:teuthology.orchestra.run.smithi148.stdout:5294 write 0xa5e8c00 thru 0xa5f80d4 (0xf4d5 bytes) 2024-09-14T09:09:30.263 INFO:teuthology.orchestra.run.smithi148.stdout:5298 punch from 0x910e600 to 0x9117400, (0x8e00 bytes) 2024-09-14T09:09:30.264 INFO:teuthology.orchestra.run.smithi148.stdout:5299 trunc from 0xa5f8200 to 0xabeb600 2024-09-14T09:09:30.285 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:30.286 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:30.291 INFO:teuthology.orchestra.run.smithi148.stdout:5301 write 0xb9d0e00 thru 0xb9d3af1 (0x2cf2 bytes) 2024-09-14T09:09:30.294 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:30.296+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:30.297 INFO:teuthology.orchestra.run.smithi148.stdout:5302 read 0x13de800 thru 0x13de87e (0x7f bytes) 2024-09-14T09:09:30.298 INFO:teuthology.orchestra.run.smithi148.stdout:5303 write 0xadbe600 thru 0xadc9cf2 (0xb6f3 bytes) 2024-09-14T09:09:30.309 INFO:teuthology.orchestra.run.smithi148.stdout:5305 trunc from 0xb9d3c00 to 0x1fcc000 2024-09-14T09:09:30.311 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 reset_purged_snaps_last 2024-09-14T09:09:30.316 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:30.317 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:30.333 INFO:teuthology.orchestra.run.smithi148.stdout:5307 trunc from 0x1fcc000 to 0x2c05e00 2024-09-14T09:09:30.333 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:30.334 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:30.334 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:30.334 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:30.334 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:30.343 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:09:30.347 INFO:teuthology.orchestra.run.smithi148.stdout:5308 read 0x11b200 thru 0x120bcd (0x59ce bytes) 2024-09-14T09:09:30.363 INFO:teuthology.orchestra.run.smithi148.stdout:5309 write 0x36db200 thru 0x36e13d7 (0x61d8 bytes) 2024-09-14T09:09:30.368 INFO:teuthology.orchestra.run.smithi148.stdout:5310 read 0x227800 thru 0x230634 (0x8e35 bytes) 2024-09-14T09:09:30.384 INFO:teuthology.orchestra.run.smithi148.stdout:5312 write 0x714d400 thru 0x714f8b1 (0x24b2 bytes) 2024-09-14T09:09:30.398 INFO:teuthology.orchestra.run.smithi148.stdout:5316 write 0x8f00000 thru 0x8f09c91 (0x9c92 bytes) 2024-09-14T09:09:30.399 INFO:teuthology.orchestra.run.smithi148.stdout:5317 write 0x212fc00 thru 0x2130744 (0xb45 bytes) 2024-09-14T09:09:30.399 INFO:teuthology.orchestra.run.smithi148.stdout:5318 write 0x8b26c00 thru 0x8b30eba (0xa2bb bytes) 2024-09-14T09:09:30.406 INFO:teuthology.orchestra.run.smithi148.stdout:5319 trunc from 0x8f09e00 to 0x32d3000 2024-09-14T09:09:30.427 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:30.429+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:30.443 INFO:teuthology.orchestra.run.smithi148.stdout:5320 write 0x6ab8a00 thru 0x6abb0f7 (0x26f8 bytes) 2024-09-14T09:09:30.444 INFO:teuthology.orchestra.run.smithi148.stdout:5322 read 0x356d400 thru 0x3572ee4 (0x5ae5 bytes) 2024-09-14T09:09:30.456 INFO:teuthology.orchestra.run.smithi148.stdout:5324 write 0x7720000 thru 0x772765c (0x765d bytes) 2024-09-14T09:09:30.466 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-09-14T09:09:30.473 INFO:teuthology.orchestra.run.smithi148.stdout:5325 write 0xbec3a00 thru 0xbed2e5d (0xf45e bytes) 2024-09-14T09:09:30.474 INFO:teuthology.orchestra.run.smithi148.stdout:5326 punch from 0x2b88c00 to 0x2b92e00, (0xa200 bytes) 2024-09-14T09:09:30.474 INFO:teuthology.orchestra.run.smithi148.stdout:5327 read 0x355fa00 thru 0x3562aa4 (0x30a5 bytes) 2024-09-14T09:09:30.474 INFO:teuthology.orchestra.run.smithi148.stdout:5330 write 0xbb93200 thru 0xbb9880d (0x560e bytes) 2024-09-14T09:09:30.474 INFO:teuthology.orchestra.run.smithi148.stdout:5331 read 0xb228800 thru 0xb22b691 (0x2e92 bytes) 2024-09-14T09:09:30.475 INFO:teuthology.orchestra.run.smithi148.stdout:5332 write 0x6476400 thru 0x647efcd (0x8bce bytes) 2024-09-14T09:09:30.475 INFO:teuthology.orchestra.run.smithi148.stdout:5333 read 0x74d800 thru 0x753410 (0x5c11 bytes) 2024-09-14T09:09:30.475 INFO:teuthology.orchestra.run.smithi148.stdout:5334 write 0x53c0400 thru 0x53c9577 (0x9178 bytes) 2024-09-14T09:09:30.489 INFO:teuthology.orchestra.run.smithi148.stdout:5336 write 0xc2a2400 thru 0xc2aa6b0 (0x82b1 bytes) 2024-09-14T09:09:30.490 INFO:teuthology.orchestra.run.smithi148.stdout:5338 read 0x6810e00 thru 0x68137b1 (0x29b2 bytes) 2024-09-14T09:09:30.490 INFO:teuthology.orchestra.run.smithi148.stdout:5339 read 0x7c15800 thru 0x7c246e1 (0xeee2 bytes) 2024-09-14T09:09:30.490 INFO:teuthology.orchestra.run.smithi148.stdout:5340 read 0x3603600 thru 0x3611836 (0xe237 bytes) 2024-09-14T09:09:30.490 INFO:teuthology.orchestra.run.smithi148.stdout:5341 punch from 0x2f7e00 to 0x300e00, (0x9000 bytes) 2024-09-14T09:09:30.490 INFO:teuthology.orchestra.run.smithi148.stdout:5342 write 0x4245c00 thru 0x42467e3 (0xbe4 bytes) 2024-09-14T09:09:30.490 INFO:teuthology.orchestra.run.smithi148.stdout:5344 read 0x8097600 thru 0x809d9bd (0x63be bytes) 2024-09-14T09:09:30.490 INFO:teuthology.orchestra.run.smithi148.stdout:5345 read 0x700d000 thru 0x700e9dd (0x19de bytes) 2024-09-14T09:09:30.491 INFO:teuthology.orchestra.run.smithi148.stdout:5346 punch from 0x84a2600 to 0x84a9800, (0x7200 bytes) 2024-09-14T09:09:30.491 INFO:teuthology.orchestra.run.smithi148.stdout:5347 read 0x1c8f600 thru 0x1c98128 (0x8b29 bytes) 2024-09-14T09:09:30.492 INFO:teuthology.orchestra.run.smithi148.stdout:5348 punch from 0xa865600 to 0xa867400, (0x1e00 bytes) 2024-09-14T09:09:30.492 INFO:teuthology.orchestra.run.smithi148.stdout:5349 punch from 0x1357c00 to 0x135e400, (0x6800 bytes) 2024-09-14T09:09:30.492 INFO:teuthology.orchestra.run.smithi148.stdout:5350 read 0x1409800 thru 0x140e70d (0x4f0e bytes) 2024-09-14T09:09:30.492 INFO:teuthology.orchestra.run.smithi148.stdout:5354 read 0x491b800 thru 0x49238a4 (0x80a5 bytes) 2024-09-14T09:09:30.492 INFO:teuthology.orchestra.run.smithi148.stdout:5356 trunc from 0xc2aa800 to 0xc2fa200 2024-09-14T09:09:30.502 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:30.502 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:30.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:30.502 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:30.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.502 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55979 3.e 3:740d1568:::rbd_data.1112a10502fe.0000000000000133:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:30.502 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:30.502 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.652372385, 2024-09-14T09:09:30.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.95211669700000001, 2024-09-14T09:09:30.503 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:30.503 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:30.503 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:30.503 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:30.503 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:30.503 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:30.503 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55979 2024-09-14T09:09:30.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.503 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:30.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:30.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:30.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:30.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:30.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:30.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850380+0000", 2024-09-14T09:09:30.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.615e-06 2024-09-14T09:09:30.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:30.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850386+0000", 2024-09-14T09:09:30.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8000000000000001e-06 2024-09-14T09:09:30.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:30.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850403+0000", 2024-09-14T09:09:30.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6339999999999999e-05 2024-09-14T09:09:30.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:30.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850413+0000", 2024-09-14T09:09:30.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8609999999999993e-06 2024-09-14T09:09:30.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851033+0000", 2024-09-14T09:09:30.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062034700000000004 2024-09-14T09:09:30.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:09:30.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851042+0000", 2024-09-14T09:09:30.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8340000000000005e-06 2024-09-14T09:09:30.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853175+0000", 2024-09-14T09:09:30.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0021332809999999999 2024-09-14T09:09:30.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:30.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853183+0000", 2024-09-14T09:09:30.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:09:30.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795232+0000", 2024-09-14T09:09:30.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94204854900000001 2024-09-14T09:09:30.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:30.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795413+0000", 2024-09-14T09:09:30.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018059200000000001 2024-09-14T09:09:30.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:09:30.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795717+0000", 2024-09-14T09:09:30.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000304636 2024-09-14T09:09:30.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:30.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799631+0000", 2024-09-14T09:09:30.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136910000000004 2024-09-14T09:09:30.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:30.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802290+0000", 2024-09-14T09:09:30.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026588010000000001 2024-09-14T09:09:30.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:30.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802362+0000", 2024-09-14T09:09:30.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2018000000000001e-05 2024-09-14T09:09:30.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:30.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802495+0000", 2024-09-14T09:09:30.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000132967 2024-09-14T09:09:30.513 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.513 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:30.513 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.513 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55990 3.e 3:72d6260e:::rbd_data.1112a10502fe.000000000000016c:head [stat,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:30.513 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:30.513 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.652311078, 2024-09-14T09:09:30.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.952433164, 2024-09-14T09:09:30.513 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:30.513 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:30.513 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:30.513 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:30.514 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:30.514 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:30.514 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55990 2024-09-14T09:09:30.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.514 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:30.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:30.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:30.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:30.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:30.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:30.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850440+0000", 2024-09-14T09:09:30.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5199999999999996e-07 2024-09-14T09:09:30.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:30.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850444+0000", 2024-09-14T09:09:30.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.019e-06 2024-09-14T09:09:30.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:30.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850452+0000", 2024-09-14T09:09:30.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0209999999999999e-06 2024-09-14T09:09:30.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:30.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850457+0000", 2024-09-14T09:09:30.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9529999999999998e-06 2024-09-14T09:09:30.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851100+0000", 2024-09-14T09:09:30.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00064299699999999997 2024-09-14T09:09:30.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:30.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851108+0000", 2024-09-14T09:09:30.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2279999999999998e-06 2024-09-14T09:09:30.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853208+0000", 2024-09-14T09:09:30.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020996579999999999 2024-09-14T09:09:30.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:30.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853213+0000", 2024-09-14T09:09:30.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4029999999999998e-06 2024-09-14T09:09:30.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796098+0000", 2024-09-14T09:09:30.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94288483700000003 2024-09-14T09:09:30.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:30.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796247+0000", 2024-09-14T09:09:30.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014925800000000001 2024-09-14T09:09:30.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:30.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802872+0000", 2024-09-14T09:09:30.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006625138 2024-09-14T09:09:30.519 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.519 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:30.519 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.519 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:30.519 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:30.520 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.488072304999999, 2024-09-14T09:09:30.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77465830800000002, 2024-09-14T09:09:30.520 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:30.520 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:30.520 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:30.520 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:30.520 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:30.520 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:30.520 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 58987 2024-09-14T09:09:30.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.520 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:30.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:30.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:30.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:30.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:30.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:30.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014680+0000", 2024-09-14T09:09:30.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9250000000000002e-06 2024-09-14T09:09:30.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:30.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014689+0000", 2024-09-14T09:09:30.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9730000000000003e-06 2024-09-14T09:09:30.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:30.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014709+0000", 2024-09-14T09:09:30.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9641999999999999e-05 2024-09-14T09:09:30.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:30.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014720+0000", 2024-09-14T09:09:30.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-09-14T09:09:30.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014796+0000", 2024-09-14T09:09:30.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6567000000000001e-05 2024-09-14T09:09:30.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:30.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014808+0000", 2024-09-14T09:09:30.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1435e-05 2024-09-14T09:09:30.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789325+0000", 2024-09-14T09:09:30.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77451705999999998 2024-09-14T09:09:30.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:30.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789336+0000", 2024-09-14T09:09:30.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1466e-05 2024-09-14T09:09:30.524 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.524 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:30.524 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.525 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:59017 3.3 3.6b81fb83 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:30.525 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:30.525 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.486419901, 2024-09-14T09:09:30.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77253447099999994, 2024-09-14T09:09:30.525 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:30.525 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:30.525 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:30.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:30.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:30.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:30.525 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 59017 2024-09-14T09:09:30.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.525 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:30.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:30.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:30.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:30.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:30.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:30.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016332+0000", 2024-09-14T09:09:30.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3459999999999999e-06 2024-09-14T09:09:30.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:30.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016337+0000", 2024-09-14T09:09:30.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.48e-06 2024-09-14T09:09:30.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:30.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016355+0000", 2024-09-14T09:09:30.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7955e-05 2024-09-14T09:09:30.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:30.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016364+0000", 2024-09-14T09:09:30.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.02e-06 2024-09-14T09:09:30.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016433+0000", 2024-09-14T09:09:30.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8398000000000005e-05 2024-09-14T09:09:30.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:30.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016442+0000", 2024-09-14T09:09:30.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1819999999999995e-06 2024-09-14T09:09:30.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788855+0000", 2024-09-14T09:09:30.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77241356299999997 2024-09-14T09:09:30.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:30.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788865+0000", 2024-09-14T09:09:30.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5270000000000004e-06 2024-09-14T09:09:30.529 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.529 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:30.529 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.530 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60343 3.e 3:721b16e6:::rbd_data.1112a10502fe.000000000000014b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:30.530 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:30.530 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.382450299, 2024-09-14T09:09:30.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68876920900000005, 2024-09-14T09:09:30.530 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:30.530 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:30.530 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:30.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:30.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:30.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:30.530 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60343 2024-09-14T09:09:30.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.530 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:30.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:30.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:30.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:30.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:30.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:30.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120302+0000", 2024-09-14T09:09:30.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0279999999999999e-06 2024-09-14T09:09:30.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:30.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120310+0000", 2024-09-14T09:09:30.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4330000000000004e-06 2024-09-14T09:09:30.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:30.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120333+0000", 2024-09-14T09:09:30.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2200000000000001e-05 2024-09-14T09:09:30.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:30.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120343+0000", 2024-09-14T09:09:30.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0560000000000001e-05 2024-09-14T09:09:30.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120414+0000", 2024-09-14T09:09:30.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0493000000000004e-05 2024-09-14T09:09:30.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:30.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120424+0000", 2024-09-14T09:09:30.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.059e-05 2024-09-14T09:09:30.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796679+0000", 2024-09-14T09:09:30.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67625512700000001 2024-09-14T09:09:30.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:30.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796833+0000", 2024-09-14T09:09:30.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015403500000000001 2024-09-14T09:09:30.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:09:30.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797239+0000", 2024-09-14T09:09:30.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040503000000000002 2024-09-14T09:09:30.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:30.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802918+0000", 2024-09-14T09:09:30.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056796199999999998 2024-09-14T09:09:30.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:30.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808655+0000", 2024-09-14T09:09:30.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057365089999999999 2024-09-14T09:09:30.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:30.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808850+0000", 2024-09-14T09:09:30.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000194904 2024-09-14T09:09:30.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:30.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809069+0000", 2024-09-14T09:09:30.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021968000000000001 2024-09-14T09:09:30.536 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.536 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:30.536 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.536 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60356 3.2 3:40f9e9e7:::rbd_data.1112a10502fe.0000000000000160:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:30.536 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:30.536 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.381387785999999, 2024-09-14T09:09:30.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68053790800000002, 2024-09-14T09:09:30.536 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:30.536 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:30.536 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:30.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:30.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:30.537 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:30.537 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60356 2024-09-14T09:09:30.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.537 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:30.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:30.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:30.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:30.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:30.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:30.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121364+0000", 2024-09-14T09:09:30.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.173e-06 2024-09-14T09:09:30.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:30.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121371+0000", 2024-09-14T09:09:30.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-09-14T09:09:30.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:30.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121386+0000", 2024-09-14T09:09:30.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4925e-05 2024-09-14T09:09:30.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:30.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121395+0000", 2024-09-14T09:09:30.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8190000000000003e-06 2024-09-14T09:09:30.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121464+0000", 2024-09-14T09:09:30.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8149000000000001e-05 2024-09-14T09:09:30.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:30.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121474+0000", 2024-09-14T09:09:30.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0927999999999999e-05 2024-09-14T09:09:30.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795901+0000", 2024-09-14T09:09:30.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67442645499999998 2024-09-14T09:09:30.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:30.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796068+0000", 2024-09-14T09:09:30.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016655700000000001 2024-09-14T09:09:30.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 3", 2024-09-14T09:09:30.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796354+0000", 2024-09-14T09:09:30.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00028646999999999999 2024-09-14T09:09:30.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:30.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.800348+0000", 2024-09-14T09:09:30.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039943119999999999 2024-09-14T09:09:30.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:30.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801690+0000", 2024-09-14T09:09:30.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013415090000000001 2024-09-14T09:09:30.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:30.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801771+0000", 2024-09-14T09:09:30.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1678e-05 2024-09-14T09:09:30.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:30.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801900+0000", 2024-09-14T09:09:30.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000128978 2024-09-14T09:09:30.542 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.542 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:30.542 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.543 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62163 3.e 3:713ab431:::rbd_data.1112a10502fe.0000000000000198:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:30.543 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:30.543 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.291017579, 2024-09-14T09:09:30.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.597552682, 2024-09-14T09:09:30.543 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:30.543 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:30.543 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:30.543 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:30.543 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:30.543 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:30.543 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62163 2024-09-14T09:09:30.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.543 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:30.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:30.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:30.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:30.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:30.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:30.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211735+0000", 2024-09-14T09:09:30.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1110000000000002e-06 2024-09-14T09:09:30.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:30.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211744+0000", 2024-09-14T09:09:30.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0790000000000007e-06 2024-09-14T09:09:30.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:30.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211765+0000", 2024-09-14T09:09:30.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1114000000000001e-05 2024-09-14T09:09:30.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:30.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211775+0000", 2024-09-14T09:09:30.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0033e-05 2024-09-14T09:09:30.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211847+0000", 2024-09-14T09:09:30.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1503999999999998e-05 2024-09-14T09:09:30.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:30.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211857+0000", 2024-09-14T09:09:30.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0378e-05 2024-09-14T09:09:30.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799140+0000", 2024-09-14T09:09:30.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.58728279100000003 2024-09-14T09:09:30.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:30.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799289+0000", 2024-09-14T09:09:30.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000148966 2024-09-14T09:09:30.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:30.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809285+0000", 2024-09-14T09:09:30.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099967059999999993 2024-09-14T09:09:30.548 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.548 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:30.548 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.548 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63582 3.2 3:467f2009:::rbd_data.1112a10502fe.00000000000001a1:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:30.548 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:30.548 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.215824462, 2024-09-14T09:09:30.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51869012999999997, 2024-09-14T09:09:30.548 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:30.549 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:30.549 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:30.549 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:30.549 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:30.549 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:30.549 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63582 2024-09-14T09:09:30.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.549 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:30.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:30.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:30.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:30.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:30.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:30.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286928+0000", 2024-09-14T09:09:30.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.812e-06 2024-09-14T09:09:30.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:30.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286936+0000", 2024-09-14T09:09:30.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2390000000000002e-06 2024-09-14T09:09:30.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:30.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286955+0000", 2024-09-14T09:09:30.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8853000000000001e-05 2024-09-14T09:09:30.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:30.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286972+0000", 2024-09-14T09:09:30.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7365000000000001e-05 2024-09-14T09:09:30.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287052+0000", 2024-09-14T09:09:30.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9491000000000002e-05 2024-09-14T09:09:30.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:30.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287063+0000", 2024-09-14T09:09:30.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1620999999999999e-05 2024-09-14T09:09:30.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796696+0000", 2024-09-14T09:09:30.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50963256999999995 2024-09-14T09:09:30.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:30.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796847+0000", 2024-09-14T09:09:30.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015126899999999999 2024-09-14T09:09:30.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:30.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.805616+0000", 2024-09-14T09:09:30.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087689099999999996 2024-09-14T09:09:30.553 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.553 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:30.553 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.554 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63586 3.3 3.d4e49b03 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:30.554 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:30.554 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.215740081, 2024-09-14T09:09:30.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50188935099999998, 2024-09-14T09:09:30.554 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:30.554 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:30.554 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:30.554 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:30.554 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:30.554 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:30.554 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63586 2024-09-14T09:09:30.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.555 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:30.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:30.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:30.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:30.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:30.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:30.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287011+0000", 2024-09-14T09:09:30.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.61e-07 2024-09-14T09:09:30.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:30.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287014+0000", 2024-09-14T09:09:30.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3900000000000002e-06 2024-09-14T09:09:30.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:30.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287023+0000", 2024-09-14T09:09:30.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3380000000000005e-06 2024-09-14T09:09:30.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:30.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287029+0000", 2024-09-14T09:09:30.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0079999999999999e-06 2024-09-14T09:09:30.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287087+0000", 2024-09-14T09:09:30.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8322000000000002e-05 2024-09-14T09:09:30.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:30.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287096+0000", 2024-09-14T09:09:30.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8580000000000006e-06 2024-09-14T09:09:30.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788891+0000", 2024-09-14T09:09:30.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50179498499999997 2024-09-14T09:09:30.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:30.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788900+0000", 2024-09-14T09:09:30.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.789e-06 2024-09-14T09:09:30.558 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.559 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:30.559 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.559 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60363 3.1d 3:b8b44067:::rbd_data.1112a10502fe.000000000000018b:head [stat,delete] snapc 21=[21] RETRY=12 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:30.559 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:30.559 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.715018343000001, 2024-09-14T09:09:30.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268612690000001, 2024-09-14T09:09:30.559 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:30.559 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:30.559 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:30.559 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:30.559 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:30.559 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:30.559 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60363 2024-09-14T09:09:30.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.560 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:30.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:30.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:30.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:30.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:30.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:30.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787733+0000", 2024-09-14T09:09:30.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.314e-06 2024-09-14T09:09:30.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:30.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787739+0000", 2024-09-14T09:09:30.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5300000000000004e-06 2024-09-14T09:09:30.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:30.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787750+0000", 2024-09-14T09:09:30.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1251e-05 2024-09-14T09:09:30.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:30.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:30.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0739999999999993e-06 2024-09-14T09:09:30.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787827+0000", 2024-09-14T09:09:30.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8861000000000004e-05 2024-09-14T09:09:30.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:09:30.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787836+0000", 2024-09-14T09:09:30.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1339999999999993e-06 2024-09-14T09:09:30.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789335+0000", 2024-09-14T09:09:30.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014988289999999999 2024-09-14T09:09:30.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:30.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789343+0000", 2024-09-14T09:09:30.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6639999999999998e-06 2024-09-14T09:09:30.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799170+0000", 2024-09-14T09:09:30.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098272500000001 2024-09-14T09:09:30.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:30.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799377+0000", 2024-09-14T09:09:30.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000207126 2024-09-14T09:09:30.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:30.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814593+0000", 2024-09-14T09:09:30.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015216235999999999 2024-09-14T09:09:30.564 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.564 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:30.564 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.565 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63565 3.1d 3:bdc63b28:::rbd_data.1112a10502fe.000000000000016d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=9 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:30.565 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:30.565 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.714972552000001, 2024-09-14T09:09:30.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0271114539999999, 2024-09-14T09:09:30.565 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:30.565 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:30.565 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:30.565 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:30.565 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:30.565 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:30.565 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63565 2024-09-14T09:09:30.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.565 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:30.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:30.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:30.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:30.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:30.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:30.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:30.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6899999999999998e-07 2024-09-14T09:09:30.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:30.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787781+0000", 2024-09-14T09:09:30.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8909999999999999e-06 2024-09-14T09:09:30.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:30.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787787+0000", 2024-09-14T09:09:30.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3230000000000003e-06 2024-09-14T09:09:30.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:30.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787793+0000", 2024-09-14T09:09:30.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-09-14T09:09:30.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789455+0000", 2024-09-14T09:09:30.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001661596 2024-09-14T09:09:30.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:30.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789463+0000", 2024-09-14T09:09:30.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4889999999999995e-06 2024-09-14T09:09:30.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800115+0000", 2024-09-14T09:09:30.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0106512670000001 2024-09-14T09:09:30.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:30.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800334+0000", 2024-09-14T09:09:30.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000219213 2024-09-14T09:09:30.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:09:30.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800651+0000", 2024-09-14T09:09:30.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00031765500000000002 2024-09-14T09:09:30.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:30.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.811875+0000", 2024-09-14T09:09:30.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011224032 2024-09-14T09:09:30.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:30.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814665+0000", 2024-09-14T09:09:30.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002789606 2024-09-14T09:09:30.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:30.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814742+0000", 2024-09-14T09:09:30.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6916999999999996e-05 2024-09-14T09:09:30.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:30.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814889+0000", 2024-09-14T09:09:30.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014725799999999999 2024-09-14T09:09:30.572 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.572 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:30.572 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.573 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:67113 3.1d 3:bba7fe0d:::rbd_data.1112a10502fe.00000000000001bf:head [stat,delete] snapc 21=[21] RETRY=4 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:30.573 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:30.573 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.714211693999999, 2024-09-14T09:09:30.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0265995649999999, 2024-09-14T09:09:30.573 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:30.573 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:30.573 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:30.573 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:30.573 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:30.573 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:30.573 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 67113 2024-09-14T09:09:30.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.574 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:30.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:30.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:30.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:30.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:30.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:30.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:30.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:09:30.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:30.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788543+0000", 2024-09-14T09:09:30.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-09-14T09:09:30.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:30.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788552+0000", 2024-09-14T09:09:30.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:09:30.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:30.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788559+0000", 2024-09-14T09:09:30.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:09:30.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789489+0000", 2024-09-14T09:09:30.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00092982199999999996 2024-09-14T09:09:30.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:30.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789497+0000", 2024-09-14T09:09:30.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6299999999999998e-06 2024-09-14T09:09:30.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801068+0000", 2024-09-14T09:09:30.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0115709530000001 2024-09-14T09:09:30.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:30.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801240+0000", 2024-09-14T09:09:30.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017276600000000001 2024-09-14T09:09:30.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:30.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815138+0000", 2024-09-14T09:09:30.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013897856 2024-09-14T09:09:30.578 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.578 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:30.578 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.578 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73412 3.1d 3:be4606c3:::rbd_data.1112a10502fe.00000000000001f2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:30.578 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:30.578 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.714180582000001, 2024-09-14T09:09:30.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026815928, 2024-09-14T09:09:30.578 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:30.578 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:30.578 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:30.578 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:30.578 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:30.579 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:30.579 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73412 2024-09-14T09:09:30.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.579 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:30.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:30.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:30.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:30.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:30.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:30.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:30.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5699999999999998e-07 2024-09-14T09:09:30.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:30.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788572+0000", 2024-09-14T09:09:30.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2809999999999998e-06 2024-09-14T09:09:30.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:30.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788579+0000", 2024-09-14T09:09:30.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5629999999999997e-06 2024-09-14T09:09:30.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:30.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788584+0000", 2024-09-14T09:09:30.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1710000000000001e-06 2024-09-14T09:09:30.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789521+0000", 2024-09-14T09:09:30.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00093657400000000002 2024-09-14T09:09:30.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:30.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789528+0000", 2024-09-14T09:09:30.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5719999999999997e-06 2024-09-14T09:09:30.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801631+0000", 2024-09-14T09:09:30.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0121023229999999 2024-09-14T09:09:30.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:30.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801792+0000", 2024-09-14T09:09:30.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016174000000000001 2024-09-14T09:09:30.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:30.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815386+0000", 2024-09-14T09:09:30.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013593246999999999 2024-09-14T09:09:30.583 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.583 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:30.584 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.584 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:77244 3.1d 3:b801be19:::rbd_data.1112a10502fe.0000000000000204:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:30.584 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:30.584 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.532316335999999, 2024-09-14T09:09:30.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.84519277100000001, 2024-09-14T09:09:30.584 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:30.584 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:30.584 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:30.584 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:30.584 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:30.585 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:30.585 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 77244 2024-09-14T09:09:30.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.585 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:30.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:30.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:30.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:30.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:30.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:30.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970436+0000", 2024-09-14T09:09:30.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.511e-06 2024-09-14T09:09:30.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:30.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970441+0000", 2024-09-14T09:09:30.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0470000000000001e-06 2024-09-14T09:09:30.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:30.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970453+0000", 2024-09-14T09:09:30.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2629999999999999e-05 2024-09-14T09:09:30.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:30.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970461+0000", 2024-09-14T09:09:30.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6850000000000001e-06 2024-09-14T09:09:30.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970524+0000", 2024-09-14T09:09:30.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3332999999999998e-05 2024-09-14T09:09:30.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:30.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970544+0000", 2024-09-14T09:09:30.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9731000000000001e-05 2024-09-14T09:09:30.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802188+0000", 2024-09-14T09:09:30.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.83164380000000004 2024-09-14T09:09:30.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:30.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:09:30.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015411999999999999 2024-09-14T09:09:30.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:30.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815627+0000", 2024-09-14T09:09:30.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013284914 2024-09-14T09:09:30.589 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.590 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:30.590 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.590 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:79796 3.1d 3:bc22caaf:::rbd_data.1112a10502fe.000000000000020c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:30.590 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:30.590 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.41100765, 2024-09-14T09:09:30.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72411694299999996, 2024-09-14T09:09:30.590 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:30.590 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:30.590 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:30.590 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:30.590 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:30.590 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:30.591 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 79796 2024-09-14T09:09:30.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.591 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:30.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:30.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:30.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:30.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:30.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:30.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091745+0000", 2024-09-14T09:09:30.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2000000000000001e-06 2024-09-14T09:09:30.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:30.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091752+0000", 2024-09-14T09:09:30.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-09-14T09:09:30.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:30.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091772+0000", 2024-09-14T09:09:30.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9822000000000001e-05 2024-09-14T09:09:30.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:30.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091791+0000", 2024-09-14T09:09:30.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9236e-05 2024-09-14T09:09:30.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091882+0000", 2024-09-14T09:09:30.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0783000000000001e-05 2024-09-14T09:09:30.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:30.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091892+0000", 2024-09-14T09:09:30.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7999999999999993e-06 2024-09-14T09:09:30.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802744+0000", 2024-09-14T09:09:30.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.710851868 2024-09-14T09:09:30.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:30.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802902+0000", 2024-09-14T09:09:30.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015814900000000001 2024-09-14T09:09:30.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:30.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815860+0000", 2024-09-14T09:09:30.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012957605000000001 2024-09-14T09:09:30.595 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.595 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:30.595 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.595 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80904 3.1d 3:be0e7f3d:::rbd_data.1112a10502fe.0000000000000214:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:30.595 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:30.595 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.330921803000001, 2024-09-14T09:09:30.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64435178100000001, 2024-09-14T09:09:30.596 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:30.596 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:30.596 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:30.596 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:30.596 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:30.596 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:30.596 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80904 2024-09-14T09:09:30.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.596 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:30.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:30.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:30.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:30.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:30.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:30.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171831+0000", 2024-09-14T09:09:30.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0729999999999999e-06 2024-09-14T09:09:30.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:30.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171839+0000", 2024-09-14T09:09:30.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9179999999999994e-06 2024-09-14T09:09:30.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:30.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171857+0000", 2024-09-14T09:09:30.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8957000000000002e-05 2024-09-14T09:09:30.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:30.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171867+0000", 2024-09-14T09:09:30.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7100000000000002e-06 2024-09-14T09:09:30.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171957+0000", 2024-09-14T09:09:30.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9932999999999994e-05 2024-09-14T09:09:30.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:30.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171974+0000", 2024-09-14T09:09:30.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6988999999999999e-05 2024-09-14T09:09:30.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803301+0000", 2024-09-14T09:09:30.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63132648599999996 2024-09-14T09:09:30.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:30.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803482+0000", 2024-09-14T09:09:30.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000181607 2024-09-14T09:09:30.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:30.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816180+0000", 2024-09-14T09:09:30.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012698108 2024-09-14T09:09:30.600 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.600 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:30.600 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.601 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80964 3.1d 3:be42e20f:::rbd_data.1112a10502fe.0000000000000219:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:30.601 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:30.601 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.325286236, 2024-09-14T09:09:30.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63896829799999999, 2024-09-14T09:09:30.601 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:30.601 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:30.601 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:30.601 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:30.602 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:30.602 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:30.602 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80964 2024-09-14T09:09:30.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.602 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:30.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:30.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:30.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:30.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:30.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:30.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177466+0000", 2024-09-14T09:09:30.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6610000000000001e-06 2024-09-14T09:09:30.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:30.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177472+0000", 2024-09-14T09:09:30.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3029999999999996e-06 2024-09-14T09:09:30.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:30.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177490+0000", 2024-09-14T09:09:30.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8099000000000001e-05 2024-09-14T09:09:30.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:30.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177499+0000", 2024-09-14T09:09:30.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:09:30.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177560+0000", 2024-09-14T09:09:30.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1334000000000006e-05 2024-09-14T09:09:30.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:30.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177578+0000", 2024-09-14T09:09:30.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8434999999999999e-05 2024-09-14T09:09:30.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803910+0000", 2024-09-14T09:09:30.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62633190699999997 2024-09-14T09:09:30.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:30.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.806612+0000", 2024-09-14T09:09:30.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002702257 2024-09-14T09:09:30.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:30.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816432+0000", 2024-09-14T09:09:30.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098199370000000008 2024-09-14T09:09:30.606 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.606 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:30.606 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.606 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83321 3.1d 3:bb24b47b:::rbd_data.1112a10502fe.0000000000000223:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:30.606 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:30.606 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.210832562, 2024-09-14T09:09:30.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52477628799999998, 2024-09-14T09:09:30.606 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:30.606 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:30.607 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:30.607 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:30.607 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:30.607 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:30.607 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83321 2024-09-14T09:09:30.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.607 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:30.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:30.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:30.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:30.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:30.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:30.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291920+0000", 2024-09-14T09:09:30.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.888e-06 2024-09-14T09:09:30.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:30.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291926+0000", 2024-09-14T09:09:30.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6059999999999999e-06 2024-09-14T09:09:30.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:30.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291943+0000", 2024-09-14T09:09:30.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6813e-05 2024-09-14T09:09:30.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:30.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291952+0000", 2024-09-14T09:09:30.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7439999999999996e-06 2024-09-14T09:09:30.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292023+0000", 2024-09-14T09:09:30.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1320000000000002e-05 2024-09-14T09:09:30.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:30.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292030+0000", 2024-09-14T09:09:30.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4219999999999997e-06 2024-09-14T09:09:30.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807221+0000", 2024-09-14T09:09:30.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51519140699999999 2024-09-14T09:09:30.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:30.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807406+0000", 2024-09-14T09:09:30.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018532800000000001 2024-09-14T09:09:30.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:30.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816694+0000", 2024-09-14T09:09:30.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092877600000000008 2024-09-14T09:09:30.612 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.612 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:30.612 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.612 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83358 3.1d 3:bb230e23:::rbd_data.1112a10502fe.000000000000022b:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:30.612 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:30.612 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.209312671999999, 2024-09-14T09:09:30.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52374808900000003, 2024-09-14T09:09:30.612 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:30.613 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:30.613 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:30.613 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:30.613 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:30.613 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:30.613 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83358 2024-09-14T09:09:30.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.613 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:30.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:30.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:30.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:30.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:30.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:30.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293439+0000", 2024-09-14T09:09:30.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5899999999999995e-07 2024-09-14T09:09:30.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:30.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293443+0000", 2024-09-14T09:09:30.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9309999999999999e-06 2024-09-14T09:09:30.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:30.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293457+0000", 2024-09-14T09:09:30.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3944999999999999e-05 2024-09-14T09:09:30.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:30.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293466+0000", 2024-09-14T09:09:30.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4319999999999999e-06 2024-09-14T09:09:30.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293530+0000", 2024-09-14T09:09:30.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3860000000000002e-05 2024-09-14T09:09:30.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:30.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293540+0000", 2024-09-14T09:09:30.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0107e-05 2024-09-14T09:09:30.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809096+0000", 2024-09-14T09:09:30.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51555587800000002 2024-09-14T09:09:30.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:30.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809265+0000", 2024-09-14T09:09:30.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000169092 2024-09-14T09:09:30.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:30.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817186+0000", 2024-09-14T09:09:30.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079209850000000002 2024-09-14T09:09:30.617 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.617 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:30.617 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.617 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83361 3.1d 3:bd571564:::rbd_data.1112a10502fe.000000000000022c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:30.617 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:30.617 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.208994596, 2024-09-14T09:09:30.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52373873100000001, 2024-09-14T09:09:30.618 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:30.618 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:30.618 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:30.618 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:30.618 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:30.618 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:30.618 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83361 2024-09-14T09:09:30.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.618 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:30.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:30.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:30.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:30.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:30.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:30.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:30.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293757+0000", 2024-09-14T09:09:30.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8000000000000004e-07 2024-09-14T09:09:30.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:30.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293762+0000", 2024-09-14T09:09:30.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8019999999999997e-06 2024-09-14T09:09:30.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:30.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293775+0000", 2024-09-14T09:09:30.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2884000000000001e-05 2024-09-14T09:09:30.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:30.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293783+0000", 2024-09-14T09:09:30.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:09:30.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293849+0000", 2024-09-14T09:09:30.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5859999999999996e-05 2024-09-14T09:09:30.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:30.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293861+0000", 2024-09-14T09:09:30.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2238999999999999e-05 2024-09-14T09:09:30.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:30.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809680+0000", 2024-09-14T09:09:30.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51581856800000003 2024-09-14T09:09:30.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:30.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809844+0000", 2024-09-14T09:09:30.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016441200000000001 2024-09-14T09:09:30.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:30.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:30.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:30.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817494+0000", 2024-09-14T09:09:30.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076502360000000004 2024-09-14T09:09:30.622 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.622 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:30.622 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.623 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:30.623 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:30.623 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:30.623 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:30.503+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:30.624 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:09:30.627 INFO:teuthology.orchestra.run.smithi148.stdout:5359 write 0xcf33800 thru 0xcf3e4e3 (0xace4 bytes) 2024-09-14T09:09:30.627 INFO:teuthology.orchestra.run.smithi148.stdout:5361 write 0x98a7a00 thru 0x98b2731 (0xad32 bytes) 2024-09-14T09:09:30.627 INFO:teuthology.orchestra.run.smithi148.stdout:5364 write 0xe2b4800 thru 0xe2b6fa7 (0x27a8 bytes) 2024-09-14T09:09:30.627 INFO:teuthology.orchestra.run.smithi148.stdout:5365 read 0x2968e00 thru 0x29729b6 (0x9bb7 bytes) 2024-09-14T09:09:30.628 INFO:teuthology.orchestra.run.smithi148.stdout:5366 punch from 0x8a48c00 to 0x8a49c00, (0x1000 bytes) 2024-09-14T09:09:30.628 INFO:teuthology.orchestra.run.smithi148.stdout:5367 write 0x78b7e00 thru 0x78be210 (0x6411 bytes) 2024-09-14T09:09:30.628 INFO:teuthology.orchestra.run.smithi148.stdout:5369 write 0x8b79200 thru 0x8b7d323 (0x4124 bytes) 2024-09-14T09:09:30.628 INFO:teuthology.orchestra.run.smithi148.stdout:5370 punch from 0x3028200 to 0x302ec00, (0x6a00 bytes) 2024-09-14T09:09:30.628 INFO:teuthology.orchestra.run.smithi148.stdout:5373 read 0x3b7b800 thru 0x3b8b2cc (0xfacd bytes) 2024-09-14T09:09:30.628 INFO:teuthology.orchestra.run.smithi148.stdout:5374 read 0x30dea00 thru 0x30ebba9 (0xd1aa bytes) 2024-09-14T09:09:30.628 INFO:teuthology.orchestra.run.smithi148.stdout:5376 punch from 0x528ce00 to 0x5299600, (0xc800 bytes) 2024-09-14T09:09:30.628 INFO:teuthology.orchestra.run.smithi148.stdout:5378 punch from 0x6231e00 to 0x6234200, (0x2400 bytes) 2024-09-14T09:09:30.628 INFO:teuthology.orchestra.run.smithi148.stdout:5379 read 0xcaea000 thru 0xcaefff8 (0x5ff9 bytes) 2024-09-14T09:09:30.628 INFO:teuthology.orchestra.run.smithi148.stdout:5382 punch from 0x872b600 to 0x8734400, (0x8e00 bytes) 2024-09-14T09:09:30.628 INFO:teuthology.orchestra.run.smithi148.stdout:5385 read 0xc80000 thru 0xc8df48 (0xdf49 bytes) 2024-09-14T09:09:30.628 INFO:teuthology.orchestra.run.smithi148.stdout:5386 write 0xb78200 thru 0xb832ee (0xb0ef bytes) 2024-09-14T09:09:30.628 INFO:teuthology.orchestra.run.smithi148.stdout:5388 write 0xb0a8400 thru 0xb0ab28d (0x2e8e bytes) 2024-09-14T09:09:30.629 INFO:teuthology.orchestra.run.smithi148.stdout:5389 punch from 0x32cbc00 to 0x32cee00, (0x3200 bytes) 2024-09-14T09:09:30.629 INFO:teuthology.orchestra.run.smithi148.stdout:5391 read 0xc87f000 thru 0xc880d5d (0x1d5e bytes) 2024-09-14T09:09:30.629 INFO:teuthology.orchestra.run.smithi148.stdout:5393 trunc from 0xe2b7000 to 0xb254400 2024-09-14T09:09:30.629 INFO:teuthology.orchestra.run.smithi148.stdout:5394 read 0x869000 thru 0x86d930 (0x4931 bytes) 2024-09-14T09:09:30.629 INFO:teuthology.orchestra.run.smithi148.stdout:5396 write 0xe027400 thru 0xe031ea4 (0xaaa5 bytes) 2024-09-14T09:09:30.629 INFO:teuthology.orchestra.run.smithi148.stdout:5397 trunc from 0xe032000 to 0xbc9200 2024-09-14T09:09:30.630 INFO:teuthology.orchestra.run.smithi148.stdout:5398 write 0x6d34600 thru 0x6d349d8 (0x3d9 bytes) 2024-09-14T09:09:30.636 INFO:teuthology.orchestra.run.smithi148.stdout:5402 trunc from 0x6d34a00 to 0x2951e00 2024-09-14T09:09:30.644 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-09-14T09:09:30.645 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:30.646+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:30.651 INFO:teuthology.orchestra.run.smithi148.stdout:5403 read 0x29d600 thru 0x2a60ab (0x8aac bytes) 2024-09-14T09:09:30.653 INFO:teuthology.orchestra.run.smithi148.stdout:5404 read 0x1447400 thru 0x144ded0 (0x6ad1 bytes) 2024-09-14T09:09:30.654 INFO:teuthology.orchestra.run.smithi148.stdout:5406 punch from 0x77ea00 to 0x781a00, (0x3000 bytes) 2024-09-14T09:09:30.656 INFO:teuthology.orchestra.run.smithi148.stdout:5408 read 0x17fc00 thru 0x18f06f (0xf470 bytes) 2024-09-14T09:09:30.656 INFO:teuthology.orchestra.run.smithi148.stdout:5410 read 0x99b400 thru 0x9a1458 (0x6059 bytes) 2024-09-14T09:09:30.670 INFO:teuthology.orchestra.run.smithi148.stdout:5411 write 0x2c9ee00 thru 0x2caa3dd (0xb5de bytes) 2024-09-14T09:09:30.677 INFO:teuthology.orchestra.run.smithi148.stdout:5412 trunc from 0x2caa400 to 0x905e400 2024-09-14T09:09:30.690 INFO:teuthology.orchestra.run.smithi148.stdout:5413 read 0x5818a00 thru 0x5823dd6 (0xb3d7 bytes) 2024-09-14T09:09:30.690 INFO:teuthology.orchestra.run.smithi148.stdout:5417 read 0x11ef400 thru 0x11f0a45 (0x1646 bytes) 2024-09-14T09:09:30.690 INFO:teuthology.orchestra.run.smithi148.stdout:5418 read 0x1a13200 thru 0x1a14f7b (0x1d7c bytes) 2024-09-14T09:09:30.694 INFO:teuthology.orchestra.run.smithi148.stdout:5420 trunc from 0x905e400 to 0x88e9a00 2024-09-14T09:09:30.700 INFO:teuthology.orchestra.run.smithi148.stdout:5421 punch from 0x6cd0400 to 0x6cdf400, (0xf000 bytes) 2024-09-14T09:09:30.706 INFO:teuthology.orchestra.run.smithi148.stdout:5422 punch from 0x31bf200 to 0x31caa00, (0xb800 bytes) 2024-09-14T09:09:30.706 INFO:teuthology.orchestra.run.smithi148.stdout:5423 write 0x10b0c00 thru 0x10bac9f (0xa0a0 bytes) 2024-09-14T09:09:30.721 INFO:teuthology.orchestra.run.smithi148.stdout:5424 write 0x94a3e00 thru 0x94b2b9f (0xeda0 bytes) 2024-09-14T09:09:30.726 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:30.728+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:30.730 INFO:teuthology.orchestra.run.smithi148.stdout:5426 trunc from 0x94b2c00 to 0x19abe00 2024-09-14T09:09:30.750 INFO:teuthology.orchestra.run.smithi148.stdout:5427 clone 36 order 18 su 131072 sc 15 2024-09-14T09:09:30.796 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:30.796 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:30.796 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:09:30.796 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:30.806 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:09:30.827 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:30.829+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:30.908 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:30.908 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:30.908 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:30.908 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:30.908 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:30.916 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:09:30.960 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:30.962+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:31.027 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:31.027 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:31.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:31.027 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:31.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.027 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2265 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4034560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:31.027 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:31.027 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.165768864, 2024-09-14T09:09:31.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073974829000000006, 2024-09-14T09:09:31.028 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.028 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.028 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:31.028 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.028 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:31.028 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:31.028 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2265 2024-09-14T09:09:31.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.028 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:31.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:31.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862542+0000", 2024-09-14T09:09:31.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:09:31.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862543+0000", 2024-09-14T09:09:31.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.81e-06 2024-09-14T09:09:31.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862549+0000", 2024-09-14T09:09:31.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8850000000000004e-06 2024-09-14T09:09:31.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862554+0000", 2024-09-14T09:09:31.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5279999999999997e-06 2024-09-14T09:09:31.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936318+0000", 2024-09-14T09:09:31.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073764422999999996 2024-09-14T09:09:31.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:31.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936412+0000", 2024-09-14T09:09:31.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3801000000000005e-05 2024-09-14T09:09:31.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936516+0000", 2024-09-14T09:09:31.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000104007 2024-09-14T09:09:31.035 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.035 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.035 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.035 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2266 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4096000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:31.035 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:31.036 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.165751, 2024-09-14T09:09:31.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074208332000000002, 2024-09-14T09:09:31.036 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.036 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.036 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:31.036 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.037 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:31.037 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:31.037 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2266 2024-09-14T09:09:31.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.037 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:31.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:31.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862738+0000", 2024-09-14T09:09:31.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017920300000000001 2024-09-14T09:09:31.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862744+0000", 2024-09-14T09:09:31.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3000000000000001e-06 2024-09-14T09:09:31.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862753+0000", 2024-09-14T09:09:31.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8179999999999999e-06 2024-09-14T09:09:31.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862785+0000", 2024-09-14T09:09:31.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1949000000000002e-05 2024-09-14T09:09:31.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936556+0000", 2024-09-14T09:09:31.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073770268999999999 2024-09-14T09:09:31.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:31.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936657+0000", 2024-09-14T09:09:31.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101387 2024-09-14T09:09:31.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936767+0000", 2024-09-14T09:09:31.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110406 2024-09-14T09:09:31.042 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.043 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.043 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.043 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2267 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4157440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:31.043 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:31.043 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.165512417999999, 2024-09-14T09:09:31.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074200918000000005, 2024-09-14T09:09:31.043 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.044 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.044 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:31.044 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.044 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:31.044 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:31.044 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2267 2024-09-14T09:09:31.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.044 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:31.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:31.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863416+0000", 2024-09-14T09:09:31.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000618492 2024-09-14T09:09:31.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863421+0000", 2024-09-14T09:09:31.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1359999999999996e-06 2024-09-14T09:09:31.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863434+0000", 2024-09-14T09:09:31.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2291e-05 2024-09-14T09:09:31.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863444+0000", 2024-09-14T09:09:31.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9769999999999995e-06 2024-09-14T09:09:31.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936808+0000", 2024-09-14T09:09:31.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073364051999999999 2024-09-14T09:09:31.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:31.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936892+0000", 2024-09-14T09:09:31.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4641999999999994e-05 2024-09-14T09:09:31.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936999+0000", 2024-09-14T09:09:31.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106328 2024-09-14T09:09:31.050 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.050 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.050 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.050 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2329 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 106496~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:31.051 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:31.051 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.164783808999999, 2024-09-14T09:09:31.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074180251000000003, 2024-09-14T09:09:31.051 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.051 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.051 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:31.051 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.052 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:31.052 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:31.052 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2329 2024-09-14T09:09:31.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.052 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:31.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:31.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864203+0000", 2024-09-14T09:09:31.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000677015 2024-09-14T09:09:31.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864208+0000", 2024-09-14T09:09:31.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.972e-06 2024-09-14T09:09:31.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864221+0000", 2024-09-14T09:09:31.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2683e-05 2024-09-14T09:09:31.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864229+0000", 2024-09-14T09:09:31.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0809999999999994e-06 2024-09-14T09:09:31.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937430+0000", 2024-09-14T09:09:31.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073201231000000005 2024-09-14T09:09:31.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:31.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937513+0000", 2024-09-14T09:09:31.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2652999999999996e-05 2024-09-14T09:09:31.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937707+0000", 2024-09-14T09:09:31.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000193616 2024-09-14T09:09:31.056 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.056 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.056 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.056 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2331 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 229376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:31.056 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:31.056 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.163966311999999, 2024-09-14T09:09:31.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.07400843, 2024-09-14T09:09:31.056 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.057 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.057 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:31.057 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.057 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:31.057 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:31.057 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2331 2024-09-14T09:09:31.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.057 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:31.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:31.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868104+0000", 2024-09-14T09:09:31.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003760453 2024-09-14T09:09:31.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868109+0000", 2024-09-14T09:09:31.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9339999999999997e-06 2024-09-14T09:09:31.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868119+0000", 2024-09-14T09:09:31.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5389999999999996e-06 2024-09-14T09:09:31.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868126+0000", 2024-09-14T09:09:31.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4499999999999998e-06 2024-09-14T09:09:31.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938065+0000", 2024-09-14T09:09:31.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069938809000000005 2024-09-14T09:09:31.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:31.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938148+0000", 2024-09-14T09:09:31.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3171999999999996e-05 2024-09-14T09:09:31.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938352+0000", 2024-09-14T09:09:31.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020407300000000001 2024-09-14T09:09:31.061 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.061 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.061 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.061 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2380 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3239936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:31.061 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:31.062 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.148941284000003, 2024-09-14T09:09:31.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073985913, 2024-09-14T09:09:31.062 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.062 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.062 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:31.062 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.062 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:31.062 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:31.062 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2380 2024-09-14T09:09:31.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.062 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:31.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:31.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879697+0000", 2024-09-14T09:09:31.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032864100000000001 2024-09-14T09:09:31.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879702+0000", 2024-09-14T09:09:31.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.578e-06 2024-09-14T09:09:31.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879716+0000", 2024-09-14T09:09:31.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.413e-05 2024-09-14T09:09:31.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879724+0000", 2024-09-14T09:09:31.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.559e-06 2024-09-14T09:09:31.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953155+0000", 2024-09-14T09:09:31.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073431221000000005 2024-09-14T09:09:31.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:31.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953247+0000", 2024-09-14T09:09:31.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1662000000000004e-05 2024-09-14T09:09:31.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953355+0000", 2024-09-14T09:09:31.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010812200000000001 2024-09-14T09:09:31.066 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.066 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.066 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.066 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2501 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2850816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:31.066 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:31.066 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.130398980000002, 2024-09-14T09:09:31.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074288858999999999, 2024-09-14T09:09:31.067 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.067 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.067 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:31.067 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.067 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:31.067 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:31.067 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2501 2024-09-14T09:09:31.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.067 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:31.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:31.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:31.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.41e-07 2024-09-14T09:09:31.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897913+0000", 2024-09-14T09:09:31.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3090000000000001e-06 2024-09-14T09:09:31.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897918+0000", 2024-09-14T09:09:31.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8470000000000003e-06 2024-09-14T09:09:31.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897922+0000", 2024-09-14T09:09:31.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5549999999999996e-06 2024-09-14T09:09:31.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971872+0000", 2024-09-14T09:09:31.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073950057999999999 2024-09-14T09:09:31.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:31.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971958+0000", 2024-09-14T09:09:31.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5941999999999998e-05 2024-09-14T09:09:31.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972200+0000", 2024-09-14T09:09:31.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000241907 2024-09-14T09:09:31.071 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.071 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.071 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.071 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2502 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2912256~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:31.071 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:31.071 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.130359800000001, 2024-09-14T09:09:31.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074614080999999999, 2024-09-14T09:09:31.071 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.071 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.071 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:31.071 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.071 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:31.072 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:31.072 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2502 2024-09-14T09:09:31.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.072 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:31.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:31.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897951+0000", 2024-09-14T09:09:31.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:09:31.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897953+0000", 2024-09-14T09:09:31.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5670000000000002e-06 2024-09-14T09:09:31.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897970+0000", 2024-09-14T09:09:31.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6319000000000001e-05 2024-09-14T09:09:31.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897976+0000", 2024-09-14T09:09:31.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8760000000000002e-06 2024-09-14T09:09:31.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972245+0000", 2024-09-14T09:09:31.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074269186000000001 2024-09-14T09:09:31.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:31.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972333+0000", 2024-09-14T09:09:31.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7800999999999995e-05 2024-09-14T09:09:31.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972564+0000", 2024-09-14T09:09:31.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000231833 2024-09-14T09:09:31.075 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.075 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.075 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.076 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2503 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2973696~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:31.076 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:31.076 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.130325783000004, 2024-09-14T09:09:31.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074944286999999998, 2024-09-14T09:09:31.076 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.077 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.077 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:31.077 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.077 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:31.077 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:31.077 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2503 2024-09-14T09:09:31.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.078 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:31.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:31.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897985+0000", 2024-09-14T09:09:31.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999998e-07 2024-09-14T09:09:31.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897987+0000", 2024-09-14T09:09:31.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.401e-06 2024-09-14T09:09:31.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897999+0000", 2024-09-14T09:09:31.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1851999999999999e-05 2024-09-14T09:09:31.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898005+0000", 2024-09-14T09:09:31.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9789999999999998e-06 2024-09-14T09:09:31.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972609+0000", 2024-09-14T09:09:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074604217 2024-09-14T09:09:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972684+0000", 2024-09-14T09:09:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4777999999999995e-05 2024-09-14T09:09:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972929+0000", 2024-09-14T09:09:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024448100000000001 2024-09-14T09:09:31.084 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.084 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.084 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.084 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2504 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3035136~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:31.084 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:31.084 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.130297691000003, 2024-09-14T09:09:31.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075285131000000005, 2024-09-14T09:09:31.084 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.084 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.084 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:31.084 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.085 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:31.085 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:31.085 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2504 2024-09-14T09:09:31.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.085 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:31.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:31.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898078+0000", 2024-09-14T09:09:31.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5775e-05 2024-09-14T09:09:31.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898082+0000", 2024-09-14T09:09:31.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.49e-06 2024-09-14T09:09:31.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898092+0000", 2024-09-14T09:09:31.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0509999999999999e-05 2024-09-14T09:09:31.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898099+0000", 2024-09-14T09:09:31.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.81e-06 2024-09-14T09:09:31.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972971+0000", 2024-09-14T09:09:31.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074871788999999994 2024-09-14T09:09:31.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:31.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973055+0000", 2024-09-14T09:09:31.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3980000000000006e-05 2024-09-14T09:09:31.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973298+0000", 2024-09-14T09:09:31.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024277700000000001 2024-09-14T09:09:31.088 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.088 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.088 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.089 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2505 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3096576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:31.089 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:31.089 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.130201436, 2024-09-14T09:09:31.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075506668999999998, 2024-09-14T09:09:31.089 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.089 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.089 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:31.089 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.089 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:31.089 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:31.089 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2505 2024-09-14T09:09:31.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.089 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:31.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:31.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898370+0000", 2024-09-14T09:09:31.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026128799999999998 2024-09-14T09:09:31.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898374+0000", 2024-09-14T09:09:31.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8070000000000001e-06 2024-09-14T09:09:31.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898383+0000", 2024-09-14T09:09:31.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0520000000000007e-06 2024-09-14T09:09:31.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898389+0000", 2024-09-14T09:09:31.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2639999999999997e-06 2024-09-14T09:09:31.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973330+0000", 2024-09-14T09:09:31.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074940548999999995 2024-09-14T09:09:31.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:31.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973402+0000", 2024-09-14T09:09:31.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2556000000000001e-05 2024-09-14T09:09:31.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973615+0000", 2024-09-14T09:09:31.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000213153 2024-09-14T09:09:31.093 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.093 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.093 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.093 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2506 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3158016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:31.093 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:31.093 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.129908192000002, 2024-09-14T09:09:31.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075556110999999995, 2024-09-14T09:09:31.093 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.093 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.093 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:31.093 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.094 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:31.094 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:31.094 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2506 2024-09-14T09:09:31.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.094 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:31.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:31.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898497+0000", 2024-09-14T09:09:31.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4806e-05 2024-09-14T09:09:31.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898500+0000", 2024-09-14T09:09:31.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.54e-06 2024-09-14T09:09:31.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898507+0000", 2024-09-14T09:09:31.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1590000000000004e-06 2024-09-14T09:09:31.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898513+0000", 2024-09-14T09:09:31.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.015e-06 2024-09-14T09:09:31.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973656+0000", 2024-09-14T09:09:31.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075142929999999997 2024-09-14T09:09:31.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:31.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973742+0000", 2024-09-14T09:09:31.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5535e-05 2024-09-14T09:09:31.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973958+0000", 2024-09-14T09:09:31.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000216126 2024-09-14T09:09:31.097 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.097 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.097 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.097 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2507 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3219456~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:31.097 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:31.097 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.129779608, 2024-09-14T09:09:31.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075623459000000004, 2024-09-14T09:09:31.097 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.097 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.097 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:31.098 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.098 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:31.098 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:31.098 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2507 2024-09-14T09:09:31.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.098 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:31.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:31.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898761+0000", 2024-09-14T09:09:31.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000230614 2024-09-14T09:09:31.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898765+0000", 2024-09-14T09:09:31.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6629999999999999e-06 2024-09-14T09:09:31.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898774+0000", 2024-09-14T09:09:31.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6749999999999997e-06 2024-09-14T09:09:31.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898781+0000", 2024-09-14T09:09:31.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4640000000000003e-06 2024-09-14T09:09:31.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973985+0000", 2024-09-14T09:09:31.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075204101999999995 2024-09-14T09:09:31.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:31.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974063+0000", 2024-09-14T09:09:31.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7632000000000005e-05 2024-09-14T09:09:31.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974154+0000", 2024-09-14T09:09:31.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1309000000000003e-05 2024-09-14T09:09:31.101 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.101 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.101 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.101 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2508 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3280896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:31.101 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:31.101 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.129517845000002, 2024-09-14T09:09:31.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075576943999999993, 2024-09-14T09:09:31.102 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.102 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.102 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:31.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:31.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:31.102 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2508 2024-09-14T09:09:31.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.102 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:31.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:31.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899176+0000", 2024-09-14T09:09:31.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038340500000000002 2024-09-14T09:09:31.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899179+0000", 2024-09-14T09:09:31.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0290000000000001e-06 2024-09-14T09:09:31.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899186+0000", 2024-09-14T09:09:31.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8199999999999999e-06 2024-09-14T09:09:31.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899190+0000", 2024-09-14T09:09:31.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2050000000000004e-06 2024-09-14T09:09:31.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974193+0000", 2024-09-14T09:09:31.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075003632000000001 2024-09-14T09:09:31.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:31.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974276+0000", 2024-09-14T09:09:31.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2272000000000001e-05 2024-09-14T09:09:31.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974369+0000", 2024-09-14T09:09:31.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3580999999999997e-05 2024-09-14T09:09:31.106 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.106 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.106 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.106 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2509 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3342336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:31.106 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:31.106 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.129110228000002, 2024-09-14T09:09:31.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075356229999999996, 2024-09-14T09:09:31.106 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.106 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.106 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:31.107 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.107 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:31.107 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:31.107 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2509 2024-09-14T09:09:31.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.107 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:31.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:31.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899439+0000", 2024-09-14T09:09:31.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023958599999999999 2024-09-14T09:09:31.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899444+0000", 2024-09-14T09:09:31.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8790000000000002e-06 2024-09-14T09:09:31.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899455+0000", 2024-09-14T09:09:31.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0597999999999999e-05 2024-09-14T09:09:31.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899462+0000", 2024-09-14T09:09:31.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8179999999999998e-06 2024-09-14T09:09:31.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974400+0000", 2024-09-14T09:09:31.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074937999000000005 2024-09-14T09:09:31.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:31.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974465+0000", 2024-09-14T09:09:31.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5134000000000004e-05 2024-09-14T09:09:31.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974556+0000", 2024-09-14T09:09:31.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1216000000000002e-05 2024-09-14T09:09:31.110 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.110 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.110 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.110 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2510 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3403776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:31.111 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:31.111 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.128834834999999, 2024-09-14T09:09:31.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075295775999999995, 2024-09-14T09:09:31.111 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.111 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.111 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:31.111 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.111 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:31.111 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:31.111 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2510 2024-09-14T09:09:31.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.111 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:31.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:31.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899691+0000", 2024-09-14T09:09:31.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021615999999999999 2024-09-14T09:09:31.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899696+0000", 2024-09-14T09:09:31.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3200000000000001e-06 2024-09-14T09:09:31.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899704+0000", 2024-09-14T09:09:31.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9440000000000005e-06 2024-09-14T09:09:31.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899710+0000", 2024-09-14T09:09:31.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.584e-06 2024-09-14T09:09:31.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974594+0000", 2024-09-14T09:09:31.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074883551000000007 2024-09-14T09:09:31.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:31.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974679+0000", 2024-09-14T09:09:31.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5365999999999995e-05 2024-09-14T09:09:31.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974771+0000", 2024-09-14T09:09:31.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1850999999999999e-05 2024-09-14T09:09:31.115 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.115 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.115 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.116 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2511 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3465216~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:31.116 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:31.116 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.128588616999998, 2024-09-14T09:09:31.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075234668000000005, 2024-09-14T09:09:31.116 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.116 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.116 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:31.116 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.116 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:31.116 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:31.116 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2511 2024-09-14T09:09:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899951+0000", 2024-09-14T09:09:31.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000229569 2024-09-14T09:09:31.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899955+0000", 2024-09-14T09:09:31.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1010000000000002e-06 2024-09-14T09:09:31.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899971+0000", 2024-09-14T09:09:31.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5648999999999999e-05 2024-09-14T09:09:31.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899978+0000", 2024-09-14T09:09:31.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0829999999999998e-06 2024-09-14T09:09:31.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974806+0000", 2024-09-14T09:09:31.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074828092999999998 2024-09-14T09:09:31.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:31.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974870+0000", 2024-09-14T09:09:31.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4492000000000005e-05 2024-09-14T09:09:31.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974956+0000", 2024-09-14T09:09:31.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5680999999999995e-05 2024-09-14T09:09:31.120 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.120 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.120 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.120 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2512 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3526656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:31.120 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:31.120 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.128321071999999, 2024-09-14T09:09:31.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075178812999999997, 2024-09-14T09:09:31.121 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.121 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.121 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:31.121 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.121 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:31.121 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:31.121 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2512 2024-09-14T09:09:31.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.121 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:31.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:31.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904181+0000", 2024-09-14T09:09:31.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041919399999999999 2024-09-14T09:09:31.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904186+0000", 2024-09-14T09:09:31.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2390000000000002e-06 2024-09-14T09:09:31.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904199+0000", 2024-09-14T09:09:31.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2709e-05 2024-09-14T09:09:31.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904207+0000", 2024-09-14T09:09:31.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8150000000000006e-06 2024-09-14T09:09:31.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975000+0000", 2024-09-14T09:09:31.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.070793444999999997 2024-09-14T09:09:31.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:31.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975079+0000", 2024-09-14T09:09:31.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8480999999999996e-05 2024-09-14T09:09:31.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975168+0000", 2024-09-14T09:09:31.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9184000000000005e-05 2024-09-14T09:09:31.124 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.124 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.124 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.125 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:22840 3.15 3:a8cf3dc2:::rbd_header.1112a10502fe:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:31.125 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:09:31.125 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.46874805, 2024-09-14T09:09:31.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.119998785, 2024-09-14T09:09:31.125 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.125 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.125 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:31.125 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.126 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:09:31.126 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:09:31.126 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 22840 2024-09-14T09:09:31.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.126 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:09:31.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:09:31.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642492+0000", 2024-09-14T09:09:31.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.082930276999999997 2024-09-14T09:09:31.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642495+0000", 2024-09-14T09:09:31.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9809999999999999e-06 2024-09-14T09:09:31.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642501+0000", 2024-09-14T09:09:31.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-09-14T09:09:31.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642506+0000", 2024-09-14T09:09:31.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6650000000000002e-06 2024-09-14T09:09:31.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679483+0000", 2024-09-14T09:09:31.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036977777000000003 2024-09-14T09:09:31.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:31.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679517+0000", 2024-09-14T09:09:31.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.345e-05 2024-09-14T09:09:31.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679561+0000", 2024-09-14T09:09:31.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3930999999999997e-05 2024-09-14T09:09:31.129 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.129 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.129 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.129 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:22857 3.15 3:a8cf3dc2:::rbd_header.1112a10502fe:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:31.130 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:09:31.130 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.318854125, 2024-09-14T09:09:31.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.088427917999999994, 2024-09-14T09:09:31.130 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.130 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.130 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:31.130 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.130 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:09:31.130 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:09:31.130 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 22857 2024-09-14T09:09:31.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.130 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:09:31.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:09:31.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777685+0000", 2024-09-14T09:09:31.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.068229181999999999 2024-09-14T09:09:31.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777688+0000", 2024-09-14T09:09:31.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1980000000000001e-06 2024-09-14T09:09:31.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777695+0000", 2024-09-14T09:09:31.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:09:31.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777700+0000", 2024-09-14T09:09:31.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0919999999999997e-06 2024-09-14T09:09:31.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797735+0000", 2024-09-14T09:09:31.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0200351 2024-09-14T09:09:31.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:31.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797800+0000", 2024-09-14T09:09:31.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4305000000000002e-05 2024-09-14T09:09:31.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797884+0000", 2024-09-14T09:09:31.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4344000000000004e-05 2024-09-14T09:09:31.133 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.133 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.134 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.134 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.134 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.134 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:31.135 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone35 from 0x19abe00 (overlap 0x265400) to 0x1ad400 2024-09-14T09:09:31.135 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:31.137+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:31.136 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:09:31.236 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:31.238+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:31.282 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:31.282 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:31.282 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:09:31.282 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:31.290 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:09:31.337 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:31.339+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:31.400 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:31.400 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:31.400 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:31.400 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:31.400 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:31.409 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:09:31.453 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:31.455+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:31.462 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #34, image image_client.0-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent35 2024-09-14T09:09:31.508 INFO:teuthology.orchestra.run.smithi148.stdout:5428 punch from 0x101fa00 to 0x1028c00, (0x9200 bytes) 2024-09-14T09:09:31.515 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:31.515 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:31.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:31.515 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:31.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.515 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:987 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:31.515 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:31.515 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.658029429999999, 2024-09-14T09:09:31.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001359466, 2024-09-14T09:09:31.516 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.516 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.516 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:31.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:31.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:31.516 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 987 2024-09-14T09:09:31.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.516 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:31.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:31.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858333+0000", 2024-09-14T09:09:31.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.621e-06 2024-09-14T09:09:31.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858349+0000", 2024-09-14T09:09:31.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5758000000000001e-05 2024-09-14T09:09:31.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858366+0000", 2024-09-14T09:09:31.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7368e-05 2024-09-14T09:09:31.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858382+0000", 2024-09-14T09:09:31.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6039e-05 2024-09-14T09:09:31.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858441+0000", 2024-09-14T09:09:31.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8662999999999997e-05 2024-09-14T09:09:31.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858449+0000", 2024-09-14T09:09:31.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3960000000000006e-06 2024-09-14T09:09:31.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859682+0000", 2024-09-14T09:09:31.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001233096 2024-09-14T09:09:31.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859691+0000", 2024-09-14T09:09:31.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5250000000000005e-06 2024-09-14T09:09:31.520 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.520 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.520 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.520 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:988 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:31.520 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:31.520 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.657901559999999, 2024-09-14T09:09:31.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0012656799999999, 2024-09-14T09:09:31.520 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.521 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.521 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:31.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:31.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:31.521 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 988 2024-09-14T09:09:31.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.521 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:31.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:31.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858460+0000", 2024-09-14T09:09:31.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9999999999999997e-07 2024-09-14T09:09:31.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858463+0000", 2024-09-14T09:09:31.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7459999999999998e-06 2024-09-14T09:09:31.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858471+0000", 2024-09-14T09:09:31.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3900000000000004e-06 2024-09-14T09:09:31.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858478+0000", 2024-09-14T09:09:31.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7020000000000004e-06 2024-09-14T09:09:31.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859102+0000", 2024-09-14T09:09:31.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062419699999999995 2024-09-14T09:09:31.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859109+0000", 2024-09-14T09:09:31.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7419999999999997e-06 2024-09-14T09:09:31.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859718+0000", 2024-09-14T09:09:31.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006085629999999 2024-09-14T09:09:31.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859725+0000", 2024-09-14T09:09:31.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7399999999999998e-06 2024-09-14T09:09:31.525 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.525 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.525 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.525 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1003 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:31.525 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:31.526 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.657038323000002, 2024-09-14T09:09:31.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009495209999999, 2024-09-14T09:09:31.526 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.526 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.526 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:31.526 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.526 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:31.526 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:31.526 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1003 2024-09-14T09:09:31.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.526 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:31.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:31.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859323+0000", 2024-09-14T09:09:31.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3099999999999998e-07 2024-09-14T09:09:31.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859326+0000", 2024-09-14T09:09:31.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-06 2024-09-14T09:09:31.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859333+0000", 2024-09-14T09:09:31.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3300000000000001e-06 2024-09-14T09:09:31.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859339+0000", 2024-09-14T09:09:31.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6400000000000002e-06 2024-09-14T09:09:31.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859387+0000", 2024-09-14T09:09:31.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8448000000000001e-05 2024-09-14T09:09:31.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:09:31.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9540000000000004e-06 2024-09-14T09:09:31.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860260+0000", 2024-09-14T09:09:31.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000864921 2024-09-14T09:09:31.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860272+0000", 2024-09-14T09:09:31.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1993e-05 2024-09-14T09:09:31.530 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.530 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.530 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.530 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1004 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:31.530 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:31.530 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.657002747999996, 2024-09-14T09:09:31.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000947875, 2024-09-14T09:09:31.530 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.530 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.531 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:31.531 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.531 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:31.531 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:31.531 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1004 2024-09-14T09:09:31.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.531 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:31.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:31.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:31.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7199999999999999e-07 2024-09-14T09:09:31.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859361+0000", 2024-09-14T09:09:31.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.892e-06 2024-09-14T09:09:31.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859368+0000", 2024-09-14T09:09:31.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4370000000000004e-06 2024-09-14T09:09:31.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859373+0000", 2024-09-14T09:09:31.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6690000000000003e-06 2024-09-14T09:09:31.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859430+0000", 2024-09-14T09:09:31.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6456999999999998e-05 2024-09-14T09:09:31.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859434+0000", 2024-09-14T09:09:31.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8410000000000002e-06 2024-09-14T09:09:31.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860299+0000", 2024-09-14T09:09:31.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008650370000001 2024-09-14T09:09:31.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860306+0000", 2024-09-14T09:09:31.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0700000000000001e-06 2024-09-14T09:09:31.535 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.535 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.535 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.535 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1005 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:31.535 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:31.535 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.656979075000002, 2024-09-14T09:09:31.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009585480000001, 2024-09-14T09:09:31.536 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.536 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.536 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:31.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:31.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:31.536 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1005 2024-09-14T09:09:31.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.536 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:31.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:31.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:31.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9700000000000002e-07 2024-09-14T09:09:31.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859384+0000", 2024-09-14T09:09:31.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.024e-06 2024-09-14T09:09:31.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859390+0000", 2024-09-14T09:09:31.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7080000000000002e-06 2024-09-14T09:09:31.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:09:31.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8980000000000004e-06 2024-09-14T09:09:31.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859527+0000", 2024-09-14T09:09:31.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013228099999999999 2024-09-14T09:09:31.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859532+0000", 2024-09-14T09:09:31.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5899999999999998e-06 2024-09-14T09:09:31.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860330+0000", 2024-09-14T09:09:31.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0007973509999999 2024-09-14T09:09:31.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860340+0000", 2024-09-14T09:09:31.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0299000000000001e-05 2024-09-14T09:09:31.540 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.540 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.540 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.540 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1006 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:31.540 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:31.540 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.656955879000002, 2024-09-14T09:09:31.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001032039, 2024-09-14T09:09:31.540 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.540 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.540 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:31.540 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.541 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:31.541 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:31.541 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1006 2024-09-14T09:09:31.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.541 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:31.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:31.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:31.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6499999999999999e-07 2024-09-14T09:09:31.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859407+0000", 2024-09-14T09:09:31.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1160000000000002e-06 2024-09-14T09:09:31.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859413+0000", 2024-09-14T09:09:31.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8880000000000002e-06 2024-09-14T09:09:31.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859419+0000", 2024-09-14T09:09:31.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3550000000000004e-06 2024-09-14T09:09:31.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859558+0000", 2024-09-14T09:09:31.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000138942 2024-09-14T09:09:31.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859563+0000", 2024-09-14T09:09:31.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.665e-06 2024-09-14T09:09:31.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860427+0000", 2024-09-14T09:09:31.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008635299999999 2024-09-14T09:09:31.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860437+0000", 2024-09-14T09:09:31.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0078000000000001e-05 2024-09-14T09:09:31.545 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.545 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.545 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.545 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1045 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:31.545 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:31.545 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.656756399000002, 2024-09-14T09:09:31.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008612990000001, 2024-09-14T09:09:31.545 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.545 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.545 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:31.546 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.546 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:31.546 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:31.546 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1045 2024-09-14T09:09:31.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.546 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:31.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:31.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859605+0000", 2024-09-14T09:09:31.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6e-07 2024-09-14T09:09:31.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859606+0000", 2024-09-14T09:09:31.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8819999999999999e-06 2024-09-14T09:09:31.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859610+0000", 2024-09-14T09:09:31.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4290000000000001e-06 2024-09-14T09:09:31.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859612+0000", 2024-09-14T09:09:31.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6309999999999999e-06 2024-09-14T09:09:31.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859643+0000", 2024-09-14T09:09:31.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0224000000000001e-05 2024-09-14T09:09:31.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859647+0000", 2024-09-14T09:09:31.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9049999999999999e-06 2024-09-14T09:09:31.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860458+0000", 2024-09-14T09:09:31.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008111180000001 2024-09-14T09:09:31.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860466+0000", 2024-09-14T09:09:31.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:09:31.550 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.550 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.550 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.550 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1046 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:31.550 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:31.550 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.656742942000001, 2024-09-14T09:09:31.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000874262, 2024-09-14T09:09:31.550 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.550 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.550 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:31.551 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.551 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:31.551 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:31.551 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1046 2024-09-14T09:09:31.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.551 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:31.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:31.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:31.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:09:31.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859619+0000", 2024-09-14T09:09:31.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0559999999999999e-06 2024-09-14T09:09:31.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859622+0000", 2024-09-14T09:09:31.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0170000000000001e-06 2024-09-14T09:09:31.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859625+0000", 2024-09-14T09:09:31.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7209999999999999e-06 2024-09-14T09:09:31.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859666+0000", 2024-09-14T09:09:31.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1677000000000001e-05 2024-09-14T09:09:31.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859672+0000", 2024-09-14T09:09:31.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4609999999999999e-06 2024-09-14T09:09:31.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860485+0000", 2024-09-14T09:09:31.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000813505 2024-09-14T09:09:31.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860492+0000", 2024-09-14T09:09:31.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6159999999999998e-06 2024-09-14T09:09:31.555 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.555 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.555 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.555 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1047 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:31.555 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:31.555 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.656731608000001, 2024-09-14T09:09:31.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008950190000001, 2024-09-14T09:09:31.556 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.556 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.556 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:31.556 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.556 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:31.556 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:31.556 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1047 2024-09-14T09:09:31.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.556 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:31.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:31.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:31.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6600000000000003e-07 2024-09-14T09:09:31.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859631+0000", 2024-09-14T09:09:31.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5600000000000001e-06 2024-09-14T09:09:31.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859637+0000", 2024-09-14T09:09:31.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7309999999999998e-06 2024-09-14T09:09:31.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859641+0000", 2024-09-14T09:09:31.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0840000000000002e-06 2024-09-14T09:09:31.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859691+0000", 2024-09-14T09:09:31.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0587999999999997e-05 2024-09-14T09:09:31.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859696+0000", 2024-09-14T09:09:31.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8940000000000001e-06 2024-09-14T09:09:31.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860516+0000", 2024-09-14T09:09:31.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008200780000001 2024-09-14T09:09:31.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860524+0000", 2024-09-14T09:09:31.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8180000000000004e-06 2024-09-14T09:09:31.560 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.560 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.560 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.560 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1048 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:31.560 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:31.560 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.656699848999999, 2024-09-14T09:09:31.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008904780000001, 2024-09-14T09:09:31.560 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.560 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.561 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:31.561 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.561 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:31.561 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:31.561 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1048 2024-09-14T09:09:31.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.561 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:31.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:31.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:31.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4700000000000002e-07 2024-09-14T09:09:31.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859663+0000", 2024-09-14T09:09:31.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0420000000000001e-06 2024-09-14T09:09:31.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859669+0000", 2024-09-14T09:09:31.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8989999999999998e-06 2024-09-14T09:09:31.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859673+0000", 2024-09-14T09:09:31.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2209999999999999e-06 2024-09-14T09:09:31.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859719+0000", 2024-09-14T09:09:31.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5788000000000003e-05 2024-09-14T09:09:31.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859725+0000", 2024-09-14T09:09:31.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4770000000000002e-06 2024-09-14T09:09:31.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860544+0000", 2024-09-14T09:09:31.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008194669999999 2024-09-14T09:09:31.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860551+0000", 2024-09-14T09:09:31.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1369999999999996e-06 2024-09-14T09:09:31.565 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.565 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.565 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.565 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1088 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:31.565 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:31.565 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.656481012, 2024-09-14T09:09:31.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00073166, 2024-09-14T09:09:31.565 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.566 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.566 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:31.566 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.566 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:31.566 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:31.566 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1088 2024-09-14T09:09:31.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.566 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:31.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:31.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:31.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3700000000000001e-07 2024-09-14T09:09:31.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859882+0000", 2024-09-14T09:09:31.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.739e-06 2024-09-14T09:09:31.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859887+0000", 2024-09-14T09:09:31.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:09:31.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859892+0000", 2024-09-14T09:09:31.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7119999999999999e-06 2024-09-14T09:09:31.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859945+0000", 2024-09-14T09:09:31.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2762000000000001e-05 2024-09-14T09:09:31.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859950+0000", 2024-09-14T09:09:31.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-09-14T09:09:31.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860603+0000", 2024-09-14T09:09:31.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000653263 2024-09-14T09:09:31.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860611+0000", 2024-09-14T09:09:31.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-09-14T09:09:31.570 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.570 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.570 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.570 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1089 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:31.570 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:31.570 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.656462855999997, 2024-09-14T09:09:31.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000733943, 2024-09-14T09:09:31.570 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.570 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.570 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:31.570 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.570 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:31.570 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:31.571 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1089 2024-09-14T09:09:31.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.571 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:31.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:31.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:31.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3000000000000002e-07 2024-09-14T09:09:31.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859900+0000", 2024-09-14T09:09:31.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9199999999999998e-06 2024-09-14T09:09:31.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859906+0000", 2024-09-14T09:09:31.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0889999999999996e-06 2024-09-14T09:09:31.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859911+0000", 2024-09-14T09:09:31.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6419999999999998e-06 2024-09-14T09:09:31.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860010+0000", 2024-09-14T09:09:31.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8956000000000006e-05 2024-09-14T09:09:31.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860014+0000", 2024-09-14T09:09:31.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.741e-06 2024-09-14T09:09:31.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860627+0000", 2024-09-14T09:09:31.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00061277 2024-09-14T09:09:31.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860632+0000", 2024-09-14T09:09:31.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:09:31.575 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.575 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.575 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.575 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1090 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:31.575 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:31.575 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.656443183999997, 2024-09-14T09:09:31.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000740763, 2024-09-14T09:09:31.575 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.575 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.575 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:31.575 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.575 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:31.576 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:31.576 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1090 2024-09-14T09:09:31.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.576 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:31.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:31.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859918+0000", 2024-09-14T09:09:31.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5199999999999998e-07 2024-09-14T09:09:31.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859920+0000", 2024-09-14T09:09:31.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9240000000000001e-06 2024-09-14T09:09:31.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859925+0000", 2024-09-14T09:09:31.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3929999999999999e-06 2024-09-14T09:09:31.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859929+0000", 2024-09-14T09:09:31.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4769999999999999e-06 2024-09-14T09:09:31.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860034+0000", 2024-09-14T09:09:31.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010549500000000001 2024-09-14T09:09:31.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860039+0000", 2024-09-14T09:09:31.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5700000000000003e-06 2024-09-14T09:09:31.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860650+0000", 2024-09-14T09:09:31.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006116119999999 2024-09-14T09:09:31.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860658+0000", 2024-09-14T09:09:31.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:09:31.580 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.580 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.580 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.580 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60374 3.14 3.6e2cd654 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:31.580 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:31.580 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 15.026564874, 2024-09-14T09:09:31.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3129433100000001, 2024-09-14T09:09:31.580 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.580 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.580 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:31.581 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.581 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:31.581 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:31.581 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60374 2024-09-14T09:09:31.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.581 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:31.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:31.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:31.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2100000000000002e-07 2024-09-14T09:09:31.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489799+0000", 2024-09-14T09:09:31.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3530000000000002e-06 2024-09-14T09:09:31.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489808+0000", 2024-09-14T09:09:31.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2e-06 2024-09-14T09:09:31.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489813+0000", 2024-09-14T09:09:31.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3249999999999998e-06 2024-09-14T09:09:31.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489866+0000", 2024-09-14T09:09:31.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3074e-05 2024-09-14T09:09:31.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489875+0000", 2024-09-14T09:09:31.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2760000000000006e-06 2024-09-14T09:09:31.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801379+0000", 2024-09-14T09:09:31.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.31150346200000001 2024-09-14T09:09:31.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801387+0000", 2024-09-14T09:09:31.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.038e-06 2024-09-14T09:09:31.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802728+0000", 2024-09-14T09:09:31.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013415569999999 2024-09-14T09:09:31.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802739+0000", 2024-09-14T09:09:31.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0604e-05 2024-09-14T09:09:31.586 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.586 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.586 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.586 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62179 3.14 3.78cf1974 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:31.586 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:09:31.586 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 15.026534245000001, 2024-09-14T09:09:31.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3129429109999999, 2024-09-14T09:09:31.586 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.586 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.587 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:31.587 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.587 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:31.587 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:31.587 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62179 2024-09-14T09:09:31.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.587 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:09:31.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:09:31.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489827+0000", 2024-09-14T09:09:31.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4300000000000003e-07 2024-09-14T09:09:31.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489829+0000", 2024-09-14T09:09:31.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2129999999999998e-06 2024-09-14T09:09:31.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489836+0000", 2024-09-14T09:09:31.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0360000000000001e-06 2024-09-14T09:09:31.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489841+0000", 2024-09-14T09:09:31.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0710000000000002e-06 2024-09-14T09:09:31.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489905+0000", 2024-09-14T09:09:31.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3578999999999996e-05 2024-09-14T09:09:31.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489913+0000", 2024-09-14T09:09:31.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2269999999999993e-06 2024-09-14T09:09:31.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801412+0000", 2024-09-14T09:09:31.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.311498989 2024-09-14T09:09:31.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801419+0000", 2024-09-14T09:09:31.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1400000000000002e-06 2024-09-14T09:09:31.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802761+0000", 2024-09-14T09:09:31.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013414620000001 2024-09-14T09:09:31.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802769+0000", 2024-09-14T09:09:31.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6510000000000007e-06 2024-09-14T09:09:31.591 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.591 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.591 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.591 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63551 3.14 3.88ccb734 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:31.591 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:09:31.591 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 15.026502615, 2024-09-14T09:09:31.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.312941181, 2024-09-14T09:09:31.592 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.592 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.592 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:31.592 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.592 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:31.592 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:31.592 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63551 2024-09-14T09:09:31.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.592 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:09:31.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:09:31.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489859+0000", 2024-09-14T09:09:31.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9200000000000001e-07 2024-09-14T09:09:31.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489862+0000", 2024-09-14T09:09:31.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9629999999999998e-06 2024-09-14T09:09:31.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489868+0000", 2024-09-14T09:09:31.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3890000000000002e-06 2024-09-14T09:09:31.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489875+0000", 2024-09-14T09:09:31.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7950000000000002e-06 2024-09-14T09:09:31.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489939+0000", 2024-09-14T09:09:31.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4704999999999998e-05 2024-09-14T09:09:31.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489949+0000", 2024-09-14T09:09:31.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7799999999999995e-06 2024-09-14T09:09:31.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801447+0000", 2024-09-14T09:09:31.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.311497527 2024-09-14T09:09:31.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801454+0000", 2024-09-14T09:09:31.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1080000000000004e-06 2024-09-14T09:09:31.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802790+0000", 2024-09-14T09:09:31.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013364330000001 2024-09-14T09:09:31.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802799+0000", 2024-09-14T09:09:31.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8890000000000008e-06 2024-09-14T09:09:31.597 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.597 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.597 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.597 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:68716 3.14 3.96fe1934 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:31.597 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:09:31.597 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.974932148000001, 2024-09-14T09:09:31.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2614012569999999, 2024-09-14T09:09:31.598 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.598 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.598 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:31.598 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.598 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:31.598 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:31.598 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 68716 2024-09-14T09:09:31.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.598 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:09:31.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:09:31.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541429+0000", 2024-09-14T09:09:31.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8899999999999998e-07 2024-09-14T09:09:31.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541433+0000", 2024-09-14T09:09:31.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7330000000000001e-06 2024-09-14T09:09:31.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541442+0000", 2024-09-14T09:09:31.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.346e-06 2024-09-14T09:09:31.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541449+0000", 2024-09-14T09:09:31.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.579e-06 2024-09-14T09:09:31.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541839+0000", 2024-09-14T09:09:31.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038993699999999998 2024-09-14T09:09:31.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541849+0000", 2024-09-14T09:09:31.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0217999999999999e-05 2024-09-14T09:09:31.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801480+0000", 2024-09-14T09:09:31.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.25963061399999998 2024-09-14T09:09:31.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801486+0000", 2024-09-14T09:09:31.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.776e-06 2024-09-14T09:09:31.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802821+0000", 2024-09-14T09:09:31.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00133435 2024-09-14T09:09:31.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802830+0000", 2024-09-14T09:09:31.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9150000000000002e-06 2024-09-14T09:09:31.603 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.603 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.603 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.603 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:69492 3.14 3.4a93714 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:31.603 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:09:31.603 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.914392452, 2024-09-14T09:09:31.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2008910690000001, 2024-09-14T09:09:31.603 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.603 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.603 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:31.603 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.604 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:31.604 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:31.604 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 69492 2024-09-14T09:09:31.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.604 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:09:31.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:09:31.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601969+0000", 2024-09-14T09:09:31.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3099999999999996e-07 2024-09-14T09:09:31.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601973+0000", 2024-09-14T09:09:31.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5899999999999999e-06 2024-09-14T09:09:31.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601983+0000", 2024-09-14T09:09:31.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098999999999999e-05 2024-09-14T09:09:31.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601989+0000", 2024-09-14T09:09:31.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0209999999999996e-06 2024-09-14T09:09:31.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.602066+0000", 2024-09-14T09:09:31.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7075000000000003e-05 2024-09-14T09:09:31.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.602075+0000", 2024-09-14T09:09:31.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8389999999999996e-06 2024-09-14T09:09:31.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801512+0000", 2024-09-14T09:09:31.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.199437225 2024-09-14T09:09:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801519+0000", 2024-09-14T09:09:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9970000000000001e-06 2024-09-14T09:09:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802851+0000", 2024-09-14T09:09:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001331711 2024-09-14T09:09:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802859+0000", 2024-09-14T09:09:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6810000000000004e-06 2024-09-14T09:09:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:72035 3.14 3.1cba9a34 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:09:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.795064564, 2024-09-14T09:09:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0815917340000001, 2024-09-14T09:09:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 72035 2024-09-14T09:09:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:09:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:09:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721297+0000", 2024-09-14T09:09:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5199999999999996e-07 2024-09-14T09:09:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721301+0000", 2024-09-14T09:09:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7790000000000002e-06 2024-09-14T09:09:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721309+0000", 2024-09-14T09:09:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8019999999999998e-06 2024-09-14T09:09:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721315+0000", 2024-09-14T09:09:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:09:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721367+0000", 2024-09-14T09:09:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2280000000000001e-05 2024-09-14T09:09:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721376+0000", 2024-09-14T09:09:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5439999999999999e-06 2024-09-14T09:09:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801545+0000", 2024-09-14T09:09:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.080169952000000003 2024-09-14T09:09:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801552+0000", 2024-09-14T09:09:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8390000000000001e-06 2024-09-14T09:09:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802879+0000", 2024-09-14T09:09:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001326846 2024-09-14T09:09:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802888+0000", 2024-09-14T09:09:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6330000000000002e-06 2024-09-14T09:09:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73403 3.14 3.87b99f94 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.752789903, 2024-09-14T09:09:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0393459899999999, 2024-09-14T09:09:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73403 2024-09-14T09:09:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9200000000000001e-07 2024-09-14T09:09:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763574+0000", 2024-09-14T09:09:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6510000000000001e-06 2024-09-14T09:09:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763582+0000", 2024-09-14T09:09:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2579999999999995e-06 2024-09-14T09:09:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763592+0000", 2024-09-14T09:09:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0193e-05 2024-09-14T09:09:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763643+0000", 2024-09-14T09:09:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0862000000000002e-05 2024-09-14T09:09:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763654+0000", 2024-09-14T09:09:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0890000000000001e-05 2024-09-14T09:09:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801577+0000", 2024-09-14T09:09:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037923074000000001 2024-09-14T09:09:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801584+0000", 2024-09-14T09:09:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0060000000000003e-06 2024-09-14T09:09:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802908+0000", 2024-09-14T09:09:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013235149999999 2024-09-14T09:09:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802917+0000", 2024-09-14T09:09:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9490000000000002e-06 2024-09-14T09:09:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:31.620 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:31.623 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:09:31.623 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:31.623+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:31.624 INFO:teuthology.orchestra.run.smithi148.stdout:5432 write 0x3150000 thru 0x31512df (0x12e0 bytes) 2024-09-14T09:09:31.624 INFO:teuthology.orchestra.run.smithi148.stdout:5433 punch from 0x2afd400 to 0x2b0a200, (0xce00 bytes) 2024-09-14T09:09:31.624 INFO:teuthology.orchestra.run.smithi148.stdout:5434 write 0x19f1800 thru 0x1a01432 (0xfc33 bytes) 2024-09-14T09:09:31.624 INFO:teuthology.orchestra.run.smithi148.stdout:5435 read 0x177d600 thru 0x1784daa (0x77ab bytes) 2024-09-14T09:09:31.625 INFO:teuthology.orchestra.run.smithi148.stdout:5439 write 0x4ee3600 thru 0x4eefdec (0xc7ed bytes) 2024-09-14T09:09:31.625 INFO:teuthology.orchestra.run.smithi148.stdout:5440 trunc from 0x4eefe00 to 0x3eea800 2024-09-14T09:09:31.625 INFO:teuthology.orchestra.run.smithi148.stdout:5441 read 0x1b5b800 thru 0x1b68ee7 (0xd6e8 bytes) 2024-09-14T09:09:31.625 INFO:teuthology.orchestra.run.smithi148.stdout:5442 read 0xb2b600 thru 0xb39d1c (0xe71d bytes) 2024-09-14T09:09:31.625 INFO:teuthology.orchestra.run.smithi148.stdout:5444 read 0x36ebe00 thru 0x36ec43b (0x63c bytes) 2024-09-14T09:09:31.625 INFO:teuthology.orchestra.run.smithi148.stdout:5446 write 0x1303c00 thru 0x131140e (0xd80f bytes) 2024-09-14T09:09:31.625 INFO:teuthology.orchestra.run.smithi148.stdout:5447 punch from 0x2f85800 to 0x2f86600, (0xe00 bytes) 2024-09-14T09:09:31.625 INFO:teuthology.orchestra.run.smithi148.stdout:5448 write 0x6bb3e00 thru 0x6bbbb16 (0x7d17 bytes) 2024-09-14T09:09:31.625 INFO:teuthology.orchestra.run.smithi148.stdout:5450 trunc from 0x6bbbc00 to 0xe4b600 2024-09-14T09:09:31.625 INFO:teuthology.orchestra.run.smithi148.stdout:5452 punch from 0xdcf400 to 0xdd4c00, (0x5800 bytes) 2024-09-14T09:09:31.625 INFO:teuthology.orchestra.run.smithi148.stdout:5454 read 0x4d3400 thru 0x4d3592 (0x193 bytes) 2024-09-14T09:09:31.625 INFO:teuthology.orchestra.run.smithi148.stdout:5456 read 0x3c3600 thru 0x3cd2ab (0x9cac bytes) 2024-09-14T09:09:31.625 INFO:teuthology.orchestra.run.smithi148.stdout:5457 punch from 0x1cfe00 to 0x1da400, (0xa600 bytes) 2024-09-14T09:09:31.628 INFO:teuthology.orchestra.run.smithi148.stdout:5458 write 0x7faa800 thru 0x7fab3be (0xbbf bytes) 2024-09-14T09:09:31.650 INFO:teuthology.orchestra.run.smithi148.stdout:5459 write 0xab4cc00 thru 0xab50a60 (0x3e61 bytes) 2024-09-14T09:09:31.651 INFO:teuthology.orchestra.run.smithi148.stdout:5460 read 0x3d6b800 thru 0x3d7a893 (0xf094 bytes) 2024-09-14T09:09:31.651 INFO:teuthology.orchestra.run.smithi148.stdout:5461 punch from 0x4994800 to 0x4997800, (0x3000 bytes) 2024-09-14T09:09:31.655 INFO:teuthology.orchestra.run.smithi148.stdout:5464 write 0x7b07c00 thru 0x7b11995 (0x9d96 bytes) 2024-09-14T09:09:31.655 INFO:teuthology.orchestra.run.smithi148.stdout:5465 trunc from 0xab50c00 to 0xabb5600 2024-09-14T09:09:31.665 INFO:teuthology.orchestra.run.smithi148.stdout:5466 write 0x93dc00 thru 0x943271 (0x5672 bytes) 2024-09-14T09:09:31.672 INFO:teuthology.orchestra.run.smithi148.stdout:5467 write 0x6893e00 thru 0x689fd18 (0xbf19 bytes) 2024-09-14T09:09:31.673 INFO:teuthology.orchestra.run.smithi148.stdout:5468 read 0x9cae400 thru 0x9caeb1b (0x71c bytes) 2024-09-14T09:09:31.673 INFO:teuthology.orchestra.run.smithi148.stdout:5471 read 0x2decc00 thru 0x2df2bad (0x5fae bytes) 2024-09-14T09:09:31.673 INFO:teuthology.orchestra.run.smithi148.stdout:5472 punch from 0x10a7200 to 0x10aa800, (0x3600 bytes) 2024-09-14T09:09:31.675 INFO:teuthology.orchestra.run.smithi148.stdout:5474 trunc from 0xabb5600 to 0xc6d9e00 2024-09-14T09:09:31.687 INFO:teuthology.orchestra.run.smithi148.stdout:5476 punch from 0x8c74000 to 0x8c77800, (0x3800 bytes) 2024-09-14T09:09:31.696 INFO:teuthology.orchestra.run.smithi148.stdout:5477 trunc from 0xc6d9e00 to 0xbc47c00 2024-09-14T09:09:31.709 INFO:teuthology.orchestra.run.smithi148.stdout:5480 read 0x59dd200 thru 0x59e3028 (0x5e29 bytes) 2024-09-14T09:09:31.711 INFO:teuthology.orchestra.run.smithi148.stdout:5483 punch from 0x216200 to 0x225800, (0xf600 bytes) 2024-09-14T09:09:31.712 INFO:teuthology.orchestra.run.smithi148.stdout:5484 read 0x60a7600 thru 0x60a897d (0x137e bytes) 2024-09-14T09:09:31.712 INFO:teuthology.orchestra.run.smithi148.stdout:5486 write 0x6010c00 thru 0x601b3d1 (0xa7d2 bytes) 2024-09-14T09:09:31.712 INFO:teuthology.orchestra.run.smithi148.stdout:5487 punch from 0x7ff7000 to 0x8003200, (0xc200 bytes) 2024-09-14T09:09:31.713 INFO:teuthology.orchestra.run.smithi148.stdout:5488 read 0xe3b400 thru 0xe3bbe2 (0x7e3 bytes) 2024-09-14T09:09:31.713 INFO:teuthology.orchestra.run.smithi148.stdout:5492 read 0x2617a00 thru 0x2619aa3 (0x20a4 bytes) 2024-09-14T09:09:31.713 INFO:teuthology.orchestra.run.smithi148.stdout:5493 write 0x1db200 thru 0x1e4cde (0x9adf bytes) 2024-09-14T09:09:31.713 INFO:teuthology.orchestra.run.smithi148.stdout:5494 punch from 0x25b9a00 to 0x25c5c00, (0xc200 bytes) 2024-09-14T09:09:31.714 INFO:teuthology.orchestra.run.smithi148.stdout:5495 read 0x5d1dc00 thru 0x5d20811 (0x2c12 bytes) 2024-09-14T09:09:31.714 INFO:teuthology.orchestra.run.smithi148.stdout:5496 read 0x3b0fc00 thru 0x3b16600 (0x6a01 bytes) 2024-09-14T09:09:31.714 INFO:teuthology.orchestra.run.smithi148.stdout:5497 read 0x8fe0c00 thru 0x8fef91b (0xed1c bytes) 2024-09-14T09:09:31.715 INFO:teuthology.orchestra.run.smithi148.stdout:5498 read 0x7103a00 thru 0x710afc4 (0x75c5 bytes) 2024-09-14T09:09:31.715 INFO:teuthology.orchestra.run.smithi148.stdout:5499 read 0x11a1600 thru 0x11a73d7 (0x5dd8 bytes) 2024-09-14T09:09:31.715 INFO:teuthology.orchestra.run.smithi148.stdout:5502 read 0x2566600 thru 0x257065d (0xa05e bytes) 2024-09-14T09:09:31.722 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:31.724+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:31.727 INFO:teuthology.orchestra.run.smithi148.stdout:5503 trunc from 0xbc47c00 to 0x15d2e00 2024-09-14T09:09:31.750 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:31.751 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:31.751 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:09:31.751 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:31.760 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:09:31.783 INFO:teuthology.orchestra.run.smithi148.stdout:5505 write 0xe70b800 thru 0xe70f1c4 (0x39c5 bytes) 2024-09-14T09:09:31.783 INFO:teuthology.orchestra.run.smithi148.stdout:5506 write 0x1597000 thru 0x15a0ce4 (0x9ce5 bytes) 2024-09-14T09:09:31.783 INFO:teuthology.orchestra.run.smithi148.stdout:5507 read 0xdecd600 thru 0xded32dc (0x5cdd bytes) 2024-09-14T09:09:31.783 INFO:teuthology.orchestra.run.smithi148.stdout:5509 punch from 0x1590000 to 0x159c400, (0xc400 bytes) 2024-09-14T09:09:31.788 INFO:teuthology.orchestra.run.smithi148.stdout:5510 write 0x288bc00 thru 0x2896218 (0xa619 bytes) 2024-09-14T09:09:31.789 INFO:teuthology.orchestra.run.smithi148.stdout:5511 read 0x798de00 thru 0x7992aa6 (0x4ca7 bytes) 2024-09-14T09:09:31.789 INFO:teuthology.orchestra.run.smithi148.stdout:5512 read 0x380200 thru 0x380a9a (0x89b bytes) 2024-09-14T09:09:31.789 INFO:teuthology.orchestra.run.smithi148.stdout:5514 write 0xb399200 thru 0xb39fb38 (0x6939 bytes) 2024-09-14T09:09:31.806 INFO:teuthology.orchestra.run.smithi148.stdout:5515 write 0xe9c1200 thru 0xe9ce618 (0xd419 bytes) 2024-09-14T09:09:31.807 INFO:teuthology.orchestra.run.smithi148.stdout:5517 punch from 0x4b00a00 to 0x4b0da00, (0xd000 bytes) 2024-09-14T09:09:31.809 INFO:teuthology.orchestra.run.smithi148.stdout:5519 read 0x10f0e00 thru 0x10f7cd2 (0x6ed3 bytes) 2024-09-14T09:09:31.809 INFO:teuthology.orchestra.run.smithi148.stdout:5520 write 0xb3bee00 thru 0xb3c0c81 (0x1e82 bytes) 2024-09-14T09:09:31.809 INFO:teuthology.orchestra.run.smithi148.stdout:5521 trunc from 0xe9ce800 to 0xeb34e00 2024-09-14T09:09:31.830 INFO:teuthology.orchestra.run.smithi148.stdout:5522 read 0xc261400 thru 0xc263b2b (0x272c bytes) 2024-09-14T09:09:31.830 INFO:teuthology.orchestra.run.smithi148.stdout:5523 read 0x287e00 thru 0x295bf8 (0xddf9 bytes) 2024-09-14T09:09:31.831 INFO:teuthology.orchestra.run.smithi148.stdout:5524 read 0x296ae00 thru 0x2973f98 (0x9199 bytes) 2024-09-14T09:09:31.831 INFO:teuthology.orchestra.run.smithi148.stdout:5525 read 0x30ab200 thru 0x30ad2d1 (0x20d2 bytes) 2024-09-14T09:09:31.831 INFO:teuthology.orchestra.run.smithi148.stdout:5526 write 0x9303e00 thru 0x930ef28 (0xb129 bytes) 2024-09-14T09:09:31.837 INFO:teuthology.orchestra.run.smithi148.stdout:5527 trunc from 0xeb34e00 to 0x9a4f400 2024-09-14T09:09:31.845 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:31.847+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:31.856 INFO:teuthology.orchestra.run.smithi148.stdout:5529 write 0x4616800 thru 0x4622524 (0xbd25 bytes) 2024-09-14T09:09:31.857 INFO:teuthology.orchestra.run.smithi148.stdout:5530 read 0x6f17000 thru 0x6f1fbe0 (0x8be1 bytes) 2024-09-14T09:09:31.857 INFO:teuthology.orchestra.run.smithi148.stdout:5531 read 0x1583800 thru 0x1586b88 (0x3389 bytes) 2024-09-14T09:09:31.857 INFO:teuthology.orchestra.run.smithi148.stdout:5532 punch from 0x7fa8800 to 0x7faa200, (0x1a00 bytes) 2024-09-14T09:09:31.861 INFO:teuthology.orchestra.run.smithi148.stdout:5534 read 0x8cbd800 thru 0x8cc992e (0xc12f bytes) 2024-09-14T09:09:31.861 INFO:teuthology.orchestra.run.smithi148.stdout:5537 write 0x26cf200 thru 0x26dd1b7 (0xdfb8 bytes) 2024-09-14T09:09:31.861 INFO:teuthology.orchestra.run.smithi148.stdout:5539 write 0x17d1800 thru 0x17d53d7 (0x3bd8 bytes) 2024-09-14T09:09:31.861 INFO:teuthology.orchestra.run.smithi148.stdout:5542 punch from 0x3efbe00 to 0x3f02e00, (0x7000 bytes) 2024-09-14T09:09:31.862 INFO:teuthology.orchestra.run.smithi148.stdout:5544 read 0x5a87000 thru 0x5a8c4c7 (0x54c8 bytes) 2024-09-14T09:09:31.863 INFO:teuthology.orchestra.run.smithi148.stdout:5548 read 0x479e800 thru 0x47a705a (0x885b bytes) 2024-09-14T09:09:31.863 INFO:teuthology.orchestra.run.smithi148.stdout:5551 read 0x4d26a00 thru 0x4d33d17 (0xd318 bytes) 2024-09-14T09:09:31.863 INFO:teuthology.orchestra.run.smithi148.stdout:5552 read 0x4b84800 thru 0x4b8aba9 (0x63aa bytes) 2024-09-14T09:09:31.863 INFO:teuthology.orchestra.run.smithi148.stdout:5554 read 0x6bde800 thru 0x6be82c3 (0x9ac4 bytes) 2024-09-14T09:09:31.863 INFO:teuthology.orchestra.run.smithi148.stdout:5555 read 0x8a4600 thru 0x8b0a19 (0xc41a bytes) 2024-09-14T09:09:31.863 INFO:teuthology.orchestra.run.smithi148.stdout:5556 read 0x5dc0600 thru 0x5dc2305 (0x1d06 bytes) 2024-09-14T09:09:31.863 INFO:teuthology.orchestra.run.smithi148.stdout:5557 read 0x2a2c400 thru 0x2a3acce (0xe8cf bytes) 2024-09-14T09:09:31.876 INFO:teuthology.orchestra.run.smithi148.stdout:5559 write 0xe4c5200 thru 0xe4d15da (0xc3db bytes) 2024-09-14T09:09:31.880 INFO:teuthology.orchestra.run.smithi148.stdout:5561 trunc from 0xe4d1600 to 0xb542200 2024-09-14T09:09:31.897 INFO:teuthology.orchestra.run.smithi148.stdout:5562 clone 37 order 23 su 131072 sc 5 2024-09-14T09:09:31.923 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:31.923 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:31.923 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:31.923 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:31.923 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:31.924 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:31.926+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:31.932 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:09:31.941 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T09:09:32.024 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:32.026+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:32.072 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone36 from 0xb542200 (overlap 0xe4b600) to 0x893a00 2024-09-14T09:09:32.089 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:249 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1638400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.292706498999998, 2024-09-14T09:09:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99070346899999995, 2024-09-14T09:09:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 249 2024-09-14T09:09:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796868+0000", 2024-09-14T09:09:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2024-09-14T09:09:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796870+0000", 2024-09-14T09:09:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7889999999999999e-06 2024-09-14T09:09:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796877+0000", 2024-09-14T09:09:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8549999999999996e-06 2024-09-14T09:09:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796883+0000", 2024-09-14T09:09:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.665e-06 2024-09-14T09:09:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796915+0000", 2024-09-14T09:09:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2215999999999998e-05 2024-09-14T09:09:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796920+0000", 2024-09-14T09:09:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.527e-06 2024-09-14T09:09:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787468+0000", 2024-09-14T09:09:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99054877100000005 2024-09-14T09:09:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787512+0000", 2024-09-14T09:09:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3958000000000002e-05 2024-09-14T09:09:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787571+0000", 2024-09-14T09:09:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8167000000000001e-05 2024-09-14T09:09:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:250 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2097152~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.292680433000001, 2024-09-14T09:09:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99079431100000004, 2024-09-14T09:09:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 250 2024-09-14T09:09:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796894+0000", 2024-09-14T09:09:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2024-09-14T09:09:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796896+0000", 2024-09-14T09:09:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5600000000000001e-06 2024-09-14T09:09:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796902+0000", 2024-09-14T09:09:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3090000000000001e-06 2024-09-14T09:09:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796909+0000", 2024-09-14T09:09:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:09:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796942+0000", 2024-09-14T09:09:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-05 2024-09-14T09:09:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796948+0000", 2024-09-14T09:09:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5910000000000001e-06 2024-09-14T09:09:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787596+0000", 2024-09-14T09:09:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99064781400000002 2024-09-14T09:09:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787636+0000", 2024-09-14T09:09:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9715000000000002e-05 2024-09-14T09:09:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787687+0000", 2024-09-14T09:09:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1674e-05 2024-09-14T09:09:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:251 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.292654998000003, 2024-09-14T09:09:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99091769600000001, 2024-09-14T09:09:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 251 2024-09-14T09:09:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000005e-07 2024-09-14T09:09:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796922+0000", 2024-09-14T09:09:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.875e-06 2024-09-14T09:09:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796929+0000", 2024-09-14T09:09:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0260000000000002e-06 2024-09-14T09:09:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796935+0000", 2024-09-14T09:09:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7030000000000003e-06 2024-09-14T09:09:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796963+0000", 2024-09-14T09:09:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8368999999999999e-05 2024-09-14T09:09:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796966+0000", 2024-09-14T09:09:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4130000000000002e-06 2024-09-14T09:09:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787718+0000", 2024-09-14T09:09:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99075151100000003 2024-09-14T09:09:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787779+0000", 2024-09-14T09:09:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.088e-05 2024-09-14T09:09:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787836+0000", 2024-09-14T09:09:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7380000000000003e-05 2024-09-14T09:09:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:252 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.292629544, 2024-09-14T09:09:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99102491400000003, 2024-09-14T09:09:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 252 2024-09-14T09:09:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796945+0000", 2024-09-14T09:09:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2900000000000003e-07 2024-09-14T09:09:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796947+0000", 2024-09-14T09:09:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4279999999999999e-06 2024-09-14T09:09:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796954+0000", 2024-09-14T09:09:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5479999999999998e-06 2024-09-14T09:09:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796959+0000", 2024-09-14T09:09:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.22e-06 2024-09-14T09:09:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796988+0000", 2024-09-14T09:09:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9473000000000001e-05 2024-09-14T09:09:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:09:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787850+0000", 2024-09-14T09:09:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99085651100000005 2024-09-14T09:09:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787891+0000", 2024-09-14T09:09:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602000000000002e-05 2024-09-14T09:09:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787969+0000", 2024-09-14T09:09:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8063000000000001e-05 2024-09-14T09:09:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:253 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.292605664, 2024-09-14T09:09:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99122695699999996, 2024-09-14T09:09:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 253 2024-09-14T09:09:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:09:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:09:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:09:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796977+0000", 2024-09-14T09:09:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5030000000000002e-06 2024-09-14T09:09:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796982+0000", 2024-09-14T09:09:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2024-09-14T09:09:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797013+0000", 2024-09-14T09:09:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0451e-05 2024-09-14T09:09:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:09:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1690000000000001e-06 2024-09-14T09:09:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788011+0000", 2024-09-14T09:09:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99099490300000004 2024-09-14T09:09:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788102+0000", 2024-09-14T09:09:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0730999999999996e-05 2024-09-14T09:09:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788195+0000", 2024-09-14T09:09:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3245999999999995e-05 2024-09-14T09:09:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:254 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3932160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.292574106000004, 2024-09-14T09:09:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99137410500000001, 2024-09-14T09:09:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 254 2024-09-14T09:09:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797000+0000", 2024-09-14T09:09:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:09:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797003+0000", 2024-09-14T09:09:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7659999999999999e-06 2024-09-14T09:09:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797010+0000", 2024-09-14T09:09:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.029e-06 2024-09-14T09:09:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2024-09-14T09:09:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797044+0000", 2024-09-14T09:09:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9213e-05 2024-09-14T09:09:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797048+0000", 2024-09-14T09:09:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3400000000000002e-06 2024-09-14T09:09:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788222+0000", 2024-09-14T09:09:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99117407400000002 2024-09-14T09:09:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788306+0000", 2024-09-14T09:09:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4512999999999995e-05 2024-09-14T09:09:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788374+0000", 2024-09-14T09:09:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7226999999999999e-05 2024-09-14T09:09:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:264 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.292547747999997, 2024-09-14T09:09:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99161474699999996, 2024-09-14T09:09:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 264 2024-09-14T09:09:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2024-09-14T09:09:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:09:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2800000000000002e-06 2024-09-14T09:09:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0979999999999999e-06 2024-09-14T09:09:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797040+0000", 2024-09-14T09:09:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:09:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797068+0000", 2024-09-14T09:09:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7302999999999999e-05 2024-09-14T09:09:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797071+0000", 2024-09-14T09:09:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3610000000000001e-06 2024-09-14T09:09:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788436+0000", 2024-09-14T09:09:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99136489500000002 2024-09-14T09:09:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788538+0000", 2024-09-14T09:09:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101931 2024-09-14T09:09:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788641+0000", 2024-09-14T09:09:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010273899999999999 2024-09-14T09:09:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:265 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.292524389, 2024-09-14T09:09:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99176878199999996, 2024-09-14T09:09:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 265 2024-09-14T09:09:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:09:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.39e-07 2024-09-14T09:09:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797052+0000", 2024-09-14T09:09:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.345e-06 2024-09-14T09:09:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797058+0000", 2024-09-14T09:09:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5429999999999999e-06 2024-09-14T09:09:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797064+0000", 2024-09-14T09:09:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2000000000000002e-06 2024-09-14T09:09:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797091+0000", 2024-09-14T09:09:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7804e-05 2024-09-14T09:09:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797095+0000", 2024-09-14T09:09:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2024-09-14T09:09:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788667+0000", 2024-09-14T09:09:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157211300000003 2024-09-14T09:09:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788742+0000", 2024-09-14T09:09:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5159000000000003e-05 2024-09-14T09:09:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788818+0000", 2024-09-14T09:09:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6038000000000006e-05 2024-09-14T09:09:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:266 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.292501557999998, 2024-09-14T09:09:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99193390100000001, 2024-09-14T09:09:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 266 2024-09-14T09:09:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:09:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797075+0000", 2024-09-14T09:09:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2570000000000002e-06 2024-09-14T09:09:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797082+0000", 2024-09-14T09:09:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8029999999999997e-06 2024-09-14T09:09:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797088+0000", 2024-09-14T09:09:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.468e-06 2024-09-14T09:09:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797116+0000", 2024-09-14T09:09:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7752000000000001e-05 2024-09-14T09:09:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797121+0000", 2024-09-14T09:09:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5960000000000003e-06 2024-09-14T09:09:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788846+0000", 2024-09-14T09:09:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99172512199999996 2024-09-14T09:09:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788916+0000", 2024-09-14T09:09:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9843000000000002e-05 2024-09-14T09:09:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789006+0000", 2024-09-14T09:09:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9608e-05 2024-09-14T09:09:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:267 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.292476751000002, 2024-09-14T09:09:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99210926799999999, 2024-09-14T09:09:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 267 2024-09-14T09:09:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2399999999999999e-07 2024-09-14T09:09:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797099+0000", 2024-09-14T09:09:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.091e-06 2024-09-14T09:09:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797105+0000", 2024-09-14T09:09:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-09-14T09:09:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797111+0000", 2024-09-14T09:09:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5130000000000004e-06 2024-09-14T09:09:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797140+0000", 2024-09-14T09:09:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9513999999999999e-05 2024-09-14T09:09:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797145+0000", 2024-09-14T09:09:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:09:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789037+0000", 2024-09-14T09:09:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99189253899999996 2024-09-14T09:09:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789110+0000", 2024-09-14T09:09:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2848000000000005e-05 2024-09-14T09:09:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789206+0000", 2024-09-14T09:09:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5778000000000004e-05 2024-09-14T09:09:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:268 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.292453512000002, 2024-09-14T09:09:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992276359, 2024-09-14T09:09:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 268 2024-09-14T09:09:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:09:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797123+0000", 2024-09-14T09:09:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2740000000000002e-06 2024-09-14T09:09:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797129+0000", 2024-09-14T09:09:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-06 2024-09-14T09:09:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797134+0000", 2024-09-14T09:09:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9099999999999996e-06 2024-09-14T09:09:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797163+0000", 2024-09-14T09:09:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9709999999999998e-05 2024-09-14T09:09:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8709999999999999e-06 2024-09-14T09:09:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789231+0000", 2024-09-14T09:09:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992063959 2024-09-14T09:09:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789306+0000", 2024-09-14T09:09:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5289000000000004e-05 2024-09-14T09:09:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789396+0000", 2024-09-14T09:09:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9939999999999996e-05 2024-09-14T09:09:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:269 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2457600~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.292430003, 2024-09-14T09:09:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99242174400000005, 2024-09-14T09:09:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 269 2024-09-14T09:09:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:09:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797146+0000", 2024-09-14T09:09:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5289999999999998e-06 2024-09-14T09:09:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797153+0000", 2024-09-14T09:09:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1920000000000002e-06 2024-09-14T09:09:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797158+0000", 2024-09-14T09:09:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099999999999998e-06 2024-09-14T09:09:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797188+0000", 2024-09-14T09:09:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0128e-05 2024-09-14T09:09:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797194+0000", 2024-09-14T09:09:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6250000000000004e-06 2024-09-14T09:09:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789439+0000", 2024-09-14T09:09:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99224531000000005 2024-09-14T09:09:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789489+0000", 2024-09-14T09:09:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9830000000000002e-05 2024-09-14T09:09:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789565+0000", 2024-09-14T09:09:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6229000000000005e-05 2024-09-14T09:09:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:270 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.292406180999997, 2024-09-14T09:09:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99257721899999996, 2024-09-14T09:09:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 270 2024-09-14T09:09:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797168+0000", 2024-09-14T09:09:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2024-09-14T09:09:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797170+0000", 2024-09-14T09:09:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3120000000000001e-06 2024-09-14T09:09:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797177+0000", 2024-09-14T09:09:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0960000000000003e-06 2024-09-14T09:09:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797183+0000", 2024-09-14T09:09:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1669999999999998e-06 2024-09-14T09:09:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797213+0000", 2024-09-14T09:09:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0494e-05 2024-09-14T09:09:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:09:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:09:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789586+0000", 2024-09-14T09:09:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99236692100000001 2024-09-14T09:09:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789658+0000", 2024-09-14T09:09:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2279000000000004e-05 2024-09-14T09:09:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789745+0000", 2024-09-14T09:09:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6698000000000002e-05 2024-09-14T09:09:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:271 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3375104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.292380983000001, 2024-09-14T09:09:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99274791699999998, 2024-09-14T09:09:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 271 2024-09-14T09:09:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:09:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797195+0000", 2024-09-14T09:09:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1639999999999999e-06 2024-09-14T09:09:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797201+0000", 2024-09-14T09:09:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1290000000000001e-06 2024-09-14T09:09:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797206+0000", 2024-09-14T09:09:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9300000000000002e-06 2024-09-14T09:09:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797237+0000", 2024-09-14T09:09:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1285000000000003e-05 2024-09-14T09:09:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797242+0000", 2024-09-14T09:09:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6e-06 2024-09-14T09:09:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789768+0000", 2024-09-14T09:09:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99252547400000002 2024-09-14T09:09:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789826+0000", 2024-09-14T09:09:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8155999999999997e-05 2024-09-14T09:09:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789940+0000", 2024-09-14T09:09:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114788 2024-09-14T09:09:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:272 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.292357588999998, 2024-09-14T09:09:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99285248800000003, 2024-09-14T09:09:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 272 2024-09-14T09:09:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:09:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:09:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5129999999999999e-06 2024-09-14T09:09:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797226+0000", 2024-09-14T09:09:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4529999999999996e-06 2024-09-14T09:09:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797232+0000", 2024-09-14T09:09:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1839999999999998e-06 2024-09-14T09:09:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797264+0000", 2024-09-14T09:09:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2691999999999998e-05 2024-09-14T09:09:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797270+0000", 2024-09-14T09:09:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-06 2024-09-14T09:09:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789965+0000", 2024-09-14T09:09:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99269526200000002 2024-09-14T09:09:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790021+0000", 2024-09-14T09:09:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5297000000000003e-05 2024-09-14T09:09:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790068+0000", 2024-09-14T09:09:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7664999999999998e-05 2024-09-14T09:09:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:09:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.302101142, 2024-09-14T09:09:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146649299999999, 2024-09-14T09:09:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 58987 2024-09-14T09:09:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:09:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:09:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787474+0000", 2024-09-14T09:09:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1799999999999999e-06 2024-09-14T09:09:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787483+0000", 2024-09-14T09:09:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9830000000000002e-06 2024-09-14T09:09:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787494+0000", 2024-09-14T09:09:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1496e-05 2024-09-14T09:09:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787502+0000", 2024-09-14T09:09:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8280000000000003e-06 2024-09-14T09:09:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787563+0000", 2024-09-14T09:09:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1583999999999999e-05 2024-09-14T09:09:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:09:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787571+0000", 2024-09-14T09:09:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.058e-06 2024-09-14T09:09:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.791999+0000", 2024-09-14T09:09:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004428675 2024-09-14T09:09:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792008+0000", 2024-09-14T09:09:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9069999999999996e-06 2024-09-14T09:09:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802124+0000", 2024-09-14T09:09:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0101154619999999 2024-09-14T09:09:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802137+0000", 2024-09-14T09:09:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3757000000000001e-05 2024-09-14T09:09:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:67110 3.5 3.6b6808c5 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:09:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.301968327000001, 2024-09-14T09:09:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0147494290000001, 2024-09-14T09:09:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 67110 2024-09-14T09:09:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:09:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:09:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787606+0000", 2024-09-14T09:09:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6300000000000005e-07 2024-09-14T09:09:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787609+0000", 2024-09-14T09:09:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2789999999999999e-06 2024-09-14T09:09:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787616+0000", 2024-09-14T09:09:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8349999999999998e-06 2024-09-14T09:09:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787622+0000", 2024-09-14T09:09:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6999999999999996e-06 2024-09-14T09:09:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787666+0000", 2024-09-14T09:09:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3887000000000002e-05 2024-09-14T09:09:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787672+0000", 2024-09-14T09:09:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-09-14T09:09:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792033+0000", 2024-09-14T09:09:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043614250000000004 2024-09-14T09:09:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792041+0000", 2024-09-14T09:09:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5449999999999998e-06 2024-09-14T09:09:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:09:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0103013569999999 2024-09-14T09:09:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802355+0000", 2024-09-14T09:09:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2717999999999999e-05 2024-09-14T09:09:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72029 3.5 3.3f02ac5 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.301890812, 2024-09-14T09:09:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.014715139, 2024-09-14T09:09:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72029 2024-09-14T09:09:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7599999999999997e-07 2024-09-14T09:09:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787686+0000", 2024-09-14T09:09:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3999999999999999e-06 2024-09-14T09:09:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787692+0000", 2024-09-14T09:09:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3489999999999997e-06 2024-09-14T09:09:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787697+0000", 2024-09-14T09:09:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2320000000000001e-06 2024-09-14T09:09:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787742+0000", 2024-09-14T09:09:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4557e-05 2024-09-14T09:09:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787748+0000", 2024-09-14T09:09:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7810000000000002e-06 2024-09-14T09:09:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792065+0000", 2024-09-14T09:09:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043178679999999999 2024-09-14T09:09:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792073+0000", 2024-09-14T09:09:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6329999999999996e-06 2024-09-14T09:09:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802388+0000", 2024-09-14T09:09:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010315394 2024-09-14T09:09:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802398+0000", 2024-09-14T09:09:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4490000000000005e-06 2024-09-14T09:09:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72038 3.5 3.c914e45 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.301815179, 2024-09-14T09:09:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146757740000001, 2024-09-14T09:09:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72038 2024-09-14T09:09:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787759+0000", 2024-09-14T09:09:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0100000000000005e-07 2024-09-14T09:09:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787761+0000", 2024-09-14T09:09:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4049999999999998e-06 2024-09-14T09:09:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787768+0000", 2024-09-14T09:09:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.314e-06 2024-09-14T09:09:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787773+0000", 2024-09-14T09:09:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2789999999999998e-06 2024-09-14T09:09:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787813+0000", 2024-09-14T09:09:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9582000000000002e-05 2024-09-14T09:09:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787818+0000", 2024-09-14T09:09:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7100000000000004e-06 2024-09-14T09:09:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792096+0000", 2024-09-14T09:09:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042776460000000004 2024-09-14T09:09:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792103+0000", 2024-09-14T09:09:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7129999999999999e-06 2024-09-14T09:09:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802427+0000", 2024-09-14T09:09:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010324805 2024-09-14T09:09:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802434+0000", 2024-09-14T09:09:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:09:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:74840 3.5 3.ab2c8d25 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:09:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.279763294, 2024-09-14T09:09:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99271963600000002, 2024-09-14T09:09:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74840 2024-09-14T09:09:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:09:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:09:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809812+0000", 2024-09-14T09:09:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2899999999999999e-06 2024-09-14T09:09:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809817+0000", 2024-09-14T09:09:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0139999999999998e-06 2024-09-14T09:09:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809834+0000", 2024-09-14T09:09:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7643e-05 2024-09-14T09:09:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809842+0000", 2024-09-14T09:09:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2970000000000004e-06 2024-09-14T09:09:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809902+0000", 2024-09-14T09:09:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9106e-05 2024-09-14T09:09:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809912+0000", 2024-09-14T09:09:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0101e-05 2024-09-14T09:09:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802520+0000", 2024-09-14T09:09:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99260828599999995 2024-09-14T09:09:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802530+0000", 2024-09-14T09:09:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8989999999999996e-06 2024-09-14T09:09:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:32.195 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:32.197 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:09:32.198 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:32.198+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:32.298 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:32.301+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:32.304 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:32.304 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:32.304 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:09:32.304 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:32.312 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:09:32.332 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:09:32.399 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:32.401+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:32.419 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:32.419 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:32.419 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:32.419 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:32.419 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:32.428 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:09:32.456 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:32.456 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:32.474 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:32.475 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:32.491 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:09:32.491 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:09:32.507 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:32.508 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:32.513 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:32.515+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:32.524 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:32.524 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:32.540 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:32.540 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:32.575 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:32.575 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:32.584 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:09:32.626 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:32.628+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:32.662 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #35, image image_client.0-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent36 2024-09-14T09:09:32.702 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:32.704+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:32.730 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:32.730 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:32.735 INFO:teuthology.orchestra.run.smithi148.stdout:5564 trunc from 0xb542200 to 0x74c0a00 2024-09-14T09:09:32.739 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:32.755 INFO:teuthology.orchestra.run.smithi148.stdout:5565 write 0x1822200 thru 0x182d9d4 (0xb7d5 bytes) 2024-09-14T09:09:32.759 INFO:teuthology.orchestra.run.smithi148.stdout:5566 trunc from 0x74c0a00 to 0x4949600 2024-09-14T09:09:32.803 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:32.805+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:32.815 INFO:teuthology.orchestra.run.smithi148.stdout:5569 write 0x80d8c00 thru 0x80dfd6a (0x716b bytes) 2024-09-14T09:09:32.821 INFO:teuthology.orchestra.run.smithi148.stdout:5570 punch from 0x1d9800 to 0x1dd400, (0x3c00 bytes) 2024-09-14T09:09:32.822 INFO:teuthology.orchestra.run.smithi148.stdout:5572 read 0x27f6e00 thru 0x2802714 (0xb915 bytes) 2024-09-14T09:09:32.826 INFO:teuthology.orchestra.run.smithi148.stdout:5574 write 0x339ba00 thru 0x33a1235 (0x5836 bytes) 2024-09-14T09:09:32.826 INFO:teuthology.orchestra.run.smithi148.stdout:5575 write 0x3ba8200 thru 0x3bad735 (0x5536 bytes) 2024-09-14T09:09:32.826 INFO:teuthology.orchestra.run.smithi148.stdout:5576 read 0x293f600 thru 0x29404e4 (0xee5 bytes) 2024-09-14T09:09:32.829 INFO:teuthology.orchestra.run.smithi148.stdout:5578 trunc from 0x80dfe00 to 0x5b70c00 2024-09-14T09:09:32.876 INFO:teuthology.orchestra.run.smithi148.stdout:5579 write 0xc51f600 thru 0xc52376d (0x416e bytes) 2024-09-14T09:09:32.876 INFO:teuthology.orchestra.run.smithi148.stdout:5580 punch from 0x68f7000 to 0x68f9400, (0x2400 bytes) 2024-09-14T09:09:32.881 INFO:teuthology.orchestra.run.smithi148.stdout:5582 trunc from 0xc523800 to 0x8549c00 2024-09-14T09:09:32.894 INFO:teuthology.orchestra.run.smithi148.stdout:5583 punch from 0x4d30200 to 0x4d39e00, (0x9c00 bytes) 2024-09-14T09:09:32.896 INFO:teuthology.orchestra.run.smithi148.stdout:5592 read 0x6166c00 thru 0x616abd6 (0x3fd7 bytes) 2024-09-14T09:09:32.896 INFO:teuthology.orchestra.run.smithi148.stdout:5594 read 0x6f00c00 thru 0x6f0ec70 (0xe071 bytes) 2024-09-14T09:09:32.897 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:32.897 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:32.903 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:32.905+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:32.907 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:09:32.911 INFO:teuthology.orchestra.run.smithi148.stdout:5597 write 0xc144a00 thru 0xc146989 (0x1f8a bytes) 2024-09-14T09:09:32.911 INFO:teuthology.orchestra.run.smithi148.stdout:5598 punch from 0x1510e00 to 0x151d200, (0xc400 bytes) 2024-09-14T09:09:32.912 INFO:teuthology.orchestra.run.smithi148.stdout:5601 read 0xa55ea00 thru 0xa569b51 (0xb152 bytes) 2024-09-14T09:09:32.912 INFO:teuthology.orchestra.run.smithi148.stdout:5603 read 0x2964800 thru 0x296b681 (0x6e82 bytes) 2024-09-14T09:09:32.927 INFO:teuthology.orchestra.run.smithi148.stdout:5605 trunc from 0xc146a00 to 0x6a0e00 2024-09-14T09:09:32.941 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is set 2024-09-14T09:09:32.978 INFO:teuthology.orchestra.run.smithi148.stdout:5606 write 0x3b69a00 thru 0x3b6b812 (0x1e13 bytes) 2024-09-14T09:09:32.990 INFO:teuthology.orchestra.run.smithi148.stdout:5608 trunc from 0x3b6ba00 to 0x9f5b400 2024-09-14T09:09:33.003 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:33.005+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:33.011 INFO:teuthology.orchestra.run.smithi148.stdout:5610 read 0x8542200 thru 0x85489a8 (0x67a9 bytes) 2024-09-14T09:09:33.022 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:33.022 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:33.023 INFO:teuthology.orchestra.run.smithi148.stdout:5611 trunc from 0x9f5b400 to 0x8b000 2024-09-14T09:09:33.031 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:09:33.056 INFO:teuthology.orchestra.run.smithi148.stdout:5614 write 0x6617a00 thru 0x66253db (0xd9dc bytes) 2024-09-14T09:09:33.057 INFO:teuthology.orchestra.run.smithi148.stdout:5615 read 0x3765600 thru 0x3765aca (0x4cb bytes) 2024-09-14T09:09:33.077 INFO:teuthology.orchestra.run.smithi148.stdout:5616 write 0xd733a00 thru 0xd7436a3 (0xfca4 bytes) 2024-09-14T09:09:33.078 INFO:teuthology.orchestra.run.smithi148.stdout:5617 read 0x52d1200 thru 0x52db065 (0x9e66 bytes) 2024-09-14T09:09:33.085 INFO:teuthology.orchestra.run.smithi148.stdout:5619 trunc from 0xd743800 to 0x8351200 2024-09-14T09:09:33.101 INFO:teuthology.orchestra.run.smithi148.stdout:5620 read 0xde6400 thru 0xde9ac9 (0x36ca bytes) 2024-09-14T09:09:33.102 INFO:teuthology.orchestra.run.smithi148.stdout:5622 read 0x410ac00 thru 0x410dba8 (0x2fa9 bytes) 2024-09-14T09:09:33.104 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:33.107+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:33.105 INFO:teuthology.orchestra.run.smithi148.stdout:5623 trunc from 0x8351200 to 0x5a7ca00 2024-09-14T09:09:33.117 INFO:teuthology.orchestra.run.smithi148.stdout:5624 read 0xc2c400 thru 0xc2fe47 (0x3a48 bytes) 2024-09-14T09:09:33.118 INFO:teuthology.orchestra.run.smithi148.stdout:5625 read 0x4021400 thru 0x40245e3 (0x31e4 bytes) 2024-09-14T09:09:33.118 INFO:teuthology.orchestra.run.smithi148.stdout:5626 write 0x23b0c00 thru 0x23c0a61 (0xfe62 bytes) 2024-09-14T09:09:33.118 INFO:teuthology.orchestra.run.smithi148.stdout:5627 punch from 0xd6be00 to 0xd79c00, (0xde00 bytes) 2024-09-14T09:09:33.119 INFO:teuthology.orchestra.run.smithi148.stdout:5628 write 0x4374c00 thru 0x4378e0a (0x420b bytes) 2024-09-14T09:09:33.119 INFO:teuthology.orchestra.run.smithi148.stdout:5630 punch from 0x1335000 to 0x1344c00, (0xfc00 bytes) 2024-09-14T09:09:33.121 INFO:teuthology.orchestra.run.smithi148.stdout:5631 trunc from 0x5a7ca00 to 0x3bc7600 2024-09-14T09:09:33.143 INFO:teuthology.orchestra.run.smithi148.stdout:5632 punch from 0x3433400 to 0x3436200, (0x2e00 bytes) 2024-09-14T09:09:33.143 INFO:teuthology.orchestra.run.smithi148.stdout:5634 read 0xa19000 thru 0xa19289 (0x28a bytes) 2024-09-14T09:09:33.145 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:33.145 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:33.155 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:09:33.170 INFO:teuthology.orchestra.run.smithi148.stdout:5637 write 0xcf56400 thru 0xcf64450 (0xe051 bytes) 2024-09-14T09:09:33.178 INFO:teuthology.orchestra.run.smithi148.stdout:5644 trunc from 0xcf64600 to 0x6d07800 2024-09-14T09:09:33.201 INFO:teuthology.orchestra.run.smithi148.stdout:5646 trunc from 0x6d07800 to 0x6834e00 2024-09-14T09:09:33.205 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:33.207+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:33.238 INFO:teuthology.orchestra.run.smithi148.stdout:5647 write 0xa0b2400 thru 0xa0b33c2 (0xfc3 bytes) 2024-09-14T09:09:33.238 INFO:teuthology.orchestra.run.smithi148.stdout:5648 write 0x6128a00 thru 0x6138292 (0xf893 bytes) 2024-09-14T09:09:33.248 INFO:teuthology.orchestra.run.smithi148.stdout:5650 trunc from 0xa0b3400 to 0x1785400 2024-09-14T09:09:33.267 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:33.267 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:33.269 INFO:teuthology.orchestra.run.smithi148.stdout:5651 flatten 2024-09-14T09:09:33.276 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:09:33.284 INFO:teuthology.orchestra.run.smithi148.stdout:5652 punch from 0xc6d200 to 0xc77c00, (0xaa00 bytes) 2024-09-14T09:09:33.286 INFO:teuthology.orchestra.run.smithi148.stdout:5653 punch from 0x1531c00 to 0x1537c00, (0x6000 bytes) 2024-09-14T09:09:33.286 INFO:teuthology.orchestra.run.smithi148.stdout:5655 read 0x367000 thru 0x3744b6 (0xd4b7 bytes) 2024-09-14T09:09:33.308 INFO:teuthology.orchestra.run.smithi148.stdout:5656 write 0xb11da00 thru 0xb125797 (0x7d98 bytes) 2024-09-14T09:09:33.308 INFO:teuthology.orchestra.run.smithi148.stdout:5657 read 0x57e9e00 thru 0x57f5c78 (0xbe79 bytes) 2024-09-14T09:09:33.319 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:33.321+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:33.323 INFO:teuthology.orchestra.run.smithi148.stdout:5658 write 0xd798c00 thru 0xd799f21 (0x1322 bytes) 2024-09-14T09:09:33.324 INFO:teuthology.orchestra.run.smithi148.stdout:5659 punch from 0xcf8e400 to 0xcf95c00, (0x7800 bytes) 2024-09-14T09:09:33.326 INFO:teuthology.orchestra.run.smithi148.stdout:5660 read 0x5524000 thru 0x552428e (0x28f bytes) 2024-09-14T09:09:33.326 INFO:teuthology.orchestra.run.smithi148.stdout:5661 read 0x993e800 thru 0x994b10c (0xc90d bytes) 2024-09-14T09:09:33.326 INFO:teuthology.orchestra.run.smithi148.stdout:5663 read 0x27dae00 thru 0x27dedff (0x4000 bytes) 2024-09-14T09:09:33.326 INFO:teuthology.orchestra.run.smithi148.stdout:5664 write 0x4984800 thru 0x498e075 (0x9876 bytes) 2024-09-14T09:09:33.330 INFO:teuthology.orchestra.run.smithi148.stdout:5669 trunc from 0xd79a000 to 0xa817400 2024-09-14T09:09:33.348 INFO:teuthology.orchestra.run.smithi148.stdout:5675 write 0x8de6e00 thru 0x8de895b (0x1b5c bytes) 2024-09-14T09:09:33.353 INFO:teuthology.orchestra.run.smithi148.stdout:5676 punch from 0x74d5200 to 0x74dd000, (0x7e00 bytes) 2024-09-14T09:09:33.372 INFO:teuthology.orchestra.run.smithi148.stdout:5677 write 0xc3ac400 thru 0xc3b28ef (0x64f0 bytes) 2024-09-14T09:09:33.372 INFO:teuthology.orchestra.run.smithi148.stdout:5678 read 0xa148200 thru 0xa154570 (0xc371 bytes) 2024-09-14T09:09:33.372 INFO:teuthology.orchestra.run.smithi148.stdout:5679 punch from 0x20a6c00 to 0x20b6600, (0xfa00 bytes) 2024-09-14T09:09:33.372 INFO:teuthology.orchestra.run.smithi148.stdout:5681 read 0x4bbb400 thru 0x4bc0d66 (0x5967 bytes) 2024-09-14T09:09:33.372 INFO:teuthology.orchestra.run.smithi148.stdout:5683 read 0xbe45200 thru 0xbe4de7c (0x8c7d bytes) 2024-09-14T09:09:33.373 INFO:teuthology.orchestra.run.smithi148.stdout:5685 read 0x957ec00 thru 0x9582f8e (0x438f bytes) 2024-09-14T09:09:33.373 INFO:teuthology.orchestra.run.smithi148.stdout:5687 read 0x3b17200 thru 0x3b21900 (0xa701 bytes) 2024-09-14T09:09:33.395 INFO:teuthology.orchestra.run.smithi148.stdout:5689 write 0xc82a000 thru 0xc8330ba (0x90bb bytes) 2024-09-14T09:09:33.395 INFO:teuthology.orchestra.run.smithi148.stdout:5690 read 0xaafce00 thru 0xab01263 (0x4464 bytes) 2024-09-14T09:09:33.395 INFO:teuthology.orchestra.run.smithi148.stdout:5693 read 0x747e200 thru 0x7486196 (0x7f97 bytes) 2024-09-14T09:09:33.395 INFO:teuthology.orchestra.run.smithi148.stdout:5694 write 0xc824e00 thru 0xc82a0e9 (0x52ea bytes) 2024-09-14T09:09:33.395 INFO:teuthology.orchestra.run.smithi148.stdout:5695 punch from 0x9614a00 to 0x961c000, (0x7600 bytes) 2024-09-14T09:09:33.395 INFO:teuthology.orchestra.run.smithi148.stdout:5698 read 0x6078e00 thru 0x6087386 (0xe587 bytes) 2024-09-14T09:09:33.395 INFO:teuthology.orchestra.run.smithi148.stdout:5701 punch from 0x5366c00 to 0x536e400, (0x7800 bytes) 2024-09-14T09:09:33.395 INFO:teuthology.orchestra.run.smithi148.stdout:5702 write 0x1707600 thru 0x1708fbd (0x19be bytes) 2024-09-14T09:09:33.396 INFO:teuthology.orchestra.run.smithi148.stdout:5703 punch from 0x7782600 to 0x778b200, (0x8c00 bytes) 2024-09-14T09:09:33.396 INFO:teuthology.orchestra.run.smithi148.stdout:5705 read 0x1a2d200 thru 0x1a34092 (0x6e93 bytes) 2024-09-14T09:09:33.397 INFO:teuthology.orchestra.run.smithi148.stdout:5707 write 0x1398200 thru 0x13a01f5 (0x7ff6 bytes) 2024-09-14T09:09:33.397 INFO:teuthology.orchestra.run.smithi148.stdout:5711 write 0x970a800 thru 0x970b4db (0xcdc bytes) 2024-09-14T09:09:33.398 INFO:teuthology.orchestra.run.smithi148.stdout:5712 punch from 0xbe32800 to 0xbe3d000, (0xa800 bytes) 2024-09-14T09:09:33.398 INFO:teuthology.orchestra.run.smithi148.stdout:5713 punch from 0x3145400 to 0x314d400, (0x8000 bytes) 2024-09-14T09:09:33.398 INFO:teuthology.orchestra.run.smithi148.stdout:5714 write 0x6d4bc00 thru 0x6d4f159 (0x355a bytes) 2024-09-14T09:09:33.398 INFO:teuthology.orchestra.run.smithi148.stdout:5716 read 0x5cc400 thru 0x5cdfe2 (0x1be3 bytes) 2024-09-14T09:09:33.401 INFO:teuthology.orchestra.run.smithi148.stdout:5717 trunc from 0xc833200 to 0xb52a200 2024-09-14T09:09:33.407 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:33.409+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:33.421 INFO:teuthology.orchestra.run.smithi148.stdout:5718 read 0x1ddae00 thru 0x1de9f38 (0xf139 bytes) 2024-09-14T09:09:33.422 INFO:teuthology.orchestra.run.smithi148.stdout:5719 read 0x2944e00 thru 0x2950d74 (0xbf75 bytes) 2024-09-14T09:09:33.422 INFO:teuthology.orchestra.run.smithi148.stdout:5720 read 0x99bbc00 thru 0x99c4f63 (0x9364 bytes) 2024-09-14T09:09:33.423 INFO:teuthology.orchestra.run.smithi148.stdout:5721 punch from 0x6f01200 to 0x6f09000, (0x7e00 bytes) 2024-09-14T09:09:33.423 INFO:teuthology.orchestra.run.smithi148.stdout:5722 read 0x32bce00 thru 0x32bfba4 (0x2da5 bytes) 2024-09-14T09:09:33.423 INFO:teuthology.orchestra.run.smithi148.stdout:5723 read 0x8472e00 thru 0x8477b7d (0x4d7e bytes) 2024-09-14T09:09:33.423 INFO:teuthology.orchestra.run.smithi148.stdout:5726 write 0x53b5a00 thru 0x53c0cb7 (0xb2b8 bytes) 2024-09-14T09:09:33.423 INFO:teuthology.orchestra.run.smithi148.stdout:5729 write 0xc36800 thru 0xc3f998 (0x9199 bytes) 2024-09-14T09:09:33.423 INFO:teuthology.orchestra.run.smithi148.stdout:5731 punch from 0xa586000 to 0xa58c800, (0x6800 bytes) 2024-09-14T09:09:33.424 INFO:teuthology.orchestra.run.smithi148.stdout:5732 trunc from 0xb52a200 to 0xc11c200 2024-09-14T09:09:33.433 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:33.433 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:33.441 INFO:teuthology.orchestra.run.smithi148.stdout:5736 clone 38 order 19 su 16384 sc 9 2024-09-14T09:09:33.442 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:09:33.508 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:33.510+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:33.585 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:33.586 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:33.594 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:09:33.638 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:33.640+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:33.695 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:33.696 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:33.704 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:09:33.745 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:33.747+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:33.811 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:33.813+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:33.847 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:33.847 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:33.856 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:09:33.912 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:33.914+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:33.961 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:33.961 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:33.970 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:09:34.013 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:34.015+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:34.113 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:34.115+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:34.114 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:34.114 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:34.123 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:09:34.215 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:34.217+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:34.269 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:34.270 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:34.279 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:09:34.323 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:34.325+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:34.386 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:34.386 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:34.395 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:09:34.436 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:34.438+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:34.474 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #36, image image_client.0-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent37 2024-09-14T09:09:34.517 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:34.519+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:34.545 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:34.545 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:34.551 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:09:34.554 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:09:34.577 INFO:teuthology.orchestra.run.smithi148.stdout:5737 trunc from 0xc11c200 to 0x283600 2024-09-14T09:09:34.618 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:34.620+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:34.632 INFO:teuthology.orchestra.run.smithi148.stdout:5738 write 0x5442c00 thru 0x5445fa9 (0x33aa bytes) 2024-09-14T09:09:34.633 INFO:teuthology.orchestra.run.smithi148.stdout:5740 write 0x4668800 thru 0x46731ff (0xaa00 bytes) 2024-09-14T09:09:34.633 INFO:teuthology.orchestra.run.smithi148.stdout:5741 write 0x3db3400 thru 0x3db988c (0x648d bytes) 2024-09-14T09:09:34.634 INFO:teuthology.orchestra.run.smithi148.stdout:5742 trunc from 0x5446000 to 0x410f600 2024-09-14T09:09:34.660 INFO:teuthology.orchestra.run.smithi148.stdout:5745 trunc from 0x410f600 to 0x3d7a800 2024-09-14T09:09:34.675 INFO:teuthology.orchestra.run.smithi148.stdout:5748 read 0x2e39400 thru 0x2e48e1e (0xfa1f bytes) 2024-09-14T09:09:34.676 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:34.676 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:34.683 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:34.683 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:34.685 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:09:34.697 INFO:teuthology.orchestra.run.smithi148.stdout:5749 write 0xdb83600 thru 0xdb8a119 (0x6b1a bytes) 2024-09-14T09:09:34.698 INFO:teuthology.orchestra.run.smithi148.stdout:5750 punch from 0x99f6a00 to 0x99f7200, (0x800 bytes) 2024-09-14T09:09:34.699 INFO:teuthology.orchestra.run.smithi148.stdout:5751 clone 39 order 25 su 131072 sc 3 2024-09-14T09:09:34.702 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:34.702 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:34.719 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:34.721+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:34.721 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:09:34.721 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:09:34.737 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:34.737 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:34.753 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:34.754 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:34.769 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:34.770 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:34.793 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:34.793 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:34.793 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:09:34.793 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:34.802 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:09:34.821 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:34.823+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:34.905 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:34.905 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:34.905 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:34.905 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:34.905 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:34.913 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:09:34.955 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T09:09:34.958 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:34.960+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:35.010 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone38 from 0xdb8a200 (overlap 0x283600) to 0x40400 2024-09-14T09:09:35.021 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:35.023+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:35.028 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:35.028 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:35.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:35.028 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:35.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.028 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5349 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8302592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:35.028 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:35.028 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 57.773613298999997, 2024-09-14T09:09:35.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039875928999999997, 2024-09-14T09:09:35.029 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.029 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.029 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.029 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.029 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:35.029 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:35.029 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5349 2024-09-14T09:09:35.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.029 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:35.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:35.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255874+0000", 2024-09-14T09:09:35.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4900000000000001e-07 2024-09-14T09:09:35.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255880+0000", 2024-09-14T09:09:35.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9939999999999997e-06 2024-09-14T09:09:35.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255886+0000", 2024-09-14T09:09:35.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3899999999999998e-06 2024-09-14T09:09:35.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255891+0000", 2024-09-14T09:09:35.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.938e-06 2024-09-14T09:09:35.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295580+0000", 2024-09-14T09:09:35.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039688681000000003 2024-09-14T09:09:35.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295653+0000", 2024-09-14T09:09:35.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3045000000000003e-05 2024-09-14T09:09:35.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295749+0000", 2024-09-14T09:09:35.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6532000000000003e-05 2024-09-14T09:09:35.032 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.032 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.032 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.032 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5350 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8364032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:35.032 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:35.033 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 57.773589491999999, 2024-09-14T09:09:35.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039989719, 2024-09-14T09:09:35.033 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.033 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.033 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.033 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.033 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:35.033 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:35.033 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5350 2024-09-14T09:09:35.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.033 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:35.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:35.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255898+0000", 2024-09-14T09:09:35.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2024-09-14T09:09:35.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255899+0000", 2024-09-14T09:09:35.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9139999999999998e-06 2024-09-14T09:09:35.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255905+0000", 2024-09-14T09:09:35.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7289999999999997e-06 2024-09-14T09:09:35.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255910+0000", 2024-09-14T09:09:35.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6210000000000003e-06 2024-09-14T09:09:35.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295775+0000", 2024-09-14T09:09:35.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039864973999999997 2024-09-14T09:09:35.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295828+0000", 2024-09-14T09:09:35.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3411000000000001e-05 2024-09-14T09:09:35.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295887+0000", 2024-09-14T09:09:35.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699000000000002e-05 2024-09-14T09:09:35.037 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.037 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.037 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.037 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4639 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1843200~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:35.037 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:35.037 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.829674033000003, 2024-09-14T09:09:35.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040843672999999997, 2024-09-14T09:09:35.037 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.037 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.037 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.037 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.037 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:35.037 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:35.038 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4639 2024-09-14T09:09:35.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.038 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:35.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:35.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:09:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199818+0000", 2024-09-14T09:09:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1450000000000001e-06 2024-09-14T09:09:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199827+0000", 2024-09-14T09:09:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3999999999999998e-06 2024-09-14T09:09:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199834+0000", 2024-09-14T09:09:35.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0809999999999996e-06 2024-09-14T09:09:35.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240541+0000", 2024-09-14T09:09:35.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040706941000000003 2024-09-14T09:09:35.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240584+0000", 2024-09-14T09:09:35.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3040999999999997e-05 2024-09-14T09:09:35.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240656+0000", 2024-09-14T09:09:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2200000000000007e-05 2024-09-14T09:09:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4640 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1871872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.829639548000003, 2024-09-14T09:09:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040967601999999999, 2024-09-14T09:09:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.042 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:35.042 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:35.042 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4640 2024-09-14T09:09:35.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.042 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:35.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:35.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199848+0000", 2024-09-14T09:09:35.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5400000000000002e-07 2024-09-14T09:09:35.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199850+0000", 2024-09-14T09:09:35.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2479999999999999e-06 2024-09-14T09:09:35.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199857+0000", 2024-09-14T09:09:35.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.187e-06 2024-09-14T09:09:35.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199862+0000", 2024-09-14T09:09:35.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5119999999999999e-06 2024-09-14T09:09:35.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240684+0000", 2024-09-14T09:09:35.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040821245999999999 2024-09-14T09:09:35.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240739+0000", 2024-09-14T09:09:35.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4991999999999998e-05 2024-09-14T09:09:35.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240815+0000", 2024-09-14T09:09:35.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5963000000000004e-05 2024-09-14T09:09:35.045 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.045 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.045 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.045 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4641 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1900544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:35.045 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:35.045 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.829617218000003, 2024-09-14T09:09:35.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041205512, 2024-09-14T09:09:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4641 2024-09-14T09:09:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:35.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199870+0000", 2024-09-14T09:09:35.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0600000000000001e-07 2024-09-14T09:09:35.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199872+0000", 2024-09-14T09:09:35.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.928e-06 2024-09-14T09:09:35.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199877+0000", 2024-09-14T09:09:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6949999999999997e-06 2024-09-14T09:09:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199882+0000", 2024-09-14T09:09:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8210000000000001e-06 2024-09-14T09:09:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240847+0000", 2024-09-14T09:09:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040965201999999999 2024-09-14T09:09:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240888+0000", 2024-09-14T09:09:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0754000000000003e-05 2024-09-14T09:09:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241075+0000", 2024-09-14T09:09:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000186706 2024-09-14T09:09:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4642 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1929216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:35.050 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.829598283000003, 2024-09-14T09:09:35.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041292575999999998, 2024-09-14T09:09:35.050 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.050 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.050 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.050 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.050 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:35.050 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:35.050 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4642 2024-09-14T09:09:35.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.050 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:35.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199889+0000", 2024-09-14T09:09:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2024-09-14T09:09:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199891+0000", 2024-09-14T09:09:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9e-06 2024-09-14T09:09:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199896+0000", 2024-09-14T09:09:35.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6960000000000002e-06 2024-09-14T09:09:35.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199901+0000", 2024-09-14T09:09:35.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6720000000000003e-06 2024-09-14T09:09:35.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241089+0000", 2024-09-14T09:09:35.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041187594000000001 2024-09-14T09:09:35.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241126+0000", 2024-09-14T09:09:35.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7490999999999997e-05 2024-09-14T09:09:35.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241181+0000", 2024-09-14T09:09:35.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4823e-05 2024-09-14T09:09:35.053 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.053 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.053 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4643 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1957888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.829579004000003, 2024-09-14T09:09:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041418333000000002, 2024-09-14T09:09:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4643 2024-09-14T09:09:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:35.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:35.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:35.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5699999999999998e-07 2024-09-14T09:09:35.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199910+0000", 2024-09-14T09:09:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.829e-06 2024-09-14T09:09:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199916+0000", 2024-09-14T09:09:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8499999999999999e-06 2024-09-14T09:09:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199920+0000", 2024-09-14T09:09:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6530000000000002e-06 2024-09-14T09:09:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241211+0000", 2024-09-14T09:09:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041290327000000002 2024-09-14T09:09:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241257+0000", 2024-09-14T09:09:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6347000000000002e-05 2024-09-14T09:09:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241326+0000", 2024-09-14T09:09:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8969999999999999e-05 2024-09-14T09:09:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4644 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1986560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.829560663999999, 2024-09-14T09:09:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041596269999999998, 2024-09-14T09:09:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4644 2024-09-14T09:09:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:35.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:35.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:35.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.41e-07 2024-09-14T09:09:35.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199928+0000", 2024-09-14T09:09:35.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8250000000000001e-06 2024-09-14T09:09:35.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199934+0000", 2024-09-14T09:09:35.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2280000000000003e-06 2024-09-14T09:09:35.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199939+0000", 2024-09-14T09:09:35.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8010000000000003e-06 2024-09-14T09:09:35.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241360+0000", 2024-09-14T09:09:35.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041421289 2024-09-14T09:09:35.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241435+0000", 2024-09-14T09:09:35.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4238000000000003e-05 2024-09-14T09:09:35.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241522+0000", 2024-09-14T09:09:35.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7547999999999996e-05 2024-09-14T09:09:35.062 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.062 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.062 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.062 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4645 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:35.064 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:35.064 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.829541757000001, 2024-09-14T09:09:35.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041714660000000001, 2024-09-14T09:09:35.064 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.064 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.064 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.064 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.064 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:35.064 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:35.064 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4645 2024-09-14T09:09:35.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.065 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:35.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:35.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:35.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4700000000000002e-07 2024-09-14T09:09:35.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199947+0000", 2024-09-14T09:09:35.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.801e-06 2024-09-14T09:09:35.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199953+0000", 2024-09-14T09:09:35.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.694e-06 2024-09-14T09:09:35.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199957+0000", 2024-09-14T09:09:35.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3069999999999996e-06 2024-09-14T09:09:35.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241547+0000", 2024-09-14T09:09:35.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041589895000000002 2024-09-14T09:09:35.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241590+0000", 2024-09-14T09:09:35.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2985000000000003e-05 2024-09-14T09:09:35.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241660+0000", 2024-09-14T09:09:35.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9630999999999998e-05 2024-09-14T09:09:35.067 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.068 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.068 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.068 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4646 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2043904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:35.068 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:35.068 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.829523768999998, 2024-09-14T09:09:35.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041827171000000003, 2024-09-14T09:09:35.068 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.068 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.068 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:35.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:35.068 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4646 2024-09-14T09:09:35.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.069 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:35.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:35.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:35.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6300000000000001e-07 2024-09-14T09:09:35.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199965+0000", 2024-09-14T09:09:35.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.035e-06 2024-09-14T09:09:35.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199973+0000", 2024-09-14T09:09:35.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9629999999999998e-06 2024-09-14T09:09:35.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199978+0000", 2024-09-14T09:09:35.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9069999999999998e-06 2024-09-14T09:09:35.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241677+0000", 2024-09-14T09:09:35.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041698662999999997 2024-09-14T09:09:35.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241717+0000", 2024-09-14T09:09:35.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602999999999997e-05 2024-09-14T09:09:35.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241790+0000", 2024-09-14T09:09:35.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2637000000000003e-05 2024-09-14T09:09:35.071 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.072 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.072 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.072 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4647 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2072576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:35.072 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:35.072 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.829495178999998, 2024-09-14T09:09:35.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041921189999999997, 2024-09-14T09:09:35.072 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.072 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.072 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.072 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.072 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:35.072 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:35.072 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4647 2024-09-14T09:09:35.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.073 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:35.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:35.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199992+0000", 2024-09-14T09:09:35.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3799999999999997e-07 2024-09-14T09:09:35.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199994+0000", 2024-09-14T09:09:35.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3020000000000002e-06 2024-09-14T09:09:35.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200004+0000", 2024-09-14T09:09:35.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3510000000000008e-06 2024-09-14T09:09:35.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200008+0000", 2024-09-14T09:09:35.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3329999999999998e-06 2024-09-14T09:09:35.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241814+0000", 2024-09-14T09:09:35.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041806280000000001 2024-09-14T09:09:35.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241855+0000", 2024-09-14T09:09:35.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0173999999999999e-05 2024-09-14T09:09:35.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241913+0000", 2024-09-14T09:09:35.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8112000000000002e-05 2024-09-14T09:09:35.075 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.075 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.076 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.076 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:59017 3.3 3:c1df81d6:::rbd_data.1112a10502fe.0000000000000189:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:35.076 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:09:35.076 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.242204577999999, 2024-09-14T09:09:35.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.024252111, 2024-09-14T09:09:35.076 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.076 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.076 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.076 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.076 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:35.076 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:35.076 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59017 2024-09-14T09:09:35.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.077 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:09:35.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:09:35.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787284+0000", 2024-09-14T09:09:35.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3879999999999998e-06 2024-09-14T09:09:35.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787297+0000", 2024-09-14T09:09:35.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2184999999999999e-05 2024-09-14T09:09:35.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787317+0000", 2024-09-14T09:09:35.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0054000000000001e-05 2024-09-14T09:09:35.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787327+0000", 2024-09-14T09:09:35.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0335e-05 2024-09-14T09:09:35.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787412+0000", 2024-09-14T09:09:35.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4691000000000006e-05 2024-09-14T09:09:35.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:09:35.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787422+0000", 2024-09-14T09:09:35.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0718e-05 2024-09-14T09:09:35.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790539+0000", 2024-09-14T09:09:35.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031164600000000002 2024-09-14T09:09:35.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790552+0000", 2024-09-14T09:09:35.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2736e-05 2024-09-14T09:09:35.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.798725+0000", 2024-09-14T09:09:35.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0081731860000001 2024-09-14T09:09:35.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.798824+0000", 2024-09-14T09:09:35.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9600999999999997e-05 2024-09-14T09:09:35.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.811534+0000", 2024-09-14T09:09:35.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012709757 2024-09-14T09:09:35.081 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.081 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.081 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.081 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:63586 3.3 3:c0d9272b:::rbd_data.1112a10502fe.00000000000001a2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:35.081 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:35.082 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.242133095, 2024-09-14T09:09:35.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0244069650000001, 2024-09-14T09:09:35.082 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.082 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.082 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.082 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.082 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:35.082 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:35.082 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 63586 2024-09-14T09:09:35.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.082 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:35.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:35.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:35.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2024-09-14T09:09:35.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787357+0000", 2024-09-14T09:09:35.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8720000000000002e-06 2024-09-14T09:09:35.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787365+0000", 2024-09-14T09:09:35.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9270000000000005e-06 2024-09-14T09:09:35.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787372+0000", 2024-09-14T09:09:35.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6810000000000001e-06 2024-09-14T09:09:35.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787479+0000", 2024-09-14T09:09:35.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010736800000000001 2024-09-14T09:09:35.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:35.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787485+0000", 2024-09-14T09:09:35.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.054e-06 2024-09-14T09:09:35.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790580+0000", 2024-09-14T09:09:35.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030949929999999999 2024-09-14T09:09:35.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790589+0000", 2024-09-14T09:09:35.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7600000000000008e-06 2024-09-14T09:09:35.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.799541+0000", 2024-09-14T09:09:35.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0089520110000001 2024-09-14T09:09:35.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.799620+0000", 2024-09-14T09:09:35.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8969999999999998e-05 2024-09-14T09:09:35.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.811760+0000", 2024-09-14T09:09:35.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012140748999999999 2024-09-14T09:09:35.087 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.087 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.087 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.087 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:65817 3.3 3:c2c49fe0:::rbd_data.1112a10502fe.00000000000001b3:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:35.087 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:09:35.087 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.242043292999998, 2024-09-14T09:09:35.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0253660200000001, 2024-09-14T09:09:35.087 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.087 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.087 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:35.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:35.088 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 65817 2024-09-14T09:09:35.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.088 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:09:35.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:09:35.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787444+0000", 2024-09-14T09:09:35.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999995e-07 2024-09-14T09:09:35.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787448+0000", 2024-09-14T09:09:35.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1420000000000003e-06 2024-09-14T09:09:35.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787497+0000", 2024-09-14T09:09:35.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8507999999999997e-05 2024-09-14T09:09:35.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787503+0000", 2024-09-14T09:09:35.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1319999999999999e-06 2024-09-14T09:09:35.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787595+0000", 2024-09-14T09:09:35.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1748000000000003e-05 2024-09-14T09:09:35.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:35.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787601+0000", 2024-09-14T09:09:35.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6150000000000002e-06 2024-09-14T09:09:35.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790613+0000", 2024-09-14T09:09:35.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003012228 2024-09-14T09:09:35.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790621+0000", 2024-09-14T09:09:35.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9219999999999997e-06 2024-09-14T09:09:35.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800130+0000", 2024-09-14T09:09:35.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.009508474 2024-09-14T09:09:35.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800257+0000", 2024-09-14T09:09:35.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012746900000000001 2024-09-14T09:09:35.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.812809+0000", 2024-09-14T09:09:35.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012552054 2024-09-14T09:09:35.093 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.093 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.093 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.093 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:68709 3.3 3:c4996abd:::rbd_data.1112a10502fe.00000000000001cd:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:35.093 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:09:35.093 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.241872347000001, 2024-09-14T09:09:35.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0254506109999999, 2024-09-14T09:09:35.093 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.093 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.093 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.093 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.093 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:35.093 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:35.094 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 68709 2024-09-14T09:09:35.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.094 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:09:35.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:09:35.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787615+0000", 2024-09-14T09:09:35.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4000000000000001e-07 2024-09-14T09:09:35.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787618+0000", 2024-09-14T09:09:35.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2780000000000002e-06 2024-09-14T09:09:35.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787626+0000", 2024-09-14T09:09:35.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0250000000000002e-06 2024-09-14T09:09:35.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787633+0000", 2024-09-14T09:09:35.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5660000000000003e-06 2024-09-14T09:09:35.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787714+0000", 2024-09-14T09:09:35.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1695999999999998e-05 2024-09-14T09:09:35.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:35.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787721+0000", 2024-09-14T09:09:35.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1109999999999996e-06 2024-09-14T09:09:35.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790646+0000", 2024-09-14T09:09:35.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029251730000000001 2024-09-14T09:09:35.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790653+0000", 2024-09-14T09:09:35.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4379999999999998e-06 2024-09-14T09:09:35.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800750+0000", 2024-09-14T09:09:35.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010097236 2024-09-14T09:09:35.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800883+0000", 2024-09-14T09:09:35.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000132466 2024-09-14T09:09:35.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813065+0000", 2024-09-14T09:09:35.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012181981999999999 2024-09-14T09:09:35.098 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.098 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.098 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.099 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:74823 3.3 3:c59acf89:::rbd_data.1112a10502fe.00000000000001fb:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:35.099 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:09:35.099 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.221037875, 2024-09-14T09:09:35.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.004859323, 2024-09-14T09:09:35.099 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.099 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.099 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.099 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.099 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:35.099 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:35.099 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74823 2024-09-14T09:09:35.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.100 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:09:35.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:09:35.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808450+0000", 2024-09-14T09:09:35.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.92e-07 2024-09-14T09:09:35.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808454+0000", 2024-09-14T09:09:35.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3660000000000002e-06 2024-09-14T09:09:35.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808463+0000", 2024-09-14T09:09:35.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1579999999999994e-06 2024-09-14T09:09:35.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808470+0000", 2024-09-14T09:09:35.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7599999999999997e-06 2024-09-14T09:09:35.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808540+0000", 2024-09-14T09:09:35.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9991000000000001e-05 2024-09-14T09:09:35.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808550+0000", 2024-09-14T09:09:35.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0282000000000001e-05 2024-09-14T09:09:35.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801352+0000", 2024-09-14T09:09:35.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99280192700000003 2024-09-14T09:09:35.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801472+0000", 2024-09-14T09:09:35.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120184 2024-09-14T09:09:35.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813308+0000", 2024-09-14T09:09:35.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011835863 2024-09-14T09:09:35.103 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.103 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.104 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.104 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:86789 3.3 3:c3063f19:::rbd_data.1112a10502fe.000000000000023a:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:35.104 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:09:35.104 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.448815150000001, 2024-09-14T09:09:35.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.23302192099999999, 2024-09-14T09:09:35.104 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.104 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.104 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.104 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.104 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:35.104 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:35.104 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86789 2024-09-14T09:09:35.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.104 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:09:35.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:09:35.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580672+0000", 2024-09-14T09:09:35.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7999999999999993e-07 2024-09-14T09:09:35.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580680+0000", 2024-09-14T09:09:35.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7540000000000006e-06 2024-09-14T09:09:35.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580694+0000", 2024-09-14T09:09:35.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3344e-05 2024-09-14T09:09:35.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580702+0000", 2024-09-14T09:09:35.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9510000000000006e-06 2024-09-14T09:09:35.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580778+0000", 2024-09-14T09:09:35.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6580000000000002e-05 2024-09-14T09:09:35.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580788+0000", 2024-09-14T09:09:35.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0327e-05 2024-09-14T09:09:35.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801980+0000", 2024-09-14T09:09:35.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.22119123900000001 2024-09-14T09:09:35.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802115+0000", 2024-09-14T09:09:35.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013572000000000001 2024-09-14T09:09:35.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813693+0000", 2024-09-14T09:09:35.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011578026 2024-09-14T09:09:35.108 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.108 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.108 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.109 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:89485 3.3 3:c3eae671:::rbd_data.1112a10502fe.0000000000000248:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:35.109 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:09:35.109 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.343958656000002, 2024-09-14T09:09:35.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.12841583300000001, 2024-09-14T09:09:35.109 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.109 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.109 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.109 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.109 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:35.109 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:35.109 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 89485 2024-09-14T09:09:35.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.109 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:09:35.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:09:35.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685529+0000", 2024-09-14T09:09:35.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.11e-06 2024-09-14T09:09:35.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685534+0000", 2024-09-14T09:09:35.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0289999999999996e-06 2024-09-14T09:09:35.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685546+0000", 2024-09-14T09:09:35.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2062000000000001e-05 2024-09-14T09:09:35.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685554+0000", 2024-09-14T09:09:35.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7889999999999995e-06 2024-09-14T09:09:35.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685618+0000", 2024-09-14T09:09:35.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4487999999999996e-05 2024-09-14T09:09:35.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685628+0000", 2024-09-14T09:09:35.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5840000000000001e-06 2024-09-14T09:09:35.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802613+0000", 2024-09-14T09:09:35.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.116984703 2024-09-14T09:09:35.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802768+0000", 2024-09-14T09:09:35.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015541599999999999 2024-09-14T09:09:35.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813944+0000", 2024-09-14T09:09:35.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011175651999999999 2024-09-14T09:09:35.113 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.113 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.113 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.114 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:90751 3.3 3:c22bfcfe:::rbd_data.1112a10502fe.000000000000024e:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:35.114 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:09:35.114 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.292887872000001, 2024-09-14T09:09:35.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077582650000000003, 2024-09-14T09:09:35.114 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.114 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.114 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.114 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.114 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:35.114 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:35.114 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 90751 2024-09-14T09:09:35.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.115 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:09:35.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:09:35.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736600+0000", 2024-09-14T09:09:35.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.71e-07 2024-09-14T09:09:35.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736608+0000", 2024-09-14T09:09:35.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2679999999999994e-06 2024-09-14T09:09:35.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736620+0000", 2024-09-14T09:09:35.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2064e-05 2024-09-14T09:09:35.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736627+0000", 2024-09-14T09:09:35.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8129999999999998e-06 2024-09-14T09:09:35.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736676+0000", 2024-09-14T09:09:35.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.901e-05 2024-09-14T09:09:35.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736685+0000", 2024-09-14T09:09:35.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:09:35.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803227+0000", 2024-09-14T09:09:35.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066541874000000001 2024-09-14T09:09:35.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803381+0000", 2024-09-14T09:09:35.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015482500000000001 2024-09-14T09:09:35.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.814181+0000", 2024-09-14T09:09:35.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010799944000000001 2024-09-14T09:09:35.118 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.118 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.118 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.119 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:90760 3.3 3:c116ad26:::rbd_data.1112a10502fe.0000000000000251:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:35.119 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:09:35.119 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.292785554999998, 2024-09-14T09:09:35.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077694599000000003, 2024-09-14T09:09:35.119 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.119 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.119 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.119 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.119 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:35.119 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:35.119 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 90760 2024-09-14T09:09:35.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.120 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:09:35.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:09:35.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736702+0000", 2024-09-14T09:09:35.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0999999999999998e-07 2024-09-14T09:09:35.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736705+0000", 2024-09-14T09:09:35.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0120000000000001e-06 2024-09-14T09:09:35.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736711+0000", 2024-09-14T09:09:35.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6279999999999999e-06 2024-09-14T09:09:35.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736717+0000", 2024-09-14T09:09:35.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6200000000000004e-06 2024-09-14T09:09:35.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736765+0000", 2024-09-14T09:09:35.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7688000000000001e-05 2024-09-14T09:09:35.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736772+0000", 2024-09-14T09:09:35.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6529999999999994e-06 2024-09-14T09:09:35.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803886+0000", 2024-09-14T09:09:35.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067113795000000004 2024-09-14T09:09:35.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.804024+0000", 2024-09-14T09:09:35.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013782000000000001 2024-09-14T09:09:35.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.814396+0000", 2024-09-14T09:09:35.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010371773000000001 2024-09-14T09:09:35.123 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.123 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.124 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.124 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.124 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.124 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:35.125 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:09:35.126 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:35.127+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:35.226 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:35.228+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:35.267 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #37, image image_client.0-clone37 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent38 2024-09-14T09:09:35.272 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:35.272 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:35.273 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:09:35.273 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:35.282 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:35.327 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:35.329+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:35.428 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:35.430+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:35.443 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:35.443 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:35.443 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:35.443 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:35.444 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:35.453 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:09:35.529 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:35.531+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:35.562 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:35.563 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:35.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:35.563 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:35.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.563 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:228 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 360448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:35.563 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:35.563 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.767087822999997, 2024-09-14T09:09:35.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99234476999999999, 2024-09-14T09:09:35.563 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.563 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.563 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 228 2024-09-14T09:09:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:35.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796906+0000", 2024-09-14T09:09:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9399999999999995e-07 2024-09-14T09:09:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796917+0000", 2024-09-14T09:09:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0801e-05 2024-09-14T09:09:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796924+0000", 2024-09-14T09:09:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7750000000000004e-06 2024-09-14T09:09:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9972000000000001e-05 2024-09-14T09:09:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798671+0000", 2024-09-14T09:09:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017271330000000001 2024-09-14T09:09:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798675+0000", 2024-09-14T09:09:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.194e-06 2024-09-14T09:09:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789003+0000", 2024-09-14T09:09:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99032768400000004 2024-09-14T09:09:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789115+0000", 2024-09-14T09:09:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112236 2024-09-14T09:09:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789250+0000", 2024-09-14T09:09:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013548100000000001 2024-09-14T09:09:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:229 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 819200~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.7670356, 2024-09-14T09:09:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99287024599999996, 2024-09-14T09:09:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.568 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 229 2024-09-14T09:09:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999999e-07 2024-09-14T09:09:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796962+0000", 2024-09-14T09:09:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1479999999999999e-06 2024-09-14T09:09:35.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796967+0000", 2024-09-14T09:09:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1499999999999998e-06 2024-09-14T09:09:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:09:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-06 2024-09-14T09:09:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798688+0000", 2024-09-14T09:09:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017172660000000001 2024-09-14T09:09:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798691+0000", 2024-09-14T09:09:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:09:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789599+0000", 2024-09-14T09:09:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99090839399999997 2024-09-14T09:09:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789716+0000", 2024-09-14T09:09:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116474 2024-09-14T09:09:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789828+0000", 2024-09-14T09:09:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112293 2024-09-14T09:09:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:230 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1277952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.767014951999997, 2024-09-14T09:09:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99307501600000003, 2024-09-14T09:09:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.573 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 230 2024-09-14T09:09:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796979+0000", 2024-09-14T09:09:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.34e-07 2024-09-14T09:09:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796980+0000", 2024-09-14T09:09:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.53e-06 2024-09-14T09:09:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796986+0000", 2024-09-14T09:09:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9989999999999997e-06 2024-09-14T09:09:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796989+0000", 2024-09-14T09:09:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0340000000000001e-06 2024-09-14T09:09:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798702+0000", 2024-09-14T09:09:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001712756 2024-09-14T09:09:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798705+0000", 2024-09-14T09:09:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7750000000000001e-06 2024-09-14T09:09:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789870+0000", 2024-09-14T09:09:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991165026 2024-09-14T09:09:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789955+0000", 2024-09-14T09:09:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4839999999999994e-05 2024-09-14T09:09:35.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790053+0000", 2024-09-14T09:09:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8721999999999994e-05 2024-09-14T09:09:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:231 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.766999624, 2024-09-14T09:09:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99319130300000003, 2024-09-14T09:09:35.578 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 231 2024-09-14T09:09:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2024-09-14T09:09:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796995+0000", 2024-09-14T09:09:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2500000000000001e-06 2024-09-14T09:09:35.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796998+0000", 2024-09-14T09:09:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3230000000000002e-06 2024-09-14T09:09:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797001+0000", 2024-09-14T09:09:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7099999999999999e-06 2024-09-14T09:09:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798718+0000", 2024-09-14T09:09:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017168070000000001 2024-09-14T09:09:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798721+0000", 2024-09-14T09:09:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.853e-06 2024-09-14T09:09:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790077+0000", 2024-09-14T09:09:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991356393 2024-09-14T09:09:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790129+0000", 2024-09-14T09:09:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2240999999999997e-05 2024-09-14T09:09:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790185+0000", 2024-09-14T09:09:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5515e-05 2024-09-14T09:09:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:232 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2195456~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.766988968, 2024-09-14T09:09:35.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99329117899999997, 2024-09-14T09:09:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 232 2024-09-14T09:09:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797005+0000", 2024-09-14T09:09:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2024-09-14T09:09:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797006+0000", 2024-09-14T09:09:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3200000000000001e-06 2024-09-14T09:09:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797009+0000", 2024-09-14T09:09:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4680000000000001e-06 2024-09-14T09:09:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797012+0000", 2024-09-14T09:09:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4770000000000002e-06 2024-09-14T09:09:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798743+0000", 2024-09-14T09:09:35.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017312 2024-09-14T09:09:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798747+0000", 2024-09-14T09:09:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.484e-06 2024-09-14T09:09:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790201+0000", 2024-09-14T09:09:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99145419499999998 2024-09-14T09:09:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790241+0000", 2024-09-14T09:09:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0587999999999998e-05 2024-09-14T09:09:35.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790296+0000", 2024-09-14T09:09:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4212000000000002e-05 2024-09-14T09:09:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:233 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2654208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.766978344999998, 2024-09-14T09:09:35.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99337220100000001, 2024-09-14T09:09:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 233 2024-09-14T09:09:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:09:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:09:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.269e-06 2024-09-14T09:09:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797019+0000", 2024-09-14T09:09:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9519999999999999e-06 2024-09-14T09:09:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797022+0000", 2024-09-14T09:09:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6079999999999998e-06 2024-09-14T09:09:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798759+0000", 2024-09-14T09:09:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001737342 2024-09-14T09:09:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798762+0000", 2024-09-14T09:09:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:09:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790310+0000", 2024-09-14T09:09:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99154738799999997 2024-09-14T09:09:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790349+0000", 2024-09-14T09:09:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9573000000000002e-05 2024-09-14T09:09:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790387+0000", 2024-09-14T09:09:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7985999999999998e-05 2024-09-14T09:09:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:234 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3112960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.766968300000002, 2024-09-14T09:09:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99345674500000003, 2024-09-14T09:09:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.593 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 234 2024-09-14T09:09:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:35.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0100000000000001e-07 2024-09-14T09:09:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0699999999999999e-06 2024-09-14T09:09:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:09:35.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.886e-06 2024-09-14T09:09:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797032+0000", 2024-09-14T09:09:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7149999999999998e-06 2024-09-14T09:09:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798778+0000", 2024-09-14T09:09:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017460329999999999 2024-09-14T09:09:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798783+0000", 2024-09-14T09:09:35.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0760000000000002e-06 2024-09-14T09:09:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790408+0000", 2024-09-14T09:09:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99162473299999998 2024-09-14T09:09:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790446+0000", 2024-09-14T09:09:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8389000000000001e-05 2024-09-14T09:09:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790482+0000", 2024-09-14T09:09:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5642000000000002e-05 2024-09-14T09:09:35.597 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:235 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3571712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.766958402, 2024-09-14T09:09:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993539477, 2024-09-14T09:09:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:35.598 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 235 2024-09-14T09:09:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9999999999999999e-07 2024-09-14T09:09:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797036+0000", 2024-09-14T09:09:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.051e-06 2024-09-14T09:09:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797039+0000", 2024-09-14T09:09:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:09:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797042+0000", 2024-09-14T09:09:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5280000000000002e-06 2024-09-14T09:09:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798809+0000", 2024-09-14T09:09:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001767394 2024-09-14T09:09:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798815+0000", 2024-09-14T09:09:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0859999999999998e-06 2024-09-14T09:09:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790502+0000", 2024-09-14T09:09:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99168652300000004 2024-09-14T09:09:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790539+0000", 2024-09-14T09:09:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7471000000000001e-05 2024-09-14T09:09:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790574+0000", 2024-09-14T09:09:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5292e-05 2024-09-14T09:09:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:236 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 4030464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.766948169000003, 2024-09-14T09:09:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993619743, 2024-09-14T09:09:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 236 2024-09-14T09:09:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.603 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1400000000000001e-07 2024-09-14T09:09:35.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797047+0000", 2024-09-14T09:09:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3400000000000001e-06 2024-09-14T09:09:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:09:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0699999999999998e-06 2024-09-14T09:09:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797053+0000", 2024-09-14T09:09:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7310000000000002e-06 2024-09-14T09:09:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798839+0000", 2024-09-14T09:09:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001786403 2024-09-14T09:09:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798844+0000", 2024-09-14T09:09:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3730000000000001e-06 2024-09-14T09:09:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790592+0000", 2024-09-14T09:09:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99174818099999995 2024-09-14T09:09:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790628+0000", 2024-09-14T09:09:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5831000000000003e-05 2024-09-14T09:09:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790665+0000", 2024-09-14T09:09:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-05 2024-09-14T09:09:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:365 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.764761141000001, 2024-09-14T09:09:35.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157278400000004, 2024-09-14T09:09:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 365 2024-09-14T09:09:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:09:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799233+0000", 2024-09-14T09:09:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.057e-06 2024-09-14T09:09:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799236+0000", 2024-09-14T09:09:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0249999999999998e-06 2024-09-14T09:09:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799239+0000", 2024-09-14T09:09:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.481e-06 2024-09-14T09:09:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800963+0000", 2024-09-14T09:09:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017240440000000001 2024-09-14T09:09:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800969+0000", 2024-09-14T09:09:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1410000000000002e-06 2024-09-14T09:09:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790682+0000", 2024-09-14T09:09:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98971330300000004 2024-09-14T09:09:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790753+0000", 2024-09-14T09:09:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0548000000000003e-05 2024-09-14T09:09:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790805+0000", 2024-09-14T09:09:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1981999999999998e-05 2024-09-14T09:09:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:366 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.764751048000001, 2024-09-14T09:09:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99173757299999998, 2024-09-14T09:09:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.612 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 366 2024-09-14T09:09:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-07 2024-09-14T09:09:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799244+0000", 2024-09-14T09:09:35.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.359e-06 2024-09-14T09:09:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799247+0000", 2024-09-14T09:09:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4929999999999998e-06 2024-09-14T09:09:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799250+0000", 2024-09-14T09:09:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:09:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800991+0000", 2024-09-14T09:09:35.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017412809999999999 2024-09-14T09:09:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800997+0000", 2024-09-14T09:09:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:09:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790824+0000", 2024-09-14T09:09:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98982735399999999 2024-09-14T09:09:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790891+0000", 2024-09-14T09:09:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7243999999999995e-05 2024-09-14T09:09:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790980+0000", 2024-09-14T09:09:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8608000000000003e-05 2024-09-14T09:09:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:367 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.764739675999998, 2024-09-14T09:09:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99188259999999995, 2024-09-14T09:09:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 367 2024-09-14T09:09:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-07 2024-09-14T09:09:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799255+0000", 2024-09-14T09:09:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.111e-06 2024-09-14T09:09:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799259+0000", 2024-09-14T09:09:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8650000000000003e-06 2024-09-14T09:09:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799262+0000", 2024-09-14T09:09:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.128e-06 2024-09-14T09:09:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801029+0000", 2024-09-14T09:09:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017668460000000001 2024-09-14T09:09:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801032+0000", 2024-09-14T09:09:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3179999999999998e-06 2024-09-14T09:09:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791011+0000", 2024-09-14T09:09:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98997920399999995 2024-09-14T09:09:35.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791077+0000", 2024-09-14T09:09:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5214000000000003e-05 2024-09-14T09:09:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791136+0000", 2024-09-14T09:09:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9710000000000003e-05 2024-09-14T09:09:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.622 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:368 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.764728132999998, 2024-09-14T09:09:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99201753800000003, 2024-09-14T09:09:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 368 2024-09-14T09:09:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4900000000000002e-07 2024-09-14T09:09:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799267+0000", 2024-09-14T09:09:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.079e-06 2024-09-14T09:09:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799270+0000", 2024-09-14T09:09:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.993e-06 2024-09-14T09:09:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799272+0000", 2024-09-14T09:09:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.695e-06 2024-09-14T09:09:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801043+0000", 2024-09-14T09:09:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001771105 2024-09-14T09:09:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801046+0000", 2024-09-14T09:09:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7999999999999999e-06 2024-09-14T09:09:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791150+0000", 2024-09-14T09:09:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99010348699999995 2024-09-14T09:09:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791193+0000", 2024-09-14T09:09:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3615999999999997e-05 2024-09-14T09:09:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791283+0000", 2024-09-14T09:09:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9513999999999997e-05 2024-09-14T09:09:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:369 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.764717795000003, 2024-09-14T09:09:35.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99213433600000001, 2024-09-14T09:09:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 369 2024-09-14T09:09:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:09:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799277+0000", 2024-09-14T09:09:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.108e-06 2024-09-14T09:09:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799280+0000", 2024-09-14T09:09:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:09:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799283+0000", 2024-09-14T09:09:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.531e-06 2024-09-14T09:09:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801058+0000", 2024-09-14T09:09:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001775085 2024-09-14T09:09:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801060+0000", 2024-09-14T09:09:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8260000000000001e-06 2024-09-14T09:09:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791299+0000", 2024-09-14T09:09:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99023856799999999 2024-09-14T09:09:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791352+0000", 2024-09-14T09:09:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2528000000000003e-05 2024-09-14T09:09:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791410+0000", 2024-09-14T09:09:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8298000000000003e-05 2024-09-14T09:09:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:370 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2457600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.764693028000003, 2024-09-14T09:09:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99220795399999995, 2024-09-14T09:09:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.632 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 370 2024-09-14T09:09:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799301+0000", 2024-09-14T09:09:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2024-09-14T09:09:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799303+0000", 2024-09-14T09:09:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9319999999999999e-06 2024-09-14T09:09:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799310+0000", 2024-09-14T09:09:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8680000000000001e-06 2024-09-14T09:09:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799315+0000", 2024-09-14T09:09:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.921e-06 2024-09-14T09:09:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801071+0000", 2024-09-14T09:09:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001756678 2024-09-14T09:09:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801080+0000", 2024-09-14T09:09:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6060000000000003e-06 2024-09-14T09:09:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791429+0000", 2024-09-14T09:09:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99034944599999997 2024-09-14T09:09:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791471+0000", 2024-09-14T09:09:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1279999999999998e-05 2024-09-14T09:09:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791508+0000", 2024-09-14T09:09:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7663999999999997e-05 2024-09-14T09:09:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:371 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2916352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.764671856, 2024-09-14T09:09:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99228692299999999, 2024-09-14T09:09:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 371 2024-09-14T09:09:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799322+0000", 2024-09-14T09:09:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:09:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799333+0000", 2024-09-14T09:09:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1044e-05 2024-09-14T09:09:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799341+0000", 2024-09-14T09:09:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8439999999999998e-06 2024-09-14T09:09:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799354+0000", 2024-09-14T09:09:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3114e-05 2024-09-14T09:09:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801093+0000", 2024-09-14T09:09:35.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017385910000000001 2024-09-14T09:09:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801096+0000", 2024-09-14T09:09:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0680000000000001e-06 2024-09-14T09:09:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791528+0000", 2024-09-14T09:09:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99043264200000003 2024-09-14T09:09:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791570+0000", 2024-09-14T09:09:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2144999999999997e-05 2024-09-14T09:09:35.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791608+0000", 2024-09-14T09:09:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7966000000000002e-05 2024-09-14T09:09:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:372 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3375104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.764631307999998, 2024-09-14T09:09:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992342897, 2024-09-14T09:09:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.641 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 372 2024-09-14T09:09:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799363+0000", 2024-09-14T09:09:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2024-09-14T09:09:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799365+0000", 2024-09-14T09:09:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5500000000000001e-06 2024-09-14T09:09:35.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799371+0000", 2024-09-14T09:09:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2500000000000003e-06 2024-09-14T09:09:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799377+0000", 2024-09-14T09:09:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7509999999999997e-06 2024-09-14T09:09:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801107+0000", 2024-09-14T09:09:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017298019999999999 2024-09-14T09:09:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801111+0000", 2024-09-14T09:09:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8619999999999996e-06 2024-09-14T09:09:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791626+0000", 2024-09-14T09:09:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99051563300000001 2024-09-14T09:09:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791668+0000", 2024-09-14T09:09:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1424000000000002e-05 2024-09-14T09:09:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791705+0000", 2024-09-14T09:09:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7035e-05 2024-09-14T09:09:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:373 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.764609362999998, 2024-09-14T09:09:35.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99253589399999997, 2024-09-14T09:09:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 373 2024-09-14T09:09:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2024-09-14T09:09:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799387+0000", 2024-09-14T09:09:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1019999999999999e-06 2024-09-14T09:09:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799393+0000", 2024-09-14T09:09:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0190000000000003e-06 2024-09-14T09:09:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799398+0000", 2024-09-14T09:09:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:09:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801123+0000", 2024-09-14T09:09:35.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017251949999999999 2024-09-14T09:09:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801126+0000", 2024-09-14T09:09:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9280000000000002e-06 2024-09-14T09:09:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791746+0000", 2024-09-14T09:09:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99062036899999995 2024-09-14T09:09:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791835+0000", 2024-09-14T09:09:35.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9004000000000004e-05 2024-09-14T09:09:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791920+0000", 2024-09-14T09:09:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4524000000000006e-05 2024-09-14T09:09:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:60352 3.0 3.6d62a5c0 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:09:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.181973525, 2024-09-14T09:09:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41710537399999997, 2024-09-14T09:09:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.651 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 60352 2024-09-14T09:09:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:09:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:09:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382044+0000", 2024-09-14T09:09:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4640000000000001e-05 2024-09-14T09:09:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382048+0000", 2024-09-14T09:09:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4690000000000002e-06 2024-09-14T09:09:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382053+0000", 2024-09-14T09:09:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:09:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382068+0000", 2024-09-14T09:09:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4399000000000001e-05 2024-09-14T09:09:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382121+0000", 2024-09-14T09:09:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3578000000000001e-05 2024-09-14T09:09:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382127+0000", 2024-09-14T09:09:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2024-09-14T09:09:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799116+0000", 2024-09-14T09:09:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.416988566 2024-09-14T09:09:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799125+0000", 2024-09-14T09:09:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3100000000000006e-06 2024-09-14T09:09:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.655 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:63559 3.0 3.95b285c0 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.176142152000001, 2024-09-14T09:09:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.411301215, 2024-09-14T09:09:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 63559 2024-09-14T09:09:35.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2499999999999999e-07 2024-09-14T09:09:35.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387853+0000", 2024-09-14T09:09:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.477e-06 2024-09-14T09:09:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387856+0000", 2024-09-14T09:09:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1429999999999998e-06 2024-09-14T09:09:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387859+0000", 2024-09-14T09:09:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.582e-06 2024-09-14T09:09:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387888+0000", 2024-09-14T09:09:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9609000000000001e-05 2024-09-14T09:09:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387893+0000", 2024-09-14T09:09:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6779999999999999e-06 2024-09-14T09:09:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799143+0000", 2024-09-14T09:09:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41124997099999999 2024-09-14T09:09:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:35.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:35.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:35.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799152+0000", 2024-09-14T09:09:35.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5300000000000002e-06 2024-09-14T09:09:35.660 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.660 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.660 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.660 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:35.660 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:35.660 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:35.662 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:09:35.662 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:35.663+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:35.762 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:35.764+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:35.765 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:35.765 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:35.765 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:09:35.765 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:35.773 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:09:35.827 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 1] out_osds: [] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 2] 2024-09-14T09:09:35.827 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:09:35.827 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-14T09:09:35.827 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T09:09:35.827 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T09:09:35.828 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-14T09:09:35.835 INFO:teuthology.orchestra.run.smithi148.stdout:5754 trunc from 0xdb8a200 to 0x4338200 2024-09-14T09:09:35.872 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:35.874+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:35.885 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:35.885 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:35.885 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:35.885 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:35.885 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:35.893 INFO:teuthology.orchestra.run.smithi148.stdout:5756 write 0xba28e00 thru 0xba31de3 (0x8fe4 bytes) 2024-09-14T09:09:35.894 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:09:35.905 INFO:teuthology.orchestra.run.smithi148.stdout:5757 trunc from 0xba31e00 to 0x2324400 2024-09-14T09:09:35.939 INFO:teuthology.orchestra.run.smithi148.stdout:5758 write 0x5033800 thru 0x5040608 (0xce09 bytes) 2024-09-14T09:09:35.941 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:35.941 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "" 2024-09-14T09:09:35.941 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:35.943 INFO:teuthology.orchestra.run.smithi148.stdout:5760 read 0x2082800 thru 0x2083f42 (0x1743 bytes) 2024-09-14T09:09:35.953 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is set 2024-09-14T09:09:35.964 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:35.966+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:35.970 INFO:teuthology.orchestra.run.smithi148.stdout:5761 write 0xe4cda00 thru 0xe4d7ece (0xa4cf bytes) 2024-09-14T09:09:35.970 INFO:teuthology.orchestra.run.smithi148.stdout:5762 read 0x7539a00 thru 0x753d735 (0x3d36 bytes) 2024-09-14T09:09:35.970 INFO:teuthology.orchestra.run.smithi148.stdout:5763 punch from 0x8e93600 to 0x8e9c400, (0x8e00 bytes) 2024-09-14T09:09:35.971 INFO:teuthology.orchestra.run.smithi148.stdout:5766 read 0x162e00 thru 0x1643ef (0x15f0 bytes) 2024-09-14T09:09:35.973 INFO:teuthology.orchestra.run.smithi148.stdout:5768 write 0x39d2e00 thru 0x39d9677 (0x6878 bytes) 2024-09-14T09:09:35.973 INFO:teuthology.orchestra.run.smithi148.stdout:5770 write 0xc34ec00 thru 0xc35256c (0x396d bytes) 2024-09-14T09:09:35.973 INFO:teuthology.orchestra.run.smithi148.stdout:5772 read 0xb658000 thru 0xb667242 (0xf243 bytes) 2024-09-14T09:09:35.973 INFO:teuthology.orchestra.run.smithi148.stdout:5776 read 0x871800 thru 0x87acbd (0x94be bytes) 2024-09-14T09:09:35.973 INFO:teuthology.orchestra.run.smithi148.stdout:5779 write 0xab49c00 thru 0xab4f6bf (0x5ac0 bytes) 2024-09-14T09:09:35.973 INFO:teuthology.orchestra.run.smithi148.stdout:5782 read 0x6c3f800 thru 0x6c4dc3e (0xe43f bytes) 2024-09-14T09:09:35.974 INFO:teuthology.orchestra.run.smithi148.stdout:5783 punch from 0x64d5600 to 0x64dba00, (0x6400 bytes) 2024-09-14T09:09:35.974 INFO:teuthology.orchestra.run.smithi148.stdout:5784 punch from 0xec6600 to 0xed1800, (0xb200 bytes) 2024-09-14T09:09:35.974 INFO:teuthology.orchestra.run.smithi148.stdout:5785 read 0x38bae00 thru 0x38be8b4 (0x3ab5 bytes) 2024-09-14T09:09:35.975 INFO:teuthology.orchestra.run.smithi148.stdout:5788 read 0x7ce600 thru 0x7cf8b4 (0x12b5 bytes) 2024-09-14T09:09:35.976 INFO:teuthology.orchestra.run.smithi148.stdout:5789 write 0xcaf8c00 thru 0xcb0002c (0x742d bytes) 2024-09-14T09:09:35.976 INFO:teuthology.orchestra.run.smithi148.stdout:5790 write 0x6e0d800 thru 0x6e1c2d0 (0xead1 bytes) 2024-09-14T09:09:35.976 INFO:teuthology.orchestra.run.smithi148.stdout:5791 write 0x7cb7600 thru 0x7cbd97c (0x637d bytes) 2024-09-14T09:09:35.976 INFO:teuthology.orchestra.run.smithi148.stdout:5792 read 0xaa05a00 thru 0xaa0c2fb (0x68fc bytes) 2024-09-14T09:09:35.976 INFO:teuthology.orchestra.run.smithi148.stdout:5797 write 0xc85c200 thru 0xc85c7a1 (0x5a2 bytes) 2024-09-14T09:09:35.976 INFO:teuthology.orchestra.run.smithi148.stdout:5798 write 0x53ad200 thru 0x53b5d51 (0x8b52 bytes) 2024-09-14T09:09:35.977 INFO:teuthology.orchestra.run.smithi148.stdout:5799 read 0x11f7a00 thru 0x1203fe2 (0xc5e3 bytes) 2024-09-14T09:09:35.977 INFO:teuthology.orchestra.run.smithi148.stdout:5805 punch from 0x7983000 to 0x7986a00, (0x3a00 bytes) 2024-09-14T09:09:35.978 INFO:teuthology.orchestra.run.smithi148.stdout:5806 write 0xbe5ee00 thru 0xbe68fac (0xa1ad bytes) 2024-09-14T09:09:35.980 INFO:teuthology.orchestra.run.smithi148.stdout:5807 write 0x3876a00 thru 0x387b1fc (0x47fd bytes) 2024-09-14T09:09:35.980 INFO:teuthology.orchestra.run.smithi148.stdout:5808 read 0x7f3cc00 thru 0x7f42db8 (0x61b9 bytes) 2024-09-14T09:09:35.982 INFO:teuthology.orchestra.run.smithi148.stdout:5811 punch from 0xa588400 to 0xa590600, (0x8200 bytes) 2024-09-14T09:09:35.982 INFO:teuthology.orchestra.run.smithi148.stdout:5813 write 0x836b800 thru 0x83753fd (0x9bfe bytes) 2024-09-14T09:09:35.984 INFO:teuthology.orchestra.run.smithi148.stdout:5814 punch from 0x8f2b400 to 0x8f2da00, (0x2600 bytes) 2024-09-14T09:09:35.984 INFO:teuthology.orchestra.run.smithi148.stdout:5818 punch from 0x3ae00 to 0x43a00, (0x8c00 bytes) 2024-09-14T09:09:35.984 INFO:teuthology.orchestra.run.smithi148.stdout:5821 write 0x5af0a00 thru 0x5af8229 (0x782a bytes) 2024-09-14T09:09:36.003 INFO:teuthology.orchestra.run.smithi148.stdout:5823 trunc from 0xe4d8000 to 0xcec00 2024-09-14T09:09:36.011 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:36.011 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:36.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:36.011 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:36.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.011 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55979 3.e 3:740d1568:::rbd_data.1112a10502fe.0000000000000133:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:36.012 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:36.012 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.161443068000001, 2024-09-14T09:09:36.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.95211669700000001, 2024-09-14T09:09:36.012 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.012 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.012 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:36.012 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.012 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:36.012 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:36.012 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55979 2024-09-14T09:09:36.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.012 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:36.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:36.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850380+0000", 2024-09-14T09:09:36.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.615e-06 2024-09-14T09:09:36.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850386+0000", 2024-09-14T09:09:36.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8000000000000001e-06 2024-09-14T09:09:36.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850403+0000", 2024-09-14T09:09:36.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6339999999999999e-05 2024-09-14T09:09:36.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850413+0000", 2024-09-14T09:09:36.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8609999999999993e-06 2024-09-14T09:09:36.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851033+0000", 2024-09-14T09:09:36.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062034700000000004 2024-09-14T09:09:36.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:09:36.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851042+0000", 2024-09-14T09:09:36.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8340000000000005e-06 2024-09-14T09:09:36.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853175+0000", 2024-09-14T09:09:36.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0021332809999999999 2024-09-14T09:09:36.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:36.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853183+0000", 2024-09-14T09:09:36.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:09:36.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795232+0000", 2024-09-14T09:09:36.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94204854900000001 2024-09-14T09:09:36.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795413+0000", 2024-09-14T09:09:36.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018059200000000001 2024-09-14T09:09:36.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:09:36.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795717+0000", 2024-09-14T09:09:36.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000304636 2024-09-14T09:09:36.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:36.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799631+0000", 2024-09-14T09:09:36.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136910000000004 2024-09-14T09:09:36.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:36.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802290+0000", 2024-09-14T09:09:36.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026588010000000001 2024-09-14T09:09:36.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:36.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802362+0000", 2024-09-14T09:09:36.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2018000000000001e-05 2024-09-14T09:09:36.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802495+0000", 2024-09-14T09:09:36.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000132967 2024-09-14T09:09:36.019 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.020 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.020 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.020 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55990 3.e 3:72d6260e:::rbd_data.1112a10502fe.000000000000016c:head [stat,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:36.020 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:36.020 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 20.161381761000001, 2024-09-14T09:09:36.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.952433164, 2024-09-14T09:09:36.020 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.020 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.020 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.020 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.020 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:36.020 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:36.021 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55990 2024-09-14T09:09:36.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.021 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:36.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:36.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850440+0000", 2024-09-14T09:09:36.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5199999999999996e-07 2024-09-14T09:09:36.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850444+0000", 2024-09-14T09:09:36.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.019e-06 2024-09-14T09:09:36.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850452+0000", 2024-09-14T09:09:36.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0209999999999999e-06 2024-09-14T09:09:36.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850457+0000", 2024-09-14T09:09:36.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9529999999999998e-06 2024-09-14T09:09:36.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851100+0000", 2024-09-14T09:09:36.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00064299699999999997 2024-09-14T09:09:36.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:36.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851108+0000", 2024-09-14T09:09:36.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2279999999999998e-06 2024-09-14T09:09:36.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853208+0000", 2024-09-14T09:09:36.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020996579999999999 2024-09-14T09:09:36.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:36.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853213+0000", 2024-09-14T09:09:36.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4029999999999998e-06 2024-09-14T09:09:36.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796098+0000", 2024-09-14T09:09:36.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94288483700000003 2024-09-14T09:09:36.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796247+0000", 2024-09-14T09:09:36.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014925800000000001 2024-09-14T09:09:36.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802872+0000", 2024-09-14T09:09:36.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006625138 2024-09-14T09:09:36.027 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.027 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.027 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.027 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:36.027 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:36.027 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 19.997142988, 2024-09-14T09:09:36.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77465830800000002, 2024-09-14T09:09:36.028 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.028 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.028 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:36.028 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.028 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:36.028 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:36.028 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 58987 2024-09-14T09:09:36.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.028 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:36.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:36.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014680+0000", 2024-09-14T09:09:36.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9250000000000002e-06 2024-09-14T09:09:36.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014689+0000", 2024-09-14T09:09:36.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9730000000000003e-06 2024-09-14T09:09:36.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014709+0000", 2024-09-14T09:09:36.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9641999999999999e-05 2024-09-14T09:09:36.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014720+0000", 2024-09-14T09:09:36.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-09-14T09:09:36.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014796+0000", 2024-09-14T09:09:36.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6567000000000001e-05 2024-09-14T09:09:36.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:36.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014808+0000", 2024-09-14T09:09:36.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1435e-05 2024-09-14T09:09:36.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789325+0000", 2024-09-14T09:09:36.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77451705999999998 2024-09-14T09:09:36.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789336+0000", 2024-09-14T09:09:36.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1466e-05 2024-09-14T09:09:36.032 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.032 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.032 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.032 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:59017 3.3 3.6b81fb83 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:36.032 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:36.032 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 19.995490583999999, 2024-09-14T09:09:36.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77253447099999994, 2024-09-14T09:09:36.033 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.033 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.033 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:36.033 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.033 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:36.033 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:36.033 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 59017 2024-09-14T09:09:36.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.033 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:36.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:36.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016332+0000", 2024-09-14T09:09:36.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3459999999999999e-06 2024-09-14T09:09:36.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016337+0000", 2024-09-14T09:09:36.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.48e-06 2024-09-14T09:09:36.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016355+0000", 2024-09-14T09:09:36.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7955e-05 2024-09-14T09:09:36.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016364+0000", 2024-09-14T09:09:36.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.02e-06 2024-09-14T09:09:36.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016433+0000", 2024-09-14T09:09:36.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8398000000000005e-05 2024-09-14T09:09:36.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:36.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016442+0000", 2024-09-14T09:09:36.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1819999999999995e-06 2024-09-14T09:09:36.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788855+0000", 2024-09-14T09:09:36.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77241356299999997 2024-09-14T09:09:36.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788865+0000", 2024-09-14T09:09:36.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5270000000000004e-06 2024-09-14T09:09:36.038 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.038 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.038 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.038 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60343 3.e 3:721b16e6:::rbd_data.1112a10502fe.000000000000014b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:36.038 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:36.038 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 19.891520981999999, 2024-09-14T09:09:36.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68876920900000005, 2024-09-14T09:09:36.038 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.038 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.038 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:36.039 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.039 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:36.039 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:36.039 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60343 2024-09-14T09:09:36.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.039 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:36.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:36.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120302+0000", 2024-09-14T09:09:36.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0279999999999999e-06 2024-09-14T09:09:36.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120310+0000", 2024-09-14T09:09:36.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4330000000000004e-06 2024-09-14T09:09:36.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120333+0000", 2024-09-14T09:09:36.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2200000000000001e-05 2024-09-14T09:09:36.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120343+0000", 2024-09-14T09:09:36.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0560000000000001e-05 2024-09-14T09:09:36.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120414+0000", 2024-09-14T09:09:36.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0493000000000004e-05 2024-09-14T09:09:36.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:36.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120424+0000", 2024-09-14T09:09:36.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.059e-05 2024-09-14T09:09:36.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796679+0000", 2024-09-14T09:09:36.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67625512700000001 2024-09-14T09:09:36.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796833+0000", 2024-09-14T09:09:36.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015403500000000001 2024-09-14T09:09:36.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:09:36.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797239+0000", 2024-09-14T09:09:36.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040503000000000002 2024-09-14T09:09:36.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:36.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802918+0000", 2024-09-14T09:09:36.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056796199999999998 2024-09-14T09:09:36.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:36.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808655+0000", 2024-09-14T09:09:36.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057365089999999999 2024-09-14T09:09:36.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:36.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808850+0000", 2024-09-14T09:09:36.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000194904 2024-09-14T09:09:36.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809069+0000", 2024-09-14T09:09:36.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021968000000000001 2024-09-14T09:09:36.044 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.044 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.045 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.045 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60356 3.2 3:40f9e9e7:::rbd_data.1112a10502fe.0000000000000160:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:36.045 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:36.045 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 19.890458468999999, 2024-09-14T09:09:36.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68053790800000002, 2024-09-14T09:09:36.045 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.045 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.045 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:36.045 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.046 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:36.046 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:36.046 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60356 2024-09-14T09:09:36.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.046 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:36.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:36.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121364+0000", 2024-09-14T09:09:36.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.173e-06 2024-09-14T09:09:36.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121371+0000", 2024-09-14T09:09:36.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-09-14T09:09:36.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121386+0000", 2024-09-14T09:09:36.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4925e-05 2024-09-14T09:09:36.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121395+0000", 2024-09-14T09:09:36.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8190000000000003e-06 2024-09-14T09:09:36.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121464+0000", 2024-09-14T09:09:36.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8149000000000001e-05 2024-09-14T09:09:36.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:36.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121474+0000", 2024-09-14T09:09:36.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0927999999999999e-05 2024-09-14T09:09:36.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795901+0000", 2024-09-14T09:09:36.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67442645499999998 2024-09-14T09:09:36.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796068+0000", 2024-09-14T09:09:36.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016655700000000001 2024-09-14T09:09:36.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 3", 2024-09-14T09:09:36.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796354+0000", 2024-09-14T09:09:36.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00028646999999999999 2024-09-14T09:09:36.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:36.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.800348+0000", 2024-09-14T09:09:36.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039943119999999999 2024-09-14T09:09:36.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:36.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801690+0000", 2024-09-14T09:09:36.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013415090000000001 2024-09-14T09:09:36.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801771+0000", 2024-09-14T09:09:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1678e-05 2024-09-14T09:09:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801900+0000", 2024-09-14T09:09:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000128978 2024-09-14T09:09:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62163 3.e 3:713ab431:::rbd_data.1112a10502fe.0000000000000198:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 19.800088261999999, 2024-09-14T09:09:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.597552682, 2024-09-14T09:09:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62163 2024-09-14T09:09:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211735+0000", 2024-09-14T09:09:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1110000000000002e-06 2024-09-14T09:09:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211744+0000", 2024-09-14T09:09:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0790000000000007e-06 2024-09-14T09:09:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211765+0000", 2024-09-14T09:09:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1114000000000001e-05 2024-09-14T09:09:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211775+0000", 2024-09-14T09:09:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0033e-05 2024-09-14T09:09:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211847+0000", 2024-09-14T09:09:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1503999999999998e-05 2024-09-14T09:09:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211857+0000", 2024-09-14T09:09:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0378e-05 2024-09-14T09:09:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799140+0000", 2024-09-14T09:09:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.58728279100000003 2024-09-14T09:09:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799289+0000", 2024-09-14T09:09:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000148966 2024-09-14T09:09:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809285+0000", 2024-09-14T09:09:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099967059999999993 2024-09-14T09:09:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63582 3.2 3:467f2009:::rbd_data.1112a10502fe.00000000000001a1:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 19.724895145000001, 2024-09-14T09:09:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51869012999999997, 2024-09-14T09:09:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63582 2024-09-14T09:09:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286928+0000", 2024-09-14T09:09:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.812e-06 2024-09-14T09:09:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286936+0000", 2024-09-14T09:09:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2390000000000002e-06 2024-09-14T09:09:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286955+0000", 2024-09-14T09:09:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8853000000000001e-05 2024-09-14T09:09:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286972+0000", 2024-09-14T09:09:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7365000000000001e-05 2024-09-14T09:09:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287052+0000", 2024-09-14T09:09:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9491000000000002e-05 2024-09-14T09:09:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287063+0000", 2024-09-14T09:09:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1620999999999999e-05 2024-09-14T09:09:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796696+0000", 2024-09-14T09:09:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50963256999999995 2024-09-14T09:09:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796847+0000", 2024-09-14T09:09:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015126899999999999 2024-09-14T09:09:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.805616+0000", 2024-09-14T09:09:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087689099999999996 2024-09-14T09:09:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63586 3.3 3.d4e49b03 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 19.724810764000001, 2024-09-14T09:09:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50188935099999998, 2024-09-14T09:09:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63586 2024-09-14T09:09:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287011+0000", 2024-09-14T09:09:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.61e-07 2024-09-14T09:09:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287014+0000", 2024-09-14T09:09:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3900000000000002e-06 2024-09-14T09:09:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287023+0000", 2024-09-14T09:09:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3380000000000005e-06 2024-09-14T09:09:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287029+0000", 2024-09-14T09:09:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0079999999999999e-06 2024-09-14T09:09:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287087+0000", 2024-09-14T09:09:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8322000000000002e-05 2024-09-14T09:09:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287096+0000", 2024-09-14T09:09:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8580000000000006e-06 2024-09-14T09:09:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788891+0000", 2024-09-14T09:09:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50179498499999997 2024-09-14T09:09:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788900+0000", 2024-09-14T09:09:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.789e-06 2024-09-14T09:09:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60363 3.1d 3:b8b44067:::rbd_data.1112a10502fe.000000000000018b:head [stat,delete] snapc 21=[21] RETRY=12 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 19.224089026000001, 2024-09-14T09:09:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268612690000001, 2024-09-14T09:09:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60363 2024-09-14T09:09:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787733+0000", 2024-09-14T09:09:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.314e-06 2024-09-14T09:09:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787739+0000", 2024-09-14T09:09:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5300000000000004e-06 2024-09-14T09:09:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787750+0000", 2024-09-14T09:09:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1251e-05 2024-09-14T09:09:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0739999999999993e-06 2024-09-14T09:09:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787827+0000", 2024-09-14T09:09:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8861000000000004e-05 2024-09-14T09:09:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:09:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787836+0000", 2024-09-14T09:09:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1339999999999993e-06 2024-09-14T09:09:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789335+0000", 2024-09-14T09:09:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014988289999999999 2024-09-14T09:09:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789343+0000", 2024-09-14T09:09:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6639999999999998e-06 2024-09-14T09:09:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799170+0000", 2024-09-14T09:09:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098272500000001 2024-09-14T09:09:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799377+0000", 2024-09-14T09:09:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000207126 2024-09-14T09:09:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814593+0000", 2024-09-14T09:09:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015216235999999999 2024-09-14T09:09:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63565 3.1d 3:bdc63b28:::rbd_data.1112a10502fe.000000000000016d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=9 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 19.224043235, 2024-09-14T09:09:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0271114539999999, 2024-09-14T09:09:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63565 2024-09-14T09:09:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6899999999999998e-07 2024-09-14T09:09:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787781+0000", 2024-09-14T09:09:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8909999999999999e-06 2024-09-14T09:09:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787787+0000", 2024-09-14T09:09:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3230000000000003e-06 2024-09-14T09:09:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787793+0000", 2024-09-14T09:09:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-09-14T09:09:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789455+0000", 2024-09-14T09:09:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001661596 2024-09-14T09:09:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789463+0000", 2024-09-14T09:09:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4889999999999995e-06 2024-09-14T09:09:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800115+0000", 2024-09-14T09:09:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0106512670000001 2024-09-14T09:09:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800334+0000", 2024-09-14T09:09:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000219213 2024-09-14T09:09:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:09:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800651+0000", 2024-09-14T09:09:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00031765500000000002 2024-09-14T09:09:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.811875+0000", 2024-09-14T09:09:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011224032 2024-09-14T09:09:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814665+0000", 2024-09-14T09:09:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002789606 2024-09-14T09:09:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814742+0000", 2024-09-14T09:09:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6916999999999996e-05 2024-09-14T09:09:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814889+0000", 2024-09-14T09:09:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014725799999999999 2024-09-14T09:09:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:67113 3.1d 3:bba7fe0d:::rbd_data.1112a10502fe.00000000000001bf:head [stat,delete] snapc 21=[21] RETRY=4 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 19.223282377, 2024-09-14T09:09:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0265995649999999, 2024-09-14T09:09:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 67113 2024-09-14T09:09:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:09:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788543+0000", 2024-09-14T09:09:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-09-14T09:09:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788552+0000", 2024-09-14T09:09:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:09:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788559+0000", 2024-09-14T09:09:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:09:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789489+0000", 2024-09-14T09:09:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00092982199999999996 2024-09-14T09:09:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789497+0000", 2024-09-14T09:09:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6299999999999998e-06 2024-09-14T09:09:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801068+0000", 2024-09-14T09:09:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0115709530000001 2024-09-14T09:09:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801240+0000", 2024-09-14T09:09:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017276600000000001 2024-09-14T09:09:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815138+0000", 2024-09-14T09:09:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013897856 2024-09-14T09:09:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73412 3.1d 3:be4606c3:::rbd_data.1112a10502fe.00000000000001f2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 19.223251264999998, 2024-09-14T09:09:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026815928, 2024-09-14T09:09:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73412 2024-09-14T09:09:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5699999999999998e-07 2024-09-14T09:09:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788572+0000", 2024-09-14T09:09:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2809999999999998e-06 2024-09-14T09:09:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788579+0000", 2024-09-14T09:09:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5629999999999997e-06 2024-09-14T09:09:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788584+0000", 2024-09-14T09:09:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1710000000000001e-06 2024-09-14T09:09:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789521+0000", 2024-09-14T09:09:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00093657400000000002 2024-09-14T09:09:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789528+0000", 2024-09-14T09:09:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5719999999999997e-06 2024-09-14T09:09:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801631+0000", 2024-09-14T09:09:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0121023229999999 2024-09-14T09:09:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801792+0000", 2024-09-14T09:09:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016174000000000001 2024-09-14T09:09:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815386+0000", 2024-09-14T09:09:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013593246999999999 2024-09-14T09:09:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:77244 3.1d 3:b801be19:::rbd_data.1112a10502fe.0000000000000204:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 19.041387018999998, 2024-09-14T09:09:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.84519277100000001, 2024-09-14T09:09:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 77244 2024-09-14T09:09:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970436+0000", 2024-09-14T09:09:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.511e-06 2024-09-14T09:09:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970441+0000", 2024-09-14T09:09:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0470000000000001e-06 2024-09-14T09:09:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970453+0000", 2024-09-14T09:09:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2629999999999999e-05 2024-09-14T09:09:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970461+0000", 2024-09-14T09:09:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6850000000000001e-06 2024-09-14T09:09:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970524+0000", 2024-09-14T09:09:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3332999999999998e-05 2024-09-14T09:09:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970544+0000", 2024-09-14T09:09:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9731000000000001e-05 2024-09-14T09:09:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802188+0000", 2024-09-14T09:09:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.83164380000000004 2024-09-14T09:09:36.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:09:36.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015411999999999999 2024-09-14T09:09:36.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815627+0000", 2024-09-14T09:09:36.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013284914 2024-09-14T09:09:36.096 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.096 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:79796 3.1d 3:bc22caaf:::rbd_data.1112a10502fe.000000000000020c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.920078332999999, 2024-09-14T09:09:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72411694299999996, 2024-09-14T09:09:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 79796 2024-09-14T09:09:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091745+0000", 2024-09-14T09:09:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2000000000000001e-06 2024-09-14T09:09:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091752+0000", 2024-09-14T09:09:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-09-14T09:09:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091772+0000", 2024-09-14T09:09:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9822000000000001e-05 2024-09-14T09:09:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091791+0000", 2024-09-14T09:09:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9236e-05 2024-09-14T09:09:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091882+0000", 2024-09-14T09:09:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0783000000000001e-05 2024-09-14T09:09:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091892+0000", 2024-09-14T09:09:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7999999999999993e-06 2024-09-14T09:09:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802744+0000", 2024-09-14T09:09:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.710851868 2024-09-14T09:09:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802902+0000", 2024-09-14T09:09:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015814900000000001 2024-09-14T09:09:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815860+0000", 2024-09-14T09:09:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012957605000000001 2024-09-14T09:09:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.103 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80904 3.1d 3:be0e7f3d:::rbd_data.1112a10502fe.0000000000000214:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:36.103 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:36.103 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.839992486, 2024-09-14T09:09:36.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64435178100000001, 2024-09-14T09:09:36.103 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.103 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.103 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.103 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80904 2024-09-14T09:09:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171831+0000", 2024-09-14T09:09:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0729999999999999e-06 2024-09-14T09:09:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171839+0000", 2024-09-14T09:09:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9179999999999994e-06 2024-09-14T09:09:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171857+0000", 2024-09-14T09:09:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8957000000000002e-05 2024-09-14T09:09:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171867+0000", 2024-09-14T09:09:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7100000000000002e-06 2024-09-14T09:09:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171957+0000", 2024-09-14T09:09:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9932999999999994e-05 2024-09-14T09:09:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171974+0000", 2024-09-14T09:09:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6988999999999999e-05 2024-09-14T09:09:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803301+0000", 2024-09-14T09:09:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63132648599999996 2024-09-14T09:09:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803482+0000", 2024-09-14T09:09:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000181607 2024-09-14T09:09:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816180+0000", 2024-09-14T09:09:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012698108 2024-09-14T09:09:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80964 3.1d 3:be42e20f:::rbd_data.1112a10502fe.0000000000000219:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.834356919000001, 2024-09-14T09:09:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63896829799999999, 2024-09-14T09:09:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80964 2024-09-14T09:09:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177466+0000", 2024-09-14T09:09:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6610000000000001e-06 2024-09-14T09:09:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177472+0000", 2024-09-14T09:09:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3029999999999996e-06 2024-09-14T09:09:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177490+0000", 2024-09-14T09:09:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8099000000000001e-05 2024-09-14T09:09:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177499+0000", 2024-09-14T09:09:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:09:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177560+0000", 2024-09-14T09:09:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1334000000000006e-05 2024-09-14T09:09:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177578+0000", 2024-09-14T09:09:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8434999999999999e-05 2024-09-14T09:09:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803910+0000", 2024-09-14T09:09:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62633190699999997 2024-09-14T09:09:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.806612+0000", 2024-09-14T09:09:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002702257 2024-09-14T09:09:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816432+0000", 2024-09-14T09:09:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098199370000000008 2024-09-14T09:09:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83321 3.1d 3:bb24b47b:::rbd_data.1112a10502fe.0000000000000223:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.719903245000001, 2024-09-14T09:09:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52477628799999998, 2024-09-14T09:09:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83321 2024-09-14T09:09:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291920+0000", 2024-09-14T09:09:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.888e-06 2024-09-14T09:09:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291926+0000", 2024-09-14T09:09:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6059999999999999e-06 2024-09-14T09:09:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291943+0000", 2024-09-14T09:09:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6813e-05 2024-09-14T09:09:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291952+0000", 2024-09-14T09:09:36.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7439999999999996e-06 2024-09-14T09:09:36.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292023+0000", 2024-09-14T09:09:36.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1320000000000002e-05 2024-09-14T09:09:36.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292030+0000", 2024-09-14T09:09:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4219999999999997e-06 2024-09-14T09:09:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807221+0000", 2024-09-14T09:09:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51519140699999999 2024-09-14T09:09:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807406+0000", 2024-09-14T09:09:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018532800000000001 2024-09-14T09:09:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816694+0000", 2024-09-14T09:09:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092877600000000008 2024-09-14T09:09:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83358 3.1d 3:bb230e23:::rbd_data.1112a10502fe.000000000000022b:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.718383355, 2024-09-14T09:09:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52374808900000003, 2024-09-14T09:09:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83358 2024-09-14T09:09:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293439+0000", 2024-09-14T09:09:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5899999999999995e-07 2024-09-14T09:09:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293443+0000", 2024-09-14T09:09:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9309999999999999e-06 2024-09-14T09:09:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293457+0000", 2024-09-14T09:09:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3944999999999999e-05 2024-09-14T09:09:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293466+0000", 2024-09-14T09:09:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4319999999999999e-06 2024-09-14T09:09:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293530+0000", 2024-09-14T09:09:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3860000000000002e-05 2024-09-14T09:09:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293540+0000", 2024-09-14T09:09:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0107e-05 2024-09-14T09:09:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809096+0000", 2024-09-14T09:09:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51555587800000002 2024-09-14T09:09:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809265+0000", 2024-09-14T09:09:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000169092 2024-09-14T09:09:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817186+0000", 2024-09-14T09:09:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079209850000000002 2024-09-14T09:09:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.124 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83361 3.1d 3:bd571564:::rbd_data.1112a10502fe.000000000000022c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:36.124 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:36.124 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.718065279000001, 2024-09-14T09:09:36.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52373873100000001, 2024-09-14T09:09:36.124 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.124 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83361 2024-09-14T09:09:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293757+0000", 2024-09-14T09:09:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8000000000000004e-07 2024-09-14T09:09:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293762+0000", 2024-09-14T09:09:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8019999999999997e-06 2024-09-14T09:09:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293775+0000", 2024-09-14T09:09:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2884000000000001e-05 2024-09-14T09:09:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293783+0000", 2024-09-14T09:09:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:09:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293849+0000", 2024-09-14T09:09:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5859999999999996e-05 2024-09-14T09:09:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293861+0000", 2024-09-14T09:09:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2238999999999999e-05 2024-09-14T09:09:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809680+0000", 2024-09-14T09:09:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51581856800000003 2024-09-14T09:09:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809844+0000", 2024-09-14T09:09:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016441200000000001 2024-09-14T09:09:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817494+0000", 2024-09-14T09:09:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076502360000000004 2024-09-14T09:09:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.129 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:36.132 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:36.132+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:36.132 INFO:teuthology.orchestra.run.smithi148.stdout:5825 punch from 0xdc00 to 0xfe00, (0x2200 bytes) 2024-09-14T09:09:36.132 INFO:teuthology.orchestra.run.smithi148.stdout:5826 write 0x5df1200 thru 0x5df86fd (0x74fe bytes) 2024-09-14T09:09:36.132 INFO:teuthology.orchestra.run.smithi148.stdout:5829 write 0xb84ae00 thru 0xb853817 (0x8a18 bytes) 2024-09-14T09:09:36.132 INFO:teuthology.orchestra.run.smithi148.stdout:5830 trunc from 0xb853a00 to 0x2c5fa00 2024-09-14T09:09:36.132 INFO:teuthology.orchestra.run.smithi148.stdout:5831 trunc from 0x2c5fa00 to 0x279fe00 2024-09-14T09:09:36.132 INFO:teuthology.orchestra.run.smithi148.stdout:5833 read 0x11a0e00 thru 0x11a54b2 (0x46b3 bytes) 2024-09-14T09:09:36.132 INFO:teuthology.orchestra.run.smithi148.stdout:5835 trunc from 0x279fe00 to 0x55d400 2024-09-14T09:09:36.133 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:09:36.136 INFO:teuthology.orchestra.run.smithi148.stdout:5836 trunc from 0x55d400 to 0x7561000 2024-09-14T09:09:36.144 INFO:teuthology.orchestra.run.smithi148.stdout:5840 read 0x148ca00 thru 0x149289a (0x5e9b bytes) 2024-09-14T09:09:36.161 INFO:teuthology.orchestra.run.smithi148.stdout:5841 write 0xc9bd000 thru 0xc9c1fa1 (0x4fa2 bytes) 2024-09-14T09:09:36.163 INFO:teuthology.orchestra.run.smithi148.stdout:5843 write 0x1b11c00 thru 0x1b120e3 (0x4e4 bytes) 2024-09-14T09:09:36.163 INFO:teuthology.orchestra.run.smithi148.stdout:5844 read 0x8696e00 thru 0x8696e3f (0x40 bytes) 2024-09-14T09:09:36.165 INFO:teuthology.orchestra.run.smithi148.stdout:5846 write 0x1da5600 thru 0x1db0f71 (0xb972 bytes) 2024-09-14T09:09:36.168 INFO:teuthology.orchestra.run.smithi148.stdout:5847 trunc from 0xc9c2000 to 0x811be00 2024-09-14T09:09:36.185 INFO:teuthology.orchestra.run.smithi148.stdout:5848 punch from 0x131a200 to 0x1325600, (0xb400 bytes) 2024-09-14T09:09:36.188 INFO:teuthology.orchestra.run.smithi148.stdout:5850 read 0x74a1200 thru 0x74acd31 (0xbb32 bytes) 2024-09-14T09:09:36.188 INFO:teuthology.orchestra.run.smithi148.stdout:5851 read 0x10a7800 thru 0x10ab6ef (0x3ef0 bytes) 2024-09-14T09:09:36.190 INFO:teuthology.orchestra.run.smithi148.stdout:5854 read 0x2788200 thru 0x2789b61 (0x1962 bytes) 2024-09-14T09:09:36.190 INFO:teuthology.orchestra.run.smithi148.stdout:5855 write 0x30b9c00 thru 0x30bbc63 (0x2064 bytes) 2024-09-14T09:09:36.203 INFO:teuthology.orchestra.run.smithi148.stdout:5857 write 0xb0b8c00 thru 0xb0c6ded (0xe1ee bytes) 2024-09-14T09:09:36.208 INFO:teuthology.orchestra.run.smithi148.stdout:5859 read 0x6dc6a00 thru 0x6dd4dab (0xe3ac bytes) 2024-09-14T09:09:36.214 INFO:teuthology.orchestra.run.smithi148.stdout:5861 trunc from 0xb0c6e00 to 0x1e63000 2024-09-14T09:09:36.231 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:36.234+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:36.254 INFO:teuthology.orchestra.run.smithi148.stdout:5863 write 0x85fec00 thru 0x8603bf2 (0x4ff3 bytes) 2024-09-14T09:09:36.256 INFO:teuthology.orchestra.run.smithi148.stdout:5866 punch from 0x2319c00 to 0x231de00, (0x4200 bytes) 2024-09-14T09:09:36.256 INFO:teuthology.orchestra.run.smithi148.stdout:5868 read 0xd30c00 thru 0xd35ea2 (0x52a3 bytes) 2024-09-14T09:09:36.258 INFO:teuthology.orchestra.run.smithi148.stdout:5869 read 0x5bc4400 thru 0x5bc5f42 (0x1b43 bytes) 2024-09-14T09:09:36.273 INFO:teuthology.orchestra.run.smithi148.stdout:5870 write 0xe281c00 thru 0xe2874d6 (0x58d7 bytes) 2024-09-14T09:09:36.275 INFO:teuthology.orchestra.run.smithi148.stdout:5873 write 0x9ed4000 thru 0x9eddba1 (0x9ba2 bytes) 2024-09-14T09:09:36.275 INFO:teuthology.orchestra.run.smithi148.stdout:5874 write 0x626ba00 thru 0x6274a58 (0x9059 bytes) 2024-09-14T09:09:36.278 INFO:teuthology.orchestra.run.smithi148.stdout:5875 read 0xc4a0200 thru 0xc4a8111 (0x7f12 bytes) 2024-09-14T09:09:36.278 INFO:teuthology.orchestra.run.smithi148.stdout:5876 write 0x6b17000 thru 0x6b1dd3c (0x6d3d bytes) 2024-09-14T09:09:36.278 INFO:teuthology.orchestra.run.smithi148.stdout:5878 write 0xb893200 thru 0xb895284 (0x2085 bytes) 2024-09-14T09:09:36.279 INFO:teuthology.orchestra.run.smithi148.stdout:5879 write 0x86fee00 thru 0x870d464 (0xe665 bytes) 2024-09-14T09:09:36.279 INFO:teuthology.orchestra.run.smithi148.stdout:5880 read 0x20ad600 thru 0x20b46ef (0x70f0 bytes) 2024-09-14T09:09:36.280 INFO:teuthology.orchestra.run.smithi148.stdout:5882 read 0x790da00 thru 0x7919afe (0xc0ff bytes) 2024-09-14T09:09:36.280 INFO:teuthology.orchestra.run.smithi148.stdout:5884 write 0xd03a200 thru 0xd03a5e9 (0x3ea bytes) 2024-09-14T09:09:36.280 INFO:teuthology.orchestra.run.smithi148.stdout:5885 write 0x7272000 thru 0x727203f (0x40 bytes) 2024-09-14T09:09:36.280 INFO:teuthology.orchestra.run.smithi148.stdout:5886 write 0x4065600 thru 0x4067a7f (0x2480 bytes) 2024-09-14T09:09:36.281 INFO:teuthology.orchestra.run.smithi148.stdout:5887 write 0xaad8800 thru 0xaae652d (0xdd2e bytes) 2024-09-14T09:09:36.281 INFO:teuthology.orchestra.run.smithi148.stdout:5889 punch from 0x34a7a00 to 0x34ab400, (0x3a00 bytes) 2024-09-14T09:09:36.281 INFO:teuthology.orchestra.run.smithi148.stdout:5891 read 0x69dec00 thru 0x69e3bbe (0x4fbf bytes) 2024-09-14T09:09:36.283 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:36.283 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:36.283 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:09:36.283 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:36.284 INFO:teuthology.orchestra.run.smithi148.stdout:5895 punch from 0xfdac00 to 0xfdae00, (0x200 bytes) 2024-09-14T09:09:36.284 INFO:teuthology.orchestra.run.smithi148.stdout:5896 read 0xe1bd000 thru 0xe1c1987 (0x4988 bytes) 2024-09-14T09:09:36.284 INFO:teuthology.orchestra.run.smithi148.stdout:5897 write 0xc5ee00 thru 0xc61506 (0x2707 bytes) 2024-09-14T09:09:36.286 INFO:teuthology.orchestra.run.smithi148.stdout:5899 punch from 0x8013200 to 0x8020c00, (0xda00 bytes) 2024-09-14T09:09:36.286 INFO:teuthology.orchestra.run.smithi148.stdout:5900 write 0x6df2e00 thru 0x6dfd1de (0xa3df bytes) 2024-09-14T09:09:36.293 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:09:36.296 INFO:teuthology.orchestra.run.smithi148.stdout:5904 trunc from 0xe287600 to 0x5edd800 2024-09-14T09:09:36.313 INFO:teuthology.orchestra.run.smithi148.stdout:5906 write 0x1e3d000 thru 0x1e44786 (0x7787 bytes) 2024-09-14T09:09:36.320 INFO:teuthology.orchestra.run.smithi148.stdout:5907 read 0x46d8800 thru 0x46e5e07 (0xd608 bytes) 2024-09-14T09:09:36.332 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:36.335+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:36.340 INFO:teuthology.orchestra.run.smithi148.stdout:5909 write 0xd5b4a00 thru 0xd5b9792 (0x4d93 bytes) 2024-09-14T09:09:36.341 INFO:teuthology.orchestra.run.smithi148.stdout:5911 read 0x81d6e00 thru 0x81dd35d (0x655e bytes) 2024-09-14T09:09:36.341 INFO:teuthology.orchestra.run.smithi148.stdout:5912 punch from 0x7bc4600 to 0x7bd3000, (0xea00 bytes) 2024-09-14T09:09:36.343 INFO:teuthology.orchestra.run.smithi148.stdout:5913 read 0x53bae00 thru 0x53c030c (0x550d bytes) 2024-09-14T09:09:36.345 INFO:teuthology.orchestra.run.smithi148.stdout:5914 read 0x25c4600 thru 0x25c9a67 (0x5468 bytes) 2024-09-14T09:09:36.353 INFO:teuthology.orchestra.run.smithi148.stdout:5915 trunc from 0xd5b9800 to 0x6aac200 2024-09-14T09:09:36.392 INFO:teuthology.orchestra.run.smithi148.stdout:5916 write 0xc757000 thru 0xc7629bd (0xb9be bytes) 2024-09-14T09:09:36.392 INFO:teuthology.orchestra.run.smithi148.stdout:5917 punch from 0xc1cd400 to 0xc1cf400, (0x2000 bytes) 2024-09-14T09:09:36.392 INFO:teuthology.orchestra.run.smithi148.stdout:5918 read 0x5c76c00 thru 0x5c850e2 (0xe4e3 bytes) 2024-09-14T09:09:36.393 INFO:teuthology.orchestra.run.smithi148.stdout:5921 write 0xbbb4a00 thru 0xbbb5934 (0xf35 bytes) 2024-09-14T09:09:36.396 INFO:teuthology.orchestra.run.smithi148.stdout:5922 trunc from 0xc762a00 to 0xa073400 2024-09-14T09:09:36.404 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:36.404 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:36.405 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:36.405 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:36.405 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:36.414 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:09:36.415 INFO:teuthology.orchestra.run.smithi148.stdout:5923 read 0x2644600 thru 0x2652738 (0xe139 bytes) 2024-09-14T09:09:36.421 INFO:teuthology.orchestra.run.smithi148.stdout:5926 trunc from 0xa073400 to 0x58d3000 2024-09-14T09:09:36.434 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:36.436+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:36.449 INFO:teuthology.orchestra.run.smithi148.stdout:5927 write 0x7af6a00 thru 0x7af8dbb (0x23bc bytes) 2024-09-14T09:09:36.450 INFO:teuthology.orchestra.run.smithi148.stdout:5928 read 0x1561200 thru 0x15689eb (0x77ec bytes) 2024-09-14T09:09:36.451 INFO:teuthology.orchestra.run.smithi148.stdout:5929 clone 40 order 22 su 262144 sc 8 2024-09-14T09:09:36.520 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:36.520 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:36.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:36.520 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:36.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.520 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2265 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4034560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:36.520 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:36.520 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.658639301000001, 2024-09-14T09:09:36.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073974829000000006, 2024-09-14T09:09:36.521 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.521 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.521 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:36.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:36.521 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2265 2024-09-14T09:09:36.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.521 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:36.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:36.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862542+0000", 2024-09-14T09:09:36.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:09:36.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862543+0000", 2024-09-14T09:09:36.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.81e-06 2024-09-14T09:09:36.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862549+0000", 2024-09-14T09:09:36.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8850000000000004e-06 2024-09-14T09:09:36.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862554+0000", 2024-09-14T09:09:36.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5279999999999997e-06 2024-09-14T09:09:36.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936318+0000", 2024-09-14T09:09:36.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073764422999999996 2024-09-14T09:09:36.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936412+0000", 2024-09-14T09:09:36.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3801000000000005e-05 2024-09-14T09:09:36.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936516+0000", 2024-09-14T09:09:36.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000104007 2024-09-14T09:09:36.525 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.525 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.525 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.525 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2266 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4096000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:36.525 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:36.525 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.658621437000001, 2024-09-14T09:09:36.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074208332000000002, 2024-09-14T09:09:36.525 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.525 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.525 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:36.526 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:36.526 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2266 2024-09-14T09:09:36.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.526 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:36.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:36.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862738+0000", 2024-09-14T09:09:36.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017920300000000001 2024-09-14T09:09:36.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862744+0000", 2024-09-14T09:09:36.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3000000000000001e-06 2024-09-14T09:09:36.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862753+0000", 2024-09-14T09:09:36.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8179999999999999e-06 2024-09-14T09:09:36.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862785+0000", 2024-09-14T09:09:36.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1949000000000002e-05 2024-09-14T09:09:36.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936556+0000", 2024-09-14T09:09:36.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073770268999999999 2024-09-14T09:09:36.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936657+0000", 2024-09-14T09:09:36.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101387 2024-09-14T09:09:36.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936767+0000", 2024-09-14T09:09:36.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110406 2024-09-14T09:09:36.530 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.530 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.530 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.530 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2267 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4157440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:36.531 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:36.531 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.658382854999999, 2024-09-14T09:09:36.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074200918000000005, 2024-09-14T09:09:36.531 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.531 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.531 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.531 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.531 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:36.531 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:36.531 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2267 2024-09-14T09:09:36.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.531 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:36.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:36.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863416+0000", 2024-09-14T09:09:36.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000618492 2024-09-14T09:09:36.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863421+0000", 2024-09-14T09:09:36.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1359999999999996e-06 2024-09-14T09:09:36.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863434+0000", 2024-09-14T09:09:36.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2291e-05 2024-09-14T09:09:36.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863444+0000", 2024-09-14T09:09:36.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9769999999999995e-06 2024-09-14T09:09:36.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936808+0000", 2024-09-14T09:09:36.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073364051999999999 2024-09-14T09:09:36.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936892+0000", 2024-09-14T09:09:36.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4641999999999994e-05 2024-09-14T09:09:36.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936999+0000", 2024-09-14T09:09:36.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106328 2024-09-14T09:09:36.535 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.535 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.535 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.535 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2329 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 106496~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:36.535 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:36.535 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.657654246, 2024-09-14T09:09:36.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074180251000000003, 2024-09-14T09:09:36.536 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.536 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.536 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:36.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:36.536 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2329 2024-09-14T09:09:36.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.536 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:36.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:36.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864203+0000", 2024-09-14T09:09:36.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000677015 2024-09-14T09:09:36.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864208+0000", 2024-09-14T09:09:36.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.972e-06 2024-09-14T09:09:36.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864221+0000", 2024-09-14T09:09:36.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2683e-05 2024-09-14T09:09:36.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864229+0000", 2024-09-14T09:09:36.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0809999999999994e-06 2024-09-14T09:09:36.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937430+0000", 2024-09-14T09:09:36.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073201231000000005 2024-09-14T09:09:36.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937513+0000", 2024-09-14T09:09:36.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2652999999999996e-05 2024-09-14T09:09:36.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937707+0000", 2024-09-14T09:09:36.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000193616 2024-09-14T09:09:36.540 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.540 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.540 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.540 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2331 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 229376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:36.540 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:36.540 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.656836749, 2024-09-14T09:09:36.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.07400843, 2024-09-14T09:09:36.540 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.540 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.541 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.541 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.541 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:36.541 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:36.541 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2331 2024-09-14T09:09:36.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.541 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:36.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:36.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868104+0000", 2024-09-14T09:09:36.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003760453 2024-09-14T09:09:36.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868109+0000", 2024-09-14T09:09:36.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9339999999999997e-06 2024-09-14T09:09:36.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868119+0000", 2024-09-14T09:09:36.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5389999999999996e-06 2024-09-14T09:09:36.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868126+0000", 2024-09-14T09:09:36.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4499999999999998e-06 2024-09-14T09:09:36.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938065+0000", 2024-09-14T09:09:36.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069938809000000005 2024-09-14T09:09:36.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938148+0000", 2024-09-14T09:09:36.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3171999999999996e-05 2024-09-14T09:09:36.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938352+0000", 2024-09-14T09:09:36.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020407300000000001 2024-09-14T09:09:36.544 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.544 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.545 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.545 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2380 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3239936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:36.545 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:36.545 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.641811721000003, 2024-09-14T09:09:36.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073985913, 2024-09-14T09:09:36.545 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.545 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.545 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.545 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.545 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:36.545 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:36.546 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2380 2024-09-14T09:09:36.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.546 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:36.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:36.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879697+0000", 2024-09-14T09:09:36.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032864100000000001 2024-09-14T09:09:36.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879702+0000", 2024-09-14T09:09:36.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.578e-06 2024-09-14T09:09:36.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879716+0000", 2024-09-14T09:09:36.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.413e-05 2024-09-14T09:09:36.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879724+0000", 2024-09-14T09:09:36.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.559e-06 2024-09-14T09:09:36.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953155+0000", 2024-09-14T09:09:36.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073431221000000005 2024-09-14T09:09:36.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953247+0000", 2024-09-14T09:09:36.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1662000000000004e-05 2024-09-14T09:09:36.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953355+0000", 2024-09-14T09:09:36.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010812200000000001 2024-09-14T09:09:36.549 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.549 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.549 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.550 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2501 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2850816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:36.550 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:36.550 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.623269417000003, 2024-09-14T09:09:36.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074288858999999999, 2024-09-14T09:09:36.550 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.550 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.550 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.550 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.550 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:36.550 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:36.551 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2501 2024-09-14T09:09:36.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.551 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:36.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:36.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:36.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.41e-07 2024-09-14T09:09:36.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897913+0000", 2024-09-14T09:09:36.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3090000000000001e-06 2024-09-14T09:09:36.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897918+0000", 2024-09-14T09:09:36.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8470000000000003e-06 2024-09-14T09:09:36.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897922+0000", 2024-09-14T09:09:36.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5549999999999996e-06 2024-09-14T09:09:36.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971872+0000", 2024-09-14T09:09:36.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073950057999999999 2024-09-14T09:09:36.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971958+0000", 2024-09-14T09:09:36.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5941999999999998e-05 2024-09-14T09:09:36.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972200+0000", 2024-09-14T09:09:36.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000241907 2024-09-14T09:09:36.554 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.554 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.554 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.554 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2502 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2912256~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:36.554 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:36.555 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.623230237000001, 2024-09-14T09:09:36.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074614080999999999, 2024-09-14T09:09:36.555 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.555 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.555 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.555 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.555 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:36.555 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:36.555 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2502 2024-09-14T09:09:36.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.555 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:36.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:36.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897951+0000", 2024-09-14T09:09:36.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:09:36.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897953+0000", 2024-09-14T09:09:36.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5670000000000002e-06 2024-09-14T09:09:36.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897970+0000", 2024-09-14T09:09:36.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6319000000000001e-05 2024-09-14T09:09:36.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897976+0000", 2024-09-14T09:09:36.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8760000000000002e-06 2024-09-14T09:09:36.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972245+0000", 2024-09-14T09:09:36.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074269186000000001 2024-09-14T09:09:36.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972333+0000", 2024-09-14T09:09:36.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7800999999999995e-05 2024-09-14T09:09:36.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972564+0000", 2024-09-14T09:09:36.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000231833 2024-09-14T09:09:36.558 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.559 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.559 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.559 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2503 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2973696~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:36.559 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:36.559 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.623196219999997, 2024-09-14T09:09:36.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074944286999999998, 2024-09-14T09:09:36.559 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.559 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.559 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.559 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.559 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:36.559 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:36.560 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2503 2024-09-14T09:09:36.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.560 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:36.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:36.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897985+0000", 2024-09-14T09:09:36.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999998e-07 2024-09-14T09:09:36.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897987+0000", 2024-09-14T09:09:36.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.401e-06 2024-09-14T09:09:36.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897999+0000", 2024-09-14T09:09:36.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1851999999999999e-05 2024-09-14T09:09:36.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898005+0000", 2024-09-14T09:09:36.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9789999999999998e-06 2024-09-14T09:09:36.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972609+0000", 2024-09-14T09:09:36.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074604217 2024-09-14T09:09:36.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972684+0000", 2024-09-14T09:09:36.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4777999999999995e-05 2024-09-14T09:09:36.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972929+0000", 2024-09-14T09:09:36.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024448100000000001 2024-09-14T09:09:36.563 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.563 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.563 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.563 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2504 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3035136~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:36.563 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:36.564 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.623168128000003, 2024-09-14T09:09:36.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075285131000000005, 2024-09-14T09:09:36.564 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.564 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.564 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.564 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.564 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:36.564 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:36.564 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2504 2024-09-14T09:09:36.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.564 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:36.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:36.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898078+0000", 2024-09-14T09:09:36.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5775e-05 2024-09-14T09:09:36.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898082+0000", 2024-09-14T09:09:36.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.49e-06 2024-09-14T09:09:36.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898092+0000", 2024-09-14T09:09:36.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0509999999999999e-05 2024-09-14T09:09:36.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898099+0000", 2024-09-14T09:09:36.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.81e-06 2024-09-14T09:09:36.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972971+0000", 2024-09-14T09:09:36.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074871788999999994 2024-09-14T09:09:36.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973055+0000", 2024-09-14T09:09:36.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3980000000000006e-05 2024-09-14T09:09:36.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973298+0000", 2024-09-14T09:09:36.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024277700000000001 2024-09-14T09:09:36.567 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.568 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.568 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.568 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2505 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3096576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:36.568 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:36.568 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.623071873000001, 2024-09-14T09:09:36.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075506668999999998, 2024-09-14T09:09:36.568 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.568 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.568 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.568 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.568 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:36.568 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:36.569 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2505 2024-09-14T09:09:36.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.569 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:36.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:36.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898370+0000", 2024-09-14T09:09:36.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026128799999999998 2024-09-14T09:09:36.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898374+0000", 2024-09-14T09:09:36.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8070000000000001e-06 2024-09-14T09:09:36.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898383+0000", 2024-09-14T09:09:36.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0520000000000007e-06 2024-09-14T09:09:36.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898389+0000", 2024-09-14T09:09:36.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2639999999999997e-06 2024-09-14T09:09:36.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973330+0000", 2024-09-14T09:09:36.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074940548999999995 2024-09-14T09:09:36.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973402+0000", 2024-09-14T09:09:36.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2556000000000001e-05 2024-09-14T09:09:36.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973615+0000", 2024-09-14T09:09:36.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000213153 2024-09-14T09:09:36.572 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.572 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.572 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.572 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2506 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3158016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:36.572 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:36.573 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.622778629000003, 2024-09-14T09:09:36.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075556110999999995, 2024-09-14T09:09:36.573 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.573 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.573 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.573 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.573 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:36.573 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:36.573 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2506 2024-09-14T09:09:36.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.573 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:36.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:36.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898497+0000", 2024-09-14T09:09:36.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4806e-05 2024-09-14T09:09:36.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898500+0000", 2024-09-14T09:09:36.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.54e-06 2024-09-14T09:09:36.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898507+0000", 2024-09-14T09:09:36.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1590000000000004e-06 2024-09-14T09:09:36.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898513+0000", 2024-09-14T09:09:36.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.015e-06 2024-09-14T09:09:36.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973656+0000", 2024-09-14T09:09:36.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075142929999999997 2024-09-14T09:09:36.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973742+0000", 2024-09-14T09:09:36.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5535e-05 2024-09-14T09:09:36.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973958+0000", 2024-09-14T09:09:36.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000216126 2024-09-14T09:09:36.576 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.577 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.577 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.577 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2507 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3219456~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:36.577 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:36.577 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.622650045, 2024-09-14T09:09:36.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075623459000000004, 2024-09-14T09:09:36.577 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.577 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.577 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.577 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.577 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:36.577 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:36.577 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2507 2024-09-14T09:09:36.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.578 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:36.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:36.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898761+0000", 2024-09-14T09:09:36.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000230614 2024-09-14T09:09:36.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898765+0000", 2024-09-14T09:09:36.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6629999999999999e-06 2024-09-14T09:09:36.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898774+0000", 2024-09-14T09:09:36.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6749999999999997e-06 2024-09-14T09:09:36.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898781+0000", 2024-09-14T09:09:36.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4640000000000003e-06 2024-09-14T09:09:36.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973985+0000", 2024-09-14T09:09:36.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075204101999999995 2024-09-14T09:09:36.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974063+0000", 2024-09-14T09:09:36.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7632000000000005e-05 2024-09-14T09:09:36.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974154+0000", 2024-09-14T09:09:36.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1309000000000003e-05 2024-09-14T09:09:36.581 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.581 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.581 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.581 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2508 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3280896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:36.581 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:36.582 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.622388282000003, 2024-09-14T09:09:36.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075576943999999993, 2024-09-14T09:09:36.582 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.582 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.582 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.582 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.582 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:36.582 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:36.582 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2508 2024-09-14T09:09:36.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.582 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:36.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:36.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899176+0000", 2024-09-14T09:09:36.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038340500000000002 2024-09-14T09:09:36.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899179+0000", 2024-09-14T09:09:36.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0290000000000001e-06 2024-09-14T09:09:36.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899186+0000", 2024-09-14T09:09:36.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8199999999999999e-06 2024-09-14T09:09:36.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899190+0000", 2024-09-14T09:09:36.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2050000000000004e-06 2024-09-14T09:09:36.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974193+0000", 2024-09-14T09:09:36.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075003632000000001 2024-09-14T09:09:36.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974276+0000", 2024-09-14T09:09:36.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2272000000000001e-05 2024-09-14T09:09:36.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974369+0000", 2024-09-14T09:09:36.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3580999999999997e-05 2024-09-14T09:09:36.586 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.586 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.586 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.586 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2509 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3342336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:36.586 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:36.586 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.621980665000002, 2024-09-14T09:09:36.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075356229999999996, 2024-09-14T09:09:36.586 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.586 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.587 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.587 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.587 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:36.587 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:36.587 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2509 2024-09-14T09:09:36.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.587 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:36.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:36.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899439+0000", 2024-09-14T09:09:36.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023958599999999999 2024-09-14T09:09:36.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899444+0000", 2024-09-14T09:09:36.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8790000000000002e-06 2024-09-14T09:09:36.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899455+0000", 2024-09-14T09:09:36.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0597999999999999e-05 2024-09-14T09:09:36.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899462+0000", 2024-09-14T09:09:36.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8179999999999998e-06 2024-09-14T09:09:36.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974400+0000", 2024-09-14T09:09:36.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074937999000000005 2024-09-14T09:09:36.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974465+0000", 2024-09-14T09:09:36.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5134000000000004e-05 2024-09-14T09:09:36.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974556+0000", 2024-09-14T09:09:36.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1216000000000002e-05 2024-09-14T09:09:36.591 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.591 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.591 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.591 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2510 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3403776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:36.591 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:36.591 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.621705272, 2024-09-14T09:09:36.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075295775999999995, 2024-09-14T09:09:36.592 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.592 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.592 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.592 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.592 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:36.592 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:36.592 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2510 2024-09-14T09:09:36.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.592 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:36.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:36.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899691+0000", 2024-09-14T09:09:36.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021615999999999999 2024-09-14T09:09:36.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899696+0000", 2024-09-14T09:09:36.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3200000000000001e-06 2024-09-14T09:09:36.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899704+0000", 2024-09-14T09:09:36.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9440000000000005e-06 2024-09-14T09:09:36.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899710+0000", 2024-09-14T09:09:36.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.584e-06 2024-09-14T09:09:36.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974594+0000", 2024-09-14T09:09:36.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074883551000000007 2024-09-14T09:09:36.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974679+0000", 2024-09-14T09:09:36.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5365999999999995e-05 2024-09-14T09:09:36.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974771+0000", 2024-09-14T09:09:36.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1850999999999999e-05 2024-09-14T09:09:36.596 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.596 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.597 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.597 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2511 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3465216~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:36.597 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:36.597 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.621459053999999, 2024-09-14T09:09:36.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075234668000000005, 2024-09-14T09:09:36.597 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.597 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.597 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.597 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.598 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:36.598 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:36.598 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2511 2024-09-14T09:09:36.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.598 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:36.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:36.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899951+0000", 2024-09-14T09:09:36.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000229569 2024-09-14T09:09:36.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899955+0000", 2024-09-14T09:09:36.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1010000000000002e-06 2024-09-14T09:09:36.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899971+0000", 2024-09-14T09:09:36.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5648999999999999e-05 2024-09-14T09:09:36.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899978+0000", 2024-09-14T09:09:36.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0829999999999998e-06 2024-09-14T09:09:36.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974806+0000", 2024-09-14T09:09:36.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074828092999999998 2024-09-14T09:09:36.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974870+0000", 2024-09-14T09:09:36.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4492000000000005e-05 2024-09-14T09:09:36.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974956+0000", 2024-09-14T09:09:36.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5680999999999995e-05 2024-09-14T09:09:36.601 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.601 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.601 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.601 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2512 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3526656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:36.602 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:36.602 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.621191508999999, 2024-09-14T09:09:36.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075178812999999997, 2024-09-14T09:09:36.602 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.602 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.602 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.602 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.602 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:36.602 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:36.602 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2512 2024-09-14T09:09:36.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.602 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:36.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:36.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904181+0000", 2024-09-14T09:09:36.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041919399999999999 2024-09-14T09:09:36.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904186+0000", 2024-09-14T09:09:36.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2390000000000002e-06 2024-09-14T09:09:36.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904199+0000", 2024-09-14T09:09:36.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2709e-05 2024-09-14T09:09:36.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904207+0000", 2024-09-14T09:09:36.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8150000000000006e-06 2024-09-14T09:09:36.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975000+0000", 2024-09-14T09:09:36.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.070793444999999997 2024-09-14T09:09:36.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975079+0000", 2024-09-14T09:09:36.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8480999999999996e-05 2024-09-14T09:09:36.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975168+0000", 2024-09-14T09:09:36.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9184000000000005e-05 2024-09-14T09:09:36.606 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.606 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.606 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.606 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:22840 3.15 3:a8cf3dc2:::rbd_header.1112a10502fe:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:36.607 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:09:36.607 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 19.961618486999999, 2024-09-14T09:09:36.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.119998785, 2024-09-14T09:09:36.607 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.607 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.607 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.607 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.607 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:09:36.607 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:09:36.607 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 22840 2024-09-14T09:09:36.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.607 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:09:36.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:09:36.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642492+0000", 2024-09-14T09:09:36.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.082930276999999997 2024-09-14T09:09:36.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642495+0000", 2024-09-14T09:09:36.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9809999999999999e-06 2024-09-14T09:09:36.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642501+0000", 2024-09-14T09:09:36.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-09-14T09:09:36.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642506+0000", 2024-09-14T09:09:36.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6650000000000002e-06 2024-09-14T09:09:36.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679483+0000", 2024-09-14T09:09:36.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036977777000000003 2024-09-14T09:09:36.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679517+0000", 2024-09-14T09:09:36.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.345e-05 2024-09-14T09:09:36.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679561+0000", 2024-09-14T09:09:36.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3930999999999997e-05 2024-09-14T09:09:36.611 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.611 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.611 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.611 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:22857 3.15 3:a8cf3dc2:::rbd_header.1112a10502fe:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:36.611 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:09:36.611 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 19.811724561999998, 2024-09-14T09:09:36.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.088427917999999994, 2024-09-14T09:09:36.611 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:36.611 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:36.611 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:36.611 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:36.612 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:09:36.612 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:09:36.612 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 22857 2024-09-14T09:09:36.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.612 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:36.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:36.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:09:36.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:36.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:09:36.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:36.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:36.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777685+0000", 2024-09-14T09:09:36.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.068229181999999999 2024-09-14T09:09:36.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:36.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777688+0000", 2024-09-14T09:09:36.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1980000000000001e-06 2024-09-14T09:09:36.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:36.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777695+0000", 2024-09-14T09:09:36.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:09:36.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:36.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777700+0000", 2024-09-14T09:09:36.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0919999999999997e-06 2024-09-14T09:09:36.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:36.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797735+0000", 2024-09-14T09:09:36.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0200351 2024-09-14T09:09:36.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:36.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797800+0000", 2024-09-14T09:09:36.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4305000000000002e-05 2024-09-14T09:09:36.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:36.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:36.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:36.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797884+0000", 2024-09-14T09:09:36.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4344000000000004e-05 2024-09-14T09:09:36.615 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.615 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.615 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.615 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:36.615 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:36.615 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:36.617 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:09:36.618 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:36.619+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:36.717 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:36.719+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:36.720 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:36.720 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:36.720 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:09:36.720 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:36.729 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:09:36.781 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:09:36.818 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:36.820+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:36.874 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:36.874 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:36.874 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:36.874 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:36.874 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:36.883 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:09:36.918 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:36.921+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:36.934 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:36.934 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:36.951 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:36.951 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:36.971 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:09:36.972 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:09:36.990 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:36.990 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:36.993 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:36.994 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:37.003 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:09:37.007 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:37.007 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:37.025 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:37.025 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:37.039 INFO:teuthology.orchestra.run.smithi148.stdout:flattening image image_client.0-clone39 2024-09-14T09:09:37.047 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:37.049+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:37.108 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:37.108 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:37.116 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:09:37.120 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:37.122+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:37.221 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:37.222+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:37.261 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:37.261 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:37.269 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:09:37.323 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:37.325+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:37.377 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:37.377 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:37.381 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #38, image image_client.0-clone38 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent39 2024-09-14T09:09:37.386 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:09:37.424 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:37.425+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:37.432 INFO:teuthology.orchestra.run.smithi148.stdout:5930 trunc from 0x7af8e00 to 0x601a800 2024-09-14T09:09:37.452 INFO:teuthology.orchestra.run.smithi148.stdout:5931 read 0x1429600 thru 0x142ebca (0x55cb bytes) 2024-09-14T09:09:37.454 INFO:teuthology.orchestra.run.smithi148.stdout:5934 read 0x5ea8600 thru 0x5eae08f (0x5a90 bytes) 2024-09-14T09:09:37.454 INFO:teuthology.orchestra.run.smithi148.stdout:5935 punch from 0x2852200 to 0x2860a00, (0xe800 bytes) 2024-09-14T09:09:37.457 INFO:teuthology.orchestra.run.smithi148.stdout:5937 read 0x153600 thru 0x159de2 (0x67e3 bytes) 2024-09-14T09:09:37.464 INFO:teuthology.orchestra.run.smithi148.stdout:5941 trunc from 0x601a800 to 0xc0faa00 2024-09-14T09:09:37.474 INFO:teuthology.orchestra.run.smithi148.stdout:5942 write 0x177f800 thru 0x1784e29 (0x562a bytes) 2024-09-14T09:09:37.478 INFO:teuthology.orchestra.run.smithi148.stdout:5944 trunc from 0xc0faa00 to 0xec4d400 2024-09-14T09:09:37.495 INFO:teuthology.orchestra.run.smithi148.stdout:5945 write 0xe2dc00 thru 0xe332b2 (0x56b3 bytes) 2024-09-14T09:09:37.496 INFO:teuthology.orchestra.run.smithi148.stdout:5947 punch from 0x26f1e00 to 0x2701000, (0xf200 bytes) 2024-09-14T09:09:37.498 INFO:teuthology.orchestra.run.smithi148.stdout:5948 read 0x28a1e00 thru 0x28a4fa9 (0x31aa bytes) 2024-09-14T09:09:37.503 INFO:teuthology.orchestra.run.smithi148.stdout:5950 write 0x1429e00 thru 0x142e150 (0x4351 bytes) 2024-09-14T09:09:37.506 INFO:teuthology.orchestra.run.smithi148.stdout:5952 read 0xaa76000 thru 0xaa84737 (0xe738 bytes) 2024-09-14T09:09:37.506 INFO:teuthology.orchestra.run.smithi148.stdout:5955 read 0x3a3f200 thru 0x3a4674a (0x754b bytes) 2024-09-14T09:09:37.507 INFO:teuthology.orchestra.run.smithi148.stdout:5956 punch from 0x8000c00 to 0x8002000, (0x1400 bytes) 2024-09-14T09:09:37.507 INFO:teuthology.orchestra.run.smithi148.stdout:5961 read 0xe485200 thru 0xe492ec6 (0xdcc7 bytes) 2024-09-14T09:09:37.507 INFO:teuthology.orchestra.run.smithi148.stdout:5962 write 0x94f1e00 thru 0x94f49e9 (0x2bea bytes) 2024-09-14T09:09:37.507 INFO:teuthology.orchestra.run.smithi148.stdout:5965 punch from 0xa2c8600 to 0xa2cd800, (0x5200 bytes) 2024-09-14T09:09:37.507 INFO:teuthology.orchestra.run.smithi148.stdout:5968 write 0x1481e00 thru 0x148c213 (0xa414 bytes) 2024-09-14T09:09:37.508 INFO:teuthology.orchestra.run.smithi148.stdout:5969 punch from 0x268d800 to 0x269d600, (0xfe00 bytes) 2024-09-14T09:09:37.508 INFO:teuthology.orchestra.run.smithi148.stdout:5970 punch from 0x2833200 to 0x2840200, (0xd000 bytes) 2024-09-14T09:09:37.509 INFO:teuthology.orchestra.run.smithi148.stdout:5971 write 0x381be00 thru 0x381f4a4 (0x36a5 bytes) 2024-09-14T09:09:37.525 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:37.526+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:37.527 INFO:teuthology.orchestra.run.smithi148.stdout:5974 trunc from 0xec4d400 to 0x4e2f800 2024-09-14T09:09:37.555 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:37.555 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:37.564 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:09:37.569 INFO:teuthology.orchestra.run.smithi148.stdout:5975 trunc from 0x4e2f800 to 0x8584000 2024-09-14T09:09:37.582 INFO:teuthology.orchestra.run.smithi148.stdout:5977 trunc from 0x8584000 to 0x4bdf000 2024-09-14T09:09:37.594 INFO:teuthology.orchestra.run.smithi148.stdout:5979 punch from 0x3aa9200 to 0x3ab5600, (0xc400 bytes) 2024-09-14T09:09:37.599 INFO:teuthology.orchestra.run.smithi148.stdout:5980 write 0x1ae400 thru 0x1be041 (0xfc42 bytes) 2024-09-14T09:09:37.600 INFO:teuthology.orchestra.run.smithi148.stdout:5981 write 0x1a68e00 thru 0x1a78802 (0xfa03 bytes) 2024-09-14T09:09:37.600 INFO:teuthology.orchestra.run.smithi148.stdout:5984 read 0x4ac1400 thru 0x4ac4f77 (0x3b78 bytes) 2024-09-14T09:09:37.601 INFO:teuthology.orchestra.run.smithi148.stdout:5986 punch from 0x521400 to 0x522000, (0xc00 bytes) 2024-09-14T09:09:37.625 INFO:teuthology.orchestra.run.smithi148.stdout:5987 write 0xc811200 thru 0xc8141f1 (0x2ff2 bytes) 2024-09-14T09:09:37.625 INFO:teuthology.orchestra.run.smithi148.stdout:skipping zero length punch hole 2024-09-14T09:09:37.625 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:37.627+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:37.630 INFO:teuthology.orchestra.run.smithi148.stdout:5993 trunc from 0xc814200 to 0x7859a00 2024-09-14T09:09:37.653 INFO:teuthology.orchestra.run.smithi148.stdout:5994 read 0x41e3a00 thru 0x41f2207 (0xe808 bytes) 2024-09-14T09:09:37.653 INFO:teuthology.orchestra.run.smithi148.stdout:5995 clone 41 order 18 su 8192 sc 15 2024-09-14T09:09:37.674 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:37.674 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:37.682 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:09:37.726 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:37.728+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:37.825 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:37.825 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:37.826 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:37.828+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:37.834 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:09:37.928 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:37.929+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:37.936 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:37.936 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:37.945 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:37.973 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T09:09:38.028 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:38.029+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:38.034 INFO:teuthology.orchestra.run.smithi148.stdout:truncating image image_client.0-clone40 from 0x7859a00 (overlap 0x4bdf000) to 0x351c000 2024-09-14T09:09:38.057 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:38.057 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:38.066 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:09:38.130 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:38.131+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:38.170 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:38.170 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:38.179 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:09:38.231 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:38.233+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:38.289 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:38.289 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:38.298 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:09:38.312 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #39, image image_client.0-clone39 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent40 2024-09-14T09:09:38.342 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:38.344+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:38.406 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:38.406 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:38.415 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:09:38.456 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:38.457+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:38.533 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:38.535+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:38.560 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:38.560 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:38.569 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:09:38.634 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:38.635+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:38.671 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:38.671 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:38.680 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:09:38.694 INFO:teuthology.orchestra.run.smithi148.stdout:5996 trunc from 0x7859a00 to 0x2d08200 2024-09-14T09:09:38.720 INFO:teuthology.orchestra.run.smithi148.stdout:5997 punch from 0x2b02600 to 0x2b04c00, (0x2600 bytes) 2024-09-14T09:09:38.743 INFO:teuthology.orchestra.run.smithi148.stdout:6000 write 0x3f4a400 thru 0x3f58262 (0xde63 bytes) 2024-09-14T09:09:38.764 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:38.765+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:38.829 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:38.830 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:38.836 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:38.837+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:38.837 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:09:38.879 INFO:teuthology.orchestra.run.smithi148.stdout:checking clone #40, image image_client.0-clone40 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent41 2024-09-14T09:09:38.937 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:38.939+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:38.968 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is unset 2024-09-14T09:09:38.997 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:38.998 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:39.007 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:09:39.037 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:09:39.038 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:39.040+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:39.138 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:39.139+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:39.159 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:39.160 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:39.172 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:09:39.180 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:39.180 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:39.201 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:39.201 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:39.220 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:09:39.221 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:09:39.239 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:39.239 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:39.240+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:39.239 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:39.257 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:39.257 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:39.274 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:39.274 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:39.289 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:39.289 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:39.289 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:39.289 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:39.289 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:39.297 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:09:39.340 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:39.342+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:39.440 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:39.443+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:39.441 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:39.442 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:39.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:39.442 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:39.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.442 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:987 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:39.442 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:39.442 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.584691562000003, 2024-09-14T09:09:39.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001359466, 2024-09-14T09:09:39.442 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:39.442 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:39.442 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.442 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:39.443 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:39.443 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:39.443 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 987 2024-09-14T09:09:39.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.443 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:39.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:39.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:39.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:39.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:39.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:39.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858333+0000", 2024-09-14T09:09:39.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.621e-06 2024-09-14T09:09:39.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:39.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858349+0000", 2024-09-14T09:09:39.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5758000000000001e-05 2024-09-14T09:09:39.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:39.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858366+0000", 2024-09-14T09:09:39.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7368e-05 2024-09-14T09:09:39.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858382+0000", 2024-09-14T09:09:39.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6039e-05 2024-09-14T09:09:39.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858441+0000", 2024-09-14T09:09:39.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8662999999999997e-05 2024-09-14T09:09:39.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858449+0000", 2024-09-14T09:09:39.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3960000000000006e-06 2024-09-14T09:09:39.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859682+0000", 2024-09-14T09:09:39.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001233096 2024-09-14T09:09:39.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:39.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859691+0000", 2024-09-14T09:09:39.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5250000000000005e-06 2024-09-14T09:09:39.447 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.447 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:39.447 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.447 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:988 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:39.447 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:39.447 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.584563692000003, 2024-09-14T09:09:39.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0012656799999999, 2024-09-14T09:09:39.447 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:39.447 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:39.447 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.447 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:39.448 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:39.448 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:39.448 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 988 2024-09-14T09:09:39.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.448 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:39.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:39.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:39.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:39.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:39.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:39.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858460+0000", 2024-09-14T09:09:39.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9999999999999997e-07 2024-09-14T09:09:39.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:39.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858463+0000", 2024-09-14T09:09:39.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7459999999999998e-06 2024-09-14T09:09:39.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:39.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858471+0000", 2024-09-14T09:09:39.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3900000000000004e-06 2024-09-14T09:09:39.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858478+0000", 2024-09-14T09:09:39.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7020000000000004e-06 2024-09-14T09:09:39.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859102+0000", 2024-09-14T09:09:39.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062419699999999995 2024-09-14T09:09:39.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859109+0000", 2024-09-14T09:09:39.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7419999999999997e-06 2024-09-14T09:09:39.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859718+0000", 2024-09-14T09:09:39.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006085629999999 2024-09-14T09:09:39.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:39.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859725+0000", 2024-09-14T09:09:39.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7399999999999998e-06 2024-09-14T09:09:39.452 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.452 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:39.452 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.452 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1003 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:39.452 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:39.453 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.583700454999999, 2024-09-14T09:09:39.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009495209999999, 2024-09-14T09:09:39.453 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:39.453 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:39.453 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.453 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:39.453 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:39.453 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:39.453 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1003 2024-09-14T09:09:39.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.453 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:39.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:39.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:39.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:39.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:39.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:39.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859323+0000", 2024-09-14T09:09:39.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3099999999999998e-07 2024-09-14T09:09:39.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:39.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859326+0000", 2024-09-14T09:09:39.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-06 2024-09-14T09:09:39.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:39.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859333+0000", 2024-09-14T09:09:39.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3300000000000001e-06 2024-09-14T09:09:39.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859339+0000", 2024-09-14T09:09:39.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6400000000000002e-06 2024-09-14T09:09:39.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859387+0000", 2024-09-14T09:09:39.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8448000000000001e-05 2024-09-14T09:09:39.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:09:39.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9540000000000004e-06 2024-09-14T09:09:39.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860260+0000", 2024-09-14T09:09:39.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000864921 2024-09-14T09:09:39.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:39.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860272+0000", 2024-09-14T09:09:39.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1993e-05 2024-09-14T09:09:39.457 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.457 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:39.457 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.457 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1004 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:39.457 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:39.457 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.583664880000001, 2024-09-14T09:09:39.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000947875, 2024-09-14T09:09:39.458 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:39.458 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:39.458 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.458 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:39.458 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:39.458 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:39.458 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1004 2024-09-14T09:09:39.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.458 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:39.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:39.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:39.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:39.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:39.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:39.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:39.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7199999999999999e-07 2024-09-14T09:09:39.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:39.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859361+0000", 2024-09-14T09:09:39.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.892e-06 2024-09-14T09:09:39.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:39.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859368+0000", 2024-09-14T09:09:39.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4370000000000004e-06 2024-09-14T09:09:39.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859373+0000", 2024-09-14T09:09:39.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6690000000000003e-06 2024-09-14T09:09:39.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859430+0000", 2024-09-14T09:09:39.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6456999999999998e-05 2024-09-14T09:09:39.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859434+0000", 2024-09-14T09:09:39.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8410000000000002e-06 2024-09-14T09:09:39.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860299+0000", 2024-09-14T09:09:39.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008650370000001 2024-09-14T09:09:39.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:39.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860306+0000", 2024-09-14T09:09:39.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0700000000000001e-06 2024-09-14T09:09:39.462 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.462 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:39.462 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.462 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1005 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:39.462 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:39.462 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.583641206999999, 2024-09-14T09:09:39.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009585480000001, 2024-09-14T09:09:39.462 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:39.462 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:39.462 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.462 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:39.462 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:39.463 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:39.463 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1005 2024-09-14T09:09:39.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.463 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:39.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:39.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:39.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:39.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:39.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:39.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:39.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9700000000000002e-07 2024-09-14T09:09:39.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:39.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859384+0000", 2024-09-14T09:09:39.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.024e-06 2024-09-14T09:09:39.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:39.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859390+0000", 2024-09-14T09:09:39.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7080000000000002e-06 2024-09-14T09:09:39.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:09:39.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8980000000000004e-06 2024-09-14T09:09:39.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859527+0000", 2024-09-14T09:09:39.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013228099999999999 2024-09-14T09:09:39.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859532+0000", 2024-09-14T09:09:39.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5899999999999998e-06 2024-09-14T09:09:39.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860330+0000", 2024-09-14T09:09:39.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0007973509999999 2024-09-14T09:09:39.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:39.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860340+0000", 2024-09-14T09:09:39.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0299000000000001e-05 2024-09-14T09:09:39.466 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.466 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:39.466 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.467 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1006 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:39.467 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:39.467 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.583618010999999, 2024-09-14T09:09:39.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001032039, 2024-09-14T09:09:39.467 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:39.467 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:39.467 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.467 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:39.467 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:39.467 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:39.467 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1006 2024-09-14T09:09:39.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.467 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:39.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:39.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:39.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:39.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:39.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:39.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:39.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6499999999999999e-07 2024-09-14T09:09:39.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:39.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859407+0000", 2024-09-14T09:09:39.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1160000000000002e-06 2024-09-14T09:09:39.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:39.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859413+0000", 2024-09-14T09:09:39.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8880000000000002e-06 2024-09-14T09:09:39.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859419+0000", 2024-09-14T09:09:39.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3550000000000004e-06 2024-09-14T09:09:39.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859558+0000", 2024-09-14T09:09:39.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000138942 2024-09-14T09:09:39.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859563+0000", 2024-09-14T09:09:39.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.665e-06 2024-09-14T09:09:39.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860427+0000", 2024-09-14T09:09:39.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008635299999999 2024-09-14T09:09:39.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:39.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860437+0000", 2024-09-14T09:09:39.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0078000000000001e-05 2024-09-14T09:09:39.471 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.471 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:39.472 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.472 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1045 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:39.472 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:39.472 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.583418531, 2024-09-14T09:09:39.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008612990000001, 2024-09-14T09:09:39.472 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:39.472 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:39.472 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.472 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:39.472 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:39.472 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:39.472 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1045 2024-09-14T09:09:39.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.473 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:39.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:39.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:39.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:39.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:39.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:39.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859605+0000", 2024-09-14T09:09:39.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6e-07 2024-09-14T09:09:39.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:39.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859606+0000", 2024-09-14T09:09:39.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8819999999999999e-06 2024-09-14T09:09:39.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:39.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859610+0000", 2024-09-14T09:09:39.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4290000000000001e-06 2024-09-14T09:09:39.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859612+0000", 2024-09-14T09:09:39.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6309999999999999e-06 2024-09-14T09:09:39.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859643+0000", 2024-09-14T09:09:39.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0224000000000001e-05 2024-09-14T09:09:39.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859647+0000", 2024-09-14T09:09:39.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9049999999999999e-06 2024-09-14T09:09:39.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860458+0000", 2024-09-14T09:09:39.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008111180000001 2024-09-14T09:09:39.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:39.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860466+0000", 2024-09-14T09:09:39.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:09:39.476 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.476 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:39.476 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.477 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1046 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:39.477 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:39.477 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.583405073999998, 2024-09-14T09:09:39.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000874262, 2024-09-14T09:09:39.477 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:39.477 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:39.477 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.477 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:39.477 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:39.477 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:39.477 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1046 2024-09-14T09:09:39.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.477 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:39.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:39.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:39.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:39.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:39.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:39.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:39.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:09:39.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:39.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859619+0000", 2024-09-14T09:09:39.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0559999999999999e-06 2024-09-14T09:09:39.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:39.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859622+0000", 2024-09-14T09:09:39.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0170000000000001e-06 2024-09-14T09:09:39.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859625+0000", 2024-09-14T09:09:39.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7209999999999999e-06 2024-09-14T09:09:39.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859666+0000", 2024-09-14T09:09:39.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1677000000000001e-05 2024-09-14T09:09:39.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859672+0000", 2024-09-14T09:09:39.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4609999999999999e-06 2024-09-14T09:09:39.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860485+0000", 2024-09-14T09:09:39.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000813505 2024-09-14T09:09:39.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:39.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860492+0000", 2024-09-14T09:09:39.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6159999999999998e-06 2024-09-14T09:09:39.481 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.481 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:39.481 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.482 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1047 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:39.482 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:39.482 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.583393739999998, 2024-09-14T09:09:39.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008950190000001, 2024-09-14T09:09:39.482 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:39.482 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:39.482 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.482 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:39.482 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:39.482 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:39.482 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1047 2024-09-14T09:09:39.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.482 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:39.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:39.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:39.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:39.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:39.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:39.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:39.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6600000000000003e-07 2024-09-14T09:09:39.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:39.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859631+0000", 2024-09-14T09:09:39.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5600000000000001e-06 2024-09-14T09:09:39.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:39.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859637+0000", 2024-09-14T09:09:39.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7309999999999998e-06 2024-09-14T09:09:39.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859641+0000", 2024-09-14T09:09:39.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0840000000000002e-06 2024-09-14T09:09:39.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859691+0000", 2024-09-14T09:09:39.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0587999999999997e-05 2024-09-14T09:09:39.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859696+0000", 2024-09-14T09:09:39.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8940000000000001e-06 2024-09-14T09:09:39.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860516+0000", 2024-09-14T09:09:39.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008200780000001 2024-09-14T09:09:39.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:39.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860524+0000", 2024-09-14T09:09:39.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8180000000000004e-06 2024-09-14T09:09:39.486 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.486 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:39.486 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.486 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1048 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:39.486 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:39.487 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.583361981000003, 2024-09-14T09:09:39.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008904780000001, 2024-09-14T09:09:39.487 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:39.487 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:39.487 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.487 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:39.487 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:39.487 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:39.487 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1048 2024-09-14T09:09:39.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.487 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:39.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:39.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:39.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:39.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:39.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:39.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:39.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4700000000000002e-07 2024-09-14T09:09:39.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:39.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859663+0000", 2024-09-14T09:09:39.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0420000000000001e-06 2024-09-14T09:09:39.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:39.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859669+0000", 2024-09-14T09:09:39.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8989999999999998e-06 2024-09-14T09:09:39.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859673+0000", 2024-09-14T09:09:39.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2209999999999999e-06 2024-09-14T09:09:39.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859719+0000", 2024-09-14T09:09:39.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5788000000000003e-05 2024-09-14T09:09:39.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859725+0000", 2024-09-14T09:09:39.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4770000000000002e-06 2024-09-14T09:09:39.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860544+0000", 2024-09-14T09:09:39.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008194669999999 2024-09-14T09:09:39.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:39.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860551+0000", 2024-09-14T09:09:39.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1369999999999996e-06 2024-09-14T09:09:39.491 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.491 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:39.491 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.491 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1088 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:39.491 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:39.491 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.583143143999997, 2024-09-14T09:09:39.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00073166, 2024-09-14T09:09:39.492 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:39.492 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:39.492 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.492 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:39.492 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:39.492 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:39.492 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1088 2024-09-14T09:09:39.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.492 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:39.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:39.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:39.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:39.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:39.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:39.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:39.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3700000000000001e-07 2024-09-14T09:09:39.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:39.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859882+0000", 2024-09-14T09:09:39.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.739e-06 2024-09-14T09:09:39.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:39.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859887+0000", 2024-09-14T09:09:39.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:09:39.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859892+0000", 2024-09-14T09:09:39.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7119999999999999e-06 2024-09-14T09:09:39.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859945+0000", 2024-09-14T09:09:39.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2762000000000001e-05 2024-09-14T09:09:39.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859950+0000", 2024-09-14T09:09:39.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-09-14T09:09:39.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860603+0000", 2024-09-14T09:09:39.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000653263 2024-09-14T09:09:39.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:39.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860611+0000", 2024-09-14T09:09:39.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-09-14T09:09:39.497 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.497 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:39.497 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.497 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1089 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:39.497 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:39.497 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.583124988000002, 2024-09-14T09:09:39.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000733943, 2024-09-14T09:09:39.497 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:39.497 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:39.497 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.497 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:39.498 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:39.498 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:39.498 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1089 2024-09-14T09:09:39.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.498 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:39.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:39.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:39.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:39.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:39.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:39.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:39.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3000000000000002e-07 2024-09-14T09:09:39.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:39.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859900+0000", 2024-09-14T09:09:39.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9199999999999998e-06 2024-09-14T09:09:39.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:39.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859906+0000", 2024-09-14T09:09:39.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0889999999999996e-06 2024-09-14T09:09:39.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859911+0000", 2024-09-14T09:09:39.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6419999999999998e-06 2024-09-14T09:09:39.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860010+0000", 2024-09-14T09:09:39.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8956000000000006e-05 2024-09-14T09:09:39.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860014+0000", 2024-09-14T09:09:39.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.741e-06 2024-09-14T09:09:39.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860627+0000", 2024-09-14T09:09:39.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00061277 2024-09-14T09:09:39.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:39.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860632+0000", 2024-09-14T09:09:39.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:09:39.502 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.502 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:39.502 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.502 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1090 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:39.502 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:39.502 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.583105316000001, 2024-09-14T09:09:39.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000740763, 2024-09-14T09:09:39.502 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:39.502 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:39.502 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.502 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:39.502 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:39.503 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:39.503 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1090 2024-09-14T09:09:39.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.503 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:39.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:39.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:39.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:39.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:39.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:39.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859918+0000", 2024-09-14T09:09:39.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5199999999999998e-07 2024-09-14T09:09:39.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:39.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859920+0000", 2024-09-14T09:09:39.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9240000000000001e-06 2024-09-14T09:09:39.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:39.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859925+0000", 2024-09-14T09:09:39.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3929999999999999e-06 2024-09-14T09:09:39.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859929+0000", 2024-09-14T09:09:39.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4769999999999999e-06 2024-09-14T09:09:39.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860034+0000", 2024-09-14T09:09:39.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010549500000000001 2024-09-14T09:09:39.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860039+0000", 2024-09-14T09:09:39.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5700000000000003e-06 2024-09-14T09:09:39.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860650+0000", 2024-09-14T09:09:39.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006116119999999 2024-09-14T09:09:39.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:39.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860658+0000", 2024-09-14T09:09:39.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:09:39.506 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.506 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:39.506 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.507 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60374 3.14 3.6e2cd654 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:39.507 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:39.507 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.953227005999999, 2024-09-14T09:09:39.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3129433100000001, 2024-09-14T09:09:39.507 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:39.507 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:39.507 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.507 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:39.507 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:39.507 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:39.507 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60374 2024-09-14T09:09:39.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.508 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:39.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:39.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:39.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:39.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:39.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:39.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:39.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2100000000000002e-07 2024-09-14T09:09:39.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:39.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489799+0000", 2024-09-14T09:09:39.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3530000000000002e-06 2024-09-14T09:09:39.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:39.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489808+0000", 2024-09-14T09:09:39.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2e-06 2024-09-14T09:09:39.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489813+0000", 2024-09-14T09:09:39.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3249999999999998e-06 2024-09-14T09:09:39.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489866+0000", 2024-09-14T09:09:39.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3074e-05 2024-09-14T09:09:39.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489875+0000", 2024-09-14T09:09:39.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2760000000000006e-06 2024-09-14T09:09:39.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801379+0000", 2024-09-14T09:09:39.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.31150346200000001 2024-09-14T09:09:39.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801387+0000", 2024-09-14T09:09:39.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.038e-06 2024-09-14T09:09:39.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802728+0000", 2024-09-14T09:09:39.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013415569999999 2024-09-14T09:09:39.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:39.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802739+0000", 2024-09-14T09:09:39.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0604e-05 2024-09-14T09:09:39.512 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.512 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:39.512 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.512 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62179 3.14 3.78cf1974 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:39.512 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:09:39.512 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.953196377000001, 2024-09-14T09:09:39.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3129429109999999, 2024-09-14T09:09:39.513 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:39.513 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:39.513 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.513 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:39.513 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:39.513 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:39.513 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62179 2024-09-14T09:09:39.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.513 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:39.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:09:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:09:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489827+0000", 2024-09-14T09:09:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4300000000000003e-07 2024-09-14T09:09:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:39.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489829+0000", 2024-09-14T09:09:39.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2129999999999998e-06 2024-09-14T09:09:39.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:39.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489836+0000", 2024-09-14T09:09:39.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0360000000000001e-06 2024-09-14T09:09:39.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489841+0000", 2024-09-14T09:09:39.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0710000000000002e-06 2024-09-14T09:09:39.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489905+0000", 2024-09-14T09:09:39.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3578999999999996e-05 2024-09-14T09:09:39.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489913+0000", 2024-09-14T09:09:39.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2269999999999993e-06 2024-09-14T09:09:39.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801412+0000", 2024-09-14T09:09:39.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.311498989 2024-09-14T09:09:39.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801419+0000", 2024-09-14T09:09:39.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1400000000000002e-06 2024-09-14T09:09:39.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802761+0000", 2024-09-14T09:09:39.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013414620000001 2024-09-14T09:09:39.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:39.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802769+0000", 2024-09-14T09:09:39.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6510000000000007e-06 2024-09-14T09:09:39.518 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.518 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:39.518 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.519 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63551 3.14 3.88ccb734 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:39.519 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:09:39.519 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.953164746999999, 2024-09-14T09:09:39.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.312941181, 2024-09-14T09:09:39.519 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:39.519 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:39.519 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.519 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:39.519 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:39.519 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:39.519 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63551 2024-09-14T09:09:39.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.519 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:39.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:09:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:09:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489859+0000", 2024-09-14T09:09:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9200000000000001e-07 2024-09-14T09:09:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:39.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489862+0000", 2024-09-14T09:09:39.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9629999999999998e-06 2024-09-14T09:09:39.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:39.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489868+0000", 2024-09-14T09:09:39.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3890000000000002e-06 2024-09-14T09:09:39.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489875+0000", 2024-09-14T09:09:39.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7950000000000002e-06 2024-09-14T09:09:39.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489939+0000", 2024-09-14T09:09:39.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4704999999999998e-05 2024-09-14T09:09:39.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489949+0000", 2024-09-14T09:09:39.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7799999999999995e-06 2024-09-14T09:09:39.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801447+0000", 2024-09-14T09:09:39.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.311497527 2024-09-14T09:09:39.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801454+0000", 2024-09-14T09:09:39.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1080000000000004e-06 2024-09-14T09:09:39.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802790+0000", 2024-09-14T09:09:39.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013364330000001 2024-09-14T09:09:39.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:39.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802799+0000", 2024-09-14T09:09:39.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8890000000000008e-06 2024-09-14T09:09:39.524 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.524 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:39.524 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.524 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:68716 3.14 3.96fe1934 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:39.524 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:09:39.524 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.901594280000001, 2024-09-14T09:09:39.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2614012569999999, 2024-09-14T09:09:39.525 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:39.525 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:39.525 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:39.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:39.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:39.525 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 68716 2024-09-14T09:09:39.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.525 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:39.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:39.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:09:39.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:39.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:09:39.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:39.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541429+0000", 2024-09-14T09:09:39.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8899999999999998e-07 2024-09-14T09:09:39.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541433+0000", 2024-09-14T09:09:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7330000000000001e-06 2024-09-14T09:09:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541442+0000", 2024-09-14T09:09:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.346e-06 2024-09-14T09:09:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541449+0000", 2024-09-14T09:09:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.579e-06 2024-09-14T09:09:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541839+0000", 2024-09-14T09:09:39.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038993699999999998 2024-09-14T09:09:39.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541849+0000", 2024-09-14T09:09:39.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0217999999999999e-05 2024-09-14T09:09:39.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801480+0000", 2024-09-14T09:09:39.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.25963061399999998 2024-09-14T09:09:39.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801486+0000", 2024-09-14T09:09:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.776e-06 2024-09-14T09:09:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802821+0000", 2024-09-14T09:09:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00133435 2024-09-14T09:09:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802830+0000", 2024-09-14T09:09:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9150000000000002e-06 2024-09-14T09:09:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.530 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:69492 3.14 3.4a93714 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:39.530 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:09:39.530 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.841054583999998, 2024-09-14T09:09:39.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2008910690000001, 2024-09-14T09:09:39.530 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:39.530 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:39.530 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.531 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:39.531 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:39.531 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:39.531 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 69492 2024-09-14T09:09:39.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.531 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:39.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:39.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:09:39.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:39.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:09:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601969+0000", 2024-09-14T09:09:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3099999999999996e-07 2024-09-14T09:09:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601973+0000", 2024-09-14T09:09:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5899999999999999e-06 2024-09-14T09:09:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:39.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601983+0000", 2024-09-14T09:09:39.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098999999999999e-05 2024-09-14T09:09:39.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601989+0000", 2024-09-14T09:09:39.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0209999999999996e-06 2024-09-14T09:09:39.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.602066+0000", 2024-09-14T09:09:39.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7075000000000003e-05 2024-09-14T09:09:39.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.602075+0000", 2024-09-14T09:09:39.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8389999999999996e-06 2024-09-14T09:09:39.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801512+0000", 2024-09-14T09:09:39.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.199437225 2024-09-14T09:09:39.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801519+0000", 2024-09-14T09:09:39.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9970000000000001e-06 2024-09-14T09:09:39.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802851+0000", 2024-09-14T09:09:39.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001331711 2024-09-14T09:09:39.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:39.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802859+0000", 2024-09-14T09:09:39.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6810000000000004e-06 2024-09-14T09:09:39.535 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.535 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:39.536 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.536 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:72035 3.14 3.1cba9a34 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:39.536 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:09:39.536 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.721726696000001, 2024-09-14T09:09:39.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0815917340000001, 2024-09-14T09:09:39.536 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:39.536 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:39.536 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:39.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:39.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:39.537 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 72035 2024-09-14T09:09:39.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.537 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:39.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:39.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:09:39.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:39.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:09:39.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:39.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721297+0000", 2024-09-14T09:09:39.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5199999999999996e-07 2024-09-14T09:09:39.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:39.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721301+0000", 2024-09-14T09:09:39.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7790000000000002e-06 2024-09-14T09:09:39.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:39.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721309+0000", 2024-09-14T09:09:39.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8019999999999998e-06 2024-09-14T09:09:39.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721315+0000", 2024-09-14T09:09:39.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:09:39.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721367+0000", 2024-09-14T09:09:39.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2280000000000001e-05 2024-09-14T09:09:39.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721376+0000", 2024-09-14T09:09:39.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5439999999999999e-06 2024-09-14T09:09:39.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801545+0000", 2024-09-14T09:09:39.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.080169952000000003 2024-09-14T09:09:39.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801552+0000", 2024-09-14T09:09:39.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8390000000000001e-06 2024-09-14T09:09:39.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802879+0000", 2024-09-14T09:09:39.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001326846 2024-09-14T09:09:39.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:39.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802888+0000", 2024-09-14T09:09:39.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6330000000000002e-06 2024-09-14T09:09:39.542 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.542 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:39.542 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.542 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73403 3.14 3.87b99f94 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:39.542 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:39.542 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.679452035000001, 2024-09-14T09:09:39.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0393459899999999, 2024-09-14T09:09:39.543 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:39.543 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:39.543 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.543 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:39.543 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:39.543 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:39.543 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73403 2024-09-14T09:09:39.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.543 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:39.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:39.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:39.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:39.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:39.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:39.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:39.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:39.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9200000000000001e-07 2024-09-14T09:09:39.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:39.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763574+0000", 2024-09-14T09:09:39.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6510000000000001e-06 2024-09-14T09:09:39.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:39.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763582+0000", 2024-09-14T09:09:39.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2579999999999995e-06 2024-09-14T09:09:39.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763592+0000", 2024-09-14T09:09:39.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0193e-05 2024-09-14T09:09:39.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763643+0000", 2024-09-14T09:09:39.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0862000000000002e-05 2024-09-14T09:09:39.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763654+0000", 2024-09-14T09:09:39.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0890000000000001e-05 2024-09-14T09:09:39.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801577+0000", 2024-09-14T09:09:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037923074000000001 2024-09-14T09:09:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801584+0000", 2024-09-14T09:09:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0060000000000003e-06 2024-09-14T09:09:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802908+0000", 2024-09-14T09:09:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013235149999999 2024-09-14T09:09:39.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:39.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:39.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:39.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802917+0000", 2024-09-14T09:09:39.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9490000000000002e-06 2024-09-14T09:09:39.548 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.548 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:39.548 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.548 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:39.548 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:39.548 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:39.550 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:09:39.550 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:39.551+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:39.651 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:39.652+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:39.654 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:39.654 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:39.654 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:09:39.654 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:39.662 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:09:39.752 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:39.753+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:39.764 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:39.764 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:39.764 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:39.764 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:39.764 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:39.772 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:09:39.852 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:39.854+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:39.877 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:39.877 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:39.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:39.878 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:39.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.878 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:249 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1638400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:39.878 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:39.878 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.081965972999996, 2024-09-14T09:09:39.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99070346899999995, 2024-09-14T09:09:39.878 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:39.878 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:39.878 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:39.878 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:39.878 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:39.878 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:39.878 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 249 2024-09-14T09:09:39.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.879 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:39.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:39.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:39.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:39.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:39.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:39.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796868+0000", 2024-09-14T09:09:39.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2024-09-14T09:09:39.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:39.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796870+0000", 2024-09-14T09:09:39.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7889999999999999e-06 2024-09-14T09:09:39.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:39.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796877+0000", 2024-09-14T09:09:39.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8549999999999996e-06 2024-09-14T09:09:39.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796883+0000", 2024-09-14T09:09:39.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.665e-06 2024-09-14T09:09:39.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796915+0000", 2024-09-14T09:09:39.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2215999999999998e-05 2024-09-14T09:09:39.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796920+0000", 2024-09-14T09:09:39.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.527e-06 2024-09-14T09:09:39.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787468+0000", 2024-09-14T09:09:39.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99054877100000005 2024-09-14T09:09:39.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:39.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787512+0000", 2024-09-14T09:09:39.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3958000000000002e-05 2024-09-14T09:09:39.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:39.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787571+0000", 2024-09-14T09:09:39.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8167000000000001e-05 2024-09-14T09:09:39.882 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.882 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:39.883 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.883 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:250 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2097152~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:39.883 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:39.883 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.081939907000006, 2024-09-14T09:09:39.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99079431100000004, 2024-09-14T09:09:39.883 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:39.883 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:39.883 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:39.883 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:39.883 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:39.884 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:39.884 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 250 2024-09-14T09:09:39.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.884 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:39.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:39.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:39.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:39.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:39.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:39.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796894+0000", 2024-09-14T09:09:39.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2024-09-14T09:09:39.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:39.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796896+0000", 2024-09-14T09:09:39.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5600000000000001e-06 2024-09-14T09:09:39.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:39.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796902+0000", 2024-09-14T09:09:39.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3090000000000001e-06 2024-09-14T09:09:39.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796909+0000", 2024-09-14T09:09:39.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:09:39.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796942+0000", 2024-09-14T09:09:39.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-05 2024-09-14T09:09:39.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796948+0000", 2024-09-14T09:09:39.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5910000000000001e-06 2024-09-14T09:09:39.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787596+0000", 2024-09-14T09:09:39.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99064781400000002 2024-09-14T09:09:39.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:39.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787636+0000", 2024-09-14T09:09:39.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9715000000000002e-05 2024-09-14T09:09:39.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:39.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787687+0000", 2024-09-14T09:09:39.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1674e-05 2024-09-14T09:09:39.888 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.888 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:39.888 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.889 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:251 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:39.889 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:39.889 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.081914471999994, 2024-09-14T09:09:39.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99091769600000001, 2024-09-14T09:09:39.889 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:39.889 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:39.889 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:39.889 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:39.889 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:39.889 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:39.889 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 251 2024-09-14T09:09:39.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.890 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:39.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:39.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:39.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:39.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:39.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:39.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:39.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000005e-07 2024-09-14T09:09:39.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:39.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796922+0000", 2024-09-14T09:09:39.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.875e-06 2024-09-14T09:09:39.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:39.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796929+0000", 2024-09-14T09:09:39.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0260000000000002e-06 2024-09-14T09:09:39.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796935+0000", 2024-09-14T09:09:39.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7030000000000003e-06 2024-09-14T09:09:39.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796963+0000", 2024-09-14T09:09:39.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8368999999999999e-05 2024-09-14T09:09:39.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796966+0000", 2024-09-14T09:09:39.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4130000000000002e-06 2024-09-14T09:09:39.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787718+0000", 2024-09-14T09:09:39.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99075151100000003 2024-09-14T09:09:39.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:39.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787779+0000", 2024-09-14T09:09:39.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.088e-05 2024-09-14T09:09:39.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:39.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787836+0000", 2024-09-14T09:09:39.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7380000000000003e-05 2024-09-14T09:09:39.895 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.895 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:39.895 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.896 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:252 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:39.896 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:39.896 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.081889017999998, 2024-09-14T09:09:39.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99102491400000003, 2024-09-14T09:09:39.896 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:39.896 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:39.896 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:39.896 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:39.897 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:39.897 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:39.897 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 252 2024-09-14T09:09:39.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.897 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:39.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:39.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:39.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:39.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:39.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:39.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796945+0000", 2024-09-14T09:09:39.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2900000000000003e-07 2024-09-14T09:09:39.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:39.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796947+0000", 2024-09-14T09:09:39.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4279999999999999e-06 2024-09-14T09:09:39.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:39.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796954+0000", 2024-09-14T09:09:39.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5479999999999998e-06 2024-09-14T09:09:39.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796959+0000", 2024-09-14T09:09:39.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.22e-06 2024-09-14T09:09:39.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796988+0000", 2024-09-14T09:09:39.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9473000000000001e-05 2024-09-14T09:09:39.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:39.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:09:39.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787850+0000", 2024-09-14T09:09:39.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99085651100000005 2024-09-14T09:09:39.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:39.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787891+0000", 2024-09-14T09:09:39.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602000000000002e-05 2024-09-14T09:09:39.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:39.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787969+0000", 2024-09-14T09:09:39.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8063000000000001e-05 2024-09-14T09:09:39.901 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.901 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:39.902 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.902 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:253 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:39.902 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:39.902 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.081865137999998, 2024-09-14T09:09:39.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99122695699999996, 2024-09-14T09:09:39.902 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:39.902 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:39.902 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:39.902 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:39.902 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:39.902 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:39.903 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 253 2024-09-14T09:09:39.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.903 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:39.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:39.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:39.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:39.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:39.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:39.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:39.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:09:39.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:39.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:09:39.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:09:39.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:39.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796977+0000", 2024-09-14T09:09:39.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5030000000000002e-06 2024-09-14T09:09:39.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796982+0000", 2024-09-14T09:09:39.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2024-09-14T09:09:39.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797013+0000", 2024-09-14T09:09:39.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0451e-05 2024-09-14T09:09:39.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:09:39.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1690000000000001e-06 2024-09-14T09:09:39.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788011+0000", 2024-09-14T09:09:39.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99099490300000004 2024-09-14T09:09:39.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:39.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788102+0000", 2024-09-14T09:09:39.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0730999999999996e-05 2024-09-14T09:09:39.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:39.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788195+0000", 2024-09-14T09:09:39.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3245999999999995e-05 2024-09-14T09:09:39.907 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.907 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:39.907 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.907 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:254 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3932160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:39.907 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:39.907 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.081833579999994, 2024-09-14T09:09:39.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99137410500000001, 2024-09-14T09:09:39.908 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:39.908 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:39.908 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:39.908 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:39.908 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:39.909 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:39.909 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 254 2024-09-14T09:09:39.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.909 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:39.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:39.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:39.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:39.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:39.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:39.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797000+0000", 2024-09-14T09:09:39.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:09:39.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:39.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797003+0000", 2024-09-14T09:09:39.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7659999999999999e-06 2024-09-14T09:09:39.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:39.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797010+0000", 2024-09-14T09:09:39.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.029e-06 2024-09-14T09:09:39.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:39.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2024-09-14T09:09:39.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797044+0000", 2024-09-14T09:09:39.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9213e-05 2024-09-14T09:09:39.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797048+0000", 2024-09-14T09:09:39.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3400000000000002e-06 2024-09-14T09:09:39.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788222+0000", 2024-09-14T09:09:39.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99117407400000002 2024-09-14T09:09:39.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:39.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788306+0000", 2024-09-14T09:09:39.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4512999999999995e-05 2024-09-14T09:09:39.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:39.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788374+0000", 2024-09-14T09:09:39.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7226999999999999e-05 2024-09-14T09:09:39.914 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.914 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:39.914 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.914 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:264 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:39.914 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:39.915 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.081807221999995, 2024-09-14T09:09:39.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99161474699999996, 2024-09-14T09:09:39.915 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:39.915 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:39.915 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:39.915 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:39.916 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:39.916 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:39.916 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 264 2024-09-14T09:09:39.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.916 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:39.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:39.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:39.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:39.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:39.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:39.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:39.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2024-09-14T09:09:39.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:39.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:09:39.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2800000000000002e-06 2024-09-14T09:09:39.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:39.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:39.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0979999999999999e-06 2024-09-14T09:09:39.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797040+0000", 2024-09-14T09:09:39.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:09:39.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797068+0000", 2024-09-14T09:09:39.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7302999999999999e-05 2024-09-14T09:09:39.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797071+0000", 2024-09-14T09:09:39.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3610000000000001e-06 2024-09-14T09:09:39.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788436+0000", 2024-09-14T09:09:39.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99136489500000002 2024-09-14T09:09:39.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:39.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788538+0000", 2024-09-14T09:09:39.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101931 2024-09-14T09:09:39.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:39.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788641+0000", 2024-09-14T09:09:39.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010273899999999999 2024-09-14T09:09:39.923 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.924 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:39.924 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.924 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:265 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:39.924 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:39.924 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.081783862999998, 2024-09-14T09:09:39.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99176878199999996, 2024-09-14T09:09:39.924 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:39.924 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:39.924 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:39.924 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:39.925 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:39.925 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:39.925 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 265 2024-09-14T09:09:39.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.925 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:39.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:39.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:39.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:39.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:39.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:39.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:09:39.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.39e-07 2024-09-14T09:09:39.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:39.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797052+0000", 2024-09-14T09:09:39.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.345e-06 2024-09-14T09:09:39.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:39.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797058+0000", 2024-09-14T09:09:39.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5429999999999999e-06 2024-09-14T09:09:39.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797064+0000", 2024-09-14T09:09:39.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2000000000000002e-06 2024-09-14T09:09:39.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797091+0000", 2024-09-14T09:09:39.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7804e-05 2024-09-14T09:09:39.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797095+0000", 2024-09-14T09:09:39.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2024-09-14T09:09:39.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788667+0000", 2024-09-14T09:09:39.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157211300000003 2024-09-14T09:09:39.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:39.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788742+0000", 2024-09-14T09:09:39.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5159000000000003e-05 2024-09-14T09:09:39.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:39.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788818+0000", 2024-09-14T09:09:39.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6038000000000006e-05 2024-09-14T09:09:39.929 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.929 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:39.929 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.930 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:266 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:39.930 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:39.930 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.081761032000003, 2024-09-14T09:09:39.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99193390100000001, 2024-09-14T09:09:39.930 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:39.930 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:39.930 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:39.930 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:39.930 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:39.930 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:39.931 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 266 2024-09-14T09:09:39.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.931 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:39.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:39.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:39.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:39.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:39.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:39.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:39.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:09:39.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:39.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797075+0000", 2024-09-14T09:09:39.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2570000000000002e-06 2024-09-14T09:09:39.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:39.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797082+0000", 2024-09-14T09:09:39.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8029999999999997e-06 2024-09-14T09:09:39.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797088+0000", 2024-09-14T09:09:39.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.468e-06 2024-09-14T09:09:39.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797116+0000", 2024-09-14T09:09:39.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7752000000000001e-05 2024-09-14T09:09:39.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797121+0000", 2024-09-14T09:09:39.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5960000000000003e-06 2024-09-14T09:09:39.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788846+0000", 2024-09-14T09:09:39.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99172512199999996 2024-09-14T09:09:39.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:39.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788916+0000", 2024-09-14T09:09:39.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9843000000000002e-05 2024-09-14T09:09:39.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:39.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789006+0000", 2024-09-14T09:09:39.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9608e-05 2024-09-14T09:09:39.936 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.936 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:39.936 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.936 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:267 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:39.936 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:39.936 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.081736225, 2024-09-14T09:09:39.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99210926799999999, 2024-09-14T09:09:39.937 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:39.937 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:39.937 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:39.937 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:39.937 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:39.937 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:39.937 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 267 2024-09-14T09:09:39.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.937 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:39.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:39.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:39.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:39.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:39.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:39.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:39.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2399999999999999e-07 2024-09-14T09:09:39.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:39.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797099+0000", 2024-09-14T09:09:39.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.091e-06 2024-09-14T09:09:39.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:39.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797105+0000", 2024-09-14T09:09:39.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-09-14T09:09:39.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797111+0000", 2024-09-14T09:09:39.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5130000000000004e-06 2024-09-14T09:09:39.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797140+0000", 2024-09-14T09:09:39.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9513999999999999e-05 2024-09-14T09:09:39.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797145+0000", 2024-09-14T09:09:39.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:09:39.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789037+0000", 2024-09-14T09:09:39.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99189253899999996 2024-09-14T09:09:39.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:39.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789110+0000", 2024-09-14T09:09:39.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2848000000000005e-05 2024-09-14T09:09:39.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:39.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789206+0000", 2024-09-14T09:09:39.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5778000000000004e-05 2024-09-14T09:09:39.942 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.942 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:39.942 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.942 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:268 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:39.942 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:39.942 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.081712985999999, 2024-09-14T09:09:39.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992276359, 2024-09-14T09:09:39.942 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:39.942 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:39.942 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:39.942 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:39.943 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:39.943 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:39.943 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 268 2024-09-14T09:09:39.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.943 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:39.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:39.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:39.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:39.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:39.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:39.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:39.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:09:39.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:39.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797123+0000", 2024-09-14T09:09:39.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2740000000000002e-06 2024-09-14T09:09:39.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:39.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797129+0000", 2024-09-14T09:09:39.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-06 2024-09-14T09:09:39.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797134+0000", 2024-09-14T09:09:39.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9099999999999996e-06 2024-09-14T09:09:39.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797163+0000", 2024-09-14T09:09:39.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9709999999999998e-05 2024-09-14T09:09:39.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:39.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8709999999999999e-06 2024-09-14T09:09:39.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789231+0000", 2024-09-14T09:09:39.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992063959 2024-09-14T09:09:39.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:39.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789306+0000", 2024-09-14T09:09:39.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5289000000000004e-05 2024-09-14T09:09:39.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:39.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789396+0000", 2024-09-14T09:09:39.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9939999999999996e-05 2024-09-14T09:09:39.947 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.947 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:39.947 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.947 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:269 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2457600~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:39.947 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:39.947 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.081689476999998, 2024-09-14T09:09:39.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99242174400000005, 2024-09-14T09:09:39.947 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:39.947 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:39.948 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:39.948 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:39.948 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:39.948 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:39.948 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 269 2024-09-14T09:09:39.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.948 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:39.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:39.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:39.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:39.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:39.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:39.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:39.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:09:39.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:39.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797146+0000", 2024-09-14T09:09:39.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5289999999999998e-06 2024-09-14T09:09:39.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:39.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797153+0000", 2024-09-14T09:09:39.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1920000000000002e-06 2024-09-14T09:09:39.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797158+0000", 2024-09-14T09:09:39.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099999999999998e-06 2024-09-14T09:09:39.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797188+0000", 2024-09-14T09:09:39.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0128e-05 2024-09-14T09:09:39.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797194+0000", 2024-09-14T09:09:39.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6250000000000004e-06 2024-09-14T09:09:39.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789439+0000", 2024-09-14T09:09:39.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99224531000000005 2024-09-14T09:09:39.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:39.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789489+0000", 2024-09-14T09:09:39.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9830000000000002e-05 2024-09-14T09:09:39.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:39.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789565+0000", 2024-09-14T09:09:39.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6229000000000005e-05 2024-09-14T09:09:39.953 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.953 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:39.953 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.953 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:270 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:39.953 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:39.954 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.081665654999995, 2024-09-14T09:09:39.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99257721899999996, 2024-09-14T09:09:39.954 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:39.954 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:39.954 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:39.954 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:39.954 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:39.954 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:39.954 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 270 2024-09-14T09:09:39.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.955 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:39.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:39.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:39.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:39.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:39.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:39.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797168+0000", 2024-09-14T09:09:39.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2024-09-14T09:09:39.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:39.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797170+0000", 2024-09-14T09:09:39.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3120000000000001e-06 2024-09-14T09:09:39.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:39.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797177+0000", 2024-09-14T09:09:39.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0960000000000003e-06 2024-09-14T09:09:39.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797183+0000", 2024-09-14T09:09:39.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1669999999999998e-06 2024-09-14T09:09:39.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797213+0000", 2024-09-14T09:09:39.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0494e-05 2024-09-14T09:09:39.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:09:39.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:09:39.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789586+0000", 2024-09-14T09:09:39.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99236692100000001 2024-09-14T09:09:39.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:39.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789658+0000", 2024-09-14T09:09:39.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2279000000000004e-05 2024-09-14T09:09:39.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:39.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789745+0000", 2024-09-14T09:09:39.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6698000000000002e-05 2024-09-14T09:09:39.959 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.959 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:39.959 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.959 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:271 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3375104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:39.959 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:39.959 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.081640457000006, 2024-09-14T09:09:39.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99274791699999998, 2024-09-14T09:09:39.959 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:39.959 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:39.959 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:39.959 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:39.960 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:39.960 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:39.960 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 271 2024-09-14T09:09:39.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.960 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:39.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:39.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:39.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:39.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:39.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:39.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:39.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:09:39.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:39.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797195+0000", 2024-09-14T09:09:39.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1639999999999999e-06 2024-09-14T09:09:39.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:39.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797201+0000", 2024-09-14T09:09:39.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1290000000000001e-06 2024-09-14T09:09:39.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797206+0000", 2024-09-14T09:09:39.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9300000000000002e-06 2024-09-14T09:09:39.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797237+0000", 2024-09-14T09:09:39.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1285000000000003e-05 2024-09-14T09:09:39.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797242+0000", 2024-09-14T09:09:39.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6e-06 2024-09-14T09:09:39.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789768+0000", 2024-09-14T09:09:39.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99252547400000002 2024-09-14T09:09:39.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:39.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789826+0000", 2024-09-14T09:09:39.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8155999999999997e-05 2024-09-14T09:09:39.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:39.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789940+0000", 2024-09-14T09:09:39.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114788 2024-09-14T09:09:39.964 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.964 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:39.964 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.964 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:272 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:39.964 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:39.964 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.081617062999996, 2024-09-14T09:09:39.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99285248800000003, 2024-09-14T09:09:39.964 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:39.965 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:39.965 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:39.965 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:39.965 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:39.965 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:39.965 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 272 2024-09-14T09:09:39.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.965 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:39.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:39.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:39.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:39.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:39.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:39.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:39.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:09:39.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:39.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:09:39.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5129999999999999e-06 2024-09-14T09:09:39.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:39.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797226+0000", 2024-09-14T09:09:39.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4529999999999996e-06 2024-09-14T09:09:39.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797232+0000", 2024-09-14T09:09:39.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1839999999999998e-06 2024-09-14T09:09:39.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797264+0000", 2024-09-14T09:09:39.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2691999999999998e-05 2024-09-14T09:09:39.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797270+0000", 2024-09-14T09:09:39.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-06 2024-09-14T09:09:39.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789965+0000", 2024-09-14T09:09:39.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99269526200000002 2024-09-14T09:09:39.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:39.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790021+0000", 2024-09-14T09:09:39.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5297000000000003e-05 2024-09-14T09:09:39.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:39.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790068+0000", 2024-09-14T09:09:39.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7664999999999998e-05 2024-09-14T09:09:39.969 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.969 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:39.969 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.969 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:39.969 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:09:39.969 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.091360615999999, 2024-09-14T09:09:39.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146649299999999, 2024-09-14T09:09:39.970 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:39.970 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:39.970 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.970 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:39.970 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:39.970 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:39.970 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 58987 2024-09-14T09:09:39.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.970 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:39.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:39.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:09:39.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:39.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:09:39.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:39.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787474+0000", 2024-09-14T09:09:39.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1799999999999999e-06 2024-09-14T09:09:39.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:39.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787483+0000", 2024-09-14T09:09:39.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9830000000000002e-06 2024-09-14T09:09:39.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:39.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787494+0000", 2024-09-14T09:09:39.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1496e-05 2024-09-14T09:09:39.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787502+0000", 2024-09-14T09:09:39.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8280000000000003e-06 2024-09-14T09:09:39.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787563+0000", 2024-09-14T09:09:39.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1583999999999999e-05 2024-09-14T09:09:39.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:09:39.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787571+0000", 2024-09-14T09:09:39.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.058e-06 2024-09-14T09:09:39.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.791999+0000", 2024-09-14T09:09:39.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004428675 2024-09-14T09:09:39.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792008+0000", 2024-09-14T09:09:39.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9069999999999996e-06 2024-09-14T09:09:39.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802124+0000", 2024-09-14T09:09:39.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0101154619999999 2024-09-14T09:09:39.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:39.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802137+0000", 2024-09-14T09:09:39.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3757000000000001e-05 2024-09-14T09:09:39.974 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.974 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:39.974 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.975 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:67110 3.5 3.6b6808c5 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:39.975 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:09:39.975 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.091227800999999, 2024-09-14T09:09:39.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0147494290000001, 2024-09-14T09:09:39.975 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:39.975 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:39.975 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:39.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:39.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:39.975 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 67110 2024-09-14T09:09:39.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.976 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:39.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:39.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:09:39.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:39.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:09:39.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:39.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787606+0000", 2024-09-14T09:09:39.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6300000000000005e-07 2024-09-14T09:09:39.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:39.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787609+0000", 2024-09-14T09:09:39.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2789999999999999e-06 2024-09-14T09:09:39.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:39.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787616+0000", 2024-09-14T09:09:39.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8349999999999998e-06 2024-09-14T09:09:39.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787622+0000", 2024-09-14T09:09:39.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6999999999999996e-06 2024-09-14T09:09:39.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787666+0000", 2024-09-14T09:09:39.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3887000000000002e-05 2024-09-14T09:09:39.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:39.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787672+0000", 2024-09-14T09:09:39.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-09-14T09:09:39.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792033+0000", 2024-09-14T09:09:39.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043614250000000004 2024-09-14T09:09:39.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792041+0000", 2024-09-14T09:09:39.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5449999999999998e-06 2024-09-14T09:09:39.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:09:39.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0103013569999999 2024-09-14T09:09:39.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:39.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802355+0000", 2024-09-14T09:09:39.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2717999999999999e-05 2024-09-14T09:09:39.980 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.980 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:39.980 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.980 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72029 3.5 3.3f02ac5 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:39.980 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:39.980 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.091150286000001, 2024-09-14T09:09:39.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.014715139, 2024-09-14T09:09:39.981 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:39.981 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:39.981 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.981 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:39.981 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:39.981 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:39.981 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72029 2024-09-14T09:09:39.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.981 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:39.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:39.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:39.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:39.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:39.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:39.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:39.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7599999999999997e-07 2024-09-14T09:09:39.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:39.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787686+0000", 2024-09-14T09:09:39.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3999999999999999e-06 2024-09-14T09:09:39.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:39.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787692+0000", 2024-09-14T09:09:39.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3489999999999997e-06 2024-09-14T09:09:39.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787697+0000", 2024-09-14T09:09:39.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2320000000000001e-06 2024-09-14T09:09:39.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787742+0000", 2024-09-14T09:09:39.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4557e-05 2024-09-14T09:09:39.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:39.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787748+0000", 2024-09-14T09:09:39.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7810000000000002e-06 2024-09-14T09:09:39.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792065+0000", 2024-09-14T09:09:39.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043178679999999999 2024-09-14T09:09:39.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792073+0000", 2024-09-14T09:09:39.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6329999999999996e-06 2024-09-14T09:09:39.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802388+0000", 2024-09-14T09:09:39.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010315394 2024-09-14T09:09:39.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:39.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802398+0000", 2024-09-14T09:09:39.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4490000000000005e-06 2024-09-14T09:09:39.985 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.985 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:39.986 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.986 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72038 3.5 3.c914e45 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:39.986 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:39.986 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.091074653, 2024-09-14T09:09:39.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146757740000001, 2024-09-14T09:09:39.986 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:39.986 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:39.986 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.986 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:39.986 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:39.986 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:39.986 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72038 2024-09-14T09:09:39.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.987 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:39.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:39.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:39.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:39.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:39.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:39.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787759+0000", 2024-09-14T09:09:39.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0100000000000005e-07 2024-09-14T09:09:39.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:39.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787761+0000", 2024-09-14T09:09:39.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4049999999999998e-06 2024-09-14T09:09:39.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:39.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787768+0000", 2024-09-14T09:09:39.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.314e-06 2024-09-14T09:09:39.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787773+0000", 2024-09-14T09:09:39.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2789999999999998e-06 2024-09-14T09:09:39.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787813+0000", 2024-09-14T09:09:39.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9582000000000002e-05 2024-09-14T09:09:39.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:39.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787818+0000", 2024-09-14T09:09:39.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7100000000000004e-06 2024-09-14T09:09:39.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792096+0000", 2024-09-14T09:09:39.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042776460000000004 2024-09-14T09:09:39.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792103+0000", 2024-09-14T09:09:39.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7129999999999999e-06 2024-09-14T09:09:39.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802427+0000", 2024-09-14T09:09:39.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010324805 2024-09-14T09:09:39.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:39.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802434+0000", 2024-09-14T09:09:39.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:09:39.992 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.992 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:39.992 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.992 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:74840 3.5 3.ab2c8d25 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:39.992 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:09:39.992 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.069022768, 2024-09-14T09:09:39.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99271963600000002, 2024-09-14T09:09:39.992 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:39.992 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:39.992 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:39.992 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:39.992 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:39.992 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:39.993 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74840 2024-09-14T09:09:39.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.993 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:39.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:39.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:09:39.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:39.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:09:39.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:39.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:39.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809812+0000", 2024-09-14T09:09:39.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2899999999999999e-06 2024-09-14T09:09:39.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:39.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809817+0000", 2024-09-14T09:09:39.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0139999999999998e-06 2024-09-14T09:09:39.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:39.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809834+0000", 2024-09-14T09:09:39.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7643e-05 2024-09-14T09:09:39.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:39.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809842+0000", 2024-09-14T09:09:39.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2970000000000004e-06 2024-09-14T09:09:39.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809902+0000", 2024-09-14T09:09:39.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9106e-05 2024-09-14T09:09:39.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:39.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809912+0000", 2024-09-14T09:09:39.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0101e-05 2024-09-14T09:09:39.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:39.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802520+0000", 2024-09-14T09:09:39.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99260828599999995 2024-09-14T09:09:39.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:39.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:39.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:39.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802530+0000", 2024-09-14T09:09:39.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8989999999999996e-06 2024-09-14T09:09:39.996 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.996 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:39.996 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.996 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:39.996 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:39.996 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:39.998 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:39.999+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:39.998 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:09:40.099 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:40.101+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:40.107 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:40.107 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:40.107 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:09:40.107 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:40.116 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:09:40.200 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:40.202+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:40.219 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:40.219 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:40.219 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:40.219 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:40.220 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:40.228 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:09:40.301 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:40.303+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:40.333 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:40.334 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:40.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:40.334 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:40.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.334 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5349 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8302592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:40.334 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:40.334 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.079070659999999, 2024-09-14T09:09:40.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039875928999999997, 2024-09-14T09:09:40.334 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.334 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.334 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.334 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.335 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:40.335 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:40.335 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5349 2024-09-14T09:09:40.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.335 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:40.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:40.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255874+0000", 2024-09-14T09:09:40.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4900000000000001e-07 2024-09-14T09:09:40.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255880+0000", 2024-09-14T09:09:40.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9939999999999997e-06 2024-09-14T09:09:40.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255886+0000", 2024-09-14T09:09:40.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3899999999999998e-06 2024-09-14T09:09:40.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255891+0000", 2024-09-14T09:09:40.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.938e-06 2024-09-14T09:09:40.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295580+0000", 2024-09-14T09:09:40.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039688681000000003 2024-09-14T09:09:40.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295653+0000", 2024-09-14T09:09:40.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3045000000000003e-05 2024-09-14T09:09:40.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295749+0000", 2024-09-14T09:09:40.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6532000000000003e-05 2024-09-14T09:09:40.338 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.338 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.338 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.338 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5350 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8364032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:40.339 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:40.339 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.079046853000001, 2024-09-14T09:09:40.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039989719, 2024-09-14T09:09:40.339 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.339 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.339 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:40.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:40.339 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5350 2024-09-14T09:09:40.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.339 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:40.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:40.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255898+0000", 2024-09-14T09:09:40.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2024-09-14T09:09:40.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255899+0000", 2024-09-14T09:09:40.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9139999999999998e-06 2024-09-14T09:09:40.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255905+0000", 2024-09-14T09:09:40.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7289999999999997e-06 2024-09-14T09:09:40.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255910+0000", 2024-09-14T09:09:40.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6210000000000003e-06 2024-09-14T09:09:40.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295775+0000", 2024-09-14T09:09:40.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039864973999999997 2024-09-14T09:09:40.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295828+0000", 2024-09-14T09:09:40.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3411000000000001e-05 2024-09-14T09:09:40.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295887+0000", 2024-09-14T09:09:40.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699000000000002e-05 2024-09-14T09:09:40.343 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.343 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.343 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.344 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4639 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1843200~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:40.344 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:40.344 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 42.135131393999998, 2024-09-14T09:09:40.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040843672999999997, 2024-09-14T09:09:40.344 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.344 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.344 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.344 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.344 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:40.344 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:40.344 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4639 2024-09-14T09:09:40.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.344 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:40.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:40.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:40.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:09:40.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199818+0000", 2024-09-14T09:09:40.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1450000000000001e-06 2024-09-14T09:09:40.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199827+0000", 2024-09-14T09:09:40.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3999999999999998e-06 2024-09-14T09:09:40.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199834+0000", 2024-09-14T09:09:40.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0809999999999996e-06 2024-09-14T09:09:40.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240541+0000", 2024-09-14T09:09:40.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040706941000000003 2024-09-14T09:09:40.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240584+0000", 2024-09-14T09:09:40.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3040999999999997e-05 2024-09-14T09:09:40.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240656+0000", 2024-09-14T09:09:40.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2200000000000007e-05 2024-09-14T09:09:40.347 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.348 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.348 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.348 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4640 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1871872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:40.348 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:40.348 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 42.135096908999998, 2024-09-14T09:09:40.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040967601999999999, 2024-09-14T09:09:40.348 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.348 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.348 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.348 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.348 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:40.348 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:40.349 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4640 2024-09-14T09:09:40.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.349 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:40.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:40.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199848+0000", 2024-09-14T09:09:40.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5400000000000002e-07 2024-09-14T09:09:40.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199850+0000", 2024-09-14T09:09:40.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2479999999999999e-06 2024-09-14T09:09:40.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199857+0000", 2024-09-14T09:09:40.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.187e-06 2024-09-14T09:09:40.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199862+0000", 2024-09-14T09:09:40.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5119999999999999e-06 2024-09-14T09:09:40.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240684+0000", 2024-09-14T09:09:40.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040821245999999999 2024-09-14T09:09:40.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240739+0000", 2024-09-14T09:09:40.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4991999999999998e-05 2024-09-14T09:09:40.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240815+0000", 2024-09-14T09:09:40.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5963000000000004e-05 2024-09-14T09:09:40.352 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.352 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.352 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.353 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4641 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1900544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:40.353 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:40.353 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 42.135074578999998, 2024-09-14T09:09:40.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041205512, 2024-09-14T09:09:40.353 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.353 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.353 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.353 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.353 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:40.353 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:40.353 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4641 2024-09-14T09:09:40.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.354 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:40.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:40.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199870+0000", 2024-09-14T09:09:40.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0600000000000001e-07 2024-09-14T09:09:40.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199872+0000", 2024-09-14T09:09:40.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.928e-06 2024-09-14T09:09:40.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199877+0000", 2024-09-14T09:09:40.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6949999999999997e-06 2024-09-14T09:09:40.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199882+0000", 2024-09-14T09:09:40.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8210000000000001e-06 2024-09-14T09:09:40.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240847+0000", 2024-09-14T09:09:40.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040965201999999999 2024-09-14T09:09:40.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240888+0000", 2024-09-14T09:09:40.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0754000000000003e-05 2024-09-14T09:09:40.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241075+0000", 2024-09-14T09:09:40.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000186706 2024-09-14T09:09:40.357 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.357 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.357 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.358 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4642 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1929216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:40.358 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:40.358 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 42.135055643999998, 2024-09-14T09:09:40.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041292575999999998, 2024-09-14T09:09:40.358 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.358 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.358 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.358 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.358 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:40.358 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:40.358 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4642 2024-09-14T09:09:40.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.359 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:40.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:40.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199889+0000", 2024-09-14T09:09:40.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2024-09-14T09:09:40.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199891+0000", 2024-09-14T09:09:40.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9e-06 2024-09-14T09:09:40.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199896+0000", 2024-09-14T09:09:40.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6960000000000002e-06 2024-09-14T09:09:40.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199901+0000", 2024-09-14T09:09:40.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6720000000000003e-06 2024-09-14T09:09:40.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241089+0000", 2024-09-14T09:09:40.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041187594000000001 2024-09-14T09:09:40.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241126+0000", 2024-09-14T09:09:40.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7490999999999997e-05 2024-09-14T09:09:40.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241181+0000", 2024-09-14T09:09:40.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4823e-05 2024-09-14T09:09:40.362 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.362 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.362 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.362 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4643 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1957888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:40.362 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:40.362 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 42.135036364999998, 2024-09-14T09:09:40.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041418333000000002, 2024-09-14T09:09:40.362 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.362 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.362 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:40.363 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:40.363 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4643 2024-09-14T09:09:40.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.363 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:40.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:40.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:40.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5699999999999998e-07 2024-09-14T09:09:40.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199910+0000", 2024-09-14T09:09:40.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.829e-06 2024-09-14T09:09:40.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199916+0000", 2024-09-14T09:09:40.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8499999999999999e-06 2024-09-14T09:09:40.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199920+0000", 2024-09-14T09:09:40.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6530000000000002e-06 2024-09-14T09:09:40.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241211+0000", 2024-09-14T09:09:40.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041290327000000002 2024-09-14T09:09:40.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241257+0000", 2024-09-14T09:09:40.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6347000000000002e-05 2024-09-14T09:09:40.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241326+0000", 2024-09-14T09:09:40.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8969999999999999e-05 2024-09-14T09:09:40.366 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.366 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.366 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.366 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4644 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1986560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:40.366 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:40.367 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 42.135018025000001, 2024-09-14T09:09:40.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041596269999999998, 2024-09-14T09:09:40.367 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.367 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.367 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:40.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:40.367 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4644 2024-09-14T09:09:40.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.367 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:40.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:40.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:40.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.41e-07 2024-09-14T09:09:40.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199928+0000", 2024-09-14T09:09:40.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8250000000000001e-06 2024-09-14T09:09:40.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199934+0000", 2024-09-14T09:09:40.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2280000000000003e-06 2024-09-14T09:09:40.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199939+0000", 2024-09-14T09:09:40.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8010000000000003e-06 2024-09-14T09:09:40.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241360+0000", 2024-09-14T09:09:40.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041421289 2024-09-14T09:09:40.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241435+0000", 2024-09-14T09:09:40.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4238000000000003e-05 2024-09-14T09:09:40.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241522+0000", 2024-09-14T09:09:40.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7547999999999996e-05 2024-09-14T09:09:40.370 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.370 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.371 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4645 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:40.371 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:40.371 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 42.134999118000003, 2024-09-14T09:09:40.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041714660000000001, 2024-09-14T09:09:40.371 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.371 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.371 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:40.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:40.371 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4645 2024-09-14T09:09:40.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.372 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:40.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:40.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:40.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4700000000000002e-07 2024-09-14T09:09:40.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199947+0000", 2024-09-14T09:09:40.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.801e-06 2024-09-14T09:09:40.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199953+0000", 2024-09-14T09:09:40.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.694e-06 2024-09-14T09:09:40.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199957+0000", 2024-09-14T09:09:40.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3069999999999996e-06 2024-09-14T09:09:40.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241547+0000", 2024-09-14T09:09:40.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041589895000000002 2024-09-14T09:09:40.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241590+0000", 2024-09-14T09:09:40.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2985000000000003e-05 2024-09-14T09:09:40.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241660+0000", 2024-09-14T09:09:40.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9630999999999998e-05 2024-09-14T09:09:40.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.375 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.375 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4646 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2043904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:40.375 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:40.375 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 42.13498113, 2024-09-14T09:09:40.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041827171000000003, 2024-09-14T09:09:40.375 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.376 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.376 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:40.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:40.376 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4646 2024-09-14T09:09:40.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.376 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:40.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:40.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:40.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6300000000000001e-07 2024-09-14T09:09:40.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199965+0000", 2024-09-14T09:09:40.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.035e-06 2024-09-14T09:09:40.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199973+0000", 2024-09-14T09:09:40.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9629999999999998e-06 2024-09-14T09:09:40.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199978+0000", 2024-09-14T09:09:40.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9069999999999998e-06 2024-09-14T09:09:40.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241677+0000", 2024-09-14T09:09:40.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041698662999999997 2024-09-14T09:09:40.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241717+0000", 2024-09-14T09:09:40.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602999999999997e-05 2024-09-14T09:09:40.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241790+0000", 2024-09-14T09:09:40.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2637000000000003e-05 2024-09-14T09:09:40.380 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.380 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.380 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.380 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4647 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2072576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:40.380 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:40.380 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 42.13495254, 2024-09-14T09:09:40.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041921189999999997, 2024-09-14T09:09:40.381 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.381 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.381 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.381 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.381 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:40.381 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:40.381 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4647 2024-09-14T09:09:40.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.381 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:40.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:40.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199992+0000", 2024-09-14T09:09:40.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3799999999999997e-07 2024-09-14T09:09:40.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199994+0000", 2024-09-14T09:09:40.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3020000000000002e-06 2024-09-14T09:09:40.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200004+0000", 2024-09-14T09:09:40.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3510000000000008e-06 2024-09-14T09:09:40.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200008+0000", 2024-09-14T09:09:40.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3329999999999998e-06 2024-09-14T09:09:40.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241814+0000", 2024-09-14T09:09:40.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041806280000000001 2024-09-14T09:09:40.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241855+0000", 2024-09-14T09:09:40.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0173999999999999e-05 2024-09-14T09:09:40.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241913+0000", 2024-09-14T09:09:40.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8112000000000002e-05 2024-09-14T09:09:40.386 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.386 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.386 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.386 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:59017 3.3 3:c1df81d6:::rbd_data.1112a10502fe.0000000000000189:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:40.386 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:09:40.387 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.547661939000001, 2024-09-14T09:09:40.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.024252111, 2024-09-14T09:09:40.387 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.387 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.387 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.387 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.387 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:40.387 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:40.387 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59017 2024-09-14T09:09:40.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.387 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:09:40.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:09:40.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787284+0000", 2024-09-14T09:09:40.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3879999999999998e-06 2024-09-14T09:09:40.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787297+0000", 2024-09-14T09:09:40.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2184999999999999e-05 2024-09-14T09:09:40.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787317+0000", 2024-09-14T09:09:40.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0054000000000001e-05 2024-09-14T09:09:40.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787327+0000", 2024-09-14T09:09:40.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0335e-05 2024-09-14T09:09:40.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787412+0000", 2024-09-14T09:09:40.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4691000000000006e-05 2024-09-14T09:09:40.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:09:40.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787422+0000", 2024-09-14T09:09:40.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0718e-05 2024-09-14T09:09:40.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790539+0000", 2024-09-14T09:09:40.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031164600000000002 2024-09-14T09:09:40.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790552+0000", 2024-09-14T09:09:40.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2736e-05 2024-09-14T09:09:40.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.798725+0000", 2024-09-14T09:09:40.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0081731860000001 2024-09-14T09:09:40.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.798824+0000", 2024-09-14T09:09:40.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9600999999999997e-05 2024-09-14T09:09:40.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.811534+0000", 2024-09-14T09:09:40.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012709757 2024-09-14T09:09:40.392 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.392 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.392 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.393 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:63586 3.3 3:c0d9272b:::rbd_data.1112a10502fe.00000000000001a2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:40.393 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:40.393 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.547590456000002, 2024-09-14T09:09:40.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0244069650000001, 2024-09-14T09:09:40.393 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.393 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.393 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:40.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:40.393 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 63586 2024-09-14T09:09:40.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.393 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:40.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:40.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:40.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2024-09-14T09:09:40.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787357+0000", 2024-09-14T09:09:40.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8720000000000002e-06 2024-09-14T09:09:40.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787365+0000", 2024-09-14T09:09:40.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9270000000000005e-06 2024-09-14T09:09:40.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787372+0000", 2024-09-14T09:09:40.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6810000000000001e-06 2024-09-14T09:09:40.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787479+0000", 2024-09-14T09:09:40.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010736800000000001 2024-09-14T09:09:40.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:40.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787485+0000", 2024-09-14T09:09:40.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.054e-06 2024-09-14T09:09:40.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790580+0000", 2024-09-14T09:09:40.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030949929999999999 2024-09-14T09:09:40.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790589+0000", 2024-09-14T09:09:40.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7600000000000008e-06 2024-09-14T09:09:40.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.799541+0000", 2024-09-14T09:09:40.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0089520110000001 2024-09-14T09:09:40.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.799620+0000", 2024-09-14T09:09:40.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8969999999999998e-05 2024-09-14T09:09:40.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.811760+0000", 2024-09-14T09:09:40.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012140748999999999 2024-09-14T09:09:40.398 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.398 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.398 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.398 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:65817 3.3 3:c2c49fe0:::rbd_data.1112a10502fe.00000000000001b3:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:40.398 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:09:40.398 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.547500654, 2024-09-14T09:09:40.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0253660200000001, 2024-09-14T09:09:40.399 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.399 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.399 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:40.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:40.399 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 65817 2024-09-14T09:09:40.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.399 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:09:40.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:09:40.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787444+0000", 2024-09-14T09:09:40.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999995e-07 2024-09-14T09:09:40.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787448+0000", 2024-09-14T09:09:40.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1420000000000003e-06 2024-09-14T09:09:40.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787497+0000", 2024-09-14T09:09:40.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8507999999999997e-05 2024-09-14T09:09:40.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787503+0000", 2024-09-14T09:09:40.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1319999999999999e-06 2024-09-14T09:09:40.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787595+0000", 2024-09-14T09:09:40.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1748000000000003e-05 2024-09-14T09:09:40.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:40.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787601+0000", 2024-09-14T09:09:40.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6150000000000002e-06 2024-09-14T09:09:40.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790613+0000", 2024-09-14T09:09:40.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003012228 2024-09-14T09:09:40.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790621+0000", 2024-09-14T09:09:40.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9219999999999997e-06 2024-09-14T09:09:40.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800130+0000", 2024-09-14T09:09:40.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.009508474 2024-09-14T09:09:40.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800257+0000", 2024-09-14T09:09:40.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012746900000000001 2024-09-14T09:09:40.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.812809+0000", 2024-09-14T09:09:40.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012552054 2024-09-14T09:09:40.405 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.405 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.405 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.405 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:68709 3.3 3:c4996abd:::rbd_data.1112a10502fe.00000000000001cd:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:40.405 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:09:40.405 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.547329707999999, 2024-09-14T09:09:40.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0254506109999999, 2024-09-14T09:09:40.405 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.405 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.405 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.406 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.406 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:40.406 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:40.406 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 68709 2024-09-14T09:09:40.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.406 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:09:40.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:09:40.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787615+0000", 2024-09-14T09:09:40.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4000000000000001e-07 2024-09-14T09:09:40.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787618+0000", 2024-09-14T09:09:40.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2780000000000002e-06 2024-09-14T09:09:40.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787626+0000", 2024-09-14T09:09:40.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0250000000000002e-06 2024-09-14T09:09:40.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787633+0000", 2024-09-14T09:09:40.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5660000000000003e-06 2024-09-14T09:09:40.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787714+0000", 2024-09-14T09:09:40.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1695999999999998e-05 2024-09-14T09:09:40.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:40.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787721+0000", 2024-09-14T09:09:40.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1109999999999996e-06 2024-09-14T09:09:40.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790646+0000", 2024-09-14T09:09:40.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029251730000000001 2024-09-14T09:09:40.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790653+0000", 2024-09-14T09:09:40.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4379999999999998e-06 2024-09-14T09:09:40.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800750+0000", 2024-09-14T09:09:40.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010097236 2024-09-14T09:09:40.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800883+0000", 2024-09-14T09:09:40.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000132466 2024-09-14T09:09:40.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813065+0000", 2024-09-14T09:09:40.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012181981999999999 2024-09-14T09:09:40.411 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.411 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.411 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.411 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:74823 3.3 3:c59acf89:::rbd_data.1112a10502fe.00000000000001fb:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:40.411 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:09:40.411 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.526495235999999, 2024-09-14T09:09:40.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.004859323, 2024-09-14T09:09:40.411 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.411 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.411 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.412 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.412 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:40.412 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:40.412 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74823 2024-09-14T09:09:40.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.412 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:09:40.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:09:40.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808450+0000", 2024-09-14T09:09:40.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.92e-07 2024-09-14T09:09:40.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808454+0000", 2024-09-14T09:09:40.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3660000000000002e-06 2024-09-14T09:09:40.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808463+0000", 2024-09-14T09:09:40.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1579999999999994e-06 2024-09-14T09:09:40.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808470+0000", 2024-09-14T09:09:40.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7599999999999997e-06 2024-09-14T09:09:40.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808540+0000", 2024-09-14T09:09:40.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9991000000000001e-05 2024-09-14T09:09:40.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808550+0000", 2024-09-14T09:09:40.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0282000000000001e-05 2024-09-14T09:09:40.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801352+0000", 2024-09-14T09:09:40.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99280192700000003 2024-09-14T09:09:40.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801472+0000", 2024-09-14T09:09:40.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120184 2024-09-14T09:09:40.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813308+0000", 2024-09-14T09:09:40.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011835863 2024-09-14T09:09:40.417 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.417 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.417 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.417 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:86789 3.3 3:c3063f19:::rbd_data.1112a10502fe.000000000000023a:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:40.417 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:09:40.417 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.754272511, 2024-09-14T09:09:40.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.23302192099999999, 2024-09-14T09:09:40.418 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.418 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.418 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.418 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.418 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:40.418 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:40.418 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86789 2024-09-14T09:09:40.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.418 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:09:40.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:09:40.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580672+0000", 2024-09-14T09:09:40.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7999999999999993e-07 2024-09-14T09:09:40.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580680+0000", 2024-09-14T09:09:40.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7540000000000006e-06 2024-09-14T09:09:40.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580694+0000", 2024-09-14T09:09:40.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3344e-05 2024-09-14T09:09:40.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580702+0000", 2024-09-14T09:09:40.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9510000000000006e-06 2024-09-14T09:09:40.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580778+0000", 2024-09-14T09:09:40.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6580000000000002e-05 2024-09-14T09:09:40.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580788+0000", 2024-09-14T09:09:40.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0327e-05 2024-09-14T09:09:40.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801980+0000", 2024-09-14T09:09:40.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.22119123900000001 2024-09-14T09:09:40.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802115+0000", 2024-09-14T09:09:40.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013572000000000001 2024-09-14T09:09:40.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813693+0000", 2024-09-14T09:09:40.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011578026 2024-09-14T09:09:40.422 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.422 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.422 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.423 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:89485 3.3 3:c3eae671:::rbd_data.1112a10502fe.0000000000000248:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:40.423 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:09:40.423 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.649416017, 2024-09-14T09:09:40.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.12841583300000001, 2024-09-14T09:09:40.423 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.423 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.423 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:40.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:40.423 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 89485 2024-09-14T09:09:40.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.423 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:09:40.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:09:40.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685529+0000", 2024-09-14T09:09:40.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.11e-06 2024-09-14T09:09:40.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685534+0000", 2024-09-14T09:09:40.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0289999999999996e-06 2024-09-14T09:09:40.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685546+0000", 2024-09-14T09:09:40.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2062000000000001e-05 2024-09-14T09:09:40.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685554+0000", 2024-09-14T09:09:40.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7889999999999995e-06 2024-09-14T09:09:40.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685618+0000", 2024-09-14T09:09:40.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4487999999999996e-05 2024-09-14T09:09:40.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685628+0000", 2024-09-14T09:09:40.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5840000000000001e-06 2024-09-14T09:09:40.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802613+0000", 2024-09-14T09:09:40.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.116984703 2024-09-14T09:09:40.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802768+0000", 2024-09-14T09:09:40.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015541599999999999 2024-09-14T09:09:40.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813944+0000", 2024-09-14T09:09:40.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011175651999999999 2024-09-14T09:09:40.427 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.427 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.427 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.428 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:90751 3.3 3:c22bfcfe:::rbd_data.1112a10502fe.000000000000024e:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:40.428 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:09:40.428 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.598345233, 2024-09-14T09:09:40.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077582650000000003, 2024-09-14T09:09:40.428 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.428 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.428 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:40.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:40.428 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 90751 2024-09-14T09:09:40.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.429 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:09:40.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:09:40.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736600+0000", 2024-09-14T09:09:40.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.71e-07 2024-09-14T09:09:40.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736608+0000", 2024-09-14T09:09:40.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2679999999999994e-06 2024-09-14T09:09:40.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736620+0000", 2024-09-14T09:09:40.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2064e-05 2024-09-14T09:09:40.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736627+0000", 2024-09-14T09:09:40.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8129999999999998e-06 2024-09-14T09:09:40.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736676+0000", 2024-09-14T09:09:40.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.901e-05 2024-09-14T09:09:40.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736685+0000", 2024-09-14T09:09:40.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:09:40.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803227+0000", 2024-09-14T09:09:40.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066541874000000001 2024-09-14T09:09:40.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803381+0000", 2024-09-14T09:09:40.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015482500000000001 2024-09-14T09:09:40.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.814181+0000", 2024-09-14T09:09:40.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010799944000000001 2024-09-14T09:09:40.433 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.433 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.433 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.434 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:90760 3.3 3:c116ad26:::rbd_data.1112a10502fe.0000000000000251:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:40.434 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:09:40.434 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.598242916, 2024-09-14T09:09:40.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077694599000000003, 2024-09-14T09:09:40.434 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.434 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.434 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.434 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.434 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:40.435 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:40.435 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 90760 2024-09-14T09:09:40.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.435 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:09:40.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:09:40.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736702+0000", 2024-09-14T09:09:40.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0999999999999998e-07 2024-09-14T09:09:40.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736705+0000", 2024-09-14T09:09:40.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0120000000000001e-06 2024-09-14T09:09:40.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736711+0000", 2024-09-14T09:09:40.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6279999999999999e-06 2024-09-14T09:09:40.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736717+0000", 2024-09-14T09:09:40.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6200000000000004e-06 2024-09-14T09:09:40.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736765+0000", 2024-09-14T09:09:40.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7688000000000001e-05 2024-09-14T09:09:40.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736772+0000", 2024-09-14T09:09:40.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6529999999999994e-06 2024-09-14T09:09:40.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803886+0000", 2024-09-14T09:09:40.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067113795000000004 2024-09-14T09:09:40.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.804024+0000", 2024-09-14T09:09:40.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013782000000000001 2024-09-14T09:09:40.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.814396+0000", 2024-09-14T09:09:40.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010371773000000001 2024-09-14T09:09:40.439 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.439 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.439 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.439 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.439 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.439 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:40.441 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:09:40.442 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:40.443+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:40.541 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:40.543+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:40.585 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:40.586 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:40.586 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:09:40.586 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:40.594 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:40.679 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:40.681+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:40.737 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:40.737 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:40.737 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:40.737 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:40.737 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:40.744 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:40.745+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:40.745 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:09:40.845 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:40.846+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:40.889 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:40.890 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:40.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:40.890 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:40.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.890 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:228 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 360448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:40.890 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:40.890 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.094327340999996, 2024-09-14T09:09:40.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99234476999999999, 2024-09-14T09:09:40.890 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.890 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.890 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.890 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.891 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:40.891 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:40.891 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 228 2024-09-14T09:09:40.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.891 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:40.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:40.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796906+0000", 2024-09-14T09:09:40.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9399999999999995e-07 2024-09-14T09:09:40.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796917+0000", 2024-09-14T09:09:40.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0801e-05 2024-09-14T09:09:40.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796924+0000", 2024-09-14T09:09:40.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7750000000000004e-06 2024-09-14T09:09:40.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:40.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9972000000000001e-05 2024-09-14T09:09:40.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798671+0000", 2024-09-14T09:09:40.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017271330000000001 2024-09-14T09:09:40.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798675+0000", 2024-09-14T09:09:40.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.194e-06 2024-09-14T09:09:40.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789003+0000", 2024-09-14T09:09:40.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99032768400000004 2024-09-14T09:09:40.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789115+0000", 2024-09-14T09:09:40.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112236 2024-09-14T09:09:40.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789250+0000", 2024-09-14T09:09:40.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013548100000000001 2024-09-14T09:09:40.895 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.895 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.895 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.896 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:229 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 819200~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:40.896 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:40.896 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.094275117999999, 2024-09-14T09:09:40.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99287024599999996, 2024-09-14T09:09:40.896 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.896 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.896 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.896 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.896 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:40.896 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:40.896 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 229 2024-09-14T09:09:40.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.896 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:40.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:40.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:40.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999999e-07 2024-09-14T09:09:40.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796962+0000", 2024-09-14T09:09:40.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1479999999999999e-06 2024-09-14T09:09:40.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796967+0000", 2024-09-14T09:09:40.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1499999999999998e-06 2024-09-14T09:09:40.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:09:40.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-06 2024-09-14T09:09:40.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798688+0000", 2024-09-14T09:09:40.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017172660000000001 2024-09-14T09:09:40.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798691+0000", 2024-09-14T09:09:40.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:09:40.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789599+0000", 2024-09-14T09:09:40.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99090839399999997 2024-09-14T09:09:40.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789716+0000", 2024-09-14T09:09:40.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116474 2024-09-14T09:09:40.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789828+0000", 2024-09-14T09:09:40.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112293 2024-09-14T09:09:40.900 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.901 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.901 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.901 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:230 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1277952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:40.901 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:40.901 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.094254469999996, 2024-09-14T09:09:40.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99307501600000003, 2024-09-14T09:09:40.901 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.901 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.901 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.901 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.901 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:40.902 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:40.902 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 230 2024-09-14T09:09:40.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.902 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:40.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:40.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796979+0000", 2024-09-14T09:09:40.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.34e-07 2024-09-14T09:09:40.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796980+0000", 2024-09-14T09:09:40.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.53e-06 2024-09-14T09:09:40.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796986+0000", 2024-09-14T09:09:40.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9989999999999997e-06 2024-09-14T09:09:40.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796989+0000", 2024-09-14T09:09:40.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0340000000000001e-06 2024-09-14T09:09:40.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798702+0000", 2024-09-14T09:09:40.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001712756 2024-09-14T09:09:40.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798705+0000", 2024-09-14T09:09:40.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7750000000000001e-06 2024-09-14T09:09:40.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789870+0000", 2024-09-14T09:09:40.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991165026 2024-09-14T09:09:40.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789955+0000", 2024-09-14T09:09:40.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4839999999999994e-05 2024-09-14T09:09:40.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790053+0000", 2024-09-14T09:09:40.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8721999999999994e-05 2024-09-14T09:09:40.906 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.906 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.906 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.906 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:231 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:40.906 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:40.906 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.094239142000006, 2024-09-14T09:09:40.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99319130300000003, 2024-09-14T09:09:40.906 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.907 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.907 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.907 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.907 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:40.907 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:40.907 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 231 2024-09-14T09:09:40.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.907 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:40.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:40.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:40.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2024-09-14T09:09:40.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796995+0000", 2024-09-14T09:09:40.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2500000000000001e-06 2024-09-14T09:09:40.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796998+0000", 2024-09-14T09:09:40.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3230000000000002e-06 2024-09-14T09:09:40.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797001+0000", 2024-09-14T09:09:40.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7099999999999999e-06 2024-09-14T09:09:40.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798718+0000", 2024-09-14T09:09:40.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017168070000000001 2024-09-14T09:09:40.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798721+0000", 2024-09-14T09:09:40.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.853e-06 2024-09-14T09:09:40.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790077+0000", 2024-09-14T09:09:40.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991356393 2024-09-14T09:09:40.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790129+0000", 2024-09-14T09:09:40.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2240999999999997e-05 2024-09-14T09:09:40.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790185+0000", 2024-09-14T09:09:40.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5515e-05 2024-09-14T09:09:40.911 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.911 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.911 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.912 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:232 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2195456~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:40.912 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:40.912 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.094228486000006, 2024-09-14T09:09:40.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99329117899999997, 2024-09-14T09:09:40.912 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.912 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.912 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.912 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.912 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:40.912 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:40.912 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 232 2024-09-14T09:09:40.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.912 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:40.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:40.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797005+0000", 2024-09-14T09:09:40.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2024-09-14T09:09:40.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797006+0000", 2024-09-14T09:09:40.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3200000000000001e-06 2024-09-14T09:09:40.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797009+0000", 2024-09-14T09:09:40.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4680000000000001e-06 2024-09-14T09:09:40.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797012+0000", 2024-09-14T09:09:40.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4770000000000002e-06 2024-09-14T09:09:40.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798743+0000", 2024-09-14T09:09:40.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017312 2024-09-14T09:09:40.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798747+0000", 2024-09-14T09:09:40.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.484e-06 2024-09-14T09:09:40.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790201+0000", 2024-09-14T09:09:40.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99145419499999998 2024-09-14T09:09:40.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790241+0000", 2024-09-14T09:09:40.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0587999999999998e-05 2024-09-14T09:09:40.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790296+0000", 2024-09-14T09:09:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4212000000000002e-05 2024-09-14T09:09:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:233 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2654208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.094217862999997, 2024-09-14T09:09:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99337220100000001, 2024-09-14T09:09:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 233 2024-09-14T09:09:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:09:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:09:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.269e-06 2024-09-14T09:09:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797019+0000", 2024-09-14T09:09:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9519999999999999e-06 2024-09-14T09:09:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797022+0000", 2024-09-14T09:09:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6079999999999998e-06 2024-09-14T09:09:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798759+0000", 2024-09-14T09:09:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001737342 2024-09-14T09:09:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798762+0000", 2024-09-14T09:09:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:09:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790310+0000", 2024-09-14T09:09:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99154738799999997 2024-09-14T09:09:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790349+0000", 2024-09-14T09:09:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9573000000000002e-05 2024-09-14T09:09:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790387+0000", 2024-09-14T09:09:40.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7985999999999998e-05 2024-09-14T09:09:40.922 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.922 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.922 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.922 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:234 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3112960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:40.922 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:40.922 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.094207818000001, 2024-09-14T09:09:40.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99345674500000003, 2024-09-14T09:09:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 234 2024-09-14T09:09:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0100000000000001e-07 2024-09-14T09:09:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0699999999999999e-06 2024-09-14T09:09:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:09:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.886e-06 2024-09-14T09:09:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797032+0000", 2024-09-14T09:09:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7149999999999998e-06 2024-09-14T09:09:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798778+0000", 2024-09-14T09:09:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017460329999999999 2024-09-14T09:09:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798783+0000", 2024-09-14T09:09:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0760000000000002e-06 2024-09-14T09:09:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790408+0000", 2024-09-14T09:09:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99162473299999998 2024-09-14T09:09:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790446+0000", 2024-09-14T09:09:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8389000000000001e-05 2024-09-14T09:09:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790482+0000", 2024-09-14T09:09:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5642000000000002e-05 2024-09-14T09:09:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:235 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3571712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.094197919999999, 2024-09-14T09:09:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993539477, 2024-09-14T09:09:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 235 2024-09-14T09:09:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9999999999999999e-07 2024-09-14T09:09:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797036+0000", 2024-09-14T09:09:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.051e-06 2024-09-14T09:09:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797039+0000", 2024-09-14T09:09:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:09:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797042+0000", 2024-09-14T09:09:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5280000000000002e-06 2024-09-14T09:09:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798809+0000", 2024-09-14T09:09:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001767394 2024-09-14T09:09:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798815+0000", 2024-09-14T09:09:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0859999999999998e-06 2024-09-14T09:09:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790502+0000", 2024-09-14T09:09:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99168652300000004 2024-09-14T09:09:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790539+0000", 2024-09-14T09:09:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7471000000000001e-05 2024-09-14T09:09:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790574+0000", 2024-09-14T09:09:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5292e-05 2024-09-14T09:09:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:236 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 4030464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.094187687000002, 2024-09-14T09:09:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993619743, 2024-09-14T09:09:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 236 2024-09-14T09:09:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1400000000000001e-07 2024-09-14T09:09:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797047+0000", 2024-09-14T09:09:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3400000000000001e-06 2024-09-14T09:09:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:09:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0699999999999998e-06 2024-09-14T09:09:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797053+0000", 2024-09-14T09:09:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7310000000000002e-06 2024-09-14T09:09:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798839+0000", 2024-09-14T09:09:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001786403 2024-09-14T09:09:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798844+0000", 2024-09-14T09:09:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3730000000000001e-06 2024-09-14T09:09:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790592+0000", 2024-09-14T09:09:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99174818099999995 2024-09-14T09:09:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790628+0000", 2024-09-14T09:09:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5831000000000003e-05 2024-09-14T09:09:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790665+0000", 2024-09-14T09:09:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-05 2024-09-14T09:09:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:365 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.092000659000007, 2024-09-14T09:09:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157278400000004, 2024-09-14T09:09:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 365 2024-09-14T09:09:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:09:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799233+0000", 2024-09-14T09:09:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.057e-06 2024-09-14T09:09:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799236+0000", 2024-09-14T09:09:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0249999999999998e-06 2024-09-14T09:09:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799239+0000", 2024-09-14T09:09:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.481e-06 2024-09-14T09:09:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800963+0000", 2024-09-14T09:09:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017240440000000001 2024-09-14T09:09:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800969+0000", 2024-09-14T09:09:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1410000000000002e-06 2024-09-14T09:09:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790682+0000", 2024-09-14T09:09:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98971330300000004 2024-09-14T09:09:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790753+0000", 2024-09-14T09:09:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0548000000000003e-05 2024-09-14T09:09:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790805+0000", 2024-09-14T09:09:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1981999999999998e-05 2024-09-14T09:09:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:366 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.091990566000007, 2024-09-14T09:09:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99173757299999998, 2024-09-14T09:09:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 366 2024-09-14T09:09:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-07 2024-09-14T09:09:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799244+0000", 2024-09-14T09:09:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.359e-06 2024-09-14T09:09:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799247+0000", 2024-09-14T09:09:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4929999999999998e-06 2024-09-14T09:09:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799250+0000", 2024-09-14T09:09:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:09:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800991+0000", 2024-09-14T09:09:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017412809999999999 2024-09-14T09:09:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800997+0000", 2024-09-14T09:09:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:09:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790824+0000", 2024-09-14T09:09:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98982735399999999 2024-09-14T09:09:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790891+0000", 2024-09-14T09:09:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7243999999999995e-05 2024-09-14T09:09:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790980+0000", 2024-09-14T09:09:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8608000000000003e-05 2024-09-14T09:09:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:367 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.091979194000004, 2024-09-14T09:09:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99188259999999995, 2024-09-14T09:09:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 367 2024-09-14T09:09:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-07 2024-09-14T09:09:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799255+0000", 2024-09-14T09:09:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.111e-06 2024-09-14T09:09:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799259+0000", 2024-09-14T09:09:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8650000000000003e-06 2024-09-14T09:09:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799262+0000", 2024-09-14T09:09:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.128e-06 2024-09-14T09:09:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801029+0000", 2024-09-14T09:09:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017668460000000001 2024-09-14T09:09:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801032+0000", 2024-09-14T09:09:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3179999999999998e-06 2024-09-14T09:09:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791011+0000", 2024-09-14T09:09:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98997920399999995 2024-09-14T09:09:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791077+0000", 2024-09-14T09:09:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5214000000000003e-05 2024-09-14T09:09:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791136+0000", 2024-09-14T09:09:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9710000000000003e-05 2024-09-14T09:09:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:368 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.091967651000004, 2024-09-14T09:09:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99201753800000003, 2024-09-14T09:09:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 368 2024-09-14T09:09:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4900000000000002e-07 2024-09-14T09:09:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799267+0000", 2024-09-14T09:09:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.079e-06 2024-09-14T09:09:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799270+0000", 2024-09-14T09:09:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.993e-06 2024-09-14T09:09:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799272+0000", 2024-09-14T09:09:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.695e-06 2024-09-14T09:09:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801043+0000", 2024-09-14T09:09:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001771105 2024-09-14T09:09:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801046+0000", 2024-09-14T09:09:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7999999999999999e-06 2024-09-14T09:09:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791150+0000", 2024-09-14T09:09:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99010348699999995 2024-09-14T09:09:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791193+0000", 2024-09-14T09:09:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3615999999999997e-05 2024-09-14T09:09:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791283+0000", 2024-09-14T09:09:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9513999999999997e-05 2024-09-14T09:09:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:369 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.091957312999995, 2024-09-14T09:09:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99213433600000001, 2024-09-14T09:09:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 369 2024-09-14T09:09:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:09:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799277+0000", 2024-09-14T09:09:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.108e-06 2024-09-14T09:09:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799280+0000", 2024-09-14T09:09:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:09:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799283+0000", 2024-09-14T09:09:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.531e-06 2024-09-14T09:09:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801058+0000", 2024-09-14T09:09:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001775085 2024-09-14T09:09:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801060+0000", 2024-09-14T09:09:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8260000000000001e-06 2024-09-14T09:09:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791299+0000", 2024-09-14T09:09:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99023856799999999 2024-09-14T09:09:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791352+0000", 2024-09-14T09:09:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2528000000000003e-05 2024-09-14T09:09:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791410+0000", 2024-09-14T09:09:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8298000000000003e-05 2024-09-14T09:09:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:370 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2457600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.091932545999995, 2024-09-14T09:09:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99220795399999995, 2024-09-14T09:09:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 370 2024-09-14T09:09:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799301+0000", 2024-09-14T09:09:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2024-09-14T09:09:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799303+0000", 2024-09-14T09:09:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9319999999999999e-06 2024-09-14T09:09:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799310+0000", 2024-09-14T09:09:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8680000000000001e-06 2024-09-14T09:09:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799315+0000", 2024-09-14T09:09:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.921e-06 2024-09-14T09:09:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801071+0000", 2024-09-14T09:09:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001756678 2024-09-14T09:09:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801080+0000", 2024-09-14T09:09:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6060000000000003e-06 2024-09-14T09:09:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791429+0000", 2024-09-14T09:09:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99034944599999997 2024-09-14T09:09:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791471+0000", 2024-09-14T09:09:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1279999999999998e-05 2024-09-14T09:09:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791508+0000", 2024-09-14T09:09:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7663999999999997e-05 2024-09-14T09:09:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:371 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2916352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.091911374000006, 2024-09-14T09:09:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99228692299999999, 2024-09-14T09:09:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 371 2024-09-14T09:09:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799322+0000", 2024-09-14T09:09:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:09:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799333+0000", 2024-09-14T09:09:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1044e-05 2024-09-14T09:09:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799341+0000", 2024-09-14T09:09:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8439999999999998e-06 2024-09-14T09:09:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799354+0000", 2024-09-14T09:09:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3114e-05 2024-09-14T09:09:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801093+0000", 2024-09-14T09:09:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017385910000000001 2024-09-14T09:09:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801096+0000", 2024-09-14T09:09:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0680000000000001e-06 2024-09-14T09:09:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791528+0000", 2024-09-14T09:09:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99043264200000003 2024-09-14T09:09:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791570+0000", 2024-09-14T09:09:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2144999999999997e-05 2024-09-14T09:09:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791608+0000", 2024-09-14T09:09:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7966000000000002e-05 2024-09-14T09:09:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:372 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3375104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.091870826000005, 2024-09-14T09:09:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992342897, 2024-09-14T09:09:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 372 2024-09-14T09:09:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799363+0000", 2024-09-14T09:09:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2024-09-14T09:09:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799365+0000", 2024-09-14T09:09:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5500000000000001e-06 2024-09-14T09:09:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799371+0000", 2024-09-14T09:09:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2500000000000003e-06 2024-09-14T09:09:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799377+0000", 2024-09-14T09:09:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7509999999999997e-06 2024-09-14T09:09:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801107+0000", 2024-09-14T09:09:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017298019999999999 2024-09-14T09:09:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801111+0000", 2024-09-14T09:09:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8619999999999996e-06 2024-09-14T09:09:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791626+0000", 2024-09-14T09:09:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99051563300000001 2024-09-14T09:09:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791668+0000", 2024-09-14T09:09:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1424000000000002e-05 2024-09-14T09:09:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791705+0000", 2024-09-14T09:09:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7035e-05 2024-09-14T09:09:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:373 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.091848881000004, 2024-09-14T09:09:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99253589399999997, 2024-09-14T09:09:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 373 2024-09-14T09:09:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2024-09-14T09:09:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799387+0000", 2024-09-14T09:09:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1019999999999999e-06 2024-09-14T09:09:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799393+0000", 2024-09-14T09:09:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0190000000000003e-06 2024-09-14T09:09:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799398+0000", 2024-09-14T09:09:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:09:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801123+0000", 2024-09-14T09:09:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017251949999999999 2024-09-14T09:09:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801126+0000", 2024-09-14T09:09:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9280000000000002e-06 2024-09-14T09:09:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791746+0000", 2024-09-14T09:09:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99062036899999995 2024-09-14T09:09:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791835+0000", 2024-09-14T09:09:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9004000000000004e-05 2024-09-14T09:09:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791920+0000", 2024-09-14T09:09:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4524000000000006e-05 2024-09-14T09:09:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:60352 3.0 3.6d62a5c0 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:09:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.509213042999999, 2024-09-14T09:09:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41710537399999997, 2024-09-14T09:09:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 60352 2024-09-14T09:09:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:09:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:09:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382044+0000", 2024-09-14T09:09:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4640000000000001e-05 2024-09-14T09:09:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382048+0000", 2024-09-14T09:09:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4690000000000002e-06 2024-09-14T09:09:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382053+0000", 2024-09-14T09:09:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:09:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382068+0000", 2024-09-14T09:09:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4399000000000001e-05 2024-09-14T09:09:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382121+0000", 2024-09-14T09:09:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3578000000000001e-05 2024-09-14T09:09:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382127+0000", 2024-09-14T09:09:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2024-09-14T09:09:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799116+0000", 2024-09-14T09:09:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.416988566 2024-09-14T09:09:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799125+0000", 2024-09-14T09:09:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3100000000000006e-06 2024-09-14T09:09:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:63559 3.0 3.95b285c0 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.50338167, 2024-09-14T09:09:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.411301215, 2024-09-14T09:09:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 63559 2024-09-14T09:09:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2499999999999999e-07 2024-09-14T09:09:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387853+0000", 2024-09-14T09:09:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.477e-06 2024-09-14T09:09:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387856+0000", 2024-09-14T09:09:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1429999999999998e-06 2024-09-14T09:09:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387859+0000", 2024-09-14T09:09:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.582e-06 2024-09-14T09:09:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387888+0000", 2024-09-14T09:09:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9609000000000001e-05 2024-09-14T09:09:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387893+0000", 2024-09-14T09:09:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6779999999999999e-06 2024-09-14T09:09:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799143+0000", 2024-09-14T09:09:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41124997099999999 2024-09-14T09:09:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799152+0000", 2024-09-14T09:09:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5300000000000002e-06 2024-09-14T09:09:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:40.991 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:40.992 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 1] out_osds: [] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 2] 2024-09-14T09:09:40.992 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:09:40.992 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-14T09:09:40.992 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T09:09:40.993 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T09:09:40.994 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:40.994+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:40.995 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:09:41.093 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:41.096+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:41.150 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:41.151 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:41.151 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:09:41.151 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:41.159 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:09:41.203 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:41.205+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:41.266 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:41.266 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:41.266 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:41.266 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:41.266 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:41.275 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:09:41.285 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:09:41.294 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:41.296+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:41.395 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:41.397+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:09:41.424 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: "epoch": 109, 2024-09-14T09:09:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: "fsid": "c991ac1c-978d-48b3-a540-4d3d4755e125", 2024-09-14T09:09:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: "created": "2024-09-14T09:07:16.982473+0000", 2024-09-14T09:09:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: "modified": "2024-09-14T09:09:40.972518+0000", 2024-09-14T09:09:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: "last_up_change": "2024-09-14T09:09:15.843683+0000", 2024-09-14T09:09:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: "last_in_change": "2024-09-14T09:08:58.845087+0000", 2024-09-14T09:09:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T09:09:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_num": 5804032, 2024-09-14T09:09:41.424 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_set": [ 2024-09-14T09:09:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: "nodeep-scrub", 2024-09-14T09:09:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: "pglog_hardlimit", 2024-09-14T09:09:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snapdirs", 2024-09-14T09:09:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_deletes", 2024-09-14T09:09:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: "sortbitwise" 2024-09-14T09:09:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_version": 6, 2024-09-14T09:09:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T09:09:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T09:09:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T09:09:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_snapshot": "", 2024-09-14T09:09:41.425 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_max": 3, 2024-09-14T09:09:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "max_osd": 6, 2024-09-14T09:09:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "require_min_compat_client": "luminous", 2024-09-14T09:09:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "min_compat_client": "jewel", 2024-09-14T09:09:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "require_osd_release": "squid", 2024-09-14T09:09:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "allow_crimson": false, 2024-09-14T09:09:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "pools": [ 2024-09-14T09:09:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 1, 2024-09-14T09:09:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": ".mgr", 2024-09-14T09:09:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:29.194849+0000", 2024-09-14T09:09:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 1, 2024-09-14T09:09:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool", 2024-09-14T09:09:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:09:41.426 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:09:41.427 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:09:41.427 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:09:41.427 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:09:41.427 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:09:41.427 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:09:41.427 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:09:41.427 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:09:41.427 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:09:41.427 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:09:41.427 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 1, 2024-09-14T09:09:41.427 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 1, 2024-09-14T09:09:41.427 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 1, 2024-09-14T09:09:41.427 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 1, 2024-09-14T09:09:41.427 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 1, 2024-09-14T09:09:41.428 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:09:41.428 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:09:41.428 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:09:41.428 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:09:41.428 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:09:41.428 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:09:41.428 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:09:41.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.428 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "16", 2024-09-14T09:09:41.428 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:09:41.428 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:09:41.428 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:09:41.428 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:09:41.429 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:09:41.429 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 0, 2024-09-14T09:09:41.429 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 0, 2024-09-14T09:09:41.429 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:09:41.429 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:09:41.429 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:09:41.429 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:09:41.429 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:09:41.429 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:09:41.429 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:09:41.429 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:09:41.429 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:09:41.429 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:09:41.430 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:09:41.430 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:09:41.430 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:09:41.430 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:09:41.430 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:09:41.430 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:09:41.430 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:09:41.430 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:09:41.430 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:09:41.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.430 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:09:41.430 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:09:41.430 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:09:41.430 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:09:41.431 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:09:41.431 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:09:41.431 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:09:41.431 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:09:41.431 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:09:41.431 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:09:41.431 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:09:41.431 INFO:teuthology.orchestra.run.smithi116.stdout: "options": { 2024-09-14T09:09:41.431 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_max": 32, 2024-09-14T09:09:41.431 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_min": 1 2024-09-14T09:09:41.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.431 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:09:41.431 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": {} 2024-09-14T09:09:41.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.432 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:09:41.432 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:09:41.432 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 6.059999942779541, 2024-09-14T09:09:41.432 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 6.059999942779541, 2024-09-14T09:09:41.432 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 0.33000001311302185, 2024-09-14T09:09:41.432 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 2, 2024-09-14T09:09:41.432 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 2, 2024-09-14T09:09:41.432 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:09:41.432 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:09:41.432 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:09:41.432 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.433 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 2, 2024-09-14T09:09:41.433 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": "rbd", 2024-09-14T09:09:41.433 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:33.684592+0000", 2024-09-14T09:09:41.433 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 8193, 2024-09-14T09:09:41.433 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T09:09:41.433 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:09:41.433 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:09:41.433 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:09:41.433 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:09:41.433 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:09:41.433 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:09:41.433 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:09:41.433 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:09:41.434 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:09:41.434 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:09:41.434 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:09:41.434 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 8, 2024-09-14T09:09:41.434 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 8, 2024-09-14T09:09:41.434 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 8, 2024-09-14T09:09:41.434 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 8, 2024-09-14T09:09:41.434 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 8, 2024-09-14T09:09:41.434 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:09:41.434 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:09:41.434 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:09:41.434 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:09:41.434 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:09:41.434 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:09:41.435 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:09:41.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.435 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "20", 2024-09-14T09:09:41.435 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:09:41.435 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:09:41.435 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:09:41.435 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:09:41.435 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:09:41.435 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 2, 2024-09-14T09:09:41.435 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 20, 2024-09-14T09:09:41.435 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:09:41.435 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:09:41.435 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:09:41.435 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:09:41.436 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:09:41.436 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:09:41.436 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:09:41.436 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:09:41.436 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:09:41.436 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:09:41.436 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:09:41.436 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:09:41.436 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:09:41.436 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:09:41.436 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:09:41.436 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:09:41.436 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:09:41.436 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:09:41.437 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:09:41.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.437 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:09:41.437 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:09:41.437 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:09:41.437 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:09:41.437 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:09:41.437 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:09:41.437 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:09:41.437 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:09:41.437 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:09:41.437 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:09:41.437 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:09:41.438 INFO:teuthology.orchestra.run.smithi116.stdout: "options": {}, 2024-09-14T09:09:41.438 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:09:41.438 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd": {} 2024-09-14T09:09:41.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.438 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:09:41.438 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:09:41.438 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 2.25, 2024-09-14T09:09:41.438 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 2.25, 2024-09-14T09:09:41.438 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 1, 2024-09-14T09:09:41.438 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 2.25, 2024-09-14T09:09:41.438 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 2.25, 2024-09-14T09:09:41.438 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:09:41.438 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:09:41.439 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:09:41.439 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.439 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 3, 2024-09-14T09:09:41.439 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": "pool_client.0", 2024-09-14T09:09:41.439 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:43.363542+0000", 2024-09-14T09:09:41.439 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 8193, 2024-09-14T09:09:41.439 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T09:09:41.439 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:09:41.439 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:09:41.439 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:09:41.439 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:09:41.439 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:09:41.439 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:09:41.439 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:09:41.440 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:09:41.440 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:09:41.440 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:09:41.440 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:09:41.440 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 32, 2024-09-14T09:09:41.440 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 32, 2024-09-14T09:09:41.440 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 32, 2024-09-14T09:09:41.440 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 32, 2024-09-14T09:09:41.440 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 32, 2024-09-14T09:09:41.440 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:09:41.440 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:09:41.440 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:09:41.440 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:09:41.440 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:09:41.440 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:09:41.441 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:09:41.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.441 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "109", 2024-09-14T09:09:41.441 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:09:41.441 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:09:41.441 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:09:41.441 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:09:41.441 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:09:41.441 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 43, 2024-09-14T09:09:41.441 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 109, 2024-09-14T09:09:41.441 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:09:41.441 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:09:41.441 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:09:41.441 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:09:41.441 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:09:41.442 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:09:41.442 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:09:41.442 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:09:41.442 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:09:41.442 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:09:41.442 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:09:41.442 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:09:41.442 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:09:41.442 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:09:41.442 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:09:41.442 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:09:41.442 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:09:41.442 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:09:41.442 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:09:41.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.443 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:09:41.443 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:09:41.443 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:09:41.443 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:09:41.443 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:09:41.443 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:09:41.443 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:09:41.443 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:09:41.443 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:09:41.443 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:09:41.443 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:09:41.443 INFO:teuthology.orchestra.run.smithi116.stdout: "options": {}, 2024-09-14T09:09:41.443 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:09:41.443 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd": {} 2024-09-14T09:09:41.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.444 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:09:41.444 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:09:41.444 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 1.8799999952316284, 2024-09-14T09:09:41.444 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 1.8799999952316284, 2024-09-14T09:09:41.444 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 1, 2024-09-14T09:09:41.444 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 1.8799999952316284, 2024-09-14T09:09:41.444 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 1.8799999952316284, 2024-09-14T09:09:41.444 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:09:41.444 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:09:41.444 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:09:41.444 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.444 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.444 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:41.445 INFO:teuthology.orchestra.run.smithi116.stdout: "osds": [ 2024-09-14T09:09:41.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.445 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 0, 2024-09-14T09:09:41.445 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "b3c13086-1183-454b-8e62-3aec9b69cdf5", 2024-09-14T09:09:41.445 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:41.445 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:41.445 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 0.3199462890625, 2024-09-14T09:09:41.445 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:09:41.445 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:09:41.445 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:09:41.445 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 11, 2024-09-14T09:09:41.445 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 78, 2024-09-14T09:09:41.445 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:09:41.446 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:41.446 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:41.446 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.446 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.446 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6816", 2024-09-14T09:09:41.446 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:41.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.446 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.446 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6817", 2024-09-14T09:09:41.446 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:41.446 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.446 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.447 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:41.447 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.447 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.447 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6818", 2024-09-14T09:09:41.447 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:41.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.447 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.447 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6819", 2024-09-14T09:09:41.447 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:41.447 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.447 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.448 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:41.448 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.448 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.448 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6822", 2024-09-14T09:09:41.448 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:41.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.448 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.448 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6823", 2024-09-14T09:09:41.448 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:41.448 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.448 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.449 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:41.449 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.449 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.449 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6820", 2024-09-14T09:09:41.449 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:41.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.449 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.449 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6821", 2024-09-14T09:09:41.449 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:41.449 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.449 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.450 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6817/1856142608", 2024-09-14T09:09:41.450 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6819/1856142608", 2024-09-14T09:09:41.450 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6823/1856142608", 2024-09-14T09:09:41.450 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6821/1856142608", 2024-09-14T09:09:41.450 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:41.450 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:41.450 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:41.450 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.450 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 1, 2024-09-14T09:09:41.450 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "8ee6a373-9d0d-4cd2-96f4-9673de96f546", 2024-09-14T09:09:41.451 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:41.451 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:41.451 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:09:41.451 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:09:41.451 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:09:41.451 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:09:41.451 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 13, 2024-09-14T09:09:41.451 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 90, 2024-09-14T09:09:41.451 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:09:41.451 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:41.451 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:41.451 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.451 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.452 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6800", 2024-09-14T09:09:41.452 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:41.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.452 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.452 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6801", 2024-09-14T09:09:41.452 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:41.452 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.452 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.452 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:41.452 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.452 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.453 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6802", 2024-09-14T09:09:41.453 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:41.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.453 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.453 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6803", 2024-09-14T09:09:41.453 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:41.453 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.453 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.453 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:41.453 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.454 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.454 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6806", 2024-09-14T09:09:41.454 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:41.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.454 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.454 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6807", 2024-09-14T09:09:41.454 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:41.454 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.454 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.454 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:41.454 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.455 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.455 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6804", 2024-09-14T09:09:41.455 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:41.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.455 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.455 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6805", 2024-09-14T09:09:41.455 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:41.455 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.455 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.455 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6801/3469105275", 2024-09-14T09:09:41.455 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6803/3469105275", 2024-09-14T09:09:41.456 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6807/3469105275", 2024-09-14T09:09:41.456 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6805/3469105275", 2024-09-14T09:09:41.456 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:41.456 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:41.456 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:41.456 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.456 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 2, 2024-09-14T09:09:41.456 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "958a9363-d751-49c3-9ec7-7330d377ee53", 2024-09-14T09:09:41.456 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:41.456 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:41.456 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 0.59710693359375, 2024-09-14T09:09:41.456 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:09:41.456 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 13, 2024-09-14T09:09:41.457 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 67, 2024-09-14T09:09:41.457 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 87, 2024-09-14T09:09:41.457 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 90, 2024-09-14T09:09:41.457 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 68, 2024-09-14T09:09:41.457 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:41.457 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:41.457 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.457 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.457 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6808", 2024-09-14T09:09:41.457 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:41.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.457 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.458 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6809", 2024-09-14T09:09:41.458 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:41.458 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.458 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.458 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:41.458 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.458 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.458 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6810", 2024-09-14T09:09:41.458 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:41.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.458 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.458 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6811", 2024-09-14T09:09:41.459 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:41.459 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.459 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.459 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:41.459 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.459 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.459 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6814", 2024-09-14T09:09:41.459 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:41.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.459 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.459 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6815", 2024-09-14T09:09:41.460 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:41.460 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.460 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.460 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:41.460 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.460 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.460 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6812", 2024-09-14T09:09:41.460 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:41.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.460 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.460 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6813", 2024-09-14T09:09:41.461 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:41.461 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.461 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.461 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6809/2050490698", 2024-09-14T09:09:41.461 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6811/2050490698", 2024-09-14T09:09:41.461 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6815/2050490698", 2024-09-14T09:09:41.461 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6813/2050490698", 2024-09-14T09:09:41.461 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:41.461 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:41.461 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:41.461 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.462 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 3, 2024-09-14T09:09:41.462 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "7fafd519-b2e9-498c-a409-f55cfe45a51a", 2024-09-14T09:09:41.462 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:41.462 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:41.462 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:09:41.462 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 0.2435760498046875, 2024-09-14T09:09:41.462 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:09:41.462 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:09:41.462 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:09:41.462 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 89, 2024-09-14T09:09:41.462 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:09:41.462 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:41.462 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:41.462 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.463 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.463 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6816", 2024-09-14T09:09:41.463 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:41.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.463 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.463 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6817", 2024-09-14T09:09:41.463 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:41.463 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.463 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.463 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:41.463 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.464 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.464 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6818", 2024-09-14T09:09:41.464 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:41.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.464 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.464 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6819", 2024-09-14T09:09:41.464 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:41.464 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.464 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.464 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:41.464 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.465 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.465 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6822", 2024-09-14T09:09:41.465 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:41.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.465 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.465 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6823", 2024-09-14T09:09:41.465 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:41.465 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.465 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.465 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:41.466 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.466 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.466 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6820", 2024-09-14T09:09:41.466 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:41.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.466 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.466 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6821", 2024-09-14T09:09:41.466 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:41.466 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.466 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.466 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6817/2855061278", 2024-09-14T09:09:41.467 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6819/2855061278", 2024-09-14T09:09:41.467 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6823/2855061278", 2024-09-14T09:09:41.467 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6821/2855061278", 2024-09-14T09:09:41.467 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:41.467 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:41.467 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:41.467 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.467 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 4, 2024-09-14T09:09:41.467 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "63d99552-5fea-4367-bf86-0addc8cceb98", 2024-09-14T09:09:41.467 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:41.467 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:41.467 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:09:41.467 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:09:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:09:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:09:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:09:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 89, 2024-09-14T09:09:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:09:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6808", 2024-09-14T09:09:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.469 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6809", 2024-09-14T09:09:41.469 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:41.469 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.469 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.469 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:41.469 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.469 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.469 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6810", 2024-09-14T09:09:41.469 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:41.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.469 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.469 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6811", 2024-09-14T09:09:41.470 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:41.470 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.470 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.470 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:41.470 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.470 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.470 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6814", 2024-09-14T09:09:41.470 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:41.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.470 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.470 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6815", 2024-09-14T09:09:41.470 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:41.470 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.471 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.471 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:41.471 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.471 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.471 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6812", 2024-09-14T09:09:41.471 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:41.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.471 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.471 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6813", 2024-09-14T09:09:41.471 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:41.471 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.472 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.472 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6809/369903047", 2024-09-14T09:09:41.472 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6811/369903047", 2024-09-14T09:09:41.472 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6815/369903047", 2024-09-14T09:09:41.472 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6813/369903047", 2024-09-14T09:09:41.472 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:41.472 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:41.472 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:41.472 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.472 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 5, 2024-09-14T09:09:41.472 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "e4bcb224-662f-4530-b477-c0dd9c4ddbf4", 2024-09-14T09:09:41.472 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:41.473 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:41.473 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:09:41.473 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:09:41.473 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:09:41.473 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:09:41.473 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:09:41.473 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 87, 2024-09-14T09:09:41.473 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:09:41.473 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:41.473 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:41.473 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.473 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.473 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6800", 2024-09-14T09:09:41.473 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:41.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.474 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.474 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6801", 2024-09-14T09:09:41.474 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:41.474 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.474 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.474 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:41.474 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.474 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.474 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6802", 2024-09-14T09:09:41.474 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:41.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.475 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.475 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6803", 2024-09-14T09:09:41.475 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:41.475 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.475 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.475 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:41.475 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.475 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.475 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6806", 2024-09-14T09:09:41.475 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:41.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.475 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.476 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6807", 2024-09-14T09:09:41.476 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:41.476 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.476 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.476 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:41.476 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:41.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.476 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:41.476 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6804", 2024-09-14T09:09:41.476 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:41.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.477 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:41.477 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6805", 2024-09-14T09:09:41.477 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:41.477 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.477 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.477 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6801/2878111293", 2024-09-14T09:09:41.477 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6803/2878111293", 2024-09-14T09:09:41.477 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6807/2878111293", 2024-09-14T09:09:41.477 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6805/2878111293", 2024-09-14T09:09:41.477 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:41.477 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:41.477 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:41.478 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.478 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.478 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:41.478 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_xinfo": [ 2024-09-14T09:09:41.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.478 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 0, 2024-09-14T09:09:41.478 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:41.478 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:41.478 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:41.478 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:41.478 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:41.478 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:24.757990+0000", 2024-09-14T09:09:41.478 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:09:41.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.479 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 1, 2024-09-14T09:09:41.479 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:41.479 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:41.479 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:41.479 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:41.479 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:41.479 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.277795+0000", 2024-09-14T09:09:41.479 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:09:41.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.479 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 2, 2024-09-14T09:09:41.479 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:41.480 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:41.480 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:41.480 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:41.480 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:41.480 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.290172+0000", 2024-09-14T09:09:41.480 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 68 2024-09-14T09:09:41.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.480 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 3, 2024-09-14T09:09:41.480 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:41.480 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:41.480 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:41.480 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:41.480 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:41.481 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.324594+0000", 2024-09-14T09:09:41.481 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:09:41.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.481 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 4, 2024-09-14T09:09:41.481 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:41.481 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:41.481 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:41.481 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:41.481 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:41.481 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:24.865136+0000", 2024-09-14T09:09:41.481 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:09:41.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.482 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 5, 2024-09-14T09:09:41.482 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:41.482 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:41.482 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:41.482 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:41.482 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:41.482 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.020572+0000", 2024-09-14T09:09:41.482 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:09:41.482 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.482 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:41.482 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap": [], 2024-09-14T09:09:41.482 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap_items": [], 2024-09-14T09:09:41.482 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap_primaries": [], 2024-09-14T09:09:41.482 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_temp": [], 2024-09-14T09:09:41.483 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_temp": [], 2024-09-14T09:09:41.483 INFO:teuthology.orchestra.run.smithi116.stdout: "blocklist": {}, 2024-09-14T09:09:41.483 INFO:teuthology.orchestra.run.smithi116.stdout: "range_blocklist": {}, 2024-09-14T09:09:41.483 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profiles": { 2024-09-14T09:09:41.483 INFO:teuthology.orchestra.run.smithi116.stdout: "default": { 2024-09-14T09:09:41.483 INFO:teuthology.orchestra.run.smithi116.stdout: "crush-failure-domain": "osd", 2024-09-14T09:09:41.483 INFO:teuthology.orchestra.run.smithi116.stdout: "k": "2", 2024-09-14T09:09:41.483 INFO:teuthology.orchestra.run.smithi116.stdout: "m": "1", 2024-09-14T09:09:41.483 INFO:teuthology.orchestra.run.smithi116.stdout: "plugin": "jerasure", 2024-09-14T09:09:41.483 INFO:teuthology.orchestra.run.smithi116.stdout: "technique": "reed_sol_van" 2024-09-14T09:09:41.483 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.483 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps_queue": [ 2024-09-14T09:09:41.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.483 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 3, 2024-09-14T09:09:41.484 INFO:teuthology.orchestra.run.smithi116.stdout: "snaps": [ 2024-09-14T09:09:41.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.484 INFO:teuthology.orchestra.run.smithi116.stdout: "begin": 42, 2024-09-14T09:09:41.484 INFO:teuthology.orchestra.run.smithi116.stdout: "length": 2 2024-09-14T09:09:41.484 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.484 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.484 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.484 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:41.484 INFO:teuthology.orchestra.run.smithi116.stdout: "new_removed_snaps": [ 2024-09-14T09:09:41.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.484 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 3, 2024-09-14T09:09:41.484 INFO:teuthology.orchestra.run.smithi116.stdout: "snaps": [ 2024-09-14T09:09:41.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.484 INFO:teuthology.orchestra.run.smithi116.stdout: "begin": 42, 2024-09-14T09:09:41.485 INFO:teuthology.orchestra.run.smithi116.stdout: "length": 1 2024-09-14T09:09:41.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.485 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.485 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:41.485 INFO:teuthology.orchestra.run.smithi116.stdout: "new_purged_snaps": [], 2024-09-14T09:09:41.485 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_node_flags": {}, 2024-09-14T09:09:41.485 INFO:teuthology.orchestra.run.smithi116.stdout: "device_class_flags": {}, 2024-09-14T09:09:41.485 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode": { 2024-09-14T09:09:41.485 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode_enabled": false, 2024-09-14T09:09:41.485 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_bucket_count": 0, 2024-09-14T09:09:41.485 INFO:teuthology.orchestra.run.smithi116.stdout: "degraded_stretch_mode": 0, 2024-09-14T09:09:41.485 INFO:teuthology.orchestra.run.smithi116.stdout: "recovering_stretch_mode": 0, 2024-09-14T09:09:41.485 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode_bucket": 0 2024-09-14T09:09:41.486 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.486 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:41.487 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:41.487 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:41.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:41.488 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:41.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.488 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55979 3.e 3:740d1568:::rbd_data.1112a10502fe.0000000000000133:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:41.488 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:41.488 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 25.575793794999999, 2024-09-14T09:09:41.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.95211669700000001, 2024-09-14T09:09:41.488 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:41.488 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:41.488 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:41.488 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:41.488 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:41.488 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:41.489 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55979 2024-09-14T09:09:41.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.489 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:41.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:41.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:41.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:41.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:41.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:41.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850380+0000", 2024-09-14T09:09:41.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.615e-06 2024-09-14T09:09:41.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:41.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850386+0000", 2024-09-14T09:09:41.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8000000000000001e-06 2024-09-14T09:09:41.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:41.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850403+0000", 2024-09-14T09:09:41.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6339999999999999e-05 2024-09-14T09:09:41.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:41.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850413+0000", 2024-09-14T09:09:41.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8609999999999993e-06 2024-09-14T09:09:41.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851033+0000", 2024-09-14T09:09:41.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062034700000000004 2024-09-14T09:09:41.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:09:41.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851042+0000", 2024-09-14T09:09:41.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8340000000000005e-06 2024-09-14T09:09:41.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853175+0000", 2024-09-14T09:09:41.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0021332809999999999 2024-09-14T09:09:41.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:41.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853183+0000", 2024-09-14T09:09:41.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:09:41.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795232+0000", 2024-09-14T09:09:41.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94204854900000001 2024-09-14T09:09:41.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:41.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795413+0000", 2024-09-14T09:09:41.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018059200000000001 2024-09-14T09:09:41.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:09:41.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795717+0000", 2024-09-14T09:09:41.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000304636 2024-09-14T09:09:41.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:41.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799631+0000", 2024-09-14T09:09:41.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136910000000004 2024-09-14T09:09:41.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:41.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802290+0000", 2024-09-14T09:09:41.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026588010000000001 2024-09-14T09:09:41.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:41.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802362+0000", 2024-09-14T09:09:41.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2018000000000001e-05 2024-09-14T09:09:41.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:41.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802495+0000", 2024-09-14T09:09:41.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000132967 2024-09-14T09:09:41.495 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.495 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.495 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.495 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55990 3.e 3:72d6260e:::rbd_data.1112a10502fe.000000000000016c:head [stat,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:41.495 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:41.495 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 25.575732488, 2024-09-14T09:09:41.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.952433164, 2024-09-14T09:09:41.495 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:41.495 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:41.496 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:41.496 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:41.496 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:41.496 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:41.496 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55990 2024-09-14T09:09:41.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.496 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:41.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:41.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:41.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:41.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:41.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:41.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850440+0000", 2024-09-14T09:09:41.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5199999999999996e-07 2024-09-14T09:09:41.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:41.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850444+0000", 2024-09-14T09:09:41.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.019e-06 2024-09-14T09:09:41.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:41.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850452+0000", 2024-09-14T09:09:41.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0209999999999999e-06 2024-09-14T09:09:41.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:41.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850457+0000", 2024-09-14T09:09:41.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9529999999999998e-06 2024-09-14T09:09:41.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851100+0000", 2024-09-14T09:09:41.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00064299699999999997 2024-09-14T09:09:41.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:41.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851108+0000", 2024-09-14T09:09:41.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2279999999999998e-06 2024-09-14T09:09:41.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853208+0000", 2024-09-14T09:09:41.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020996579999999999 2024-09-14T09:09:41.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:41.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853213+0000", 2024-09-14T09:09:41.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4029999999999998e-06 2024-09-14T09:09:41.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796098+0000", 2024-09-14T09:09:41.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94288483700000003 2024-09-14T09:09:41.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:41.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796247+0000", 2024-09-14T09:09:41.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014925800000000001 2024-09-14T09:09:41.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:41.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802872+0000", 2024-09-14T09:09:41.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006625138 2024-09-14T09:09:41.500 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.500 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.500 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.501 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:41.501 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:41.501 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 25.411493714999999, 2024-09-14T09:09:41.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77465830800000002, 2024-09-14T09:09:41.501 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:41.501 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:41.501 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:41.501 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:41.501 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:41.501 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:41.501 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 58987 2024-09-14T09:09:41.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.502 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:41.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:41.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:41.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:41.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:41.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:41.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014680+0000", 2024-09-14T09:09:41.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9250000000000002e-06 2024-09-14T09:09:41.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:41.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014689+0000", 2024-09-14T09:09:41.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9730000000000003e-06 2024-09-14T09:09:41.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:41.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014709+0000", 2024-09-14T09:09:41.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9641999999999999e-05 2024-09-14T09:09:41.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:41.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014720+0000", 2024-09-14T09:09:41.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-09-14T09:09:41.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014796+0000", 2024-09-14T09:09:41.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6567000000000001e-05 2024-09-14T09:09:41.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:41.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014808+0000", 2024-09-14T09:09:41.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1435e-05 2024-09-14T09:09:41.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789325+0000", 2024-09-14T09:09:41.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77451705999999998 2024-09-14T09:09:41.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:41.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789336+0000", 2024-09-14T09:09:41.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1466e-05 2024-09-14T09:09:41.505 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.506 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.506 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.506 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:59017 3.3 3.6b81fb83 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:41.506 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:41.506 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 25.409841311000001, 2024-09-14T09:09:41.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77253447099999994, 2024-09-14T09:09:41.506 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:41.506 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:41.506 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:41.506 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:41.506 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:41.506 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:41.506 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 59017 2024-09-14T09:09:41.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.507 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:41.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:41.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:41.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:41.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:41.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:41.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016332+0000", 2024-09-14T09:09:41.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3459999999999999e-06 2024-09-14T09:09:41.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:41.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016337+0000", 2024-09-14T09:09:41.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.48e-06 2024-09-14T09:09:41.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:41.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016355+0000", 2024-09-14T09:09:41.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7955e-05 2024-09-14T09:09:41.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:41.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016364+0000", 2024-09-14T09:09:41.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.02e-06 2024-09-14T09:09:41.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016433+0000", 2024-09-14T09:09:41.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8398000000000005e-05 2024-09-14T09:09:41.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:41.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016442+0000", 2024-09-14T09:09:41.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1819999999999995e-06 2024-09-14T09:09:41.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788855+0000", 2024-09-14T09:09:41.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77241356299999997 2024-09-14T09:09:41.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:41.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788865+0000", 2024-09-14T09:09:41.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5270000000000004e-06 2024-09-14T09:09:41.510 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.510 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.510 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.511 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60343 3.e 3:721b16e6:::rbd_data.1112a10502fe.000000000000014b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:41.511 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:41.511 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 25.305871709000002, 2024-09-14T09:09:41.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68876920900000005, 2024-09-14T09:09:41.511 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:41.511 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:41.511 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:41.511 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:41.511 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:41.511 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:41.511 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60343 2024-09-14T09:09:41.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.511 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:41.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:41.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:41.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:41.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:41.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:41.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120302+0000", 2024-09-14T09:09:41.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0279999999999999e-06 2024-09-14T09:09:41.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:41.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120310+0000", 2024-09-14T09:09:41.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4330000000000004e-06 2024-09-14T09:09:41.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:41.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120333+0000", 2024-09-14T09:09:41.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2200000000000001e-05 2024-09-14T09:09:41.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:41.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120343+0000", 2024-09-14T09:09:41.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0560000000000001e-05 2024-09-14T09:09:41.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120414+0000", 2024-09-14T09:09:41.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0493000000000004e-05 2024-09-14T09:09:41.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:41.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120424+0000", 2024-09-14T09:09:41.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.059e-05 2024-09-14T09:09:41.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796679+0000", 2024-09-14T09:09:41.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67625512700000001 2024-09-14T09:09:41.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:41.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796833+0000", 2024-09-14T09:09:41.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015403500000000001 2024-09-14T09:09:41.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:09:41.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797239+0000", 2024-09-14T09:09:41.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040503000000000002 2024-09-14T09:09:41.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:41.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802918+0000", 2024-09-14T09:09:41.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056796199999999998 2024-09-14T09:09:41.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:41.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808655+0000", 2024-09-14T09:09:41.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057365089999999999 2024-09-14T09:09:41.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:41.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808850+0000", 2024-09-14T09:09:41.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000194904 2024-09-14T09:09:41.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:41.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809069+0000", 2024-09-14T09:09:41.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021968000000000001 2024-09-14T09:09:41.517 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.517 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.517 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.517 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60356 3.2 3:40f9e9e7:::rbd_data.1112a10502fe.0000000000000160:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:41.517 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:41.517 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 25.304809196000001, 2024-09-14T09:09:41.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68053790800000002, 2024-09-14T09:09:41.517 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:41.517 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:41.517 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:41.518 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:41.518 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:41.518 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:41.518 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60356 2024-09-14T09:09:41.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.518 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:41.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:41.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:41.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:41.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:41.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:41.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121364+0000", 2024-09-14T09:09:41.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.173e-06 2024-09-14T09:09:41.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:41.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121371+0000", 2024-09-14T09:09:41.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-09-14T09:09:41.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:41.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121386+0000", 2024-09-14T09:09:41.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4925e-05 2024-09-14T09:09:41.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:41.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121395+0000", 2024-09-14T09:09:41.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8190000000000003e-06 2024-09-14T09:09:41.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121464+0000", 2024-09-14T09:09:41.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8149000000000001e-05 2024-09-14T09:09:41.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:41.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121474+0000", 2024-09-14T09:09:41.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0927999999999999e-05 2024-09-14T09:09:41.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795901+0000", 2024-09-14T09:09:41.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67442645499999998 2024-09-14T09:09:41.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:41.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796068+0000", 2024-09-14T09:09:41.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016655700000000001 2024-09-14T09:09:41.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 3", 2024-09-14T09:09:41.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796354+0000", 2024-09-14T09:09:41.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00028646999999999999 2024-09-14T09:09:41.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:41.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.800348+0000", 2024-09-14T09:09:41.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039943119999999999 2024-09-14T09:09:41.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:41.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801690+0000", 2024-09-14T09:09:41.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013415090000000001 2024-09-14T09:09:41.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:41.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801771+0000", 2024-09-14T09:09:41.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1678e-05 2024-09-14T09:09:41.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:41.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801900+0000", 2024-09-14T09:09:41.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000128978 2024-09-14T09:09:41.523 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.523 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.523 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.523 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62163 3.e 3:713ab431:::rbd_data.1112a10502fe.0000000000000198:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:41.523 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:41.523 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 25.214438989000001, 2024-09-14T09:09:41.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.597552682, 2024-09-14T09:09:41.524 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:41.524 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:41.524 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:41.524 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:41.524 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:41.524 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:41.524 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62163 2024-09-14T09:09:41.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.524 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:41.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:41.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:41.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:41.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:41.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:41.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211735+0000", 2024-09-14T09:09:41.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1110000000000002e-06 2024-09-14T09:09:41.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:41.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211744+0000", 2024-09-14T09:09:41.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0790000000000007e-06 2024-09-14T09:09:41.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:41.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211765+0000", 2024-09-14T09:09:41.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1114000000000001e-05 2024-09-14T09:09:41.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:41.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211775+0000", 2024-09-14T09:09:41.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0033e-05 2024-09-14T09:09:41.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211847+0000", 2024-09-14T09:09:41.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1503999999999998e-05 2024-09-14T09:09:41.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:41.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211857+0000", 2024-09-14T09:09:41.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0378e-05 2024-09-14T09:09:41.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799140+0000", 2024-09-14T09:09:41.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.58728279100000003 2024-09-14T09:09:41.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:41.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799289+0000", 2024-09-14T09:09:41.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000148966 2024-09-14T09:09:41.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:41.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809285+0000", 2024-09-14T09:09:41.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099967059999999993 2024-09-14T09:09:41.528 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.528 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.528 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.528 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63582 3.2 3:467f2009:::rbd_data.1112a10502fe.00000000000001a1:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:41.528 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:41.528 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 25.139245872, 2024-09-14T09:09:41.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51869012999999997, 2024-09-14T09:09:41.528 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:41.528 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:41.528 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:41.528 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:41.528 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:41.529 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:41.529 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63582 2024-09-14T09:09:41.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.529 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:41.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:41.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:41.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:41.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:41.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:41.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286928+0000", 2024-09-14T09:09:41.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.812e-06 2024-09-14T09:09:41.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:41.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286936+0000", 2024-09-14T09:09:41.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2390000000000002e-06 2024-09-14T09:09:41.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:41.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286955+0000", 2024-09-14T09:09:41.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8853000000000001e-05 2024-09-14T09:09:41.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:41.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286972+0000", 2024-09-14T09:09:41.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7365000000000001e-05 2024-09-14T09:09:41.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287052+0000", 2024-09-14T09:09:41.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9491000000000002e-05 2024-09-14T09:09:41.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:41.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287063+0000", 2024-09-14T09:09:41.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1620999999999999e-05 2024-09-14T09:09:41.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796696+0000", 2024-09-14T09:09:41.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50963256999999995 2024-09-14T09:09:41.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:41.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796847+0000", 2024-09-14T09:09:41.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015126899999999999 2024-09-14T09:09:41.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:41.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.805616+0000", 2024-09-14T09:09:41.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087689099999999996 2024-09-14T09:09:41.532 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.533 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.533 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.533 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63586 3.3 3.d4e49b03 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:41.533 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:41.533 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 25.139161490999999, 2024-09-14T09:09:41.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50188935099999998, 2024-09-14T09:09:41.533 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:41.533 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:41.533 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:41.533 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:41.533 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:41.533 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:41.533 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63586 2024-09-14T09:09:41.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.534 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:41.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:41.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:41.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:41.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:41.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:41.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287011+0000", 2024-09-14T09:09:41.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.61e-07 2024-09-14T09:09:41.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:41.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287014+0000", 2024-09-14T09:09:41.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3900000000000002e-06 2024-09-14T09:09:41.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:41.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287023+0000", 2024-09-14T09:09:41.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3380000000000005e-06 2024-09-14T09:09:41.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:41.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287029+0000", 2024-09-14T09:09:41.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0079999999999999e-06 2024-09-14T09:09:41.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287087+0000", 2024-09-14T09:09:41.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8322000000000002e-05 2024-09-14T09:09:41.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:41.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287096+0000", 2024-09-14T09:09:41.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8580000000000006e-06 2024-09-14T09:09:41.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788891+0000", 2024-09-14T09:09:41.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50179498499999997 2024-09-14T09:09:41.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:41.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788900+0000", 2024-09-14T09:09:41.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.789e-06 2024-09-14T09:09:41.537 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.537 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.537 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.537 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60363 3.1d 3:b8b44067:::rbd_data.1112a10502fe.000000000000018b:head [stat,delete] snapc 21=[21] RETRY=12 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:41.537 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:41.537 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.638439753, 2024-09-14T09:09:41.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268612690000001, 2024-09-14T09:09:41.537 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:41.537 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:41.538 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:41.538 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:41.538 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:41.538 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:41.538 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60363 2024-09-14T09:09:41.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.538 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:41.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:41.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:41.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:41.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:41.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:41.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787733+0000", 2024-09-14T09:09:41.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.314e-06 2024-09-14T09:09:41.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:41.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787739+0000", 2024-09-14T09:09:41.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5300000000000004e-06 2024-09-14T09:09:41.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:41.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787750+0000", 2024-09-14T09:09:41.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1251e-05 2024-09-14T09:09:41.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:41.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:41.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0739999999999993e-06 2024-09-14T09:09:41.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787827+0000", 2024-09-14T09:09:41.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8861000000000004e-05 2024-09-14T09:09:41.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:09:41.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787836+0000", 2024-09-14T09:09:41.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1339999999999993e-06 2024-09-14T09:09:41.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789335+0000", 2024-09-14T09:09:41.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014988289999999999 2024-09-14T09:09:41.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:41.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789343+0000", 2024-09-14T09:09:41.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6639999999999998e-06 2024-09-14T09:09:41.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799170+0000", 2024-09-14T09:09:41.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098272500000001 2024-09-14T09:09:41.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:41.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799377+0000", 2024-09-14T09:09:41.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000207126 2024-09-14T09:09:41.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:41.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814593+0000", 2024-09-14T09:09:41.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015216235999999999 2024-09-14T09:09:41.542 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.542 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.542 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.542 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63565 3.1d 3:bdc63b28:::rbd_data.1112a10502fe.000000000000016d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=9 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:41.542 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:41.543 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.638393961999999, 2024-09-14T09:09:41.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0271114539999999, 2024-09-14T09:09:41.543 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:41.543 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:41.543 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:41.543 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:41.543 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:41.543 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:41.543 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63565 2024-09-14T09:09:41.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.543 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:41.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:41.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:41.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:41.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:41.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:41.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:41.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6899999999999998e-07 2024-09-14T09:09:41.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:41.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787781+0000", 2024-09-14T09:09:41.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8909999999999999e-06 2024-09-14T09:09:41.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:41.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787787+0000", 2024-09-14T09:09:41.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3230000000000003e-06 2024-09-14T09:09:41.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:41.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787793+0000", 2024-09-14T09:09:41.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-09-14T09:09:41.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789455+0000", 2024-09-14T09:09:41.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001661596 2024-09-14T09:09:41.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:41.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789463+0000", 2024-09-14T09:09:41.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4889999999999995e-06 2024-09-14T09:09:41.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800115+0000", 2024-09-14T09:09:41.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0106512670000001 2024-09-14T09:09:41.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:41.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800334+0000", 2024-09-14T09:09:41.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000219213 2024-09-14T09:09:41.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:09:41.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800651+0000", 2024-09-14T09:09:41.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00031765500000000002 2024-09-14T09:09:41.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:41.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.811875+0000", 2024-09-14T09:09:41.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011224032 2024-09-14T09:09:41.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:41.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814665+0000", 2024-09-14T09:09:41.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002789606 2024-09-14T09:09:41.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:41.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814742+0000", 2024-09-14T09:09:41.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6916999999999996e-05 2024-09-14T09:09:41.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:41.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814889+0000", 2024-09-14T09:09:41.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014725799999999999 2024-09-14T09:09:41.548 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.548 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.548 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.549 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:67113 3.1d 3:bba7fe0d:::rbd_data.1112a10502fe.00000000000001bf:head [stat,delete] snapc 21=[21] RETRY=4 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:41.549 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:41.549 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.637633103999999, 2024-09-14T09:09:41.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0265995649999999, 2024-09-14T09:09:41.549 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:41.549 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:41.549 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:41.549 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:41.549 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:41.549 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:41.549 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 67113 2024-09-14T09:09:41.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.549 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:41.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:41.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:41.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:41.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:41.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:41.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:41.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:09:41.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:41.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788543+0000", 2024-09-14T09:09:41.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-09-14T09:09:41.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:41.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788552+0000", 2024-09-14T09:09:41.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:09:41.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:41.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788559+0000", 2024-09-14T09:09:41.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:09:41.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789489+0000", 2024-09-14T09:09:41.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00092982199999999996 2024-09-14T09:09:41.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:41.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789497+0000", 2024-09-14T09:09:41.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6299999999999998e-06 2024-09-14T09:09:41.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801068+0000", 2024-09-14T09:09:41.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0115709530000001 2024-09-14T09:09:41.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:41.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801240+0000", 2024-09-14T09:09:41.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017276600000000001 2024-09-14T09:09:41.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:41.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815138+0000", 2024-09-14T09:09:41.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013897856 2024-09-14T09:09:41.553 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.553 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.553 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.553 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73412 3.1d 3:be4606c3:::rbd_data.1112a10502fe.00000000000001f2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:41.553 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:41.553 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.637601992, 2024-09-14T09:09:41.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026815928, 2024-09-14T09:09:41.554 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:41.554 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:41.554 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:41.554 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:41.554 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:41.554 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:41.554 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73412 2024-09-14T09:09:41.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.554 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:41.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:41.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:41.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:41.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:41.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:41.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:41.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5699999999999998e-07 2024-09-14T09:09:41.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:41.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788572+0000", 2024-09-14T09:09:41.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2809999999999998e-06 2024-09-14T09:09:41.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:41.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788579+0000", 2024-09-14T09:09:41.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5629999999999997e-06 2024-09-14T09:09:41.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:41.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788584+0000", 2024-09-14T09:09:41.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1710000000000001e-06 2024-09-14T09:09:41.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789521+0000", 2024-09-14T09:09:41.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00093657400000000002 2024-09-14T09:09:41.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:41.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789528+0000", 2024-09-14T09:09:41.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5719999999999997e-06 2024-09-14T09:09:41.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801631+0000", 2024-09-14T09:09:41.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0121023229999999 2024-09-14T09:09:41.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:41.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801792+0000", 2024-09-14T09:09:41.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016174000000000001 2024-09-14T09:09:41.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:41.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815386+0000", 2024-09-14T09:09:41.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013593246999999999 2024-09-14T09:09:41.558 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.558 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.558 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.558 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:77244 3.1d 3:b801be19:::rbd_data.1112a10502fe.0000000000000204:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:41.558 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:41.558 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.455737746, 2024-09-14T09:09:41.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.84519277100000001, 2024-09-14T09:09:41.558 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:41.558 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:41.559 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:41.559 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:41.559 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:41.559 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:41.559 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 77244 2024-09-14T09:09:41.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.559 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:41.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:41.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:41.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:41.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:41.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:41.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970436+0000", 2024-09-14T09:09:41.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.511e-06 2024-09-14T09:09:41.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:41.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970441+0000", 2024-09-14T09:09:41.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0470000000000001e-06 2024-09-14T09:09:41.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:41.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970453+0000", 2024-09-14T09:09:41.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2629999999999999e-05 2024-09-14T09:09:41.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:41.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970461+0000", 2024-09-14T09:09:41.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6850000000000001e-06 2024-09-14T09:09:41.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970524+0000", 2024-09-14T09:09:41.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3332999999999998e-05 2024-09-14T09:09:41.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:41.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970544+0000", 2024-09-14T09:09:41.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9731000000000001e-05 2024-09-14T09:09:41.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802188+0000", 2024-09-14T09:09:41.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.83164380000000004 2024-09-14T09:09:41.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:41.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:09:41.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015411999999999999 2024-09-14T09:09:41.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:41.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815627+0000", 2024-09-14T09:09:41.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013284914 2024-09-14T09:09:41.563 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.563 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.563 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.563 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:79796 3.1d 3:bc22caaf:::rbd_data.1112a10502fe.000000000000020c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:41.563 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:41.563 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.334429060000001, 2024-09-14T09:09:41.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72411694299999996, 2024-09-14T09:09:41.563 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:41.563 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:41.563 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:41.563 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:41.563 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:41.564 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:41.564 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 79796 2024-09-14T09:09:41.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.564 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:41.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:41.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:41.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:41.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:41.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:41.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091745+0000", 2024-09-14T09:09:41.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2000000000000001e-06 2024-09-14T09:09:41.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:41.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091752+0000", 2024-09-14T09:09:41.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-09-14T09:09:41.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:41.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091772+0000", 2024-09-14T09:09:41.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9822000000000001e-05 2024-09-14T09:09:41.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:41.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091791+0000", 2024-09-14T09:09:41.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9236e-05 2024-09-14T09:09:41.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091882+0000", 2024-09-14T09:09:41.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0783000000000001e-05 2024-09-14T09:09:41.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:41.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091892+0000", 2024-09-14T09:09:41.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7999999999999993e-06 2024-09-14T09:09:41.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802744+0000", 2024-09-14T09:09:41.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.710851868 2024-09-14T09:09:41.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:41.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802902+0000", 2024-09-14T09:09:41.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015814900000000001 2024-09-14T09:09:41.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:41.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815860+0000", 2024-09-14T09:09:41.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012957605000000001 2024-09-14T09:09:41.568 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.568 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.568 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.568 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80904 3.1d 3:be0e7f3d:::rbd_data.1112a10502fe.0000000000000214:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:41.568 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:41.568 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.254343212999999, 2024-09-14T09:09:41.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64435178100000001, 2024-09-14T09:09:41.568 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:41.568 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:41.568 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:41.568 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:41.569 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:41.569 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:41.569 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80904 2024-09-14T09:09:41.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.569 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:41.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:41.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:41.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:41.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:41.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:41.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171831+0000", 2024-09-14T09:09:41.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0729999999999999e-06 2024-09-14T09:09:41.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:41.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171839+0000", 2024-09-14T09:09:41.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9179999999999994e-06 2024-09-14T09:09:41.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:41.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171857+0000", 2024-09-14T09:09:41.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8957000000000002e-05 2024-09-14T09:09:41.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:41.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171867+0000", 2024-09-14T09:09:41.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7100000000000002e-06 2024-09-14T09:09:41.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171957+0000", 2024-09-14T09:09:41.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9932999999999994e-05 2024-09-14T09:09:41.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:41.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171974+0000", 2024-09-14T09:09:41.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6988999999999999e-05 2024-09-14T09:09:41.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803301+0000", 2024-09-14T09:09:41.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63132648599999996 2024-09-14T09:09:41.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:41.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803482+0000", 2024-09-14T09:09:41.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000181607 2024-09-14T09:09:41.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:41.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816180+0000", 2024-09-14T09:09:41.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012698108 2024-09-14T09:09:41.573 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.573 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.573 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.573 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80964 3.1d 3:be42e20f:::rbd_data.1112a10502fe.0000000000000219:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:41.573 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:41.573 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.248707646, 2024-09-14T09:09:41.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63896829799999999, 2024-09-14T09:09:41.573 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:41.573 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:41.574 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:41.574 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:41.574 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:41.574 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:41.574 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80964 2024-09-14T09:09:41.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.574 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:41.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:41.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:41.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:41.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:41.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:41.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177466+0000", 2024-09-14T09:09:41.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6610000000000001e-06 2024-09-14T09:09:41.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:41.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177472+0000", 2024-09-14T09:09:41.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3029999999999996e-06 2024-09-14T09:09:41.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:41.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177490+0000", 2024-09-14T09:09:41.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8099000000000001e-05 2024-09-14T09:09:41.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:41.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177499+0000", 2024-09-14T09:09:41.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:09:41.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177560+0000", 2024-09-14T09:09:41.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1334000000000006e-05 2024-09-14T09:09:41.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:41.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177578+0000", 2024-09-14T09:09:41.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8434999999999999e-05 2024-09-14T09:09:41.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803910+0000", 2024-09-14T09:09:41.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62633190699999997 2024-09-14T09:09:41.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:41.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.806612+0000", 2024-09-14T09:09:41.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002702257 2024-09-14T09:09:41.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:41.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816432+0000", 2024-09-14T09:09:41.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098199370000000008 2024-09-14T09:09:41.578 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.578 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.578 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.578 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83321 3.1d 3:bb24b47b:::rbd_data.1112a10502fe.0000000000000223:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:41.578 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:41.578 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.134253972, 2024-09-14T09:09:41.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52477628799999998, 2024-09-14T09:09:41.578 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:41.579 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:41.579 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:41.579 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:41.579 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:41.579 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:41.579 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83321 2024-09-14T09:09:41.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.579 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:41.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:41.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:41.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:41.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:41.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:41.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291920+0000", 2024-09-14T09:09:41.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.888e-06 2024-09-14T09:09:41.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:41.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291926+0000", 2024-09-14T09:09:41.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6059999999999999e-06 2024-09-14T09:09:41.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:41.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291943+0000", 2024-09-14T09:09:41.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6813e-05 2024-09-14T09:09:41.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:41.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291952+0000", 2024-09-14T09:09:41.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7439999999999996e-06 2024-09-14T09:09:41.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292023+0000", 2024-09-14T09:09:41.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1320000000000002e-05 2024-09-14T09:09:41.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:41.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292030+0000", 2024-09-14T09:09:41.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4219999999999997e-06 2024-09-14T09:09:41.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807221+0000", 2024-09-14T09:09:41.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51519140699999999 2024-09-14T09:09:41.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:41.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807406+0000", 2024-09-14T09:09:41.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018532800000000001 2024-09-14T09:09:41.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:41.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816694+0000", 2024-09-14T09:09:41.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092877600000000008 2024-09-14T09:09:41.583 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.583 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.583 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.583 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83358 3.1d 3:bb230e23:::rbd_data.1112a10502fe.000000000000022b:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:41.583 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:41.583 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.132734081999999, 2024-09-14T09:09:41.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52374808900000003, 2024-09-14T09:09:41.583 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:41.583 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:41.583 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:41.583 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:41.583 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:41.583 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:41.584 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83358 2024-09-14T09:09:41.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.584 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:41.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:41.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:41.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:41.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:41.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:41.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293439+0000", 2024-09-14T09:09:41.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5899999999999995e-07 2024-09-14T09:09:41.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:41.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293443+0000", 2024-09-14T09:09:41.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9309999999999999e-06 2024-09-14T09:09:41.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:41.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293457+0000", 2024-09-14T09:09:41.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3944999999999999e-05 2024-09-14T09:09:41.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:41.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293466+0000", 2024-09-14T09:09:41.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4319999999999999e-06 2024-09-14T09:09:41.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293530+0000", 2024-09-14T09:09:41.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3860000000000002e-05 2024-09-14T09:09:41.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:41.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293540+0000", 2024-09-14T09:09:41.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0107e-05 2024-09-14T09:09:41.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809096+0000", 2024-09-14T09:09:41.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51555587800000002 2024-09-14T09:09:41.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:41.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809265+0000", 2024-09-14T09:09:41.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000169092 2024-09-14T09:09:41.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:41.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817186+0000", 2024-09-14T09:09:41.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079209850000000002 2024-09-14T09:09:41.587 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.587 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.587 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.588 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83361 3.1d 3:bd571564:::rbd_data.1112a10502fe.000000000000022c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:41.588 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:41.588 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 24.132416006, 2024-09-14T09:09:41.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52373873100000001, 2024-09-14T09:09:41.588 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:41.588 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:41.588 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:41.588 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:41.588 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:41.588 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:41.588 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83361 2024-09-14T09:09:41.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.588 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:41.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:41.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:41.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:41.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:41.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:41.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:41.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293757+0000", 2024-09-14T09:09:41.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8000000000000004e-07 2024-09-14T09:09:41.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:41.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293762+0000", 2024-09-14T09:09:41.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8019999999999997e-06 2024-09-14T09:09:41.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:41.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293775+0000", 2024-09-14T09:09:41.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2884000000000001e-05 2024-09-14T09:09:41.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:41.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293783+0000", 2024-09-14T09:09:41.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:09:41.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293849+0000", 2024-09-14T09:09:41.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5859999999999996e-05 2024-09-14T09:09:41.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:41.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293861+0000", 2024-09-14T09:09:41.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2238999999999999e-05 2024-09-14T09:09:41.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:41.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809680+0000", 2024-09-14T09:09:41.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51581856800000003 2024-09-14T09:09:41.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:41.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809844+0000", 2024-09-14T09:09:41.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016441200000000001 2024-09-14T09:09:41.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:41.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:41.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:41.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817494+0000", 2024-09-14T09:09:41.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076502360000000004 2024-09-14T09:09:41.592 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.592 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.592 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.592 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:41.592 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:41.592 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:41.593 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:41.593 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:09:41.593 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:41.595 INFO:tasks.thrashosds.thrasher:j is {'epoch': 109, 'fsid': 'c991ac1c-978d-48b3-a540-4d3d4755e125', 'created': '2024-09-14T09:07:16.982473+0000', 'modified': '2024-09-14T09:09:40.972518+0000', 'last_up_change': '2024-09-14T09:09:15.843683+0000', 'last_in_change': '2024-09-14T09:08:58.845087+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T09:07:29.194849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T09:07:33.684592+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-14T09:07:43.363542+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 43, 'snap_epoch': 109, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}], 'osds': [{'osd': 0, 'uuid': 'b3c13086-1183-454b-8e62-3aec9b69cdf5', 'up': 1, 'in': 1, 'weight': 0.3199462890625, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 78, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6816', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6817', 'nonce': 1856142608}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6818', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6819', 'nonce': 1856142608}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6822', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6823', 'nonce': 1856142608}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6820', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6821', 'nonce': 1856142608}]}, 'public_addr': '172.21.15.116:6817/1856142608', 'cluster_addr': '172.21.15.116:6819/1856142608', 'heartbeat_back_addr': '172.21.15.116:6823/1856142608', 'heartbeat_front_addr': '172.21.15.116:6821/1856142608', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '8ee6a373-9d0d-4cd2-96f4-9673de96f546', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 90, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6800', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6801', 'nonce': 3469105275}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6802', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6803', 'nonce': 3469105275}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6806', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6807', 'nonce': 3469105275}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6804', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6805', 'nonce': 3469105275}]}, 'public_addr': '172.21.15.116:6801/3469105275', 'cluster_addr': '172.21.15.116:6803/3469105275', 'heartbeat_back_addr': '172.21.15.116:6807/3469105275', 'heartbeat_front_addr': '172.21.15.116:6805/3469105275', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '958a9363-d751-49c3-9ec7-7330d377ee53', 'up': 1, 'in': 1, 'weight': 0.59710693359375, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 67, 'up_from': 87, 'up_thru': 90, 'down_at': 68, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6808', 'nonce': 2050490698}, {'type': 'v1', 'addr': '172.21.15.116:6809', 'nonce': 2050490698}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6810', 'nonce': 2050490698}, {'type': 'v1', 'addr': '172.21.15.116:6811', 'nonce': 2050490698}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6814', 'nonce': 2050490698}, {'type': 'v1', 'addr': '172.21.15.116:6815', 'nonce': 2050490698}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6812', 'nonce': 2050490698}, {'type': 'v1', 'addr': '172.21.15.116:6813', 'nonce': 2050490698}]}, 'public_addr': '172.21.15.116:6809/2050490698', 'cluster_addr': '172.21.15.116:6811/2050490698', 'heartbeat_back_addr': '172.21.15.116:6815/2050490698', 'heartbeat_front_addr': '172.21.15.116:6813/2050490698', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '7fafd519-b2e9-498c-a409-f55cfe45a51a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.2435760498046875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 89, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6816', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6817', 'nonce': 2855061278}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6818', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6819', 'nonce': 2855061278}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6822', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6823', 'nonce': 2855061278}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6820', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6821', 'nonce': 2855061278}]}, 'public_addr': '172.21.15.144:6817/2855061278', 'cluster_addr': '172.21.15.144:6819/2855061278', 'heartbeat_back_addr': '172.21.15.144:6823/2855061278', 'heartbeat_front_addr': '172.21.15.144:6821/2855061278', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '63d99552-5fea-4367-bf86-0addc8cceb98', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 89, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6808', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6809', 'nonce': 369903047}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6810', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6811', 'nonce': 369903047}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6814', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6815', 'nonce': 369903047}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6812', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6813', 'nonce': 369903047}]}, 'public_addr': '172.21.15.144:6809/369903047', 'cluster_addr': '172.21.15.144:6811/369903047', 'heartbeat_back_addr': '172.21.15.144:6815/369903047', 'heartbeat_front_addr': '172.21.15.144:6813/369903047', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e4bcb224-662f-4530-b477-c0dd9c4ddbf4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 87, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6800', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6801', 'nonce': 2878111293}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6802', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6803', 'nonce': 2878111293}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6806', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6807', 'nonce': 2878111293}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6804', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6805', 'nonce': 2878111293}]}, 'public_addr': '172.21.15.144:6801/2878111293', 'cluster_addr': '172.21.15.144:6803/2878111293', 'heartbeat_back_addr': '172.21.15.144:6807/2878111293', 'heartbeat_front_addr': '172.21.15.144:6805/2878111293', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:24.757990+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.277795+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.290172+0000', 'dead_epoch': 68}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.324594+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:24.865136+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.020572+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 42, 'length': 2}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 42, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T09:09:41.595 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-14T09:09:41.595 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:41.595 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:41.596 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:09:41.596 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:09:41.597 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:41.597 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:41.597 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:41.597 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:41.598 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:41.598 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:41.636 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:41.638+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:41.698 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:41.700+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:41.738 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:41.738 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:41.746 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:09:41.830 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:41.832+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:41.890 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:41.890 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:41.900 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:09:41.941 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:41.943+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:41.981 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is unset 2024-09-14T09:09:42.002 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:42.005+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:42.054 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:42.055 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:42.064 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:09:42.107 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:42.109+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:42.168 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:42.168 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:42.176 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:09:42.217 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:42.219+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:42.305 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:42.307+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:42.318 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:42.318 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:42.326 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:09:42.406 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:42.408+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:42.432 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:42.433 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:42.438 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:09:42.507 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:42.509+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:42.545 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:42.545 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:42.554 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:09:42.608 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:42.609+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:42.696 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:42.696 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:42.704 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:09:42.709 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:42.710+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:42.807 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:42.807 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:42.809 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:42.812+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:42.815 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:09:42.910 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:42.913+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:42.958 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:42.959 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:42.967 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:09:43.011 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:43.013+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:43.111 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:43.113+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:43.120 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:43.120 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:43.130 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:09:43.212 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:43.214+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:43.237 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:43.237 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:43.246 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:09:43.313 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:43.315+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:43.348 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:43.348 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:43.357 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:43.414 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:43.416+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:43.461 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:43.461 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:43.469 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:09:43.514 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:43.516+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:43.599 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:09:43.613 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:43.613 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:43.615 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:43.618+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:43.622 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:09:43.716 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:43.719+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:43.733 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:43.733 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:43.750 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:43.750 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:43.755 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:43.755 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:43.765 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:09:43.767 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:09:43.767 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:09:43.784 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:43.784 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:43.801 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:43.801 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:43.818 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:43.820+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:43.818 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:43.818 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:43.870 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:43.870 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:43.870 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:43.870 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:43.870 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:43.879 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:09:43.918 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:43.920+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:44.002 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T09:09:44.019 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:44.021+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:44.031 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:44.031 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:44.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:44.031 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:44.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.031 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55979 3.e 3:740d1568:::rbd_data.1112a10502fe.0000000000000133:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:44.031 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:44.031 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.181726681000001, 2024-09-14T09:09:44.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.95211669700000001, 2024-09-14T09:09:44.032 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.032 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.032 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:44.032 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.032 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:44.032 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:44.032 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55979 2024-09-14T09:09:44.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.032 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:44.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:44.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850380+0000", 2024-09-14T09:09:44.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.615e-06 2024-09-14T09:09:44.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850386+0000", 2024-09-14T09:09:44.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8000000000000001e-06 2024-09-14T09:09:44.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850403+0000", 2024-09-14T09:09:44.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6339999999999999e-05 2024-09-14T09:09:44.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850413+0000", 2024-09-14T09:09:44.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8609999999999993e-06 2024-09-14T09:09:44.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851033+0000", 2024-09-14T09:09:44.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062034700000000004 2024-09-14T09:09:44.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:09:44.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851042+0000", 2024-09-14T09:09:44.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8340000000000005e-06 2024-09-14T09:09:44.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853175+0000", 2024-09-14T09:09:44.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0021332809999999999 2024-09-14T09:09:44.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:44.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853183+0000", 2024-09-14T09:09:44.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:09:44.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795232+0000", 2024-09-14T09:09:44.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94204854900000001 2024-09-14T09:09:44.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795413+0000", 2024-09-14T09:09:44.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018059200000000001 2024-09-14T09:09:44.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:09:44.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795717+0000", 2024-09-14T09:09:44.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000304636 2024-09-14T09:09:44.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:44.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799631+0000", 2024-09-14T09:09:44.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136910000000004 2024-09-14T09:09:44.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:44.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802290+0000", 2024-09-14T09:09:44.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026588010000000001 2024-09-14T09:09:44.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:44.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802362+0000", 2024-09-14T09:09:44.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2018000000000001e-05 2024-09-14T09:09:44.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802495+0000", 2024-09-14T09:09:44.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000132967 2024-09-14T09:09:44.039 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.039 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.039 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.039 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55990 3.e 3:72d6260e:::rbd_data.1112a10502fe.000000000000016c:head [stat,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:44.039 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:44.039 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.181665374000001, 2024-09-14T09:09:44.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.952433164, 2024-09-14T09:09:44.039 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.039 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.039 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.039 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.040 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:44.040 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:44.040 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55990 2024-09-14T09:09:44.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.040 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:44.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:44.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850440+0000", 2024-09-14T09:09:44.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5199999999999996e-07 2024-09-14T09:09:44.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850444+0000", 2024-09-14T09:09:44.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.019e-06 2024-09-14T09:09:44.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850452+0000", 2024-09-14T09:09:44.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0209999999999999e-06 2024-09-14T09:09:44.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850457+0000", 2024-09-14T09:09:44.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9529999999999998e-06 2024-09-14T09:09:44.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851100+0000", 2024-09-14T09:09:44.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00064299699999999997 2024-09-14T09:09:44.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:44.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851108+0000", 2024-09-14T09:09:44.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2279999999999998e-06 2024-09-14T09:09:44.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853208+0000", 2024-09-14T09:09:44.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020996579999999999 2024-09-14T09:09:44.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:44.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853213+0000", 2024-09-14T09:09:44.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4029999999999998e-06 2024-09-14T09:09:44.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796098+0000", 2024-09-14T09:09:44.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94288483700000003 2024-09-14T09:09:44.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796247+0000", 2024-09-14T09:09:44.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014925800000000001 2024-09-14T09:09:44.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802872+0000", 2024-09-14T09:09:44.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006625138 2024-09-14T09:09:44.045 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.045 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.045 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.045 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:44.045 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:44.045 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.017426601, 2024-09-14T09:09:44.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77465830800000002, 2024-09-14T09:09:44.045 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.045 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.045 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:44.045 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.046 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:44.046 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:44.046 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 58987 2024-09-14T09:09:44.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.046 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:44.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:44.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014680+0000", 2024-09-14T09:09:44.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9250000000000002e-06 2024-09-14T09:09:44.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014689+0000", 2024-09-14T09:09:44.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9730000000000003e-06 2024-09-14T09:09:44.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014709+0000", 2024-09-14T09:09:44.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9641999999999999e-05 2024-09-14T09:09:44.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014720+0000", 2024-09-14T09:09:44.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-09-14T09:09:44.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014796+0000", 2024-09-14T09:09:44.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6567000000000001e-05 2024-09-14T09:09:44.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:44.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014808+0000", 2024-09-14T09:09:44.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1435e-05 2024-09-14T09:09:44.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789325+0000", 2024-09-14T09:09:44.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77451705999999998 2024-09-14T09:09:44.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789336+0000", 2024-09-14T09:09:44.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1466e-05 2024-09-14T09:09:44.049 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.049 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.049 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.050 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:59017 3.3 3.6b81fb83 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:44.050 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:44.050 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.015774196999999, 2024-09-14T09:09:44.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77253447099999994, 2024-09-14T09:09:44.050 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.050 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.050 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:44.050 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.050 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:44.050 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:44.050 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 59017 2024-09-14T09:09:44.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.051 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:44.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:44.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016332+0000", 2024-09-14T09:09:44.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3459999999999999e-06 2024-09-14T09:09:44.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016337+0000", 2024-09-14T09:09:44.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.48e-06 2024-09-14T09:09:44.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016355+0000", 2024-09-14T09:09:44.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7955e-05 2024-09-14T09:09:44.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016364+0000", 2024-09-14T09:09:44.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.02e-06 2024-09-14T09:09:44.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016433+0000", 2024-09-14T09:09:44.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8398000000000005e-05 2024-09-14T09:09:44.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:44.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016442+0000", 2024-09-14T09:09:44.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1819999999999995e-06 2024-09-14T09:09:44.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788855+0000", 2024-09-14T09:09:44.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77241356299999997 2024-09-14T09:09:44.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788865+0000", 2024-09-14T09:09:44.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5270000000000004e-06 2024-09-14T09:09:44.054 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.054 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.054 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.054 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60343 3.e 3:721b16e6:::rbd_data.1112a10502fe.000000000000014b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:44.055 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:44.055 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.911804595, 2024-09-14T09:09:44.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68876920900000005, 2024-09-14T09:09:44.055 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.055 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.055 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:44.055 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.055 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:44.055 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:44.055 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60343 2024-09-14T09:09:44.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.055 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:44.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:44.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120302+0000", 2024-09-14T09:09:44.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0279999999999999e-06 2024-09-14T09:09:44.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120310+0000", 2024-09-14T09:09:44.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4330000000000004e-06 2024-09-14T09:09:44.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120333+0000", 2024-09-14T09:09:44.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2200000000000001e-05 2024-09-14T09:09:44.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120343+0000", 2024-09-14T09:09:44.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0560000000000001e-05 2024-09-14T09:09:44.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120414+0000", 2024-09-14T09:09:44.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0493000000000004e-05 2024-09-14T09:09:44.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:44.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120424+0000", 2024-09-14T09:09:44.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.059e-05 2024-09-14T09:09:44.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796679+0000", 2024-09-14T09:09:44.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67625512700000001 2024-09-14T09:09:44.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796833+0000", 2024-09-14T09:09:44.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015403500000000001 2024-09-14T09:09:44.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:09:44.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797239+0000", 2024-09-14T09:09:44.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040503000000000002 2024-09-14T09:09:44.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:44.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802918+0000", 2024-09-14T09:09:44.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056796199999999998 2024-09-14T09:09:44.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:44.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808655+0000", 2024-09-14T09:09:44.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057365089999999999 2024-09-14T09:09:44.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:44.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808850+0000", 2024-09-14T09:09:44.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000194904 2024-09-14T09:09:44.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809069+0000", 2024-09-14T09:09:44.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021968000000000001 2024-09-14T09:09:44.061 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.061 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.061 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.061 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60356 3.2 3:40f9e9e7:::rbd_data.1112a10502fe.0000000000000160:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:44.061 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:44.061 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.910742081999999, 2024-09-14T09:09:44.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68053790800000002, 2024-09-14T09:09:44.062 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.062 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.062 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:44.062 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.062 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:44.062 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:44.062 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60356 2024-09-14T09:09:44.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.062 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:44.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:44.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121364+0000", 2024-09-14T09:09:44.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.173e-06 2024-09-14T09:09:44.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121371+0000", 2024-09-14T09:09:44.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-09-14T09:09:44.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121386+0000", 2024-09-14T09:09:44.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4925e-05 2024-09-14T09:09:44.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121395+0000", 2024-09-14T09:09:44.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8190000000000003e-06 2024-09-14T09:09:44.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121464+0000", 2024-09-14T09:09:44.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8149000000000001e-05 2024-09-14T09:09:44.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:44.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121474+0000", 2024-09-14T09:09:44.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0927999999999999e-05 2024-09-14T09:09:44.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795901+0000", 2024-09-14T09:09:44.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67442645499999998 2024-09-14T09:09:44.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796068+0000", 2024-09-14T09:09:44.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016655700000000001 2024-09-14T09:09:44.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 3", 2024-09-14T09:09:44.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796354+0000", 2024-09-14T09:09:44.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00028646999999999999 2024-09-14T09:09:44.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:44.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.800348+0000", 2024-09-14T09:09:44.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039943119999999999 2024-09-14T09:09:44.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:44.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801690+0000", 2024-09-14T09:09:44.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013415090000000001 2024-09-14T09:09:44.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:44.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801771+0000", 2024-09-14T09:09:44.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1678e-05 2024-09-14T09:09:44.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801900+0000", 2024-09-14T09:09:44.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000128978 2024-09-14T09:09:44.069 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.069 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.070 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.070 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62163 3.e 3:713ab431:::rbd_data.1112a10502fe.0000000000000198:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:44.070 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:44.070 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.820371874999999, 2024-09-14T09:09:44.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.597552682, 2024-09-14T09:09:44.070 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.070 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.070 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.070 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.070 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:44.070 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:44.070 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62163 2024-09-14T09:09:44.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.071 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:44.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:44.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211735+0000", 2024-09-14T09:09:44.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1110000000000002e-06 2024-09-14T09:09:44.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211744+0000", 2024-09-14T09:09:44.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0790000000000007e-06 2024-09-14T09:09:44.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211765+0000", 2024-09-14T09:09:44.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1114000000000001e-05 2024-09-14T09:09:44.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211775+0000", 2024-09-14T09:09:44.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0033e-05 2024-09-14T09:09:44.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211847+0000", 2024-09-14T09:09:44.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1503999999999998e-05 2024-09-14T09:09:44.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:44.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211857+0000", 2024-09-14T09:09:44.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0378e-05 2024-09-14T09:09:44.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799140+0000", 2024-09-14T09:09:44.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.58728279100000003 2024-09-14T09:09:44.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799289+0000", 2024-09-14T09:09:44.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000148966 2024-09-14T09:09:44.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809285+0000", 2024-09-14T09:09:44.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099967059999999993 2024-09-14T09:09:44.074 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.075 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.075 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.075 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63582 3.2 3:467f2009:::rbd_data.1112a10502fe.00000000000001a1:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:44.075 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:44.075 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.745178758000002, 2024-09-14T09:09:44.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51869012999999997, 2024-09-14T09:09:44.075 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.075 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.075 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.075 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.075 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:44.075 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:44.076 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63582 2024-09-14T09:09:44.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.076 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:44.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:44.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286928+0000", 2024-09-14T09:09:44.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.812e-06 2024-09-14T09:09:44.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286936+0000", 2024-09-14T09:09:44.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2390000000000002e-06 2024-09-14T09:09:44.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286955+0000", 2024-09-14T09:09:44.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8853000000000001e-05 2024-09-14T09:09:44.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286972+0000", 2024-09-14T09:09:44.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7365000000000001e-05 2024-09-14T09:09:44.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287052+0000", 2024-09-14T09:09:44.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9491000000000002e-05 2024-09-14T09:09:44.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:44.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287063+0000", 2024-09-14T09:09:44.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1620999999999999e-05 2024-09-14T09:09:44.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796696+0000", 2024-09-14T09:09:44.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50963256999999995 2024-09-14T09:09:44.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796847+0000", 2024-09-14T09:09:44.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015126899999999999 2024-09-14T09:09:44.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.805616+0000", 2024-09-14T09:09:44.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087689099999999996 2024-09-14T09:09:44.080 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.080 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.080 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.080 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63586 3.3 3.d4e49b03 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:44.080 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:44.080 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.745094377000001, 2024-09-14T09:09:44.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50188935099999998, 2024-09-14T09:09:44.080 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.080 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.080 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:44.081 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.081 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:44.081 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:44.081 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63586 2024-09-14T09:09:44.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.081 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:44.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:44.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287011+0000", 2024-09-14T09:09:44.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.61e-07 2024-09-14T09:09:44.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287014+0000", 2024-09-14T09:09:44.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3900000000000002e-06 2024-09-14T09:09:44.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287023+0000", 2024-09-14T09:09:44.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3380000000000005e-06 2024-09-14T09:09:44.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287029+0000", 2024-09-14T09:09:44.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0079999999999999e-06 2024-09-14T09:09:44.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287087+0000", 2024-09-14T09:09:44.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8322000000000002e-05 2024-09-14T09:09:44.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:44.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287096+0000", 2024-09-14T09:09:44.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8580000000000006e-06 2024-09-14T09:09:44.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788891+0000", 2024-09-14T09:09:44.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50179498499999997 2024-09-14T09:09:44.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788900+0000", 2024-09-14T09:09:44.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.789e-06 2024-09-14T09:09:44.084 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.084 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.085 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.085 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60363 3.1d 3:b8b44067:::rbd_data.1112a10502fe.000000000000018b:head [stat,delete] snapc 21=[21] RETRY=12 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:44.085 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:44.085 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.244372639000002, 2024-09-14T09:09:44.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268612690000001, 2024-09-14T09:09:44.085 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.085 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.085 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.086 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.086 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:44.086 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:44.086 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60363 2024-09-14T09:09:44.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.086 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:44.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:44.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787733+0000", 2024-09-14T09:09:44.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.314e-06 2024-09-14T09:09:44.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787739+0000", 2024-09-14T09:09:44.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5300000000000004e-06 2024-09-14T09:09:44.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787750+0000", 2024-09-14T09:09:44.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1251e-05 2024-09-14T09:09:44.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:44.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0739999999999993e-06 2024-09-14T09:09:44.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787827+0000", 2024-09-14T09:09:44.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8861000000000004e-05 2024-09-14T09:09:44.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:09:44.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787836+0000", 2024-09-14T09:09:44.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1339999999999993e-06 2024-09-14T09:09:44.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789335+0000", 2024-09-14T09:09:44.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014988289999999999 2024-09-14T09:09:44.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:44.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789343+0000", 2024-09-14T09:09:44.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6639999999999998e-06 2024-09-14T09:09:44.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799170+0000", 2024-09-14T09:09:44.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098272500000001 2024-09-14T09:09:44.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799377+0000", 2024-09-14T09:09:44.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000207126 2024-09-14T09:09:44.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814593+0000", 2024-09-14T09:09:44.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015216235999999999 2024-09-14T09:09:44.091 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.091 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.091 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.091 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63565 3.1d 3:bdc63b28:::rbd_data.1112a10502fe.000000000000016d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=9 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:44.091 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:44.091 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.244326848, 2024-09-14T09:09:44.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0271114539999999, 2024-09-14T09:09:44.091 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.091 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.091 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:44.091 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.091 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:44.091 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:44.092 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63565 2024-09-14T09:09:44.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.092 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:44.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:44.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:44.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6899999999999998e-07 2024-09-14T09:09:44.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787781+0000", 2024-09-14T09:09:44.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8909999999999999e-06 2024-09-14T09:09:44.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787787+0000", 2024-09-14T09:09:44.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3230000000000003e-06 2024-09-14T09:09:44.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787793+0000", 2024-09-14T09:09:44.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-09-14T09:09:44.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789455+0000", 2024-09-14T09:09:44.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001661596 2024-09-14T09:09:44.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:44.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789463+0000", 2024-09-14T09:09:44.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4889999999999995e-06 2024-09-14T09:09:44.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800115+0000", 2024-09-14T09:09:44.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0106512670000001 2024-09-14T09:09:44.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800334+0000", 2024-09-14T09:09:44.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000219213 2024-09-14T09:09:44.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:09:44.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800651+0000", 2024-09-14T09:09:44.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00031765500000000002 2024-09-14T09:09:44.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:44.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.811875+0000", 2024-09-14T09:09:44.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011224032 2024-09-14T09:09:44.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:44.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814665+0000", 2024-09-14T09:09:44.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002789606 2024-09-14T09:09:44.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:44.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814742+0000", 2024-09-14T09:09:44.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6916999999999996e-05 2024-09-14T09:09:44.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814889+0000", 2024-09-14T09:09:44.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014725799999999999 2024-09-14T09:09:44.097 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.097 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.097 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.097 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:67113 3.1d 3:bba7fe0d:::rbd_data.1112a10502fe.00000000000001bf:head [stat,delete] snapc 21=[21] RETRY=4 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:44.098 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:44.098 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.24356599, 2024-09-14T09:09:44.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0265995649999999, 2024-09-14T09:09:44.098 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.098 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.098 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.098 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.098 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:44.098 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:44.098 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 67113 2024-09-14T09:09:44.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.098 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:44.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:44.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:44.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:09:44.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788543+0000", 2024-09-14T09:09:44.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-09-14T09:09:44.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788552+0000", 2024-09-14T09:09:44.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:09:44.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788559+0000", 2024-09-14T09:09:44.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:09:44.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789489+0000", 2024-09-14T09:09:44.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00092982199999999996 2024-09-14T09:09:44.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:44.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789497+0000", 2024-09-14T09:09:44.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6299999999999998e-06 2024-09-14T09:09:44.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801068+0000", 2024-09-14T09:09:44.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0115709530000001 2024-09-14T09:09:44.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801240+0000", 2024-09-14T09:09:44.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017276600000000001 2024-09-14T09:09:44.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815138+0000", 2024-09-14T09:09:44.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013897856 2024-09-14T09:09:44.103 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.103 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.103 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.103 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73412 3.1d 3:be4606c3:::rbd_data.1112a10502fe.00000000000001f2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:44.103 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:44.103 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.243534877999998, 2024-09-14T09:09:44.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026815928, 2024-09-14T09:09:44.103 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.103 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.103 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.104 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.104 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:44.104 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:44.104 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73412 2024-09-14T09:09:44.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.104 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:44.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:44.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:44.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5699999999999998e-07 2024-09-14T09:09:44.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788572+0000", 2024-09-14T09:09:44.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2809999999999998e-06 2024-09-14T09:09:44.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788579+0000", 2024-09-14T09:09:44.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5629999999999997e-06 2024-09-14T09:09:44.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788584+0000", 2024-09-14T09:09:44.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1710000000000001e-06 2024-09-14T09:09:44.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789521+0000", 2024-09-14T09:09:44.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00093657400000000002 2024-09-14T09:09:44.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:44.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789528+0000", 2024-09-14T09:09:44.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5719999999999997e-06 2024-09-14T09:09:44.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801631+0000", 2024-09-14T09:09:44.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0121023229999999 2024-09-14T09:09:44.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801792+0000", 2024-09-14T09:09:44.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016174000000000001 2024-09-14T09:09:44.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815386+0000", 2024-09-14T09:09:44.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013593246999999999 2024-09-14T09:09:44.108 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.108 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.108 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.108 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:77244 3.1d 3:b801be19:::rbd_data.1112a10502fe.0000000000000204:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:44.108 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:44.108 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.061670631999998, 2024-09-14T09:09:44.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.84519277100000001, 2024-09-14T09:09:44.108 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.108 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.109 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.109 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.109 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:44.109 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:44.109 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 77244 2024-09-14T09:09:44.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.109 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:44.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:44.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970436+0000", 2024-09-14T09:09:44.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.511e-06 2024-09-14T09:09:44.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970441+0000", 2024-09-14T09:09:44.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0470000000000001e-06 2024-09-14T09:09:44.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970453+0000", 2024-09-14T09:09:44.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2629999999999999e-05 2024-09-14T09:09:44.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970461+0000", 2024-09-14T09:09:44.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6850000000000001e-06 2024-09-14T09:09:44.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970524+0000", 2024-09-14T09:09:44.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3332999999999998e-05 2024-09-14T09:09:44.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:44.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970544+0000", 2024-09-14T09:09:44.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9731000000000001e-05 2024-09-14T09:09:44.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802188+0000", 2024-09-14T09:09:44.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.83164380000000004 2024-09-14T09:09:44.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:09:44.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015411999999999999 2024-09-14T09:09:44.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815627+0000", 2024-09-14T09:09:44.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013284914 2024-09-14T09:09:44.113 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.113 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.113 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.113 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:79796 3.1d 3:bc22caaf:::rbd_data.1112a10502fe.000000000000020c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:44.113 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:44.113 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.940361945999999, 2024-09-14T09:09:44.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72411694299999996, 2024-09-14T09:09:44.114 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.114 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.114 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.114 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.114 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:44.114 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:44.114 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 79796 2024-09-14T09:09:44.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.114 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:44.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:44.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091745+0000", 2024-09-14T09:09:44.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2000000000000001e-06 2024-09-14T09:09:44.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091752+0000", 2024-09-14T09:09:44.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-09-14T09:09:44.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091772+0000", 2024-09-14T09:09:44.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9822000000000001e-05 2024-09-14T09:09:44.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091791+0000", 2024-09-14T09:09:44.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9236e-05 2024-09-14T09:09:44.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091882+0000", 2024-09-14T09:09:44.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0783000000000001e-05 2024-09-14T09:09:44.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:44.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091892+0000", 2024-09-14T09:09:44.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7999999999999993e-06 2024-09-14T09:09:44.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802744+0000", 2024-09-14T09:09:44.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.710851868 2024-09-14T09:09:44.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802902+0000", 2024-09-14T09:09:44.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015814900000000001 2024-09-14T09:09:44.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815860+0000", 2024-09-14T09:09:44.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012957605000000001 2024-09-14T09:09:44.118 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.118 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.118 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.118 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80904 3.1d 3:be0e7f3d:::rbd_data.1112a10502fe.0000000000000214:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:44.118 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:44.119 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.860276099, 2024-09-14T09:09:44.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64435178100000001, 2024-09-14T09:09:44.119 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.119 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.119 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.119 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.119 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:44.119 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:44.119 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80904 2024-09-14T09:09:44.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.119 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:44.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:44.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171831+0000", 2024-09-14T09:09:44.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0729999999999999e-06 2024-09-14T09:09:44.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171839+0000", 2024-09-14T09:09:44.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9179999999999994e-06 2024-09-14T09:09:44.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171857+0000", 2024-09-14T09:09:44.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8957000000000002e-05 2024-09-14T09:09:44.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171867+0000", 2024-09-14T09:09:44.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7100000000000002e-06 2024-09-14T09:09:44.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171957+0000", 2024-09-14T09:09:44.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9932999999999994e-05 2024-09-14T09:09:44.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:44.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171974+0000", 2024-09-14T09:09:44.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6988999999999999e-05 2024-09-14T09:09:44.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803301+0000", 2024-09-14T09:09:44.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63132648599999996 2024-09-14T09:09:44.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803482+0000", 2024-09-14T09:09:44.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000181607 2024-09-14T09:09:44.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816180+0000", 2024-09-14T09:09:44.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012698108 2024-09-14T09:09:44.123 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.123 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.123 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.124 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80964 3.1d 3:be42e20f:::rbd_data.1112a10502fe.0000000000000219:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:44.124 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:44.124 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.854640532000001, 2024-09-14T09:09:44.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63896829799999999, 2024-09-14T09:09:44.124 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.124 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.124 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.124 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.124 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:44.124 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:44.124 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80964 2024-09-14T09:09:44.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.124 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:44.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:44.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177466+0000", 2024-09-14T09:09:44.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6610000000000001e-06 2024-09-14T09:09:44.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177472+0000", 2024-09-14T09:09:44.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3029999999999996e-06 2024-09-14T09:09:44.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177490+0000", 2024-09-14T09:09:44.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8099000000000001e-05 2024-09-14T09:09:44.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177499+0000", 2024-09-14T09:09:44.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:09:44.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177560+0000", 2024-09-14T09:09:44.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1334000000000006e-05 2024-09-14T09:09:44.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:44.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177578+0000", 2024-09-14T09:09:44.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8434999999999999e-05 2024-09-14T09:09:44.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803910+0000", 2024-09-14T09:09:44.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62633190699999997 2024-09-14T09:09:44.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.806612+0000", 2024-09-14T09:09:44.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002702257 2024-09-14T09:09:44.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816432+0000", 2024-09-14T09:09:44.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098199370000000008 2024-09-14T09:09:44.128 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.128 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.129 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.129 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83321 3.1d 3:bb24b47b:::rbd_data.1112a10502fe.0000000000000223:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:44.129 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:44.129 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.740186858000001, 2024-09-14T09:09:44.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52477628799999998, 2024-09-14T09:09:44.129 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.129 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.129 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.129 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.129 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:44.129 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:44.129 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83321 2024-09-14T09:09:44.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.130 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:44.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:44.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291920+0000", 2024-09-14T09:09:44.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.888e-06 2024-09-14T09:09:44.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291926+0000", 2024-09-14T09:09:44.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6059999999999999e-06 2024-09-14T09:09:44.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291943+0000", 2024-09-14T09:09:44.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6813e-05 2024-09-14T09:09:44.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291952+0000", 2024-09-14T09:09:44.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7439999999999996e-06 2024-09-14T09:09:44.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292023+0000", 2024-09-14T09:09:44.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1320000000000002e-05 2024-09-14T09:09:44.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:44.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292030+0000", 2024-09-14T09:09:44.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4219999999999997e-06 2024-09-14T09:09:44.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807221+0000", 2024-09-14T09:09:44.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51519140699999999 2024-09-14T09:09:44.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807406+0000", 2024-09-14T09:09:44.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018532800000000001 2024-09-14T09:09:44.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816694+0000", 2024-09-14T09:09:44.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092877600000000008 2024-09-14T09:09:44.134 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.134 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.134 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.134 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83358 3.1d 3:bb230e23:::rbd_data.1112a10502fe.000000000000022b:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:44.134 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:44.134 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.738666968, 2024-09-14T09:09:44.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52374808900000003, 2024-09-14T09:09:44.134 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.134 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.134 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.134 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.134 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:44.135 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:44.135 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83358 2024-09-14T09:09:44.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.135 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:44.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:44.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293439+0000", 2024-09-14T09:09:44.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5899999999999995e-07 2024-09-14T09:09:44.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293443+0000", 2024-09-14T09:09:44.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9309999999999999e-06 2024-09-14T09:09:44.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293457+0000", 2024-09-14T09:09:44.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3944999999999999e-05 2024-09-14T09:09:44.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293466+0000", 2024-09-14T09:09:44.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4319999999999999e-06 2024-09-14T09:09:44.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293530+0000", 2024-09-14T09:09:44.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3860000000000002e-05 2024-09-14T09:09:44.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:44.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293540+0000", 2024-09-14T09:09:44.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0107e-05 2024-09-14T09:09:44.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809096+0000", 2024-09-14T09:09:44.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51555587800000002 2024-09-14T09:09:44.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809265+0000", 2024-09-14T09:09:44.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000169092 2024-09-14T09:09:44.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817186+0000", 2024-09-14T09:09:44.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079209850000000002 2024-09-14T09:09:44.139 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.139 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.139 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.139 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83361 3.1d 3:bd571564:::rbd_data.1112a10502fe.000000000000022c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:44.139 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:44.139 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.738348892000001, 2024-09-14T09:09:44.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52373873100000001, 2024-09-14T09:09:44.139 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.140 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.140 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.140 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.140 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:44.140 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:44.140 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83361 2024-09-14T09:09:44.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.140 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:44.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:44.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293757+0000", 2024-09-14T09:09:44.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8000000000000004e-07 2024-09-14T09:09:44.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293762+0000", 2024-09-14T09:09:44.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8019999999999997e-06 2024-09-14T09:09:44.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293775+0000", 2024-09-14T09:09:44.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2884000000000001e-05 2024-09-14T09:09:44.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293783+0000", 2024-09-14T09:09:44.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:09:44.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293849+0000", 2024-09-14T09:09:44.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5859999999999996e-05 2024-09-14T09:09:44.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:44.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293861+0000", 2024-09-14T09:09:44.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2238999999999999e-05 2024-09-14T09:09:44.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809680+0000", 2024-09-14T09:09:44.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51581856800000003 2024-09-14T09:09:44.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809844+0000", 2024-09-14T09:09:44.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016441200000000001 2024-09-14T09:09:44.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817494+0000", 2024-09-14T09:09:44.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076502360000000004 2024-09-14T09:09:44.144 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.144 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.144 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.144 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.144 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.144 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:44.146 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:09:44.146 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:44.148+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:44.247 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:44.249+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:44.292 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:44.292 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:44.292 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:09:44.292 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:44.301 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:09:44.348 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:44.350+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:44.402 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:44.403 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:44.403 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:44.403 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:44.403 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:44.411 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:09:44.452 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:44.454+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:44.551 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:44.553+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:44.555 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:44.555 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:44.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:44.556 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:44.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.556 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2265 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4034560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:44.556 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:44.556 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.694514437999999, 2024-09-14T09:09:44.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073974829000000006, 2024-09-14T09:09:44.556 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.556 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.556 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.556 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.556 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:44.557 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:44.557 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2265 2024-09-14T09:09:44.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.557 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:44.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:44.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862542+0000", 2024-09-14T09:09:44.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:09:44.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862543+0000", 2024-09-14T09:09:44.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.81e-06 2024-09-14T09:09:44.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862549+0000", 2024-09-14T09:09:44.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8850000000000004e-06 2024-09-14T09:09:44.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862554+0000", 2024-09-14T09:09:44.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5279999999999997e-06 2024-09-14T09:09:44.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936318+0000", 2024-09-14T09:09:44.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073764422999999996 2024-09-14T09:09:44.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936412+0000", 2024-09-14T09:09:44.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3801000000000005e-05 2024-09-14T09:09:44.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936516+0000", 2024-09-14T09:09:44.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000104007 2024-09-14T09:09:44.560 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.560 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.560 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.560 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2266 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4096000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:44.561 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:44.561 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.694496573999999, 2024-09-14T09:09:44.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074208332000000002, 2024-09-14T09:09:44.561 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.561 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.561 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.561 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.561 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:44.561 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:44.561 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2266 2024-09-14T09:09:44.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.561 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:44.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:44.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862738+0000", 2024-09-14T09:09:44.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017920300000000001 2024-09-14T09:09:44.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862744+0000", 2024-09-14T09:09:44.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3000000000000001e-06 2024-09-14T09:09:44.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862753+0000", 2024-09-14T09:09:44.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8179999999999999e-06 2024-09-14T09:09:44.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862785+0000", 2024-09-14T09:09:44.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1949000000000002e-05 2024-09-14T09:09:44.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936556+0000", 2024-09-14T09:09:44.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073770268999999999 2024-09-14T09:09:44.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936657+0000", 2024-09-14T09:09:44.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101387 2024-09-14T09:09:44.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936767+0000", 2024-09-14T09:09:44.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110406 2024-09-14T09:09:44.565 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.565 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.565 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.565 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2267 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4157440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:44.565 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:44.565 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.694257992000004, 2024-09-14T09:09:44.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074200918000000005, 2024-09-14T09:09:44.565 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.565 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.565 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.566 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.566 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:44.566 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:44.566 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2267 2024-09-14T09:09:44.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.566 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:44.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:44.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863416+0000", 2024-09-14T09:09:44.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000618492 2024-09-14T09:09:44.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863421+0000", 2024-09-14T09:09:44.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1359999999999996e-06 2024-09-14T09:09:44.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863434+0000", 2024-09-14T09:09:44.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2291e-05 2024-09-14T09:09:44.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863444+0000", 2024-09-14T09:09:44.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9769999999999995e-06 2024-09-14T09:09:44.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936808+0000", 2024-09-14T09:09:44.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073364051999999999 2024-09-14T09:09:44.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936892+0000", 2024-09-14T09:09:44.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4641999999999994e-05 2024-09-14T09:09:44.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936999+0000", 2024-09-14T09:09:44.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106328 2024-09-14T09:09:44.569 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.569 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.569 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.569 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2329 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 106496~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:44.570 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:44.570 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.693529382999998, 2024-09-14T09:09:44.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074180251000000003, 2024-09-14T09:09:44.570 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.570 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.570 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.570 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.570 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:44.570 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:44.570 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2329 2024-09-14T09:09:44.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.570 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:44.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:44.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864203+0000", 2024-09-14T09:09:44.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000677015 2024-09-14T09:09:44.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864208+0000", 2024-09-14T09:09:44.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.972e-06 2024-09-14T09:09:44.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864221+0000", 2024-09-14T09:09:44.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2683e-05 2024-09-14T09:09:44.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864229+0000", 2024-09-14T09:09:44.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0809999999999994e-06 2024-09-14T09:09:44.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937430+0000", 2024-09-14T09:09:44.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073201231000000005 2024-09-14T09:09:44.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937513+0000", 2024-09-14T09:09:44.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2652999999999996e-05 2024-09-14T09:09:44.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937707+0000", 2024-09-14T09:09:44.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000193616 2024-09-14T09:09:44.574 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.574 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.574 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.574 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2331 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 229376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:44.574 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:44.574 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.692711885999998, 2024-09-14T09:09:44.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.07400843, 2024-09-14T09:09:44.574 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.574 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.574 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.574 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.575 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:44.575 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:44.575 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2331 2024-09-14T09:09:44.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.575 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:44.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:44.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868104+0000", 2024-09-14T09:09:44.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003760453 2024-09-14T09:09:44.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868109+0000", 2024-09-14T09:09:44.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9339999999999997e-06 2024-09-14T09:09:44.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868119+0000", 2024-09-14T09:09:44.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5389999999999996e-06 2024-09-14T09:09:44.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868126+0000", 2024-09-14T09:09:44.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4499999999999998e-06 2024-09-14T09:09:44.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938065+0000", 2024-09-14T09:09:44.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069938809000000005 2024-09-14T09:09:44.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938148+0000", 2024-09-14T09:09:44.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3171999999999996e-05 2024-09-14T09:09:44.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938352+0000", 2024-09-14T09:09:44.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020407300000000001 2024-09-14T09:09:44.578 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.578 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.578 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.578 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2380 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3239936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:44.578 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:44.578 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.677686858000001, 2024-09-14T09:09:44.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073985913, 2024-09-14T09:09:44.578 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.579 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.579 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.579 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.579 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:44.579 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:44.579 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2380 2024-09-14T09:09:44.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.579 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:44.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:44.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879697+0000", 2024-09-14T09:09:44.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032864100000000001 2024-09-14T09:09:44.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879702+0000", 2024-09-14T09:09:44.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.578e-06 2024-09-14T09:09:44.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879716+0000", 2024-09-14T09:09:44.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.413e-05 2024-09-14T09:09:44.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879724+0000", 2024-09-14T09:09:44.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.559e-06 2024-09-14T09:09:44.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953155+0000", 2024-09-14T09:09:44.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073431221000000005 2024-09-14T09:09:44.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953247+0000", 2024-09-14T09:09:44.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1662000000000004e-05 2024-09-14T09:09:44.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953355+0000", 2024-09-14T09:09:44.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010812200000000001 2024-09-14T09:09:44.582 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.582 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.582 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.583 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2501 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2850816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:44.583 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:44.583 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.659144553999994, 2024-09-14T09:09:44.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074288858999999999, 2024-09-14T09:09:44.583 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.583 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.583 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.583 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.583 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:44.583 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:44.583 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2501 2024-09-14T09:09:44.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.584 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:44.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:44.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:44.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.41e-07 2024-09-14T09:09:44.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897913+0000", 2024-09-14T09:09:44.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3090000000000001e-06 2024-09-14T09:09:44.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897918+0000", 2024-09-14T09:09:44.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8470000000000003e-06 2024-09-14T09:09:44.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897922+0000", 2024-09-14T09:09:44.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5549999999999996e-06 2024-09-14T09:09:44.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971872+0000", 2024-09-14T09:09:44.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073950057999999999 2024-09-14T09:09:44.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971958+0000", 2024-09-14T09:09:44.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5941999999999998e-05 2024-09-14T09:09:44.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972200+0000", 2024-09-14T09:09:44.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000241907 2024-09-14T09:09:44.587 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.587 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.587 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.587 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2502 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2912256~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:44.587 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:44.587 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.659105374000006, 2024-09-14T09:09:44.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074614080999999999, 2024-09-14T09:09:44.588 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.588 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.588 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.588 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.588 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:44.588 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:44.588 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2502 2024-09-14T09:09:44.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.588 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:44.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:44.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897951+0000", 2024-09-14T09:09:44.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:09:44.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897953+0000", 2024-09-14T09:09:44.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5670000000000002e-06 2024-09-14T09:09:44.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897970+0000", 2024-09-14T09:09:44.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6319000000000001e-05 2024-09-14T09:09:44.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897976+0000", 2024-09-14T09:09:44.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8760000000000002e-06 2024-09-14T09:09:44.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972245+0000", 2024-09-14T09:09:44.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074269186000000001 2024-09-14T09:09:44.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972333+0000", 2024-09-14T09:09:44.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7800999999999995e-05 2024-09-14T09:09:44.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972564+0000", 2024-09-14T09:09:44.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000231833 2024-09-14T09:09:44.592 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.592 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.592 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.592 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2503 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2973696~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:44.592 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:44.592 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.659071357000002, 2024-09-14T09:09:44.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074944286999999998, 2024-09-14T09:09:44.592 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.592 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.592 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.592 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.592 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:44.593 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:44.593 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2503 2024-09-14T09:09:44.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.593 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:44.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:44.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897985+0000", 2024-09-14T09:09:44.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999998e-07 2024-09-14T09:09:44.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897987+0000", 2024-09-14T09:09:44.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.401e-06 2024-09-14T09:09:44.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897999+0000", 2024-09-14T09:09:44.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1851999999999999e-05 2024-09-14T09:09:44.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898005+0000", 2024-09-14T09:09:44.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9789999999999998e-06 2024-09-14T09:09:44.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972609+0000", 2024-09-14T09:09:44.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074604217 2024-09-14T09:09:44.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972684+0000", 2024-09-14T09:09:44.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4777999999999995e-05 2024-09-14T09:09:44.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972929+0000", 2024-09-14T09:09:44.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024448100000000001 2024-09-14T09:09:44.596 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.596 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.596 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.596 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2504 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3035136~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:44.597 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:44.597 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.659043264999994, 2024-09-14T09:09:44.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075285131000000005, 2024-09-14T09:09:44.597 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.597 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.597 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.597 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.597 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:44.597 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:44.597 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2504 2024-09-14T09:09:44.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.597 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:44.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:44.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898078+0000", 2024-09-14T09:09:44.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5775e-05 2024-09-14T09:09:44.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898082+0000", 2024-09-14T09:09:44.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.49e-06 2024-09-14T09:09:44.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898092+0000", 2024-09-14T09:09:44.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0509999999999999e-05 2024-09-14T09:09:44.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898099+0000", 2024-09-14T09:09:44.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.81e-06 2024-09-14T09:09:44.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972971+0000", 2024-09-14T09:09:44.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074871788999999994 2024-09-14T09:09:44.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973055+0000", 2024-09-14T09:09:44.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3980000000000006e-05 2024-09-14T09:09:44.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973298+0000", 2024-09-14T09:09:44.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024277700000000001 2024-09-14T09:09:44.600 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.601 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.601 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.601 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2505 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3096576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:44.601 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:44.601 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.658947010000006, 2024-09-14T09:09:44.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075506668999999998, 2024-09-14T09:09:44.601 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.601 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.601 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.601 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.602 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:44.602 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:44.602 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2505 2024-09-14T09:09:44.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.602 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:44.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:44.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898370+0000", 2024-09-14T09:09:44.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026128799999999998 2024-09-14T09:09:44.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898374+0000", 2024-09-14T09:09:44.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8070000000000001e-06 2024-09-14T09:09:44.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898383+0000", 2024-09-14T09:09:44.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0520000000000007e-06 2024-09-14T09:09:44.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898389+0000", 2024-09-14T09:09:44.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2639999999999997e-06 2024-09-14T09:09:44.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973330+0000", 2024-09-14T09:09:44.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074940548999999995 2024-09-14T09:09:44.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973402+0000", 2024-09-14T09:09:44.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2556000000000001e-05 2024-09-14T09:09:44.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973615+0000", 2024-09-14T09:09:44.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000213153 2024-09-14T09:09:44.605 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.605 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.605 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.605 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2506 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3158016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:44.605 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:44.606 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.658653766, 2024-09-14T09:09:44.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075556110999999995, 2024-09-14T09:09:44.606 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.606 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.606 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.606 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.606 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:44.606 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:44.606 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2506 2024-09-14T09:09:44.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.606 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:44.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:44.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898497+0000", 2024-09-14T09:09:44.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4806e-05 2024-09-14T09:09:44.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898500+0000", 2024-09-14T09:09:44.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.54e-06 2024-09-14T09:09:44.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898507+0000", 2024-09-14T09:09:44.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1590000000000004e-06 2024-09-14T09:09:44.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898513+0000", 2024-09-14T09:09:44.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.015e-06 2024-09-14T09:09:44.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973656+0000", 2024-09-14T09:09:44.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075142929999999997 2024-09-14T09:09:44.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973742+0000", 2024-09-14T09:09:44.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5535e-05 2024-09-14T09:09:44.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973958+0000", 2024-09-14T09:09:44.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000216126 2024-09-14T09:09:44.609 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.610 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.610 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.610 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2507 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3219456~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:44.610 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:44.610 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.658525182000005, 2024-09-14T09:09:44.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075623459000000004, 2024-09-14T09:09:44.610 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.610 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.610 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.610 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.610 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:44.610 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:44.611 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2507 2024-09-14T09:09:44.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.611 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:44.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:44.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898761+0000", 2024-09-14T09:09:44.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000230614 2024-09-14T09:09:44.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898765+0000", 2024-09-14T09:09:44.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6629999999999999e-06 2024-09-14T09:09:44.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898774+0000", 2024-09-14T09:09:44.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6749999999999997e-06 2024-09-14T09:09:44.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898781+0000", 2024-09-14T09:09:44.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4640000000000003e-06 2024-09-14T09:09:44.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973985+0000", 2024-09-14T09:09:44.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075204101999999995 2024-09-14T09:09:44.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974063+0000", 2024-09-14T09:09:44.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7632000000000005e-05 2024-09-14T09:09:44.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974154+0000", 2024-09-14T09:09:44.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1309000000000003e-05 2024-09-14T09:09:44.614 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.614 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.614 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.614 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2508 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3280896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:44.614 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:44.614 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.658263418999994, 2024-09-14T09:09:44.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075576943999999993, 2024-09-14T09:09:44.615 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.615 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.615 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.615 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.615 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:44.615 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:44.615 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2508 2024-09-14T09:09:44.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.615 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:44.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:44.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899176+0000", 2024-09-14T09:09:44.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038340500000000002 2024-09-14T09:09:44.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899179+0000", 2024-09-14T09:09:44.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0290000000000001e-06 2024-09-14T09:09:44.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899186+0000", 2024-09-14T09:09:44.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8199999999999999e-06 2024-09-14T09:09:44.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899190+0000", 2024-09-14T09:09:44.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2050000000000004e-06 2024-09-14T09:09:44.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974193+0000", 2024-09-14T09:09:44.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075003632000000001 2024-09-14T09:09:44.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974276+0000", 2024-09-14T09:09:44.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2272000000000001e-05 2024-09-14T09:09:44.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974369+0000", 2024-09-14T09:09:44.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3580999999999997e-05 2024-09-14T09:09:44.618 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.618 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.618 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.619 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2509 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3342336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:44.619 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:44.619 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.657855802, 2024-09-14T09:09:44.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075356229999999996, 2024-09-14T09:09:44.619 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.619 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.619 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.619 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.619 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:44.619 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:44.619 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2509 2024-09-14T09:09:44.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.620 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:44.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:44.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899439+0000", 2024-09-14T09:09:44.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023958599999999999 2024-09-14T09:09:44.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899444+0000", 2024-09-14T09:09:44.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8790000000000002e-06 2024-09-14T09:09:44.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899455+0000", 2024-09-14T09:09:44.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0597999999999999e-05 2024-09-14T09:09:44.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899462+0000", 2024-09-14T09:09:44.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8179999999999998e-06 2024-09-14T09:09:44.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974400+0000", 2024-09-14T09:09:44.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074937999000000005 2024-09-14T09:09:44.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974465+0000", 2024-09-14T09:09:44.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5134000000000004e-05 2024-09-14T09:09:44.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974556+0000", 2024-09-14T09:09:44.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1216000000000002e-05 2024-09-14T09:09:44.623 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.623 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.623 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.623 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2510 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3403776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:44.623 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:44.623 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.657580409000005, 2024-09-14T09:09:44.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075295775999999995, 2024-09-14T09:09:44.623 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.623 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.624 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.624 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.624 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:44.624 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:44.624 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2510 2024-09-14T09:09:44.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.624 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:44.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:44.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899691+0000", 2024-09-14T09:09:44.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021615999999999999 2024-09-14T09:09:44.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899696+0000", 2024-09-14T09:09:44.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3200000000000001e-06 2024-09-14T09:09:44.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899704+0000", 2024-09-14T09:09:44.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9440000000000005e-06 2024-09-14T09:09:44.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899710+0000", 2024-09-14T09:09:44.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.584e-06 2024-09-14T09:09:44.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974594+0000", 2024-09-14T09:09:44.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074883551000000007 2024-09-14T09:09:44.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974679+0000", 2024-09-14T09:09:44.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5365999999999995e-05 2024-09-14T09:09:44.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974771+0000", 2024-09-14T09:09:44.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1850999999999999e-05 2024-09-14T09:09:44.627 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.627 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.627 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.627 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2511 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3465216~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:44.628 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:44.628 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.657334191000004, 2024-09-14T09:09:44.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075234668000000005, 2024-09-14T09:09:44.628 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.628 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.628 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.628 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.628 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:44.628 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:44.628 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2511 2024-09-14T09:09:44.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.628 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:44.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:44.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899951+0000", 2024-09-14T09:09:44.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000229569 2024-09-14T09:09:44.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899955+0000", 2024-09-14T09:09:44.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1010000000000002e-06 2024-09-14T09:09:44.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899971+0000", 2024-09-14T09:09:44.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5648999999999999e-05 2024-09-14T09:09:44.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899978+0000", 2024-09-14T09:09:44.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0829999999999998e-06 2024-09-14T09:09:44.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974806+0000", 2024-09-14T09:09:44.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074828092999999998 2024-09-14T09:09:44.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974870+0000", 2024-09-14T09:09:44.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4492000000000005e-05 2024-09-14T09:09:44.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974956+0000", 2024-09-14T09:09:44.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5680999999999995e-05 2024-09-14T09:09:44.632 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.632 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.632 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.632 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2512 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3526656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:44.632 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:44.632 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.657066646000004, 2024-09-14T09:09:44.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075178812999999997, 2024-09-14T09:09:44.632 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.632 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.633 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.633 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.633 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:44.633 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:44.633 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2512 2024-09-14T09:09:44.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.633 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:44.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:44.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904181+0000", 2024-09-14T09:09:44.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041919399999999999 2024-09-14T09:09:44.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904186+0000", 2024-09-14T09:09:44.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2390000000000002e-06 2024-09-14T09:09:44.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904199+0000", 2024-09-14T09:09:44.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2709e-05 2024-09-14T09:09:44.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904207+0000", 2024-09-14T09:09:44.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8150000000000006e-06 2024-09-14T09:09:44.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975000+0000", 2024-09-14T09:09:44.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.070793444999999997 2024-09-14T09:09:44.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975079+0000", 2024-09-14T09:09:44.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8480999999999996e-05 2024-09-14T09:09:44.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975168+0000", 2024-09-14T09:09:44.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9184000000000005e-05 2024-09-14T09:09:44.636 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.636 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.636 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.637 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:22840 3.15 3:a8cf3dc2:::rbd_header.1112a10502fe:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:44.637 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:09:44.637 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.997493624000001, 2024-09-14T09:09:44.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.119998785, 2024-09-14T09:09:44.637 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.637 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.637 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.637 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.637 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:09:44.637 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:09:44.637 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 22840 2024-09-14T09:09:44.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.638 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:09:44.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:09:44.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642492+0000", 2024-09-14T09:09:44.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.082930276999999997 2024-09-14T09:09:44.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642495+0000", 2024-09-14T09:09:44.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9809999999999999e-06 2024-09-14T09:09:44.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642501+0000", 2024-09-14T09:09:44.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-09-14T09:09:44.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642506+0000", 2024-09-14T09:09:44.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6650000000000002e-06 2024-09-14T09:09:44.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679483+0000", 2024-09-14T09:09:44.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036977777000000003 2024-09-14T09:09:44.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679517+0000", 2024-09-14T09:09:44.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.345e-05 2024-09-14T09:09:44.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679561+0000", 2024-09-14T09:09:44.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3930999999999997e-05 2024-09-14T09:09:44.641 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.641 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.641 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.641 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:22857 3.15 3:a8cf3dc2:::rbd_header.1112a10502fe:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:44.641 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:09:44.641 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.847599699, 2024-09-14T09:09:44.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.088427917999999994, 2024-09-14T09:09:44.641 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:44.642 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:44.642 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:44.642 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:44.642 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:09:44.642 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:09:44.642 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 22857 2024-09-14T09:09:44.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.642 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:44.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:44.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:09:44.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:44.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:09:44.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:44.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:44.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777685+0000", 2024-09-14T09:09:44.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.068229181999999999 2024-09-14T09:09:44.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:44.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777688+0000", 2024-09-14T09:09:44.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1980000000000001e-06 2024-09-14T09:09:44.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:44.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777695+0000", 2024-09-14T09:09:44.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:09:44.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:44.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777700+0000", 2024-09-14T09:09:44.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0919999999999997e-06 2024-09-14T09:09:44.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:44.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797735+0000", 2024-09-14T09:09:44.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0200351 2024-09-14T09:09:44.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:44.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797800+0000", 2024-09-14T09:09:44.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4305000000000002e-05 2024-09-14T09:09:44.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:44.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:44.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:44.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797884+0000", 2024-09-14T09:09:44.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4344000000000004e-05 2024-09-14T09:09:44.645 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.645 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.645 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.645 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:44.646 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:44.646 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:44.647 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:09:44.652 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:44.654+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:44.753 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:44.755+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:44.791 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:44.791 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:44.791 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:09:44.791 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:44.800 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:09:44.854 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:44.856+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:44.943 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:44.944 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:44.944 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:44.944 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:44.944 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:44.952 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:09:44.955 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:44.956+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:44.999 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is set 2024-09-14T09:09:45.055 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:45.057+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:45.067 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:45.067 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:45.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:45.067 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:45.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.067 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:987 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:45.067 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:45.067 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.210007754999999, 2024-09-14T09:09:45.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001359466, 2024-09-14T09:09:45.068 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:45.068 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:45.068 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.068 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:45.068 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:45.068 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:45.068 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 987 2024-09-14T09:09:45.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.068 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:45.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:45.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:45.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:45.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:45.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:45.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858333+0000", 2024-09-14T09:09:45.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.621e-06 2024-09-14T09:09:45.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:45.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858349+0000", 2024-09-14T09:09:45.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5758000000000001e-05 2024-09-14T09:09:45.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:45.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858366+0000", 2024-09-14T09:09:45.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7368e-05 2024-09-14T09:09:45.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858382+0000", 2024-09-14T09:09:45.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6039e-05 2024-09-14T09:09:45.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858441+0000", 2024-09-14T09:09:45.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8662999999999997e-05 2024-09-14T09:09:45.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858449+0000", 2024-09-14T09:09:45.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3960000000000006e-06 2024-09-14T09:09:45.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859682+0000", 2024-09-14T09:09:45.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001233096 2024-09-14T09:09:45.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:45.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859691+0000", 2024-09-14T09:09:45.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5250000000000005e-06 2024-09-14T09:09:45.072 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.072 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:45.072 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.072 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:988 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:45.072 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:45.072 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.209879884999999, 2024-09-14T09:09:45.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0012656799999999, 2024-09-14T09:09:45.072 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:45.072 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:45.072 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.073 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:45.073 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:45.073 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:45.073 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 988 2024-09-14T09:09:45.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.073 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:45.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:45.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:45.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:45.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:45.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:45.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858460+0000", 2024-09-14T09:09:45.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9999999999999997e-07 2024-09-14T09:09:45.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:45.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858463+0000", 2024-09-14T09:09:45.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7459999999999998e-06 2024-09-14T09:09:45.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:45.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858471+0000", 2024-09-14T09:09:45.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3900000000000004e-06 2024-09-14T09:09:45.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858478+0000", 2024-09-14T09:09:45.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7020000000000004e-06 2024-09-14T09:09:45.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859102+0000", 2024-09-14T09:09:45.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062419699999999995 2024-09-14T09:09:45.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859109+0000", 2024-09-14T09:09:45.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7419999999999997e-06 2024-09-14T09:09:45.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859718+0000", 2024-09-14T09:09:45.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006085629999999 2024-09-14T09:09:45.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:45.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859725+0000", 2024-09-14T09:09:45.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7399999999999998e-06 2024-09-14T09:09:45.077 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.077 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:45.077 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.077 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1003 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:45.077 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:45.077 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.209016648000002, 2024-09-14T09:09:45.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009495209999999, 2024-09-14T09:09:45.077 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:45.077 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:45.078 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.078 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:45.078 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:45.078 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:45.078 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1003 2024-09-14T09:09:45.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.078 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:45.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:45.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:45.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:45.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:45.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:45.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859323+0000", 2024-09-14T09:09:45.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3099999999999998e-07 2024-09-14T09:09:45.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:45.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859326+0000", 2024-09-14T09:09:45.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-06 2024-09-14T09:09:45.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:45.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859333+0000", 2024-09-14T09:09:45.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3300000000000001e-06 2024-09-14T09:09:45.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859339+0000", 2024-09-14T09:09:45.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6400000000000002e-06 2024-09-14T09:09:45.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859387+0000", 2024-09-14T09:09:45.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8448000000000001e-05 2024-09-14T09:09:45.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:09:45.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9540000000000004e-06 2024-09-14T09:09:45.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860260+0000", 2024-09-14T09:09:45.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000864921 2024-09-14T09:09:45.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:45.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860272+0000", 2024-09-14T09:09:45.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1993e-05 2024-09-14T09:09:45.081 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.081 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:45.082 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.082 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1004 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:45.082 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:45.082 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.208981072999997, 2024-09-14T09:09:45.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000947875, 2024-09-14T09:09:45.082 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:45.082 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:45.082 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.082 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:45.082 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:45.082 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:45.082 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1004 2024-09-14T09:09:45.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.083 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:45.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:45.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:45.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:45.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:45.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:45.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:45.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7199999999999999e-07 2024-09-14T09:09:45.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:45.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859361+0000", 2024-09-14T09:09:45.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.892e-06 2024-09-14T09:09:45.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:45.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859368+0000", 2024-09-14T09:09:45.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4370000000000004e-06 2024-09-14T09:09:45.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859373+0000", 2024-09-14T09:09:45.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6690000000000003e-06 2024-09-14T09:09:45.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859430+0000", 2024-09-14T09:09:45.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6456999999999998e-05 2024-09-14T09:09:45.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859434+0000", 2024-09-14T09:09:45.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8410000000000002e-06 2024-09-14T09:09:45.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860299+0000", 2024-09-14T09:09:45.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008650370000001 2024-09-14T09:09:45.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:45.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860306+0000", 2024-09-14T09:09:45.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0700000000000001e-06 2024-09-14T09:09:45.086 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.086 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:45.086 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.086 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1005 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:45.086 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:45.087 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.208957400000003, 2024-09-14T09:09:45.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009585480000001, 2024-09-14T09:09:45.087 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:45.087 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:45.087 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.087 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:45.087 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:45.087 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:45.087 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1005 2024-09-14T09:09:45.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.087 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:45.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:45.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:45.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:45.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:45.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:45.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:45.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9700000000000002e-07 2024-09-14T09:09:45.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:45.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859384+0000", 2024-09-14T09:09:45.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.024e-06 2024-09-14T09:09:45.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:45.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859390+0000", 2024-09-14T09:09:45.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7080000000000002e-06 2024-09-14T09:09:45.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:09:45.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8980000000000004e-06 2024-09-14T09:09:45.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859527+0000", 2024-09-14T09:09:45.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013228099999999999 2024-09-14T09:09:45.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859532+0000", 2024-09-14T09:09:45.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5899999999999998e-06 2024-09-14T09:09:45.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860330+0000", 2024-09-14T09:09:45.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0007973509999999 2024-09-14T09:09:45.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:45.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860340+0000", 2024-09-14T09:09:45.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0299000000000001e-05 2024-09-14T09:09:45.091 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.091 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:45.091 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.091 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1006 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:45.092 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:45.092 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.208934204000002, 2024-09-14T09:09:45.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001032039, 2024-09-14T09:09:45.092 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:45.092 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:45.092 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.092 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:45.092 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:45.092 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:45.092 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1006 2024-09-14T09:09:45.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.092 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:45.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:45.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:45.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:45.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:45.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:45.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:45.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6499999999999999e-07 2024-09-14T09:09:45.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:45.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859407+0000", 2024-09-14T09:09:45.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1160000000000002e-06 2024-09-14T09:09:45.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:45.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859413+0000", 2024-09-14T09:09:45.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8880000000000002e-06 2024-09-14T09:09:45.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859419+0000", 2024-09-14T09:09:45.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3550000000000004e-06 2024-09-14T09:09:45.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859558+0000", 2024-09-14T09:09:45.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000138942 2024-09-14T09:09:45.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859563+0000", 2024-09-14T09:09:45.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.665e-06 2024-09-14T09:09:45.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860427+0000", 2024-09-14T09:09:45.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008635299999999 2024-09-14T09:09:45.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:45.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860437+0000", 2024-09-14T09:09:45.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0078000000000001e-05 2024-09-14T09:09:45.096 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.096 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:45.096 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.097 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1045 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:45.097 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:45.097 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.208734724000003, 2024-09-14T09:09:45.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008612990000001, 2024-09-14T09:09:45.097 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:45.097 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:45.097 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.097 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:45.097 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:45.097 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:45.097 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1045 2024-09-14T09:09:45.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.097 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:45.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:45.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:45.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:45.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:45.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:45.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859605+0000", 2024-09-14T09:09:45.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6e-07 2024-09-14T09:09:45.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:45.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859606+0000", 2024-09-14T09:09:45.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8819999999999999e-06 2024-09-14T09:09:45.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:45.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859610+0000", 2024-09-14T09:09:45.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4290000000000001e-06 2024-09-14T09:09:45.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859612+0000", 2024-09-14T09:09:45.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6309999999999999e-06 2024-09-14T09:09:45.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859643+0000", 2024-09-14T09:09:45.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0224000000000001e-05 2024-09-14T09:09:45.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859647+0000", 2024-09-14T09:09:45.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9049999999999999e-06 2024-09-14T09:09:45.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860458+0000", 2024-09-14T09:09:45.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008111180000001 2024-09-14T09:09:45.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:45.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860466+0000", 2024-09-14T09:09:45.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:09:45.101 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.101 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:45.101 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.102 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1046 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:45.102 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:45.102 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.208721267000001, 2024-09-14T09:09:45.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000874262, 2024-09-14T09:09:45.102 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:45.102 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:45.102 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:45.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:45.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:45.102 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1046 2024-09-14T09:09:45.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.102 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:45.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:45.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:45.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:45.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:45.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:45.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:45.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:09:45.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:45.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859619+0000", 2024-09-14T09:09:45.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0559999999999999e-06 2024-09-14T09:09:45.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:45.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859622+0000", 2024-09-14T09:09:45.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0170000000000001e-06 2024-09-14T09:09:45.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859625+0000", 2024-09-14T09:09:45.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7209999999999999e-06 2024-09-14T09:09:45.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859666+0000", 2024-09-14T09:09:45.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1677000000000001e-05 2024-09-14T09:09:45.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859672+0000", 2024-09-14T09:09:45.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4609999999999999e-06 2024-09-14T09:09:45.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860485+0000", 2024-09-14T09:09:45.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000813505 2024-09-14T09:09:45.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:45.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860492+0000", 2024-09-14T09:09:45.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6159999999999998e-06 2024-09-14T09:09:45.106 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.106 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:45.106 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.106 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1047 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:45.107 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:45.107 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.208709933000002, 2024-09-14T09:09:45.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008950190000001, 2024-09-14T09:09:45.107 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:45.107 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:45.107 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.107 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:45.107 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:45.107 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:45.107 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1047 2024-09-14T09:09:45.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.107 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:45.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:45.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:45.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:45.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:45.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:45.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:45.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6600000000000003e-07 2024-09-14T09:09:45.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:45.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859631+0000", 2024-09-14T09:09:45.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5600000000000001e-06 2024-09-14T09:09:45.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:45.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859637+0000", 2024-09-14T09:09:45.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7309999999999998e-06 2024-09-14T09:09:45.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859641+0000", 2024-09-14T09:09:45.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0840000000000002e-06 2024-09-14T09:09:45.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859691+0000", 2024-09-14T09:09:45.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0587999999999997e-05 2024-09-14T09:09:45.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859696+0000", 2024-09-14T09:09:45.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8940000000000001e-06 2024-09-14T09:09:45.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860516+0000", 2024-09-14T09:09:45.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008200780000001 2024-09-14T09:09:45.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:45.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860524+0000", 2024-09-14T09:09:45.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8180000000000004e-06 2024-09-14T09:09:45.111 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.111 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:45.111 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.111 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1048 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:45.111 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:45.111 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.208678173999999, 2024-09-14T09:09:45.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008904780000001, 2024-09-14T09:09:45.112 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:45.112 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:45.112 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.112 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:45.112 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:45.112 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:45.112 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1048 2024-09-14T09:09:45.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.112 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:45.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:45.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:45.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:45.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:45.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:45.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:45.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4700000000000002e-07 2024-09-14T09:09:45.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:45.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859663+0000", 2024-09-14T09:09:45.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0420000000000001e-06 2024-09-14T09:09:45.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:45.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859669+0000", 2024-09-14T09:09:45.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8989999999999998e-06 2024-09-14T09:09:45.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859673+0000", 2024-09-14T09:09:45.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2209999999999999e-06 2024-09-14T09:09:45.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859719+0000", 2024-09-14T09:09:45.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5788000000000003e-05 2024-09-14T09:09:45.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859725+0000", 2024-09-14T09:09:45.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4770000000000002e-06 2024-09-14T09:09:45.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860544+0000", 2024-09-14T09:09:45.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008194669999999 2024-09-14T09:09:45.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:45.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860551+0000", 2024-09-14T09:09:45.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1369999999999996e-06 2024-09-14T09:09:45.115 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.115 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:45.116 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.116 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1088 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:45.116 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:45.116 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.208459337000001, 2024-09-14T09:09:45.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00073166, 2024-09-14T09:09:45.116 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:45.116 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:45.116 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.116 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:45.116 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:45.116 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:45.116 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1088 2024-09-14T09:09:45.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.117 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:45.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:45.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:45.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:45.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:45.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:45.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:45.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3700000000000001e-07 2024-09-14T09:09:45.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:45.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859882+0000", 2024-09-14T09:09:45.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.739e-06 2024-09-14T09:09:45.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:45.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859887+0000", 2024-09-14T09:09:45.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:09:45.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859892+0000", 2024-09-14T09:09:45.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7119999999999999e-06 2024-09-14T09:09:45.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859945+0000", 2024-09-14T09:09:45.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2762000000000001e-05 2024-09-14T09:09:45.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859950+0000", 2024-09-14T09:09:45.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-09-14T09:09:45.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860603+0000", 2024-09-14T09:09:45.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000653263 2024-09-14T09:09:45.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:45.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860611+0000", 2024-09-14T09:09:45.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-09-14T09:09:45.120 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.120 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:45.120 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.120 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1089 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:45.120 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:45.121 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.208441180999998, 2024-09-14T09:09:45.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000733943, 2024-09-14T09:09:45.121 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:45.121 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:45.121 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.121 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:45.121 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:45.121 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:45.121 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1089 2024-09-14T09:09:45.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.121 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:45.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:45.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:45.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:45.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:45.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:45.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:45.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3000000000000002e-07 2024-09-14T09:09:45.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:45.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859900+0000", 2024-09-14T09:09:45.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9199999999999998e-06 2024-09-14T09:09:45.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:45.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859906+0000", 2024-09-14T09:09:45.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0889999999999996e-06 2024-09-14T09:09:45.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859911+0000", 2024-09-14T09:09:45.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6419999999999998e-06 2024-09-14T09:09:45.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860010+0000", 2024-09-14T09:09:45.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8956000000000006e-05 2024-09-14T09:09:45.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860014+0000", 2024-09-14T09:09:45.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.741e-06 2024-09-14T09:09:45.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860627+0000", 2024-09-14T09:09:45.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00061277 2024-09-14T09:09:45.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:45.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860632+0000", 2024-09-14T09:09:45.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:09:45.125 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.125 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:45.125 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.125 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1090 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:45.125 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:45.125 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.208421508999997, 2024-09-14T09:09:45.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000740763, 2024-09-14T09:09:45.126 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:45.126 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:45.126 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.126 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:45.126 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:45.126 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:45.126 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1090 2024-09-14T09:09:45.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.126 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:45.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:45.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:45.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:45.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:45.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:45.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859918+0000", 2024-09-14T09:09:45.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5199999999999998e-07 2024-09-14T09:09:45.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859920+0000", 2024-09-14T09:09:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9240000000000001e-06 2024-09-14T09:09:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859925+0000", 2024-09-14T09:09:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3929999999999999e-06 2024-09-14T09:09:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859929+0000", 2024-09-14T09:09:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4769999999999999e-06 2024-09-14T09:09:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860034+0000", 2024-09-14T09:09:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010549500000000001 2024-09-14T09:09:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860039+0000", 2024-09-14T09:09:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5700000000000003e-06 2024-09-14T09:09:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860650+0000", 2024-09-14T09:09:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006116119999999 2024-09-14T09:09:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860658+0000", 2024-09-14T09:09:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:09:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60374 3.14 3.6e2cd654 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.578543198999999, 2024-09-14T09:09:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3129433100000001, 2024-09-14T09:09:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60374 2024-09-14T09:09:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2100000000000002e-07 2024-09-14T09:09:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489799+0000", 2024-09-14T09:09:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3530000000000002e-06 2024-09-14T09:09:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489808+0000", 2024-09-14T09:09:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2e-06 2024-09-14T09:09:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489813+0000", 2024-09-14T09:09:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3249999999999998e-06 2024-09-14T09:09:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489866+0000", 2024-09-14T09:09:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3074e-05 2024-09-14T09:09:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489875+0000", 2024-09-14T09:09:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2760000000000006e-06 2024-09-14T09:09:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801379+0000", 2024-09-14T09:09:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.31150346200000001 2024-09-14T09:09:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801387+0000", 2024-09-14T09:09:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.038e-06 2024-09-14T09:09:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802728+0000", 2024-09-14T09:09:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013415569999999 2024-09-14T09:09:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802739+0000", 2024-09-14T09:09:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0604e-05 2024-09-14T09:09:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62179 3.14 3.78cf1974 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:09:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.578512570000001, 2024-09-14T09:09:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3129429109999999, 2024-09-14T09:09:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62179 2024-09-14T09:09:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:09:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:09:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:45.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489827+0000", 2024-09-14T09:09:45.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4300000000000003e-07 2024-09-14T09:09:45.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:45.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489829+0000", 2024-09-14T09:09:45.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2129999999999998e-06 2024-09-14T09:09:45.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:45.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489836+0000", 2024-09-14T09:09:45.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0360000000000001e-06 2024-09-14T09:09:45.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489841+0000", 2024-09-14T09:09:45.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0710000000000002e-06 2024-09-14T09:09:45.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489905+0000", 2024-09-14T09:09:45.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3578999999999996e-05 2024-09-14T09:09:45.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489913+0000", 2024-09-14T09:09:45.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2269999999999993e-06 2024-09-14T09:09:45.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801412+0000", 2024-09-14T09:09:45.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.311498989 2024-09-14T09:09:45.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801419+0000", 2024-09-14T09:09:45.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1400000000000002e-06 2024-09-14T09:09:45.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802761+0000", 2024-09-14T09:09:45.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013414620000001 2024-09-14T09:09:45.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:45.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802769+0000", 2024-09-14T09:09:45.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6510000000000007e-06 2024-09-14T09:09:45.141 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.141 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:45.141 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.141 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63551 3.14 3.88ccb734 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:45.141 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:09:45.141 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.578480939999999, 2024-09-14T09:09:45.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.312941181, 2024-09-14T09:09:45.142 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:45.142 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:45.142 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.142 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:45.142 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:45.142 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:45.142 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63551 2024-09-14T09:09:45.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.142 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:45.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:45.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:09:45.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:09:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489859+0000", 2024-09-14T09:09:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9200000000000001e-07 2024-09-14T09:09:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489862+0000", 2024-09-14T09:09:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9629999999999998e-06 2024-09-14T09:09:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489868+0000", 2024-09-14T09:09:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3890000000000002e-06 2024-09-14T09:09:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489875+0000", 2024-09-14T09:09:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7950000000000002e-06 2024-09-14T09:09:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489939+0000", 2024-09-14T09:09:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4704999999999998e-05 2024-09-14T09:09:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489949+0000", 2024-09-14T09:09:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7799999999999995e-06 2024-09-14T09:09:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801447+0000", 2024-09-14T09:09:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.311497527 2024-09-14T09:09:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801454+0000", 2024-09-14T09:09:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1080000000000004e-06 2024-09-14T09:09:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802790+0000", 2024-09-14T09:09:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013364330000001 2024-09-14T09:09:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802799+0000", 2024-09-14T09:09:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8890000000000008e-06 2024-09-14T09:09:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:68716 3.14 3.96fe1934 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:09:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.526910473000001, 2024-09-14T09:09:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2614012569999999, 2024-09-14T09:09:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 68716 2024-09-14T09:09:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:09:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:09:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541429+0000", 2024-09-14T09:09:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8899999999999998e-07 2024-09-14T09:09:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541433+0000", 2024-09-14T09:09:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7330000000000001e-06 2024-09-14T09:09:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541442+0000", 2024-09-14T09:09:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.346e-06 2024-09-14T09:09:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541449+0000", 2024-09-14T09:09:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.579e-06 2024-09-14T09:09:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541839+0000", 2024-09-14T09:09:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038993699999999998 2024-09-14T09:09:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541849+0000", 2024-09-14T09:09:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0217999999999999e-05 2024-09-14T09:09:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801480+0000", 2024-09-14T09:09:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.25963061399999998 2024-09-14T09:09:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801486+0000", 2024-09-14T09:09:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.776e-06 2024-09-14T09:09:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802821+0000", 2024-09-14T09:09:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00133435 2024-09-14T09:09:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802830+0000", 2024-09-14T09:09:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9150000000000002e-06 2024-09-14T09:09:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:69492 3.14 3.4a93714 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:09:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.466370777000002, 2024-09-14T09:09:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2008910690000001, 2024-09-14T09:09:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 69492 2024-09-14T09:09:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:09:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:09:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601969+0000", 2024-09-14T09:09:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3099999999999996e-07 2024-09-14T09:09:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601973+0000", 2024-09-14T09:09:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5899999999999999e-06 2024-09-14T09:09:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601983+0000", 2024-09-14T09:09:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098999999999999e-05 2024-09-14T09:09:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601989+0000", 2024-09-14T09:09:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0209999999999996e-06 2024-09-14T09:09:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.602066+0000", 2024-09-14T09:09:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7075000000000003e-05 2024-09-14T09:09:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.602075+0000", 2024-09-14T09:09:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8389999999999996e-06 2024-09-14T09:09:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801512+0000", 2024-09-14T09:09:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.199437225 2024-09-14T09:09:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801519+0000", 2024-09-14T09:09:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9970000000000001e-06 2024-09-14T09:09:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802851+0000", 2024-09-14T09:09:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001331711 2024-09-14T09:09:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802859+0000", 2024-09-14T09:09:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6810000000000004e-06 2024-09-14T09:09:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:72035 3.14 3.1cba9a34 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:09:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.347042889000001, 2024-09-14T09:09:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0815917340000001, 2024-09-14T09:09:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 72035 2024-09-14T09:09:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:09:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:09:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721297+0000", 2024-09-14T09:09:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5199999999999996e-07 2024-09-14T09:09:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721301+0000", 2024-09-14T09:09:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7790000000000002e-06 2024-09-14T09:09:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721309+0000", 2024-09-14T09:09:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8019999999999998e-06 2024-09-14T09:09:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721315+0000", 2024-09-14T09:09:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:09:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721367+0000", 2024-09-14T09:09:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2280000000000001e-05 2024-09-14T09:09:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721376+0000", 2024-09-14T09:09:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5439999999999999e-06 2024-09-14T09:09:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801545+0000", 2024-09-14T09:09:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.080169952000000003 2024-09-14T09:09:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801552+0000", 2024-09-14T09:09:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8390000000000001e-06 2024-09-14T09:09:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802879+0000", 2024-09-14T09:09:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001326846 2024-09-14T09:09:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802888+0000", 2024-09-14T09:09:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6330000000000002e-06 2024-09-14T09:09:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73403 3.14 3.87b99f94 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.304768228, 2024-09-14T09:09:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0393459899999999, 2024-09-14T09:09:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73403 2024-09-14T09:09:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9200000000000001e-07 2024-09-14T09:09:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763574+0000", 2024-09-14T09:09:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6510000000000001e-06 2024-09-14T09:09:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763582+0000", 2024-09-14T09:09:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2579999999999995e-06 2024-09-14T09:09:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763592+0000", 2024-09-14T09:09:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0193e-05 2024-09-14T09:09:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763643+0000", 2024-09-14T09:09:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0862000000000002e-05 2024-09-14T09:09:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763654+0000", 2024-09-14T09:09:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0890000000000001e-05 2024-09-14T09:09:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801577+0000", 2024-09-14T09:09:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037923074000000001 2024-09-14T09:09:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801584+0000", 2024-09-14T09:09:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0060000000000003e-06 2024-09-14T09:09:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802908+0000", 2024-09-14T09:09:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013235149999999 2024-09-14T09:09:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:45.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802917+0000", 2024-09-14T09:09:45.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9490000000000002e-06 2024-09-14T09:09:45.169 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.169 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:45.169 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.169 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:45.169 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:45.169 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:45.171 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:09:45.171 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:45.172+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:45.271 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:45.273+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:45.276 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:45.277 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:45.277 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:09:45.277 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:45.285 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:09:45.372 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:45.375+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:45.387 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:45.387 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:45.388 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:45.388 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:45.388 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:45.396 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:09:45.473 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:45.475+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:45.540 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:45.540 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:45.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:45.541 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:45.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.541 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:249 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1638400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:45.541 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:45.541 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 73.744929205000005, 2024-09-14T09:09:45.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99070346899999995, 2024-09-14T09:09:45.541 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:45.541 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:45.541 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:45.541 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:45.541 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:45.542 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:45.542 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 249 2024-09-14T09:09:45.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.542 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:45.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:45.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:45.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:45.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:45.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:45.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796868+0000", 2024-09-14T09:09:45.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2024-09-14T09:09:45.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:45.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796870+0000", 2024-09-14T09:09:45.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7889999999999999e-06 2024-09-14T09:09:45.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:45.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796877+0000", 2024-09-14T09:09:45.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8549999999999996e-06 2024-09-14T09:09:45.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796883+0000", 2024-09-14T09:09:45.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.665e-06 2024-09-14T09:09:45.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796915+0000", 2024-09-14T09:09:45.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2215999999999998e-05 2024-09-14T09:09:45.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796920+0000", 2024-09-14T09:09:45.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.527e-06 2024-09-14T09:09:45.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787468+0000", 2024-09-14T09:09:45.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99054877100000005 2024-09-14T09:09:45.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:45.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787512+0000", 2024-09-14T09:09:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3958000000000002e-05 2024-09-14T09:09:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787571+0000", 2024-09-14T09:09:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8167000000000001e-05 2024-09-14T09:09:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:250 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2097152~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:45.546 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 73.744903139000002, 2024-09-14T09:09:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99079431100000004, 2024-09-14T09:09:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 250 2024-09-14T09:09:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:45.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:45.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:45.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:45.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796894+0000", 2024-09-14T09:09:45.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2024-09-14T09:09:45.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:45.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796896+0000", 2024-09-14T09:09:45.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5600000000000001e-06 2024-09-14T09:09:45.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:45.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796902+0000", 2024-09-14T09:09:45.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3090000000000001e-06 2024-09-14T09:09:45.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796909+0000", 2024-09-14T09:09:45.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:09:45.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796942+0000", 2024-09-14T09:09:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-05 2024-09-14T09:09:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796948+0000", 2024-09-14T09:09:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5910000000000001e-06 2024-09-14T09:09:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787596+0000", 2024-09-14T09:09:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99064781400000002 2024-09-14T09:09:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787636+0000", 2024-09-14T09:09:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9715000000000002e-05 2024-09-14T09:09:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787687+0000", 2024-09-14T09:09:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1674e-05 2024-09-14T09:09:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:251 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 73.744877704000004, 2024-09-14T09:09:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99091769600000001, 2024-09-14T09:09:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 251 2024-09-14T09:09:45.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000005e-07 2024-09-14T09:09:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796922+0000", 2024-09-14T09:09:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.875e-06 2024-09-14T09:09:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796929+0000", 2024-09-14T09:09:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0260000000000002e-06 2024-09-14T09:09:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796935+0000", 2024-09-14T09:09:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7030000000000003e-06 2024-09-14T09:09:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796963+0000", 2024-09-14T09:09:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8368999999999999e-05 2024-09-14T09:09:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796966+0000", 2024-09-14T09:09:45.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4130000000000002e-06 2024-09-14T09:09:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787718+0000", 2024-09-14T09:09:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99075151100000003 2024-09-14T09:09:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787779+0000", 2024-09-14T09:09:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.088e-05 2024-09-14T09:09:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787836+0000", 2024-09-14T09:09:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7380000000000003e-05 2024-09-14T09:09:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:252 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 73.744852249999994, 2024-09-14T09:09:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99102491400000003, 2024-09-14T09:09:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:45.557 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 252 2024-09-14T09:09:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796945+0000", 2024-09-14T09:09:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2900000000000003e-07 2024-09-14T09:09:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796947+0000", 2024-09-14T09:09:45.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4279999999999999e-06 2024-09-14T09:09:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796954+0000", 2024-09-14T09:09:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5479999999999998e-06 2024-09-14T09:09:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796959+0000", 2024-09-14T09:09:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.22e-06 2024-09-14T09:09:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796988+0000", 2024-09-14T09:09:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9473000000000001e-05 2024-09-14T09:09:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:09:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787850+0000", 2024-09-14T09:09:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99085651100000005 2024-09-14T09:09:45.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787891+0000", 2024-09-14T09:09:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602000000000002e-05 2024-09-14T09:09:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787969+0000", 2024-09-14T09:09:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8063000000000001e-05 2024-09-14T09:09:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:253 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 73.744828369999993, 2024-09-14T09:09:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99122695699999996, 2024-09-14T09:09:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 253 2024-09-14T09:09:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:45.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:09:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:45.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:09:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:09:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796977+0000", 2024-09-14T09:09:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5030000000000002e-06 2024-09-14T09:09:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796982+0000", 2024-09-14T09:09:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2024-09-14T09:09:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797013+0000", 2024-09-14T09:09:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0451e-05 2024-09-14T09:09:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:09:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1690000000000001e-06 2024-09-14T09:09:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788011+0000", 2024-09-14T09:09:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99099490300000004 2024-09-14T09:09:45.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788102+0000", 2024-09-14T09:09:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0730999999999996e-05 2024-09-14T09:09:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788195+0000", 2024-09-14T09:09:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3245999999999995e-05 2024-09-14T09:09:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:254 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3932160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 73.744796812000004, 2024-09-14T09:09:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99137410500000001, 2024-09-14T09:09:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 254 2024-09-14T09:09:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:45.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:45.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797000+0000", 2024-09-14T09:09:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:09:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797003+0000", 2024-09-14T09:09:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7659999999999999e-06 2024-09-14T09:09:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797010+0000", 2024-09-14T09:09:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.029e-06 2024-09-14T09:09:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2024-09-14T09:09:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797044+0000", 2024-09-14T09:09:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9213e-05 2024-09-14T09:09:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797048+0000", 2024-09-14T09:09:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3400000000000002e-06 2024-09-14T09:09:45.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788222+0000", 2024-09-14T09:09:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99117407400000002 2024-09-14T09:09:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788306+0000", 2024-09-14T09:09:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4512999999999995e-05 2024-09-14T09:09:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788374+0000", 2024-09-14T09:09:45.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7226999999999999e-05 2024-09-14T09:09:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:264 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 73.744770454000005, 2024-09-14T09:09:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99161474699999996, 2024-09-14T09:09:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:45.573 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 264 2024-09-14T09:09:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:45.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2024-09-14T09:09:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:09:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2800000000000002e-06 2024-09-14T09:09:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0979999999999999e-06 2024-09-14T09:09:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797040+0000", 2024-09-14T09:09:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:09:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797068+0000", 2024-09-14T09:09:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7302999999999999e-05 2024-09-14T09:09:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797071+0000", 2024-09-14T09:09:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3610000000000001e-06 2024-09-14T09:09:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788436+0000", 2024-09-14T09:09:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99136489500000002 2024-09-14T09:09:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788538+0000", 2024-09-14T09:09:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101931 2024-09-14T09:09:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788641+0000", 2024-09-14T09:09:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010273899999999999 2024-09-14T09:09:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:265 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 73.744747094999994, 2024-09-14T09:09:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99176878199999996, 2024-09-14T09:09:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:45.578 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 265 2024-09-14T09:09:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:45.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:09:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.39e-07 2024-09-14T09:09:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797052+0000", 2024-09-14T09:09:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.345e-06 2024-09-14T09:09:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797058+0000", 2024-09-14T09:09:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5429999999999999e-06 2024-09-14T09:09:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797064+0000", 2024-09-14T09:09:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2000000000000002e-06 2024-09-14T09:09:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797091+0000", 2024-09-14T09:09:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7804e-05 2024-09-14T09:09:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797095+0000", 2024-09-14T09:09:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2024-09-14T09:09:45.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788667+0000", 2024-09-14T09:09:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157211300000003 2024-09-14T09:09:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788742+0000", 2024-09-14T09:09:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5159000000000003e-05 2024-09-14T09:09:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788818+0000", 2024-09-14T09:09:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6038000000000006e-05 2024-09-14T09:09:45.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:266 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 73.744724263999998, 2024-09-14T09:09:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99193390100000001, 2024-09-14T09:09:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:45.583 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 266 2024-09-14T09:09:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:09:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797075+0000", 2024-09-14T09:09:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2570000000000002e-06 2024-09-14T09:09:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797082+0000", 2024-09-14T09:09:45.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8029999999999997e-06 2024-09-14T09:09:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797088+0000", 2024-09-14T09:09:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.468e-06 2024-09-14T09:09:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797116+0000", 2024-09-14T09:09:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7752000000000001e-05 2024-09-14T09:09:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797121+0000", 2024-09-14T09:09:45.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5960000000000003e-06 2024-09-14T09:09:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788846+0000", 2024-09-14T09:09:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99172512199999996 2024-09-14T09:09:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788916+0000", 2024-09-14T09:09:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9843000000000002e-05 2024-09-14T09:09:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789006+0000", 2024-09-14T09:09:45.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9608e-05 2024-09-14T09:09:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:267 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 73.744699456999996, 2024-09-14T09:09:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99210926799999999, 2024-09-14T09:09:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:45.588 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 267 2024-09-14T09:09:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2399999999999999e-07 2024-09-14T09:09:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797099+0000", 2024-09-14T09:09:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.091e-06 2024-09-14T09:09:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797105+0000", 2024-09-14T09:09:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-09-14T09:09:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797111+0000", 2024-09-14T09:09:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5130000000000004e-06 2024-09-14T09:09:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797140+0000", 2024-09-14T09:09:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9513999999999999e-05 2024-09-14T09:09:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797145+0000", 2024-09-14T09:09:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:09:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789037+0000", 2024-09-14T09:09:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99189253899999996 2024-09-14T09:09:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789110+0000", 2024-09-14T09:09:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2848000000000005e-05 2024-09-14T09:09:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789206+0000", 2024-09-14T09:09:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5778000000000004e-05 2024-09-14T09:09:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:268 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 73.744676217999995, 2024-09-14T09:09:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992276359, 2024-09-14T09:09:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:45.593 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 268 2024-09-14T09:09:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:09:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797123+0000", 2024-09-14T09:09:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2740000000000002e-06 2024-09-14T09:09:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:45.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797129+0000", 2024-09-14T09:09:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-06 2024-09-14T09:09:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797134+0000", 2024-09-14T09:09:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9099999999999996e-06 2024-09-14T09:09:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797163+0000", 2024-09-14T09:09:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9709999999999998e-05 2024-09-14T09:09:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8709999999999999e-06 2024-09-14T09:09:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789231+0000", 2024-09-14T09:09:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992063959 2024-09-14T09:09:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789306+0000", 2024-09-14T09:09:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5289000000000004e-05 2024-09-14T09:09:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789396+0000", 2024-09-14T09:09:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9939999999999996e-05 2024-09-14T09:09:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:269 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2457600~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 73.744652708999993, 2024-09-14T09:09:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99242174400000005, 2024-09-14T09:09:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 269 2024-09-14T09:09:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:45.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:09:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797146+0000", 2024-09-14T09:09:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5289999999999998e-06 2024-09-14T09:09:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:45.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797153+0000", 2024-09-14T09:09:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1920000000000002e-06 2024-09-14T09:09:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797158+0000", 2024-09-14T09:09:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099999999999998e-06 2024-09-14T09:09:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797188+0000", 2024-09-14T09:09:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0128e-05 2024-09-14T09:09:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797194+0000", 2024-09-14T09:09:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6250000000000004e-06 2024-09-14T09:09:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789439+0000", 2024-09-14T09:09:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99224531000000005 2024-09-14T09:09:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789489+0000", 2024-09-14T09:09:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9830000000000002e-05 2024-09-14T09:09:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789565+0000", 2024-09-14T09:09:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6229000000000005e-05 2024-09-14T09:09:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:270 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 73.744628887000005, 2024-09-14T09:09:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99257721899999996, 2024-09-14T09:09:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:45.603 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 270 2024-09-14T09:09:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:45.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797168+0000", 2024-09-14T09:09:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2024-09-14T09:09:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797170+0000", 2024-09-14T09:09:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3120000000000001e-06 2024-09-14T09:09:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:45.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797177+0000", 2024-09-14T09:09:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0960000000000003e-06 2024-09-14T09:09:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797183+0000", 2024-09-14T09:09:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1669999999999998e-06 2024-09-14T09:09:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797213+0000", 2024-09-14T09:09:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0494e-05 2024-09-14T09:09:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:09:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:09:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789586+0000", 2024-09-14T09:09:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99236692100000001 2024-09-14T09:09:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789658+0000", 2024-09-14T09:09:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2279000000000004e-05 2024-09-14T09:09:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789745+0000", 2024-09-14T09:09:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6698000000000002e-05 2024-09-14T09:09:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:271 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3375104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 73.744603689000002, 2024-09-14T09:09:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99274791699999998, 2024-09-14T09:09:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:45.608 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 271 2024-09-14T09:09:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:45.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:09:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797195+0000", 2024-09-14T09:09:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1639999999999999e-06 2024-09-14T09:09:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797201+0000", 2024-09-14T09:09:45.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1290000000000001e-06 2024-09-14T09:09:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797206+0000", 2024-09-14T09:09:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9300000000000002e-06 2024-09-14T09:09:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797237+0000", 2024-09-14T09:09:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1285000000000003e-05 2024-09-14T09:09:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797242+0000", 2024-09-14T09:09:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6e-06 2024-09-14T09:09:45.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789768+0000", 2024-09-14T09:09:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99252547400000002 2024-09-14T09:09:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789826+0000", 2024-09-14T09:09:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8155999999999997e-05 2024-09-14T09:09:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789940+0000", 2024-09-14T09:09:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114788 2024-09-14T09:09:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:272 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 73.744580295000006, 2024-09-14T09:09:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99285248800000003, 2024-09-14T09:09:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:45.613 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 272 2024-09-14T09:09:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:09:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:09:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5129999999999999e-06 2024-09-14T09:09:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797226+0000", 2024-09-14T09:09:45.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4529999999999996e-06 2024-09-14T09:09:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797232+0000", 2024-09-14T09:09:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1839999999999998e-06 2024-09-14T09:09:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797264+0000", 2024-09-14T09:09:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2691999999999998e-05 2024-09-14T09:09:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797270+0000", 2024-09-14T09:09:45.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-06 2024-09-14T09:09:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789965+0000", 2024-09-14T09:09:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99269526200000002 2024-09-14T09:09:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790021+0000", 2024-09-14T09:09:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5297000000000003e-05 2024-09-14T09:09:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:45.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790068+0000", 2024-09-14T09:09:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7664999999999998e-05 2024-09-14T09:09:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:09:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.754323847999999, 2024-09-14T09:09:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146649299999999, 2024-09-14T09:09:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:45.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 58987 2024-09-14T09:09:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:09:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:09:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787474+0000", 2024-09-14T09:09:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1799999999999999e-06 2024-09-14T09:09:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787483+0000", 2024-09-14T09:09:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9830000000000002e-06 2024-09-14T09:09:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787494+0000", 2024-09-14T09:09:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1496e-05 2024-09-14T09:09:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787502+0000", 2024-09-14T09:09:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8280000000000003e-06 2024-09-14T09:09:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787563+0000", 2024-09-14T09:09:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1583999999999999e-05 2024-09-14T09:09:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:09:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787571+0000", 2024-09-14T09:09:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.058e-06 2024-09-14T09:09:45.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.791999+0000", 2024-09-14T09:09:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004428675 2024-09-14T09:09:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792008+0000", 2024-09-14T09:09:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9069999999999996e-06 2024-09-14T09:09:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802124+0000", 2024-09-14T09:09:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0101154619999999 2024-09-14T09:09:45.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802137+0000", 2024-09-14T09:09:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3757000000000001e-05 2024-09-14T09:09:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:67110 3.5 3.6b6808c5 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:09:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.754191033000001, 2024-09-14T09:09:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0147494290000001, 2024-09-14T09:09:45.623 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 67110 2024-09-14T09:09:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:09:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:09:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787606+0000", 2024-09-14T09:09:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6300000000000005e-07 2024-09-14T09:09:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787609+0000", 2024-09-14T09:09:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2789999999999999e-06 2024-09-14T09:09:45.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787616+0000", 2024-09-14T09:09:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8349999999999998e-06 2024-09-14T09:09:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787622+0000", 2024-09-14T09:09:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6999999999999996e-06 2024-09-14T09:09:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787666+0000", 2024-09-14T09:09:45.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3887000000000002e-05 2024-09-14T09:09:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787672+0000", 2024-09-14T09:09:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-09-14T09:09:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792033+0000", 2024-09-14T09:09:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043614250000000004 2024-09-14T09:09:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792041+0000", 2024-09-14T09:09:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5449999999999998e-06 2024-09-14T09:09:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:09:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0103013569999999 2024-09-14T09:09:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802355+0000", 2024-09-14T09:09:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2717999999999999e-05 2024-09-14T09:09:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.628 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72029 3.5 3.3f02ac5 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.754113518, 2024-09-14T09:09:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.014715139, 2024-09-14T09:09:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:45.629 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72029 2024-09-14T09:09:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7599999999999997e-07 2024-09-14T09:09:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787686+0000", 2024-09-14T09:09:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3999999999999999e-06 2024-09-14T09:09:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787692+0000", 2024-09-14T09:09:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3489999999999997e-06 2024-09-14T09:09:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787697+0000", 2024-09-14T09:09:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2320000000000001e-06 2024-09-14T09:09:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787742+0000", 2024-09-14T09:09:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4557e-05 2024-09-14T09:09:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787748+0000", 2024-09-14T09:09:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7810000000000002e-06 2024-09-14T09:09:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792065+0000", 2024-09-14T09:09:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043178679999999999 2024-09-14T09:09:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792073+0000", 2024-09-14T09:09:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6329999999999996e-06 2024-09-14T09:09:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802388+0000", 2024-09-14T09:09:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010315394 2024-09-14T09:09:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802398+0000", 2024-09-14T09:09:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4490000000000005e-06 2024-09-14T09:09:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72038 3.5 3.c914e45 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.754037884999999, 2024-09-14T09:09:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146757740000001, 2024-09-14T09:09:45.634 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72038 2024-09-14T09:09:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787759+0000", 2024-09-14T09:09:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0100000000000005e-07 2024-09-14T09:09:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787761+0000", 2024-09-14T09:09:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4049999999999998e-06 2024-09-14T09:09:45.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787768+0000", 2024-09-14T09:09:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.314e-06 2024-09-14T09:09:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787773+0000", 2024-09-14T09:09:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2789999999999998e-06 2024-09-14T09:09:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787813+0000", 2024-09-14T09:09:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9582000000000002e-05 2024-09-14T09:09:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787818+0000", 2024-09-14T09:09:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7100000000000004e-06 2024-09-14T09:09:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792096+0000", 2024-09-14T09:09:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042776460000000004 2024-09-14T09:09:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792103+0000", 2024-09-14T09:09:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7129999999999999e-06 2024-09-14T09:09:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802427+0000", 2024-09-14T09:09:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010324805 2024-09-14T09:09:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802434+0000", 2024-09-14T09:09:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:09:45.639 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:74840 3.5 3.ab2c8d25 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:09:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.731985999999999, 2024-09-14T09:09:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99271963600000002, 2024-09-14T09:09:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:45.640 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74840 2024-09-14T09:09:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:09:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:09:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809812+0000", 2024-09-14T09:09:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2899999999999999e-06 2024-09-14T09:09:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809817+0000", 2024-09-14T09:09:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0139999999999998e-06 2024-09-14T09:09:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809834+0000", 2024-09-14T09:09:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7643e-05 2024-09-14T09:09:45.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809842+0000", 2024-09-14T09:09:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2970000000000004e-06 2024-09-14T09:09:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809902+0000", 2024-09-14T09:09:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9106e-05 2024-09-14T09:09:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809912+0000", 2024-09-14T09:09:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0101e-05 2024-09-14T09:09:45.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802520+0000", 2024-09-14T09:09:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99260828599999995 2024-09-14T09:09:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802530+0000", 2024-09-14T09:09:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8989999999999996e-06 2024-09-14T09:09:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.644 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:45.645 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:45.645 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:45.646 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:09:45.647 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:45.648+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:45.746 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:45.748+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:45.790 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:45.791 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:45.791 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:09:45.791 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:45.799 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:09:45.830 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:09:45.874 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:45.876+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:45.902 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:45.902 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:45.902 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:45.902 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:45.902 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:45.910 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:09:45.947 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:45.949+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:45.961 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:45.961 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:45.977 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:45.977 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:45.993 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:09:45.993 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:09:46.013 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:46.013 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:46.022 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:46.022 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:46.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:46.022 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:46.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.022 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5349 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8302592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:46.023 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:46.023 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.76771377, 2024-09-14T09:09:46.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039875928999999997, 2024-09-14T09:09:46.023 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:46.023 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:46.023 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:46.023 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:46.023 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:46.023 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:46.023 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5349 2024-09-14T09:09:46.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.023 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:46.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:46.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:46.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:46.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:46.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:46.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255874+0000", 2024-09-14T09:09:46.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4900000000000001e-07 2024-09-14T09:09:46.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:46.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255880+0000", 2024-09-14T09:09:46.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9939999999999997e-06 2024-09-14T09:09:46.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:46.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255886+0000", 2024-09-14T09:09:46.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3899999999999998e-06 2024-09-14T09:09:46.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:46.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255891+0000", 2024-09-14T09:09:46.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.938e-06 2024-09-14T09:09:46.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295580+0000", 2024-09-14T09:09:46.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039688681000000003 2024-09-14T09:09:46.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:46.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295653+0000", 2024-09-14T09:09:46.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3045000000000003e-05 2024-09-14T09:09:46.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:46.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295749+0000", 2024-09-14T09:09:46.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6532000000000003e-05 2024-09-14T09:09:46.026 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.026 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:46.026 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.027 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5350 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8364032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:46.027 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:46.027 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.767689962999995, 2024-09-14T09:09:46.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039989719, 2024-09-14T09:09:46.027 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:46.027 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:46.027 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:46.027 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:46.027 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:46.027 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:46.027 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5350 2024-09-14T09:09:46.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.028 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:46.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:46.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:46.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:46.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:46.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:46.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255898+0000", 2024-09-14T09:09:46.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2024-09-14T09:09:46.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:46.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255899+0000", 2024-09-14T09:09:46.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9139999999999998e-06 2024-09-14T09:09:46.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:46.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255905+0000", 2024-09-14T09:09:46.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7289999999999997e-06 2024-09-14T09:09:46.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:46.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255910+0000", 2024-09-14T09:09:46.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6210000000000003e-06 2024-09-14T09:09:46.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295775+0000", 2024-09-14T09:09:46.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039864973999999997 2024-09-14T09:09:46.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:46.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295828+0000", 2024-09-14T09:09:46.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3411000000000001e-05 2024-09-14T09:09:46.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:46.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295887+0000", 2024-09-14T09:09:46.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699000000000002e-05 2024-09-14T09:09:46.031 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.031 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:46.031 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.031 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4639 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1843200~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:46.031 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:46.031 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.823774503999999, 2024-09-14T09:09:46.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040843672999999997, 2024-09-14T09:09:46.031 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:46.032 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:46.032 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:46.032 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:46.032 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:46.032 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:46.032 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4639 2024-09-14T09:09:46.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.032 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:46.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:46.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:46.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:46.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:46.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:46.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:46.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:09:46.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:46.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199818+0000", 2024-09-14T09:09:46.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1450000000000001e-06 2024-09-14T09:09:46.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:46.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199827+0000", 2024-09-14T09:09:46.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3999999999999998e-06 2024-09-14T09:09:46.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:46.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199834+0000", 2024-09-14T09:09:46.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0809999999999996e-06 2024-09-14T09:09:46.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240541+0000", 2024-09-14T09:09:46.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040706941000000003 2024-09-14T09:09:46.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:46.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240584+0000", 2024-09-14T09:09:46.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3040999999999997e-05 2024-09-14T09:09:46.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:46.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240656+0000", 2024-09-14T09:09:46.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2200000000000007e-05 2024-09-14T09:09:46.035 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.035 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:46.035 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.036 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4640 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1871872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:46.036 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:46.036 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.823740018999999, 2024-09-14T09:09:46.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040967601999999999, 2024-09-14T09:09:46.036 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:46.036 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:46.036 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:46.036 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:46.036 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:46.036 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:46.036 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4640 2024-09-14T09:09:46.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.037 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:46.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:46.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:46.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:46.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:46.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:46.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199848+0000", 2024-09-14T09:09:46.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5400000000000002e-07 2024-09-14T09:09:46.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:46.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199850+0000", 2024-09-14T09:09:46.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2479999999999999e-06 2024-09-14T09:09:46.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:46.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199857+0000", 2024-09-14T09:09:46.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.187e-06 2024-09-14T09:09:46.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:46.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199862+0000", 2024-09-14T09:09:46.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5119999999999999e-06 2024-09-14T09:09:46.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240684+0000", 2024-09-14T09:09:46.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040821245999999999 2024-09-14T09:09:46.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:46.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240739+0000", 2024-09-14T09:09:46.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4991999999999998e-05 2024-09-14T09:09:46.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:46.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240815+0000", 2024-09-14T09:09:46.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5963000000000004e-05 2024-09-14T09:09:46.040 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.040 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:46.040 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.040 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4641 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1900544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:46.040 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:46.040 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.823717688999999, 2024-09-14T09:09:46.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041205512, 2024-09-14T09:09:46.040 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:46.041 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:46.041 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:46.041 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:46.041 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:46.041 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:46.041 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4641 2024-09-14T09:09:46.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.041 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:46.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:46.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:46.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:46.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:46.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:46.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199870+0000", 2024-09-14T09:09:46.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0600000000000001e-07 2024-09-14T09:09:46.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:46.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199872+0000", 2024-09-14T09:09:46.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.928e-06 2024-09-14T09:09:46.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:46.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199877+0000", 2024-09-14T09:09:46.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6949999999999997e-06 2024-09-14T09:09:46.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:46.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199882+0000", 2024-09-14T09:09:46.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8210000000000001e-06 2024-09-14T09:09:46.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240847+0000", 2024-09-14T09:09:46.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040965201999999999 2024-09-14T09:09:46.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:46.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240888+0000", 2024-09-14T09:09:46.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0754000000000003e-05 2024-09-14T09:09:46.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:46.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241075+0000", 2024-09-14T09:09:46.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000186706 2024-09-14T09:09:46.044 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.044 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:46.044 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.045 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4642 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1929216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:46.045 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:46.045 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.823698753999999, 2024-09-14T09:09:46.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041292575999999998, 2024-09-14T09:09:46.045 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:46.045 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:46.045 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:46.045 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:46.045 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:46.045 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:46.045 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4642 2024-09-14T09:09:46.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.046 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:46.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:46.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:46.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:46.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:46.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:46.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199889+0000", 2024-09-14T09:09:46.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2024-09-14T09:09:46.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:46.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199891+0000", 2024-09-14T09:09:46.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9e-06 2024-09-14T09:09:46.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:46.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199896+0000", 2024-09-14T09:09:46.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6960000000000002e-06 2024-09-14T09:09:46.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:46.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199901+0000", 2024-09-14T09:09:46.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6720000000000003e-06 2024-09-14T09:09:46.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241089+0000", 2024-09-14T09:09:46.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041187594000000001 2024-09-14T09:09:46.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:46.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241126+0000", 2024-09-14T09:09:46.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7490999999999997e-05 2024-09-14T09:09:46.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:46.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241181+0000", 2024-09-14T09:09:46.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4823e-05 2024-09-14T09:09:46.049 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.049 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:46.049 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.049 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4643 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1957888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:46.049 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:46.049 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.823679474999999, 2024-09-14T09:09:46.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041418333000000002, 2024-09-14T09:09:46.049 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:46.049 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:46.049 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:46.049 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:46.050 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:46.050 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:46.050 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4643 2024-09-14T09:09:46.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.050 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:46.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:46.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:46.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:46.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:46.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:46.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:46.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5699999999999998e-07 2024-09-14T09:09:46.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:46.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199910+0000", 2024-09-14T09:09:46.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.829e-06 2024-09-14T09:09:46.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:46.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199916+0000", 2024-09-14T09:09:46.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8499999999999999e-06 2024-09-14T09:09:46.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:46.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199920+0000", 2024-09-14T09:09:46.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6530000000000002e-06 2024-09-14T09:09:46.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241211+0000", 2024-09-14T09:09:46.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041290327000000002 2024-09-14T09:09:46.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:46.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241257+0000", 2024-09-14T09:09:46.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6347000000000002e-05 2024-09-14T09:09:46.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:46.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241326+0000", 2024-09-14T09:09:46.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8969999999999999e-05 2024-09-14T09:09:46.053 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.053 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:46.053 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.053 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4644 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1986560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:46.054 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:46.054 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.823661135000002, 2024-09-14T09:09:46.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041596269999999998, 2024-09-14T09:09:46.054 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:46.054 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:46.054 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:46.054 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:46.054 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:46.054 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:46.054 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4644 2024-09-14T09:09:46.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.054 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:46.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:46.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:46.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:46.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:46.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:46.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:46.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.41e-07 2024-09-14T09:09:46.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:46.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199928+0000", 2024-09-14T09:09:46.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8250000000000001e-06 2024-09-14T09:09:46.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:46.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199934+0000", 2024-09-14T09:09:46.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2280000000000003e-06 2024-09-14T09:09:46.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:46.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199939+0000", 2024-09-14T09:09:46.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8010000000000003e-06 2024-09-14T09:09:46.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241360+0000", 2024-09-14T09:09:46.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041421289 2024-09-14T09:09:46.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:46.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241435+0000", 2024-09-14T09:09:46.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4238000000000003e-05 2024-09-14T09:09:46.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:46.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241522+0000", 2024-09-14T09:09:46.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7547999999999996e-05 2024-09-14T09:09:46.058 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.058 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:46.058 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.058 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4645 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:46.058 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:46.058 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.823642227999997, 2024-09-14T09:09:46.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041714660000000001, 2024-09-14T09:09:46.058 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:46.059 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:46.059 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:46.059 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:46.059 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:46.059 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:46.059 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4645 2024-09-14T09:09:46.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.059 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:46.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:46.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:46.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:46.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:46.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:46.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:46.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4700000000000002e-07 2024-09-14T09:09:46.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:46.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199947+0000", 2024-09-14T09:09:46.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.801e-06 2024-09-14T09:09:46.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:46.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199953+0000", 2024-09-14T09:09:46.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.694e-06 2024-09-14T09:09:46.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:46.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199957+0000", 2024-09-14T09:09:46.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3069999999999996e-06 2024-09-14T09:09:46.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241547+0000", 2024-09-14T09:09:46.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041589895000000002 2024-09-14T09:09:46.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:46.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241590+0000", 2024-09-14T09:09:46.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2985000000000003e-05 2024-09-14T09:09:46.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:46.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241660+0000", 2024-09-14T09:09:46.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9630999999999998e-05 2024-09-14T09:09:46.063 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.063 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:46.063 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.063 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4646 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2043904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:46.063 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:46.063 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.823624240000001, 2024-09-14T09:09:46.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041827171000000003, 2024-09-14T09:09:46.063 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:46.063 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:46.063 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:46.063 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:46.064 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:46.064 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:46.064 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4646 2024-09-14T09:09:46.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.064 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:46.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:46.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:46.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:46.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:46.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:46.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:46.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6300000000000001e-07 2024-09-14T09:09:46.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:46.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199965+0000", 2024-09-14T09:09:46.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.035e-06 2024-09-14T09:09:46.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:46.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199973+0000", 2024-09-14T09:09:46.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9629999999999998e-06 2024-09-14T09:09:46.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:46.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199978+0000", 2024-09-14T09:09:46.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9069999999999998e-06 2024-09-14T09:09:46.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241677+0000", 2024-09-14T09:09:46.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041698662999999997 2024-09-14T09:09:46.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:46.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241717+0000", 2024-09-14T09:09:46.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602999999999997e-05 2024-09-14T09:09:46.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:46.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241790+0000", 2024-09-14T09:09:46.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2637000000000003e-05 2024-09-14T09:09:46.067 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.067 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:46.067 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.067 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4647 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2072576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:46.067 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:46.067 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.823595650000001, 2024-09-14T09:09:46.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041921189999999997, 2024-09-14T09:09:46.068 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:46.068 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:46.068 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:46.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:46.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:46.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:46.068 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4647 2024-09-14T09:09:46.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.068 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:46.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:46.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:46.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:46.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:46.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:46.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199992+0000", 2024-09-14T09:09:46.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3799999999999997e-07 2024-09-14T09:09:46.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:46.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199994+0000", 2024-09-14T09:09:46.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3020000000000002e-06 2024-09-14T09:09:46.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:46.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200004+0000", 2024-09-14T09:09:46.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3510000000000008e-06 2024-09-14T09:09:46.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:46.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200008+0000", 2024-09-14T09:09:46.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3329999999999998e-06 2024-09-14T09:09:46.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241814+0000", 2024-09-14T09:09:46.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041806280000000001 2024-09-14T09:09:46.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:46.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241855+0000", 2024-09-14T09:09:46.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0173999999999999e-05 2024-09-14T09:09:46.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:46.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241913+0000", 2024-09-14T09:09:46.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8112000000000002e-05 2024-09-14T09:09:46.071 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.071 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:46.071 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.072 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:59017 3.3 3:c1df81d6:::rbd_data.1112a10502fe.0000000000000189:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:46.072 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:09:46.072 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 29.236305048999998, 2024-09-14T09:09:46.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.024252111, 2024-09-14T09:09:46.072 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:46.072 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:46.072 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:46.072 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:46.072 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:46.072 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:46.072 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59017 2024-09-14T09:09:46.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.072 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:46.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:46.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:09:46.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:46.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:09:46.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:46.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787284+0000", 2024-09-14T09:09:46.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3879999999999998e-06 2024-09-14T09:09:46.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:46.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787297+0000", 2024-09-14T09:09:46.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2184999999999999e-05 2024-09-14T09:09:46.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:46.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787317+0000", 2024-09-14T09:09:46.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0054000000000001e-05 2024-09-14T09:09:46.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:46.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787327+0000", 2024-09-14T09:09:46.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0335e-05 2024-09-14T09:09:46.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787412+0000", 2024-09-14T09:09:46.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4691000000000006e-05 2024-09-14T09:09:46.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:09:46.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787422+0000", 2024-09-14T09:09:46.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0718e-05 2024-09-14T09:09:46.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790539+0000", 2024-09-14T09:09:46.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031164600000000002 2024-09-14T09:09:46.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:46.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790552+0000", 2024-09-14T09:09:46.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2736e-05 2024-09-14T09:09:46.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.798725+0000", 2024-09-14T09:09:46.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0081731860000001 2024-09-14T09:09:46.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:46.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.798824+0000", 2024-09-14T09:09:46.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9600999999999997e-05 2024-09-14T09:09:46.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:46.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.811534+0000", 2024-09-14T09:09:46.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012709757 2024-09-14T09:09:46.077 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.077 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:46.077 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.078 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:63586 3.3 3:c0d9272b:::rbd_data.1112a10502fe.00000000000001a2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:46.078 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:46.078 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 29.236233565999999, 2024-09-14T09:09:46.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0244069650000001, 2024-09-14T09:09:46.078 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:46.078 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:46.078 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:46.078 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:46.078 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:46.078 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:46.078 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 63586 2024-09-14T09:09:46.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.079 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:46.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:46.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:46.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:46.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:46.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:46.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:46.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2024-09-14T09:09:46.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:46.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787357+0000", 2024-09-14T09:09:46.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8720000000000002e-06 2024-09-14T09:09:46.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:46.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787365+0000", 2024-09-14T09:09:46.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9270000000000005e-06 2024-09-14T09:09:46.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:46.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787372+0000", 2024-09-14T09:09:46.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6810000000000001e-06 2024-09-14T09:09:46.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787479+0000", 2024-09-14T09:09:46.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010736800000000001 2024-09-14T09:09:46.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:46.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787485+0000", 2024-09-14T09:09:46.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.054e-06 2024-09-14T09:09:46.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790580+0000", 2024-09-14T09:09:46.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030949929999999999 2024-09-14T09:09:46.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:46.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790589+0000", 2024-09-14T09:09:46.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7600000000000008e-06 2024-09-14T09:09:46.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.799541+0000", 2024-09-14T09:09:46.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0089520110000001 2024-09-14T09:09:46.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:46.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.799620+0000", 2024-09-14T09:09:46.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8969999999999998e-05 2024-09-14T09:09:46.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:46.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.811760+0000", 2024-09-14T09:09:46.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012140748999999999 2024-09-14T09:09:46.083 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.083 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:46.084 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.084 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:65817 3.3 3:c2c49fe0:::rbd_data.1112a10502fe.00000000000001b3:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:46.084 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:09:46.084 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 29.236143764000001, 2024-09-14T09:09:46.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0253660200000001, 2024-09-14T09:09:46.084 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:46.084 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:46.084 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:46.084 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:46.084 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:46.084 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:46.084 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 65817 2024-09-14T09:09:46.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.085 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:46.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:46.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:09:46.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:46.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:09:46.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:46.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787444+0000", 2024-09-14T09:09:46.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999995e-07 2024-09-14T09:09:46.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:46.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787448+0000", 2024-09-14T09:09:46.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1420000000000003e-06 2024-09-14T09:09:46.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:46.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787497+0000", 2024-09-14T09:09:46.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8507999999999997e-05 2024-09-14T09:09:46.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:46.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787503+0000", 2024-09-14T09:09:46.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1319999999999999e-06 2024-09-14T09:09:46.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787595+0000", 2024-09-14T09:09:46.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1748000000000003e-05 2024-09-14T09:09:46.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:46.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787601+0000", 2024-09-14T09:09:46.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6150000000000002e-06 2024-09-14T09:09:46.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790613+0000", 2024-09-14T09:09:46.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003012228 2024-09-14T09:09:46.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:46.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790621+0000", 2024-09-14T09:09:46.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9219999999999997e-06 2024-09-14T09:09:46.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800130+0000", 2024-09-14T09:09:46.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.009508474 2024-09-14T09:09:46.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:46.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800257+0000", 2024-09-14T09:09:46.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012746900000000001 2024-09-14T09:09:46.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:46.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.812809+0000", 2024-09-14T09:09:46.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012552054 2024-09-14T09:09:46.089 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.089 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:46.089 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.090 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:68709 3.3 3:c4996abd:::rbd_data.1112a10502fe.00000000000001cd:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:46.090 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:09:46.090 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 29.235972818, 2024-09-14T09:09:46.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0254506109999999, 2024-09-14T09:09:46.090 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:46.090 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:46.090 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:46.090 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:46.090 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:46.090 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:46.090 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 68709 2024-09-14T09:09:46.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.090 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:46.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:46.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:09:46.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:46.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:09:46.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:46.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787615+0000", 2024-09-14T09:09:46.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4000000000000001e-07 2024-09-14T09:09:46.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:46.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787618+0000", 2024-09-14T09:09:46.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2780000000000002e-06 2024-09-14T09:09:46.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:46.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787626+0000", 2024-09-14T09:09:46.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0250000000000002e-06 2024-09-14T09:09:46.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:46.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787633+0000", 2024-09-14T09:09:46.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5660000000000003e-06 2024-09-14T09:09:46.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787714+0000", 2024-09-14T09:09:46.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1695999999999998e-05 2024-09-14T09:09:46.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:46.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787721+0000", 2024-09-14T09:09:46.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1109999999999996e-06 2024-09-14T09:09:46.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790646+0000", 2024-09-14T09:09:46.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029251730000000001 2024-09-14T09:09:46.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:46.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790653+0000", 2024-09-14T09:09:46.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4379999999999998e-06 2024-09-14T09:09:46.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800750+0000", 2024-09-14T09:09:46.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010097236 2024-09-14T09:09:46.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:46.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800883+0000", 2024-09-14T09:09:46.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000132466 2024-09-14T09:09:46.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:46.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813065+0000", 2024-09-14T09:09:46.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012181981999999999 2024-09-14T09:09:46.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.095 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:46.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.096 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:74823 3.3 3:c59acf89:::rbd_data.1112a10502fe.00000000000001fb:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:46.096 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:09:46.096 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 29.215138346, 2024-09-14T09:09:46.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.004859323, 2024-09-14T09:09:46.096 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:46.096 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:46.096 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:46.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:46.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:46.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:46.096 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74823 2024-09-14T09:09:46.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.096 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:46.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:46.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:09:46.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:46.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:09:46.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:46.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808450+0000", 2024-09-14T09:09:46.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.92e-07 2024-09-14T09:09:46.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:46.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808454+0000", 2024-09-14T09:09:46.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3660000000000002e-06 2024-09-14T09:09:46.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:46.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808463+0000", 2024-09-14T09:09:46.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1579999999999994e-06 2024-09-14T09:09:46.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:46.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808470+0000", 2024-09-14T09:09:46.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7599999999999997e-06 2024-09-14T09:09:46.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808540+0000", 2024-09-14T09:09:46.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9991000000000001e-05 2024-09-14T09:09:46.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:46.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808550+0000", 2024-09-14T09:09:46.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0282000000000001e-05 2024-09-14T09:09:46.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801352+0000", 2024-09-14T09:09:46.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99280192700000003 2024-09-14T09:09:46.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:46.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801472+0000", 2024-09-14T09:09:46.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120184 2024-09-14T09:09:46.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:46.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813308+0000", 2024-09-14T09:09:46.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011835863 2024-09-14T09:09:46.100 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.100 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:46.100 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.100 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:86789 3.3 3:c3063f19:::rbd_data.1112a10502fe.000000000000023a:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:46.100 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:09:46.100 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.442915621000001, 2024-09-14T09:09:46.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.23302192099999999, 2024-09-14T09:09:46.101 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:46.101 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:46.101 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:46.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:46.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:46.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:46.101 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86789 2024-09-14T09:09:46.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.101 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:46.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:46.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:09:46.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:46.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:09:46.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:46.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580672+0000", 2024-09-14T09:09:46.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7999999999999993e-07 2024-09-14T09:09:46.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:46.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580680+0000", 2024-09-14T09:09:46.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7540000000000006e-06 2024-09-14T09:09:46.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:46.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580694+0000", 2024-09-14T09:09:46.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3344e-05 2024-09-14T09:09:46.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:46.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580702+0000", 2024-09-14T09:09:46.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9510000000000006e-06 2024-09-14T09:09:46.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580778+0000", 2024-09-14T09:09:46.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6580000000000002e-05 2024-09-14T09:09:46.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:46.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580788+0000", 2024-09-14T09:09:46.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0327e-05 2024-09-14T09:09:46.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801980+0000", 2024-09-14T09:09:46.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.22119123900000001 2024-09-14T09:09:46.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:46.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802115+0000", 2024-09-14T09:09:46.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013572000000000001 2024-09-14T09:09:46.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:46.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813693+0000", 2024-09-14T09:09:46.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011578026 2024-09-14T09:09:46.105 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.105 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:46.105 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.105 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:89485 3.3 3:c3eae671:::rbd_data.1112a10502fe.0000000000000248:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:46.105 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:09:46.105 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.338059127000001, 2024-09-14T09:09:46.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.12841583300000001, 2024-09-14T09:09:46.106 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:46.106 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:46.106 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:46.106 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:46.106 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:46.106 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:46.106 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 89485 2024-09-14T09:09:46.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.106 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:46.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:46.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:09:46.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:46.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:09:46.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:46.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685529+0000", 2024-09-14T09:09:46.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.11e-06 2024-09-14T09:09:46.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:46.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685534+0000", 2024-09-14T09:09:46.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0289999999999996e-06 2024-09-14T09:09:46.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:46.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685546+0000", 2024-09-14T09:09:46.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2062000000000001e-05 2024-09-14T09:09:46.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:46.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685554+0000", 2024-09-14T09:09:46.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7889999999999995e-06 2024-09-14T09:09:46.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685618+0000", 2024-09-14T09:09:46.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4487999999999996e-05 2024-09-14T09:09:46.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:46.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685628+0000", 2024-09-14T09:09:46.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5840000000000001e-06 2024-09-14T09:09:46.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802613+0000", 2024-09-14T09:09:46.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.116984703 2024-09-14T09:09:46.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:46.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802768+0000", 2024-09-14T09:09:46.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015541599999999999 2024-09-14T09:09:46.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:46.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813944+0000", 2024-09-14T09:09:46.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011175651999999999 2024-09-14T09:09:46.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.110 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:46.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.110 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:90751 3.3 3:c22bfcfe:::rbd_data.1112a10502fe.000000000000024e:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:46.110 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:09:46.110 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.286988343000001, 2024-09-14T09:09:46.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077582650000000003, 2024-09-14T09:09:46.110 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:46.110 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:46.110 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:46.111 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:46.111 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:46.111 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:46.111 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 90751 2024-09-14T09:09:46.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.111 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:46.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:46.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:09:46.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:46.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:09:46.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:46.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736600+0000", 2024-09-14T09:09:46.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.71e-07 2024-09-14T09:09:46.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:46.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736608+0000", 2024-09-14T09:09:46.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2679999999999994e-06 2024-09-14T09:09:46.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:46.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736620+0000", 2024-09-14T09:09:46.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2064e-05 2024-09-14T09:09:46.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:46.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736627+0000", 2024-09-14T09:09:46.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8129999999999998e-06 2024-09-14T09:09:46.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736676+0000", 2024-09-14T09:09:46.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.901e-05 2024-09-14T09:09:46.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:46.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736685+0000", 2024-09-14T09:09:46.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:09:46.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803227+0000", 2024-09-14T09:09:46.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066541874000000001 2024-09-14T09:09:46.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:46.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803381+0000", 2024-09-14T09:09:46.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015482500000000001 2024-09-14T09:09:46.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:46.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.814181+0000", 2024-09-14T09:09:46.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010799944000000001 2024-09-14T09:09:46.115 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.115 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:46.115 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.115 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:90760 3.3 3:c116ad26:::rbd_data.1112a10502fe.0000000000000251:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:46.115 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:09:46.115 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.286886026000001, 2024-09-14T09:09:46.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077694599000000003, 2024-09-14T09:09:46.115 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:46.115 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:46.115 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:46.115 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:46.115 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:46.115 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:46.116 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 90760 2024-09-14T09:09:46.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.116 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:46.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:46.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:09:46.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:46.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:09:46.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:46.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:46.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736702+0000", 2024-09-14T09:09:46.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0999999999999998e-07 2024-09-14T09:09:46.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:46.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736705+0000", 2024-09-14T09:09:46.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0120000000000001e-06 2024-09-14T09:09:46.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:46.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736711+0000", 2024-09-14T09:09:46.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6279999999999999e-06 2024-09-14T09:09:46.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:46.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736717+0000", 2024-09-14T09:09:46.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6200000000000004e-06 2024-09-14T09:09:46.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736765+0000", 2024-09-14T09:09:46.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7688000000000001e-05 2024-09-14T09:09:46.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:46.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736772+0000", 2024-09-14T09:09:46.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6529999999999994e-06 2024-09-14T09:09:46.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:46.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803886+0000", 2024-09-14T09:09:46.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067113795000000004 2024-09-14T09:09:46.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:46.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.804024+0000", 2024-09-14T09:09:46.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013782000000000001 2024-09-14T09:09:46.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:46.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:46.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:46.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.814396+0000", 2024-09-14T09:09:46.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010371773000000001 2024-09-14T09:09:46.119 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.119 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:46.119 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.119 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:46.119 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:46.120 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:46.120 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:46.121 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:46.121 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:46.124 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:09:46.125 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:46.125 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:46.122+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:46.222 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:46.224+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:46.230 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:46.230 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:46.239 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:46.323 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:46.325+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:46.382 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:46.382 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:46.391 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:09:46.422 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:46.424+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:46.523 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:46.525+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:46.534 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:46.534 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:46.543 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:09:46.596 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 1] out_osds: [] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 2] 2024-09-14T09:09:46.596 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:09:46.596 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-14T09:09:46.596 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T09:09:46.624 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:46.626+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:46.650 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:46.650 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:46.659 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:09:46.725 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:46.728+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:46.778 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:46.778 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:46.787 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:09:46.826 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:46.828+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:46.901 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:46.901 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:46.912 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:09:46.932 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:09:46.932 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:46.933 INFO:teuthology.orchestra.run.smithi116.stdout: "epoch": 115, 2024-09-14T09:09:46.933 INFO:teuthology.orchestra.run.smithi116.stdout: "fsid": "c991ac1c-978d-48b3-a540-4d3d4755e125", 2024-09-14T09:09:46.933 INFO:teuthology.orchestra.run.smithi116.stdout: "created": "2024-09-14T09:07:16.982473+0000", 2024-09-14T09:09:46.933 INFO:teuthology.orchestra.run.smithi116.stdout: "modified": "2024-09-14T09:09:46.786594+0000", 2024-09-14T09:09:46.933 INFO:teuthology.orchestra.run.smithi116.stdout: "last_up_change": "2024-09-14T09:09:15.843683+0000", 2024-09-14T09:09:46.933 INFO:teuthology.orchestra.run.smithi116.stdout: "last_in_change": "2024-09-14T09:08:58.845087+0000", 2024-09-14T09:09:46.933 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T09:09:46.933 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_num": 5801984, 2024-09-14T09:09:46.933 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_set": [ 2024-09-14T09:09:46.933 INFO:teuthology.orchestra.run.smithi116.stdout: "noscrub", 2024-09-14T09:09:46.933 INFO:teuthology.orchestra.run.smithi116.stdout: "pglog_hardlimit", 2024-09-14T09:09:46.933 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snapdirs", 2024-09-14T09:09:46.933 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_deletes", 2024-09-14T09:09:46.934 INFO:teuthology.orchestra.run.smithi116.stdout: "sortbitwise" 2024-09-14T09:09:46.934 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:46.934 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_version": 6, 2024-09-14T09:09:46.934 INFO:teuthology.orchestra.run.smithi116.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T09:09:46.934 INFO:teuthology.orchestra.run.smithi116.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T09:09:46.934 INFO:teuthology.orchestra.run.smithi116.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T09:09:46.934 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_snapshot": "", 2024-09-14T09:09:46.934 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_max": 3, 2024-09-14T09:09:46.934 INFO:teuthology.orchestra.run.smithi116.stdout: "max_osd": 6, 2024-09-14T09:09:46.934 INFO:teuthology.orchestra.run.smithi116.stdout: "require_min_compat_client": "luminous", 2024-09-14T09:09:46.934 INFO:teuthology.orchestra.run.smithi116.stdout: "min_compat_client": "jewel", 2024-09-14T09:09:46.934 INFO:teuthology.orchestra.run.smithi116.stdout: "require_osd_release": "squid", 2024-09-14T09:09:46.934 INFO:teuthology.orchestra.run.smithi116.stdout: "allow_crimson": false, 2024-09-14T09:09:46.934 INFO:teuthology.orchestra.run.smithi116.stdout: "pools": [ 2024-09-14T09:09:46.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.935 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 1, 2024-09-14T09:09:46.935 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": ".mgr", 2024-09-14T09:09:46.935 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:29.194849+0000", 2024-09-14T09:09:46.935 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 1, 2024-09-14T09:09:46.935 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool", 2024-09-14T09:09:46.935 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:09:46.935 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:09:46.935 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:09:46.935 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:09:46.935 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:09:46.935 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:09:46.935 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:09:46.935 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:09:46.936 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:09:46.936 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:09:46.936 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:09:46.936 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 1, 2024-09-14T09:09:46.936 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 1, 2024-09-14T09:09:46.936 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 1, 2024-09-14T09:09:46.936 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 1, 2024-09-14T09:09:46.936 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 1, 2024-09-14T09:09:46.936 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:09:46.936 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:09:46.936 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:09:46.936 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:09:46.936 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:09:46.937 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:09:46.937 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:09:46.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.937 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "16", 2024-09-14T09:09:46.937 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:09:46.937 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:09:46.937 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:09:46.937 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:09:46.937 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:09:46.937 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 0, 2024-09-14T09:09:46.937 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 0, 2024-09-14T09:09:46.937 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:09:46.937 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:09:46.937 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:09:46.938 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:09:46.938 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:09:46.938 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:09:46.938 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:09:46.938 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:09:46.938 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:09:46.938 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:09:46.938 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:09:46.938 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:09:46.938 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:09:46.938 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:09:46.938 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:09:46.938 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:09:46.938 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:09:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:09:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:09:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:09:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:09:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:09:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:09:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:09:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:09:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:09:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:09:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:09:46.939 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:09:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:09:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: "options": { 2024-09-14T09:09:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_max": 32, 2024-09-14T09:09:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_min": 1 2024-09-14T09:09:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:09:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": {} 2024-09-14T09:09:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:09:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:09:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 6.059999942779541, 2024-09-14T09:09:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 6.059999942779541, 2024-09-14T09:09:46.940 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 0.33000001311302185, 2024-09-14T09:09:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 2, 2024-09-14T09:09:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 2, 2024-09-14T09:09:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:09:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:09:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:09:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 2, 2024-09-14T09:09:46.941 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": "rbd", 2024-09-14T09:09:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:33.684592+0000", 2024-09-14T09:09:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 8193, 2024-09-14T09:09:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T09:09:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:09:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:09:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:09:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:09:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:09:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:09:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:09:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:09:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:09:46.942 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:09:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:09:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 8, 2024-09-14T09:09:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 8, 2024-09-14T09:09:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 8, 2024-09-14T09:09:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 8, 2024-09-14T09:09:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 8, 2024-09-14T09:09:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:09:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:09:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:09:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:09:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:09:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:09:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:09:46.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "20", 2024-09-14T09:09:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:09:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:09:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:09:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:09:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:09:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 2, 2024-09-14T09:09:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 20, 2024-09-14T09:09:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:09:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:09:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:09:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:09:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:09:46.944 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:09:46.945 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:09:46.945 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:09:46.945 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:09:46.945 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:09:46.945 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:09:46.945 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:09:46.945 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:09:46.945 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:09:46.945 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:09:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:09:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:09:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:09:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:09:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:09:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:09:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:09:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:09:46.948 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:09:46.949 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:09:46.949 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:09:46.949 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:09:46.949 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:09:46.949 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:09:46.949 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:09:46.949 INFO:teuthology.orchestra.run.smithi116.stdout: "options": {}, 2024-09-14T09:09:46.949 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:09:46.949 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd": {} 2024-09-14T09:09:46.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.949 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:09:46.949 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:09:46.949 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 2.25, 2024-09-14T09:09:46.950 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 2.25, 2024-09-14T09:09:46.950 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 1, 2024-09-14T09:09:46.950 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 2.25, 2024-09-14T09:09:46.950 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 2.25, 2024-09-14T09:09:46.950 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:09:46.950 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:09:46.950 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:09:46.950 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.950 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 3, 2024-09-14T09:09:46.950 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": "pool_client.0", 2024-09-14T09:09:46.950 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:43.363542+0000", 2024-09-14T09:09:46.950 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 8193, 2024-09-14T09:09:46.951 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T09:09:46.951 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:09:46.951 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:09:46.951 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:09:46.951 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:09:46.951 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:09:46.951 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:09:46.951 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:09:46.951 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:09:46.951 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:09:46.951 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:09:46.951 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:09:46.951 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 32, 2024-09-14T09:09:46.951 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 32, 2024-09-14T09:09:46.951 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 32, 2024-09-14T09:09:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 32, 2024-09-14T09:09:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 32, 2024-09-14T09:09:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:09:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:09:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:09:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:09:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:09:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:09:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:09:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "115", 2024-09-14T09:09:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:09:46.952 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:09:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:09:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:09:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:09:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 43, 2024-09-14T09:09:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 115, 2024-09-14T09:09:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:09:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:09:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:09:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:09:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:09:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:09:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:09:46.953 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:09:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:09:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:09:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:09:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:09:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:09:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:09:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:09:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:09:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:09:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:09:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:09:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.954 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:09:46.955 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:09:46.955 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:09:46.955 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:09:46.955 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:09:46.955 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:09:46.955 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:09:46.955 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:09:46.955 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:09:46.955 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:09:46.955 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:09:46.955 INFO:teuthology.orchestra.run.smithi116.stdout: "options": {}, 2024-09-14T09:09:46.955 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:09:46.956 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd": {} 2024-09-14T09:09:46.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.956 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:09:46.956 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:09:46.956 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 1.8799999952316284, 2024-09-14T09:09:46.956 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 1.8799999952316284, 2024-09-14T09:09:46.956 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 1, 2024-09-14T09:09:46.956 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 1.8799999952316284, 2024-09-14T09:09:46.956 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 1.8799999952316284, 2024-09-14T09:09:46.956 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:09:46.956 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:09:46.956 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:09:46.956 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.957 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.957 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:46.957 INFO:teuthology.orchestra.run.smithi116.stdout: "osds": [ 2024-09-14T09:09:46.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.957 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 0, 2024-09-14T09:09:46.957 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "b3c13086-1183-454b-8e62-3aec9b69cdf5", 2024-09-14T09:09:46.957 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:46.957 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:46.957 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 0.3199462890625, 2024-09-14T09:09:46.957 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:09:46.957 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:09:46.957 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:09:46.957 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 11, 2024-09-14T09:09:46.958 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 78, 2024-09-14T09:09:46.958 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:09:46.958 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:46.958 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:46.958 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.958 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.958 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6816", 2024-09-14T09:09:46.958 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:46.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.958 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.958 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6817", 2024-09-14T09:09:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6818", 2024-09-14T09:09:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.959 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.960 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6819", 2024-09-14T09:09:46.960 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:46.960 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.960 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.960 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:46.960 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.960 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.960 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6822", 2024-09-14T09:09:46.960 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:46.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6823", 2024-09-14T09:09:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6820", 2024-09-14T09:09:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:46.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6821", 2024-09-14T09:09:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6817/1856142608", 2024-09-14T09:09:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6819/1856142608", 2024-09-14T09:09:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6823/1856142608", 2024-09-14T09:09:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6821/1856142608", 2024-09-14T09:09:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:46.962 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 1, 2024-09-14T09:09:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "8ee6a373-9d0d-4cd2-96f4-9673de96f546", 2024-09-14T09:09:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:09:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:09:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:09:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:09:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 13, 2024-09-14T09:09:46.963 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 90, 2024-09-14T09:09:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:09:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6800", 2024-09-14T09:09:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6801", 2024-09-14T09:09:46.964 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6802", 2024-09-14T09:09:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6803", 2024-09-14T09:09:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:46.965 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6806", 2024-09-14T09:09:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6807", 2024-09-14T09:09:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6804", 2024-09-14T09:09:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6805", 2024-09-14T09:09:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.967 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6801/3469105275", 2024-09-14T09:09:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6803/3469105275", 2024-09-14T09:09:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6807/3469105275", 2024-09-14T09:09:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6805/3469105275", 2024-09-14T09:09:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 2, 2024-09-14T09:09:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "958a9363-d751-49c3-9ec7-7330d377ee53", 2024-09-14T09:09:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:46.968 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 0.59710693359375, 2024-09-14T09:09:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:09:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 13, 2024-09-14T09:09:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 67, 2024-09-14T09:09:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 87, 2024-09-14T09:09:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 90, 2024-09-14T09:09:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 68, 2024-09-14T09:09:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6808", 2024-09-14T09:09:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:46.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6809", 2024-09-14T09:09:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6810", 2024-09-14T09:09:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:46.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6811", 2024-09-14T09:09:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6814", 2024-09-14T09:09:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6815", 2024-09-14T09:09:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6812", 2024-09-14T09:09:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6813", 2024-09-14T09:09:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6809/2050490698", 2024-09-14T09:09:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6811/2050490698", 2024-09-14T09:09:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6815/2050490698", 2024-09-14T09:09:46.973 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6813/2050490698", 2024-09-14T09:09:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 3, 2024-09-14T09:09:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "7fafd519-b2e9-498c-a409-f55cfe45a51a", 2024-09-14T09:09:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:09:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 0.2435760498046875, 2024-09-14T09:09:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:09:46.974 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:09:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:09:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 89, 2024-09-14T09:09:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:09:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6816", 2024-09-14T09:09:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6817", 2024-09-14T09:09:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6818", 2024-09-14T09:09:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6819", 2024-09-14T09:09:46.976 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6822", 2024-09-14T09:09:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.977 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6823", 2024-09-14T09:09:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6820", 2024-09-14T09:09:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6821", 2024-09-14T09:09:46.978 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6817/2855061278", 2024-09-14T09:09:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6819/2855061278", 2024-09-14T09:09:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6823/2855061278", 2024-09-14T09:09:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6821/2855061278", 2024-09-14T09:09:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.979 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 4, 2024-09-14T09:09:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "63d99552-5fea-4367-bf86-0addc8cceb98", 2024-09-14T09:09:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:09:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:09:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:09:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:09:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:09:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 89, 2024-09-14T09:09:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:09:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6808", 2024-09-14T09:09:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6809", 2024-09-14T09:09:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.981 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6810", 2024-09-14T09:09:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6811", 2024-09-14T09:09:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6814", 2024-09-14T09:09:46.982 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6815", 2024-09-14T09:09:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6812", 2024-09-14T09:09:46.983 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6813", 2024-09-14T09:09:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6809/369903047", 2024-09-14T09:09:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6811/369903047", 2024-09-14T09:09:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6815/369903047", 2024-09-14T09:09:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6813/369903047", 2024-09-14T09:09:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:46.984 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 5, 2024-09-14T09:09:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "e4bcb224-662f-4530-b477-c0dd9c4ddbf4", 2024-09-14T09:09:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:09:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:09:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:09:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:09:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:09:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 87, 2024-09-14T09:09:46.985 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:09:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6800", 2024-09-14T09:09:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6801", 2024-09-14T09:09:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.986 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6802", 2024-09-14T09:09:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6803", 2024-09-14T09:09:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6806", 2024-09-14T09:09:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6807", 2024-09-14T09:09:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.989 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:46.989 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:46.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.989 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:46.989 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6804", 2024-09-14T09:09:46.989 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:46.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.989 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6805", 2024-09-14T09:09:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6801/2878111293", 2024-09-14T09:09:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6803/2878111293", 2024-09-14T09:09:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6807/2878111293", 2024-09-14T09:09:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6805/2878111293", 2024-09-14T09:09:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.990 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_xinfo": [ 2024-09-14T09:09:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 0, 2024-09-14T09:09:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:24.757990+0000", 2024-09-14T09:09:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:09:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.991 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 1, 2024-09-14T09:09:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.277795+0000", 2024-09-14T09:09:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:09:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 2, 2024-09-14T09:09:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:46.992 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:46.993 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:46.993 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.290172+0000", 2024-09-14T09:09:46.993 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 68 2024-09-14T09:09:46.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.993 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 3, 2024-09-14T09:09:46.993 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:46.993 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:46.993 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:46.994 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:46.994 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:46.994 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.324594+0000", 2024-09-14T09:09:46.994 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:09:46.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.994 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 4, 2024-09-14T09:09:46.994 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:46.994 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:46.994 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:46.994 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:46.994 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:24.865136+0000", 2024-09-14T09:09:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:09:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 5, 2024-09-14T09:09:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.020572+0000", 2024-09-14T09:09:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:09:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:46.995 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap": [], 2024-09-14T09:09:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap_items": [], 2024-09-14T09:09:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap_primaries": [], 2024-09-14T09:09:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_temp": [], 2024-09-14T09:09:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_temp": [], 2024-09-14T09:09:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: "blocklist": {}, 2024-09-14T09:09:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: "range_blocklist": {}, 2024-09-14T09:09:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profiles": { 2024-09-14T09:09:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: "default": { 2024-09-14T09:09:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: "crush-failure-domain": "osd", 2024-09-14T09:09:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: "k": "2", 2024-09-14T09:09:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: "m": "1", 2024-09-14T09:09:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: "plugin": "jerasure", 2024-09-14T09:09:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: "technique": "reed_sol_van" 2024-09-14T09:09:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps_queue": [ 2024-09-14T09:09:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 3, 2024-09-14T09:09:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: "snaps": [ 2024-09-14T09:09:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: "begin": 36, 2024-09-14T09:09:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: "length": 5 2024-09-14T09:09:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: "new_removed_snaps": [ 2024-09-14T09:09:46.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 3, 2024-09-14T09:09:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: "snaps": [ 2024-09-14T09:09:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: "begin": 36, 2024-09-14T09:09:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: "length": 1 2024-09-14T09:09:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: "new_purged_snaps": [ 2024-09-14T09:09:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 3, 2024-09-14T09:09:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: "snaps": [ 2024-09-14T09:09:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:46.998 INFO:teuthology.orchestra.run.smithi116.stdout: "begin": 41, 2024-09-14T09:09:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: "length": 3 2024-09-14T09:09:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_node_flags": {}, 2024-09-14T09:09:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: "device_class_flags": {}, 2024-09-14T09:09:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode": { 2024-09-14T09:09:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode_enabled": false, 2024-09-14T09:09:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_bucket_count": 0, 2024-09-14T09:09:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: "degraded_stretch_mode": 0, 2024-09-14T09:09:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: "recovering_stretch_mode": 0, 2024-09-14T09:09:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode_bucket": 0 2024-09-14T09:09:46.999 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:46.999 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:47.000 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:46.934+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:47.001 INFO:tasks.thrashosds.thrasher:j is {'epoch': 115, 'fsid': 'c991ac1c-978d-48b3-a540-4d3d4755e125', 'created': '2024-09-14T09:07:16.982473+0000', 'modified': '2024-09-14T09:09:46.786594+0000', 'last_up_change': '2024-09-14T09:09:15.843683+0000', 'last_in_change': '2024-09-14T09:08:58.845087+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T09:07:29.194849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T09:07:33.684592+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-14T09:07:43.363542+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 43, 'snap_epoch': 115, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}], 'osds': [{'osd': 0, 'uuid': 'b3c13086-1183-454b-8e62-3aec9b69cdf5', 'up': 1, 'in': 1, 'weight': 0.3199462890625, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 78, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6816', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6817', 'nonce': 1856142608}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6818', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6819', 'nonce': 1856142608}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6822', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6823', 'nonce': 1856142608}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6820', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6821', 'nonce': 1856142608}]}, 'public_addr': '172.21.15.116:6817/1856142608', 'cluster_addr': '172.21.15.116:6819/1856142608', 'heartbeat_back_addr': '172.21.15.116:6823/1856142608', 'heartbeat_front_addr': '172.21.15.116:6821/1856142608', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '8ee6a373-9d0d-4cd2-96f4-9673de96f546', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 90, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6800', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6801', 'nonce': 3469105275}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6802', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6803', 'nonce': 3469105275}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6806', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6807', 'nonce': 3469105275}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6804', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6805', 'nonce': 3469105275}]}, 'public_addr': '172.21.15.116:6801/3469105275', 'cluster_addr': '172.21.15.116:6803/3469105275', 'heartbeat_back_addr': '172.21.15.116:6807/3469105275', 'heartbeat_front_addr': '172.21.15.116:6805/3469105275', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '958a9363-d751-49c3-9ec7-7330d377ee53', 'up': 1, 'in': 1, 'weight': 0.59710693359375, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 67, 'up_from': 87, 'up_thru': 90, 'down_at': 68, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6808', 'nonce': 2050490698}, {'type': 'v1', 'addr': '172.21.15.116:6809', 'nonce': 2050490698}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6810', 'nonce': 2050490698}, {'type': 'v1', 'addr': '172.21.15.116:6811', 'nonce': 2050490698}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6814', 'nonce': 2050490698}, {'type': 'v1', 'addr': '172.21.15.116:6815', 'nonce': 2050490698}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6812', 'nonce': 2050490698}, {'type': 'v1', 'addr': '172.21.15.116:6813', 'nonce': 2050490698}]}, 'public_addr': '172.21.15.116:6809/2050490698', 'cluster_addr': '172.21.15.116:6811/2050490698', 'heartbeat_back_addr': '172.21.15.116:6815/2050490698', 'heartbeat_front_addr': '172.21.15.116:6813/2050490698', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '7fafd519-b2e9-498c-a409-f55cfe45a51a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.2435760498046875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 89, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6816', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6817', 'nonce': 2855061278}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6818', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6819', 'nonce': 2855061278}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6822', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6823', 'nonce': 2855061278}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6820', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6821', 'nonce': 2855061278}]}, 'public_addr': '172.21.15.144:6817/2855061278', 'cluster_addr': '172.21.15.144:6819/2855061278', 'heartbeat_back_addr': '172.21.15.144:6823/2855061278', 'heartbeat_front_addr': '172.21.15.144:6821/2855061278', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '63d99552-5fea-4367-bf86-0addc8cceb98', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 89, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6808', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6809', 'nonce': 369903047}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6810', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6811', 'nonce': 369903047}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6814', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6815', 'nonce': 369903047}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6812', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6813', 'nonce': 369903047}]}, 'public_addr': '172.21.15.144:6809/369903047', 'cluster_addr': '172.21.15.144:6811/369903047', 'heartbeat_back_addr': '172.21.15.144:6815/369903047', 'heartbeat_front_addr': '172.21.15.144:6813/369903047', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e4bcb224-662f-4530-b477-c0dd9c4ddbf4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 87, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6800', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6801', 'nonce': 2878111293}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6802', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6803', 'nonce': 2878111293}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6806', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6807', 'nonce': 2878111293}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6804', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6805', 'nonce': 2878111293}]}, 'public_addr': '172.21.15.144:6801/2878111293', 'cluster_addr': '172.21.15.144:6803/2878111293', 'heartbeat_back_addr': '172.21.15.144:6807/2878111293', 'heartbeat_front_addr': '172.21.15.144:6805/2878111293', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:24.757990+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.277795+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.290172+0000', 'dead_epoch': 68}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.324594+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:24.865136+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.020572+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 36, 'length': 5}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 36, 'length': 1}]}], 'new_purged_snaps': [{'pool': 3, 'snaps': [{'begin': 41, 'length': 3}]}], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T09:09:47.001 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-14T09:09:47.017 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T09:09:47.019 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:47.019 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:47.029 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:09:47.029 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:47.030+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:47.129 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:47.132+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:47.177 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:47.177 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:47.186 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:09:47.231 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:47.233+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:47.292 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:47.292 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:47.301 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:09:47.344 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:47.346+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:47.403 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:47.403 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:47.412 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:09:47.432 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:47.434+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:47.533 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:47.535+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:47.556 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:47.556 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:47.564 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:09:47.634 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:47.636+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:47.706 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:47.706 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:47.715 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:09:47.735 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:47.737+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:47.792 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is set 2024-09-14T09:09:47.834 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:47.834 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:47.843 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:09:47.849 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:47.851+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:47.937 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:47.939+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:47.947 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:47.947 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:47.957 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:09:48.038 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:48.040+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:48.060 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:48.060 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:48.069 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:09:48.127 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:09:48.170 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:48.172+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:48.213 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:48.213 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:48.221 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:09:48.245 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:48.245 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:48.261 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:48.262 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:48.265 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:48.268+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:48.277 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:09:48.277 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:09:48.293 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:48.293 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:48.311 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:48.311 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:48.327 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:48.327 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:48.327 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:48.327 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:48.327 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:48.327 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:48.328 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:48.336 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:09:48.377 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:48.379+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:48.442 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:48.444+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:48.480 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:48.480 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:48.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:48.480 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:48.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.480 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5349 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8302592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 71.225705754000003, 2024-09-14T09:09:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039875928999999997, 2024-09-14T09:09:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5349 2024-09-14T09:09:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255874+0000", 2024-09-14T09:09:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4900000000000001e-07 2024-09-14T09:09:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255880+0000", 2024-09-14T09:09:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9939999999999997e-06 2024-09-14T09:09:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255886+0000", 2024-09-14T09:09:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3899999999999998e-06 2024-09-14T09:09:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255891+0000", 2024-09-14T09:09:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.938e-06 2024-09-14T09:09:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295580+0000", 2024-09-14T09:09:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039688681000000003 2024-09-14T09:09:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295653+0000", 2024-09-14T09:09:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3045000000000003e-05 2024-09-14T09:09:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295749+0000", 2024-09-14T09:09:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6532000000000003e-05 2024-09-14T09:09:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5350 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8364032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 71.225681946999998, 2024-09-14T09:09:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039989719, 2024-09-14T09:09:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5350 2024-09-14T09:09:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255898+0000", 2024-09-14T09:09:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2024-09-14T09:09:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255899+0000", 2024-09-14T09:09:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9139999999999998e-06 2024-09-14T09:09:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255905+0000", 2024-09-14T09:09:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7289999999999997e-06 2024-09-14T09:09:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255910+0000", 2024-09-14T09:09:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6210000000000003e-06 2024-09-14T09:09:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295775+0000", 2024-09-14T09:09:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039864973999999997 2024-09-14T09:09:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295828+0000", 2024-09-14T09:09:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3411000000000001e-05 2024-09-14T09:09:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295887+0000", 2024-09-14T09:09:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699000000000002e-05 2024-09-14T09:09:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4639 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1843200~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.281766488000002, 2024-09-14T09:09:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040843672999999997, 2024-09-14T09:09:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4639 2024-09-14T09:09:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:09:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199818+0000", 2024-09-14T09:09:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1450000000000001e-06 2024-09-14T09:09:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199827+0000", 2024-09-14T09:09:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3999999999999998e-06 2024-09-14T09:09:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199834+0000", 2024-09-14T09:09:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0809999999999996e-06 2024-09-14T09:09:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240541+0000", 2024-09-14T09:09:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040706941000000003 2024-09-14T09:09:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240584+0000", 2024-09-14T09:09:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3040999999999997e-05 2024-09-14T09:09:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240656+0000", 2024-09-14T09:09:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2200000000000007e-05 2024-09-14T09:09:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4640 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1871872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.281732003000002, 2024-09-14T09:09:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040967601999999999, 2024-09-14T09:09:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4640 2024-09-14T09:09:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199848+0000", 2024-09-14T09:09:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5400000000000002e-07 2024-09-14T09:09:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199850+0000", 2024-09-14T09:09:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2479999999999999e-06 2024-09-14T09:09:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199857+0000", 2024-09-14T09:09:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.187e-06 2024-09-14T09:09:48.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:48.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199862+0000", 2024-09-14T09:09:48.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5119999999999999e-06 2024-09-14T09:09:48.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240684+0000", 2024-09-14T09:09:48.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040821245999999999 2024-09-14T09:09:48.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240739+0000", 2024-09-14T09:09:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4991999999999998e-05 2024-09-14T09:09:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240815+0000", 2024-09-14T09:09:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5963000000000004e-05 2024-09-14T09:09:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4641 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1900544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.281709673000002, 2024-09-14T09:09:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041205512, 2024-09-14T09:09:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4641 2024-09-14T09:09:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199870+0000", 2024-09-14T09:09:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0600000000000001e-07 2024-09-14T09:09:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199872+0000", 2024-09-14T09:09:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.928e-06 2024-09-14T09:09:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199877+0000", 2024-09-14T09:09:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6949999999999997e-06 2024-09-14T09:09:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199882+0000", 2024-09-14T09:09:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8210000000000001e-06 2024-09-14T09:09:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240847+0000", 2024-09-14T09:09:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040965201999999999 2024-09-14T09:09:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240888+0000", 2024-09-14T09:09:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0754000000000003e-05 2024-09-14T09:09:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241075+0000", 2024-09-14T09:09:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000186706 2024-09-14T09:09:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.503 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:48.503 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.503 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4642 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1929216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:48.503 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:48.503 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.281690738000002, 2024-09-14T09:09:48.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041292575999999998, 2024-09-14T09:09:48.503 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:48.503 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:48.503 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:48.503 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:48.503 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:48.504 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:48.504 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4642 2024-09-14T09:09:48.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.504 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:48.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:48.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:48.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:48.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:48.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:48.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199889+0000", 2024-09-14T09:09:48.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2024-09-14T09:09:48.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:48.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199891+0000", 2024-09-14T09:09:48.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9e-06 2024-09-14T09:09:48.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:48.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199896+0000", 2024-09-14T09:09:48.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6960000000000002e-06 2024-09-14T09:09:48.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199901+0000", 2024-09-14T09:09:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6720000000000003e-06 2024-09-14T09:09:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241089+0000", 2024-09-14T09:09:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041187594000000001 2024-09-14T09:09:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241126+0000", 2024-09-14T09:09:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7490999999999997e-05 2024-09-14T09:09:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241181+0000", 2024-09-14T09:09:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4823e-05 2024-09-14T09:09:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4643 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1957888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.281671459000002, 2024-09-14T09:09:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041418333000000002, 2024-09-14T09:09:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4643 2024-09-14T09:09:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5699999999999998e-07 2024-09-14T09:09:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199910+0000", 2024-09-14T09:09:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.829e-06 2024-09-14T09:09:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199916+0000", 2024-09-14T09:09:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8499999999999999e-06 2024-09-14T09:09:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199920+0000", 2024-09-14T09:09:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6530000000000002e-06 2024-09-14T09:09:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241211+0000", 2024-09-14T09:09:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041290327000000002 2024-09-14T09:09:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241257+0000", 2024-09-14T09:09:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6347000000000002e-05 2024-09-14T09:09:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241326+0000", 2024-09-14T09:09:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8969999999999999e-05 2024-09-14T09:09:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4644 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1986560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.281653118999998, 2024-09-14T09:09:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041596269999999998, 2024-09-14T09:09:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4644 2024-09-14T09:09:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.41e-07 2024-09-14T09:09:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199928+0000", 2024-09-14T09:09:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8250000000000001e-06 2024-09-14T09:09:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199934+0000", 2024-09-14T09:09:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2280000000000003e-06 2024-09-14T09:09:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199939+0000", 2024-09-14T09:09:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8010000000000003e-06 2024-09-14T09:09:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241360+0000", 2024-09-14T09:09:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041421289 2024-09-14T09:09:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241435+0000", 2024-09-14T09:09:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4238000000000003e-05 2024-09-14T09:09:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241522+0000", 2024-09-14T09:09:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7547999999999996e-05 2024-09-14T09:09:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4645 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.281634212, 2024-09-14T09:09:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041714660000000001, 2024-09-14T09:09:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4645 2024-09-14T09:09:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4700000000000002e-07 2024-09-14T09:09:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199947+0000", 2024-09-14T09:09:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.801e-06 2024-09-14T09:09:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199953+0000", 2024-09-14T09:09:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.694e-06 2024-09-14T09:09:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199957+0000", 2024-09-14T09:09:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3069999999999996e-06 2024-09-14T09:09:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241547+0000", 2024-09-14T09:09:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041589895000000002 2024-09-14T09:09:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241590+0000", 2024-09-14T09:09:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2985000000000003e-05 2024-09-14T09:09:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241660+0000", 2024-09-14T09:09:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9630999999999998e-05 2024-09-14T09:09:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4646 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2043904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.281616223999997, 2024-09-14T09:09:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041827171000000003, 2024-09-14T09:09:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4646 2024-09-14T09:09:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6300000000000001e-07 2024-09-14T09:09:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199965+0000", 2024-09-14T09:09:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.035e-06 2024-09-14T09:09:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199973+0000", 2024-09-14T09:09:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9629999999999998e-06 2024-09-14T09:09:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199978+0000", 2024-09-14T09:09:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9069999999999998e-06 2024-09-14T09:09:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241677+0000", 2024-09-14T09:09:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041698662999999997 2024-09-14T09:09:48.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:48.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241717+0000", 2024-09-14T09:09:48.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602999999999997e-05 2024-09-14T09:09:48.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:48.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241790+0000", 2024-09-14T09:09:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2637000000000003e-05 2024-09-14T09:09:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4647 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2072576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.281587633999997, 2024-09-14T09:09:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041921189999999997, 2024-09-14T09:09:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4647 2024-09-14T09:09:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199992+0000", 2024-09-14T09:09:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3799999999999997e-07 2024-09-14T09:09:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199994+0000", 2024-09-14T09:09:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3020000000000002e-06 2024-09-14T09:09:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200004+0000", 2024-09-14T09:09:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3510000000000008e-06 2024-09-14T09:09:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200008+0000", 2024-09-14T09:09:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3329999999999998e-06 2024-09-14T09:09:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241814+0000", 2024-09-14T09:09:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041806280000000001 2024-09-14T09:09:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241855+0000", 2024-09-14T09:09:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0173999999999999e-05 2024-09-14T09:09:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241913+0000", 2024-09-14T09:09:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8112000000000002e-05 2024-09-14T09:09:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:59017 3.3 3:c1df81d6:::rbd_data.1112a10502fe.0000000000000189:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:09:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.694297033000002, 2024-09-14T09:09:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.024252111, 2024-09-14T09:09:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59017 2024-09-14T09:09:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:09:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:09:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787284+0000", 2024-09-14T09:09:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3879999999999998e-06 2024-09-14T09:09:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787297+0000", 2024-09-14T09:09:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2184999999999999e-05 2024-09-14T09:09:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787317+0000", 2024-09-14T09:09:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0054000000000001e-05 2024-09-14T09:09:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787327+0000", 2024-09-14T09:09:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0335e-05 2024-09-14T09:09:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787412+0000", 2024-09-14T09:09:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4691000000000006e-05 2024-09-14T09:09:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:09:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787422+0000", 2024-09-14T09:09:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0718e-05 2024-09-14T09:09:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790539+0000", 2024-09-14T09:09:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031164600000000002 2024-09-14T09:09:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790552+0000", 2024-09-14T09:09:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2736e-05 2024-09-14T09:09:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.798725+0000", 2024-09-14T09:09:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0081731860000001 2024-09-14T09:09:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.798824+0000", 2024-09-14T09:09:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9600999999999997e-05 2024-09-14T09:09:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:48.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.811534+0000", 2024-09-14T09:09:48.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012709757 2024-09-14T09:09:48.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.535 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:48.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.535 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:63586 3.3 3:c0d9272b:::rbd_data.1112a10502fe.00000000000001a2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:48.535 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:48.535 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.694225549999999, 2024-09-14T09:09:48.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0244069650000001, 2024-09-14T09:09:48.535 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:48.536 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:48.536 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:48.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:48.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:48.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:48.536 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 63586 2024-09-14T09:09:48.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.536 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:48.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:48.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:48.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2024-09-14T09:09:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787357+0000", 2024-09-14T09:09:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8720000000000002e-06 2024-09-14T09:09:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787365+0000", 2024-09-14T09:09:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9270000000000005e-06 2024-09-14T09:09:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787372+0000", 2024-09-14T09:09:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6810000000000001e-06 2024-09-14T09:09:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787479+0000", 2024-09-14T09:09:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010736800000000001 2024-09-14T09:09:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787485+0000", 2024-09-14T09:09:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.054e-06 2024-09-14T09:09:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790580+0000", 2024-09-14T09:09:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030949929999999999 2024-09-14T09:09:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790589+0000", 2024-09-14T09:09:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7600000000000008e-06 2024-09-14T09:09:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.799541+0000", 2024-09-14T09:09:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0089520110000001 2024-09-14T09:09:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.799620+0000", 2024-09-14T09:09:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8969999999999998e-05 2024-09-14T09:09:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.811760+0000", 2024-09-14T09:09:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012140748999999999 2024-09-14T09:09:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:65817 3.3 3:c2c49fe0:::rbd_data.1112a10502fe.00000000000001b3:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:09:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.694135748000001, 2024-09-14T09:09:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0253660200000001, 2024-09-14T09:09:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 65817 2024-09-14T09:09:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:09:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:48.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:09:48.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:48.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787444+0000", 2024-09-14T09:09:48.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999995e-07 2024-09-14T09:09:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787448+0000", 2024-09-14T09:09:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1420000000000003e-06 2024-09-14T09:09:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787497+0000", 2024-09-14T09:09:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8507999999999997e-05 2024-09-14T09:09:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787503+0000", 2024-09-14T09:09:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1319999999999999e-06 2024-09-14T09:09:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787595+0000", 2024-09-14T09:09:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1748000000000003e-05 2024-09-14T09:09:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787601+0000", 2024-09-14T09:09:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6150000000000002e-06 2024-09-14T09:09:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790613+0000", 2024-09-14T09:09:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003012228 2024-09-14T09:09:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790621+0000", 2024-09-14T09:09:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9219999999999997e-06 2024-09-14T09:09:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800130+0000", 2024-09-14T09:09:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.009508474 2024-09-14T09:09:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:48.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800257+0000", 2024-09-14T09:09:48.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012746900000000001 2024-09-14T09:09:48.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:48.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.812809+0000", 2024-09-14T09:09:48.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012552054 2024-09-14T09:09:48.547 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.547 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:48.547 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.548 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:68709 3.3 3:c4996abd:::rbd_data.1112a10502fe.00000000000001cd:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:48.548 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:09:48.548 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.693964802, 2024-09-14T09:09:48.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0254506109999999, 2024-09-14T09:09:48.548 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:48.548 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:48.548 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:48.548 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:48.548 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 68709 2024-09-14T09:09:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:09:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:09:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787615+0000", 2024-09-14T09:09:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4000000000000001e-07 2024-09-14T09:09:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787618+0000", 2024-09-14T09:09:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2780000000000002e-06 2024-09-14T09:09:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787626+0000", 2024-09-14T09:09:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0250000000000002e-06 2024-09-14T09:09:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787633+0000", 2024-09-14T09:09:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5660000000000003e-06 2024-09-14T09:09:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787714+0000", 2024-09-14T09:09:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1695999999999998e-05 2024-09-14T09:09:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787721+0000", 2024-09-14T09:09:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1109999999999996e-06 2024-09-14T09:09:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790646+0000", 2024-09-14T09:09:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029251730000000001 2024-09-14T09:09:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790653+0000", 2024-09-14T09:09:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4379999999999998e-06 2024-09-14T09:09:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800750+0000", 2024-09-14T09:09:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010097236 2024-09-14T09:09:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800883+0000", 2024-09-14T09:09:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000132466 2024-09-14T09:09:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813065+0000", 2024-09-14T09:09:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012181981999999999 2024-09-14T09:09:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:74823 3.3 3:c59acf89:::rbd_data.1112a10502fe.00000000000001fb:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:09:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.673130329999999, 2024-09-14T09:09:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.004859323, 2024-09-14T09:09:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74823 2024-09-14T09:09:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:09:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:09:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808450+0000", 2024-09-14T09:09:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.92e-07 2024-09-14T09:09:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808454+0000", 2024-09-14T09:09:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3660000000000002e-06 2024-09-14T09:09:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808463+0000", 2024-09-14T09:09:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1579999999999994e-06 2024-09-14T09:09:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808470+0000", 2024-09-14T09:09:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7599999999999997e-06 2024-09-14T09:09:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808540+0000", 2024-09-14T09:09:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9991000000000001e-05 2024-09-14T09:09:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808550+0000", 2024-09-14T09:09:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0282000000000001e-05 2024-09-14T09:09:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801352+0000", 2024-09-14T09:09:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99280192700000003 2024-09-14T09:09:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801472+0000", 2024-09-14T09:09:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120184 2024-09-14T09:09:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813308+0000", 2024-09-14T09:09:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011835863 2024-09-14T09:09:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:86789 3.3 3:c3063f19:::rbd_data.1112a10502fe.000000000000023a:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:09:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.900907605, 2024-09-14T09:09:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.23302192099999999, 2024-09-14T09:09:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86789 2024-09-14T09:09:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:09:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:09:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580672+0000", 2024-09-14T09:09:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7999999999999993e-07 2024-09-14T09:09:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580680+0000", 2024-09-14T09:09:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7540000000000006e-06 2024-09-14T09:09:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580694+0000", 2024-09-14T09:09:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3344e-05 2024-09-14T09:09:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580702+0000", 2024-09-14T09:09:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9510000000000006e-06 2024-09-14T09:09:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580778+0000", 2024-09-14T09:09:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6580000000000002e-05 2024-09-14T09:09:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580788+0000", 2024-09-14T09:09:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0327e-05 2024-09-14T09:09:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801980+0000", 2024-09-14T09:09:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.22119123900000001 2024-09-14T09:09:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802115+0000", 2024-09-14T09:09:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013572000000000001 2024-09-14T09:09:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813693+0000", 2024-09-14T09:09:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011578026 2024-09-14T09:09:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:89485 3.3 3:c3eae671:::rbd_data.1112a10502fe.0000000000000248:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:09:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.796051111000001, 2024-09-14T09:09:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.12841583300000001, 2024-09-14T09:09:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 89485 2024-09-14T09:09:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:09:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:09:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685529+0000", 2024-09-14T09:09:48.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.11e-06 2024-09-14T09:09:48.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:48.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685534+0000", 2024-09-14T09:09:48.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0289999999999996e-06 2024-09-14T09:09:48.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:48.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685546+0000", 2024-09-14T09:09:48.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2062000000000001e-05 2024-09-14T09:09:48.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685554+0000", 2024-09-14T09:09:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7889999999999995e-06 2024-09-14T09:09:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685618+0000", 2024-09-14T09:09:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4487999999999996e-05 2024-09-14T09:09:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685628+0000", 2024-09-14T09:09:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5840000000000001e-06 2024-09-14T09:09:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802613+0000", 2024-09-14T09:09:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.116984703 2024-09-14T09:09:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802768+0000", 2024-09-14T09:09:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015541599999999999 2024-09-14T09:09:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813944+0000", 2024-09-14T09:09:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011175651999999999 2024-09-14T09:09:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:90751 3.3 3:c22bfcfe:::rbd_data.1112a10502fe.000000000000024e:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:09:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.744980327, 2024-09-14T09:09:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077582650000000003, 2024-09-14T09:09:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 90751 2024-09-14T09:09:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:09:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:09:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736600+0000", 2024-09-14T09:09:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.71e-07 2024-09-14T09:09:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736608+0000", 2024-09-14T09:09:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2679999999999994e-06 2024-09-14T09:09:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736620+0000", 2024-09-14T09:09:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2064e-05 2024-09-14T09:09:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736627+0000", 2024-09-14T09:09:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8129999999999998e-06 2024-09-14T09:09:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736676+0000", 2024-09-14T09:09:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.901e-05 2024-09-14T09:09:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736685+0000", 2024-09-14T09:09:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:09:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803227+0000", 2024-09-14T09:09:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066541874000000001 2024-09-14T09:09:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803381+0000", 2024-09-14T09:09:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015482500000000001 2024-09-14T09:09:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.814181+0000", 2024-09-14T09:09:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010799944000000001 2024-09-14T09:09:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:90760 3.3 3:c116ad26:::rbd_data.1112a10502fe.0000000000000251:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:09:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.744878010000001, 2024-09-14T09:09:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077694599000000003, 2024-09-14T09:09:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 90760 2024-09-14T09:09:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:09:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:09:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736702+0000", 2024-09-14T09:09:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0999999999999998e-07 2024-09-14T09:09:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736705+0000", 2024-09-14T09:09:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0120000000000001e-06 2024-09-14T09:09:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736711+0000", 2024-09-14T09:09:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6279999999999999e-06 2024-09-14T09:09:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736717+0000", 2024-09-14T09:09:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6200000000000004e-06 2024-09-14T09:09:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736765+0000", 2024-09-14T09:09:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7688000000000001e-05 2024-09-14T09:09:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736772+0000", 2024-09-14T09:09:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6529999999999994e-06 2024-09-14T09:09:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803886+0000", 2024-09-14T09:09:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067113795000000004 2024-09-14T09:09:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.804024+0000", 2024-09-14T09:09:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013782000000000001 2024-09-14T09:09:48.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:48.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:48.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:48.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.814396+0000", 2024-09-14T09:09:48.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010371773000000001 2024-09-14T09:09:48.579 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.579 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:48.579 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.579 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:48.579 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:48.579 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:48.581 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:09:48.581 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:48.583+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:48.682 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:48.684+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:48.724 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:48.724 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:48.724 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:09:48.724 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:48.732 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:48.782 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:48.785+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:48.841 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:48.841 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:48.841 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:48.841 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:48.841 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:48.853 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:09:48.883 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:48.885+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:48.984 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:48.987+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:49.001 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:228 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 360448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 77.205478869000004, 2024-09-14T09:09:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99234476999999999, 2024-09-14T09:09:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 228 2024-09-14T09:09:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796906+0000", 2024-09-14T09:09:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9399999999999995e-07 2024-09-14T09:09:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796917+0000", 2024-09-14T09:09:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0801e-05 2024-09-14T09:09:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796924+0000", 2024-09-14T09:09:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7750000000000004e-06 2024-09-14T09:09:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9972000000000001e-05 2024-09-14T09:09:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798671+0000", 2024-09-14T09:09:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017271330000000001 2024-09-14T09:09:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798675+0000", 2024-09-14T09:09:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.194e-06 2024-09-14T09:09:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789003+0000", 2024-09-14T09:09:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99032768400000004 2024-09-14T09:09:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789115+0000", 2024-09-14T09:09:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112236 2024-09-14T09:09:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789250+0000", 2024-09-14T09:09:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013548100000000001 2024-09-14T09:09:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:229 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 819200~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 77.205426646000006, 2024-09-14T09:09:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99287024599999996, 2024-09-14T09:09:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 229 2024-09-14T09:09:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999999e-07 2024-09-14T09:09:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796962+0000", 2024-09-14T09:09:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1479999999999999e-06 2024-09-14T09:09:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796967+0000", 2024-09-14T09:09:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1499999999999998e-06 2024-09-14T09:09:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:09:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-06 2024-09-14T09:09:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798688+0000", 2024-09-14T09:09:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017172660000000001 2024-09-14T09:09:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798691+0000", 2024-09-14T09:09:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:09:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789599+0000", 2024-09-14T09:09:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99090839399999997 2024-09-14T09:09:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789716+0000", 2024-09-14T09:09:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116474 2024-09-14T09:09:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789828+0000", 2024-09-14T09:09:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112293 2024-09-14T09:09:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:230 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1277952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 77.205405998000003, 2024-09-14T09:09:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99307501600000003, 2024-09-14T09:09:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 230 2024-09-14T09:09:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796979+0000", 2024-09-14T09:09:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.34e-07 2024-09-14T09:09:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796980+0000", 2024-09-14T09:09:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.53e-06 2024-09-14T09:09:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796986+0000", 2024-09-14T09:09:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9989999999999997e-06 2024-09-14T09:09:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796989+0000", 2024-09-14T09:09:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0340000000000001e-06 2024-09-14T09:09:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798702+0000", 2024-09-14T09:09:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001712756 2024-09-14T09:09:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798705+0000", 2024-09-14T09:09:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7750000000000001e-06 2024-09-14T09:09:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789870+0000", 2024-09-14T09:09:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991165026 2024-09-14T09:09:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789955+0000", 2024-09-14T09:09:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4839999999999994e-05 2024-09-14T09:09:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790053+0000", 2024-09-14T09:09:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8721999999999994e-05 2024-09-14T09:09:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:231 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 77.20539067, 2024-09-14T09:09:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99319130300000003, 2024-09-14T09:09:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 231 2024-09-14T09:09:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2024-09-14T09:09:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796995+0000", 2024-09-14T09:09:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2500000000000001e-06 2024-09-14T09:09:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796998+0000", 2024-09-14T09:09:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3230000000000002e-06 2024-09-14T09:09:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797001+0000", 2024-09-14T09:09:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7099999999999999e-06 2024-09-14T09:09:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798718+0000", 2024-09-14T09:09:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017168070000000001 2024-09-14T09:09:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798721+0000", 2024-09-14T09:09:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.853e-06 2024-09-14T09:09:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790077+0000", 2024-09-14T09:09:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991356393 2024-09-14T09:09:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790129+0000", 2024-09-14T09:09:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2240999999999997e-05 2024-09-14T09:09:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790185+0000", 2024-09-14T09:09:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5515e-05 2024-09-14T09:09:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:232 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2195456~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 77.205380013999999, 2024-09-14T09:09:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99329117899999997, 2024-09-14T09:09:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 232 2024-09-14T09:09:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797005+0000", 2024-09-14T09:09:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2024-09-14T09:09:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797006+0000", 2024-09-14T09:09:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3200000000000001e-06 2024-09-14T09:09:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797009+0000", 2024-09-14T09:09:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4680000000000001e-06 2024-09-14T09:09:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797012+0000", 2024-09-14T09:09:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4770000000000002e-06 2024-09-14T09:09:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798743+0000", 2024-09-14T09:09:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017312 2024-09-14T09:09:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798747+0000", 2024-09-14T09:09:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.484e-06 2024-09-14T09:09:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790201+0000", 2024-09-14T09:09:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99145419499999998 2024-09-14T09:09:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790241+0000", 2024-09-14T09:09:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0587999999999998e-05 2024-09-14T09:09:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790296+0000", 2024-09-14T09:09:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4212000000000002e-05 2024-09-14T09:09:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:233 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2654208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 77.205369391000005, 2024-09-14T09:09:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99337220100000001, 2024-09-14T09:09:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 233 2024-09-14T09:09:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:09:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:09:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.269e-06 2024-09-14T09:09:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797019+0000", 2024-09-14T09:09:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9519999999999999e-06 2024-09-14T09:09:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797022+0000", 2024-09-14T09:09:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6079999999999998e-06 2024-09-14T09:09:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798759+0000", 2024-09-14T09:09:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001737342 2024-09-14T09:09:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798762+0000", 2024-09-14T09:09:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:09:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790310+0000", 2024-09-14T09:09:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99154738799999997 2024-09-14T09:09:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790349+0000", 2024-09-14T09:09:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9573000000000002e-05 2024-09-14T09:09:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790387+0000", 2024-09-14T09:09:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7985999999999998e-05 2024-09-14T09:09:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:234 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3112960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 77.205359345999995, 2024-09-14T09:09:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99345674500000003, 2024-09-14T09:09:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 234 2024-09-14T09:09:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0100000000000001e-07 2024-09-14T09:09:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0699999999999999e-06 2024-09-14T09:09:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:09:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.886e-06 2024-09-14T09:09:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797032+0000", 2024-09-14T09:09:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7149999999999998e-06 2024-09-14T09:09:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798778+0000", 2024-09-14T09:09:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017460329999999999 2024-09-14T09:09:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798783+0000", 2024-09-14T09:09:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0760000000000002e-06 2024-09-14T09:09:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790408+0000", 2024-09-14T09:09:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99162473299999998 2024-09-14T09:09:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790446+0000", 2024-09-14T09:09:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8389000000000001e-05 2024-09-14T09:09:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790482+0000", 2024-09-14T09:09:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5642000000000002e-05 2024-09-14T09:09:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:235 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3571712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 77.205349448000007, 2024-09-14T09:09:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993539477, 2024-09-14T09:09:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 235 2024-09-14T09:09:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9999999999999999e-07 2024-09-14T09:09:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797036+0000", 2024-09-14T09:09:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.051e-06 2024-09-14T09:09:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797039+0000", 2024-09-14T09:09:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:09:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797042+0000", 2024-09-14T09:09:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5280000000000002e-06 2024-09-14T09:09:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798809+0000", 2024-09-14T09:09:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001767394 2024-09-14T09:09:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798815+0000", 2024-09-14T09:09:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0859999999999998e-06 2024-09-14T09:09:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790502+0000", 2024-09-14T09:09:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99168652300000004 2024-09-14T09:09:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790539+0000", 2024-09-14T09:09:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7471000000000001e-05 2024-09-14T09:09:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790574+0000", 2024-09-14T09:09:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5292e-05 2024-09-14T09:09:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:236 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 4030464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 77.205339214999995, 2024-09-14T09:09:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993619743, 2024-09-14T09:09:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 236 2024-09-14T09:09:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1400000000000001e-07 2024-09-14T09:09:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797047+0000", 2024-09-14T09:09:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3400000000000001e-06 2024-09-14T09:09:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:09:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0699999999999998e-06 2024-09-14T09:09:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797053+0000", 2024-09-14T09:09:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7310000000000002e-06 2024-09-14T09:09:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798839+0000", 2024-09-14T09:09:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001786403 2024-09-14T09:09:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798844+0000", 2024-09-14T09:09:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3730000000000001e-06 2024-09-14T09:09:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790592+0000", 2024-09-14T09:09:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99174818099999995 2024-09-14T09:09:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790628+0000", 2024-09-14T09:09:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5831000000000003e-05 2024-09-14T09:09:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790665+0000", 2024-09-14T09:09:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-05 2024-09-14T09:09:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:365 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 77.203152187000001, 2024-09-14T09:09:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157278400000004, 2024-09-14T09:09:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 365 2024-09-14T09:09:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:09:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799233+0000", 2024-09-14T09:09:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.057e-06 2024-09-14T09:09:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799236+0000", 2024-09-14T09:09:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0249999999999998e-06 2024-09-14T09:09:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799239+0000", 2024-09-14T09:09:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.481e-06 2024-09-14T09:09:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800963+0000", 2024-09-14T09:09:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017240440000000001 2024-09-14T09:09:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800969+0000", 2024-09-14T09:09:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1410000000000002e-06 2024-09-14T09:09:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790682+0000", 2024-09-14T09:09:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98971330300000004 2024-09-14T09:09:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790753+0000", 2024-09-14T09:09:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0548000000000003e-05 2024-09-14T09:09:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790805+0000", 2024-09-14T09:09:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1981999999999998e-05 2024-09-14T09:09:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:366 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 77.203142094, 2024-09-14T09:09:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99173757299999998, 2024-09-14T09:09:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 366 2024-09-14T09:09:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-07 2024-09-14T09:09:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799244+0000", 2024-09-14T09:09:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.359e-06 2024-09-14T09:09:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799247+0000", 2024-09-14T09:09:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4929999999999998e-06 2024-09-14T09:09:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799250+0000", 2024-09-14T09:09:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:09:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800991+0000", 2024-09-14T09:09:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017412809999999999 2024-09-14T09:09:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800997+0000", 2024-09-14T09:09:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:09:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790824+0000", 2024-09-14T09:09:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98982735399999999 2024-09-14T09:09:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790891+0000", 2024-09-14T09:09:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7243999999999995e-05 2024-09-14T09:09:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790980+0000", 2024-09-14T09:09:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8608000000000003e-05 2024-09-14T09:09:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:367 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 77.203130721999997, 2024-09-14T09:09:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99188259999999995, 2024-09-14T09:09:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 367 2024-09-14T09:09:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-07 2024-09-14T09:09:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799255+0000", 2024-09-14T09:09:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.111e-06 2024-09-14T09:09:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799259+0000", 2024-09-14T09:09:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8650000000000003e-06 2024-09-14T09:09:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799262+0000", 2024-09-14T09:09:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.128e-06 2024-09-14T09:09:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801029+0000", 2024-09-14T09:09:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017668460000000001 2024-09-14T09:09:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801032+0000", 2024-09-14T09:09:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3179999999999998e-06 2024-09-14T09:09:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791011+0000", 2024-09-14T09:09:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98997920399999995 2024-09-14T09:09:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791077+0000", 2024-09-14T09:09:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5214000000000003e-05 2024-09-14T09:09:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791136+0000", 2024-09-14T09:09:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9710000000000003e-05 2024-09-14T09:09:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:368 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 77.203119178999998, 2024-09-14T09:09:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99201753800000003, 2024-09-14T09:09:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 368 2024-09-14T09:09:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4900000000000002e-07 2024-09-14T09:09:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799267+0000", 2024-09-14T09:09:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.079e-06 2024-09-14T09:09:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799270+0000", 2024-09-14T09:09:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.993e-06 2024-09-14T09:09:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799272+0000", 2024-09-14T09:09:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.695e-06 2024-09-14T09:09:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801043+0000", 2024-09-14T09:09:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001771105 2024-09-14T09:09:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801046+0000", 2024-09-14T09:09:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7999999999999999e-06 2024-09-14T09:09:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791150+0000", 2024-09-14T09:09:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99010348699999995 2024-09-14T09:09:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791193+0000", 2024-09-14T09:09:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3615999999999997e-05 2024-09-14T09:09:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791283+0000", 2024-09-14T09:09:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9513999999999997e-05 2024-09-14T09:09:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:369 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 77.203108841000002, 2024-09-14T09:09:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99213433600000001, 2024-09-14T09:09:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 369 2024-09-14T09:09:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:09:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799277+0000", 2024-09-14T09:09:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.108e-06 2024-09-14T09:09:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799280+0000", 2024-09-14T09:09:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:09:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799283+0000", 2024-09-14T09:09:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.531e-06 2024-09-14T09:09:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801058+0000", 2024-09-14T09:09:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001775085 2024-09-14T09:09:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801060+0000", 2024-09-14T09:09:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8260000000000001e-06 2024-09-14T09:09:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791299+0000", 2024-09-14T09:09:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99023856799999999 2024-09-14T09:09:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791352+0000", 2024-09-14T09:09:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2528000000000003e-05 2024-09-14T09:09:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791410+0000", 2024-09-14T09:09:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8298000000000003e-05 2024-09-14T09:09:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:370 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2457600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 77.203084074000003, 2024-09-14T09:09:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99220795399999995, 2024-09-14T09:09:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 370 2024-09-14T09:09:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799301+0000", 2024-09-14T09:09:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2024-09-14T09:09:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799303+0000", 2024-09-14T09:09:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9319999999999999e-06 2024-09-14T09:09:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799310+0000", 2024-09-14T09:09:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8680000000000001e-06 2024-09-14T09:09:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799315+0000", 2024-09-14T09:09:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.921e-06 2024-09-14T09:09:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801071+0000", 2024-09-14T09:09:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001756678 2024-09-14T09:09:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801080+0000", 2024-09-14T09:09:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6060000000000003e-06 2024-09-14T09:09:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791429+0000", 2024-09-14T09:09:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99034944599999997 2024-09-14T09:09:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791471+0000", 2024-09-14T09:09:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1279999999999998e-05 2024-09-14T09:09:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791508+0000", 2024-09-14T09:09:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7663999999999997e-05 2024-09-14T09:09:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:371 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2916352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 77.203062901999999, 2024-09-14T09:09:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99228692299999999, 2024-09-14T09:09:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 371 2024-09-14T09:09:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799322+0000", 2024-09-14T09:09:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:09:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799333+0000", 2024-09-14T09:09:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1044e-05 2024-09-14T09:09:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799341+0000", 2024-09-14T09:09:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8439999999999998e-06 2024-09-14T09:09:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799354+0000", 2024-09-14T09:09:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3114e-05 2024-09-14T09:09:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801093+0000", 2024-09-14T09:09:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017385910000000001 2024-09-14T09:09:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801096+0000", 2024-09-14T09:09:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0680000000000001e-06 2024-09-14T09:09:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791528+0000", 2024-09-14T09:09:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99043264200000003 2024-09-14T09:09:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791570+0000", 2024-09-14T09:09:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2144999999999997e-05 2024-09-14T09:09:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791608+0000", 2024-09-14T09:09:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7966000000000002e-05 2024-09-14T09:09:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:372 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3375104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 77.203022353999998, 2024-09-14T09:09:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992342897, 2024-09-14T09:09:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 372 2024-09-14T09:09:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799363+0000", 2024-09-14T09:09:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2024-09-14T09:09:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799365+0000", 2024-09-14T09:09:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5500000000000001e-06 2024-09-14T09:09:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799371+0000", 2024-09-14T09:09:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2500000000000003e-06 2024-09-14T09:09:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799377+0000", 2024-09-14T09:09:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7509999999999997e-06 2024-09-14T09:09:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801107+0000", 2024-09-14T09:09:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017298019999999999 2024-09-14T09:09:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801111+0000", 2024-09-14T09:09:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8619999999999996e-06 2024-09-14T09:09:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791626+0000", 2024-09-14T09:09:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99051563300000001 2024-09-14T09:09:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791668+0000", 2024-09-14T09:09:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1424000000000002e-05 2024-09-14T09:09:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791705+0000", 2024-09-14T09:09:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7035e-05 2024-09-14T09:09:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:373 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 77.203000408999998, 2024-09-14T09:09:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99253589399999997, 2024-09-14T09:09:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 373 2024-09-14T09:09:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2024-09-14T09:09:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799387+0000", 2024-09-14T09:09:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1019999999999999e-06 2024-09-14T09:09:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799393+0000", 2024-09-14T09:09:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0190000000000003e-06 2024-09-14T09:09:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799398+0000", 2024-09-14T09:09:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:09:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801123+0000", 2024-09-14T09:09:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017251949999999999 2024-09-14T09:09:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801126+0000", 2024-09-14T09:09:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9280000000000002e-06 2024-09-14T09:09:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791746+0000", 2024-09-14T09:09:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99062036899999995 2024-09-14T09:09:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791835+0000", 2024-09-14T09:09:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9004000000000004e-05 2024-09-14T09:09:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791920+0000", 2024-09-14T09:09:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4524000000000006e-05 2024-09-14T09:09:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:60352 3.0 3.6d62a5c0 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:09:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.620364571000003, 2024-09-14T09:09:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41710537399999997, 2024-09-14T09:09:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 60352 2024-09-14T09:09:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:09:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:09:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382044+0000", 2024-09-14T09:09:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4640000000000001e-05 2024-09-14T09:09:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382048+0000", 2024-09-14T09:09:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4690000000000002e-06 2024-09-14T09:09:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382053+0000", 2024-09-14T09:09:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:09:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382068+0000", 2024-09-14T09:09:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4399000000000001e-05 2024-09-14T09:09:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382121+0000", 2024-09-14T09:09:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3578000000000001e-05 2024-09-14T09:09:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382127+0000", 2024-09-14T09:09:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2024-09-14T09:09:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799116+0000", 2024-09-14T09:09:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.416988566 2024-09-14T09:09:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799125+0000", 2024-09-14T09:09:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3100000000000006e-06 2024-09-14T09:09:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:63559 3.0 3.95b285c0 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.614533197999997, 2024-09-14T09:09:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.411301215, 2024-09-14T09:09:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 63559 2024-09-14T09:09:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2499999999999999e-07 2024-09-14T09:09:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387853+0000", 2024-09-14T09:09:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.477e-06 2024-09-14T09:09:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387856+0000", 2024-09-14T09:09:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1429999999999998e-06 2024-09-14T09:09:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387859+0000", 2024-09-14T09:09:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.582e-06 2024-09-14T09:09:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387888+0000", 2024-09-14T09:09:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9609000000000001e-05 2024-09-14T09:09:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387893+0000", 2024-09-14T09:09:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6779999999999999e-06 2024-09-14T09:09:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799143+0000", 2024-09-14T09:09:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41124997099999999 2024-09-14T09:09:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799152+0000", 2024-09-14T09:09:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5300000000000002e-06 2024-09-14T09:09:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:49.105 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:49.107 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:09:49.107 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:49.108+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:49.208 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:49.209+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:49.209 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:49.210 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:49.210 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:09:49.210 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:49.219 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:09:49.309 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:49.311+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:49.362 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:49.362 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:49.362 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:49.362 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:49.362 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:49.370 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:09:49.412 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:49.414+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:49.511 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:49.513+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:49.515 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:49.515 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:49.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:49.515 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:49.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.515 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55979 3.e 3:740d1568:::rbd_data.1112a10502fe.0000000000000133:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:49.515 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:49.515 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 33.665660027999998, 2024-09-14T09:09:49.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.95211669700000001, 2024-09-14T09:09:49.516 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:49.516 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:49.516 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:49.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:49.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:49.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:49.516 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55979 2024-09-14T09:09:49.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.516 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:49.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:49.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:49.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:49.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:49.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:49.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850380+0000", 2024-09-14T09:09:49.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.615e-06 2024-09-14T09:09:49.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:49.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850386+0000", 2024-09-14T09:09:49.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8000000000000001e-06 2024-09-14T09:09:49.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:49.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850403+0000", 2024-09-14T09:09:49.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6339999999999999e-05 2024-09-14T09:09:49.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850413+0000", 2024-09-14T09:09:49.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8609999999999993e-06 2024-09-14T09:09:49.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851033+0000", 2024-09-14T09:09:49.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062034700000000004 2024-09-14T09:09:49.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:09:49.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851042+0000", 2024-09-14T09:09:49.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8340000000000005e-06 2024-09-14T09:09:49.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853175+0000", 2024-09-14T09:09:49.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0021332809999999999 2024-09-14T09:09:49.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853183+0000", 2024-09-14T09:09:49.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:09:49.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795232+0000", 2024-09-14T09:09:49.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94204854900000001 2024-09-14T09:09:49.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:49.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795413+0000", 2024-09-14T09:09:49.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018059200000000001 2024-09-14T09:09:49.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:09:49.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795717+0000", 2024-09-14T09:09:49.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000304636 2024-09-14T09:09:49.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:49.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799631+0000", 2024-09-14T09:09:49.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136910000000004 2024-09-14T09:09:49.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:49.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802290+0000", 2024-09-14T09:09:49.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026588010000000001 2024-09-14T09:09:49.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:49.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802362+0000", 2024-09-14T09:09:49.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2018000000000001e-05 2024-09-14T09:09:49.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:49.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802495+0000", 2024-09-14T09:09:49.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000132967 2024-09-14T09:09:49.523 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.523 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:49.523 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.523 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55990 3.e 3:72d6260e:::rbd_data.1112a10502fe.000000000000016c:head [stat,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:49.523 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:49.523 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 33.665598721000002, 2024-09-14T09:09:49.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.952433164, 2024-09-14T09:09:49.523 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:49.523 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:49.523 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:49.523 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:49.523 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:49.524 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:49.524 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55990 2024-09-14T09:09:49.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.524 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:49.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:49.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:49.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:49.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:49.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:49.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850440+0000", 2024-09-14T09:09:49.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5199999999999996e-07 2024-09-14T09:09:49.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:49.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850444+0000", 2024-09-14T09:09:49.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.019e-06 2024-09-14T09:09:49.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:49.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850452+0000", 2024-09-14T09:09:49.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0209999999999999e-06 2024-09-14T09:09:49.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850457+0000", 2024-09-14T09:09:49.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9529999999999998e-06 2024-09-14T09:09:49.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851100+0000", 2024-09-14T09:09:49.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00064299699999999997 2024-09-14T09:09:49.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:49.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851108+0000", 2024-09-14T09:09:49.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2279999999999998e-06 2024-09-14T09:09:49.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853208+0000", 2024-09-14T09:09:49.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020996579999999999 2024-09-14T09:09:49.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853213+0000", 2024-09-14T09:09:49.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4029999999999998e-06 2024-09-14T09:09:49.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796098+0000", 2024-09-14T09:09:49.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94288483700000003 2024-09-14T09:09:49.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:49.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796247+0000", 2024-09-14T09:09:49.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014925800000000001 2024-09-14T09:09:49.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:49.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802872+0000", 2024-09-14T09:09:49.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006625138 2024-09-14T09:09:49.528 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.528 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:49.528 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.529 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:49.529 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:49.529 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 33.501359948000001, 2024-09-14T09:09:49.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77465830800000002, 2024-09-14T09:09:49.529 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:49.529 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:49.529 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:49.529 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:49.529 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:49.529 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:49.529 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 58987 2024-09-14T09:09:49.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.530 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:49.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:49.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:49.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:49.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:49.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:49.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014680+0000", 2024-09-14T09:09:49.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9250000000000002e-06 2024-09-14T09:09:49.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:49.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014689+0000", 2024-09-14T09:09:49.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9730000000000003e-06 2024-09-14T09:09:49.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:49.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014709+0000", 2024-09-14T09:09:49.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9641999999999999e-05 2024-09-14T09:09:49.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014720+0000", 2024-09-14T09:09:49.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-09-14T09:09:49.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014796+0000", 2024-09-14T09:09:49.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6567000000000001e-05 2024-09-14T09:09:49.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014808+0000", 2024-09-14T09:09:49.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1435e-05 2024-09-14T09:09:49.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789325+0000", 2024-09-14T09:09:49.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77451705999999998 2024-09-14T09:09:49.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:49.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789336+0000", 2024-09-14T09:09:49.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1466e-05 2024-09-14T09:09:49.533 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.533 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:49.533 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.533 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:59017 3.3 3.6b81fb83 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:49.533 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:49.533 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 33.499707544000003, 2024-09-14T09:09:49.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77253447099999994, 2024-09-14T09:09:49.534 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:49.534 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:49.534 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:49.534 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:49.534 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:49.534 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:49.534 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 59017 2024-09-14T09:09:49.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.534 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:49.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:49.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:49.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:49.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:49.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:49.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016332+0000", 2024-09-14T09:09:49.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3459999999999999e-06 2024-09-14T09:09:49.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:49.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016337+0000", 2024-09-14T09:09:49.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.48e-06 2024-09-14T09:09:49.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:49.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016355+0000", 2024-09-14T09:09:49.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7955e-05 2024-09-14T09:09:49.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016364+0000", 2024-09-14T09:09:49.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.02e-06 2024-09-14T09:09:49.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016433+0000", 2024-09-14T09:09:49.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8398000000000005e-05 2024-09-14T09:09:49.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016442+0000", 2024-09-14T09:09:49.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1819999999999995e-06 2024-09-14T09:09:49.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788855+0000", 2024-09-14T09:09:49.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77241356299999997 2024-09-14T09:09:49.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:49.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788865+0000", 2024-09-14T09:09:49.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5270000000000004e-06 2024-09-14T09:09:49.537 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.537 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:49.538 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.538 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60343 3.e 3:721b16e6:::rbd_data.1112a10502fe.000000000000014b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:49.538 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:49.538 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 33.395737941999997, 2024-09-14T09:09:49.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68876920900000005, 2024-09-14T09:09:49.538 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:49.538 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:49.538 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:49.538 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:49.538 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:49.538 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:49.538 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60343 2024-09-14T09:09:49.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.538 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:49.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:49.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:49.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:49.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:49.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:49.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120302+0000", 2024-09-14T09:09:49.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0279999999999999e-06 2024-09-14T09:09:49.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:49.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120310+0000", 2024-09-14T09:09:49.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4330000000000004e-06 2024-09-14T09:09:49.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:49.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120333+0000", 2024-09-14T09:09:49.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2200000000000001e-05 2024-09-14T09:09:49.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120343+0000", 2024-09-14T09:09:49.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0560000000000001e-05 2024-09-14T09:09:49.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120414+0000", 2024-09-14T09:09:49.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0493000000000004e-05 2024-09-14T09:09:49.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120424+0000", 2024-09-14T09:09:49.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.059e-05 2024-09-14T09:09:49.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796679+0000", 2024-09-14T09:09:49.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67625512700000001 2024-09-14T09:09:49.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:49.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796833+0000", 2024-09-14T09:09:49.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015403500000000001 2024-09-14T09:09:49.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:09:49.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797239+0000", 2024-09-14T09:09:49.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040503000000000002 2024-09-14T09:09:49.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:49.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802918+0000", 2024-09-14T09:09:49.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056796199999999998 2024-09-14T09:09:49.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:49.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808655+0000", 2024-09-14T09:09:49.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057365089999999999 2024-09-14T09:09:49.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:49.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808850+0000", 2024-09-14T09:09:49.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000194904 2024-09-14T09:09:49.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:49.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809069+0000", 2024-09-14T09:09:49.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021968000000000001 2024-09-14T09:09:49.543 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.544 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:49.544 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.544 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60356 3.2 3:40f9e9e7:::rbd_data.1112a10502fe.0000000000000160:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:49.544 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:49.544 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 33.394675429000003, 2024-09-14T09:09:49.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68053790800000002, 2024-09-14T09:09:49.544 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:49.544 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:49.544 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:49.544 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:49.544 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:49.545 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:49.545 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60356 2024-09-14T09:09:49.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.545 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:49.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:49.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:49.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:49.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:49.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:49.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121364+0000", 2024-09-14T09:09:49.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.173e-06 2024-09-14T09:09:49.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:49.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121371+0000", 2024-09-14T09:09:49.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-09-14T09:09:49.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:49.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121386+0000", 2024-09-14T09:09:49.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4925e-05 2024-09-14T09:09:49.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121395+0000", 2024-09-14T09:09:49.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8190000000000003e-06 2024-09-14T09:09:49.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121464+0000", 2024-09-14T09:09:49.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8149000000000001e-05 2024-09-14T09:09:49.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121474+0000", 2024-09-14T09:09:49.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0927999999999999e-05 2024-09-14T09:09:49.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795901+0000", 2024-09-14T09:09:49.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67442645499999998 2024-09-14T09:09:49.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:49.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796068+0000", 2024-09-14T09:09:49.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016655700000000001 2024-09-14T09:09:49.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 3", 2024-09-14T09:09:49.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796354+0000", 2024-09-14T09:09:49.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00028646999999999999 2024-09-14T09:09:49.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:49.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.800348+0000", 2024-09-14T09:09:49.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039943119999999999 2024-09-14T09:09:49.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:49.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801690+0000", 2024-09-14T09:09:49.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013415090000000001 2024-09-14T09:09:49.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:49.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801771+0000", 2024-09-14T09:09:49.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1678e-05 2024-09-14T09:09:49.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:49.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801900+0000", 2024-09-14T09:09:49.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000128978 2024-09-14T09:09:49.551 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.551 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:49.551 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.551 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62163 3.e 3:713ab431:::rbd_data.1112a10502fe.0000000000000198:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:49.551 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:49.551 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 33.304305221999996, 2024-09-14T09:09:49.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.597552682, 2024-09-14T09:09:49.552 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:49.552 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:49.552 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:49.552 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:49.552 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:49.552 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:49.552 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62163 2024-09-14T09:09:49.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.552 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:49.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:49.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:49.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:49.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:49.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:49.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211735+0000", 2024-09-14T09:09:49.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1110000000000002e-06 2024-09-14T09:09:49.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:49.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211744+0000", 2024-09-14T09:09:49.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0790000000000007e-06 2024-09-14T09:09:49.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:49.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211765+0000", 2024-09-14T09:09:49.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1114000000000001e-05 2024-09-14T09:09:49.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211775+0000", 2024-09-14T09:09:49.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0033e-05 2024-09-14T09:09:49.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211847+0000", 2024-09-14T09:09:49.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1503999999999998e-05 2024-09-14T09:09:49.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211857+0000", 2024-09-14T09:09:49.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0378e-05 2024-09-14T09:09:49.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799140+0000", 2024-09-14T09:09:49.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.58728279100000003 2024-09-14T09:09:49.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:49.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799289+0000", 2024-09-14T09:09:49.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000148966 2024-09-14T09:09:49.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:49.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809285+0000", 2024-09-14T09:09:49.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099967059999999993 2024-09-14T09:09:49.556 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.556 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:49.557 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.557 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63582 3.2 3:467f2009:::rbd_data.1112a10502fe.00000000000001a1:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:49.557 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:49.557 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 33.229112104999999, 2024-09-14T09:09:49.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51869012999999997, 2024-09-14T09:09:49.557 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:49.557 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:49.557 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:49.557 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:49.557 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:49.557 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:49.558 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63582 2024-09-14T09:09:49.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.558 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:49.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:49.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:49.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:49.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:49.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:49.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286928+0000", 2024-09-14T09:09:49.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.812e-06 2024-09-14T09:09:49.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:49.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286936+0000", 2024-09-14T09:09:49.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2390000000000002e-06 2024-09-14T09:09:49.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:49.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286955+0000", 2024-09-14T09:09:49.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8853000000000001e-05 2024-09-14T09:09:49.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286972+0000", 2024-09-14T09:09:49.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7365000000000001e-05 2024-09-14T09:09:49.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287052+0000", 2024-09-14T09:09:49.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9491000000000002e-05 2024-09-14T09:09:49.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287063+0000", 2024-09-14T09:09:49.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1620999999999999e-05 2024-09-14T09:09:49.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796696+0000", 2024-09-14T09:09:49.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50963256999999995 2024-09-14T09:09:49.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:49.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796847+0000", 2024-09-14T09:09:49.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015126899999999999 2024-09-14T09:09:49.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:49.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.805616+0000", 2024-09-14T09:09:49.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087689099999999996 2024-09-14T09:09:49.561 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.562 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:49.562 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.562 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63586 3.3 3.d4e49b03 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:49.562 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:49.562 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 33.229027723999998, 2024-09-14T09:09:49.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50188935099999998, 2024-09-14T09:09:49.562 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:49.562 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:49.562 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:49.562 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:49.562 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:49.562 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:49.562 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63586 2024-09-14T09:09:49.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.563 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:49.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:49.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:49.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:49.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:49.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:49.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287011+0000", 2024-09-14T09:09:49.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.61e-07 2024-09-14T09:09:49.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:49.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287014+0000", 2024-09-14T09:09:49.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3900000000000002e-06 2024-09-14T09:09:49.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:49.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287023+0000", 2024-09-14T09:09:49.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3380000000000005e-06 2024-09-14T09:09:49.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287029+0000", 2024-09-14T09:09:49.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0079999999999999e-06 2024-09-14T09:09:49.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287087+0000", 2024-09-14T09:09:49.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8322000000000002e-05 2024-09-14T09:09:49.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287096+0000", 2024-09-14T09:09:49.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8580000000000006e-06 2024-09-14T09:09:49.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788891+0000", 2024-09-14T09:09:49.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50179498499999997 2024-09-14T09:09:49.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:49.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788900+0000", 2024-09-14T09:09:49.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.789e-06 2024-09-14T09:09:49.566 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.566 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:49.566 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.566 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60363 3.1d 3:b8b44067:::rbd_data.1112a10502fe.000000000000018b:head [stat,delete] snapc 21=[21] RETRY=12 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:49.566 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:49.566 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.728305986000002, 2024-09-14T09:09:49.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268612690000001, 2024-09-14T09:09:49.567 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:49.567 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:49.567 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:49.567 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:49.567 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:49.567 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:49.567 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60363 2024-09-14T09:09:49.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.567 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:49.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:49.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:49.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:49.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:49.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:49.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787733+0000", 2024-09-14T09:09:49.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.314e-06 2024-09-14T09:09:49.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:49.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787739+0000", 2024-09-14T09:09:49.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5300000000000004e-06 2024-09-14T09:09:49.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:49.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787750+0000", 2024-09-14T09:09:49.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1251e-05 2024-09-14T09:09:49.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:49.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0739999999999993e-06 2024-09-14T09:09:49.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787827+0000", 2024-09-14T09:09:49.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8861000000000004e-05 2024-09-14T09:09:49.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:09:49.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787836+0000", 2024-09-14T09:09:49.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1339999999999993e-06 2024-09-14T09:09:49.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789335+0000", 2024-09-14T09:09:49.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014988289999999999 2024-09-14T09:09:49.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789343+0000", 2024-09-14T09:09:49.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6639999999999998e-06 2024-09-14T09:09:49.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799170+0000", 2024-09-14T09:09:49.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098272500000001 2024-09-14T09:09:49.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:49.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799377+0000", 2024-09-14T09:09:49.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000207126 2024-09-14T09:09:49.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:49.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814593+0000", 2024-09-14T09:09:49.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015216235999999999 2024-09-14T09:09:49.572 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.572 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:49.572 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.572 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63565 3.1d 3:bdc63b28:::rbd_data.1112a10502fe.000000000000016d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=9 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:49.572 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:49.572 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.728260194999997, 2024-09-14T09:09:49.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0271114539999999, 2024-09-14T09:09:49.572 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:49.572 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:49.573 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:49.573 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:49.573 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:49.573 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:49.573 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63565 2024-09-14T09:09:49.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.573 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:49.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:49.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:49.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:49.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:49.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:49.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:49.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6899999999999998e-07 2024-09-14T09:09:49.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:49.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787781+0000", 2024-09-14T09:09:49.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8909999999999999e-06 2024-09-14T09:09:49.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:49.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787787+0000", 2024-09-14T09:09:49.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3230000000000003e-06 2024-09-14T09:09:49.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787793+0000", 2024-09-14T09:09:49.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-09-14T09:09:49.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789455+0000", 2024-09-14T09:09:49.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001661596 2024-09-14T09:09:49.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789463+0000", 2024-09-14T09:09:49.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4889999999999995e-06 2024-09-14T09:09:49.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800115+0000", 2024-09-14T09:09:49.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0106512670000001 2024-09-14T09:09:49.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:49.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800334+0000", 2024-09-14T09:09:49.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000219213 2024-09-14T09:09:49.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:09:49.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800651+0000", 2024-09-14T09:09:49.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00031765500000000002 2024-09-14T09:09:49.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:49.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.811875+0000", 2024-09-14T09:09:49.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011224032 2024-09-14T09:09:49.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:49.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814665+0000", 2024-09-14T09:09:49.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002789606 2024-09-14T09:09:49.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:49.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814742+0000", 2024-09-14T09:09:49.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6916999999999996e-05 2024-09-14T09:09:49.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:49.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814889+0000", 2024-09-14T09:09:49.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014725799999999999 2024-09-14T09:09:49.578 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.578 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:49.578 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.579 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:67113 3.1d 3:bba7fe0d:::rbd_data.1112a10502fe.00000000000001bf:head [stat,delete] snapc 21=[21] RETRY=4 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:49.579 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:49.579 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.727499336999998, 2024-09-14T09:09:49.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0265995649999999, 2024-09-14T09:09:49.579 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:49.579 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:49.579 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:49.579 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:49.579 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:49.579 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:49.579 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 67113 2024-09-14T09:09:49.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.579 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:49.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:49.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:49.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:49.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:49.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:49.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:49.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:09:49.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:49.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788543+0000", 2024-09-14T09:09:49.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-09-14T09:09:49.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:49.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788552+0000", 2024-09-14T09:09:49.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:09:49.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788559+0000", 2024-09-14T09:09:49.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:09:49.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789489+0000", 2024-09-14T09:09:49.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00092982199999999996 2024-09-14T09:09:49.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789497+0000", 2024-09-14T09:09:49.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6299999999999998e-06 2024-09-14T09:09:49.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801068+0000", 2024-09-14T09:09:49.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0115709530000001 2024-09-14T09:09:49.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:49.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801240+0000", 2024-09-14T09:09:49.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017276600000000001 2024-09-14T09:09:49.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:49.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815138+0000", 2024-09-14T09:09:49.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013897856 2024-09-14T09:09:49.584 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.584 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:49.584 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.584 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73412 3.1d 3:be4606c3:::rbd_data.1112a10502fe.00000000000001f2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:49.584 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:49.584 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.727468225000003, 2024-09-14T09:09:49.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026815928, 2024-09-14T09:09:49.584 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:49.584 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:49.584 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:49.584 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:49.584 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:49.585 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:49.585 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73412 2024-09-14T09:09:49.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.585 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:49.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:49.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:49.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:49.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:49.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:49.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:49.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5699999999999998e-07 2024-09-14T09:09:49.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:49.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788572+0000", 2024-09-14T09:09:49.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2809999999999998e-06 2024-09-14T09:09:49.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:49.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788579+0000", 2024-09-14T09:09:49.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5629999999999997e-06 2024-09-14T09:09:49.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788584+0000", 2024-09-14T09:09:49.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1710000000000001e-06 2024-09-14T09:09:49.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789521+0000", 2024-09-14T09:09:49.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00093657400000000002 2024-09-14T09:09:49.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789528+0000", 2024-09-14T09:09:49.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5719999999999997e-06 2024-09-14T09:09:49.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801631+0000", 2024-09-14T09:09:49.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0121023229999999 2024-09-14T09:09:49.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:49.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801792+0000", 2024-09-14T09:09:49.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016174000000000001 2024-09-14T09:09:49.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:49.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815386+0000", 2024-09-14T09:09:49.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013593246999999999 2024-09-14T09:09:49.589 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.589 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:49.589 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.589 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:77244 3.1d 3:b801be19:::rbd_data.1112a10502fe.0000000000000204:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:49.589 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:49.589 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.545603978999999, 2024-09-14T09:09:49.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.84519277100000001, 2024-09-14T09:09:49.589 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:49.589 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:49.589 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:49.589 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:49.589 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:49.590 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:49.590 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 77244 2024-09-14T09:09:49.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.590 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:49.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:49.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:49.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:49.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:49.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:49.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970436+0000", 2024-09-14T09:09:49.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.511e-06 2024-09-14T09:09:49.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:49.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970441+0000", 2024-09-14T09:09:49.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0470000000000001e-06 2024-09-14T09:09:49.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:49.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970453+0000", 2024-09-14T09:09:49.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2629999999999999e-05 2024-09-14T09:09:49.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970461+0000", 2024-09-14T09:09:49.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6850000000000001e-06 2024-09-14T09:09:49.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970524+0000", 2024-09-14T09:09:49.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3332999999999998e-05 2024-09-14T09:09:49.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970544+0000", 2024-09-14T09:09:49.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9731000000000001e-05 2024-09-14T09:09:49.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802188+0000", 2024-09-14T09:09:49.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.83164380000000004 2024-09-14T09:09:49.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:49.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:09:49.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015411999999999999 2024-09-14T09:09:49.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:49.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815627+0000", 2024-09-14T09:09:49.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013284914 2024-09-14T09:09:49.594 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.594 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:49.594 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.594 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:79796 3.1d 3:bc22caaf:::rbd_data.1112a10502fe.000000000000020c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:49.594 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:49.594 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.424295293, 2024-09-14T09:09:49.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72411694299999996, 2024-09-14T09:09:49.594 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:49.595 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:49.595 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:49.595 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:49.595 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:49.595 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:49.595 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 79796 2024-09-14T09:09:49.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.595 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:49.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:49.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:49.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:49.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:49.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:49.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091745+0000", 2024-09-14T09:09:49.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2000000000000001e-06 2024-09-14T09:09:49.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:49.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091752+0000", 2024-09-14T09:09:49.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-09-14T09:09:49.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:49.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091772+0000", 2024-09-14T09:09:49.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9822000000000001e-05 2024-09-14T09:09:49.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091791+0000", 2024-09-14T09:09:49.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9236e-05 2024-09-14T09:09:49.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091882+0000", 2024-09-14T09:09:49.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0783000000000001e-05 2024-09-14T09:09:49.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091892+0000", 2024-09-14T09:09:49.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7999999999999993e-06 2024-09-14T09:09:49.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802744+0000", 2024-09-14T09:09:49.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.710851868 2024-09-14T09:09:49.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:49.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802902+0000", 2024-09-14T09:09:49.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015814900000000001 2024-09-14T09:09:49.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:49.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815860+0000", 2024-09-14T09:09:49.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012957605000000001 2024-09-14T09:09:49.599 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.599 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:49.599 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.599 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80904 3.1d 3:be0e7f3d:::rbd_data.1112a10502fe.0000000000000214:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:49.599 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:49.599 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.344209446000001, 2024-09-14T09:09:49.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64435178100000001, 2024-09-14T09:09:49.600 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:49.600 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:49.600 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:49.600 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:49.600 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:49.600 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:49.600 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80904 2024-09-14T09:09:49.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.600 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:49.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:49.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:49.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:49.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:49.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:49.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171831+0000", 2024-09-14T09:09:49.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0729999999999999e-06 2024-09-14T09:09:49.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:49.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171839+0000", 2024-09-14T09:09:49.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9179999999999994e-06 2024-09-14T09:09:49.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:49.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171857+0000", 2024-09-14T09:09:49.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8957000000000002e-05 2024-09-14T09:09:49.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171867+0000", 2024-09-14T09:09:49.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7100000000000002e-06 2024-09-14T09:09:49.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171957+0000", 2024-09-14T09:09:49.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9932999999999994e-05 2024-09-14T09:09:49.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171974+0000", 2024-09-14T09:09:49.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6988999999999999e-05 2024-09-14T09:09:49.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803301+0000", 2024-09-14T09:09:49.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63132648599999996 2024-09-14T09:09:49.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:49.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803482+0000", 2024-09-14T09:09:49.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000181607 2024-09-14T09:09:49.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:49.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816180+0000", 2024-09-14T09:09:49.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012698108 2024-09-14T09:09:49.604 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.604 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:49.604 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.605 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80964 3.1d 3:be42e20f:::rbd_data.1112a10502fe.0000000000000219:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:49.605 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:49.605 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.338573879000002, 2024-09-14T09:09:49.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63896829799999999, 2024-09-14T09:09:49.605 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:49.605 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:49.605 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:49.605 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:49.605 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:49.605 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:49.605 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80964 2024-09-14T09:09:49.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.605 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:49.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:49.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:49.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:49.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:49.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:49.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177466+0000", 2024-09-14T09:09:49.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6610000000000001e-06 2024-09-14T09:09:49.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:49.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177472+0000", 2024-09-14T09:09:49.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3029999999999996e-06 2024-09-14T09:09:49.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:49.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177490+0000", 2024-09-14T09:09:49.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8099000000000001e-05 2024-09-14T09:09:49.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177499+0000", 2024-09-14T09:09:49.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:09:49.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177560+0000", 2024-09-14T09:09:49.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1334000000000006e-05 2024-09-14T09:09:49.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177578+0000", 2024-09-14T09:09:49.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8434999999999999e-05 2024-09-14T09:09:49.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803910+0000", 2024-09-14T09:09:49.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62633190699999997 2024-09-14T09:09:49.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:49.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.806612+0000", 2024-09-14T09:09:49.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002702257 2024-09-14T09:09:49.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:49.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816432+0000", 2024-09-14T09:09:49.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098199370000000008 2024-09-14T09:09:49.609 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.609 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:49.609 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.610 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83321 3.1d 3:bb24b47b:::rbd_data.1112a10502fe.0000000000000223:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:49.610 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:49.610 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.224120204999998, 2024-09-14T09:09:49.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52477628799999998, 2024-09-14T09:09:49.610 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:49.610 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:49.610 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:49.610 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:49.610 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:49.610 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:49.610 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83321 2024-09-14T09:09:49.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.610 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:49.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:49.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:49.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:49.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:49.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:49.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291920+0000", 2024-09-14T09:09:49.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.888e-06 2024-09-14T09:09:49.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:49.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291926+0000", 2024-09-14T09:09:49.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6059999999999999e-06 2024-09-14T09:09:49.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:49.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291943+0000", 2024-09-14T09:09:49.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6813e-05 2024-09-14T09:09:49.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291952+0000", 2024-09-14T09:09:49.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7439999999999996e-06 2024-09-14T09:09:49.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292023+0000", 2024-09-14T09:09:49.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1320000000000002e-05 2024-09-14T09:09:49.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292030+0000", 2024-09-14T09:09:49.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4219999999999997e-06 2024-09-14T09:09:49.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807221+0000", 2024-09-14T09:09:49.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51519140699999999 2024-09-14T09:09:49.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:49.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807406+0000", 2024-09-14T09:09:49.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018532800000000001 2024-09-14T09:09:49.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:49.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816694+0000", 2024-09-14T09:09:49.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092877600000000008 2024-09-14T09:09:49.614 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.614 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:49.614 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83358 3.1d 3:bb230e23:::rbd_data.1112a10502fe.000000000000022b:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.222600315000001, 2024-09-14T09:09:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52374808900000003, 2024-09-14T09:09:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83358 2024-09-14T09:09:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293439+0000", 2024-09-14T09:09:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5899999999999995e-07 2024-09-14T09:09:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293443+0000", 2024-09-14T09:09:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9309999999999999e-06 2024-09-14T09:09:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293457+0000", 2024-09-14T09:09:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3944999999999999e-05 2024-09-14T09:09:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293466+0000", 2024-09-14T09:09:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4319999999999999e-06 2024-09-14T09:09:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293530+0000", 2024-09-14T09:09:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3860000000000002e-05 2024-09-14T09:09:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293540+0000", 2024-09-14T09:09:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0107e-05 2024-09-14T09:09:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809096+0000", 2024-09-14T09:09:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51555587800000002 2024-09-14T09:09:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809265+0000", 2024-09-14T09:09:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000169092 2024-09-14T09:09:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817186+0000", 2024-09-14T09:09:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079209850000000002 2024-09-14T09:09:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83361 3.1d 3:bd571564:::rbd_data.1112a10502fe.000000000000022c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.222282239000002, 2024-09-14T09:09:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52373873100000001, 2024-09-14T09:09:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83361 2024-09-14T09:09:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293757+0000", 2024-09-14T09:09:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8000000000000004e-07 2024-09-14T09:09:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293762+0000", 2024-09-14T09:09:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8019999999999997e-06 2024-09-14T09:09:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293775+0000", 2024-09-14T09:09:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2884000000000001e-05 2024-09-14T09:09:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293783+0000", 2024-09-14T09:09:49.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:09:49.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293849+0000", 2024-09-14T09:09:49.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5859999999999996e-05 2024-09-14T09:09:49.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:49.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293861+0000", 2024-09-14T09:09:49.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2238999999999999e-05 2024-09-14T09:09:49.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809680+0000", 2024-09-14T09:09:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51581856800000003 2024-09-14T09:09:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809844+0000", 2024-09-14T09:09:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016441200000000001 2024-09-14T09:09:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817494+0000", 2024-09-14T09:09:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076502360000000004 2024-09-14T09:09:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:49.625 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.625 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:49.625 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:49.625 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:49.626 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:49.628+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:49.626 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:09:49.726 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:49.728+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:49.769 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:49.769 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:49.769 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:09:49.770 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:49.778 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:09:49.809 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T09:09:49.863 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:49.865+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:49.928 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:49.930+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:49.931 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:49.931 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:49.931 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:49.931 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:49.931 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:49.941 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:09:50.030 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:50.032+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:50.088 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:50.088 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:50.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:50.089 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:50.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.089 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2265 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4034560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:50.089 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:50.089 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 73.227319578999996, 2024-09-14T09:09:50.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073974829000000006, 2024-09-14T09:09:50.089 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:50.089 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:50.089 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:50.089 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:50.089 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:50.090 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:50.090 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2265 2024-09-14T09:09:50.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.090 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:50.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:50.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:50.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:50.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:50.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:50.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862542+0000", 2024-09-14T09:09:50.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:09:50.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:50.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862543+0000", 2024-09-14T09:09:50.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.81e-06 2024-09-14T09:09:50.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:50.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862549+0000", 2024-09-14T09:09:50.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8850000000000004e-06 2024-09-14T09:09:50.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:50.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862554+0000", 2024-09-14T09:09:50.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5279999999999997e-06 2024-09-14T09:09:50.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:50.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936318+0000", 2024-09-14T09:09:50.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073764422999999996 2024-09-14T09:09:50.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:50.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936412+0000", 2024-09-14T09:09:50.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3801000000000005e-05 2024-09-14T09:09:50.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:50.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936516+0000", 2024-09-14T09:09:50.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000104007 2024-09-14T09:09:50.093 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.094 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:50.094 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.094 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2266 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4096000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:50.094 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:50.094 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 73.227301714999996, 2024-09-14T09:09:50.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074208332000000002, 2024-09-14T09:09:50.094 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:50.094 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:50.094 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:50.094 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:50.095 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:50.095 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:50.095 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2266 2024-09-14T09:09:50.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.095 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:50.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:50.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:50.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:50.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:50.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:50.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862738+0000", 2024-09-14T09:09:50.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017920300000000001 2024-09-14T09:09:50.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:50.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862744+0000", 2024-09-14T09:09:50.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3000000000000001e-06 2024-09-14T09:09:50.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:50.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862753+0000", 2024-09-14T09:09:50.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8179999999999999e-06 2024-09-14T09:09:50.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:50.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862785+0000", 2024-09-14T09:09:50.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1949000000000002e-05 2024-09-14T09:09:50.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:50.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936556+0000", 2024-09-14T09:09:50.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073770268999999999 2024-09-14T09:09:50.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:50.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936657+0000", 2024-09-14T09:09:50.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101387 2024-09-14T09:09:50.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:50.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936767+0000", 2024-09-14T09:09:50.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110406 2024-09-14T09:09:50.098 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.098 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:50.098 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.099 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2267 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4157440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:50.099 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:50.099 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 73.227063133000001, 2024-09-14T09:09:50.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074200918000000005, 2024-09-14T09:09:50.099 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:50.099 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:50.099 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:50.099 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:50.099 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:50.099 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:50.099 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2267 2024-09-14T09:09:50.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.099 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:50.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:50.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:50.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:50.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:50.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:50.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863416+0000", 2024-09-14T09:09:50.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000618492 2024-09-14T09:09:50.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:50.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863421+0000", 2024-09-14T09:09:50.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1359999999999996e-06 2024-09-14T09:09:50.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:50.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863434+0000", 2024-09-14T09:09:50.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2291e-05 2024-09-14T09:09:50.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:50.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863444+0000", 2024-09-14T09:09:50.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9769999999999995e-06 2024-09-14T09:09:50.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:50.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936808+0000", 2024-09-14T09:09:50.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073364051999999999 2024-09-14T09:09:50.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:50.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936892+0000", 2024-09-14T09:09:50.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4641999999999994e-05 2024-09-14T09:09:50.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:50.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936999+0000", 2024-09-14T09:09:50.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106328 2024-09-14T09:09:50.103 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.103 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:50.103 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.103 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2329 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 106496~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:50.103 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:50.104 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 73.226334523999995, 2024-09-14T09:09:50.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074180251000000003, 2024-09-14T09:09:50.104 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:50.104 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:50.104 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:50.104 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:50.104 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:50.104 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:50.104 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2329 2024-09-14T09:09:50.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.104 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:50.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:50.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:50.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:50.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:50.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:50.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864203+0000", 2024-09-14T09:09:50.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000677015 2024-09-14T09:09:50.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:50.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864208+0000", 2024-09-14T09:09:50.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.972e-06 2024-09-14T09:09:50.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:50.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864221+0000", 2024-09-14T09:09:50.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2683e-05 2024-09-14T09:09:50.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:50.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864229+0000", 2024-09-14T09:09:50.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0809999999999994e-06 2024-09-14T09:09:50.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:50.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937430+0000", 2024-09-14T09:09:50.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073201231000000005 2024-09-14T09:09:50.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:50.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937513+0000", 2024-09-14T09:09:50.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2652999999999996e-05 2024-09-14T09:09:50.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:50.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937707+0000", 2024-09-14T09:09:50.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000193616 2024-09-14T09:09:50.110 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.110 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:50.110 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.110 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2331 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 229376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:50.110 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:50.110 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 73.225517026999995, 2024-09-14T09:09:50.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.07400843, 2024-09-14T09:09:50.111 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:50.111 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:50.111 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:50.111 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:50.111 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:50.111 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:50.111 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2331 2024-09-14T09:09:50.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.111 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:50.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:50.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:50.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:50.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:50.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:50.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868104+0000", 2024-09-14T09:09:50.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003760453 2024-09-14T09:09:50.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:50.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868109+0000", 2024-09-14T09:09:50.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9339999999999997e-06 2024-09-14T09:09:50.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:50.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868119+0000", 2024-09-14T09:09:50.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5389999999999996e-06 2024-09-14T09:09:50.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:50.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868126+0000", 2024-09-14T09:09:50.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4499999999999998e-06 2024-09-14T09:09:50.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:50.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938065+0000", 2024-09-14T09:09:50.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069938809000000005 2024-09-14T09:09:50.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:50.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938148+0000", 2024-09-14T09:09:50.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3171999999999996e-05 2024-09-14T09:09:50.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:50.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938352+0000", 2024-09-14T09:09:50.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020407300000000001 2024-09-14T09:09:50.115 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.115 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:50.115 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.115 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2380 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3239936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:50.115 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:50.115 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 73.210491998999998, 2024-09-14T09:09:50.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073985913, 2024-09-14T09:09:50.115 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:50.115 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:50.115 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:50.116 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:50.116 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:50.116 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:50.116 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2380 2024-09-14T09:09:50.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.116 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:50.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:50.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:50.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:50.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:50.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:50.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879697+0000", 2024-09-14T09:09:50.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032864100000000001 2024-09-14T09:09:50.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:50.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879702+0000", 2024-09-14T09:09:50.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.578e-06 2024-09-14T09:09:50.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:50.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879716+0000", 2024-09-14T09:09:50.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.413e-05 2024-09-14T09:09:50.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:50.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879724+0000", 2024-09-14T09:09:50.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.559e-06 2024-09-14T09:09:50.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:50.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953155+0000", 2024-09-14T09:09:50.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073431221000000005 2024-09-14T09:09:50.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:50.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953247+0000", 2024-09-14T09:09:50.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1662000000000004e-05 2024-09-14T09:09:50.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:50.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953355+0000", 2024-09-14T09:09:50.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010812200000000001 2024-09-14T09:09:50.119 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.119 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:50.120 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.120 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2501 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2850816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:50.120 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:50.120 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 73.191949695000005, 2024-09-14T09:09:50.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074288858999999999, 2024-09-14T09:09:50.120 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:50.120 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:50.120 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:50.120 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:50.120 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:50.120 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:50.120 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2501 2024-09-14T09:09:50.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.121 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:50.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:50.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:50.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:50.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:50.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:50.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:50.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.41e-07 2024-09-14T09:09:50.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:50.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897913+0000", 2024-09-14T09:09:50.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3090000000000001e-06 2024-09-14T09:09:50.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:50.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897918+0000", 2024-09-14T09:09:50.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8470000000000003e-06 2024-09-14T09:09:50.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:50.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897922+0000", 2024-09-14T09:09:50.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5549999999999996e-06 2024-09-14T09:09:50.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:50.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971872+0000", 2024-09-14T09:09:50.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073950057999999999 2024-09-14T09:09:50.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:50.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971958+0000", 2024-09-14T09:09:50.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5941999999999998e-05 2024-09-14T09:09:50.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:50.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972200+0000", 2024-09-14T09:09:50.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000241907 2024-09-14T09:09:50.124 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.124 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:50.124 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.124 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2502 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2912256~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:50.124 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:50.124 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 73.191910515000004, 2024-09-14T09:09:50.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074614080999999999, 2024-09-14T09:09:50.124 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:50.124 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:50.125 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:50.125 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:50.125 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:50.125 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:50.125 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2502 2024-09-14T09:09:50.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.126 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:50.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:50.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:50.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:50.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:50.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:50.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897951+0000", 2024-09-14T09:09:50.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:09:50.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:50.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897953+0000", 2024-09-14T09:09:50.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5670000000000002e-06 2024-09-14T09:09:50.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:50.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897970+0000", 2024-09-14T09:09:50.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6319000000000001e-05 2024-09-14T09:09:50.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:50.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897976+0000", 2024-09-14T09:09:50.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8760000000000002e-06 2024-09-14T09:09:50.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:50.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972245+0000", 2024-09-14T09:09:50.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074269186000000001 2024-09-14T09:09:50.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:50.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972333+0000", 2024-09-14T09:09:50.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7800999999999995e-05 2024-09-14T09:09:50.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:50.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972564+0000", 2024-09-14T09:09:50.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000231833 2024-09-14T09:09:50.129 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.129 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:50.129 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.130 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2503 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2973696~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:50.130 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:50.130 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 73.191876497999999, 2024-09-14T09:09:50.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074944286999999998, 2024-09-14T09:09:50.130 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:50.130 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:50.130 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:50.130 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:50.130 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:50.130 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:50.130 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2503 2024-09-14T09:09:50.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.130 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:50.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:50.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:50.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:50.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:50.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:50.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897985+0000", 2024-09-14T09:09:50.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999998e-07 2024-09-14T09:09:50.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:50.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897987+0000", 2024-09-14T09:09:50.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.401e-06 2024-09-14T09:09:50.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:50.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897999+0000", 2024-09-14T09:09:50.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1851999999999999e-05 2024-09-14T09:09:50.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:50.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898005+0000", 2024-09-14T09:09:50.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9789999999999998e-06 2024-09-14T09:09:50.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:50.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972609+0000", 2024-09-14T09:09:50.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074604217 2024-09-14T09:09:50.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:50.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972684+0000", 2024-09-14T09:09:50.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4777999999999995e-05 2024-09-14T09:09:50.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:50.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972929+0000", 2024-09-14T09:09:50.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024448100000000001 2024-09-14T09:09:50.134 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.134 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:50.134 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.134 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2504 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3035136~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:50.134 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:50.135 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 73.191848406000005, 2024-09-14T09:09:50.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075285131000000005, 2024-09-14T09:09:50.135 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:50.135 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:50.135 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:50.135 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:50.135 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:50.135 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:50.135 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2504 2024-09-14T09:09:50.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.135 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:50.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:50.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:50.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:50.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:50.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:50.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898078+0000", 2024-09-14T09:09:50.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5775e-05 2024-09-14T09:09:50.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:50.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898082+0000", 2024-09-14T09:09:50.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.49e-06 2024-09-14T09:09:50.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:50.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898092+0000", 2024-09-14T09:09:50.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0509999999999999e-05 2024-09-14T09:09:50.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:50.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898099+0000", 2024-09-14T09:09:50.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.81e-06 2024-09-14T09:09:50.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:50.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972971+0000", 2024-09-14T09:09:50.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074871788999999994 2024-09-14T09:09:50.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:50.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973055+0000", 2024-09-14T09:09:50.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3980000000000006e-05 2024-09-14T09:09:50.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:50.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973298+0000", 2024-09-14T09:09:50.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024277700000000001 2024-09-14T09:09:50.139 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.139 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:50.139 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.139 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2505 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3096576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:50.139 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:50.139 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 73.191752151000003, 2024-09-14T09:09:50.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075506668999999998, 2024-09-14T09:09:50.139 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:50.139 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:50.139 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:50.139 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:50.140 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:50.140 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:50.140 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2505 2024-09-14T09:09:50.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.140 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:50.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:50.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:50.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:50.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:50.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:50.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898370+0000", 2024-09-14T09:09:50.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026128799999999998 2024-09-14T09:09:50.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:50.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898374+0000", 2024-09-14T09:09:50.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8070000000000001e-06 2024-09-14T09:09:50.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:50.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898383+0000", 2024-09-14T09:09:50.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0520000000000007e-06 2024-09-14T09:09:50.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:50.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898389+0000", 2024-09-14T09:09:50.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2639999999999997e-06 2024-09-14T09:09:50.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:50.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973330+0000", 2024-09-14T09:09:50.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074940548999999995 2024-09-14T09:09:50.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:50.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973402+0000", 2024-09-14T09:09:50.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2556000000000001e-05 2024-09-14T09:09:50.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:50.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973615+0000", 2024-09-14T09:09:50.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000213153 2024-09-14T09:09:50.143 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.143 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:50.143 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.144 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2506 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3158016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:50.144 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:50.144 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 73.191458906999998, 2024-09-14T09:09:50.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075556110999999995, 2024-09-14T09:09:50.144 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:50.144 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:50.144 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:50.144 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:50.144 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:50.144 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:50.144 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2506 2024-09-14T09:09:50.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.144 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:50.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:50.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:50.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:50.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:50.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:50.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898497+0000", 2024-09-14T09:09:50.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4806e-05 2024-09-14T09:09:50.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:50.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898500+0000", 2024-09-14T09:09:50.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.54e-06 2024-09-14T09:09:50.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:50.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898507+0000", 2024-09-14T09:09:50.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1590000000000004e-06 2024-09-14T09:09:50.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:50.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898513+0000", 2024-09-14T09:09:50.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.015e-06 2024-09-14T09:09:50.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:50.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973656+0000", 2024-09-14T09:09:50.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075142929999999997 2024-09-14T09:09:50.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:50.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973742+0000", 2024-09-14T09:09:50.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5535e-05 2024-09-14T09:09:50.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:50.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973958+0000", 2024-09-14T09:09:50.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000216126 2024-09-14T09:09:50.149 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.149 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:50.149 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.149 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2507 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3219456~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:50.150 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:50.150 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 73.191330323000003, 2024-09-14T09:09:50.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075623459000000004, 2024-09-14T09:09:50.150 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:50.150 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:50.150 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:50.150 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:50.150 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:50.150 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:50.150 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2507 2024-09-14T09:09:50.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.151 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:50.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:50.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:50.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:50.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:50.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:50.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898761+0000", 2024-09-14T09:09:50.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000230614 2024-09-14T09:09:50.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:50.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898765+0000", 2024-09-14T09:09:50.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6629999999999999e-06 2024-09-14T09:09:50.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:50.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898774+0000", 2024-09-14T09:09:50.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6749999999999997e-06 2024-09-14T09:09:50.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:50.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898781+0000", 2024-09-14T09:09:50.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4640000000000003e-06 2024-09-14T09:09:50.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:50.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973985+0000", 2024-09-14T09:09:50.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075204101999999995 2024-09-14T09:09:50.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:50.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974063+0000", 2024-09-14T09:09:50.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7632000000000005e-05 2024-09-14T09:09:50.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:50.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974154+0000", 2024-09-14T09:09:50.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1309000000000003e-05 2024-09-14T09:09:50.155 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.155 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:50.155 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.155 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2508 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3280896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:50.155 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:50.155 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 73.191068560000005, 2024-09-14T09:09:50.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075576943999999993, 2024-09-14T09:09:50.155 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:50.156 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:50.156 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:50.156 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:50.156 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:50.156 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:50.156 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2508 2024-09-14T09:09:50.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.156 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:50.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:50.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:50.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:50.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:50.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:50.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899176+0000", 2024-09-14T09:09:50.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038340500000000002 2024-09-14T09:09:50.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:50.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899179+0000", 2024-09-14T09:09:50.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0290000000000001e-06 2024-09-14T09:09:50.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:50.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899186+0000", 2024-09-14T09:09:50.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8199999999999999e-06 2024-09-14T09:09:50.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:50.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899190+0000", 2024-09-14T09:09:50.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2050000000000004e-06 2024-09-14T09:09:50.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:50.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974193+0000", 2024-09-14T09:09:50.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075003632000000001 2024-09-14T09:09:50.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:50.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974276+0000", 2024-09-14T09:09:50.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2272000000000001e-05 2024-09-14T09:09:50.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:50.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974369+0000", 2024-09-14T09:09:50.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3580999999999997e-05 2024-09-14T09:09:50.159 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.159 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:50.159 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.160 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2509 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3342336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:50.160 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:50.160 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 73.190660942999997, 2024-09-14T09:09:50.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075356229999999996, 2024-09-14T09:09:50.160 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:50.160 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:50.160 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:50.160 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:50.160 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:50.160 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:50.160 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2509 2024-09-14T09:09:50.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.161 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:50.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:50.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:50.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:50.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:50.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:50.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899439+0000", 2024-09-14T09:09:50.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023958599999999999 2024-09-14T09:09:50.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:50.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899444+0000", 2024-09-14T09:09:50.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8790000000000002e-06 2024-09-14T09:09:50.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:50.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899455+0000", 2024-09-14T09:09:50.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0597999999999999e-05 2024-09-14T09:09:50.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:50.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899462+0000", 2024-09-14T09:09:50.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8179999999999998e-06 2024-09-14T09:09:50.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:50.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974400+0000", 2024-09-14T09:09:50.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074937999000000005 2024-09-14T09:09:50.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:50.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974465+0000", 2024-09-14T09:09:50.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5134000000000004e-05 2024-09-14T09:09:50.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:50.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974556+0000", 2024-09-14T09:09:50.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1216000000000002e-05 2024-09-14T09:09:50.164 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.164 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:50.164 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.164 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2510 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3403776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:50.164 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:50.164 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 73.190385550000002, 2024-09-14T09:09:50.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075295775999999995, 2024-09-14T09:09:50.165 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:50.165 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:50.165 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:50.165 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:50.165 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:50.165 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:50.165 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2510 2024-09-14T09:09:50.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.165 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:50.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:50.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:50.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:50.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:50.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:50.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899691+0000", 2024-09-14T09:09:50.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021615999999999999 2024-09-14T09:09:50.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:50.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899696+0000", 2024-09-14T09:09:50.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3200000000000001e-06 2024-09-14T09:09:50.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:50.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899704+0000", 2024-09-14T09:09:50.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9440000000000005e-06 2024-09-14T09:09:50.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:50.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899710+0000", 2024-09-14T09:09:50.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.584e-06 2024-09-14T09:09:50.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:50.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974594+0000", 2024-09-14T09:09:50.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074883551000000007 2024-09-14T09:09:50.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:50.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974679+0000", 2024-09-14T09:09:50.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5365999999999995e-05 2024-09-14T09:09:50.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:50.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974771+0000", 2024-09-14T09:09:50.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1850999999999999e-05 2024-09-14T09:09:50.169 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.169 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:50.169 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.169 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2511 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3465216~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:50.169 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:50.169 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 73.190139332000001, 2024-09-14T09:09:50.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075234668000000005, 2024-09-14T09:09:50.169 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:50.169 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:50.169 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:50.170 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:50.170 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:50.170 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:50.170 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2511 2024-09-14T09:09:50.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.170 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:50.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:50.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:50.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:50.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:50.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:50.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899951+0000", 2024-09-14T09:09:50.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000229569 2024-09-14T09:09:50.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:50.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899955+0000", 2024-09-14T09:09:50.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1010000000000002e-06 2024-09-14T09:09:50.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:50.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899971+0000", 2024-09-14T09:09:50.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5648999999999999e-05 2024-09-14T09:09:50.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:50.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899978+0000", 2024-09-14T09:09:50.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0829999999999998e-06 2024-09-14T09:09:50.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:50.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974806+0000", 2024-09-14T09:09:50.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074828092999999998 2024-09-14T09:09:50.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:50.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974870+0000", 2024-09-14T09:09:50.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4492000000000005e-05 2024-09-14T09:09:50.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:50.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974956+0000", 2024-09-14T09:09:50.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5680999999999995e-05 2024-09-14T09:09:50.173 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.173 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:50.173 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.173 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2512 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3526656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:50.173 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:50.174 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 73.189871787000001, 2024-09-14T09:09:50.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075178812999999997, 2024-09-14T09:09:50.174 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:50.174 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:50.174 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:50.174 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:50.174 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:50.174 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:50.174 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2512 2024-09-14T09:09:50.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.174 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:50.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:50.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:50.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:50.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:50.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:50.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904181+0000", 2024-09-14T09:09:50.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041919399999999999 2024-09-14T09:09:50.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:50.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904186+0000", 2024-09-14T09:09:50.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2390000000000002e-06 2024-09-14T09:09:50.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:50.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904199+0000", 2024-09-14T09:09:50.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2709e-05 2024-09-14T09:09:50.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:50.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904207+0000", 2024-09-14T09:09:50.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8150000000000006e-06 2024-09-14T09:09:50.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:50.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975000+0000", 2024-09-14T09:09:50.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.070793444999999997 2024-09-14T09:09:50.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:50.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975079+0000", 2024-09-14T09:09:50.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8480999999999996e-05 2024-09-14T09:09:50.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:50.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975168+0000", 2024-09-14T09:09:50.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9184000000000005e-05 2024-09-14T09:09:50.178 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.178 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:50.178 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.178 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:22840 3.15 3:a8cf3dc2:::rbd_header.1112a10502fe:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:50.178 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:09:50.178 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 33.530298764999998, 2024-09-14T09:09:50.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.119998785, 2024-09-14T09:09:50.178 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:50.178 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:50.179 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:50.179 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:50.179 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:09:50.179 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:09:50.179 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 22840 2024-09-14T09:09:50.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.179 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:50.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:50.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:09:50.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:50.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:09:50.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:50.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642492+0000", 2024-09-14T09:09:50.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.082930276999999997 2024-09-14T09:09:50.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:50.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642495+0000", 2024-09-14T09:09:50.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9809999999999999e-06 2024-09-14T09:09:50.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:50.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642501+0000", 2024-09-14T09:09:50.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-09-14T09:09:50.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:50.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642506+0000", 2024-09-14T09:09:50.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6650000000000002e-06 2024-09-14T09:09:50.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:50.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679483+0000", 2024-09-14T09:09:50.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036977777000000003 2024-09-14T09:09:50.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:50.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679517+0000", 2024-09-14T09:09:50.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.345e-05 2024-09-14T09:09:50.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:50.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679561+0000", 2024-09-14T09:09:50.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3930999999999997e-05 2024-09-14T09:09:50.182 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.182 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:50.182 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.183 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:22857 3.15 3:a8cf3dc2:::rbd_header.1112a10502fe:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:50.183 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:09:50.183 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 33.380404839999997, 2024-09-14T09:09:50.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.088427917999999994, 2024-09-14T09:09:50.183 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:50.183 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:50.183 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:50.183 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:50.183 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:09:50.183 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:09:50.183 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 22857 2024-09-14T09:09:50.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.183 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:50.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:50.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:09:50.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:50.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:09:50.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:50.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:50.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777685+0000", 2024-09-14T09:09:50.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.068229181999999999 2024-09-14T09:09:50.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:50.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777688+0000", 2024-09-14T09:09:50.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1980000000000001e-06 2024-09-14T09:09:50.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:50.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777695+0000", 2024-09-14T09:09:50.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:09:50.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:50.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777700+0000", 2024-09-14T09:09:50.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0919999999999997e-06 2024-09-14T09:09:50.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:50.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797735+0000", 2024-09-14T09:09:50.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0200351 2024-09-14T09:09:50.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:50.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797800+0000", 2024-09-14T09:09:50.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4305000000000002e-05 2024-09-14T09:09:50.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:50.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:50.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:50.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797884+0000", 2024-09-14T09:09:50.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4344000000000004e-05 2024-09-14T09:09:50.186 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.187 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:50.187 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.187 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:50.187 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:50.187 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:50.189 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:09:50.189 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:50.191+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:50.290 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:50.292+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:50.331 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:50.331 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:50.332 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:09:50.332 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:50.339 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:09:50.340 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:09:50.390 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:50.393+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:50.487 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:50.487 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:50.487 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:50.487 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:50.487 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:50.491 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:50.493+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:50.496 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:09:50.501 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:50.502 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:50.519 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:50.519 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:50.536 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:09:50.600 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:09:50.600 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:50.600 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:50.601 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:50.601 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:50.601 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:50.602 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:50.607 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:50.607 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:50.607 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:50.609+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:50.616 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:09:50.704 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:50.706+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:50.722 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:50.722 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:50.731 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:09:50.790 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is unset 2024-09-14T09:09:50.804 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:50.806+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:50.841 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:50.841 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:50.850 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:09:50.905 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:50.907+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:50.960 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:50.960 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:50.969 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:09:51.013 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:51.015+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:51.073 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:51.073 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:51.081 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:09:51.122 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:51.124+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:51.208 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:51.210+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:51.224 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:51.225 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:51.233 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:09:51.309 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:51.311+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:51.337 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:51.337 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:51.346 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:09:51.410 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:51.412+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:51.449 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:51.450 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:51.458 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:51.511 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:51.512+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:51.602 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:51.602 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:51.611 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:09:51.612 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:51.614+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:51.714 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:51.716+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:51.714 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:51.715 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:51.723 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:09:51.814 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:51.816+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:51.844 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:51.844 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:51.854 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:09:51.939 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:51.941+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:51.998 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:51.998 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:52.003 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 1] out_osds: [] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 2] 2024-09-14T09:09:52.003 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:09:52.003 INFO:tasks.thrashosds.thrasher:Removing osd 5, in_osds are: [0, 2, 3, 4, 5, 1] 2024-09-14T09:09:52.003 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 5 2024-09-14T09:09:52.007 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:09:52.017 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:52.019+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:52.118 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:52.120+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:52.153 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:52.153 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:52.162 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:09:52.219 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:52.221+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:52.267 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:52.267 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:52.275 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:09:52.306 INFO:tasks.ceph.mon.a.smithi116.stderr:2024-09-14T09:09:52.307+0000 7f4999343640 -1 mon.a@0(leader).osd e120 definitely_dead 0 2024-09-14T09:09:52.349 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:52.351+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:52.408 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:52.408 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:52.416 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:09:52.457 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:52.459+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:52.522 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:52.524+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:52.559 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:52.559 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:52.569 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:09:52.603 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:09:52.653 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:52.655+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:52.718 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:52.718 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:52.723 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:52.725+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:52.730 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:09:52.737 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:52.737 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:52.754 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:52.754 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:52.771 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:09:52.771 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:09:52.788 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:52.788 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:52.804 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:52.805 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:52.809 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T09:09:52.810 INFO:teuthology.orchestra.run.smithi116.stderr:marked out osd.5. 2024-09-14T09:09:52.835 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:52.835 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:52.836 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:52.837+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:52.855 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:52.855 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:52.855 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:52.855 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:52.855 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:52.864 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:09:52.925 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:52.927+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:53.013 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:53.013 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:53.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:53.013 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:53.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.014 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:987 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:53.014 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:53.014 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.155402985999999, 2024-09-14T09:09:53.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001359466, 2024-09-14T09:09:53.014 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:53.014 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:53.014 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.015 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:53.015 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:53.015 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:53.015 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 987 2024-09-14T09:09:53.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.015 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:53.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:53.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:53.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:53.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:53.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:53.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858333+0000", 2024-09-14T09:09:53.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.621e-06 2024-09-14T09:09:53.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:53.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858349+0000", 2024-09-14T09:09:53.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5758000000000001e-05 2024-09-14T09:09:53.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:53.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858366+0000", 2024-09-14T09:09:53.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7368e-05 2024-09-14T09:09:53.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858382+0000", 2024-09-14T09:09:53.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6039e-05 2024-09-14T09:09:53.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858441+0000", 2024-09-14T09:09:53.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8662999999999997e-05 2024-09-14T09:09:53.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858449+0000", 2024-09-14T09:09:53.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3960000000000006e-06 2024-09-14T09:09:53.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859682+0000", 2024-09-14T09:09:53.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001233096 2024-09-14T09:09:53.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:53.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859691+0000", 2024-09-14T09:09:53.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5250000000000005e-06 2024-09-14T09:09:53.019 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.019 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:53.019 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.019 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:988 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:53.020 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:53.020 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.155275115999999, 2024-09-14T09:09:53.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0012656799999999, 2024-09-14T09:09:53.020 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:53.020 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:53.020 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.020 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:53.020 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:53.020 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:53.020 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 988 2024-09-14T09:09:53.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.021 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:53.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:53.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:53.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:53.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:53.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:53.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858460+0000", 2024-09-14T09:09:53.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9999999999999997e-07 2024-09-14T09:09:53.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:53.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858463+0000", 2024-09-14T09:09:53.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7459999999999998e-06 2024-09-14T09:09:53.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:53.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858471+0000", 2024-09-14T09:09:53.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3900000000000004e-06 2024-09-14T09:09:53.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858478+0000", 2024-09-14T09:09:53.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7020000000000004e-06 2024-09-14T09:09:53.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859102+0000", 2024-09-14T09:09:53.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062419699999999995 2024-09-14T09:09:53.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859109+0000", 2024-09-14T09:09:53.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7419999999999997e-06 2024-09-14T09:09:53.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859718+0000", 2024-09-14T09:09:53.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006085629999999 2024-09-14T09:09:53.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:53.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859725+0000", 2024-09-14T09:09:53.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7399999999999998e-06 2024-09-14T09:09:53.025 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.025 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:53.025 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.025 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1003 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:53.025 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:53.025 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.154411879000001, 2024-09-14T09:09:53.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009495209999999, 2024-09-14T09:09:53.025 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:53.025 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:53.026 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.026 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:53.026 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:53.026 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:53.026 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1003 2024-09-14T09:09:53.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.026 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:53.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:53.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:53.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:53.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:53.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:53.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859323+0000", 2024-09-14T09:09:53.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3099999999999998e-07 2024-09-14T09:09:53.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:53.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859326+0000", 2024-09-14T09:09:53.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-06 2024-09-14T09:09:53.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:53.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859333+0000", 2024-09-14T09:09:53.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3300000000000001e-06 2024-09-14T09:09:53.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859339+0000", 2024-09-14T09:09:53.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6400000000000002e-06 2024-09-14T09:09:53.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859387+0000", 2024-09-14T09:09:53.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8448000000000001e-05 2024-09-14T09:09:53.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:09:53.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9540000000000004e-06 2024-09-14T09:09:53.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860260+0000", 2024-09-14T09:09:53.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000864921 2024-09-14T09:09:53.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:53.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860272+0000", 2024-09-14T09:09:53.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1993e-05 2024-09-14T09:09:53.030 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.030 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:53.030 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.031 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1004 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:53.031 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:53.031 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.154376304000003, 2024-09-14T09:09:53.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000947875, 2024-09-14T09:09:53.031 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:53.031 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:53.031 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.031 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:53.031 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:53.031 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:53.031 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1004 2024-09-14T09:09:53.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.031 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:53.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:53.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:53.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:53.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:53.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:53.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:53.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7199999999999999e-07 2024-09-14T09:09:53.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:53.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859361+0000", 2024-09-14T09:09:53.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.892e-06 2024-09-14T09:09:53.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:53.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859368+0000", 2024-09-14T09:09:53.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4370000000000004e-06 2024-09-14T09:09:53.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859373+0000", 2024-09-14T09:09:53.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6690000000000003e-06 2024-09-14T09:09:53.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859430+0000", 2024-09-14T09:09:53.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6456999999999998e-05 2024-09-14T09:09:53.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859434+0000", 2024-09-14T09:09:53.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8410000000000002e-06 2024-09-14T09:09:53.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860299+0000", 2024-09-14T09:09:53.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008650370000001 2024-09-14T09:09:53.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:53.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860306+0000", 2024-09-14T09:09:53.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0700000000000001e-06 2024-09-14T09:09:53.035 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.035 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:53.035 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.035 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1005 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:53.036 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:53.036 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.154352631000002, 2024-09-14T09:09:53.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009585480000001, 2024-09-14T09:09:53.036 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:53.036 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:53.036 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.036 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:53.036 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:53.036 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:53.036 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1005 2024-09-14T09:09:53.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.036 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:53.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:53.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:53.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:53.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:53.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:53.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:53.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9700000000000002e-07 2024-09-14T09:09:53.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:53.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859384+0000", 2024-09-14T09:09:53.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.024e-06 2024-09-14T09:09:53.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:53.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859390+0000", 2024-09-14T09:09:53.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7080000000000002e-06 2024-09-14T09:09:53.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:09:53.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8980000000000004e-06 2024-09-14T09:09:53.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859527+0000", 2024-09-14T09:09:53.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013228099999999999 2024-09-14T09:09:53.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859532+0000", 2024-09-14T09:09:53.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5899999999999998e-06 2024-09-14T09:09:53.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860330+0000", 2024-09-14T09:09:53.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0007973509999999 2024-09-14T09:09:53.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:53.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860340+0000", 2024-09-14T09:09:53.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0299000000000001e-05 2024-09-14T09:09:53.040 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.040 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:53.040 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.040 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1006 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:53.040 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:53.040 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.154329435000001, 2024-09-14T09:09:53.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001032039, 2024-09-14T09:09:53.041 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:53.041 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:53.041 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.041 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:53.041 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:53.041 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:53.041 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1006 2024-09-14T09:09:53.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.041 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:53.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:53.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:53.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:53.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:53.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:53.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:53.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6499999999999999e-07 2024-09-14T09:09:53.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:53.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859407+0000", 2024-09-14T09:09:53.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1160000000000002e-06 2024-09-14T09:09:53.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:53.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859413+0000", 2024-09-14T09:09:53.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8880000000000002e-06 2024-09-14T09:09:53.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859419+0000", 2024-09-14T09:09:53.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3550000000000004e-06 2024-09-14T09:09:53.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859558+0000", 2024-09-14T09:09:53.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000138942 2024-09-14T09:09:53.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859563+0000", 2024-09-14T09:09:53.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.665e-06 2024-09-14T09:09:53.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860427+0000", 2024-09-14T09:09:53.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008635299999999 2024-09-14T09:09:53.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:53.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860437+0000", 2024-09-14T09:09:53.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0078000000000001e-05 2024-09-14T09:09:53.045 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.045 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:53.045 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.046 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1045 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:53.046 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:53.046 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.154129955000002, 2024-09-14T09:09:53.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008612990000001, 2024-09-14T09:09:53.046 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:53.046 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:53.046 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.046 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:53.046 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:53.046 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:53.047 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1045 2024-09-14T09:09:53.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.047 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:53.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:53.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:53.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:53.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:53.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:53.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859605+0000", 2024-09-14T09:09:53.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6e-07 2024-09-14T09:09:53.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:53.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859606+0000", 2024-09-14T09:09:53.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8819999999999999e-06 2024-09-14T09:09:53.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:53.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859610+0000", 2024-09-14T09:09:53.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4290000000000001e-06 2024-09-14T09:09:53.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859612+0000", 2024-09-14T09:09:53.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6309999999999999e-06 2024-09-14T09:09:53.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859643+0000", 2024-09-14T09:09:53.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0224000000000001e-05 2024-09-14T09:09:53.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859647+0000", 2024-09-14T09:09:53.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9049999999999999e-06 2024-09-14T09:09:53.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860458+0000", 2024-09-14T09:09:53.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008111180000001 2024-09-14T09:09:53.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:53.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860466+0000", 2024-09-14T09:09:53.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:09:53.051 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.051 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:53.051 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.051 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1046 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:53.051 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:53.051 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.154116498, 2024-09-14T09:09:53.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000874262, 2024-09-14T09:09:53.051 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:53.051 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:53.051 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.051 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:53.052 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:53.052 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:53.052 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1046 2024-09-14T09:09:53.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.052 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:53.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:53.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:53.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:53.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:53.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:53.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:53.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:09:53.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:53.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859619+0000", 2024-09-14T09:09:53.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0559999999999999e-06 2024-09-14T09:09:53.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:53.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859622+0000", 2024-09-14T09:09:53.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0170000000000001e-06 2024-09-14T09:09:53.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859625+0000", 2024-09-14T09:09:53.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7209999999999999e-06 2024-09-14T09:09:53.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859666+0000", 2024-09-14T09:09:53.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1677000000000001e-05 2024-09-14T09:09:53.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859672+0000", 2024-09-14T09:09:53.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4609999999999999e-06 2024-09-14T09:09:53.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860485+0000", 2024-09-14T09:09:53.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000813505 2024-09-14T09:09:53.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:53.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860492+0000", 2024-09-14T09:09:53.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6159999999999998e-06 2024-09-14T09:09:53.056 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.056 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:53.056 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.056 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1047 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:53.056 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:53.056 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.154105164000001, 2024-09-14T09:09:53.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008950190000001, 2024-09-14T09:09:53.056 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:53.056 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:53.057 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.057 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:53.057 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:53.057 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:53.057 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1047 2024-09-14T09:09:53.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.057 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:53.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:53.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:53.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:53.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:53.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:53.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:53.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6600000000000003e-07 2024-09-14T09:09:53.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:53.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859631+0000", 2024-09-14T09:09:53.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5600000000000001e-06 2024-09-14T09:09:53.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:53.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859637+0000", 2024-09-14T09:09:53.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7309999999999998e-06 2024-09-14T09:09:53.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859641+0000", 2024-09-14T09:09:53.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0840000000000002e-06 2024-09-14T09:09:53.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859691+0000", 2024-09-14T09:09:53.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0587999999999997e-05 2024-09-14T09:09:53.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859696+0000", 2024-09-14T09:09:53.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8940000000000001e-06 2024-09-14T09:09:53.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860516+0000", 2024-09-14T09:09:53.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008200780000001 2024-09-14T09:09:53.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:53.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860524+0000", 2024-09-14T09:09:53.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8180000000000004e-06 2024-09-14T09:09:53.061 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.061 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:53.061 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.061 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1048 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:53.061 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:53.061 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.154073404999998, 2024-09-14T09:09:53.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008904780000001, 2024-09-14T09:09:53.062 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:53.062 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:53.062 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.062 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:53.062 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:53.062 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:53.062 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1048 2024-09-14T09:09:53.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.063 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:53.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:53.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:53.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:53.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:53.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:53.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:53.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4700000000000002e-07 2024-09-14T09:09:53.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:53.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859663+0000", 2024-09-14T09:09:53.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0420000000000001e-06 2024-09-14T09:09:53.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:53.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859669+0000", 2024-09-14T09:09:53.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8989999999999998e-06 2024-09-14T09:09:53.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859673+0000", 2024-09-14T09:09:53.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2209999999999999e-06 2024-09-14T09:09:53.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859719+0000", 2024-09-14T09:09:53.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5788000000000003e-05 2024-09-14T09:09:53.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859725+0000", 2024-09-14T09:09:53.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4770000000000002e-06 2024-09-14T09:09:53.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860544+0000", 2024-09-14T09:09:53.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008194669999999 2024-09-14T09:09:53.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:53.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860551+0000", 2024-09-14T09:09:53.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1369999999999996e-06 2024-09-14T09:09:53.067 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.067 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:53.067 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.067 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1088 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:53.067 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:53.067 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.153854568, 2024-09-14T09:09:53.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00073166, 2024-09-14T09:09:53.067 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:53.067 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:53.067 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.067 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:53.067 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:53.068 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:53.068 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1088 2024-09-14T09:09:53.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.068 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:53.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:53.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:53.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:53.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:53.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:53.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859880+0000", 2024-09-14T09:09:53.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3700000000000001e-07 2024-09-14T09:09:53.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:53.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859882+0000", 2024-09-14T09:09:53.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.739e-06 2024-09-14T09:09:53.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:53.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859887+0000", 2024-09-14T09:09:53.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:09:53.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859892+0000", 2024-09-14T09:09:53.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7119999999999999e-06 2024-09-14T09:09:53.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859945+0000", 2024-09-14T09:09:53.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2762000000000001e-05 2024-09-14T09:09:53.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859950+0000", 2024-09-14T09:09:53.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-09-14T09:09:53.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860603+0000", 2024-09-14T09:09:53.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000653263 2024-09-14T09:09:53.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:53.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860611+0000", 2024-09-14T09:09:53.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-09-14T09:09:53.072 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.072 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:53.072 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.072 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1089 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:53.072 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:53.072 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.153836411999997, 2024-09-14T09:09:53.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000733943, 2024-09-14T09:09:53.072 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:53.072 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:53.072 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.072 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:53.072 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:53.072 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:53.073 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1089 2024-09-14T09:09:53.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.073 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:53.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:53.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:53.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:53.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:53.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:53.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:53.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3000000000000002e-07 2024-09-14T09:09:53.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:53.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859900+0000", 2024-09-14T09:09:53.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9199999999999998e-06 2024-09-14T09:09:53.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:53.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859906+0000", 2024-09-14T09:09:53.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0889999999999996e-06 2024-09-14T09:09:53.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859911+0000", 2024-09-14T09:09:53.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6419999999999998e-06 2024-09-14T09:09:53.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860010+0000", 2024-09-14T09:09:53.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8956000000000006e-05 2024-09-14T09:09:53.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860014+0000", 2024-09-14T09:09:53.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.741e-06 2024-09-14T09:09:53.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860627+0000", 2024-09-14T09:09:53.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00061277 2024-09-14T09:09:53.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:53.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860632+0000", 2024-09-14T09:09:53.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:09:53.077 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.077 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:53.077 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.077 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1090 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:53.077 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:53.077 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.153816740000003, 2024-09-14T09:09:53.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000740763, 2024-09-14T09:09:53.077 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:53.077 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:53.077 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.077 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:53.078 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:53.078 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:53.078 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1090 2024-09-14T09:09:53.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.078 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:53.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:53.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:53.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:53.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:53.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:53.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859918+0000", 2024-09-14T09:09:53.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5199999999999998e-07 2024-09-14T09:09:53.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:53.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859920+0000", 2024-09-14T09:09:53.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9240000000000001e-06 2024-09-14T09:09:53.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:53.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859925+0000", 2024-09-14T09:09:53.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3929999999999999e-06 2024-09-14T09:09:53.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859929+0000", 2024-09-14T09:09:53.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4769999999999999e-06 2024-09-14T09:09:53.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860034+0000", 2024-09-14T09:09:53.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010549500000000001 2024-09-14T09:09:53.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860039+0000", 2024-09-14T09:09:53.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5700000000000003e-06 2024-09-14T09:09:53.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860650+0000", 2024-09-14T09:09:53.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006116119999999 2024-09-14T09:09:53.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:53.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860658+0000", 2024-09-14T09:09:53.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:09:53.081 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.081 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:53.081 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.082 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60374 3.14 3.6e2cd654 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:53.082 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:53.082 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.523938430000001, 2024-09-14T09:09:53.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3129433100000001, 2024-09-14T09:09:53.082 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:53.082 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:53.082 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.082 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:53.082 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:53.082 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:53.082 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60374 2024-09-14T09:09:53.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.082 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:53.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:53.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:53.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:53.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:53.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:53.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:53.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2100000000000002e-07 2024-09-14T09:09:53.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:53.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489799+0000", 2024-09-14T09:09:53.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3530000000000002e-06 2024-09-14T09:09:53.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:53.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489808+0000", 2024-09-14T09:09:53.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2e-06 2024-09-14T09:09:53.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489813+0000", 2024-09-14T09:09:53.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3249999999999998e-06 2024-09-14T09:09:53.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489866+0000", 2024-09-14T09:09:53.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3074e-05 2024-09-14T09:09:53.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489875+0000", 2024-09-14T09:09:53.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2760000000000006e-06 2024-09-14T09:09:53.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801379+0000", 2024-09-14T09:09:53.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.31150346200000001 2024-09-14T09:09:53.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801387+0000", 2024-09-14T09:09:53.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.038e-06 2024-09-14T09:09:53.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802728+0000", 2024-09-14T09:09:53.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013415569999999 2024-09-14T09:09:53.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:53.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802739+0000", 2024-09-14T09:09:53.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0604e-05 2024-09-14T09:09:53.087 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.089 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:53.089 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.089 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62179 3.14 3.78cf1974 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:53.089 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:09:53.089 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.523907801, 2024-09-14T09:09:53.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3129429109999999, 2024-09-14T09:09:53.090 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:53.090 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:53.090 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.090 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:53.090 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:53.090 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:53.090 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62179 2024-09-14T09:09:53.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.090 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:53.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:53.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:09:53.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:53.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:09:53.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:53.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489827+0000", 2024-09-14T09:09:53.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4300000000000003e-07 2024-09-14T09:09:53.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:53.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489829+0000", 2024-09-14T09:09:53.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2129999999999998e-06 2024-09-14T09:09:53.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:53.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489836+0000", 2024-09-14T09:09:53.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0360000000000001e-06 2024-09-14T09:09:53.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489841+0000", 2024-09-14T09:09:53.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0710000000000002e-06 2024-09-14T09:09:53.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489905+0000", 2024-09-14T09:09:53.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3578999999999996e-05 2024-09-14T09:09:53.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489913+0000", 2024-09-14T09:09:53.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2269999999999993e-06 2024-09-14T09:09:53.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801412+0000", 2024-09-14T09:09:53.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.311498989 2024-09-14T09:09:53.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801419+0000", 2024-09-14T09:09:53.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1400000000000002e-06 2024-09-14T09:09:53.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802761+0000", 2024-09-14T09:09:53.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013414620000001 2024-09-14T09:09:53.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:53.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802769+0000", 2024-09-14T09:09:53.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6510000000000007e-06 2024-09-14T09:09:53.095 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.095 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:53.095 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.095 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63551 3.14 3.88ccb734 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:53.095 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:09:53.095 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.523876170999998, 2024-09-14T09:09:53.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.312941181, 2024-09-14T09:09:53.095 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:53.095 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:53.095 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.096 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:53.096 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:53.096 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:53.096 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63551 2024-09-14T09:09:53.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.096 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:53.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:53.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:09:53.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:53.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:09:53.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:53.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489859+0000", 2024-09-14T09:09:53.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9200000000000001e-07 2024-09-14T09:09:53.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:53.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489862+0000", 2024-09-14T09:09:53.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9629999999999998e-06 2024-09-14T09:09:53.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:53.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489868+0000", 2024-09-14T09:09:53.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3890000000000002e-06 2024-09-14T09:09:53.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489875+0000", 2024-09-14T09:09:53.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7950000000000002e-06 2024-09-14T09:09:53.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489939+0000", 2024-09-14T09:09:53.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4704999999999998e-05 2024-09-14T09:09:53.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489949+0000", 2024-09-14T09:09:53.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7799999999999995e-06 2024-09-14T09:09:53.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801447+0000", 2024-09-14T09:09:53.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.311497527 2024-09-14T09:09:53.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801454+0000", 2024-09-14T09:09:53.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1080000000000004e-06 2024-09-14T09:09:53.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802790+0000", 2024-09-14T09:09:53.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013364330000001 2024-09-14T09:09:53.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:53.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802799+0000", 2024-09-14T09:09:53.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8890000000000008e-06 2024-09-14T09:09:53.101 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.101 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:53.101 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.101 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:68716 3.14 3.96fe1934 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:53.102 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:09:53.102 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.472305704, 2024-09-14T09:09:53.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2614012569999999, 2024-09-14T09:09:53.102 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:53.102 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:53.102 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:53.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:53.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:53.102 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 68716 2024-09-14T09:09:53.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.102 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:53.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:53.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:09:53.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:53.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:09:53.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:53.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541429+0000", 2024-09-14T09:09:53.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8899999999999998e-07 2024-09-14T09:09:53.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:53.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541433+0000", 2024-09-14T09:09:53.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7330000000000001e-06 2024-09-14T09:09:53.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:53.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541442+0000", 2024-09-14T09:09:53.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.346e-06 2024-09-14T09:09:53.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541449+0000", 2024-09-14T09:09:53.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.579e-06 2024-09-14T09:09:53.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541839+0000", 2024-09-14T09:09:53.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038993699999999998 2024-09-14T09:09:53.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541849+0000", 2024-09-14T09:09:53.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0217999999999999e-05 2024-09-14T09:09:53.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801480+0000", 2024-09-14T09:09:53.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.25963061399999998 2024-09-14T09:09:53.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801486+0000", 2024-09-14T09:09:53.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.776e-06 2024-09-14T09:09:53.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802821+0000", 2024-09-14T09:09:53.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00133435 2024-09-14T09:09:53.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:53.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802830+0000", 2024-09-14T09:09:53.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9150000000000002e-06 2024-09-14T09:09:53.108 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.108 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:53.108 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.108 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:69492 3.14 3.4a93714 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:53.108 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:09:53.108 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.411766008000001, 2024-09-14T09:09:53.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2008910690000001, 2024-09-14T09:09:53.108 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:53.108 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:53.108 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.109 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:53.109 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:53.109 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:53.109 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 69492 2024-09-14T09:09:53.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.109 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:53.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:53.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:09:53.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:53.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:09:53.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:53.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601969+0000", 2024-09-14T09:09:53.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3099999999999996e-07 2024-09-14T09:09:53.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:53.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601973+0000", 2024-09-14T09:09:53.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5899999999999999e-06 2024-09-14T09:09:53.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:53.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601983+0000", 2024-09-14T09:09:53.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098999999999999e-05 2024-09-14T09:09:53.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601989+0000", 2024-09-14T09:09:53.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0209999999999996e-06 2024-09-14T09:09:53.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.602066+0000", 2024-09-14T09:09:53.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7075000000000003e-05 2024-09-14T09:09:53.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.602075+0000", 2024-09-14T09:09:53.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8389999999999996e-06 2024-09-14T09:09:53.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801512+0000", 2024-09-14T09:09:53.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.199437225 2024-09-14T09:09:53.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801519+0000", 2024-09-14T09:09:53.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9970000000000001e-06 2024-09-14T09:09:53.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802851+0000", 2024-09-14T09:09:53.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001331711 2024-09-14T09:09:53.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:53.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802859+0000", 2024-09-14T09:09:53.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6810000000000004e-06 2024-09-14T09:09:53.114 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.114 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:53.114 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.114 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:72035 3.14 3.1cba9a34 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:53.114 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:09:53.115 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.29243812, 2024-09-14T09:09:53.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0815917340000001, 2024-09-14T09:09:53.115 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:53.115 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:53.115 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.115 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:53.115 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:53.115 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:53.115 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 72035 2024-09-14T09:09:53.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.115 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:53.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:53.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:09:53.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:53.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:09:53.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:53.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721297+0000", 2024-09-14T09:09:53.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5199999999999996e-07 2024-09-14T09:09:53.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:53.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721301+0000", 2024-09-14T09:09:53.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7790000000000002e-06 2024-09-14T09:09:53.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:53.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721309+0000", 2024-09-14T09:09:53.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8019999999999998e-06 2024-09-14T09:09:53.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721315+0000", 2024-09-14T09:09:53.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:09:53.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721367+0000", 2024-09-14T09:09:53.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2280000000000001e-05 2024-09-14T09:09:53.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721376+0000", 2024-09-14T09:09:53.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5439999999999999e-06 2024-09-14T09:09:53.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801545+0000", 2024-09-14T09:09:53.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.080169952000000003 2024-09-14T09:09:53.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801552+0000", 2024-09-14T09:09:53.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8390000000000001e-06 2024-09-14T09:09:53.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802879+0000", 2024-09-14T09:09:53.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001326846 2024-09-14T09:09:53.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:53.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802888+0000", 2024-09-14T09:09:53.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6330000000000002e-06 2024-09-14T09:09:53.120 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.120 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:53.120 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.120 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73403 3.14 3.87b99f94 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:53.120 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:53.121 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.250163458999999, 2024-09-14T09:09:53.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0393459899999999, 2024-09-14T09:09:53.121 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:53.121 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:53.121 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.121 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:53.121 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:53.121 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:53.121 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73403 2024-09-14T09:09:53.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.121 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:53.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:53.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:53.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:53.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:53.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:53.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:53.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:53.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9200000000000001e-07 2024-09-14T09:09:53.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:53.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763574+0000", 2024-09-14T09:09:53.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6510000000000001e-06 2024-09-14T09:09:53.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:53.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763582+0000", 2024-09-14T09:09:53.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2579999999999995e-06 2024-09-14T09:09:53.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763592+0000", 2024-09-14T09:09:53.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0193e-05 2024-09-14T09:09:53.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763643+0000", 2024-09-14T09:09:53.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0862000000000002e-05 2024-09-14T09:09:53.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763654+0000", 2024-09-14T09:09:53.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0890000000000001e-05 2024-09-14T09:09:53.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801577+0000", 2024-09-14T09:09:53.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037923074000000001 2024-09-14T09:09:53.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801584+0000", 2024-09-14T09:09:53.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0060000000000003e-06 2024-09-14T09:09:53.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:53.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802908+0000", 2024-09-14T09:09:53.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013235149999999 2024-09-14T09:09:53.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:53.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:53.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:53.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802917+0000", 2024-09-14T09:09:53.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9490000000000002e-06 2024-09-14T09:09:53.126 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.126 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:53.126 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.126 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:53.126 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:53.126 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:53.128 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:09:53.129 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:53.130+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:53.229 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:53.230+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:53.243 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:53.244 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:53.244 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:09:53.244 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:53.253 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:09:53.329 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:53.331+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:53.356 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:53.357 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:53.365 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:09:53.430 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:53.432+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:53.470 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:53.470 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:53.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:53.471 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:53.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.471 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:249 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1638400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:53.471 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:53.471 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 81.674722481000003, 2024-09-14T09:09:53.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99070346899999995, 2024-09-14T09:09:53.471 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.471 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.471 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.471 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.471 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:53.471 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:53.471 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 249 2024-09-14T09:09:53.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.472 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:53.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:53.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796868+0000", 2024-09-14T09:09:53.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2024-09-14T09:09:53.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796870+0000", 2024-09-14T09:09:53.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7889999999999999e-06 2024-09-14T09:09:53.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796877+0000", 2024-09-14T09:09:53.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8549999999999996e-06 2024-09-14T09:09:53.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796883+0000", 2024-09-14T09:09:53.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.665e-06 2024-09-14T09:09:53.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796915+0000", 2024-09-14T09:09:53.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2215999999999998e-05 2024-09-14T09:09:53.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796920+0000", 2024-09-14T09:09:53.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.527e-06 2024-09-14T09:09:53.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787468+0000", 2024-09-14T09:09:53.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99054877100000005 2024-09-14T09:09:53.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787512+0000", 2024-09-14T09:09:53.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3958000000000002e-05 2024-09-14T09:09:53.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787571+0000", 2024-09-14T09:09:53.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8167000000000001e-05 2024-09-14T09:09:53.476 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.476 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.476 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.476 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:250 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2097152~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:53.476 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:53.476 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 81.674696415, 2024-09-14T09:09:53.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99079431100000004, 2024-09-14T09:09:53.476 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.476 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.476 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.477 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.477 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:53.477 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:53.477 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 250 2024-09-14T09:09:53.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.477 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:53.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:53.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796894+0000", 2024-09-14T09:09:53.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2024-09-14T09:09:53.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796896+0000", 2024-09-14T09:09:53.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5600000000000001e-06 2024-09-14T09:09:53.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796902+0000", 2024-09-14T09:09:53.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3090000000000001e-06 2024-09-14T09:09:53.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796909+0000", 2024-09-14T09:09:53.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:09:53.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796942+0000", 2024-09-14T09:09:53.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-05 2024-09-14T09:09:53.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796948+0000", 2024-09-14T09:09:53.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5910000000000001e-06 2024-09-14T09:09:53.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787596+0000", 2024-09-14T09:09:53.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99064781400000002 2024-09-14T09:09:53.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787636+0000", 2024-09-14T09:09:53.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9715000000000002e-05 2024-09-14T09:09:53.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787687+0000", 2024-09-14T09:09:53.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1674e-05 2024-09-14T09:09:53.481 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.481 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.481 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.481 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:251 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:53.481 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:53.481 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 81.674670980000002, 2024-09-14T09:09:53.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99091769600000001, 2024-09-14T09:09:53.482 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.482 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.482 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.482 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.482 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:53.482 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:53.482 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 251 2024-09-14T09:09:53.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.482 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:53.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:53.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:53.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000005e-07 2024-09-14T09:09:53.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796922+0000", 2024-09-14T09:09:53.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.875e-06 2024-09-14T09:09:53.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796929+0000", 2024-09-14T09:09:53.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0260000000000002e-06 2024-09-14T09:09:53.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796935+0000", 2024-09-14T09:09:53.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7030000000000003e-06 2024-09-14T09:09:53.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796963+0000", 2024-09-14T09:09:53.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8368999999999999e-05 2024-09-14T09:09:53.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796966+0000", 2024-09-14T09:09:53.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4130000000000002e-06 2024-09-14T09:09:53.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787718+0000", 2024-09-14T09:09:53.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99075151100000003 2024-09-14T09:09:53.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787779+0000", 2024-09-14T09:09:53.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.088e-05 2024-09-14T09:09:53.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787836+0000", 2024-09-14T09:09:53.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7380000000000003e-05 2024-09-14T09:09:53.486 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.486 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.486 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.487 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:252 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:53.487 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:53.487 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 81.674645526000006, 2024-09-14T09:09:53.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99102491400000003, 2024-09-14T09:09:53.487 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.487 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.487 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.487 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.487 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:53.487 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:53.487 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 252 2024-09-14T09:09:53.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.487 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:53.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:53.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796945+0000", 2024-09-14T09:09:53.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2900000000000003e-07 2024-09-14T09:09:53.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796947+0000", 2024-09-14T09:09:53.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4279999999999999e-06 2024-09-14T09:09:53.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796954+0000", 2024-09-14T09:09:53.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5479999999999998e-06 2024-09-14T09:09:53.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796959+0000", 2024-09-14T09:09:53.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.22e-06 2024-09-14T09:09:53.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796988+0000", 2024-09-14T09:09:53.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9473000000000001e-05 2024-09-14T09:09:53.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:53.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:09:53.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787850+0000", 2024-09-14T09:09:53.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99085651100000005 2024-09-14T09:09:53.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787891+0000", 2024-09-14T09:09:53.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602000000000002e-05 2024-09-14T09:09:53.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787969+0000", 2024-09-14T09:09:53.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8063000000000001e-05 2024-09-14T09:09:53.492 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.492 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.492 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.492 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:253 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:53.492 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:53.492 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 81.674621646000006, 2024-09-14T09:09:53.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99122695699999996, 2024-09-14T09:09:53.492 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.492 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.492 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.492 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.492 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:53.493 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:53.493 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 253 2024-09-14T09:09:53.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.493 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:53.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:53.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:53.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:09:53.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:09:53.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:09:53.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796977+0000", 2024-09-14T09:09:53.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5030000000000002e-06 2024-09-14T09:09:53.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796982+0000", 2024-09-14T09:09:53.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2024-09-14T09:09:53.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797013+0000", 2024-09-14T09:09:53.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0451e-05 2024-09-14T09:09:53.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:09:53.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1690000000000001e-06 2024-09-14T09:09:53.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788011+0000", 2024-09-14T09:09:53.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99099490300000004 2024-09-14T09:09:53.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788102+0000", 2024-09-14T09:09:53.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0730999999999996e-05 2024-09-14T09:09:53.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788195+0000", 2024-09-14T09:09:53.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3245999999999995e-05 2024-09-14T09:09:53.499 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.499 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.499 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.499 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:254 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3932160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:53.499 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:53.499 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 81.674590088000002, 2024-09-14T09:09:53.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99137410500000001, 2024-09-14T09:09:53.500 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.500 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.500 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:53.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:53.500 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 254 2024-09-14T09:09:53.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.500 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:53.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:53.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797000+0000", 2024-09-14T09:09:53.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:09:53.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797003+0000", 2024-09-14T09:09:53.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7659999999999999e-06 2024-09-14T09:09:53.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797010+0000", 2024-09-14T09:09:53.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.029e-06 2024-09-14T09:09:53.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:53.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2024-09-14T09:09:53.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797044+0000", 2024-09-14T09:09:53.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9213e-05 2024-09-14T09:09:53.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797048+0000", 2024-09-14T09:09:53.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3400000000000002e-06 2024-09-14T09:09:53.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788222+0000", 2024-09-14T09:09:53.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99117407400000002 2024-09-14T09:09:53.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788306+0000", 2024-09-14T09:09:53.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4512999999999995e-05 2024-09-14T09:09:53.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788374+0000", 2024-09-14T09:09:53.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7226999999999999e-05 2024-09-14T09:09:53.504 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.504 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.504 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.505 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:264 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:53.505 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:53.505 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 81.674563730000003, 2024-09-14T09:09:53.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99161474699999996, 2024-09-14T09:09:53.505 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.505 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.505 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.505 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.505 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:53.505 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:53.505 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 264 2024-09-14T09:09:53.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.506 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:53.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:53.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:53.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2024-09-14T09:09:53.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:09:53.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2800000000000002e-06 2024-09-14T09:09:53.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:53.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0979999999999999e-06 2024-09-14T09:09:53.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797040+0000", 2024-09-14T09:09:53.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:09:53.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797068+0000", 2024-09-14T09:09:53.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7302999999999999e-05 2024-09-14T09:09:53.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797071+0000", 2024-09-14T09:09:53.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3610000000000001e-06 2024-09-14T09:09:53.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788436+0000", 2024-09-14T09:09:53.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99136489500000002 2024-09-14T09:09:53.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788538+0000", 2024-09-14T09:09:53.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101931 2024-09-14T09:09:53.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788641+0000", 2024-09-14T09:09:53.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010273899999999999 2024-09-14T09:09:53.510 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.510 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.510 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.510 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:265 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:53.511 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:53.511 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 81.674540371000006, 2024-09-14T09:09:53.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99176878199999996, 2024-09-14T09:09:53.511 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.511 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.511 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:53.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:53.511 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 265 2024-09-14T09:09:53.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.511 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:53.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:53.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:09:53.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.39e-07 2024-09-14T09:09:53.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797052+0000", 2024-09-14T09:09:53.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.345e-06 2024-09-14T09:09:53.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797058+0000", 2024-09-14T09:09:53.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5429999999999999e-06 2024-09-14T09:09:53.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797064+0000", 2024-09-14T09:09:53.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2000000000000002e-06 2024-09-14T09:09:53.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797091+0000", 2024-09-14T09:09:53.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7804e-05 2024-09-14T09:09:53.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797095+0000", 2024-09-14T09:09:53.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2024-09-14T09:09:53.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788667+0000", 2024-09-14T09:09:53.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157211300000003 2024-09-14T09:09:53.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788742+0000", 2024-09-14T09:09:53.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5159000000000003e-05 2024-09-14T09:09:53.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788818+0000", 2024-09-14T09:09:53.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6038000000000006e-05 2024-09-14T09:09:53.515 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.515 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.516 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.516 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:266 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:53.516 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:53.516 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 81.674517539999997, 2024-09-14T09:09:53.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99193390100000001, 2024-09-14T09:09:53.516 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.516 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.516 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.516 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.516 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:53.516 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:53.517 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 266 2024-09-14T09:09:53.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.517 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:53.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:53.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:53.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:09:53.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797075+0000", 2024-09-14T09:09:53.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2570000000000002e-06 2024-09-14T09:09:53.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797082+0000", 2024-09-14T09:09:53.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8029999999999997e-06 2024-09-14T09:09:53.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797088+0000", 2024-09-14T09:09:53.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.468e-06 2024-09-14T09:09:53.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797116+0000", 2024-09-14T09:09:53.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7752000000000001e-05 2024-09-14T09:09:53.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797121+0000", 2024-09-14T09:09:53.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5960000000000003e-06 2024-09-14T09:09:53.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788846+0000", 2024-09-14T09:09:53.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99172512199999996 2024-09-14T09:09:53.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788916+0000", 2024-09-14T09:09:53.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9843000000000002e-05 2024-09-14T09:09:53.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789006+0000", 2024-09-14T09:09:53.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9608e-05 2024-09-14T09:09:53.521 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.521 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.521 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.521 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:267 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:53.521 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:53.521 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 81.674492732999994, 2024-09-14T09:09:53.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99210926799999999, 2024-09-14T09:09:53.522 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.522 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.522 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.522 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.522 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:53.522 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:53.522 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 267 2024-09-14T09:09:53.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.522 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:53.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:53.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:53.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2399999999999999e-07 2024-09-14T09:09:53.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797099+0000", 2024-09-14T09:09:53.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.091e-06 2024-09-14T09:09:53.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797105+0000", 2024-09-14T09:09:53.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-09-14T09:09:53.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797111+0000", 2024-09-14T09:09:53.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5130000000000004e-06 2024-09-14T09:09:53.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797140+0000", 2024-09-14T09:09:53.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9513999999999999e-05 2024-09-14T09:09:53.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797145+0000", 2024-09-14T09:09:53.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:09:53.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789037+0000", 2024-09-14T09:09:53.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99189253899999996 2024-09-14T09:09:53.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789110+0000", 2024-09-14T09:09:53.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2848000000000005e-05 2024-09-14T09:09:53.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789206+0000", 2024-09-14T09:09:53.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5778000000000004e-05 2024-09-14T09:09:53.526 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.526 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.526 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.527 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:268 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:53.527 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:53.527 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 81.674469493999993, 2024-09-14T09:09:53.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992276359, 2024-09-14T09:09:53.527 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.527 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.527 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:53.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:53.527 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 268 2024-09-14T09:09:53.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.527 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:53.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:53.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:53.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:09:53.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797123+0000", 2024-09-14T09:09:53.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2740000000000002e-06 2024-09-14T09:09:53.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797129+0000", 2024-09-14T09:09:53.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-06 2024-09-14T09:09:53.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797134+0000", 2024-09-14T09:09:53.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9099999999999996e-06 2024-09-14T09:09:53.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797163+0000", 2024-09-14T09:09:53.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9709999999999998e-05 2024-09-14T09:09:53.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:53.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8709999999999999e-06 2024-09-14T09:09:53.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789231+0000", 2024-09-14T09:09:53.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992063959 2024-09-14T09:09:53.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789306+0000", 2024-09-14T09:09:53.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5289000000000004e-05 2024-09-14T09:09:53.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789396+0000", 2024-09-14T09:09:53.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9939999999999996e-05 2024-09-14T09:09:53.531 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.532 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.532 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.532 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:269 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2457600~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:53.532 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:53.532 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 81.674445985000006, 2024-09-14T09:09:53.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99242174400000005, 2024-09-14T09:09:53.532 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.532 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.532 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.532 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.532 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:53.533 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:53.533 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 269 2024-09-14T09:09:53.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.533 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:53.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:53.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:53.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:09:53.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797146+0000", 2024-09-14T09:09:53.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5289999999999998e-06 2024-09-14T09:09:53.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797153+0000", 2024-09-14T09:09:53.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1920000000000002e-06 2024-09-14T09:09:53.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797158+0000", 2024-09-14T09:09:53.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099999999999998e-06 2024-09-14T09:09:53.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797188+0000", 2024-09-14T09:09:53.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0128e-05 2024-09-14T09:09:53.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797194+0000", 2024-09-14T09:09:53.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6250000000000004e-06 2024-09-14T09:09:53.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789439+0000", 2024-09-14T09:09:53.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99224531000000005 2024-09-14T09:09:53.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789489+0000", 2024-09-14T09:09:53.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9830000000000002e-05 2024-09-14T09:09:53.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789565+0000", 2024-09-14T09:09:53.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6229000000000005e-05 2024-09-14T09:09:53.537 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.537 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.537 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.537 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:270 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:53.537 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:53.537 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 81.674422163000003, 2024-09-14T09:09:53.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99257721899999996, 2024-09-14T09:09:53.538 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.538 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.538 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.538 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.538 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:53.538 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:53.538 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 270 2024-09-14T09:09:53.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.538 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:53.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:53.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797168+0000", 2024-09-14T09:09:53.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2024-09-14T09:09:53.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797170+0000", 2024-09-14T09:09:53.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3120000000000001e-06 2024-09-14T09:09:53.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797177+0000", 2024-09-14T09:09:53.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0960000000000003e-06 2024-09-14T09:09:53.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797183+0000", 2024-09-14T09:09:53.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1669999999999998e-06 2024-09-14T09:09:53.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797213+0000", 2024-09-14T09:09:53.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0494e-05 2024-09-14T09:09:53.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:09:53.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:09:53.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789586+0000", 2024-09-14T09:09:53.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99236692100000001 2024-09-14T09:09:53.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789658+0000", 2024-09-14T09:09:53.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2279000000000004e-05 2024-09-14T09:09:53.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789745+0000", 2024-09-14T09:09:53.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6698000000000002e-05 2024-09-14T09:09:53.542 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.542 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.542 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.543 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:271 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3375104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:53.543 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:53.543 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 81.674396965, 2024-09-14T09:09:53.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99274791699999998, 2024-09-14T09:09:53.543 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.543 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.543 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.543 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.543 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:53.543 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:53.543 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 271 2024-09-14T09:09:53.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.544 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:53.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:53.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:53.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:09:53.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797195+0000", 2024-09-14T09:09:53.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1639999999999999e-06 2024-09-14T09:09:53.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797201+0000", 2024-09-14T09:09:53.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1290000000000001e-06 2024-09-14T09:09:53.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797206+0000", 2024-09-14T09:09:53.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9300000000000002e-06 2024-09-14T09:09:53.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797237+0000", 2024-09-14T09:09:53.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1285000000000003e-05 2024-09-14T09:09:53.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797242+0000", 2024-09-14T09:09:53.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6e-06 2024-09-14T09:09:53.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789768+0000", 2024-09-14T09:09:53.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99252547400000002 2024-09-14T09:09:53.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789826+0000", 2024-09-14T09:09:53.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8155999999999997e-05 2024-09-14T09:09:53.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789940+0000", 2024-09-14T09:09:53.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114788 2024-09-14T09:09:53.548 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.548 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.548 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.548 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:272 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:53.548 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:53.548 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 81.674373571000004, 2024-09-14T09:09:53.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99285248800000003, 2024-09-14T09:09:53.548 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.548 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.548 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:53.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:53.549 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 272 2024-09-14T09:09:53.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.549 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:53.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:53.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:53.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:09:53.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:09:53.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5129999999999999e-06 2024-09-14T09:09:53.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797226+0000", 2024-09-14T09:09:53.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4529999999999996e-06 2024-09-14T09:09:53.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797232+0000", 2024-09-14T09:09:53.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1839999999999998e-06 2024-09-14T09:09:53.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797264+0000", 2024-09-14T09:09:53.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2691999999999998e-05 2024-09-14T09:09:53.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797270+0000", 2024-09-14T09:09:53.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-06 2024-09-14T09:09:53.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789965+0000", 2024-09-14T09:09:53.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99269526200000002 2024-09-14T09:09:53.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790021+0000", 2024-09-14T09:09:53.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5297000000000003e-05 2024-09-14T09:09:53.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790068+0000", 2024-09-14T09:09:53.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7664999999999998e-05 2024-09-14T09:09:53.553 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.553 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.553 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.553 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:53.553 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:09:53.553 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.684117123999997, 2024-09-14T09:09:53.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146649299999999, 2024-09-14T09:09:53.554 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.554 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.554 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.554 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.554 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:53.554 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:53.554 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 58987 2024-09-14T09:09:53.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.554 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:09:53.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:09:53.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787474+0000", 2024-09-14T09:09:53.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1799999999999999e-06 2024-09-14T09:09:53.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787483+0000", 2024-09-14T09:09:53.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9830000000000002e-06 2024-09-14T09:09:53.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787494+0000", 2024-09-14T09:09:53.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1496e-05 2024-09-14T09:09:53.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787502+0000", 2024-09-14T09:09:53.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8280000000000003e-06 2024-09-14T09:09:53.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787563+0000", 2024-09-14T09:09:53.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1583999999999999e-05 2024-09-14T09:09:53.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:09:53.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787571+0000", 2024-09-14T09:09:53.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.058e-06 2024-09-14T09:09:53.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.791999+0000", 2024-09-14T09:09:53.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004428675 2024-09-14T09:09:53.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792008+0000", 2024-09-14T09:09:53.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9069999999999996e-06 2024-09-14T09:09:53.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802124+0000", 2024-09-14T09:09:53.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0101154619999999 2024-09-14T09:09:53.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802137+0000", 2024-09-14T09:09:53.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3757000000000001e-05 2024-09-14T09:09:53.558 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.559 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.559 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.559 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:67110 3.5 3.6b6808c5 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:53.559 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:09:53.559 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.683984309000003, 2024-09-14T09:09:53.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0147494290000001, 2024-09-14T09:09:53.559 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.559 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.559 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.559 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.559 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:53.559 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:53.560 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 67110 2024-09-14T09:09:53.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.560 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:09:53.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:09:53.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787606+0000", 2024-09-14T09:09:53.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6300000000000005e-07 2024-09-14T09:09:53.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787609+0000", 2024-09-14T09:09:53.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2789999999999999e-06 2024-09-14T09:09:53.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787616+0000", 2024-09-14T09:09:53.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8349999999999998e-06 2024-09-14T09:09:53.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787622+0000", 2024-09-14T09:09:53.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6999999999999996e-06 2024-09-14T09:09:53.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787666+0000", 2024-09-14T09:09:53.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3887000000000002e-05 2024-09-14T09:09:53.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:53.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787672+0000", 2024-09-14T09:09:53.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-09-14T09:09:53.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792033+0000", 2024-09-14T09:09:53.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043614250000000004 2024-09-14T09:09:53.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792041+0000", 2024-09-14T09:09:53.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5449999999999998e-06 2024-09-14T09:09:53.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:09:53.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0103013569999999 2024-09-14T09:09:53.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802355+0000", 2024-09-14T09:09:53.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2717999999999999e-05 2024-09-14T09:09:53.564 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.564 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.565 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.565 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72029 3.5 3.3f02ac5 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:53.565 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:53.565 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.683906794000002, 2024-09-14T09:09:53.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.014715139, 2024-09-14T09:09:53.565 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.565 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.565 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.565 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.565 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:53.565 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:53.565 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72029 2024-09-14T09:09:53.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.566 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:53.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:53.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:53.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7599999999999997e-07 2024-09-14T09:09:53.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787686+0000", 2024-09-14T09:09:53.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3999999999999999e-06 2024-09-14T09:09:53.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787692+0000", 2024-09-14T09:09:53.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3489999999999997e-06 2024-09-14T09:09:53.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787697+0000", 2024-09-14T09:09:53.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2320000000000001e-06 2024-09-14T09:09:53.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787742+0000", 2024-09-14T09:09:53.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4557e-05 2024-09-14T09:09:53.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:53.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787748+0000", 2024-09-14T09:09:53.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7810000000000002e-06 2024-09-14T09:09:53.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792065+0000", 2024-09-14T09:09:53.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043178679999999999 2024-09-14T09:09:53.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792073+0000", 2024-09-14T09:09:53.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6329999999999996e-06 2024-09-14T09:09:53.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802388+0000", 2024-09-14T09:09:53.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010315394 2024-09-14T09:09:53.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802398+0000", 2024-09-14T09:09:53.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4490000000000005e-06 2024-09-14T09:09:53.570 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.570 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.570 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.570 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72038 3.5 3.c914e45 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:53.570 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:53.570 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.683831161000001, 2024-09-14T09:09:53.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146757740000001, 2024-09-14T09:09:53.571 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.571 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.571 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.571 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.571 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:53.571 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:53.571 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72038 2024-09-14T09:09:53.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.571 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:53.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:53.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787759+0000", 2024-09-14T09:09:53.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0100000000000005e-07 2024-09-14T09:09:53.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787761+0000", 2024-09-14T09:09:53.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4049999999999998e-06 2024-09-14T09:09:53.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787768+0000", 2024-09-14T09:09:53.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.314e-06 2024-09-14T09:09:53.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787773+0000", 2024-09-14T09:09:53.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2789999999999998e-06 2024-09-14T09:09:53.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787813+0000", 2024-09-14T09:09:53.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9582000000000002e-05 2024-09-14T09:09:53.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:53.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787818+0000", 2024-09-14T09:09:53.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7100000000000004e-06 2024-09-14T09:09:53.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792096+0000", 2024-09-14T09:09:53.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042776460000000004 2024-09-14T09:09:53.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792103+0000", 2024-09-14T09:09:53.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7129999999999999e-06 2024-09-14T09:09:53.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802427+0000", 2024-09-14T09:09:53.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010324805 2024-09-14T09:09:53.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802434+0000", 2024-09-14T09:09:53.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:09:53.576 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.576 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.576 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.576 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:74840 3.5 3.ab2c8d25 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:53.576 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:09:53.576 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.661779275999997, 2024-09-14T09:09:53.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99271963600000002, 2024-09-14T09:09:53.576 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.576 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.576 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:53.576 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:53.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:53.577 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74840 2024-09-14T09:09:53.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.577 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:09:53.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:09:53.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809812+0000", 2024-09-14T09:09:53.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2899999999999999e-06 2024-09-14T09:09:53.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809817+0000", 2024-09-14T09:09:53.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0139999999999998e-06 2024-09-14T09:09:53.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809834+0000", 2024-09-14T09:09:53.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7643e-05 2024-09-14T09:09:53.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809842+0000", 2024-09-14T09:09:53.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2970000000000004e-06 2024-09-14T09:09:53.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809902+0000", 2024-09-14T09:09:53.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9106e-05 2024-09-14T09:09:53.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:53.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809912+0000", 2024-09-14T09:09:53.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0101e-05 2024-09-14T09:09:53.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802520+0000", 2024-09-14T09:09:53.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99260828599999995 2024-09-14T09:09:53.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802530+0000", 2024-09-14T09:09:53.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8989999999999996e-06 2024-09-14T09:09:53.580 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.580 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.581 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.581 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.581 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.581 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:53.582 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:09:53.583 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:53.584+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:53.683 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:53.685+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:53.726 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:53.726 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:53.726 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:09:53.726 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:53.735 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:09:53.783 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:53.785+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:53.811 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is unset 2024-09-14T09:09:53.842 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:53.842 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:53.842 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:53.842 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:53.842 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:53.851 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:09:53.884 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:53.886+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:53.954 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5349 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8302592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 76.700126539999999, 2024-09-14T09:09:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039875928999999997, 2024-09-14T09:09:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5349 2024-09-14T09:09:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:09:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255874+0000", 2024-09-14T09:09:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4900000000000001e-07 2024-09-14T09:09:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255880+0000", 2024-09-14T09:09:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9939999999999997e-06 2024-09-14T09:09:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255886+0000", 2024-09-14T09:09:53.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3899999999999998e-06 2024-09-14T09:09:53.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255891+0000", 2024-09-14T09:09:53.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.938e-06 2024-09-14T09:09:53.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295580+0000", 2024-09-14T09:09:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039688681000000003 2024-09-14T09:09:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295653+0000", 2024-09-14T09:09:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3045000000000003e-05 2024-09-14T09:09:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295749+0000", 2024-09-14T09:09:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6532000000000003e-05 2024-09-14T09:09:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5350 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8364032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 76.700102732999994, 2024-09-14T09:09:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039989719, 2024-09-14T09:09:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:09:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5350 2024-09-14T09:09:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:09:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255898+0000", 2024-09-14T09:09:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2024-09-14T09:09:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255899+0000", 2024-09-14T09:09:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9139999999999998e-06 2024-09-14T09:09:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255905+0000", 2024-09-14T09:09:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7289999999999997e-06 2024-09-14T09:09:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255910+0000", 2024-09-14T09:09:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6210000000000003e-06 2024-09-14T09:09:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295775+0000", 2024-09-14T09:09:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039864973999999997 2024-09-14T09:09:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295828+0000", 2024-09-14T09:09:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3411000000000001e-05 2024-09-14T09:09:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295887+0000", 2024-09-14T09:09:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699000000000002e-05 2024-09-14T09:09:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4639 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1843200~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.756187273999998, 2024-09-14T09:09:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040843672999999997, 2024-09-14T09:09:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4639 2024-09-14T09:09:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:09:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:09:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199818+0000", 2024-09-14T09:09:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1450000000000001e-06 2024-09-14T09:09:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199827+0000", 2024-09-14T09:09:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3999999999999998e-06 2024-09-14T09:09:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199834+0000", 2024-09-14T09:09:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0809999999999996e-06 2024-09-14T09:09:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240541+0000", 2024-09-14T09:09:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040706941000000003 2024-09-14T09:09:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240584+0000", 2024-09-14T09:09:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3040999999999997e-05 2024-09-14T09:09:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240656+0000", 2024-09-14T09:09:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2200000000000007e-05 2024-09-14T09:09:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4640 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1871872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.756152788999998, 2024-09-14T09:09:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040967601999999999, 2024-09-14T09:09:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4640 2024-09-14T09:09:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:09:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199848+0000", 2024-09-14T09:09:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5400000000000002e-07 2024-09-14T09:09:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199850+0000", 2024-09-14T09:09:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2479999999999999e-06 2024-09-14T09:09:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199857+0000", 2024-09-14T09:09:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.187e-06 2024-09-14T09:09:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199862+0000", 2024-09-14T09:09:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5119999999999999e-06 2024-09-14T09:09:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240684+0000", 2024-09-14T09:09:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040821245999999999 2024-09-14T09:09:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240739+0000", 2024-09-14T09:09:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4991999999999998e-05 2024-09-14T09:09:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240815+0000", 2024-09-14T09:09:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5963000000000004e-05 2024-09-14T09:09:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4641 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1900544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.756130458999998, 2024-09-14T09:09:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041205512, 2024-09-14T09:09:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4641 2024-09-14T09:09:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:09:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199870+0000", 2024-09-14T09:09:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0600000000000001e-07 2024-09-14T09:09:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199872+0000", 2024-09-14T09:09:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.928e-06 2024-09-14T09:09:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199877+0000", 2024-09-14T09:09:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6949999999999997e-06 2024-09-14T09:09:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199882+0000", 2024-09-14T09:09:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8210000000000001e-06 2024-09-14T09:09:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240847+0000", 2024-09-14T09:09:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040965201999999999 2024-09-14T09:09:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240888+0000", 2024-09-14T09:09:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0754000000000003e-05 2024-09-14T09:09:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241075+0000", 2024-09-14T09:09:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000186706 2024-09-14T09:09:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4642 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1929216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.756111523999998, 2024-09-14T09:09:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041292575999999998, 2024-09-14T09:09:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4642 2024-09-14T09:09:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:09:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199889+0000", 2024-09-14T09:09:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2024-09-14T09:09:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199891+0000", 2024-09-14T09:09:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9e-06 2024-09-14T09:09:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199896+0000", 2024-09-14T09:09:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6960000000000002e-06 2024-09-14T09:09:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199901+0000", 2024-09-14T09:09:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6720000000000003e-06 2024-09-14T09:09:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241089+0000", 2024-09-14T09:09:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041187594000000001 2024-09-14T09:09:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241126+0000", 2024-09-14T09:09:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7490999999999997e-05 2024-09-14T09:09:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241181+0000", 2024-09-14T09:09:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4823e-05 2024-09-14T09:09:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4643 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1957888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.756092244999998, 2024-09-14T09:09:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041418333000000002, 2024-09-14T09:09:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4643 2024-09-14T09:09:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:09:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5699999999999998e-07 2024-09-14T09:09:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199910+0000", 2024-09-14T09:09:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.829e-06 2024-09-14T09:09:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199916+0000", 2024-09-14T09:09:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8499999999999999e-06 2024-09-14T09:09:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199920+0000", 2024-09-14T09:09:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6530000000000002e-06 2024-09-14T09:09:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241211+0000", 2024-09-14T09:09:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041290327000000002 2024-09-14T09:09:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241257+0000", 2024-09-14T09:09:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6347000000000002e-05 2024-09-14T09:09:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241326+0000", 2024-09-14T09:09:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8969999999999999e-05 2024-09-14T09:09:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4644 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1986560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.756073905000001, 2024-09-14T09:09:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041596269999999998, 2024-09-14T09:09:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4644 2024-09-14T09:09:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:09:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.41e-07 2024-09-14T09:09:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199928+0000", 2024-09-14T09:09:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8250000000000001e-06 2024-09-14T09:09:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199934+0000", 2024-09-14T09:09:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2280000000000003e-06 2024-09-14T09:09:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199939+0000", 2024-09-14T09:09:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8010000000000003e-06 2024-09-14T09:09:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241360+0000", 2024-09-14T09:09:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041421289 2024-09-14T09:09:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241435+0000", 2024-09-14T09:09:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4238000000000003e-05 2024-09-14T09:09:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241522+0000", 2024-09-14T09:09:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7547999999999996e-05 2024-09-14T09:09:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4645 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.756054998000003, 2024-09-14T09:09:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041714660000000001, 2024-09-14T09:09:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4645 2024-09-14T09:09:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:09:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4700000000000002e-07 2024-09-14T09:09:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199947+0000", 2024-09-14T09:09:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.801e-06 2024-09-14T09:09:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199953+0000", 2024-09-14T09:09:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.694e-06 2024-09-14T09:09:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199957+0000", 2024-09-14T09:09:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3069999999999996e-06 2024-09-14T09:09:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241547+0000", 2024-09-14T09:09:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041589895000000002 2024-09-14T09:09:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241590+0000", 2024-09-14T09:09:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2985000000000003e-05 2024-09-14T09:09:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241660+0000", 2024-09-14T09:09:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9630999999999998e-05 2024-09-14T09:09:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4646 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2043904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.75603701, 2024-09-14T09:09:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041827171000000003, 2024-09-14T09:09:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4646 2024-09-14T09:09:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:09:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6300000000000001e-07 2024-09-14T09:09:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199965+0000", 2024-09-14T09:09:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.035e-06 2024-09-14T09:09:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199973+0000", 2024-09-14T09:09:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9629999999999998e-06 2024-09-14T09:09:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199978+0000", 2024-09-14T09:09:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9069999999999998e-06 2024-09-14T09:09:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241677+0000", 2024-09-14T09:09:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041698662999999997 2024-09-14T09:09:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241717+0000", 2024-09-14T09:09:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602999999999997e-05 2024-09-14T09:09:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241790+0000", 2024-09-14T09:09:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2637000000000003e-05 2024-09-14T09:09:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4647 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2072576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:09:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.756008420000001, 2024-09-14T09:09:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041921189999999997, 2024-09-14T09:09:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:09:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:09:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4647 2024-09-14T09:09:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:09:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199992+0000", 2024-09-14T09:09:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3799999999999997e-07 2024-09-14T09:09:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199994+0000", 2024-09-14T09:09:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3020000000000002e-06 2024-09-14T09:09:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200004+0000", 2024-09-14T09:09:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3510000000000008e-06 2024-09-14T09:09:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200008+0000", 2024-09-14T09:09:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3329999999999998e-06 2024-09-14T09:09:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241814+0000", 2024-09-14T09:09:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041806280000000001 2024-09-14T09:09:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241855+0000", 2024-09-14T09:09:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0173999999999999e-05 2024-09-14T09:09:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241913+0000", 2024-09-14T09:09:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8112000000000002e-05 2024-09-14T09:09:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:59017 3.3 3:c1df81d6:::rbd_data.1112a10502fe.0000000000000189:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:09:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.168717819000001, 2024-09-14T09:09:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.024252111, 2024-09-14T09:09:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59017 2024-09-14T09:09:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:09:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:09:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787284+0000", 2024-09-14T09:09:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3879999999999998e-06 2024-09-14T09:09:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787297+0000", 2024-09-14T09:09:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2184999999999999e-05 2024-09-14T09:09:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787317+0000", 2024-09-14T09:09:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0054000000000001e-05 2024-09-14T09:09:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787327+0000", 2024-09-14T09:09:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0335e-05 2024-09-14T09:09:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787412+0000", 2024-09-14T09:09:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4691000000000006e-05 2024-09-14T09:09:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:09:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787422+0000", 2024-09-14T09:09:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0718e-05 2024-09-14T09:09:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790539+0000", 2024-09-14T09:09:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031164600000000002 2024-09-14T09:09:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790552+0000", 2024-09-14T09:09:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2736e-05 2024-09-14T09:09:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.798725+0000", 2024-09-14T09:09:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0081731860000001 2024-09-14T09:09:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.798824+0000", 2024-09-14T09:09:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9600999999999997e-05 2024-09-14T09:09:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.811534+0000", 2024-09-14T09:09:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012709757 2024-09-14T09:09:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:63586 3.3 3:c0d9272b:::rbd_data.1112a10502fe.00000000000001a2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.168646336000002, 2024-09-14T09:09:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0244069650000001, 2024-09-14T09:09:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 63586 2024-09-14T09:09:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:09:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2024-09-14T09:09:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787357+0000", 2024-09-14T09:09:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8720000000000002e-06 2024-09-14T09:09:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787365+0000", 2024-09-14T09:09:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9270000000000005e-06 2024-09-14T09:09:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787372+0000", 2024-09-14T09:09:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6810000000000001e-06 2024-09-14T09:09:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787479+0000", 2024-09-14T09:09:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010736800000000001 2024-09-14T09:09:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787485+0000", 2024-09-14T09:09:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.054e-06 2024-09-14T09:09:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790580+0000", 2024-09-14T09:09:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030949929999999999 2024-09-14T09:09:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790589+0000", 2024-09-14T09:09:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7600000000000008e-06 2024-09-14T09:09:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.799541+0000", 2024-09-14T09:09:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0089520110000001 2024-09-14T09:09:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.799620+0000", 2024-09-14T09:09:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8969999999999998e-05 2024-09-14T09:09:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.811760+0000", 2024-09-14T09:09:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012140748999999999 2024-09-14T09:09:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:65817 3.3 3:c2c49fe0:::rbd_data.1112a10502fe.00000000000001b3:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:09:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.168556533999997, 2024-09-14T09:09:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0253660200000001, 2024-09-14T09:09:54.020 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.020 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.020 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.020 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.020 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:54.020 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:54.020 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 65817 2024-09-14T09:09:54.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.020 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:09:54.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:09:54.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787444+0000", 2024-09-14T09:09:54.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999995e-07 2024-09-14T09:09:54.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787448+0000", 2024-09-14T09:09:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1420000000000003e-06 2024-09-14T09:09:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787497+0000", 2024-09-14T09:09:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8507999999999997e-05 2024-09-14T09:09:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787503+0000", 2024-09-14T09:09:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1319999999999999e-06 2024-09-14T09:09:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787595+0000", 2024-09-14T09:09:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1748000000000003e-05 2024-09-14T09:09:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787601+0000", 2024-09-14T09:09:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6150000000000002e-06 2024-09-14T09:09:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790613+0000", 2024-09-14T09:09:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003012228 2024-09-14T09:09:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790621+0000", 2024-09-14T09:09:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9219999999999997e-06 2024-09-14T09:09:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800130+0000", 2024-09-14T09:09:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.009508474 2024-09-14T09:09:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800257+0000", 2024-09-14T09:09:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012746900000000001 2024-09-14T09:09:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.812809+0000", 2024-09-14T09:09:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012552054 2024-09-14T09:09:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:68709 3.3 3:c4996abd:::rbd_data.1112a10502fe.00000000000001cd:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:09:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.168385588, 2024-09-14T09:09:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0254506109999999, 2024-09-14T09:09:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 68709 2024-09-14T09:09:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:09:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:09:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787615+0000", 2024-09-14T09:09:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4000000000000001e-07 2024-09-14T09:09:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787618+0000", 2024-09-14T09:09:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2780000000000002e-06 2024-09-14T09:09:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787626+0000", 2024-09-14T09:09:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0250000000000002e-06 2024-09-14T09:09:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787633+0000", 2024-09-14T09:09:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5660000000000003e-06 2024-09-14T09:09:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787714+0000", 2024-09-14T09:09:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1695999999999998e-05 2024-09-14T09:09:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787721+0000", 2024-09-14T09:09:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1109999999999996e-06 2024-09-14T09:09:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790646+0000", 2024-09-14T09:09:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029251730000000001 2024-09-14T09:09:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790653+0000", 2024-09-14T09:09:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4379999999999998e-06 2024-09-14T09:09:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800750+0000", 2024-09-14T09:09:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010097236 2024-09-14T09:09:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800883+0000", 2024-09-14T09:09:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000132466 2024-09-14T09:09:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813065+0000", 2024-09-14T09:09:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012181981999999999 2024-09-14T09:09:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:74823 3.3 3:c59acf89:::rbd_data.1112a10502fe.00000000000001fb:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:09:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.147551116000002, 2024-09-14T09:09:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.004859323, 2024-09-14T09:09:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74823 2024-09-14T09:09:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:09:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:09:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808450+0000", 2024-09-14T09:09:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.92e-07 2024-09-14T09:09:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808454+0000", 2024-09-14T09:09:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3660000000000002e-06 2024-09-14T09:09:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808463+0000", 2024-09-14T09:09:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1579999999999994e-06 2024-09-14T09:09:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808470+0000", 2024-09-14T09:09:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7599999999999997e-06 2024-09-14T09:09:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808540+0000", 2024-09-14T09:09:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9991000000000001e-05 2024-09-14T09:09:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808550+0000", 2024-09-14T09:09:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0282000000000001e-05 2024-09-14T09:09:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801352+0000", 2024-09-14T09:09:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99280192700000003 2024-09-14T09:09:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801472+0000", 2024-09-14T09:09:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120184 2024-09-14T09:09:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813308+0000", 2024-09-14T09:09:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011835863 2024-09-14T09:09:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:86789 3.3 3:c3063f19:::rbd_data.1112a10502fe.000000000000023a:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:09:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.375328390999996, 2024-09-14T09:09:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.23302192099999999, 2024-09-14T09:09:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86789 2024-09-14T09:09:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:09:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:09:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580672+0000", 2024-09-14T09:09:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7999999999999993e-07 2024-09-14T09:09:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580680+0000", 2024-09-14T09:09:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7540000000000006e-06 2024-09-14T09:09:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580694+0000", 2024-09-14T09:09:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3344e-05 2024-09-14T09:09:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580702+0000", 2024-09-14T09:09:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9510000000000006e-06 2024-09-14T09:09:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580778+0000", 2024-09-14T09:09:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6580000000000002e-05 2024-09-14T09:09:54.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580788+0000", 2024-09-14T09:09:54.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0327e-05 2024-09-14T09:09:54.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801980+0000", 2024-09-14T09:09:54.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.22119123900000001 2024-09-14T09:09:54.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802115+0000", 2024-09-14T09:09:54.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013572000000000001 2024-09-14T09:09:54.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813693+0000", 2024-09-14T09:09:54.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011578026 2024-09-14T09:09:54.042 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.042 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.042 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.042 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:89485 3.3 3:c3eae671:::rbd_data.1112a10502fe.0000000000000248:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:54.042 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:09:54.043 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.270471897, 2024-09-14T09:09:54.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.12841583300000001, 2024-09-14T09:09:54.043 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.043 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.043 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.043 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.043 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:54.043 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:54.043 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 89485 2024-09-14T09:09:54.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.043 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:09:54.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:09:54.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685529+0000", 2024-09-14T09:09:54.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.11e-06 2024-09-14T09:09:54.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685534+0000", 2024-09-14T09:09:54.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0289999999999996e-06 2024-09-14T09:09:54.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685546+0000", 2024-09-14T09:09:54.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2062000000000001e-05 2024-09-14T09:09:54.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685554+0000", 2024-09-14T09:09:54.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7889999999999995e-06 2024-09-14T09:09:54.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685618+0000", 2024-09-14T09:09:54.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4487999999999996e-05 2024-09-14T09:09:54.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685628+0000", 2024-09-14T09:09:54.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5840000000000001e-06 2024-09-14T09:09:54.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802613+0000", 2024-09-14T09:09:54.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.116984703 2024-09-14T09:09:54.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802768+0000", 2024-09-14T09:09:54.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015541599999999999 2024-09-14T09:09:54.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813944+0000", 2024-09-14T09:09:54.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011175651999999999 2024-09-14T09:09:54.048 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.048 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.048 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.048 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:90751 3.3 3:c22bfcfe:::rbd_data.1112a10502fe.000000000000024e:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:54.048 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:09:54.048 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.219401113000004, 2024-09-14T09:09:54.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077582650000000003, 2024-09-14T09:09:54.048 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.048 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.048 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.049 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.049 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:54.049 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:54.049 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 90751 2024-09-14T09:09:54.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.049 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:09:54.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:09:54.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736600+0000", 2024-09-14T09:09:54.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.71e-07 2024-09-14T09:09:54.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736608+0000", 2024-09-14T09:09:54.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2679999999999994e-06 2024-09-14T09:09:54.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736620+0000", 2024-09-14T09:09:54.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2064e-05 2024-09-14T09:09:54.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736627+0000", 2024-09-14T09:09:54.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8129999999999998e-06 2024-09-14T09:09:54.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736676+0000", 2024-09-14T09:09:54.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.901e-05 2024-09-14T09:09:54.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736685+0000", 2024-09-14T09:09:54.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:09:54.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803227+0000", 2024-09-14T09:09:54.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066541874000000001 2024-09-14T09:09:54.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803381+0000", 2024-09-14T09:09:54.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015482500000000001 2024-09-14T09:09:54.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.814181+0000", 2024-09-14T09:09:54.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010799944000000001 2024-09-14T09:09:54.053 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.053 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.053 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.053 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:90760 3.3 3:c116ad26:::rbd_data.1112a10502fe.0000000000000251:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:54.053 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:09:54.053 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.219298795999997, 2024-09-14T09:09:54.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077694599000000003, 2024-09-14T09:09:54.054 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.054 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.054 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.054 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.054 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:54.054 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:54.054 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 90760 2024-09-14T09:09:54.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.054 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:09:54.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:09:54.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736702+0000", 2024-09-14T09:09:54.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0999999999999998e-07 2024-09-14T09:09:54.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736705+0000", 2024-09-14T09:09:54.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0120000000000001e-06 2024-09-14T09:09:54.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736711+0000", 2024-09-14T09:09:54.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6279999999999999e-06 2024-09-14T09:09:54.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736717+0000", 2024-09-14T09:09:54.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6200000000000004e-06 2024-09-14T09:09:54.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736765+0000", 2024-09-14T09:09:54.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7688000000000001e-05 2024-09-14T09:09:54.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736772+0000", 2024-09-14T09:09:54.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6529999999999994e-06 2024-09-14T09:09:54.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803886+0000", 2024-09-14T09:09:54.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067113795000000004 2024-09-14T09:09:54.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.804024+0000", 2024-09-14T09:09:54.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013782000000000001 2024-09-14T09:09:54.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.814396+0000", 2024-09-14T09:09:54.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010371773000000001 2024-09-14T09:09:54.059 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.059 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.059 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.059 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.059 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.059 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:54.060 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:09:54.061 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:54.062+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:54.161 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:54.163+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:54.163 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:54.163 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:54.164 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:09:54.164 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:54.173 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:54.263 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:54.265+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:54.276 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:54.276 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:54.276 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:54.276 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:54.276 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:54.285 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:09:54.364 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:54.366+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:54.429 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:54.430 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:54.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:54.430 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:54.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.430 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:228 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 360448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:54.430 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:54.430 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 82.634100782000004, 2024-09-14T09:09:54.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99234476999999999, 2024-09-14T09:09:54.430 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.430 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.430 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.430 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.431 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:54.431 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:54.431 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 228 2024-09-14T09:09:54.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.431 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:54.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:09:54.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796906+0000", 2024-09-14T09:09:54.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9399999999999995e-07 2024-09-14T09:09:54.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796917+0000", 2024-09-14T09:09:54.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0801e-05 2024-09-14T09:09:54.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796924+0000", 2024-09-14T09:09:54.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7750000000000004e-06 2024-09-14T09:09:54.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:54.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9972000000000001e-05 2024-09-14T09:09:54.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798671+0000", 2024-09-14T09:09:54.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017271330000000001 2024-09-14T09:09:54.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798675+0000", 2024-09-14T09:09:54.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.194e-06 2024-09-14T09:09:54.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789003+0000", 2024-09-14T09:09:54.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99032768400000004 2024-09-14T09:09:54.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789115+0000", 2024-09-14T09:09:54.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112236 2024-09-14T09:09:54.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789250+0000", 2024-09-14T09:09:54.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013548100000000001 2024-09-14T09:09:54.435 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.435 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.435 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.435 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:229 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 819200~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:54.435 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:54.435 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 82.634048559000007, 2024-09-14T09:09:54.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99287024599999996, 2024-09-14T09:09:54.436 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.436 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.436 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.436 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.436 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:54.436 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:54.436 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 229 2024-09-14T09:09:54.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.436 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:54.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:54.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:09:54.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999999e-07 2024-09-14T09:09:54.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796962+0000", 2024-09-14T09:09:54.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1479999999999999e-06 2024-09-14T09:09:54.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796967+0000", 2024-09-14T09:09:54.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1499999999999998e-06 2024-09-14T09:09:54.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:09:54.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-06 2024-09-14T09:09:54.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798688+0000", 2024-09-14T09:09:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017172660000000001 2024-09-14T09:09:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798691+0000", 2024-09-14T09:09:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:09:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789599+0000", 2024-09-14T09:09:54.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99090839399999997 2024-09-14T09:09:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789716+0000", 2024-09-14T09:09:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116474 2024-09-14T09:09:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789828+0000", 2024-09-14T09:09:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112293 2024-09-14T09:09:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:230 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1277952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 82.634027911000004, 2024-09-14T09:09:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99307501600000003, 2024-09-14T09:09:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 230 2024-09-14T09:09:54.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:09:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796979+0000", 2024-09-14T09:09:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.34e-07 2024-09-14T09:09:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796980+0000", 2024-09-14T09:09:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.53e-06 2024-09-14T09:09:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796986+0000", 2024-09-14T09:09:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9989999999999997e-06 2024-09-14T09:09:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796989+0000", 2024-09-14T09:09:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0340000000000001e-06 2024-09-14T09:09:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798702+0000", 2024-09-14T09:09:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001712756 2024-09-14T09:09:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798705+0000", 2024-09-14T09:09:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7750000000000001e-06 2024-09-14T09:09:54.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789870+0000", 2024-09-14T09:09:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991165026 2024-09-14T09:09:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789955+0000", 2024-09-14T09:09:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4839999999999994e-05 2024-09-14T09:09:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790053+0000", 2024-09-14T09:09:54.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8721999999999994e-05 2024-09-14T09:09:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:231 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 82.634012583000001, 2024-09-14T09:09:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99319130300000003, 2024-09-14T09:09:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 231 2024-09-14T09:09:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2024-09-14T09:09:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796995+0000", 2024-09-14T09:09:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2500000000000001e-06 2024-09-14T09:09:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796998+0000", 2024-09-14T09:09:54.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3230000000000002e-06 2024-09-14T09:09:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797001+0000", 2024-09-14T09:09:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7099999999999999e-06 2024-09-14T09:09:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798718+0000", 2024-09-14T09:09:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017168070000000001 2024-09-14T09:09:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798721+0000", 2024-09-14T09:09:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.853e-06 2024-09-14T09:09:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790077+0000", 2024-09-14T09:09:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991356393 2024-09-14T09:09:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790129+0000", 2024-09-14T09:09:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2240999999999997e-05 2024-09-14T09:09:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790185+0000", 2024-09-14T09:09:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5515e-05 2024-09-14T09:09:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:232 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2195456~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 82.634001927, 2024-09-14T09:09:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99329117899999997, 2024-09-14T09:09:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.451 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 232 2024-09-14T09:09:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:09:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797005+0000", 2024-09-14T09:09:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2024-09-14T09:09:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797006+0000", 2024-09-14T09:09:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3200000000000001e-06 2024-09-14T09:09:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797009+0000", 2024-09-14T09:09:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4680000000000001e-06 2024-09-14T09:09:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797012+0000", 2024-09-14T09:09:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4770000000000002e-06 2024-09-14T09:09:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798743+0000", 2024-09-14T09:09:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017312 2024-09-14T09:09:54.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798747+0000", 2024-09-14T09:09:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.484e-06 2024-09-14T09:09:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790201+0000", 2024-09-14T09:09:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99145419499999998 2024-09-14T09:09:54.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790241+0000", 2024-09-14T09:09:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0587999999999998e-05 2024-09-14T09:09:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790296+0000", 2024-09-14T09:09:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4212000000000002e-05 2024-09-14T09:09:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.456 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:233 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2654208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 82.633991304000006, 2024-09-14T09:09:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99337220100000001, 2024-09-14T09:09:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.457 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 233 2024-09-14T09:09:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:09:54.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:09:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.269e-06 2024-09-14T09:09:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797019+0000", 2024-09-14T09:09:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9519999999999999e-06 2024-09-14T09:09:54.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797022+0000", 2024-09-14T09:09:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6079999999999998e-06 2024-09-14T09:09:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798759+0000", 2024-09-14T09:09:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001737342 2024-09-14T09:09:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798762+0000", 2024-09-14T09:09:54.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:09:54.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790310+0000", 2024-09-14T09:09:54.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99154738799999997 2024-09-14T09:09:54.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790349+0000", 2024-09-14T09:09:54.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9573000000000002e-05 2024-09-14T09:09:54.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790387+0000", 2024-09-14T09:09:54.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7985999999999998e-05 2024-09-14T09:09:54.463 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.463 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.463 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.463 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:234 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3112960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:54.463 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:54.464 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 82.633981258999995, 2024-09-14T09:09:54.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99345674500000003, 2024-09-14T09:09:54.464 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.464 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.464 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:54.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:54.464 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 234 2024-09-14T09:09:54.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.464 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:09:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0100000000000001e-07 2024-09-14T09:09:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0699999999999999e-06 2024-09-14T09:09:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:09:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.886e-06 2024-09-14T09:09:54.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797032+0000", 2024-09-14T09:09:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7149999999999998e-06 2024-09-14T09:09:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798778+0000", 2024-09-14T09:09:54.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017460329999999999 2024-09-14T09:09:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798783+0000", 2024-09-14T09:09:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0760000000000002e-06 2024-09-14T09:09:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790408+0000", 2024-09-14T09:09:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99162473299999998 2024-09-14T09:09:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790446+0000", 2024-09-14T09:09:54.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8389000000000001e-05 2024-09-14T09:09:54.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790482+0000", 2024-09-14T09:09:54.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5642000000000002e-05 2024-09-14T09:09:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:235 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3571712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 82.633971360999993, 2024-09-14T09:09:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993539477, 2024-09-14T09:09:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.470 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 235 2024-09-14T09:09:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9999999999999999e-07 2024-09-14T09:09:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797036+0000", 2024-09-14T09:09:54.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.051e-06 2024-09-14T09:09:54.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797039+0000", 2024-09-14T09:09:54.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:09:54.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797042+0000", 2024-09-14T09:09:54.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5280000000000002e-06 2024-09-14T09:09:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798809+0000", 2024-09-14T09:09:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001767394 2024-09-14T09:09:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798815+0000", 2024-09-14T09:09:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0859999999999998e-06 2024-09-14T09:09:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790502+0000", 2024-09-14T09:09:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99168652300000004 2024-09-14T09:09:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790539+0000", 2024-09-14T09:09:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7471000000000001e-05 2024-09-14T09:09:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790574+0000", 2024-09-14T09:09:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5292e-05 2024-09-14T09:09:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:236 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 4030464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 82.633961127999996, 2024-09-14T09:09:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993619743, 2024-09-14T09:09:54.476 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.477 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.477 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.477 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.477 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:54.477 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:54.477 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 236 2024-09-14T09:09:54.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.477 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:54.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:54.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:09:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1400000000000001e-07 2024-09-14T09:09:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797047+0000", 2024-09-14T09:09:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3400000000000001e-06 2024-09-14T09:09:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:09:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0699999999999998e-06 2024-09-14T09:09:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797053+0000", 2024-09-14T09:09:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7310000000000002e-06 2024-09-14T09:09:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798839+0000", 2024-09-14T09:09:54.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001786403 2024-09-14T09:09:54.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798844+0000", 2024-09-14T09:09:54.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3730000000000001e-06 2024-09-14T09:09:54.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790592+0000", 2024-09-14T09:09:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99174818099999995 2024-09-14T09:09:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790628+0000", 2024-09-14T09:09:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5831000000000003e-05 2024-09-14T09:09:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790665+0000", 2024-09-14T09:09:54.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-05 2024-09-14T09:09:54.483 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.483 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.483 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.483 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:365 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:54.484 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:54.484 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 82.631774100000001, 2024-09-14T09:09:54.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157278400000004, 2024-09-14T09:09:54.484 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.484 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.484 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.484 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.485 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:54.485 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:54.485 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 365 2024-09-14T09:09:54.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.485 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:54.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:54.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:09:54.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:09:54.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799233+0000", 2024-09-14T09:09:54.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.057e-06 2024-09-14T09:09:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799236+0000", 2024-09-14T09:09:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0249999999999998e-06 2024-09-14T09:09:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799239+0000", 2024-09-14T09:09:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.481e-06 2024-09-14T09:09:54.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800963+0000", 2024-09-14T09:09:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017240440000000001 2024-09-14T09:09:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800969+0000", 2024-09-14T09:09:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1410000000000002e-06 2024-09-14T09:09:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790682+0000", 2024-09-14T09:09:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98971330300000004 2024-09-14T09:09:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790753+0000", 2024-09-14T09:09:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0548000000000003e-05 2024-09-14T09:09:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790805+0000", 2024-09-14T09:09:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1981999999999998e-05 2024-09-14T09:09:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:366 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 82.631764007000001, 2024-09-14T09:09:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99173757299999998, 2024-09-14T09:09:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.491 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 366 2024-09-14T09:09:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:09:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-07 2024-09-14T09:09:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799244+0000", 2024-09-14T09:09:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.359e-06 2024-09-14T09:09:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799247+0000", 2024-09-14T09:09:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4929999999999998e-06 2024-09-14T09:09:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799250+0000", 2024-09-14T09:09:54.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:09:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800991+0000", 2024-09-14T09:09:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017412809999999999 2024-09-14T09:09:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800997+0000", 2024-09-14T09:09:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:09:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790824+0000", 2024-09-14T09:09:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98982735399999999 2024-09-14T09:09:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790891+0000", 2024-09-14T09:09:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7243999999999995e-05 2024-09-14T09:09:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790980+0000", 2024-09-14T09:09:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8608000000000003e-05 2024-09-14T09:09:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:367 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 82.631752634999998, 2024-09-14T09:09:54.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99188259999999995, 2024-09-14T09:09:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 367 2024-09-14T09:09:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:54.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:54.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:09:54.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-07 2024-09-14T09:09:54.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799255+0000", 2024-09-14T09:09:54.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.111e-06 2024-09-14T09:09:54.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799259+0000", 2024-09-14T09:09:54.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8650000000000003e-06 2024-09-14T09:09:54.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799262+0000", 2024-09-14T09:09:54.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.128e-06 2024-09-14T09:09:54.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801029+0000", 2024-09-14T09:09:54.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017668460000000001 2024-09-14T09:09:54.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801032+0000", 2024-09-14T09:09:54.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3179999999999998e-06 2024-09-14T09:09:54.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791011+0000", 2024-09-14T09:09:54.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98997920399999995 2024-09-14T09:09:54.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791077+0000", 2024-09-14T09:09:54.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5214000000000003e-05 2024-09-14T09:09:54.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791136+0000", 2024-09-14T09:09:54.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9710000000000003e-05 2024-09-14T09:09:54.503 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.503 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.503 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.503 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:368 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:54.504 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:54.504 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 82.631741091999999, 2024-09-14T09:09:54.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99201753800000003, 2024-09-14T09:09:54.504 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.504 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.504 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.504 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.504 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:54.504 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:54.504 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 368 2024-09-14T09:09:54.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.505 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:54.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:54.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:09:54.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4900000000000002e-07 2024-09-14T09:09:54.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799267+0000", 2024-09-14T09:09:54.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.079e-06 2024-09-14T09:09:54.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799270+0000", 2024-09-14T09:09:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.993e-06 2024-09-14T09:09:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799272+0000", 2024-09-14T09:09:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.695e-06 2024-09-14T09:09:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801043+0000", 2024-09-14T09:09:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001771105 2024-09-14T09:09:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801046+0000", 2024-09-14T09:09:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7999999999999999e-06 2024-09-14T09:09:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791150+0000", 2024-09-14T09:09:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99010348699999995 2024-09-14T09:09:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791193+0000", 2024-09-14T09:09:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3615999999999997e-05 2024-09-14T09:09:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791283+0000", 2024-09-14T09:09:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9513999999999997e-05 2024-09-14T09:09:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:369 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 82.631730754000003, 2024-09-14T09:09:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99213433600000001, 2024-09-14T09:09:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.510 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 369 2024-09-14T09:09:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:54.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:09:54.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:09:54.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799277+0000", 2024-09-14T09:09:54.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.108e-06 2024-09-14T09:09:54.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799280+0000", 2024-09-14T09:09:54.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:09:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799283+0000", 2024-09-14T09:09:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.531e-06 2024-09-14T09:09:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801058+0000", 2024-09-14T09:09:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001775085 2024-09-14T09:09:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801060+0000", 2024-09-14T09:09:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8260000000000001e-06 2024-09-14T09:09:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791299+0000", 2024-09-14T09:09:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99023856799999999 2024-09-14T09:09:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791352+0000", 2024-09-14T09:09:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2528000000000003e-05 2024-09-14T09:09:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791410+0000", 2024-09-14T09:09:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8298000000000003e-05 2024-09-14T09:09:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.516 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:370 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2457600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 82.631705987000004, 2024-09-14T09:09:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99220795399999995, 2024-09-14T09:09:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.517 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 370 2024-09-14T09:09:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:09:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799301+0000", 2024-09-14T09:09:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2024-09-14T09:09:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799303+0000", 2024-09-14T09:09:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9319999999999999e-06 2024-09-14T09:09:54.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799310+0000", 2024-09-14T09:09:54.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8680000000000001e-06 2024-09-14T09:09:54.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799315+0000", 2024-09-14T09:09:54.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.921e-06 2024-09-14T09:09:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801071+0000", 2024-09-14T09:09:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001756678 2024-09-14T09:09:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801080+0000", 2024-09-14T09:09:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6060000000000003e-06 2024-09-14T09:09:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791429+0000", 2024-09-14T09:09:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99034944599999997 2024-09-14T09:09:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791471+0000", 2024-09-14T09:09:54.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1279999999999998e-05 2024-09-14T09:09:54.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791508+0000", 2024-09-14T09:09:54.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7663999999999997e-05 2024-09-14T09:09:54.525 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.525 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.525 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.525 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:371 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2916352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:54.525 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:54.525 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 82.631684815, 2024-09-14T09:09:54.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99228692299999999, 2024-09-14T09:09:54.525 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.526 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.526 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.526 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.526 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:54.526 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:54.526 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 371 2024-09-14T09:09:54.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.526 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:54.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:09:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799322+0000", 2024-09-14T09:09:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:09:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799333+0000", 2024-09-14T09:09:54.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1044e-05 2024-09-14T09:09:54.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799341+0000", 2024-09-14T09:09:54.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8439999999999998e-06 2024-09-14T09:09:54.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799354+0000", 2024-09-14T09:09:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3114e-05 2024-09-14T09:09:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801093+0000", 2024-09-14T09:09:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017385910000000001 2024-09-14T09:09:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801096+0000", 2024-09-14T09:09:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0680000000000001e-06 2024-09-14T09:09:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791528+0000", 2024-09-14T09:09:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99043264200000003 2024-09-14T09:09:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791570+0000", 2024-09-14T09:09:54.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2144999999999997e-05 2024-09-14T09:09:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791608+0000", 2024-09-14T09:09:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7966000000000002e-05 2024-09-14T09:09:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:372 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3375104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:54.531 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 82.631644266999999, 2024-09-14T09:09:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992342897, 2024-09-14T09:09:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 372 2024-09-14T09:09:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.532 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:09:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799363+0000", 2024-09-14T09:09:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2024-09-14T09:09:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799365+0000", 2024-09-14T09:09:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5500000000000001e-06 2024-09-14T09:09:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799371+0000", 2024-09-14T09:09:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2500000000000003e-06 2024-09-14T09:09:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799377+0000", 2024-09-14T09:09:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7509999999999997e-06 2024-09-14T09:09:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801107+0000", 2024-09-14T09:09:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017298019999999999 2024-09-14T09:09:54.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801111+0000", 2024-09-14T09:09:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8619999999999996e-06 2024-09-14T09:09:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791626+0000", 2024-09-14T09:09:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99051563300000001 2024-09-14T09:09:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791668+0000", 2024-09-14T09:09:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1424000000000002e-05 2024-09-14T09:09:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791705+0000", 2024-09-14T09:09:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7035e-05 2024-09-14T09:09:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.537 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:373 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 82.631622321999998, 2024-09-14T09:09:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99253589399999997, 2024-09-14T09:09:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 373 2024-09-14T09:09:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.538 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:09:54.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2024-09-14T09:09:54.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799387+0000", 2024-09-14T09:09:54.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1019999999999999e-06 2024-09-14T09:09:54.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799393+0000", 2024-09-14T09:09:54.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0190000000000003e-06 2024-09-14T09:09:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799398+0000", 2024-09-14T09:09:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:09:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801123+0000", 2024-09-14T09:09:54.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017251949999999999 2024-09-14T09:09:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801126+0000", 2024-09-14T09:09:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9280000000000002e-06 2024-09-14T09:09:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791746+0000", 2024-09-14T09:09:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99062036899999995 2024-09-14T09:09:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791835+0000", 2024-09-14T09:09:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9004000000000004e-05 2024-09-14T09:09:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791920+0000", 2024-09-14T09:09:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4524000000000006e-05 2024-09-14T09:09:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.543 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:60352 3.0 3.6d62a5c0 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:09:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 38.048986483999997, 2024-09-14T09:09:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41710537399999997, 2024-09-14T09:09:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.544 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:54.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:54.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:54.545 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 60352 2024-09-14T09:09:54.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.545 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:09:54.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:09:54.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382044+0000", 2024-09-14T09:09:54.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4640000000000001e-05 2024-09-14T09:09:54.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382048+0000", 2024-09-14T09:09:54.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4690000000000002e-06 2024-09-14T09:09:54.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382053+0000", 2024-09-14T09:09:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:09:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382068+0000", 2024-09-14T09:09:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4399000000000001e-05 2024-09-14T09:09:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382121+0000", 2024-09-14T09:09:54.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3578000000000001e-05 2024-09-14T09:09:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382127+0000", 2024-09-14T09:09:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2024-09-14T09:09:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799116+0000", 2024-09-14T09:09:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.416988566 2024-09-14T09:09:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799125+0000", 2024-09-14T09:09:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3100000000000006e-06 2024-09-14T09:09:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.551 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:63559 3.0 3.95b285c0 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:54.551 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:54.551 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 38.043155110999997, 2024-09-14T09:09:54.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.411301215, 2024-09-14T09:09:54.551 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:54.551 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:54.551 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:54.551 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:54.551 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:54.552 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:54.552 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 63559 2024-09-14T09:09:54.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.552 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:54.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:54.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:54.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:54.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:54.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:54.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:54.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:09:54.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2499999999999999e-07 2024-09-14T09:09:54.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387853+0000", 2024-09-14T09:09:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.477e-06 2024-09-14T09:09:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:54.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387856+0000", 2024-09-14T09:09:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1429999999999998e-06 2024-09-14T09:09:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387859+0000", 2024-09-14T09:09:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.582e-06 2024-09-14T09:09:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387888+0000", 2024-09-14T09:09:54.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9609000000000001e-05 2024-09-14T09:09:54.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387893+0000", 2024-09-14T09:09:54.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6779999999999999e-06 2024-09-14T09:09:54.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:54.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799143+0000", 2024-09-14T09:09:54.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41124997099999999 2024-09-14T09:09:54.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:54.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:54.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:54.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799152+0000", 2024-09-14T09:09:54.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5300000000000002e-06 2024-09-14T09:09:54.558 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.558 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.558 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.558 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:54.558 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:54.558 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:54.560 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:09:54.561 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:54.562+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:54.660 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:54.663+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:54.675 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:54.675 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:54.675 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:09:54.676 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:54.684 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:09:54.761 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:54.763+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:54.787 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:54.787 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:54.788 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:54.788 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:54.788 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:54.796 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:09:54.852 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:09:54.896 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:54.898+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:54.941 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:54.941 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:54.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:54.941 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:54.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.941 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55979 3.e 3:740d1568:::rbd_data.1112a10502fe.0000000000000133:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:54.942 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:54.942 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 39.090921340999998, 2024-09-14T09:09:54.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.95211669700000001, 2024-09-14T09:09:54.942 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:54.942 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:54.942 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:54.942 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:54.942 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:54.942 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:54.942 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55979 2024-09-14T09:09:54.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.942 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:54.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:54.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:54.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:54.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:54.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:54.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:54.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:54.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850380+0000", 2024-09-14T09:09:54.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.615e-06 2024-09-14T09:09:54.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:54.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850386+0000", 2024-09-14T09:09:54.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8000000000000001e-06 2024-09-14T09:09:54.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:54.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850403+0000", 2024-09-14T09:09:54.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6339999999999999e-05 2024-09-14T09:09:54.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850413+0000", 2024-09-14T09:09:54.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8609999999999993e-06 2024-09-14T09:09:54.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:54.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851033+0000", 2024-09-14T09:09:54.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062034700000000004 2024-09-14T09:09:54.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:09:54.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851042+0000", 2024-09-14T09:09:54.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8340000000000005e-06 2024-09-14T09:09:54.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:54.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853175+0000", 2024-09-14T09:09:54.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0021332809999999999 2024-09-14T09:09:54.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853183+0000", 2024-09-14T09:09:54.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:09:54.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:54.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795232+0000", 2024-09-14T09:09:54.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94204854900000001 2024-09-14T09:09:54.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:54.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795413+0000", 2024-09-14T09:09:54.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018059200000000001 2024-09-14T09:09:54.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:09:54.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795717+0000", 2024-09-14T09:09:54.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000304636 2024-09-14T09:09:54.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:54.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799631+0000", 2024-09-14T09:09:54.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136910000000004 2024-09-14T09:09:54.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:54.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802290+0000", 2024-09-14T09:09:54.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026588010000000001 2024-09-14T09:09:54.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:54.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802362+0000", 2024-09-14T09:09:54.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2018000000000001e-05 2024-09-14T09:09:54.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:54.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802495+0000", 2024-09-14T09:09:54.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000132967 2024-09-14T09:09:54.949 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:54.949 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:54.949 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:54.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.949 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55990 3.e 3:72d6260e:::rbd_data.1112a10502fe.000000000000016c:head [stat,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:54.949 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:54.949 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 39.090860034000002, 2024-09-14T09:09:54.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.952433164, 2024-09-14T09:09:54.949 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:54.949 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:54.949 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:54.950 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:54.950 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:54.950 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:54.950 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55990 2024-09-14T09:09:54.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.950 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:54.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:54.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:54.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:54.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:54.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:54.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:54.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:54.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850440+0000", 2024-09-14T09:09:54.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5199999999999996e-07 2024-09-14T09:09:54.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:54.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850444+0000", 2024-09-14T09:09:54.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.019e-06 2024-09-14T09:09:54.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:54.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850452+0000", 2024-09-14T09:09:54.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0209999999999999e-06 2024-09-14T09:09:54.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850457+0000", 2024-09-14T09:09:54.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9529999999999998e-06 2024-09-14T09:09:54.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:54.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851100+0000", 2024-09-14T09:09:54.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00064299699999999997 2024-09-14T09:09:54.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:54.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851108+0000", 2024-09-14T09:09:54.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2279999999999998e-06 2024-09-14T09:09:54.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:54.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853208+0000", 2024-09-14T09:09:54.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020996579999999999 2024-09-14T09:09:54.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853213+0000", 2024-09-14T09:09:54.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4029999999999998e-06 2024-09-14T09:09:54.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:54.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796098+0000", 2024-09-14T09:09:54.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94288483700000003 2024-09-14T09:09:54.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:54.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796247+0000", 2024-09-14T09:09:54.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014925800000000001 2024-09-14T09:09:54.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:54.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802872+0000", 2024-09-14T09:09:54.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006625138 2024-09-14T09:09:54.955 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:54.955 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:54.955 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:54.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.956 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:54.956 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:54.956 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 38.926621261000001, 2024-09-14T09:09:54.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77465830800000002, 2024-09-14T09:09:54.956 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:54.956 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:54.956 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:54.956 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:54.956 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:54.956 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:54.957 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 58987 2024-09-14T09:09:54.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.957 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:54.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:54.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:54.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:54.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:54.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:54.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:54.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:54.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014680+0000", 2024-09-14T09:09:54.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9250000000000002e-06 2024-09-14T09:09:54.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:54.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014689+0000", 2024-09-14T09:09:54.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9730000000000003e-06 2024-09-14T09:09:54.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:54.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014709+0000", 2024-09-14T09:09:54.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9641999999999999e-05 2024-09-14T09:09:54.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014720+0000", 2024-09-14T09:09:54.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-09-14T09:09:54.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:54.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014796+0000", 2024-09-14T09:09:54.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6567000000000001e-05 2024-09-14T09:09:54.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014808+0000", 2024-09-14T09:09:54.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1435e-05 2024-09-14T09:09:54.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:54.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789325+0000", 2024-09-14T09:09:54.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77451705999999998 2024-09-14T09:09:54.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:54.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789336+0000", 2024-09-14T09:09:54.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1466e-05 2024-09-14T09:09:54.960 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:54.960 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:54.960 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:54.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.961 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:59017 3.3 3.6b81fb83 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:54.961 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:54.961 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 38.924968857000003, 2024-09-14T09:09:54.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77253447099999994, 2024-09-14T09:09:54.961 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:54.961 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:54.961 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:54.961 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:54.961 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:54.961 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:54.961 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 59017 2024-09-14T09:09:54.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.962 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:54.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:54.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:54.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:54.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:54.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:54.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:54.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:54.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016332+0000", 2024-09-14T09:09:54.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3459999999999999e-06 2024-09-14T09:09:54.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:54.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016337+0000", 2024-09-14T09:09:54.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.48e-06 2024-09-14T09:09:54.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:54.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016355+0000", 2024-09-14T09:09:54.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7955e-05 2024-09-14T09:09:54.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016364+0000", 2024-09-14T09:09:54.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.02e-06 2024-09-14T09:09:54.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:54.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016433+0000", 2024-09-14T09:09:54.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8398000000000005e-05 2024-09-14T09:09:54.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016442+0000", 2024-09-14T09:09:54.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1819999999999995e-06 2024-09-14T09:09:54.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:54.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788855+0000", 2024-09-14T09:09:54.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77241356299999997 2024-09-14T09:09:54.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:54.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788865+0000", 2024-09-14T09:09:54.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5270000000000004e-06 2024-09-14T09:09:54.965 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:54.965 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:54.965 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:54.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.966 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60343 3.e 3:721b16e6:::rbd_data.1112a10502fe.000000000000014b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:54.966 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:54.966 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 38.820999254999997, 2024-09-14T09:09:54.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68876920900000005, 2024-09-14T09:09:54.966 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:54.966 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:54.966 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:54.966 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:54.966 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:54.966 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:54.966 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60343 2024-09-14T09:09:54.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.966 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:54.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:54.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:54.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:54.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:54.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:54.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:54.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:54.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120302+0000", 2024-09-14T09:09:54.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0279999999999999e-06 2024-09-14T09:09:54.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:54.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120310+0000", 2024-09-14T09:09:54.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4330000000000004e-06 2024-09-14T09:09:54.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:54.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120333+0000", 2024-09-14T09:09:54.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2200000000000001e-05 2024-09-14T09:09:54.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120343+0000", 2024-09-14T09:09:54.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0560000000000001e-05 2024-09-14T09:09:54.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:54.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120414+0000", 2024-09-14T09:09:54.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0493000000000004e-05 2024-09-14T09:09:54.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120424+0000", 2024-09-14T09:09:54.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.059e-05 2024-09-14T09:09:54.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:54.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796679+0000", 2024-09-14T09:09:54.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67625512700000001 2024-09-14T09:09:54.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:54.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796833+0000", 2024-09-14T09:09:54.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015403500000000001 2024-09-14T09:09:54.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:09:54.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797239+0000", 2024-09-14T09:09:54.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040503000000000002 2024-09-14T09:09:54.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:54.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802918+0000", 2024-09-14T09:09:54.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056796199999999998 2024-09-14T09:09:54.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:54.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808655+0000", 2024-09-14T09:09:54.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057365089999999999 2024-09-14T09:09:54.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:54.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808850+0000", 2024-09-14T09:09:54.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000194904 2024-09-14T09:09:54.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:54.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809069+0000", 2024-09-14T09:09:54.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021968000000000001 2024-09-14T09:09:54.973 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:54.973 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:54.973 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:54.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.973 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60356 3.2 3:40f9e9e7:::rbd_data.1112a10502fe.0000000000000160:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:54.973 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:54.973 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 38.819936742000003, 2024-09-14T09:09:54.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68053790800000002, 2024-09-14T09:09:54.973 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:54.974 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:54.974 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:54.974 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:54.974 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:54.974 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:54.974 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60356 2024-09-14T09:09:54.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.974 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:54.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:54.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:54.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:54.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:54.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:54.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:54.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:54.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121364+0000", 2024-09-14T09:09:54.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.173e-06 2024-09-14T09:09:54.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:54.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121371+0000", 2024-09-14T09:09:54.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-09-14T09:09:54.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:54.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121386+0000", 2024-09-14T09:09:54.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4925e-05 2024-09-14T09:09:54.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121395+0000", 2024-09-14T09:09:54.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8190000000000003e-06 2024-09-14T09:09:54.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:54.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121464+0000", 2024-09-14T09:09:54.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8149000000000001e-05 2024-09-14T09:09:54.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121474+0000", 2024-09-14T09:09:54.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0927999999999999e-05 2024-09-14T09:09:54.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:54.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795901+0000", 2024-09-14T09:09:54.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67442645499999998 2024-09-14T09:09:54.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:54.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796068+0000", 2024-09-14T09:09:54.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016655700000000001 2024-09-14T09:09:54.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 3", 2024-09-14T09:09:54.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796354+0000", 2024-09-14T09:09:54.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00028646999999999999 2024-09-14T09:09:54.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:54.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.800348+0000", 2024-09-14T09:09:54.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039943119999999999 2024-09-14T09:09:54.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:54.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801690+0000", 2024-09-14T09:09:54.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013415090000000001 2024-09-14T09:09:54.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:54.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801771+0000", 2024-09-14T09:09:54.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1678e-05 2024-09-14T09:09:54.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:54.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801900+0000", 2024-09-14T09:09:54.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000128978 2024-09-14T09:09:54.979 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:54.980 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:54.980 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:54.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.980 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62163 3.e 3:713ab431:::rbd_data.1112a10502fe.0000000000000198:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:54.980 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:54.980 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 38.729566535000004, 2024-09-14T09:09:54.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.597552682, 2024-09-14T09:09:54.980 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:54.980 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:54.980 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:54.980 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:54.980 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:54.981 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:54.981 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62163 2024-09-14T09:09:54.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.981 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:54.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:54.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:54.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:54.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:54.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:54.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:54.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:54.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211735+0000", 2024-09-14T09:09:54.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1110000000000002e-06 2024-09-14T09:09:54.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:54.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211744+0000", 2024-09-14T09:09:54.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0790000000000007e-06 2024-09-14T09:09:54.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:54.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211765+0000", 2024-09-14T09:09:54.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1114000000000001e-05 2024-09-14T09:09:54.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211775+0000", 2024-09-14T09:09:54.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0033e-05 2024-09-14T09:09:54.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:54.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211847+0000", 2024-09-14T09:09:54.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1503999999999998e-05 2024-09-14T09:09:54.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211857+0000", 2024-09-14T09:09:54.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0378e-05 2024-09-14T09:09:54.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:54.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799140+0000", 2024-09-14T09:09:54.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.58728279100000003 2024-09-14T09:09:54.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:54.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799289+0000", 2024-09-14T09:09:54.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000148966 2024-09-14T09:09:54.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:54.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809285+0000", 2024-09-14T09:09:54.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099967059999999993 2024-09-14T09:09:54.985 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:54.985 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:54.985 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:54.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.985 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63582 3.2 3:467f2009:::rbd_data.1112a10502fe.00000000000001a1:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:54.985 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:54.985 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 38.654373417999999, 2024-09-14T09:09:54.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51869012999999997, 2024-09-14T09:09:54.985 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:54.986 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:54.986 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:54.986 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:54.986 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:54.986 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:54.986 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63582 2024-09-14T09:09:54.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.986 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:54.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:54.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:54.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:54.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:54.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:54.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:54.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:54.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286928+0000", 2024-09-14T09:09:54.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.812e-06 2024-09-14T09:09:54.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:54.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286936+0000", 2024-09-14T09:09:54.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2390000000000002e-06 2024-09-14T09:09:54.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:54.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286955+0000", 2024-09-14T09:09:54.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8853000000000001e-05 2024-09-14T09:09:54.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286972+0000", 2024-09-14T09:09:54.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7365000000000001e-05 2024-09-14T09:09:54.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:54.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287052+0000", 2024-09-14T09:09:54.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9491000000000002e-05 2024-09-14T09:09:54.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287063+0000", 2024-09-14T09:09:54.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1620999999999999e-05 2024-09-14T09:09:54.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:54.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796696+0000", 2024-09-14T09:09:54.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50963256999999995 2024-09-14T09:09:54.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:54.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796847+0000", 2024-09-14T09:09:54.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015126899999999999 2024-09-14T09:09:54.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:54.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.805616+0000", 2024-09-14T09:09:54.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087689099999999996 2024-09-14T09:09:54.990 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:54.990 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:54.990 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:54.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.990 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63586 3.3 3.d4e49b03 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:54.990 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:54.991 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 38.654289036999998, 2024-09-14T09:09:54.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50188935099999998, 2024-09-14T09:09:54.991 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:54.991 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:54.991 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:54.991 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:54.991 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:54.991 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:54.991 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63586 2024-09-14T09:09:54.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.991 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:54.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:54.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:54.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:54.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:54.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:54.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:54.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:54.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287011+0000", 2024-09-14T09:09:54.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.61e-07 2024-09-14T09:09:54.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:54.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287014+0000", 2024-09-14T09:09:54.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3900000000000002e-06 2024-09-14T09:09:54.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:54.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287023+0000", 2024-09-14T09:09:54.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3380000000000005e-06 2024-09-14T09:09:54.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287029+0000", 2024-09-14T09:09:54.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0079999999999999e-06 2024-09-14T09:09:54.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:54.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287087+0000", 2024-09-14T09:09:54.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8322000000000002e-05 2024-09-14T09:09:54.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:54.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287096+0000", 2024-09-14T09:09:54.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8580000000000006e-06 2024-09-14T09:09:54.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:54.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788891+0000", 2024-09-14T09:09:54.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50179498499999997 2024-09-14T09:09:54.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:54.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788900+0000", 2024-09-14T09:09:54.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.789e-06 2024-09-14T09:09:54.995 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:54.995 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:54.995 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:54.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.995 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60363 3.1d 3:b8b44067:::rbd_data.1112a10502fe.000000000000018b:head [stat,delete] snapc 21=[21] RETRY=12 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:54.995 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:54.995 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 38.153567299000002, 2024-09-14T09:09:54.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268612690000001, 2024-09-14T09:09:54.996 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:54.996 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:54.996 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:54.996 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:54.996 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:54.996 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:54.996 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60363 2024-09-14T09:09:54.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.996 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:54.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:54.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:54.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:54.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:54.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:54.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:54.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:54.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787733+0000", 2024-09-14T09:09:54.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.314e-06 2024-09-14T09:09:54.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:54.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787739+0000", 2024-09-14T09:09:54.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5300000000000004e-06 2024-09-14T09:09:54.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:54.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787750+0000", 2024-09-14T09:09:54.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1251e-05 2024-09-14T09:09:54.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:54.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:54.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0739999999999993e-06 2024-09-14T09:09:54.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:54.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787827+0000", 2024-09-14T09:09:54.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8861000000000004e-05 2024-09-14T09:09:54.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:09:54.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787836+0000", 2024-09-14T09:09:54.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1339999999999993e-06 2024-09-14T09:09:54.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:54.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:54.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:55.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789335+0000", 2024-09-14T09:09:55.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014988289999999999 2024-09-14T09:09:55.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:55.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789343+0000", 2024-09-14T09:09:55.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6639999999999998e-06 2024-09-14T09:09:55.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:55.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799170+0000", 2024-09-14T09:09:55.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098272500000001 2024-09-14T09:09:55.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:55.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799377+0000", 2024-09-14T09:09:55.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000207126 2024-09-14T09:09:55.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:55.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814593+0000", 2024-09-14T09:09:55.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015216235999999999 2024-09-14T09:09:55.001 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.001 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:55.001 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.002 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63565 3.1d 3:bdc63b28:::rbd_data.1112a10502fe.000000000000016d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=9 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:55.002 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:55.002 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 38.153521507999997, 2024-09-14T09:09:55.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0271114539999999, 2024-09-14T09:09:55.002 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:55.002 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:55.002 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:55.002 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:55.002 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:55.002 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:55.002 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63565 2024-09-14T09:09:55.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.002 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:55.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:55.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:55.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:55.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:55.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:55.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:55.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:55.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:55.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6899999999999998e-07 2024-09-14T09:09:55.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:55.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787781+0000", 2024-09-14T09:09:55.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8909999999999999e-06 2024-09-14T09:09:55.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:55.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787787+0000", 2024-09-14T09:09:55.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3230000000000003e-06 2024-09-14T09:09:55.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:55.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787793+0000", 2024-09-14T09:09:55.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-09-14T09:09:55.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:55.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789455+0000", 2024-09-14T09:09:55.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001661596 2024-09-14T09:09:55.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:55.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789463+0000", 2024-09-14T09:09:55.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4889999999999995e-06 2024-09-14T09:09:55.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:55.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800115+0000", 2024-09-14T09:09:55.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0106512670000001 2024-09-14T09:09:55.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:55.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800334+0000", 2024-09-14T09:09:55.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000219213 2024-09-14T09:09:55.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:09:55.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800651+0000", 2024-09-14T09:09:55.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00031765500000000002 2024-09-14T09:09:55.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:55.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.811875+0000", 2024-09-14T09:09:55.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011224032 2024-09-14T09:09:55.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:55.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814665+0000", 2024-09-14T09:09:55.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002789606 2024-09-14T09:09:55.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:55.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814742+0000", 2024-09-14T09:09:55.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6916999999999996e-05 2024-09-14T09:09:55.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:55.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814889+0000", 2024-09-14T09:09:55.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014725799999999999 2024-09-14T09:09:55.008 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.008 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:55.008 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.008 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:67113 3.1d 3:bba7fe0d:::rbd_data.1112a10502fe.00000000000001bf:head [stat,delete] snapc 21=[21] RETRY=4 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:55.008 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:55.008 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 38.152760649999998, 2024-09-14T09:09:55.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0265995649999999, 2024-09-14T09:09:55.009 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:55.009 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:55.009 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:55.009 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:55.009 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:55.009 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:55.009 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 67113 2024-09-14T09:09:55.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.009 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:55.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:55.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:55.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:55.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:55.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:55.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:55.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:55.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:55.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:09:55.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:55.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788543+0000", 2024-09-14T09:09:55.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-09-14T09:09:55.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:55.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788552+0000", 2024-09-14T09:09:55.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:09:55.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:55.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788559+0000", 2024-09-14T09:09:55.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:09:55.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:55.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789489+0000", 2024-09-14T09:09:55.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00092982199999999996 2024-09-14T09:09:55.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:55.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789497+0000", 2024-09-14T09:09:55.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6299999999999998e-06 2024-09-14T09:09:55.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:55.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801068+0000", 2024-09-14T09:09:55.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0115709530000001 2024-09-14T09:09:55.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:55.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801240+0000", 2024-09-14T09:09:55.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017276600000000001 2024-09-14T09:09:55.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:55.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815138+0000", 2024-09-14T09:09:55.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013897856 2024-09-14T09:09:55.013 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.013 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:55.014 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.014 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73412 3.1d 3:be4606c3:::rbd_data.1112a10502fe.00000000000001f2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:55.014 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:55.014 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 38.152729538000003, 2024-09-14T09:09:55.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026815928, 2024-09-14T09:09:55.014 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:55.014 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:55.015 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:55.015 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:55.015 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:55.015 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:55.015 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73412 2024-09-14T09:09:55.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.015 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:55.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:55.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:55.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:55.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:55.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:55.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:55.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:55.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:55.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5699999999999998e-07 2024-09-14T09:09:55.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:55.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788572+0000", 2024-09-14T09:09:55.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2809999999999998e-06 2024-09-14T09:09:55.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:55.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788579+0000", 2024-09-14T09:09:55.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5629999999999997e-06 2024-09-14T09:09:55.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:55.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788584+0000", 2024-09-14T09:09:55.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1710000000000001e-06 2024-09-14T09:09:55.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:55.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789521+0000", 2024-09-14T09:09:55.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00093657400000000002 2024-09-14T09:09:55.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:55.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789528+0000", 2024-09-14T09:09:55.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5719999999999997e-06 2024-09-14T09:09:55.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:55.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801631+0000", 2024-09-14T09:09:55.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0121023229999999 2024-09-14T09:09:55.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:55.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801792+0000", 2024-09-14T09:09:55.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016174000000000001 2024-09-14T09:09:55.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:55.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815386+0000", 2024-09-14T09:09:55.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013593246999999999 2024-09-14T09:09:55.019 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.019 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:55.019 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.019 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:77244 3.1d 3:b801be19:::rbd_data.1112a10502fe.0000000000000204:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:55.019 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:55.020 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 37.970865291999999, 2024-09-14T09:09:55.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.84519277100000001, 2024-09-14T09:09:55.020 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:55.020 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:55.020 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:55.020 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:55.020 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:55.020 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:55.020 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 77244 2024-09-14T09:09:55.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.020 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:55.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:55.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:55.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:55.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:55.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:55.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:55.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:55.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970436+0000", 2024-09-14T09:09:55.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.511e-06 2024-09-14T09:09:55.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:55.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970441+0000", 2024-09-14T09:09:55.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0470000000000001e-06 2024-09-14T09:09:55.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:55.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970453+0000", 2024-09-14T09:09:55.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2629999999999999e-05 2024-09-14T09:09:55.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:55.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970461+0000", 2024-09-14T09:09:55.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6850000000000001e-06 2024-09-14T09:09:55.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:55.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970524+0000", 2024-09-14T09:09:55.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3332999999999998e-05 2024-09-14T09:09:55.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:55.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970544+0000", 2024-09-14T09:09:55.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9731000000000001e-05 2024-09-14T09:09:55.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:55.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802188+0000", 2024-09-14T09:09:55.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.83164380000000004 2024-09-14T09:09:55.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:55.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:09:55.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015411999999999999 2024-09-14T09:09:55.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:55.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815627+0000", 2024-09-14T09:09:55.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013284914 2024-09-14T09:09:55.024 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.024 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:55.024 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.025 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:79796 3.1d 3:bc22caaf:::rbd_data.1112a10502fe.000000000000020c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:55.025 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:55.025 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 37.849556606, 2024-09-14T09:09:55.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72411694299999996, 2024-09-14T09:09:55.025 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:55.025 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:55.025 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:55.025 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:55.025 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:55.025 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:55.025 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 79796 2024-09-14T09:09:55.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.025 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:55.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:55.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:55.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:55.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:55.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:55.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:55.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:55.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091745+0000", 2024-09-14T09:09:55.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2000000000000001e-06 2024-09-14T09:09:55.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:55.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091752+0000", 2024-09-14T09:09:55.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-09-14T09:09:55.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:55.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091772+0000", 2024-09-14T09:09:55.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9822000000000001e-05 2024-09-14T09:09:55.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:55.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091791+0000", 2024-09-14T09:09:55.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9236e-05 2024-09-14T09:09:55.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:55.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091882+0000", 2024-09-14T09:09:55.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0783000000000001e-05 2024-09-14T09:09:55.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:55.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091892+0000", 2024-09-14T09:09:55.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7999999999999993e-06 2024-09-14T09:09:55.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:55.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802744+0000", 2024-09-14T09:09:55.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.710851868 2024-09-14T09:09:55.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:55.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802902+0000", 2024-09-14T09:09:55.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015814900000000001 2024-09-14T09:09:55.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:55.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815860+0000", 2024-09-14T09:09:55.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012957605000000001 2024-09-14T09:09:55.029 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.030 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:55.030 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.030 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80904 3.1d 3:be0e7f3d:::rbd_data.1112a10502fe.0000000000000214:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:55.030 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:55.030 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 37.769470759000001, 2024-09-14T09:09:55.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64435178100000001, 2024-09-14T09:09:55.030 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:55.030 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:55.030 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:55.030 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:55.030 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:55.030 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:55.031 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80904 2024-09-14T09:09:55.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.031 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:55.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:55.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:55.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:55.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:55.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:55.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:55.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:55.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171831+0000", 2024-09-14T09:09:55.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0729999999999999e-06 2024-09-14T09:09:55.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:55.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171839+0000", 2024-09-14T09:09:55.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9179999999999994e-06 2024-09-14T09:09:55.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:55.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171857+0000", 2024-09-14T09:09:55.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8957000000000002e-05 2024-09-14T09:09:55.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:55.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171867+0000", 2024-09-14T09:09:55.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7100000000000002e-06 2024-09-14T09:09:55.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:55.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171957+0000", 2024-09-14T09:09:55.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9932999999999994e-05 2024-09-14T09:09:55.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:55.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171974+0000", 2024-09-14T09:09:55.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6988999999999999e-05 2024-09-14T09:09:55.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:55.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803301+0000", 2024-09-14T09:09:55.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63132648599999996 2024-09-14T09:09:55.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:55.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803482+0000", 2024-09-14T09:09:55.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000181607 2024-09-14T09:09:55.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:55.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816180+0000", 2024-09-14T09:09:55.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012698108 2024-09-14T09:09:55.035 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.035 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:55.035 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.035 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80964 3.1d 3:be42e20f:::rbd_data.1112a10502fe.0000000000000219:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:55.035 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:55.035 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 37.763835192000002, 2024-09-14T09:09:55.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63896829799999999, 2024-09-14T09:09:55.035 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:55.036 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:55.036 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:55.036 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:55.036 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:55.036 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:55.036 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80964 2024-09-14T09:09:55.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.036 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:55.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:55.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:55.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:55.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:55.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:55.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:55.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:55.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177466+0000", 2024-09-14T09:09:55.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6610000000000001e-06 2024-09-14T09:09:55.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:55.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177472+0000", 2024-09-14T09:09:55.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3029999999999996e-06 2024-09-14T09:09:55.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:55.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177490+0000", 2024-09-14T09:09:55.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8099000000000001e-05 2024-09-14T09:09:55.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:55.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177499+0000", 2024-09-14T09:09:55.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:09:55.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:55.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177560+0000", 2024-09-14T09:09:55.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1334000000000006e-05 2024-09-14T09:09:55.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:55.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177578+0000", 2024-09-14T09:09:55.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8434999999999999e-05 2024-09-14T09:09:55.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:55.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803910+0000", 2024-09-14T09:09:55.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62633190699999997 2024-09-14T09:09:55.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:55.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.806612+0000", 2024-09-14T09:09:55.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002702257 2024-09-14T09:09:55.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:55.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816432+0000", 2024-09-14T09:09:55.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098199370000000008 2024-09-14T09:09:55.040 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.040 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:55.040 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.040 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83321 3.1d 3:bb24b47b:::rbd_data.1112a10502fe.0000000000000223:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:55.041 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:55.041 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 37.649381517999998, 2024-09-14T09:09:55.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52477628799999998, 2024-09-14T09:09:55.041 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:55.041 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:55.041 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:55.041 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:55.041 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:55.041 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:55.041 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83321 2024-09-14T09:09:55.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.041 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:55.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:55.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:55.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:55.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:55.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:55.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:55.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:55.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291920+0000", 2024-09-14T09:09:55.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.888e-06 2024-09-14T09:09:55.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:55.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291926+0000", 2024-09-14T09:09:55.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6059999999999999e-06 2024-09-14T09:09:55.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:55.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291943+0000", 2024-09-14T09:09:55.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6813e-05 2024-09-14T09:09:55.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:55.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291952+0000", 2024-09-14T09:09:55.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7439999999999996e-06 2024-09-14T09:09:55.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:55.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292023+0000", 2024-09-14T09:09:55.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1320000000000002e-05 2024-09-14T09:09:55.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:55.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292030+0000", 2024-09-14T09:09:55.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4219999999999997e-06 2024-09-14T09:09:55.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:55.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807221+0000", 2024-09-14T09:09:55.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51519140699999999 2024-09-14T09:09:55.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:55.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807406+0000", 2024-09-14T09:09:55.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018532800000000001 2024-09-14T09:09:55.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:55.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816694+0000", 2024-09-14T09:09:55.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092877600000000008 2024-09-14T09:09:55.045 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.045 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:55.046 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.046 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83358 3.1d 3:bb230e23:::rbd_data.1112a10502fe.000000000000022b:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:55.046 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:55.046 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 37.647861628000001, 2024-09-14T09:09:55.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52374808900000003, 2024-09-14T09:09:55.046 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:55.046 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:55.046 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:55.046 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:55.046 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:55.046 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:55.046 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83358 2024-09-14T09:09:55.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.047 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:55.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:55.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:55.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:55.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:55.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:55.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:55.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:55.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293439+0000", 2024-09-14T09:09:55.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5899999999999995e-07 2024-09-14T09:09:55.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:55.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293443+0000", 2024-09-14T09:09:55.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9309999999999999e-06 2024-09-14T09:09:55.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:55.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293457+0000", 2024-09-14T09:09:55.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3944999999999999e-05 2024-09-14T09:09:55.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:55.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293466+0000", 2024-09-14T09:09:55.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4319999999999999e-06 2024-09-14T09:09:55.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:55.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293530+0000", 2024-09-14T09:09:55.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3860000000000002e-05 2024-09-14T09:09:55.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:55.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293540+0000", 2024-09-14T09:09:55.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0107e-05 2024-09-14T09:09:55.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:55.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809096+0000", 2024-09-14T09:09:55.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51555587800000002 2024-09-14T09:09:55.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:55.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809265+0000", 2024-09-14T09:09:55.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000169092 2024-09-14T09:09:55.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:55.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817186+0000", 2024-09-14T09:09:55.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079209850000000002 2024-09-14T09:09:55.051 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.051 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:55.051 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.051 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83361 3.1d 3:bd571564:::rbd_data.1112a10502fe.000000000000022c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:55.051 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:55.051 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 37.647543552000002, 2024-09-14T09:09:55.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52373873100000001, 2024-09-14T09:09:55.051 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:55.051 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:55.051 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:55.051 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:55.052 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:55.052 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:55.052 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83361 2024-09-14T09:09:55.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.052 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:55.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:55.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:55.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:55.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:55.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:55.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:55.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:55.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293757+0000", 2024-09-14T09:09:55.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8000000000000004e-07 2024-09-14T09:09:55.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:55.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293762+0000", 2024-09-14T09:09:55.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8019999999999997e-06 2024-09-14T09:09:55.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:55.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293775+0000", 2024-09-14T09:09:55.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2884000000000001e-05 2024-09-14T09:09:55.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:55.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293783+0000", 2024-09-14T09:09:55.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:09:55.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:55.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293849+0000", 2024-09-14T09:09:55.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5859999999999996e-05 2024-09-14T09:09:55.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:55.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293861+0000", 2024-09-14T09:09:55.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2238999999999999e-05 2024-09-14T09:09:55.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:55.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809680+0000", 2024-09-14T09:09:55.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51581856800000003 2024-09-14T09:09:55.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:55.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809844+0000", 2024-09-14T09:09:55.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016441200000000001 2024-09-14T09:09:55.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:55.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:55.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:55.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817494+0000", 2024-09-14T09:09:55.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076502360000000004 2024-09-14T09:09:55.056 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.056 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:55.056 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.056 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:55.056 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:55.056 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:55.057 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:55.060+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:55.058 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:09:55.059 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:55.059 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:55.059 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:55.060 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:55.070 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:09:55.070 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:09:55.094 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:55.095 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:55.115 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:55.115 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:55.134 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:55.135 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:55.188 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:55.190+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:55.190 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:55.191 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:55.200 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:09:55.286 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:55.288+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:55.352 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:55.352 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:55.360 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:55.362+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:55.362 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:09:55.461 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:55.463+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:55.507 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:55.508 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:55.516 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:09:55.561 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:55.563+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:55.626 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:55.626 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:55.635 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:09:55.676 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:55.678+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:55.763 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:55.765+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:55.787 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:55.787 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:55.797 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:09:55.830 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T09:09:55.864 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:55.866+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:55.963 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:55.963 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:55.965 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:55.967+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:55.972 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:09:56.067 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:56.069+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:56.076 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:56.076 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:56.084 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:09:56.168 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:56.170+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:56.187 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:56.187 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:56.195 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:09:56.269 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:56.271+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:56.298 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:56.298 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:56.307 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:09:56.391 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:56.393+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:56.450 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:56.450 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:56.459 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:09:56.472 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:56.474+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:56.573 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:56.575+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:56.602 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:56.602 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:56.610 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:09:56.674 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:56.676+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:56.755 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:56.755 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:56.763 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:09:56.786 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is set 2024-09-14T09:09:56.808 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:56.810+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:56.876 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:56.878+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:56.882 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:56.882 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:56.891 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:56.977 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:56.979+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:57.033 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:57.034 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:57.042 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:09:57.078 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:57.080+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:57.148 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:09:57.179 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:57.181+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:57.187 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:57.187 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:57.196 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:09:57.276 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:57.276 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:57.279 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:57.282+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:57.293 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:57.293 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:57.305 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:57.305 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:57.310 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:09:57.310 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:09:57.315 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:09:57.327 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:57.327 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:57.344 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:57.344 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:57.360 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:57.361 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:57.416 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:57.418+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:57.423 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:57.423 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:57.423 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:57.423 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:57.423 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:57.431 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:09:57.516 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:57.518+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:57.576 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:57.577 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:57.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:57.577 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:57.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.577 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55979 3.e 3:740d1568:::rbd_data.1112a10502fe.0000000000000133:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:57.577 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:57.577 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.727358184000003, 2024-09-14T09:09:57.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.95211669700000001, 2024-09-14T09:09:57.577 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:57.577 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:57.577 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:57.578 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:57.578 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:57.578 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:57.578 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55979 2024-09-14T09:09:57.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.578 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:57.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:57.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:57.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:57.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:09:57.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:57.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850380+0000", 2024-09-14T09:09:57.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.615e-06 2024-09-14T09:09:57.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:57.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850386+0000", 2024-09-14T09:09:57.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8000000000000001e-06 2024-09-14T09:09:57.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:57.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850403+0000", 2024-09-14T09:09:57.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6339999999999999e-05 2024-09-14T09:09:57.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:57.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850413+0000", 2024-09-14T09:09:57.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8609999999999993e-06 2024-09-14T09:09:57.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851033+0000", 2024-09-14T09:09:57.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062034700000000004 2024-09-14T09:09:57.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:09:57.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851042+0000", 2024-09-14T09:09:57.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8340000000000005e-06 2024-09-14T09:09:57.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853175+0000", 2024-09-14T09:09:57.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0021332809999999999 2024-09-14T09:09:57.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:57.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853183+0000", 2024-09-14T09:09:57.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:09:57.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795232+0000", 2024-09-14T09:09:57.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94204854900000001 2024-09-14T09:09:57.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:57.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795413+0000", 2024-09-14T09:09:57.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018059200000000001 2024-09-14T09:09:57.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:09:57.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795717+0000", 2024-09-14T09:09:57.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000304636 2024-09-14T09:09:57.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:57.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799631+0000", 2024-09-14T09:09:57.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136910000000004 2024-09-14T09:09:57.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:57.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802290+0000", 2024-09-14T09:09:57.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026588010000000001 2024-09-14T09:09:57.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:57.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802362+0000", 2024-09-14T09:09:57.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2018000000000001e-05 2024-09-14T09:09:57.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:57.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802495+0000", 2024-09-14T09:09:57.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000132967 2024-09-14T09:09:57.584 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.585 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:57.585 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.585 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55990 3.e 3:72d6260e:::rbd_data.1112a10502fe.000000000000016c:head [stat,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:57.585 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:57.585 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.727296877000001, 2024-09-14T09:09:57.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.952433164, 2024-09-14T09:09:57.585 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:57.585 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:57.585 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:57.585 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:57.585 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:57.585 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:57.586 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55990 2024-09-14T09:09:57.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.586 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:57.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:57.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:57.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:57.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:09:57.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:57.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850440+0000", 2024-09-14T09:09:57.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5199999999999996e-07 2024-09-14T09:09:57.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:57.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850444+0000", 2024-09-14T09:09:57.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.019e-06 2024-09-14T09:09:57.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:57.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850452+0000", 2024-09-14T09:09:57.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0209999999999999e-06 2024-09-14T09:09:57.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:57.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850457+0000", 2024-09-14T09:09:57.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9529999999999998e-06 2024-09-14T09:09:57.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851100+0000", 2024-09-14T09:09:57.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00064299699999999997 2024-09-14T09:09:57.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:57.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851108+0000", 2024-09-14T09:09:57.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2279999999999998e-06 2024-09-14T09:09:57.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853208+0000", 2024-09-14T09:09:57.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020996579999999999 2024-09-14T09:09:57.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:57.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853213+0000", 2024-09-14T09:09:57.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4029999999999998e-06 2024-09-14T09:09:57.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796098+0000", 2024-09-14T09:09:57.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94288483700000003 2024-09-14T09:09:57.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:57.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796247+0000", 2024-09-14T09:09:57.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014925800000000001 2024-09-14T09:09:57.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:57.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802872+0000", 2024-09-14T09:09:57.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006625138 2024-09-14T09:09:57.590 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.590 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:57.590 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.591 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:57.591 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:57.591 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.563058104, 2024-09-14T09:09:57.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77465830800000002, 2024-09-14T09:09:57.591 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:57.591 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:57.591 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:57.591 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:57.591 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:57.591 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:57.591 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 58987 2024-09-14T09:09:57.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.592 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:57.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:57.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:57.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:57.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:09:57.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:57.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014680+0000", 2024-09-14T09:09:57.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9250000000000002e-06 2024-09-14T09:09:57.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:57.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014689+0000", 2024-09-14T09:09:57.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9730000000000003e-06 2024-09-14T09:09:57.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:57.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014709+0000", 2024-09-14T09:09:57.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9641999999999999e-05 2024-09-14T09:09:57.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:57.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014720+0000", 2024-09-14T09:09:57.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-09-14T09:09:57.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014796+0000", 2024-09-14T09:09:57.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6567000000000001e-05 2024-09-14T09:09:57.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:57.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014808+0000", 2024-09-14T09:09:57.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1435e-05 2024-09-14T09:09:57.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789325+0000", 2024-09-14T09:09:57.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77451705999999998 2024-09-14T09:09:57.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:57.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789336+0000", 2024-09-14T09:09:57.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1466e-05 2024-09-14T09:09:57.595 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.595 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:57.595 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.596 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:59017 3.3 3.6b81fb83 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:57.596 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:57.596 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.561405700000002, 2024-09-14T09:09:57.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77253447099999994, 2024-09-14T09:09:57.596 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:57.596 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:57.596 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:57.596 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:57.596 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:57.596 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:57.596 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 59017 2024-09-14T09:09:57.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.596 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:57.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:57.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:57.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:57.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:09:57.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:57.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016332+0000", 2024-09-14T09:09:57.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3459999999999999e-06 2024-09-14T09:09:57.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:57.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016337+0000", 2024-09-14T09:09:57.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.48e-06 2024-09-14T09:09:57.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:57.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016355+0000", 2024-09-14T09:09:57.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7955e-05 2024-09-14T09:09:57.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:57.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016364+0000", 2024-09-14T09:09:57.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.02e-06 2024-09-14T09:09:57.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016433+0000", 2024-09-14T09:09:57.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8398000000000005e-05 2024-09-14T09:09:57.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:57.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016442+0000", 2024-09-14T09:09:57.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1819999999999995e-06 2024-09-14T09:09:57.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788855+0000", 2024-09-14T09:09:57.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77241356299999997 2024-09-14T09:09:57.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:57.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788865+0000", 2024-09-14T09:09:57.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5270000000000004e-06 2024-09-14T09:09:57.600 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.600 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:57.600 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.601 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60343 3.e 3:721b16e6:::rbd_data.1112a10502fe.000000000000014b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:57.601 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:57.601 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.457436098000002, 2024-09-14T09:09:57.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68876920900000005, 2024-09-14T09:09:57.601 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:57.601 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:57.601 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:57.601 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:57.601 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:57.601 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:57.601 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60343 2024-09-14T09:09:57.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.601 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:57.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:57.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:57.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:57.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:09:57.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:57.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120302+0000", 2024-09-14T09:09:57.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0279999999999999e-06 2024-09-14T09:09:57.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:57.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120310+0000", 2024-09-14T09:09:57.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4330000000000004e-06 2024-09-14T09:09:57.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:57.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120333+0000", 2024-09-14T09:09:57.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2200000000000001e-05 2024-09-14T09:09:57.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:57.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120343+0000", 2024-09-14T09:09:57.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0560000000000001e-05 2024-09-14T09:09:57.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120414+0000", 2024-09-14T09:09:57.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0493000000000004e-05 2024-09-14T09:09:57.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:57.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120424+0000", 2024-09-14T09:09:57.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.059e-05 2024-09-14T09:09:57.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796679+0000", 2024-09-14T09:09:57.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67625512700000001 2024-09-14T09:09:57.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:57.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796833+0000", 2024-09-14T09:09:57.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015403500000000001 2024-09-14T09:09:57.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:09:57.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797239+0000", 2024-09-14T09:09:57.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040503000000000002 2024-09-14T09:09:57.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:57.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802918+0000", 2024-09-14T09:09:57.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056796199999999998 2024-09-14T09:09:57.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:57.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808655+0000", 2024-09-14T09:09:57.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057365089999999999 2024-09-14T09:09:57.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:57.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808850+0000", 2024-09-14T09:09:57.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000194904 2024-09-14T09:09:57.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:57.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809069+0000", 2024-09-14T09:09:57.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021968000000000001 2024-09-14T09:09:57.607 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.607 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:57.607 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.607 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60356 3.2 3:40f9e9e7:::rbd_data.1112a10502fe.0000000000000160:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:57.607 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:57.607 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.456373585000001, 2024-09-14T09:09:57.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68053790800000002, 2024-09-14T09:09:57.607 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:57.608 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:57.608 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:57.608 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:57.608 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:57.608 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:57.608 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60356 2024-09-14T09:09:57.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.608 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:57.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:57.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:57.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:57.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:09:57.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:57.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121364+0000", 2024-09-14T09:09:57.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.173e-06 2024-09-14T09:09:57.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:57.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121371+0000", 2024-09-14T09:09:57.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-09-14T09:09:57.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:57.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121386+0000", 2024-09-14T09:09:57.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4925e-05 2024-09-14T09:09:57.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:57.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121395+0000", 2024-09-14T09:09:57.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8190000000000003e-06 2024-09-14T09:09:57.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121464+0000", 2024-09-14T09:09:57.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8149000000000001e-05 2024-09-14T09:09:57.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:57.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121474+0000", 2024-09-14T09:09:57.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0927999999999999e-05 2024-09-14T09:09:57.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795901+0000", 2024-09-14T09:09:57.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67442645499999998 2024-09-14T09:09:57.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:57.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796068+0000", 2024-09-14T09:09:57.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016655700000000001 2024-09-14T09:09:57.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 3", 2024-09-14T09:09:57.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796354+0000", 2024-09-14T09:09:57.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00028646999999999999 2024-09-14T09:09:57.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:57.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.800348+0000", 2024-09-14T09:09:57.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039943119999999999 2024-09-14T09:09:57.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:57.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801690+0000", 2024-09-14T09:09:57.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013415090000000001 2024-09-14T09:09:57.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:57.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801771+0000", 2024-09-14T09:09:57.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1678e-05 2024-09-14T09:09:57.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:57.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801900+0000", 2024-09-14T09:09:57.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000128978 2024-09-14T09:09:57.613 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.614 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:57.614 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.614 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62163 3.e 3:713ab431:::rbd_data.1112a10502fe.0000000000000198:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:57.614 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:57.614 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.366003378000002, 2024-09-14T09:09:57.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.597552682, 2024-09-14T09:09:57.614 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:57.614 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:57.614 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:57.614 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:57.615 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:57.615 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:57.615 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62163 2024-09-14T09:09:57.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.615 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:57.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:57.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:57.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:57.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:09:57.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:57.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211735+0000", 2024-09-14T09:09:57.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1110000000000002e-06 2024-09-14T09:09:57.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:57.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211744+0000", 2024-09-14T09:09:57.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0790000000000007e-06 2024-09-14T09:09:57.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:57.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211765+0000", 2024-09-14T09:09:57.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1114000000000001e-05 2024-09-14T09:09:57.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:57.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211775+0000", 2024-09-14T09:09:57.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0033e-05 2024-09-14T09:09:57.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211847+0000", 2024-09-14T09:09:57.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1503999999999998e-05 2024-09-14T09:09:57.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:57.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211857+0000", 2024-09-14T09:09:57.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0378e-05 2024-09-14T09:09:57.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799140+0000", 2024-09-14T09:09:57.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.58728279100000003 2024-09-14T09:09:57.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:57.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799289+0000", 2024-09-14T09:09:57.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000148966 2024-09-14T09:09:57.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:57.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809285+0000", 2024-09-14T09:09:57.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099967059999999993 2024-09-14T09:09:57.619 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.619 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:57.619 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.620 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63582 3.2 3:467f2009:::rbd_data.1112a10502fe.00000000000001a1:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:57.620 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:57.620 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.290810260999997, 2024-09-14T09:09:57.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51869012999999997, 2024-09-14T09:09:57.620 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:57.620 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:57.620 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:57.620 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:57.620 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:57.620 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:57.620 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63582 2024-09-14T09:09:57.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.620 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:57.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:57.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:57.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:57.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:09:57.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:57.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286928+0000", 2024-09-14T09:09:57.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.812e-06 2024-09-14T09:09:57.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:57.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286936+0000", 2024-09-14T09:09:57.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2390000000000002e-06 2024-09-14T09:09:57.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:57.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286955+0000", 2024-09-14T09:09:57.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8853000000000001e-05 2024-09-14T09:09:57.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:57.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286972+0000", 2024-09-14T09:09:57.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7365000000000001e-05 2024-09-14T09:09:57.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287052+0000", 2024-09-14T09:09:57.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9491000000000002e-05 2024-09-14T09:09:57.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:57.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287063+0000", 2024-09-14T09:09:57.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1620999999999999e-05 2024-09-14T09:09:57.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796696+0000", 2024-09-14T09:09:57.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50963256999999995 2024-09-14T09:09:57.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:57.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796847+0000", 2024-09-14T09:09:57.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015126899999999999 2024-09-14T09:09:57.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:57.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.805616+0000", 2024-09-14T09:09:57.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087689099999999996 2024-09-14T09:09:57.625 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.625 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:57.625 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.625 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63586 3.3 3.d4e49b03 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:57.626 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:57.626 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.290725879999997, 2024-09-14T09:09:57.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50188935099999998, 2024-09-14T09:09:57.626 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:57.626 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:57.626 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:57.626 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:57.626 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:57.626 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:57.626 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63586 2024-09-14T09:09:57.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.626 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:57.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:57.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:57.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:57.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:09:57.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:57.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287011+0000", 2024-09-14T09:09:57.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.61e-07 2024-09-14T09:09:57.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:57.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287014+0000", 2024-09-14T09:09:57.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3900000000000002e-06 2024-09-14T09:09:57.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:57.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287023+0000", 2024-09-14T09:09:57.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3380000000000005e-06 2024-09-14T09:09:57.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:57.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287029+0000", 2024-09-14T09:09:57.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0079999999999999e-06 2024-09-14T09:09:57.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287087+0000", 2024-09-14T09:09:57.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8322000000000002e-05 2024-09-14T09:09:57.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:57.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287096+0000", 2024-09-14T09:09:57.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8580000000000006e-06 2024-09-14T09:09:57.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788891+0000", 2024-09-14T09:09:57.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50179498499999997 2024-09-14T09:09:57.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:57.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788900+0000", 2024-09-14T09:09:57.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.789e-06 2024-09-14T09:09:57.631 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.631 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:57.631 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.631 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60363 3.1d 3:b8b44067:::rbd_data.1112a10502fe.000000000000018b:head [stat,delete] snapc 21=[21] RETRY=12 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:57.631 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:57.631 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.790004142000001, 2024-09-14T09:09:57.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268612690000001, 2024-09-14T09:09:57.632 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:57.632 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:57.632 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:57.632 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:57.632 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:57.632 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:57.632 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60363 2024-09-14T09:09:57.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.632 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:57.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:57.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:57.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:57.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:09:57.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:57.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787733+0000", 2024-09-14T09:09:57.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.314e-06 2024-09-14T09:09:57.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:57.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787739+0000", 2024-09-14T09:09:57.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5300000000000004e-06 2024-09-14T09:09:57.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:57.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787750+0000", 2024-09-14T09:09:57.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1251e-05 2024-09-14T09:09:57.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:57.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:57.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0739999999999993e-06 2024-09-14T09:09:57.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787827+0000", 2024-09-14T09:09:57.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8861000000000004e-05 2024-09-14T09:09:57.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:09:57.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787836+0000", 2024-09-14T09:09:57.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1339999999999993e-06 2024-09-14T09:09:57.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789335+0000", 2024-09-14T09:09:57.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014988289999999999 2024-09-14T09:09:57.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:57.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789343+0000", 2024-09-14T09:09:57.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6639999999999998e-06 2024-09-14T09:09:57.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799170+0000", 2024-09-14T09:09:57.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098272500000001 2024-09-14T09:09:57.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:57.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799377+0000", 2024-09-14T09:09:57.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000207126 2024-09-14T09:09:57.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:57.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814593+0000", 2024-09-14T09:09:57.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015216235999999999 2024-09-14T09:09:57.638 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.638 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:57.638 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.638 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63565 3.1d 3:bdc63b28:::rbd_data.1112a10502fe.000000000000016d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=9 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:57.639 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:57.639 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.789958351000003, 2024-09-14T09:09:57.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0271114539999999, 2024-09-14T09:09:57.639 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:57.639 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:57.639 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:09:57.639 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:57.639 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:57.639 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:57.639 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63565 2024-09-14T09:09:57.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.639 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:57.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:57.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:57.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:57.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:57.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:57.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:09:57.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6899999999999998e-07 2024-09-14T09:09:57.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:57.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787781+0000", 2024-09-14T09:09:57.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8909999999999999e-06 2024-09-14T09:09:57.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:57.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787787+0000", 2024-09-14T09:09:57.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3230000000000003e-06 2024-09-14T09:09:57.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:57.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787793+0000", 2024-09-14T09:09:57.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-09-14T09:09:57.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789455+0000", 2024-09-14T09:09:57.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001661596 2024-09-14T09:09:57.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:57.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789463+0000", 2024-09-14T09:09:57.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4889999999999995e-06 2024-09-14T09:09:57.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800115+0000", 2024-09-14T09:09:57.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0106512670000001 2024-09-14T09:09:57.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:57.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800334+0000", 2024-09-14T09:09:57.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000219213 2024-09-14T09:09:57.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:09:57.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800651+0000", 2024-09-14T09:09:57.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00031765500000000002 2024-09-14T09:09:57.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:09:57.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.811875+0000", 2024-09-14T09:09:57.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011224032 2024-09-14T09:09:57.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:09:57.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814665+0000", 2024-09-14T09:09:57.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002789606 2024-09-14T09:09:57.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:09:57.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814742+0000", 2024-09-14T09:09:57.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6916999999999996e-05 2024-09-14T09:09:57.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:57.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814889+0000", 2024-09-14T09:09:57.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014725799999999999 2024-09-14T09:09:57.645 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.645 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:57.645 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.645 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:67113 3.1d 3:bba7fe0d:::rbd_data.1112a10502fe.00000000000001bf:head [stat,delete] snapc 21=[21] RETRY=4 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.789197493000003, 2024-09-14T09:09:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0265995649999999, 2024-09-14T09:09:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 67113 2024-09-14T09:09:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:57.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:57.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:57.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:57.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:09:57.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:09:57.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:57.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788543+0000", 2024-09-14T09:09:57.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-09-14T09:09:57.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:57.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788552+0000", 2024-09-14T09:09:57.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:09:57.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:57.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788559+0000", 2024-09-14T09:09:57.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:09:57.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789489+0000", 2024-09-14T09:09:57.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00092982199999999996 2024-09-14T09:09:57.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:57.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789497+0000", 2024-09-14T09:09:57.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6299999999999998e-06 2024-09-14T09:09:57.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801068+0000", 2024-09-14T09:09:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0115709530000001 2024-09-14T09:09:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801240+0000", 2024-09-14T09:09:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017276600000000001 2024-09-14T09:09:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815138+0000", 2024-09-14T09:09:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013897856 2024-09-14T09:09:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:57.650 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.651 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73412 3.1d 3:be4606c3:::rbd_data.1112a10502fe.00000000000001f2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:57.651 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:57.651 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.789166381000001, 2024-09-14T09:09:57.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026815928, 2024-09-14T09:09:57.651 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:57.651 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:57.651 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:57.651 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:57.651 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:57.651 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:57.651 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73412 2024-09-14T09:09:57.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.652 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:57.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:57.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:57.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:57.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:57.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:57.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:09:57.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5699999999999998e-07 2024-09-14T09:09:57.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:57.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788572+0000", 2024-09-14T09:09:57.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2809999999999998e-06 2024-09-14T09:09:57.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:57.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788579+0000", 2024-09-14T09:09:57.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5629999999999997e-06 2024-09-14T09:09:57.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:57.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788584+0000", 2024-09-14T09:09:57.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1710000000000001e-06 2024-09-14T09:09:57.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789521+0000", 2024-09-14T09:09:57.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00093657400000000002 2024-09-14T09:09:57.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:57.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789528+0000", 2024-09-14T09:09:57.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5719999999999997e-06 2024-09-14T09:09:57.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801631+0000", 2024-09-14T09:09:57.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0121023229999999 2024-09-14T09:09:57.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:57.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801792+0000", 2024-09-14T09:09:57.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016174000000000001 2024-09-14T09:09:57.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:57.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815386+0000", 2024-09-14T09:09:57.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013593246999999999 2024-09-14T09:09:57.655 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.656 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:57.656 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.656 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:77244 3.1d 3:b801be19:::rbd_data.1112a10502fe.0000000000000204:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:57.656 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:57.656 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.607302134999998, 2024-09-14T09:09:57.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.84519277100000001, 2024-09-14T09:09:57.656 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:57.656 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:57.656 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:57.656 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:57.656 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:57.657 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:57.657 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 77244 2024-09-14T09:09:57.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.657 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:57.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:57.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:57.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:57.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:09:57.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:57.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970436+0000", 2024-09-14T09:09:57.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.511e-06 2024-09-14T09:09:57.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:57.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970441+0000", 2024-09-14T09:09:57.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0470000000000001e-06 2024-09-14T09:09:57.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:57.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970453+0000", 2024-09-14T09:09:57.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2629999999999999e-05 2024-09-14T09:09:57.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:57.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970461+0000", 2024-09-14T09:09:57.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6850000000000001e-06 2024-09-14T09:09:57.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970524+0000", 2024-09-14T09:09:57.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3332999999999998e-05 2024-09-14T09:09:57.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:57.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970544+0000", 2024-09-14T09:09:57.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9731000000000001e-05 2024-09-14T09:09:57.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802188+0000", 2024-09-14T09:09:57.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.83164380000000004 2024-09-14T09:09:57.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:57.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:09:57.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015411999999999999 2024-09-14T09:09:57.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:57.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815627+0000", 2024-09-14T09:09:57.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013284914 2024-09-14T09:09:57.661 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.661 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:57.661 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.661 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:79796 3.1d 3:bc22caaf:::rbd_data.1112a10502fe.000000000000020c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:57.661 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:57.661 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.485993448999999, 2024-09-14T09:09:57.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72411694299999996, 2024-09-14T09:09:57.661 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:57.662 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:57.662 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:57.662 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:57.662 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:57.662 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:57.662 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 79796 2024-09-14T09:09:57.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.662 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:57.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:57.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:57.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:57.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:09:57.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:57.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091745+0000", 2024-09-14T09:09:57.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2000000000000001e-06 2024-09-14T09:09:57.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:57.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091752+0000", 2024-09-14T09:09:57.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-09-14T09:09:57.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:57.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091772+0000", 2024-09-14T09:09:57.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9822000000000001e-05 2024-09-14T09:09:57.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:57.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091791+0000", 2024-09-14T09:09:57.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9236e-05 2024-09-14T09:09:57.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091882+0000", 2024-09-14T09:09:57.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0783000000000001e-05 2024-09-14T09:09:57.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:57.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091892+0000", 2024-09-14T09:09:57.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7999999999999993e-06 2024-09-14T09:09:57.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802744+0000", 2024-09-14T09:09:57.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.710851868 2024-09-14T09:09:57.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:57.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802902+0000", 2024-09-14T09:09:57.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015814900000000001 2024-09-14T09:09:57.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:57.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815860+0000", 2024-09-14T09:09:57.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012957605000000001 2024-09-14T09:09:57.667 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.667 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:57.667 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.667 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80904 3.1d 3:be0e7f3d:::rbd_data.1112a10502fe.0000000000000214:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:57.667 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:57.667 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.405907601999999, 2024-09-14T09:09:57.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64435178100000001, 2024-09-14T09:09:57.667 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:57.667 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:57.667 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:57.668 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:57.668 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:57.668 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:57.668 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80904 2024-09-14T09:09:57.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.668 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:57.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:57.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:57.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:57.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:09:57.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:57.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171831+0000", 2024-09-14T09:09:57.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0729999999999999e-06 2024-09-14T09:09:57.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:57.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171839+0000", 2024-09-14T09:09:57.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9179999999999994e-06 2024-09-14T09:09:57.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:57.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171857+0000", 2024-09-14T09:09:57.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8957000000000002e-05 2024-09-14T09:09:57.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:57.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171867+0000", 2024-09-14T09:09:57.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7100000000000002e-06 2024-09-14T09:09:57.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171957+0000", 2024-09-14T09:09:57.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9932999999999994e-05 2024-09-14T09:09:57.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:57.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171974+0000", 2024-09-14T09:09:57.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6988999999999999e-05 2024-09-14T09:09:57.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803301+0000", 2024-09-14T09:09:57.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63132648599999996 2024-09-14T09:09:57.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:57.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803482+0000", 2024-09-14T09:09:57.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000181607 2024-09-14T09:09:57.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:57.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816180+0000", 2024-09-14T09:09:57.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012698108 2024-09-14T09:09:57.672 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.672 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:57.672 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.673 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80964 3.1d 3:be42e20f:::rbd_data.1112a10502fe.0000000000000219:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:57.673 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:57.673 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.400272035, 2024-09-14T09:09:57.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63896829799999999, 2024-09-14T09:09:57.673 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:57.673 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:57.673 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:57.673 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:57.673 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:57.673 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:57.673 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80964 2024-09-14T09:09:57.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.673 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:57.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:57.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:57.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:57.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:09:57.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:57.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177466+0000", 2024-09-14T09:09:57.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6610000000000001e-06 2024-09-14T09:09:57.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:57.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177472+0000", 2024-09-14T09:09:57.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3029999999999996e-06 2024-09-14T09:09:57.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:57.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177490+0000", 2024-09-14T09:09:57.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8099000000000001e-05 2024-09-14T09:09:57.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:57.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177499+0000", 2024-09-14T09:09:57.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:09:57.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177560+0000", 2024-09-14T09:09:57.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1334000000000006e-05 2024-09-14T09:09:57.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:57.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177578+0000", 2024-09-14T09:09:57.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8434999999999999e-05 2024-09-14T09:09:57.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803910+0000", 2024-09-14T09:09:57.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62633190699999997 2024-09-14T09:09:57.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:57.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.806612+0000", 2024-09-14T09:09:57.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002702257 2024-09-14T09:09:57.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:57.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816432+0000", 2024-09-14T09:09:57.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098199370000000008 2024-09-14T09:09:57.678 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.678 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:57.678 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.678 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83321 3.1d 3:bb24b47b:::rbd_data.1112a10502fe.0000000000000223:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:57.678 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:57.678 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.285818360999997, 2024-09-14T09:09:57.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52477628799999998, 2024-09-14T09:09:57.678 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:57.678 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:57.679 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:57.679 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:57.679 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:57.679 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:57.679 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83321 2024-09-14T09:09:57.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.679 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:57.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:57.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:57.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:57.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:09:57.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:57.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291920+0000", 2024-09-14T09:09:57.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.888e-06 2024-09-14T09:09:57.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:57.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291926+0000", 2024-09-14T09:09:57.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6059999999999999e-06 2024-09-14T09:09:57.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:57.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291943+0000", 2024-09-14T09:09:57.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6813e-05 2024-09-14T09:09:57.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:57.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291952+0000", 2024-09-14T09:09:57.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7439999999999996e-06 2024-09-14T09:09:57.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292023+0000", 2024-09-14T09:09:57.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1320000000000002e-05 2024-09-14T09:09:57.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:57.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292030+0000", 2024-09-14T09:09:57.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4219999999999997e-06 2024-09-14T09:09:57.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807221+0000", 2024-09-14T09:09:57.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51519140699999999 2024-09-14T09:09:57.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:57.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807406+0000", 2024-09-14T09:09:57.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018532800000000001 2024-09-14T09:09:57.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:57.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816694+0000", 2024-09-14T09:09:57.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092877600000000008 2024-09-14T09:09:57.683 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.683 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:57.683 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.684 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83358 3.1d 3:bb230e23:::rbd_data.1112a10502fe.000000000000022b:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:57.684 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:57.684 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.284298471, 2024-09-14T09:09:57.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52374808900000003, 2024-09-14T09:09:57.684 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:57.684 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:57.684 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:57.684 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:57.684 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:57.684 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:57.684 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83358 2024-09-14T09:09:57.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.685 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:57.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:57.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:57.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:57.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:09:57.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:57.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293439+0000", 2024-09-14T09:09:57.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5899999999999995e-07 2024-09-14T09:09:57.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:57.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293443+0000", 2024-09-14T09:09:57.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9309999999999999e-06 2024-09-14T09:09:57.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:57.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293457+0000", 2024-09-14T09:09:57.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3944999999999999e-05 2024-09-14T09:09:57.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:57.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293466+0000", 2024-09-14T09:09:57.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4319999999999999e-06 2024-09-14T09:09:57.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293530+0000", 2024-09-14T09:09:57.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3860000000000002e-05 2024-09-14T09:09:57.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:57.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293540+0000", 2024-09-14T09:09:57.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0107e-05 2024-09-14T09:09:57.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809096+0000", 2024-09-14T09:09:57.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51555587800000002 2024-09-14T09:09:57.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:57.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809265+0000", 2024-09-14T09:09:57.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000169092 2024-09-14T09:09:57.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:57.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817186+0000", 2024-09-14T09:09:57.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079209850000000002 2024-09-14T09:09:57.689 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.689 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:57.689 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.689 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83361 3.1d 3:bd571564:::rbd_data.1112a10502fe.000000000000022c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:57.689 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:57.689 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.283980395, 2024-09-14T09:09:57.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52373873100000001, 2024-09-14T09:09:57.689 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:57.689 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:57.690 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:57.690 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:57.690 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:57.690 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:57.690 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83361 2024-09-14T09:09:57.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.690 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:57.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:57.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:57.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:57.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:09:57.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:57.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:57.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293757+0000", 2024-09-14T09:09:57.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8000000000000004e-07 2024-09-14T09:09:57.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:57.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293762+0000", 2024-09-14T09:09:57.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8019999999999997e-06 2024-09-14T09:09:57.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:57.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293775+0000", 2024-09-14T09:09:57.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2884000000000001e-05 2024-09-14T09:09:57.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:57.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293783+0000", 2024-09-14T09:09:57.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:09:57.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293849+0000", 2024-09-14T09:09:57.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5859999999999996e-05 2024-09-14T09:09:57.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:57.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293861+0000", 2024-09-14T09:09:57.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2238999999999999e-05 2024-09-14T09:09:57.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:57.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809680+0000", 2024-09-14T09:09:57.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51581856800000003 2024-09-14T09:09:57.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:57.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809844+0000", 2024-09-14T09:09:57.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016441200000000001 2024-09-14T09:09:57.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:57.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:57.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:57.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817494+0000", 2024-09-14T09:09:57.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076502360000000004 2024-09-14T09:09:57.694 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.694 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:57.694 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.694 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:57.694 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:57.694 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:57.696 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:57.697+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:57.696 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:09:57.797 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:57.799+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:57.840 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 1] out_osds: [5] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 2] 2024-09-14T09:09:57.840 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:09:57.840 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-14T09:09:57.841 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T09:09:57.847 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:57.847 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:57.847 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:09:57.847 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:57.859 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:09:57.901 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:57.903+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:57.998 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:58.000+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:58.007 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:58.007 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:58.007 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:58.008 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:58.008 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:58.016 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:09:58.100 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:58.102+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:58.145 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:09:58.145 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:58.145 INFO:teuthology.orchestra.run.smithi116.stdout: "epoch": 126, 2024-09-14T09:09:58.145 INFO:teuthology.orchestra.run.smithi116.stdout: "fsid": "c991ac1c-978d-48b3-a540-4d3d4755e125", 2024-09-14T09:09:58.145 INFO:teuthology.orchestra.run.smithi116.stdout: "created": "2024-09-14T09:07:16.982473+0000", 2024-09-14T09:09:58.145 INFO:teuthology.orchestra.run.smithi116.stdout: "modified": "2024-09-14T09:09:57.789541+0000", 2024-09-14T09:09:58.146 INFO:teuthology.orchestra.run.smithi116.stdout: "last_up_change": "2024-09-14T09:09:15.843683+0000", 2024-09-14T09:09:58.146 INFO:teuthology.orchestra.run.smithi116.stdout: "last_in_change": "2024-09-14T09:09:52.811197+0000", 2024-09-14T09:09:58.146 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T09:09:58.146 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_num": 5801984, 2024-09-14T09:09:58.146 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_set": [ 2024-09-14T09:09:58.146 INFO:teuthology.orchestra.run.smithi116.stdout: "noscrub", 2024-09-14T09:09:58.146 INFO:teuthology.orchestra.run.smithi116.stdout: "pglog_hardlimit", 2024-09-14T09:09:58.146 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snapdirs", 2024-09-14T09:09:58.146 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_deletes", 2024-09-14T09:09:58.146 INFO:teuthology.orchestra.run.smithi116.stdout: "sortbitwise" 2024-09-14T09:09:58.146 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:58.146 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_version": 6, 2024-09-14T09:09:58.146 INFO:teuthology.orchestra.run.smithi116.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T09:09:58.147 INFO:teuthology.orchestra.run.smithi116.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T09:09:58.147 INFO:teuthology.orchestra.run.smithi116.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T09:09:58.147 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_snapshot": "", 2024-09-14T09:09:58.147 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_max": 3, 2024-09-14T09:09:58.147 INFO:teuthology.orchestra.run.smithi116.stdout: "max_osd": 6, 2024-09-14T09:09:58.147 INFO:teuthology.orchestra.run.smithi116.stdout: "require_min_compat_client": "luminous", 2024-09-14T09:09:58.147 INFO:teuthology.orchestra.run.smithi116.stdout: "min_compat_client": "jewel", 2024-09-14T09:09:58.147 INFO:teuthology.orchestra.run.smithi116.stdout: "require_osd_release": "squid", 2024-09-14T09:09:58.147 INFO:teuthology.orchestra.run.smithi116.stdout: "allow_crimson": false, 2024-09-14T09:09:58.147 INFO:teuthology.orchestra.run.smithi116.stdout: "pools": [ 2024-09-14T09:09:58.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.147 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 1, 2024-09-14T09:09:58.147 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": ".mgr", 2024-09-14T09:09:58.147 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:29.194849+0000", 2024-09-14T09:09:58.148 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 1, 2024-09-14T09:09:58.148 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool", 2024-09-14T09:09:58.148 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:09:58.148 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:09:58.148 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:09:58.148 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:09:58.148 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:09:58.148 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:09:58.148 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:09:58.148 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:09:58.148 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:09:58.148 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:09:58.148 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:09:58.148 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 1, 2024-09-14T09:09:58.149 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 1, 2024-09-14T09:09:58.149 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 1, 2024-09-14T09:09:58.149 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 1, 2024-09-14T09:09:58.149 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 1, 2024-09-14T09:09:58.149 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:09:58.149 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:09:58.149 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:09:58.149 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:09:58.149 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:09:58.149 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:09:58.149 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:09:58.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.149 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "16", 2024-09-14T09:09:58.150 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:09:58.150 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:09:58.150 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:09:58.150 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:09:58.150 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:09:58.150 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 0, 2024-09-14T09:09:58.150 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 0, 2024-09-14T09:09:58.150 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:09:58.150 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:09:58.150 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:09:58.150 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:09:58.150 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:09:58.150 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:09:58.150 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:09:58.151 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:09:58.151 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:09:58.151 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:09:58.151 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:09:58.151 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:09:58.151 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:09:58.151 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:09:58.151 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:09:58.151 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:09:58.151 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:09:58.151 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:09:58.151 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:09:58.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.152 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:09:58.152 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:09:58.152 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:09:58.152 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:09:58.152 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:09:58.152 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:09:58.152 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:09:58.152 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:09:58.152 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:09:58.152 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:09:58.152 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:09:58.152 INFO:teuthology.orchestra.run.smithi116.stdout: "options": { 2024-09-14T09:09:58.152 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_max": 32, 2024-09-14T09:09:58.153 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_min": 1 2024-09-14T09:09:58.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.153 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:09:58.153 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": {} 2024-09-14T09:09:58.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.153 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:09:58.153 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:09:58.153 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 6.059999942779541, 2024-09-14T09:09:58.153 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 6.059999942779541, 2024-09-14T09:09:58.153 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 0.33000001311302185, 2024-09-14T09:09:58.153 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 2, 2024-09-14T09:09:58.153 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 2, 2024-09-14T09:09:58.153 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:09:58.154 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:09:58.154 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:09:58.154 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.154 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 2, 2024-09-14T09:09:58.154 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": "rbd", 2024-09-14T09:09:58.154 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:33.684592+0000", 2024-09-14T09:09:58.154 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 8193, 2024-09-14T09:09:58.154 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T09:09:58.154 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:09:58.154 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:09:58.154 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:09:58.155 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:09:58.155 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:09:58.155 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:09:58.155 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:09:58.155 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:09:58.155 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:09:58.155 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:09:58.155 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:09:58.155 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 8, 2024-09-14T09:09:58.155 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 8, 2024-09-14T09:09:58.155 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 8, 2024-09-14T09:09:58.155 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 8, 2024-09-14T09:09:58.155 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 8, 2024-09-14T09:09:58.155 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:09:58.156 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:09:58.156 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:09:58.156 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:09:58.156 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:09:58.156 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:09:58.156 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:09:58.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.156 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "20", 2024-09-14T09:09:58.156 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:09:58.156 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:09:58.156 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:09:58.156 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:09:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:09:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 2, 2024-09-14T09:09:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 20, 2024-09-14T09:09:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:09:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:09:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:09:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:09:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:09:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:09:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:09:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:09:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:09:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:09:58.157 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:09:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:09:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:09:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:09:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:09:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:09:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:09:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:09:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:09:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:09:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:09:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:09:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:09:58.158 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:09:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:09:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:09:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:09:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:09:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:09:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:09:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: "options": {}, 2024-09-14T09:09:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:09:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd": {} 2024-09-14T09:09:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:09:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:09:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 2.2699999809265137, 2024-09-14T09:09:58.159 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 2.2699999809265137, 2024-09-14T09:09:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 0.82999998331069946, 2024-09-14T09:09:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 1.8799999952316284, 2024-09-14T09:09:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 1.8799999952316284, 2024-09-14T09:09:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:09:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:09:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:09:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 3, 2024-09-14T09:09:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": "pool_client.0", 2024-09-14T09:09:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:43.363542+0000", 2024-09-14T09:09:58.160 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 8193, 2024-09-14T09:09:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T09:09:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:09:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:09:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:09:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:09:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:09:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:09:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:09:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:09:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:09:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:09:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:09:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 32, 2024-09-14T09:09:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 32, 2024-09-14T09:09:58.161 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 32, 2024-09-14T09:09:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 32, 2024-09-14T09:09:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 32, 2024-09-14T09:09:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:09:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:09:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:09:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:09:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:09:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:09:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:09:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "124", 2024-09-14T09:09:58.162 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:09:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:09:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:09:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:09:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:09:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 43, 2024-09-14T09:09:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 124, 2024-09-14T09:09:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:09:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:09:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:09:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:09:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:09:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:09:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:09:58.163 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:09:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:09:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:09:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:09:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:09:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:09:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:09:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:09:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:09:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:09:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:09:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:09:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.164 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:09:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:09:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:09:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:09:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:09:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:09:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:09:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:09:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:09:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:09:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:09:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: "options": {}, 2024-09-14T09:09:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:09:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd": {} 2024-09-14T09:09:58.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.166 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:09:58.166 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:09:58.166 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 2.2699999809265137, 2024-09-14T09:09:58.166 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 2.2699999809265137, 2024-09-14T09:09:58.166 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 0.82999998331069946, 2024-09-14T09:09:58.166 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 1.8799999952316284, 2024-09-14T09:09:58.166 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 1.8799999952316284, 2024-09-14T09:09:58.166 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:09:58.166 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:09:58.166 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:09:58.166 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.166 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.166 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:58.166 INFO:teuthology.orchestra.run.smithi116.stdout: "osds": [ 2024-09-14T09:09:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 0, 2024-09-14T09:09:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "b3c13086-1183-454b-8e62-3aec9b69cdf5", 2024-09-14T09:09:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 0.3199462890625, 2024-09-14T09:09:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:09:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:09:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:09:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 11, 2024-09-14T09:09:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 78, 2024-09-14T09:09:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:09:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:58.167 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6816", 2024-09-14T09:09:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6817", 2024-09-14T09:09:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6818", 2024-09-14T09:09:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6819", 2024-09-14T09:09:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.169 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6822", 2024-09-14T09:09:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6823", 2024-09-14T09:09:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.170 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6820", 2024-09-14T09:09:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6821", 2024-09-14T09:09:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:09:58.171 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6817/1856142608", 2024-09-14T09:09:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6819/1856142608", 2024-09-14T09:09:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6823/1856142608", 2024-09-14T09:09:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6821/1856142608", 2024-09-14T09:09:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.172 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 1, 2024-09-14T09:09:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "8ee6a373-9d0d-4cd2-96f4-9673de96f546", 2024-09-14T09:09:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:09:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:09:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:09:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:09:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 13, 2024-09-14T09:09:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 125, 2024-09-14T09:09:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:09:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:58.173 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6800", 2024-09-14T09:09:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6801", 2024-09-14T09:09:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.174 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6802", 2024-09-14T09:09:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6803", 2024-09-14T09:09:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6806", 2024-09-14T09:09:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6807", 2024-09-14T09:09:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6804", 2024-09-14T09:09:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6805", 2024-09-14T09:09:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:09:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6801/3469105275", 2024-09-14T09:09:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6803/3469105275", 2024-09-14T09:09:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6807/3469105275", 2024-09-14T09:09:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6805/3469105275", 2024-09-14T09:09:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 2, 2024-09-14T09:09:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "958a9363-d751-49c3-9ec7-7330d377ee53", 2024-09-14T09:09:58.178 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 0.59710693359375, 2024-09-14T09:09:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:09:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 13, 2024-09-14T09:09:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 67, 2024-09-14T09:09:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 87, 2024-09-14T09:09:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 124, 2024-09-14T09:09:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 68, 2024-09-14T09:09:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6808", 2024-09-14T09:09:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6809", 2024-09-14T09:09:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6810", 2024-09-14T09:09:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6811", 2024-09-14T09:09:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6814", 2024-09-14T09:09:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6815", 2024-09-14T09:09:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6812", 2024-09-14T09:09:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6813", 2024-09-14T09:09:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:09:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6809/2050490698", 2024-09-14T09:09:58.183 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6811/2050490698", 2024-09-14T09:09:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6815/2050490698", 2024-09-14T09:09:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6813/2050490698", 2024-09-14T09:09:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 3, 2024-09-14T09:09:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "7fafd519-b2e9-498c-a409-f55cfe45a51a", 2024-09-14T09:09:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:58.184 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:09:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 0.2435760498046875, 2024-09-14T09:09:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:09:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:09:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:09:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 124, 2024-09-14T09:09:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:09:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6816", 2024-09-14T09:09:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:58.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6817", 2024-09-14T09:09:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6818", 2024-09-14T09:09:58.186 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6819", 2024-09-14T09:09:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.187 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6822", 2024-09-14T09:09:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6823", 2024-09-14T09:09:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:58.188 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6820", 2024-09-14T09:09:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6821", 2024-09-14T09:09:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:09:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.189 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6817/2855061278", 2024-09-14T09:09:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6819/2855061278", 2024-09-14T09:09:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6823/2855061278", 2024-09-14T09:09:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6821/2855061278", 2024-09-14T09:09:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 4, 2024-09-14T09:09:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "63d99552-5fea-4367-bf86-0addc8cceb98", 2024-09-14T09:09:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:58.190 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:09:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:09:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:09:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:09:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:09:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:09:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 124, 2024-09-14T09:09:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:09:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.191 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6808", 2024-09-14T09:09:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6809", 2024-09-14T09:09:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.192 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6810", 2024-09-14T09:09:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6811", 2024-09-14T09:09:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6814", 2024-09-14T09:09:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6815", 2024-09-14T09:09:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:58.194 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6812", 2024-09-14T09:09:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6813", 2024-09-14T09:09:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:09:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6809/369903047", 2024-09-14T09:09:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6811/369903047", 2024-09-14T09:09:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6815/369903047", 2024-09-14T09:09:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6813/369903047", 2024-09-14T09:09:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 5, 2024-09-14T09:09:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "e4bcb224-662f-4530-b477-c0dd9c4ddbf4", 2024-09-14T09:09:58.196 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:09:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 0, 2024-09-14T09:09:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 0, 2024-09-14T09:09:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:09:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:09:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:09:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:09:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 87, 2024-09-14T09:09:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:09:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:09:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:09:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.197 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6800", 2024-09-14T09:09:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6801", 2024-09-14T09:09:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:09:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.198 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6802", 2024-09-14T09:09:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6803", 2024-09-14T09:09:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:09:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.199 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6806", 2024-09-14T09:09:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6807", 2024-09-14T09:09:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:09:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:09:58.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:09:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6804", 2024-09-14T09:09:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:09:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6805", 2024-09-14T09:09:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:09:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6801/2878111293", 2024-09-14T09:09:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6803/2878111293", 2024-09-14T09:09:58.201 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6807/2878111293", 2024-09-14T09:09:58.202 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6805/2878111293", 2024-09-14T09:09:58.202 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:09:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:09:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:09:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_xinfo": [ 2024-09-14T09:09:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 0, 2024-09-14T09:09:58.204 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:24.757990+0000", 2024-09-14T09:09:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:09:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 1, 2024-09-14T09:09:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:58.205 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.277795+0000", 2024-09-14T09:09:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:09:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 2, 2024-09-14T09:09:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.290172+0000", 2024-09-14T09:09:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 68 2024-09-14T09:09:58.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 3, 2024-09-14T09:09:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.324594+0000", 2024-09-14T09:09:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:09:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 4, 2024-09-14T09:09:58.207 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:09:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:24.865136+0000", 2024-09-14T09:09:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:09:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 5, 2024-09-14T09:09:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:09:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:09:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:09:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:09:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 65536, 2024-09-14T09:09:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.020572+0000", 2024-09-14T09:09:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:09:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap": [], 2024-09-14T09:09:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap_items": [], 2024-09-14T09:09:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap_primaries": [], 2024-09-14T09:09:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_temp": [], 2024-09-14T09:09:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_temp": [], 2024-09-14T09:09:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: "blocklist": {}, 2024-09-14T09:09:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: "range_blocklist": {}, 2024-09-14T09:09:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profiles": { 2024-09-14T09:09:58.209 INFO:teuthology.orchestra.run.smithi116.stdout: "default": { 2024-09-14T09:09:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: "crush-failure-domain": "osd", 2024-09-14T09:09:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: "k": "2", 2024-09-14T09:09:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: "m": "1", 2024-09-14T09:09:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: "plugin": "jerasure", 2024-09-14T09:09:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: "technique": "reed_sol_van" 2024-09-14T09:09:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps_queue": [ 2024-09-14T09:09:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 3, 2024-09-14T09:09:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: "snaps": [ 2024-09-14T09:09:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: "begin": 29, 2024-09-14T09:09:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: "length": 10 2024-09-14T09:09:58.210 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:09:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: "new_removed_snaps": [], 2024-09-14T09:09:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: "new_purged_snaps": [], 2024-09-14T09:09:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_node_flags": {}, 2024-09-14T09:09:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: "device_class_flags": {}, 2024-09-14T09:09:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode": { 2024-09-14T09:09:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode_enabled": false, 2024-09-14T09:09:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_bucket_count": 0, 2024-09-14T09:09:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: "degraded_stretch_mode": 0, 2024-09-14T09:09:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: "recovering_stretch_mode": 0, 2024-09-14T09:09:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode_bucket": 0 2024-09-14T09:09:58.211 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.212 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:58.214 INFO:tasks.thrashosds.thrasher:j is {'epoch': 126, 'fsid': 'c991ac1c-978d-48b3-a540-4d3d4755e125', 'created': '2024-09-14T09:07:16.982473+0000', 'modified': '2024-09-14T09:09:57.789541+0000', 'last_up_change': '2024-09-14T09:09:15.843683+0000', 'last_in_change': '2024-09-14T09:09:52.811197+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T09:07:29.194849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T09:07:33.684592+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.2699999809265137, 'score_stable': 2.2699999809265137, 'optimal_score': 0.8299999833106995, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-14T09:07:43.363542+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 43, 'snap_epoch': 124, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.2699999809265137, 'score_stable': 2.2699999809265137, 'optimal_score': 0.8299999833106995, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}], 'osds': [{'osd': 0, 'uuid': 'b3c13086-1183-454b-8e62-3aec9b69cdf5', 'up': 1, 'in': 1, 'weight': 0.3199462890625, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 78, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6816', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6817', 'nonce': 1856142608}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6818', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6819', 'nonce': 1856142608}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6822', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6823', 'nonce': 1856142608}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6820', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6821', 'nonce': 1856142608}]}, 'public_addr': '172.21.15.116:6817/1856142608', 'cluster_addr': '172.21.15.116:6819/1856142608', 'heartbeat_back_addr': '172.21.15.116:6823/1856142608', 'heartbeat_front_addr': '172.21.15.116:6821/1856142608', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '8ee6a373-9d0d-4cd2-96f4-9673de96f546', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 125, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6800', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6801', 'nonce': 3469105275}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6802', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6803', 'nonce': 3469105275}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6806', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6807', 'nonce': 3469105275}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6804', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6805', 'nonce': 3469105275}]}, 'public_addr': '172.21.15.116:6801/3469105275', 'cluster_addr': '172.21.15.116:6803/3469105275', 'heartbeat_back_addr': '172.21.15.116:6807/3469105275', 'heartbeat_front_addr': '172.21.15.116:6805/3469105275', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '958a9363-d751-49c3-9ec7-7330d377ee53', 'up': 1, 'in': 1, 'weight': 0.59710693359375, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 67, 'up_from': 87, 'up_thru': 124, 'down_at': 68, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6808', 'nonce': 2050490698}, {'type': 'v1', 'addr': '172.21.15.116:6809', 'nonce': 2050490698}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6810', 'nonce': 2050490698}, {'type': 'v1', 'addr': '172.21.15.116:6811', 'nonce': 2050490698}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6814', 'nonce': 2050490698}, {'type': 'v1', 'addr': '172.21.15.116:6815', 'nonce': 2050490698}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6812', 'nonce': 2050490698}, {'type': 'v1', 'addr': '172.21.15.116:6813', 'nonce': 2050490698}]}, 'public_addr': '172.21.15.116:6809/2050490698', 'cluster_addr': '172.21.15.116:6811/2050490698', 'heartbeat_back_addr': '172.21.15.116:6815/2050490698', 'heartbeat_front_addr': '172.21.15.116:6813/2050490698', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '7fafd519-b2e9-498c-a409-f55cfe45a51a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.2435760498046875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 124, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6816', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6817', 'nonce': 2855061278}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6818', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6819', 'nonce': 2855061278}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6822', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6823', 'nonce': 2855061278}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6820', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6821', 'nonce': 2855061278}]}, 'public_addr': '172.21.15.144:6817/2855061278', 'cluster_addr': '172.21.15.144:6819/2855061278', 'heartbeat_back_addr': '172.21.15.144:6823/2855061278', 'heartbeat_front_addr': '172.21.15.144:6821/2855061278', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '63d99552-5fea-4367-bf86-0addc8cceb98', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 124, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6808', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6809', 'nonce': 369903047}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6810', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6811', 'nonce': 369903047}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6814', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6815', 'nonce': 369903047}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6812', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6813', 'nonce': 369903047}]}, 'public_addr': '172.21.15.144:6809/369903047', 'cluster_addr': '172.21.15.144:6811/369903047', 'heartbeat_back_addr': '172.21.15.144:6815/369903047', 'heartbeat_front_addr': '172.21.15.144:6813/369903047', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e4bcb224-662f-4530-b477-c0dd9c4ddbf4', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 87, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6800', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6801', 'nonce': 2878111293}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6802', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6803', 'nonce': 2878111293}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6806', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6807', 'nonce': 2878111293}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6804', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6805', 'nonce': 2878111293}]}, 'public_addr': '172.21.15.144:6801/2878111293', 'cluster_addr': '172.21.15.144:6803/2878111293', 'heartbeat_back_addr': '172.21.15.144:6807/2878111293', 'heartbeat_front_addr': '172.21.15.144:6805/2878111293', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:24.757990+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.277795+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.290172+0000', 'dead_epoch': 68}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.324594+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:24.865136+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.020572+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 29, 'length': 10}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T09:09:58.214 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T09:09:58.215 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:58.215 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2265 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4034560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.301933004999995, 2024-09-14T09:09:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073974829000000006, 2024-09-14T09:09:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2265 2024-09-14T09:09:58.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:09:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862542+0000", 2024-09-14T09:09:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:09:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862543+0000", 2024-09-14T09:09:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.81e-06 2024-09-14T09:09:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862549+0000", 2024-09-14T09:09:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8850000000000004e-06 2024-09-14T09:09:58.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862554+0000", 2024-09-14T09:09:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5279999999999997e-06 2024-09-14T09:09:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936318+0000", 2024-09-14T09:09:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073764422999999996 2024-09-14T09:09:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936412+0000", 2024-09-14T09:09:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3801000000000005e-05 2024-09-14T09:09:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936516+0000", 2024-09-14T09:09:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000104007 2024-09-14T09:09:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.220 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2266 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4096000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.301915140999995, 2024-09-14T09:09:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074208332000000002, 2024-09-14T09:09:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2266 2024-09-14T09:09:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:09:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862738+0000", 2024-09-14T09:09:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017920300000000001 2024-09-14T09:09:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862744+0000", 2024-09-14T09:09:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3000000000000001e-06 2024-09-14T09:09:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862753+0000", 2024-09-14T09:09:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8179999999999999e-06 2024-09-14T09:09:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862785+0000", 2024-09-14T09:09:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1949000000000002e-05 2024-09-14T09:09:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936556+0000", 2024-09-14T09:09:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073770268999999999 2024-09-14T09:09:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936657+0000", 2024-09-14T09:09:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101387 2024-09-14T09:09:58.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936767+0000", 2024-09-14T09:09:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110406 2024-09-14T09:09:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2267 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4157440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.301676559000001, 2024-09-14T09:09:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074200918000000005, 2024-09-14T09:09:58.225 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2267 2024-09-14T09:09:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:09:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863416+0000", 2024-09-14T09:09:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000618492 2024-09-14T09:09:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863421+0000", 2024-09-14T09:09:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1359999999999996e-06 2024-09-14T09:09:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863434+0000", 2024-09-14T09:09:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2291e-05 2024-09-14T09:09:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863444+0000", 2024-09-14T09:09:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9769999999999995e-06 2024-09-14T09:09:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936808+0000", 2024-09-14T09:09:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073364051999999999 2024-09-14T09:09:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936892+0000", 2024-09-14T09:09:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4641999999999994e-05 2024-09-14T09:09:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936999+0000", 2024-09-14T09:09:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106328 2024-09-14T09:09:58.229 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2329 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 106496~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.300947949999994, 2024-09-14T09:09:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074180251000000003, 2024-09-14T09:09:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:58.230 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2329 2024-09-14T09:09:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:09:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864203+0000", 2024-09-14T09:09:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000677015 2024-09-14T09:09:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864208+0000", 2024-09-14T09:09:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.972e-06 2024-09-14T09:09:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864221+0000", 2024-09-14T09:09:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2683e-05 2024-09-14T09:09:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864229+0000", 2024-09-14T09:09:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0809999999999994e-06 2024-09-14T09:09:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937430+0000", 2024-09-14T09:09:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073201231000000005 2024-09-14T09:09:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937513+0000", 2024-09-14T09:09:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2652999999999996e-05 2024-09-14T09:09:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937707+0000", 2024-09-14T09:09:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000193616 2024-09-14T09:09:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.234 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2331 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 229376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.300130452999994, 2024-09-14T09:09:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.07400843, 2024-09-14T09:09:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:58.235 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2331 2024-09-14T09:09:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:09:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868104+0000", 2024-09-14T09:09:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003760453 2024-09-14T09:09:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868109+0000", 2024-09-14T09:09:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9339999999999997e-06 2024-09-14T09:09:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868119+0000", 2024-09-14T09:09:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5389999999999996e-06 2024-09-14T09:09:58.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868126+0000", 2024-09-14T09:09:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4499999999999998e-06 2024-09-14T09:09:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938065+0000", 2024-09-14T09:09:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069938809000000005 2024-09-14T09:09:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938148+0000", 2024-09-14T09:09:58.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3171999999999996e-05 2024-09-14T09:09:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938352+0000", 2024-09-14T09:09:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020407300000000001 2024-09-14T09:09:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2380 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3239936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.285105424999998, 2024-09-14T09:09:58.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073985913, 2024-09-14T09:09:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2380 2024-09-14T09:09:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:09:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879697+0000", 2024-09-14T09:09:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032864100000000001 2024-09-14T09:09:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879702+0000", 2024-09-14T09:09:58.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.578e-06 2024-09-14T09:09:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879716+0000", 2024-09-14T09:09:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.413e-05 2024-09-14T09:09:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879724+0000", 2024-09-14T09:09:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.559e-06 2024-09-14T09:09:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.242 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953155+0000", 2024-09-14T09:09:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073431221000000005 2024-09-14T09:09:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953247+0000", 2024-09-14T09:09:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1662000000000004e-05 2024-09-14T09:09:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953355+0000", 2024-09-14T09:09:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010812200000000001 2024-09-14T09:09:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.243 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2501 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2850816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.266563121000004, 2024-09-14T09:09:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074288858999999999, 2024-09-14T09:09:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2501 2024-09-14T09:09:58.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:09:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.41e-07 2024-09-14T09:09:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897913+0000", 2024-09-14T09:09:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3090000000000001e-06 2024-09-14T09:09:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897918+0000", 2024-09-14T09:09:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8470000000000003e-06 2024-09-14T09:09:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.246 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897922+0000", 2024-09-14T09:09:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5549999999999996e-06 2024-09-14T09:09:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971872+0000", 2024-09-14T09:09:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073950057999999999 2024-09-14T09:09:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971958+0000", 2024-09-14T09:09:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5941999999999998e-05 2024-09-14T09:09:58.247 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972200+0000", 2024-09-14T09:09:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000241907 2024-09-14T09:09:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2502 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2912256~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.266523941000003, 2024-09-14T09:09:58.248 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074614080999999999, 2024-09-14T09:09:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2502 2024-09-14T09:09:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:58.249 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.250 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.250 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:09:58.250 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.250 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.250 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897951+0000", 2024-09-14T09:09:58.250 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:09:58.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.250 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897953+0000", 2024-09-14T09:09:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5670000000000002e-06 2024-09-14T09:09:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897970+0000", 2024-09-14T09:09:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6319000000000001e-05 2024-09-14T09:09:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897976+0000", 2024-09-14T09:09:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8760000000000002e-06 2024-09-14T09:09:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972245+0000", 2024-09-14T09:09:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074269186000000001 2024-09-14T09:09:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972333+0000", 2024-09-14T09:09:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7800999999999995e-05 2024-09-14T09:09:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972564+0000", 2024-09-14T09:09:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000231833 2024-09-14T09:09:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2503 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2973696~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.266489923999998, 2024-09-14T09:09:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074944286999999998, 2024-09-14T09:09:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.253 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2503 2024-09-14T09:09:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:09:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897985+0000", 2024-09-14T09:09:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999998e-07 2024-09-14T09:09:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897987+0000", 2024-09-14T09:09:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.401e-06 2024-09-14T09:09:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.255 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897999+0000", 2024-09-14T09:09:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1851999999999999e-05 2024-09-14T09:09:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898005+0000", 2024-09-14T09:09:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9789999999999998e-06 2024-09-14T09:09:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972609+0000", 2024-09-14T09:09:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074604217 2024-09-14T09:09:58.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972684+0000", 2024-09-14T09:09:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4777999999999995e-05 2024-09-14T09:09:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972929+0000", 2024-09-14T09:09:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024448100000000001 2024-09-14T09:09:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2504 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3035136~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.266461832000005, 2024-09-14T09:09:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075285131000000005, 2024-09-14T09:09:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2504 2024-09-14T09:09:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:09:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898078+0000", 2024-09-14T09:09:58.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5775e-05 2024-09-14T09:09:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898082+0000", 2024-09-14T09:09:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.49e-06 2024-09-14T09:09:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898092+0000", 2024-09-14T09:09:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0509999999999999e-05 2024-09-14T09:09:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.260 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898099+0000", 2024-09-14T09:09:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.81e-06 2024-09-14T09:09:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972971+0000", 2024-09-14T09:09:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074871788999999994 2024-09-14T09:09:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973055+0000", 2024-09-14T09:09:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3980000000000006e-05 2024-09-14T09:09:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973298+0000", 2024-09-14T09:09:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024277700000000001 2024-09-14T09:09:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2505 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3096576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.266365577000002, 2024-09-14T09:09:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075506668999999998, 2024-09-14T09:09:58.262 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2505 2024-09-14T09:09:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.263 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:09:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898370+0000", 2024-09-14T09:09:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026128799999999998 2024-09-14T09:09:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898374+0000", 2024-09-14T09:09:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8070000000000001e-06 2024-09-14T09:09:58.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898383+0000", 2024-09-14T09:09:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0520000000000007e-06 2024-09-14T09:09:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898389+0000", 2024-09-14T09:09:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2639999999999997e-06 2024-09-14T09:09:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973330+0000", 2024-09-14T09:09:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074940548999999995 2024-09-14T09:09:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973402+0000", 2024-09-14T09:09:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2556000000000001e-05 2024-09-14T09:09:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973615+0000", 2024-09-14T09:09:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000213153 2024-09-14T09:09:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.266 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2506 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3158016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.266072332999997, 2024-09-14T09:09:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075556110999999995, 2024-09-14T09:09:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:58.267 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2506 2024-09-14T09:09:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:09:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898497+0000", 2024-09-14T09:09:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4806e-05 2024-09-14T09:09:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898500+0000", 2024-09-14T09:09:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.54e-06 2024-09-14T09:09:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898507+0000", 2024-09-14T09:09:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1590000000000004e-06 2024-09-14T09:09:58.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898513+0000", 2024-09-14T09:09:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.015e-06 2024-09-14T09:09:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973656+0000", 2024-09-14T09:09:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075142929999999997 2024-09-14T09:09:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973742+0000", 2024-09-14T09:09:58.270 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5535e-05 2024-09-14T09:09:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973958+0000", 2024-09-14T09:09:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000216126 2024-09-14T09:09:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2507 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3219456~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.265943749000002, 2024-09-14T09:09:58.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075623459000000004, 2024-09-14T09:09:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2507 2024-09-14T09:09:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:09:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898761+0000", 2024-09-14T09:09:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000230614 2024-09-14T09:09:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898765+0000", 2024-09-14T09:09:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6629999999999999e-06 2024-09-14T09:09:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898774+0000", 2024-09-14T09:09:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6749999999999997e-06 2024-09-14T09:09:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898781+0000", 2024-09-14T09:09:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4640000000000003e-06 2024-09-14T09:09:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973985+0000", 2024-09-14T09:09:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075204101999999995 2024-09-14T09:09:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974063+0000", 2024-09-14T09:09:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7632000000000005e-05 2024-09-14T09:09:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974154+0000", 2024-09-14T09:09:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1309000000000003e-05 2024-09-14T09:09:58.275 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2508 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3280896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.265681986000004, 2024-09-14T09:09:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075576943999999993, 2024-09-14T09:09:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.276 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2508 2024-09-14T09:09:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:09:58.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899176+0000", 2024-09-14T09:09:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038340500000000002 2024-09-14T09:09:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899179+0000", 2024-09-14T09:09:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0290000000000001e-06 2024-09-14T09:09:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899186+0000", 2024-09-14T09:09:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8199999999999999e-06 2024-09-14T09:09:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899190+0000", 2024-09-14T09:09:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2050000000000004e-06 2024-09-14T09:09:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974193+0000", 2024-09-14T09:09:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075003632000000001 2024-09-14T09:09:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:58.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974276+0000", 2024-09-14T09:09:58.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2272000000000001e-05 2024-09-14T09:09:58.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974369+0000", 2024-09-14T09:09:58.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3580999999999997e-05 2024-09-14T09:09:58.280 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.280 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.280 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.280 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2509 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3342336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:58.281 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:58.281 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.265274368999997, 2024-09-14T09:09:58.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075356229999999996, 2024-09-14T09:09:58.281 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.281 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.281 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:58.281 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.281 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:58.281 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:58.281 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2509 2024-09-14T09:09:58.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.281 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:09:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899439+0000", 2024-09-14T09:09:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023958599999999999 2024-09-14T09:09:58.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899444+0000", 2024-09-14T09:09:58.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8790000000000002e-06 2024-09-14T09:09:58.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899455+0000", 2024-09-14T09:09:58.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0597999999999999e-05 2024-09-14T09:09:58.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899462+0000", 2024-09-14T09:09:58.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8179999999999998e-06 2024-09-14T09:09:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974400+0000", 2024-09-14T09:09:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074937999000000005 2024-09-14T09:09:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974465+0000", 2024-09-14T09:09:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5134000000000004e-05 2024-09-14T09:09:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974556+0000", 2024-09-14T09:09:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1216000000000002e-05 2024-09-14T09:09:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2510 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3403776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.264998976000001, 2024-09-14T09:09:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075295775999999995, 2024-09-14T09:09:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:58.285 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2510 2024-09-14T09:09:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:09:58.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899691+0000", 2024-09-14T09:09:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021615999999999999 2024-09-14T09:09:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899696+0000", 2024-09-14T09:09:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3200000000000001e-06 2024-09-14T09:09:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899704+0000", 2024-09-14T09:09:58.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9440000000000005e-06 2024-09-14T09:09:58.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899710+0000", 2024-09-14T09:09:58.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.584e-06 2024-09-14T09:09:58.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974594+0000", 2024-09-14T09:09:58.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074883551000000007 2024-09-14T09:09:58.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:58.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974679+0000", 2024-09-14T09:09:58.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5365999999999995e-05 2024-09-14T09:09:58.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974771+0000", 2024-09-14T09:09:58.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1850999999999999e-05 2024-09-14T09:09:58.289 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.289 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.289 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2511 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3465216~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.264752758, 2024-09-14T09:09:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075234668000000005, 2024-09-14T09:09:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2511 2024-09-14T09:09:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.290 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:09:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899951+0000", 2024-09-14T09:09:58.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000229569 2024-09-14T09:09:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899955+0000", 2024-09-14T09:09:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1010000000000002e-06 2024-09-14T09:09:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899971+0000", 2024-09-14T09:09:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5648999999999999e-05 2024-09-14T09:09:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899978+0000", 2024-09-14T09:09:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0829999999999998e-06 2024-09-14T09:09:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974806+0000", 2024-09-14T09:09:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074828092999999998 2024-09-14T09:09:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974870+0000", 2024-09-14T09:09:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4492000000000005e-05 2024-09-14T09:09:58.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974956+0000", 2024-09-14T09:09:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5680999999999995e-05 2024-09-14T09:09:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2512 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3526656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:09:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:58.294 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.264485213, 2024-09-14T09:09:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075178812999999997, 2024-09-14T09:09:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:09:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:09:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2512 2024-09-14T09:09:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:58.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:09:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904181+0000", 2024-09-14T09:09:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041919399999999999 2024-09-14T09:09:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904186+0000", 2024-09-14T09:09:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2390000000000002e-06 2024-09-14T09:09:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904199+0000", 2024-09-14T09:09:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2709e-05 2024-09-14T09:09:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904207+0000", 2024-09-14T09:09:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8150000000000006e-06 2024-09-14T09:09:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975000+0000", 2024-09-14T09:09:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.070793444999999997 2024-09-14T09:09:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975079+0000", 2024-09-14T09:09:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8480999999999996e-05 2024-09-14T09:09:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975168+0000", 2024-09-14T09:09:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9184000000000005e-05 2024-09-14T09:09:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:22840 3.15 3:a8cf3dc2:::rbd_header.1112a10502fe:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:09:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.604912190999997, 2024-09-14T09:09:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.119998785, 2024-09-14T09:09:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.299 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:09:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:09:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 22840 2024-09-14T09:09:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:09:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:09:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642492+0000", 2024-09-14T09:09:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.082930276999999997 2024-09-14T09:09:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642495+0000", 2024-09-14T09:09:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9809999999999999e-06 2024-09-14T09:09:58.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642501+0000", 2024-09-14T09:09:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-09-14T09:09:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642506+0000", 2024-09-14T09:09:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6650000000000002e-06 2024-09-14T09:09:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679483+0000", 2024-09-14T09:09:58.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036977777000000003 2024-09-14T09:09:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679517+0000", 2024-09-14T09:09:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.345e-05 2024-09-14T09:09:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679561+0000", 2024-09-14T09:09:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3930999999999997e-05 2024-09-14T09:09:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:22857 3.15 3:a8cf3dc2:::rbd_header.1112a10502fe:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:09:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.455018266000003, 2024-09-14T09:09:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.088427917999999994, 2024-09-14T09:09:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:09:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:09:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 22857 2024-09-14T09:09:58.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:09:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:09:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777685+0000", 2024-09-14T09:09:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.068229181999999999 2024-09-14T09:09:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777688+0000", 2024-09-14T09:09:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1980000000000001e-06 2024-09-14T09:09:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777695+0000", 2024-09-14T09:09:58.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:09:58.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777700+0000", 2024-09-14T09:09:58.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0919999999999997e-06 2024-09-14T09:09:58.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797735+0000", 2024-09-14T09:09:58.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0200351 2024-09-14T09:09:58.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:58.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797800+0000", 2024-09-14T09:09:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4305000000000002e-05 2024-09-14T09:09:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797884+0000", 2024-09-14T09:09:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4344000000000004e-05 2024-09-14T09:09:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.308 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.308 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:58.309 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:09:58.310 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:58.215+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:58.314 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:58.316+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:58.414 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:58.416+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:58.415 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:58.415 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:58.415 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:09:58.415 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:58.426 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:09:58.515 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:58.517+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:58.570 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:58.570 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:09:58.570 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:09:58.570 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:09:58.571 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:58.579 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:09:58.604 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:09:58.605 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T09:09:58.615 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:58.617+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:58.616 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-09-14T09:09:57.792210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1004328172,"num_objects":2029,"num_object_clones":260,"num_object_copies":4058,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":161,"num_objects_misplaced":57,"num_objects_unfound":0,"num_objects_dirty":2029,"num_whiteouts":1023,"num_read":414091,"num_read_kb":1454040,"num_write":25644,"num_write_kb":495486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3139,"num_bytes_recovered":192374844,"num_keys_recovered":743,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22342,"ondisk_log_size":22342,"up":82,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":521532,"kb_used_data":234636,"kb_used_omap":30,"kb_used_meta":286753,"kb_avail":471337668,"statfs":{"total":483183820800,"available":482649772032,"internally_reserved":0,"allocated":240267264,"data_stored":285883972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31300,"internal_metadata":293635516},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,1],"upper_bound":4096},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-131763099,"num_objects":-253,"num_object_clones":-112,"num_object_copies":-506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":161,"num_objects_misplaced":57,"num_objects_unfound":0,"num_objects_dirty":-253,"num_whiteouts":-99,"num_read":536,"num_read_kb":456,"num_write":120,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":668246,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.977698"},"pg_stats":[{"pgid":"3.1f","version":"120'710","reported_seq":6052,"reported_epoch":122,"state":"remapped+peering","last_fresh":"2024-09-14T09:09:53.820989+0000","last_change":"2024-09-14T09:09:53.820989+0000","last_active":"2024-09-14T09:09:52.817916+0000","last_peered":"2024-09-14T09:09:51.888204+0000","last_clean":"2024-09-14T09:09:51.888204+0000","last_became_active":"2024-09-14T09:09:02.793185+0000","last_became_peered":"2024-09-14T09:09:02.793185+0000","last_unstale":"2024-09-14T09:09:53.820989+0000","last_undegraded":"2024-09-14T09:09:53.820989+0000","last_fullsized":"2024-09-14T09:09:53.820989+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071657100000000005,"stat_sum":{"num_bytes":36643344,"num_objects":71,"num_object_clones":13,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":32,"num_read":6424,"num_read_kb":42400,"num_write":935,"num_write_kb":16264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":12011552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1f","length":"8"}]},{"pgid":"3.1e","version":"121'435","reported_seq":7684,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-14T09:09:53.819844+0000","last_change":"2024-09-14T09:09:52.829460+0000","last_active":"2024-09-14T09:09:53.819844+0000","last_peered":"2024-09-14T09:09:53.819844+0000","last_clean":"2024-09-14T09:09:53.819844+0000","last_became_active":"2024-09-14T09:09:02.797062+0000","last_became_peered":"2024-09-14T09:09:02.797062+0000","last_unstale":"2024-09-14T09:09:53.819844+0000","last_undegraded":"2024-09-14T09:09:53.819844+0000","last_fullsized":"2024-09-14T09:09:53.819844+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:31.756392+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.012223970000000001,"stat_sum":{"num_bytes":19369504,"num_objects":56,"num_object_clones":4,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":29,"num_read":7541,"num_read_kb":35880,"num_write":420,"num_write_kb":5523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":7376960,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1e","length":"9"}]},{"pgid":"3.1d","version":"121'602","reported_seq":6357,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-14T09:09:54.822126+0000","last_change":"2024-09-14T09:09:52.841203+0000","last_active":"2024-09-14T09:09:54.822126+0000","last_peered":"2024-09-14T09:09:54.822126+0000","last_clean":"2024-09-14T09:09:54.822126+0000","last_became_active":"2024-09-14T09:09:17.797408+0000","last_became_peered":"2024-09-14T09:09:17.797408+0000","last_unstale":"2024-09-14T09:09:54.822126+0000","last_undegraded":"2024-09-14T09:09:54.822126+0000","last_fullsized":"2024-09-14T09:09:54.822126+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:09.473683+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.024910516000000001,"stat_sum":{"num_bytes":47178799,"num_objects":62,"num_object_clones":8,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":26,"num_read":9940,"num_read_kb":74590,"num_write":664,"num_write_kb":20026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":31416461,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1e","length":"9"}]},{"pgid":"3.1c","version":"120'683","reported_seq":5638,"reported_epoch":121,"state":"remapped+peering","last_fresh":"2024-09-14T09:09:52.821503+0000","last_change":"2024-09-14T09:09:53.820914+0000","last_active":"2024-09-14T09:09:52.821503+0000","last_peered":"2024-09-14T09:09:51.911810+0000","last_clean":"2024-09-14T09:09:51.911810+0000","last_became_active":"2024-09-14T09:09:03.796622+0000","last_became_peered":"2024-09-14T09:09:03.796622+0000","last_unstale":"2024-09-14T09:09:52.821503+0000","last_undegraded":"2024-09-14T09:09:52.821503+0000","last_fullsized":"2024-09-14T09:09:52.821503+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031541906000000001,"stat_sum":{"num_bytes":8827865,"num_objects":64,"num_object_clones":6,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":40,"num_read":7361,"num_read_kb":20623,"num_write":699,"num_write_kb":12454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":1486129,"num_keys_recovered":177,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1f","length":"8"}]},{"pgid":"3.1b","version":"121'668","reported_seq":5772,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-14T09:09:52.829870+0000","last_change":"2024-09-14T09:09:52.830257+0000","last_active":"2024-09-14T09:09:52.829870+0000","last_peered":"2024-09-14T09:09:52.829870+0000","last_clean":"2024-09-14T09:09:52.829870+0000","last_became_active":"2024-09-14T09:09:03.794248+0000","last_became_peered":"2024-09-14T09:09:03.794248+0000","last_unstale":"2024-09-14T09:09:52.829870+0000","last_undegraded":"2024-09-14T09:09:52.829870+0000","last_fullsized":"2024-09-14T09:09:52.829870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":668,"log_dups_size":0,"ondisk_log_size":668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:03.603879+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011178224,"stat_sum":{"num_bytes":41385088,"num_objects":58,"num_object_clones":10,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":27,"num_read":6790,"num_read_kb":42435,"num_write":915,"num_write_kb":14368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":16991946,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"9"}]},{"pgid":"3.1a","version":"120'1018","reported_seq":45088,"reported_epoch":121,"state":"remapped+peering","last_fresh":"2024-09-14T09:09:52.819637+0000","last_change":"2024-09-14T09:09:53.820374+0000","last_active":"2024-09-14T09:09:52.819637+0000","last_peered":"2024-09-14T09:09:51.926252+0000","last_clean":"2024-09-14T09:09:51.926252+0000","last_became_active":"2024-09-14T09:09:03.795736+0000","last_became_peered":"2024-09-14T09:09:03.795736+0000","last_unstale":"2024-09-14T09:09:52.819637+0000","last_undegraded":"2024-09-14T09:09:52.819637+0000","last_fullsized":"2024-09-14T09:09:52.819637+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.026545571,"stat_sum":{"num_bytes":36295755,"num_objects":61,"num_object_clones":5,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":26,"num_read":45931,"num_read_kb":91760,"num_write":971,"num_write_kb":40119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":11112086,"num_keys_recovered":47,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1f","length":"8"}]},{"pgid":"3.19","version":"121'476","reported_seq":8202,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-14T09:09:52.829486+0000","last_change":"2024-09-14T09:09:52.829830+0000","last_active":"2024-09-14T09:09:52.829486+0000","last_peered":"2024-09-14T09:09:52.829486+0000","last_clean":"2024-09-14T09:09:52.829486+0000","last_became_active":"2024-09-14T09:07:45.291261+0000","last_became_peered":"2024-09-14T09:07:45.291261+0000","last_unstale":"2024-09-14T09:09:52.829486+0000","last_undegraded":"2024-09-14T09:09:52.829486+0000","last_fullsized":"2024-09-14T09:09:52.829486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:35.087599+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.014984900000000001,"stat_sum":{"num_bytes":48233808,"num_objects":67,"num_object_clones":8,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":34,"num_read":8013,"num_read_kb":52352,"num_write":621,"num_write_kb":14128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"9"}]},{"pgid":"3.18","version":"121'752","reported_seq":5953,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-14T09:09:52.822471+0000","last_change":"2024-09-14T09:09:52.822471+0000","last_active":"2024-09-14T09:09:52.822471+0000","last_peered":"2024-09-14T09:09:52.822471+0000","last_clean":"2024-09-14T09:09:52.822471+0000","last_became_active":"2024-09-14T09:07:45.290340+0000","last_became_peered":"2024-09-14T09:07:45.290340+0000","last_unstale":"2024-09-14T09:09:52.822471+0000","last_undegraded":"2024-09-14T09:09:52.822471+0000","last_fullsized":"2024-09-14T09:09:52.822471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:20:29.368445+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0078234629999999993,"stat_sum":{"num_bytes":9953883,"num_objects":52,"num_object_clones":4,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":23,"num_read":7211,"num_read_kb":25019,"num_write":1046,"num_write_kb":4335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"9"}]},{"pgid":"3.17","version":"120'778","reported_seq":71364,"reported_epoch":122,"state":"remapped+peering","last_fresh":"2024-09-14T09:09:53.822078+0000","last_change":"2024-09-14T09:09:53.822078+0000","last_active":"2024-09-14T09:09:52.819205+0000","last_peered":"2024-09-14T09:09:51.805563+0000","last_clean":"2024-09-14T09:09:51.805563+0000","last_became_active":"2024-09-14T09:09:02.793317+0000","last_became_peered":"2024-09-14T09:09:02.793317+0000","last_unstale":"2024-09-14T09:09:53.822078+0000","last_undegraded":"2024-09-14T09:09:53.822078+0000","last_fullsized":"2024-09-14T09:09:53.822078+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0094860499999999993,"stat_sum":{"num_bytes":57619998,"num_objects":74,"num_object_clones":12,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":36,"num_read":74204,"num_read_kb":113571,"num_write":950,"num_write_kb":72678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":20495962,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1f","length":"8"}]},{"pgid":"3.16","version":"120'517","reported_seq":21138,"reported_epoch":120,"state":"peering","last_fresh":"2024-09-14T09:09:51.882102+0000","last_change":"2024-09-14T09:09:52.820592+0000","last_active":"2024-09-14T09:09:52.820592+0000","last_peered":"2024-09-14T09:09:51.882102+0000","last_clean":"2024-09-14T09:09:51.882102+0000","last_became_active":"2024-09-14T09:08:32.785844+0000","last_became_peered":"2024-09-14T09:08:32.785844+0000","last_unstale":"2024-09-14T09:09:51.882102+0000","last_undegraded":"2024-09-14T09:09:51.882102+0000","last_fullsized":"2024-09-14T09:09:51.882102+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0063404250000000002,"stat_sum":{"num_bytes":29418496,"num_objects":59,"num_object_clones":10,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":34,"num_read":21018,"num_read_kb":58767,"num_write":555,"num_write_kb":35397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":49,"num_bytes_recovered":2796544,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"8"}]},{"pgid":"3.15","version":"121'871","reported_seq":56716,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-14T09:09:57.110274+0000","last_change":"2024-09-14T09:09:55.848908+0000","last_active":"2024-09-14T09:09:57.110274+0000","last_peered":"2024-09-14T09:09:57.110274+0000","last_clean":"2024-09-14T09:09:57.110274+0000","last_became_active":"2024-09-14T09:07:45.293650+0000","last_became_peered":"2024-09-14T09:07:45.293650+0000","last_unstale":"2024-09-14T09:09:57.110274+0000","last_undegraded":"2024-09-14T09:09:57.110274+0000","last_fullsized":"2024-09-14T09:09:57.110274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:23.033700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068537000000000003,"stat_sum":{"num_bytes":12662869,"num_objects":52,"num_object_clones":5,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":29,"num_read":27355,"num_read_kb":68429,"num_write":723,"num_write_kb":21024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1d","length":"a"}]},{"pgid":"3.14","version":"121'587","reported_seq":5883,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-14T09:09:53.821911+0000","last_change":"2024-09-14T09:09:52.843345+0000","last_active":"2024-09-14T09:09:53.821911+0000","last_peered":"2024-09-14T09:09:53.821911+0000","last_clean":"2024-09-14T09:09:53.821911+0000","last_became_active":"2024-09-14T09:09:19.878805+0000","last_became_peered":"2024-09-14T09:09:19.878805+0000","last_unstale":"2024-09-14T09:09:53.821911+0000","last_undegraded":"2024-09-14T09:09:53.821911+0000","last_fullsized":"2024-09-14T09:09:53.821911+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:00.889343+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.025000644999999998,"stat_sum":{"num_bytes":24882283,"num_objects":55,"num_object_clones":7,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":31,"num_read":7545,"num_read_kb":24364,"num_write":568,"num_write_kb":4277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":4454614,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1e","length":"9"}]},{"pgid":"2.7","version":"0'0","reported_seq":103,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-14T09:09:53.821522+0000","last_change":"2024-09-14T09:08:59.862372+0000","last_active":"2024-09-14T09:09:53.821522+0000","last_peered":"2024-09-14T09:09:53.821522+0000","last_clean":"2024-09-14T09:09:53.821522+0000","last_became_active":"2024-09-14T09:08:59.862110+0000","last_became_peered":"2024-09-14T09:08:59.862110+0000","last_unstale":"2024-09-14T09:09:53.821522+0000","last_undegraded":"2024-09-14T09:09:53.821522+0000","last_fullsized":"2024-09-14T09:09:53.821522+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:19.095016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061552199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"121'594","reported_seq":4900,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-14T09:09:52.830139+0000","last_change":"2024-09-14T09:09:52.830824+0000","last_active":"2024-09-14T09:09:52.830139+0000","last_peered":"2024-09-14T09:09:52.830139+0000","last_clean":"2024-09-14T09:09:52.830139+0000","last_became_active":"2024-09-14T09:07:45.290675+0000","last_became_peered":"2024-09-14T09:07:45.290675+0000","last_unstale":"2024-09-14T09:09:52.830139+0000","last_undegraded":"2024-09-14T09:09:52.830139+0000","last_fullsized":"2024-09-14T09:09:52.830139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:45.564995+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.015970544,"stat_sum":{"num_bytes":10632320,"num_objects":59,"num_object_clones":5,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":35,"num_read":6513,"num_read_kb":15308,"num_write":477,"num_write_kb":3566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"9"}]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-14T09:09:52.814896+0000","last_change":"2024-09-14T09:08:28.924279+0000","last_active":"2024-09-14T09:09:52.814896+0000","last_peered":"2024-09-14T09:09:52.814896+0000","last_clean":"2024-09-14T09:09:52.814896+0000","last_became_active":"2024-09-14T09:08:28.923956+0000","last_became_peered":"2024-09-14T09:08:28.923956+0000","last_unstale":"2024-09-14T09:09:52.814896+0000","last_undegraded":"2024-09-14T09:09:52.814896+0000","last_fullsized":"2024-09-14T09:09:52.814896+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:10:28.827669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042190199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"121'679","reported_seq":8060,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-14T09:09:52.834443+0000","last_change":"2024-09-14T09:09:52.834756+0000","last_active":"2024-09-14T09:09:52.834443+0000","last_peered":"2024-09-14T09:09:52.834443+0000","last_clean":"2024-09-14T09:09:52.834443+0000","last_became_active":"2024-09-14T09:07:45.290313+0000","last_became_peered":"2024-09-14T09:07:45.290313+0000","last_unstale":"2024-09-14T09:09:52.834443+0000","last_undegraded":"2024-09-14T09:09:52.834443+0000","last_fullsized":"2024-09-14T09:09:52.834443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:31.600032+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.019750329,"stat_sum":{"num_bytes":16955628,"num_objects":58,"num_object_clones":5,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":29,"num_read":8980,"num_read_kb":43356,"num_write":795,"num_write_kb":5614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"9"}]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-14T09:09:53.821522+0000","last_change":"2024-09-14T09:08:59.862420+0000","last_active":"2024-09-14T09:09:53.821522+0000","last_peered":"2024-09-14T09:09:53.821522+0000","last_clean":"2024-09-14T09:09:53.821522+0000","last_became_active":"2024-09-14T09:08:59.862144+0000","last_became_peered":"2024-09-14T09:08:59.862144+0000","last_unstale":"2024-09-14T09:09:53.821522+0000","last_undegraded":"2024-09-14T09:09:53.821522+0000","last_fullsized":"2024-09-14T09:09:53.821522+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:46.664994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"120'964","reported_seq":6103,"reported_epoch":121,"state":"unknown","last_fresh":"2024-09-14T09:09:52.815516+0000","last_change":"2024-09-14T09:09:53.210140+0000","last_active":"2024-09-14T09:09:52.815516+0000","last_peered":"2024-09-14T09:09:51.881722+0000","last_clean":"2024-09-14T09:09:51.881722+0000","last_became_active":"2024-09-14T09:07:45.294376+0000","last_became_peered":"2024-09-14T09:07:45.294376+0000","last_unstale":"2024-09-14T09:09:52.815516+0000","last_undegraded":"2024-09-14T09:09:52.815516+0000","last_fullsized":"2024-09-14T09:09:52.815516+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":964,"log_dups_size":0,"ondisk_log_size":964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.019700405000000001,"stat_sum":{"num_bytes":22085784,"num_objects":77,"num_object_clones":13,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":41,"num_read":7886,"num_read_kb":40026,"num_write":1405,"num_write_kb":11551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1f","length":"8"}]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-14T09:09:54.821852+0000","last_change":"2024-09-14T09:09:53.824239+0000","last_active":"2024-09-14T09:09:54.821852+0000","last_peered":"2024-09-14T09:09:54.821852+0000","last_clean":"2024-09-14T09:09:54.821852+0000","last_became_active":"2024-09-14T09:09:53.823821+0000","last_became_peered":"2024-09-14T09:09:53.823821+0000","last_unstale":"2024-09-14T09:09:54.821852+0000","last_undegraded":"2024-09-14T09:09:54.821852+0000","last_fullsized":"2024-09-14T09:09:54.821852+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:52.230246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"121'743","reported_seq":9385,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-14T09:09:54.822023+0000","last_change":"2024-09-14T09:09:52.841132+0000","last_active":"2024-09-14T09:09:54.822023+0000","last_peered":"2024-09-14T09:09:54.822023+0000","last_clean":"2024-09-14T09:09:54.822023+0000","last_became_active":"2024-09-14T09:09:19.870716+0000","last_became_peered":"2024-09-14T09:09:19.870716+0000","last_unstale":"2024-09-14T09:09:54.822023+0000","last_undegraded":"2024-09-14T09:09:54.822023+0000","last_fullsized":"2024-09-14T09:09:54.822023+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:36.636064+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.025100746,"stat_sum":{"num_bytes":29963980,"num_objects":68,"num_object_clones":8,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":32,"num_read":11440,"num_read_kb":51086,"num_write":662,"num_write_kb":9345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":2441232,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1e","length":"9"}]},{"pgid":"3.3","version":"121'1359","reported_seq":10734,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-14T09:09:54.821827+0000","last_change":"2024-09-14T09:09:52.834196+0000","last_active":"2024-09-14T09:09:54.821827+0000","last_peered":"2024-09-14T09:09:54.821827+0000","last_clean":"2024-09-14T09:09:54.821827+0000","last_became_active":"2024-09-14T09:09:19.869813+0000","last_became_peered":"2024-09-14T09:09:19.869813+0000","last_unstale":"2024-09-14T09:09:54.821827+0000","last_undegraded":"2024-09-14T09:09:54.821827+0000","last_fullsized":"2024-09-14T09:09:54.821827+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1359,"log_dups_size":0,"ondisk_log_size":1359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:04:58.979775+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.01843962,"stat_sum":{"num_bytes":17768675,"num_objects":61,"num_object_clones":3,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":31,"num_read":15801,"num_read_kb":41180,"num_write":1774,"num_write_kb":7096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":2340129,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1e","length":"9"}]},{"pgid":"2.2","version":"20'2","reported_seq":233,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-14T09:09:57.110270+0000","last_change":"2024-09-14T09:07:37.260986+0000","last_active":"2024-09-14T09:09:57.110270+0000","last_peered":"2024-09-14T09:09:57.110270+0000","last_clean":"2024-09-14T09:09:57.110270+0000","last_became_active":"2024-09-14T09:07:35.254256+0000","last_became_peered":"2024-09-14T09:07:35.254256+0000","last_unstale":"2024-09-14T09:09:57.110270+0000","last_undegraded":"2024-09-14T09:09:57.110270+0000","last_fullsized":"2024-09-14T09:09:57.110270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:07.063058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096898500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"120'417","reported_seq":9969,"reported_epoch":123,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-14T09:09:54.854772+0000","last_change":"2024-09-14T09:09:54.846986+0000","last_active":"2024-09-14T09:09:54.854772+0000","last_peered":"2024-09-14T09:09:54.854772+0000","last_clean":"2024-09-14T09:09:51.874709+0000","last_became_active":"2024-09-14T09:09:54.838008+0000","last_became_peered":"2024-09-14T09:09:54.838008+0000","last_unstale":"2024-09-14T09:09:54.854772+0000","last_undegraded":"2024-09-14T09:09:54.854772+0000","last_fullsized":"2024-09-14T09:09:54.821475+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0051835689999999999,"stat_sum":{"num_bytes":36776006,"num_objects":61,"num_object_clones":12,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":57,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":24,"num_read":9580,"num_read_kb":58824,"num_write":496,"num_write_kb":14686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":1489715,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2],"avail_no_missing":["2","5"],"object_location_counts":[{"shards":"2","objects":4},{"shards":"2,5","objects":57}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"8"}]},{"pgid":"2.1","version":"0'0","reported_seq":2,"reported_epoch":121,"state":"peering","last_fresh":"2024-09-14T09:07:45.289486+0000","last_change":"2024-09-14T09:07:44.283617+0000","last_active":"2024-09-14T09:07:34.236582+0000","last_peered":"2024-09-14T09:07:34.236582+0000","last_clean":"2024-09-14T09:07:34.236582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-14T09:07:45.289486+0000","last_undegraded":"2024-09-14T09:07:45.289486+0000","last_fullsized":"2024-09-14T09:07:45.289486+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"121'726","reported_seq":6316,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-14T09:09:52.836553+0000","last_change":"2024-09-14T09:09:52.836553+0000","last_active":"2024-09-14T09:09:52.836553+0000","last_peered":"2024-09-14T09:09:52.836553+0000","last_clean":"2024-09-14T09:09:52.836553+0000","last_became_active":"2024-09-14T09:08:30.922755+0000","last_became_peered":"2024-09-14T09:08:30.922755+0000","last_unstale":"2024-09-14T09:09:52.836553+0000","last_undegraded":"2024-09-14T09:09:52.836553+0000","last_fullsized":"2024-09-14T09:09:52.836553+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:09.123824+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.021286065999999999,"stat_sum":{"num_bytes":52856356,"num_objects":59,"num_object_clones":9,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":25,"num_read":7593,"num_read_kb":31770,"num_write":856,"num_write_kb":10923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":49,"num_bytes_recovered":230948,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"9"}]},{"pgid":"2.0","version":"0'0","reported_seq":194,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-14T09:09:54.821377+0000","last_change":"2024-09-14T09:09:53.824803+0000","last_active":"2024-09-14T09:09:54.821377+0000","last_peered":"2024-09-14T09:09:54.821377+0000","last_clean":"2024-09-14T09:09:54.821377+0000","last_became_active":"2024-09-14T09:09:53.824503+0000","last_became_peered":"2024-09-14T09:09:53.824503+0000","last_unstale":"2024-09-14T09:09:54.821377+0000","last_undegraded":"2024-09-14T09:09:54.821377+0000","last_fullsized":"2024-09-14T09:09:54.821377+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:00.876142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"121'404","reported_seq":1832,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-14T09:09:54.821644+0000","last_change":"2024-09-14T09:09:52.833038+0000","last_active":"2024-09-14T09:09:54.821644+0000","last_peered":"2024-09-14T09:09:54.821644+0000","last_clean":"2024-09-14T09:09:54.821644+0000","last_became_active":"2024-09-14T09:09:16.794591+0000","last_became_peered":"2024-09-14T09:09:16.794591+0000","last_unstale":"2024-09-14T09:09:54.821644+0000","last_undegraded":"2024-09-14T09:09:54.821644+0000","last_fullsized":"2024-09-14T09:09:54.821644+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:21.749188+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.017285134000000001,"stat_sum":{"num_bytes":37933271,"num_objects":62,"num_object_clones":8,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":35,"num_read":3100,"num_read_kb":25085,"num_write":375,"num_write_kb":10842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":1975296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1e","length":"9"}]},{"pgid":"2.3","version":"18'1","reported_seq":111,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-14T09:09:53.821366+0000","last_change":"2024-09-14T09:09:17.798249+0000","last_active":"2024-09-14T09:09:53.821366+0000","last_peered":"2024-09-14T09:09:53.821366+0000","last_clean":"2024-09-14T09:09:53.821366+0000","last_became_active":"2024-09-14T09:09:17.797925+0000","last_became_peered":"2024-09-14T09:09:17.797925+0000","last_unstale":"2024-09-14T09:09:53.821366+0000","last_undegraded":"2024-09-14T09:09:53.821366+0000","last_fullsized":"2024-09-14T09:09:53.821366+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:22.149422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":121,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-14T09:09:53.842701+0000","last_change":"2024-09-14T09:09:53.842602+0000","last_active":"2024-09-14T09:09:53.842701+0000","last_peered":"2024-09-14T09:09:53.842701+0000","last_clean":"2024-09-14T09:09:53.842701+0000","last_became_active":"2024-09-14T09:09:53.826122+0000","last_became_peered":"2024-09-14T09:09:53.826122+0000","last_unstale":"2024-09-14T09:09:53.842701+0000","last_undegraded":"2024-09-14T09:09:53.842701+0000","last_fullsized":"2024-09-14T09:09:53.842701+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_clean_scrub_stamp":"2024-09-14T09:07:29.211432+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:23:08.636902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"121'620","reported_seq":9247,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-14T09:09:52.825084+0000","last_change":"2024-09-14T09:09:52.825432+0000","last_active":"2024-09-14T09:09:52.825084+0000","last_peered":"2024-09-14T09:09:52.825084+0000","last_clean":"2024-09-14T09:09:52.825084+0000","last_became_active":"2024-09-14T09:08:33.788711+0000","last_became_peered":"2024-09-14T09:08:33.788711+0000","last_unstale":"2024-09-14T09:09:52.825084+0000","last_undegraded":"2024-09-14T09:09:52.825084+0000","last_fullsized":"2024-09-14T09:09:52.825084+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:05.026032+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.010782666999999999,"stat_sum":{"num_bytes":43955269,"num_objects":59,"num_object_clones":4,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":29,"num_read":10682,"num_read_kb":52436,"num_write":521,"num_write_kb":14203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":2555973,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"9"}]},{"pgid":"3.9","version":"121'492","reported_seq":6749,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-14T09:09:52.836979+0000","last_change":"2024-09-14T09:09:52.837467+0000","last_active":"2024-09-14T09:09:52.836979+0000","last_peered":"2024-09-14T09:09:52.836979+0000","last_clean":"2024-09-14T09:09:52.836979+0000","last_became_active":"2024-09-14T09:09:16.800864+0000","last_became_peered":"2024-09-14T09:09:16.800864+0000","last_unstale":"2024-09-14T09:09:52.836979+0000","last_undegraded":"2024-09-14T09:09:52.836979+0000","last_fullsized":"2024-09-14T09:09:52.836979+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:59.680166+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.019834239,"stat_sum":{"num_bytes":53336080,"num_objects":70,"num_object_clones":9,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":36,"num_read":5988,"num_read_kb":50678,"num_write":451,"num_write_kb":15575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":3599888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"9"}]},{"pgid":"3.a","version":"124'820","reported_seq":7795,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-14T09:09:57.110315+0000","last_change":"2024-09-14T09:09:55.850848+0000","last_active":"2024-09-14T09:09:57.110315+0000","last_peered":"2024-09-14T09:09:57.110315+0000","last_clean":"2024-09-14T09:09:57.110315+0000","last_became_active":"2024-09-14T09:09:02.793112+0000","last_became_peered":"2024-09-14T09:09:02.793112+0000","last_unstale":"2024-09-14T09:09:57.110315+0000","last_undegraded":"2024-09-14T09:09:57.110315+0000","last_fullsized":"2024-09-14T09:09:57.110315+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:18.392133+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0038224790000000002,"stat_sum":{"num_bytes":34747630,"num_objects":67,"num_object_clones":4,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":36,"num_read":8737,"num_read_kb":44654,"num_write":1015,"num_write_kb":15893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":9779638,"num_keys_recovered":46,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1d","length":"a"}]},{"pgid":"3.b","version":"121'424","reported_seq":4992,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-14T09:09:52.832940+0000","last_change":"2024-09-14T09:09:52.833333+0000","last_active":"2024-09-14T09:09:52.832940+0000","last_peered":"2024-09-14T09:09:52.832940+0000","last_clean":"2024-09-14T09:09:52.832940+0000","last_became_active":"2024-09-14T09:08:30.922780+0000","last_became_peered":"2024-09-14T09:08:30.922780+0000","last_unstale":"2024-09-14T09:09:52.832940+0000","last_undegraded":"2024-09-14T09:09:52.832940+0000","last_fullsized":"2024-09-14T09:09:52.832940+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:47.604469+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.018227525000000001,"stat_sum":{"num_bytes":10296623,"num_objects":58,"num_object_clones":6,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":29,"num_read":4716,"num_read_kb":18669,"num_write":451,"num_write_kb":6044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":540832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"9"}]},{"pgid":"3.c","version":"121'856","reported_seq":16875,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-14T09:09:53.821604+0000","last_change":"2024-09-14T09:09:52.834210+0000","last_active":"2024-09-14T09:09:53.821604+0000","last_peered":"2024-09-14T09:09:53.821604+0000","last_clean":"2024-09-14T09:09:53.821604+0000","last_became_active":"2024-09-14T09:09:03.794861+0000","last_became_peered":"2024-09-14T09:09:03.794861+0000","last_unstale":"2024-09-14T09:09:53.821604+0000","last_undegraded":"2024-09-14T09:09:53.821604+0000","last_fullsized":"2024-09-14T09:09:53.821604+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":856,"log_dups_size":0,"ondisk_log_size":856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:07.031949+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.016128298999999999,"stat_sum":{"num_bytes":37189120,"num_objects":59,"num_object_clones":9,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":32,"num_read":12978,"num_read_kb":46172,"num_write":856,"num_write_kb":9931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":13533184,"num_keys_recovered":116,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1e","length":"9"}]},{"pgid":"3.d","version":"121'487","reported_seq":21007,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-14T09:09:53.821630+0000","last_change":"2024-09-14T09:09:52.844254+0000","last_active":"2024-09-14T09:09:53.821630+0000","last_peered":"2024-09-14T09:09:53.821630+0000","last_clean":"2024-09-14T09:09:53.821630+0000","last_became_active":"2024-09-14T09:09:03.794231+0000","last_became_peered":"2024-09-14T09:09:03.794231+0000","last_unstale":"2024-09-14T09:09:53.821630+0000","last_undegraded":"2024-09-14T09:09:53.821630+0000","last_fullsized":"2024-09-14T09:09:53.821630+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:09.707611+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.024816185000000001,"stat_sum":{"num_bytes":48852992,"num_objects":59,"num_object_clones":6,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":33,"num_read":21382,"num_read_kb":52622,"num_write":606,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":140,"num_bytes_recovered":16325120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1e","length":"9"}]},{"pgid":"3.e","version":"120'483","reported_seq":3186,"reported_epoch":123,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-14T09:09:54.839481+0000","last_change":"2024-09-14T09:09:54.839723+0000","last_active":"2024-09-14T09:09:54.839481+0000","last_peered":"2024-09-14T09:09:54.839481+0000","last_clean":"2024-09-14T09:09:51.880309+0000","last_became_active":"2024-09-14T09:09:54.837766+0000","last_became_peered":"2024-09-14T09:09:54.837766+0000","last_unstale":"2024-09-14T09:09:54.839481+0000","last_undegraded":"2024-09-14T09:09:54.823434+0000","last_fullsized":"2024-09-14T09:09:54.821890+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.025805682,"stat_sum":{"num_bytes":34475536,"num_objects":82,"num_object_clones":18,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":161,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":40,"num_read":5228,"num_read_kb":39381,"num_write":435,"num_write_kb":12180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":6536208,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2],"avail_no_missing":["2","5"],"object_location_counts":[{"shards":"2,5","objects":82}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"8"}]},{"pgid":"3.f","version":"121'354","reported_seq":3381,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-14T09:09:53.821391+0000","last_change":"2024-09-14T09:09:52.835058+0000","last_active":"2024-09-14T09:09:53.821391+0000","last_peered":"2024-09-14T09:09:53.821391+0000","last_clean":"2024-09-14T09:09:53.821391+0000","last_became_active":"2024-09-14T09:09:02.795740+0000","last_became_peered":"2024-09-14T09:09:02.795740+0000","last_unstale":"2024-09-14T09:09:53.821391+0000","last_undegraded":"2024-09-14T09:09:53.821391+0000","last_fullsized":"2024-09-14T09:09:53.821391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:01.887377+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.016807334,"stat_sum":{"num_bytes":7353411,"num_objects":61,"num_object_clones":8,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":32,"num_read":2149,"num_read_kb":13854,"num_write":319,"num_write_kb":3973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":1385641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1e","length":"9"}]},{"pgid":"3.10","version":"120'520","reported_seq":9463,"reported_epoch":121,"state":"remapped+peering","last_fresh":"2024-09-14T09:09:52.821165+0000","last_change":"2024-09-14T09:09:53.820229+0000","last_active":"2024-09-14T09:09:52.821165+0000","last_peered":"2024-09-14T09:09:51.880848+0000","last_clean":"2024-09-14T09:09:51.880848+0000","last_became_active":"2024-09-14T09:09:03.795643+0000","last_became_peered":"2024-09-14T09:09:03.795643+0000","last_unstale":"2024-09-14T09:09:52.821165+0000","last_undegraded":"2024-09-14T09:09:52.821165+0000","last_fullsized":"2024-09-14T09:09:52.821165+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.005188621,"stat_sum":{"num_bytes":31016505,"num_objects":71,"num_object_clones":11,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":37,"num_read":9676,"num_read_kb":41428,"num_write":681,"num_write_kb":14542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":140,"num_bytes_recovered":3992690,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,5],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1f","length":"8"}]},{"pgid":"3.11","version":"121'739","reported_seq":9712,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-14T09:09:53.820403+0000","last_change":"2024-09-14T09:09:52.832153+0000","last_active":"2024-09-14T09:09:53.820403+0000","last_peered":"2024-09-14T09:09:53.820403+0000","last_clean":"2024-09-14T09:09:53.820403+0000","last_became_active":"2024-09-14T09:09:02.793611+0000","last_became_peered":"2024-09-14T09:09:02.793611+0000","last_unstale":"2024-09-14T09:09:53.820403+0000","last_undegraded":"2024-09-14T09:09:53.820403+0000","last_fullsized":"2024-09-14T09:09:53.820403+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:45.248667+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.015135722000000001,"stat_sum":{"num_bytes":39249122,"num_objects":65,"num_object_clones":10,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":36,"num_read":12245,"num_read_kb":58400,"num_write":633,"num_write_kb":13814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":10373286,"num_keys_recovered":102,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1e","length":"9"}]},{"pgid":"3.12","version":"111'429","reported_seq":4659,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-14T09:09:47.795859+0000","last_change":"2024-09-14T09:09:47.796262+0000","last_active":"2024-09-14T09:09:47.795859+0000","last_peered":"2024-09-14T09:09:47.795859+0000","last_clean":"2024-09-14T09:09:47.795859+0000","last_became_active":"2024-09-14T09:08:31.785088+0000","last_became_peered":"2024-09-14T09:08:31.785088+0000","last_unstale":"2024-09-14T09:09:47.795859+0000","last_undegraded":"2024-09-14T09:09:47.795859+0000","last_fullsized":"2024-09-14T09:09:47.795859+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:30.161044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014760680000000001,"stat_sum":{"num_bytes":41771055,"num_objects":79,"num_object_clones":13,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":41,"num_read":3991,"num_read_kb":34356,"num_write":382,"num_write_kb":6924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":1209903,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"23","length":"6"}]},{"pgid":"3.13","version":"121'2060","reported_seq":8471,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-14T09:09:53.821271+0000","last_change":"2024-09-14T09:09:52.842375+0000","last_active":"2024-09-14T09:09:53.821271+0000","last_peered":"2024-09-14T09:09:53.821271+0000","last_clean":"2024-09-14T09:09:53.821271+0000","last_became_active":"2024-09-14T09:09:03.794283+0000","last_became_peered":"2024-09-14T09:09:03.794283+0000","last_unstale":"2024-09-14T09:09:53.821271+0000","last_undegraded":"2024-09-14T09:09:53.821271+0000","last_fullsized":"2024-09-14T09:09:53.821271+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":2060,"log_dups_size":0,"ondisk_log_size":2060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:51.104999+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.023925065999999998,"stat_sum":{"num_bytes":24050730,"num_objects":59,"num_object_clones":7,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":23,"num_read":16027,"num_read_kb":44510,"num_write":3284,"num_write_kb":14817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":4151803,"num_keys_recovered":53,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1e","length":"9"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1003737785,"num_objects":2025,"num_object_clones":260,"num_object_copies":4050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":161,"num_objects_misplaced":57,"num_objects_unfound":0,"num_objects_dirty":2025,"num_whiteouts":1023,"num_read":414025,"num_read_kb":1453985,"num_write":25541,"num_write_kb":493856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3132,"num_bytes_recovered":190603740,"num_keys_recovered":743,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":285614080,"data_stored":349314418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12266,"internal_metadata":0},"log_size":22267,"ondisk_log_size":22267,"up":64,"acting":57,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":87,"seq":373662154761,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73028,"kb_used_data":39984,"kb_used_omap":24,"kb_used_meta":32999,"kb_avail":94298812,"statfs":{"total":96636764160,"available":96561983488,"internally_reserved":0,"allocated":40943616,"data_stored":48618351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24922,"internal_metadata":33791654},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149504,"kb_used_data":78060,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94222336,"statfs":{"total":96636764160,"available":96483672064,"internally_reserved":0,"allocated":79933440,"data_stored":96123883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,1],"upper_bound":4096},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":0,"seq":51539607584,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607586,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91676,"kb_used_data":34112,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94280164,"statfs":{"total":96636764160,"available":96542887936,"internally_reserved":0,"allocated":34930688,"data_stored":38809812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607584,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120896,"kb_used_data":71660,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94250944,"statfs":{"total":96636764160,"available":96512966656,"internally_reserved":0,"allocated":73379840,"data_stored":88685169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640289,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86428,"kb_used_data":10820,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94285412,"statfs":{"total":96636764160,"available":96548261888,"internally_reserved":0,"allocated":11079680,"data_stored":13646757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9609216,"data_stored":13037421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77897728,"data_stored":94935042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":39202816,"data_stored":47983494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12266,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":70221824,"data_stored":86247528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":33497088,"data_stored":38216813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":55185408,"data_stored":68894120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T09:09:58.619 INFO:tasks.thrashosds.thrasher:Setting 3.1c to [1, 5, 0, 3] 2024-09-14T09:09:58.619 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.1c', '1', '5', '0', '3'] 2024-09-14T09:09:58.619 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.1c 1 5 0 3 2024-09-14T09:09:58.685 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:09:58.685 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:09:58.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:09:58.685 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:09:58.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.685 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:987 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:58.685 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:58.685 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.827986406000001, 2024-09-14T09:09:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001359466, 2024-09-14T09:09:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 987 2024-09-14T09:09:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:58.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:09:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858333+0000", 2024-09-14T09:09:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.621e-06 2024-09-14T09:09:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858349+0000", 2024-09-14T09:09:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5758000000000001e-05 2024-09-14T09:09:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858366+0000", 2024-09-14T09:09:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7368e-05 2024-09-14T09:09:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858382+0000", 2024-09-14T09:09:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6039e-05 2024-09-14T09:09:58.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858441+0000", 2024-09-14T09:09:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8662999999999997e-05 2024-09-14T09:09:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858449+0000", 2024-09-14T09:09:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3960000000000006e-06 2024-09-14T09:09:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859682+0000", 2024-09-14T09:09:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001233096 2024-09-14T09:09:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859691+0000", 2024-09-14T09:09:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5250000000000005e-06 2024-09-14T09:09:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:988 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.827858536000001, 2024-09-14T09:09:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0012656799999999, 2024-09-14T09:09:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 988 2024-09-14T09:09:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:09:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858460+0000", 2024-09-14T09:09:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9999999999999997e-07 2024-09-14T09:09:58.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858463+0000", 2024-09-14T09:09:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7459999999999998e-06 2024-09-14T09:09:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858471+0000", 2024-09-14T09:09:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3900000000000004e-06 2024-09-14T09:09:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858478+0000", 2024-09-14T09:09:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7020000000000004e-06 2024-09-14T09:09:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859102+0000", 2024-09-14T09:09:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062419699999999995 2024-09-14T09:09:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859109+0000", 2024-09-14T09:09:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7419999999999997e-06 2024-09-14T09:09:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859718+0000", 2024-09-14T09:09:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006085629999999 2024-09-14T09:09:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859725+0000", 2024-09-14T09:09:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7399999999999998e-06 2024-09-14T09:09:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.695 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1003 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.826995299000004, 2024-09-14T09:09:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009495209999999, 2024-09-14T09:09:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1003 2024-09-14T09:09:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:09:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859323+0000", 2024-09-14T09:09:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3099999999999998e-07 2024-09-14T09:09:58.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859326+0000", 2024-09-14T09:09:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-06 2024-09-14T09:09:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859333+0000", 2024-09-14T09:09:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3300000000000001e-06 2024-09-14T09:09:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859339+0000", 2024-09-14T09:09:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6400000000000002e-06 2024-09-14T09:09:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859387+0000", 2024-09-14T09:09:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8448000000000001e-05 2024-09-14T09:09:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:09:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9540000000000004e-06 2024-09-14T09:09:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860260+0000", 2024-09-14T09:09:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000864921 2024-09-14T09:09:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860272+0000", 2024-09-14T09:09:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1993e-05 2024-09-14T09:09:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.700 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1004 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.826959723999998, 2024-09-14T09:09:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000947875, 2024-09-14T09:09:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1004 2024-09-14T09:09:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:09:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7199999999999999e-07 2024-09-14T09:09:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859361+0000", 2024-09-14T09:09:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.892e-06 2024-09-14T09:09:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859368+0000", 2024-09-14T09:09:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4370000000000004e-06 2024-09-14T09:09:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859373+0000", 2024-09-14T09:09:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6690000000000003e-06 2024-09-14T09:09:58.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859430+0000", 2024-09-14T09:09:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6456999999999998e-05 2024-09-14T09:09:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859434+0000", 2024-09-14T09:09:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8410000000000002e-06 2024-09-14T09:09:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860299+0000", 2024-09-14T09:09:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008650370000001 2024-09-14T09:09:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860306+0000", 2024-09-14T09:09:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0700000000000001e-06 2024-09-14T09:09:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1005 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:58.705 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.826936050999997, 2024-09-14T09:09:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009585480000001, 2024-09-14T09:09:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1005 2024-09-14T09:09:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:58.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:09:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9700000000000002e-07 2024-09-14T09:09:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859384+0000", 2024-09-14T09:09:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.024e-06 2024-09-14T09:09:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859390+0000", 2024-09-14T09:09:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7080000000000002e-06 2024-09-14T09:09:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:09:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8980000000000004e-06 2024-09-14T09:09:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859527+0000", 2024-09-14T09:09:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013228099999999999 2024-09-14T09:09:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859532+0000", 2024-09-14T09:09:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5899999999999998e-06 2024-09-14T09:09:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860330+0000", 2024-09-14T09:09:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0007973509999999 2024-09-14T09:09:58.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860340+0000", 2024-09-14T09:09:58.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0299000000000001e-05 2024-09-14T09:09:58.710 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.710 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.710 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1006 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.826912855000003, 2024-09-14T09:09:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001032039, 2024-09-14T09:09:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1006 2024-09-14T09:09:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:58.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:58.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:09:58.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6499999999999999e-07 2024-09-14T09:09:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859407+0000", 2024-09-14T09:09:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1160000000000002e-06 2024-09-14T09:09:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859413+0000", 2024-09-14T09:09:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8880000000000002e-06 2024-09-14T09:09:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859419+0000", 2024-09-14T09:09:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3550000000000004e-06 2024-09-14T09:09:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859558+0000", 2024-09-14T09:09:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000138942 2024-09-14T09:09:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859563+0000", 2024-09-14T09:09:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.665e-06 2024-09-14T09:09:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860427+0000", 2024-09-14T09:09:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008635299999999 2024-09-14T09:09:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860437+0000", 2024-09-14T09:09:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0078000000000001e-05 2024-09-14T09:09:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.715 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1045 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.826713374999997, 2024-09-14T09:09:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008612990000001, 2024-09-14T09:09:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1045 2024-09-14T09:09:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:09:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859605+0000", 2024-09-14T09:09:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6e-07 2024-09-14T09:09:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859606+0000", 2024-09-14T09:09:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8819999999999999e-06 2024-09-14T09:09:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859610+0000", 2024-09-14T09:09:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4290000000000001e-06 2024-09-14T09:09:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859612+0000", 2024-09-14T09:09:58.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6309999999999999e-06 2024-09-14T09:09:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859643+0000", 2024-09-14T09:09:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0224000000000001e-05 2024-09-14T09:09:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859647+0000", 2024-09-14T09:09:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9049999999999999e-06 2024-09-14T09:09:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860458+0000", 2024-09-14T09:09:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008111180000001 2024-09-14T09:09:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860466+0000", 2024-09-14T09:09:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:09:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1046 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:58.720 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.826699918000003, 2024-09-14T09:09:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000874262, 2024-09-14T09:09:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1046 2024-09-14T09:09:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:09:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:09:58.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859619+0000", 2024-09-14T09:09:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0559999999999999e-06 2024-09-14T09:09:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859622+0000", 2024-09-14T09:09:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0170000000000001e-06 2024-09-14T09:09:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859625+0000", 2024-09-14T09:09:58.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7209999999999999e-06 2024-09-14T09:09:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859666+0000", 2024-09-14T09:09:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1677000000000001e-05 2024-09-14T09:09:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859672+0000", 2024-09-14T09:09:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4609999999999999e-06 2024-09-14T09:09:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860485+0000", 2024-09-14T09:09:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000813505 2024-09-14T09:09:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860492+0000", 2024-09-14T09:09:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6159999999999998e-06 2024-09-14T09:09:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1047 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.826688584000003, 2024-09-14T09:09:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008950190000001, 2024-09-14T09:09:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1047 2024-09-14T09:09:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.726 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:09:58.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6600000000000003e-07 2024-09-14T09:09:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859631+0000", 2024-09-14T09:09:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5600000000000001e-06 2024-09-14T09:09:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859637+0000", 2024-09-14T09:09:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7309999999999998e-06 2024-09-14T09:09:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859641+0000", 2024-09-14T09:09:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0840000000000002e-06 2024-09-14T09:09:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859691+0000", 2024-09-14T09:09:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0587999999999997e-05 2024-09-14T09:09:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859696+0000", 2024-09-14T09:09:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8940000000000001e-06 2024-09-14T09:09:58.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860516+0000", 2024-09-14T09:09:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008200780000001 2024-09-14T09:09:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860524+0000", 2024-09-14T09:09:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8180000000000004e-06 2024-09-14T09:09:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1048 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.826656825000001, 2024-09-14T09:09:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008904780000001, 2024-09-14T09:09:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1048 2024-09-14T09:09:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:09:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4700000000000002e-07 2024-09-14T09:09:58.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859663+0000", 2024-09-14T09:09:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0420000000000001e-06 2024-09-14T09:09:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859669+0000", 2024-09-14T09:09:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8989999999999998e-06 2024-09-14T09:09:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859673+0000", 2024-09-14T09:09:58.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2209999999999999e-06 2024-09-14T09:09:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859719+0000", 2024-09-14T09:09:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5788000000000003e-05 2024-09-14T09:09:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859725+0000", 2024-09-14T09:09:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4770000000000002e-06 2024-09-14T09:09:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860544+0000", 2024-09-14T09:09:58.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008194669999999 2024-09-14T09:09:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860551+0000", 2024-09-14T09:09:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1369999999999996e-06 2024-09-14T09:09:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1089 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:58.735 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.826419831999999, 2024-09-14T09:09:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000733943, 2024-09-14T09:09:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1089 2024-09-14T09:09:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:58.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:58.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:09:58.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3000000000000002e-07 2024-09-14T09:09:58.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859900+0000", 2024-09-14T09:09:58.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9199999999999998e-06 2024-09-14T09:09:58.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859906+0000", 2024-09-14T09:09:58.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0889999999999996e-06 2024-09-14T09:09:58.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859911+0000", 2024-09-14T09:09:58.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6419999999999998e-06 2024-09-14T09:09:58.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860010+0000", 2024-09-14T09:09:58.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8956000000000006e-05 2024-09-14T09:09:58.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860014+0000", 2024-09-14T09:09:58.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.741e-06 2024-09-14T09:09:58.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860627+0000", 2024-09-14T09:09:58.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00061277 2024-09-14T09:09:58.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860632+0000", 2024-09-14T09:09:58.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:09:58.740 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.740 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.740 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.740 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1090 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:09:58.740 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:58.740 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.826400159999999, 2024-09-14T09:09:58.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000740763, 2024-09-14T09:09:58.740 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.741 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.741 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:58.741 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.741 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:09:58.741 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:09:58.741 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1090 2024-09-14T09:09:58.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.741 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:58.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:09:58.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859918+0000", 2024-09-14T09:09:58.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5199999999999998e-07 2024-09-14T09:09:58.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859920+0000", 2024-09-14T09:09:58.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9240000000000001e-06 2024-09-14T09:09:58.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859925+0000", 2024-09-14T09:09:58.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3929999999999999e-06 2024-09-14T09:09:58.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859929+0000", 2024-09-14T09:09:58.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4769999999999999e-06 2024-09-14T09:09:58.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860034+0000", 2024-09-14T09:09:58.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010549500000000001 2024-09-14T09:09:58.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860039+0000", 2024-09-14T09:09:58.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5700000000000003e-06 2024-09-14T09:09:58.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860650+0000", 2024-09-14T09:09:58.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006116119999999 2024-09-14T09:09:58.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860658+0000", 2024-09-14T09:09:58.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:09:58.745 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.745 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.745 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.745 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60374 3.14 3.6e2cd654 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:58.745 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:58.745 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 42.196521850000003, 2024-09-14T09:09:58.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3129433100000001, 2024-09-14T09:09:58.745 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.745 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.746 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:58.746 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.746 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:58.746 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:58.746 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60374 2024-09-14T09:09:58.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.746 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:58.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:58.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:09:58.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2100000000000002e-07 2024-09-14T09:09:58.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489799+0000", 2024-09-14T09:09:58.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3530000000000002e-06 2024-09-14T09:09:58.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489808+0000", 2024-09-14T09:09:58.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2e-06 2024-09-14T09:09:58.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489813+0000", 2024-09-14T09:09:58.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3249999999999998e-06 2024-09-14T09:09:58.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489866+0000", 2024-09-14T09:09:58.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3074e-05 2024-09-14T09:09:58.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489875+0000", 2024-09-14T09:09:58.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2760000000000006e-06 2024-09-14T09:09:58.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801379+0000", 2024-09-14T09:09:58.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.31150346200000001 2024-09-14T09:09:58.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801387+0000", 2024-09-14T09:09:58.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.038e-06 2024-09-14T09:09:58.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802728+0000", 2024-09-14T09:09:58.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013415569999999 2024-09-14T09:09:58.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802739+0000", 2024-09-14T09:09:58.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0604e-05 2024-09-14T09:09:58.750 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.750 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.750 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.751 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62179 3.14 3.78cf1974 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:58.751 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:09:58.751 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 42.196491221000002, 2024-09-14T09:09:58.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3129429109999999, 2024-09-14T09:09:58.751 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.751 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.751 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:58.751 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.751 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:58.751 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:58.751 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62179 2024-09-14T09:09:58.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.752 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.752 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:09:58.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.752 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:09:58.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.752 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489827+0000", 2024-09-14T09:09:58.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4300000000000003e-07 2024-09-14T09:09:58.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489829+0000", 2024-09-14T09:09:58.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2129999999999998e-06 2024-09-14T09:09:58.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489836+0000", 2024-09-14T09:09:58.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0360000000000001e-06 2024-09-14T09:09:58.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489841+0000", 2024-09-14T09:09:58.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0710000000000002e-06 2024-09-14T09:09:58.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489905+0000", 2024-09-14T09:09:58.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3578999999999996e-05 2024-09-14T09:09:58.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489913+0000", 2024-09-14T09:09:58.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2269999999999993e-06 2024-09-14T09:09:58.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801412+0000", 2024-09-14T09:09:58.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.311498989 2024-09-14T09:09:58.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801419+0000", 2024-09-14T09:09:58.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1400000000000002e-06 2024-09-14T09:09:58.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802761+0000", 2024-09-14T09:09:58.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013414620000001 2024-09-14T09:09:58.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802769+0000", 2024-09-14T09:09:58.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6510000000000007e-06 2024-09-14T09:09:58.756 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.756 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.756 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.756 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63551 3.14 3.88ccb734 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:58.756 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:09:58.757 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 42.196459591, 2024-09-14T09:09:58.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.312941181, 2024-09-14T09:09:58.757 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.757 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.757 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:58.757 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.757 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:58.757 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:58.757 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63551 2024-09-14T09:09:58.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.757 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:09:58.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:09:58.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489859+0000", 2024-09-14T09:09:58.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9200000000000001e-07 2024-09-14T09:09:58.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489862+0000", 2024-09-14T09:09:58.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9629999999999998e-06 2024-09-14T09:09:58.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489868+0000", 2024-09-14T09:09:58.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3890000000000002e-06 2024-09-14T09:09:58.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489875+0000", 2024-09-14T09:09:58.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7950000000000002e-06 2024-09-14T09:09:58.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489939+0000", 2024-09-14T09:09:58.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4704999999999998e-05 2024-09-14T09:09:58.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489949+0000", 2024-09-14T09:09:58.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7799999999999995e-06 2024-09-14T09:09:58.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801447+0000", 2024-09-14T09:09:58.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.311497527 2024-09-14T09:09:58.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801454+0000", 2024-09-14T09:09:58.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1080000000000004e-06 2024-09-14T09:09:58.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802790+0000", 2024-09-14T09:09:58.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013364330000001 2024-09-14T09:09:58.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802799+0000", 2024-09-14T09:09:58.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8890000000000008e-06 2024-09-14T09:09:58.762 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.762 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.762 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.762 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:68716 3.14 3.96fe1934 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:58.762 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:09:58.762 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 42.144889124000002, 2024-09-14T09:09:58.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2614012569999999, 2024-09-14T09:09:58.762 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.762 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.762 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:58.762 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.763 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:58.763 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:58.763 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 68716 2024-09-14T09:09:58.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.763 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:09:58.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:09:58.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541429+0000", 2024-09-14T09:09:58.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8899999999999998e-07 2024-09-14T09:09:58.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541433+0000", 2024-09-14T09:09:58.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7330000000000001e-06 2024-09-14T09:09:58.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541442+0000", 2024-09-14T09:09:58.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.346e-06 2024-09-14T09:09:58.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541449+0000", 2024-09-14T09:09:58.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.579e-06 2024-09-14T09:09:58.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541839+0000", 2024-09-14T09:09:58.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038993699999999998 2024-09-14T09:09:58.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541849+0000", 2024-09-14T09:09:58.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0217999999999999e-05 2024-09-14T09:09:58.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801480+0000", 2024-09-14T09:09:58.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.25963061399999998 2024-09-14T09:09:58.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801486+0000", 2024-09-14T09:09:58.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.776e-06 2024-09-14T09:09:58.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802821+0000", 2024-09-14T09:09:58.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00133435 2024-09-14T09:09:58.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802830+0000", 2024-09-14T09:09:58.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9150000000000002e-06 2024-09-14T09:09:58.767 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.767 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.767 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.768 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:69492 3.14 3.4a93714 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:58.768 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:09:58.768 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 42.084349428000003, 2024-09-14T09:09:58.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2008910690000001, 2024-09-14T09:09:58.768 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.768 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.768 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:58.768 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.768 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:58.768 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:58.768 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 69492 2024-09-14T09:09:58.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.769 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:09:58.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:09:58.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601969+0000", 2024-09-14T09:09:58.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3099999999999996e-07 2024-09-14T09:09:58.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601973+0000", 2024-09-14T09:09:58.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5899999999999999e-06 2024-09-14T09:09:58.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601983+0000", 2024-09-14T09:09:58.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098999999999999e-05 2024-09-14T09:09:58.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601989+0000", 2024-09-14T09:09:58.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0209999999999996e-06 2024-09-14T09:09:58.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.602066+0000", 2024-09-14T09:09:58.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7075000000000003e-05 2024-09-14T09:09:58.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.602075+0000", 2024-09-14T09:09:58.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8389999999999996e-06 2024-09-14T09:09:58.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801512+0000", 2024-09-14T09:09:58.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.199437225 2024-09-14T09:09:58.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801519+0000", 2024-09-14T09:09:58.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9970000000000001e-06 2024-09-14T09:09:58.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802851+0000", 2024-09-14T09:09:58.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001331711 2024-09-14T09:09:58.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802859+0000", 2024-09-14T09:09:58.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6810000000000004e-06 2024-09-14T09:09:58.773 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.774 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.774 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.774 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:72035 3.14 3.1cba9a34 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:58.774 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:09:58.774 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.965021540000002, 2024-09-14T09:09:58.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0815917340000001, 2024-09-14T09:09:58.774 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.774 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.774 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:58.774 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.774 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:58.775 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:58.775 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 72035 2024-09-14T09:09:58.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.775 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:09:58.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:09:58.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721297+0000", 2024-09-14T09:09:58.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5199999999999996e-07 2024-09-14T09:09:58.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721301+0000", 2024-09-14T09:09:58.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7790000000000002e-06 2024-09-14T09:09:58.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721309+0000", 2024-09-14T09:09:58.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8019999999999998e-06 2024-09-14T09:09:58.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721315+0000", 2024-09-14T09:09:58.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:09:58.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721367+0000", 2024-09-14T09:09:58.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2280000000000001e-05 2024-09-14T09:09:58.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721376+0000", 2024-09-14T09:09:58.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5439999999999999e-06 2024-09-14T09:09:58.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801545+0000", 2024-09-14T09:09:58.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.080169952000000003 2024-09-14T09:09:58.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801552+0000", 2024-09-14T09:09:58.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8390000000000001e-06 2024-09-14T09:09:58.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802879+0000", 2024-09-14T09:09:58.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001326846 2024-09-14T09:09:58.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802888+0000", 2024-09-14T09:09:58.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6330000000000002e-06 2024-09-14T09:09:58.779 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.779 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.780 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.780 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73403 3.14 3.87b99f94 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:09:58.780 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:58.780 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.922746879000002, 2024-09-14T09:09:58.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0393459899999999, 2024-09-14T09:09:58.780 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.780 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.780 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:09:58.780 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.780 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:09:58.780 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:58.781 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73403 2024-09-14T09:09:58.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.781 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:58.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:58.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:09:58.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9200000000000001e-07 2024-09-14T09:09:58.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763574+0000", 2024-09-14T09:09:58.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6510000000000001e-06 2024-09-14T09:09:58.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763582+0000", 2024-09-14T09:09:58.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2579999999999995e-06 2024-09-14T09:09:58.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763592+0000", 2024-09-14T09:09:58.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0193e-05 2024-09-14T09:09:58.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763643+0000", 2024-09-14T09:09:58.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0862000000000002e-05 2024-09-14T09:09:58.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763654+0000", 2024-09-14T09:09:58.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0890000000000001e-05 2024-09-14T09:09:58.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801577+0000", 2024-09-14T09:09:58.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037923074000000001 2024-09-14T09:09:58.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801584+0000", 2024-09-14T09:09:58.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0060000000000003e-06 2024-09-14T09:09:58.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802908+0000", 2024-09-14T09:09:58.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013235149999999 2024-09-14T09:09:58.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802917+0000", 2024-09-14T09:09:58.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9490000000000002e-06 2024-09-14T09:09:58.785 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.785 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.785 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.786 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:36215 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T09:09:58.786 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:52.846616+0000", 2024-09-14T09:09:58.786 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.8397012750000004, 2024-09-14T09:09:58.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0047992570000002, 2024-09-14T09:09:58.786 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:09:58.786 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:09:58.786 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:09:58.786 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:09:58.786 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:09:58.786 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:09:58.786 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36215 2024-09-14T09:09:58.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.787 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:09:58.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:09:58.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846616+0000", 2024-09-14T09:09:58.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:09:58.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846616+0000", 2024-09-14T09:09:58.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:09:58.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:09:58.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846618+0000", 2024-09-14T09:09:58.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6700000000000001e-06 2024-09-14T09:09:58.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:09:58.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846626+0000", 2024-09-14T09:09:58.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0430000000000008e-06 2024-09-14T09:09:58.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:09:58.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846641+0000", 2024-09-14T09:09:58.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5009e-05 2024-09-14T09:09:58.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:09:58.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846650+0000", 2024-09-14T09:09:58.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7409999999999998e-06 2024-09-14T09:09:58.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846726+0000", 2024-09-14T09:09:58.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6149000000000006e-05 2024-09-14T09:09:58.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846736+0000", 2024-09-14T09:09:58.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7119999999999995e-06 2024-09-14T09:09:58.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:53.822292+0000", 2024-09-14T09:09:58.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.97555623800000002 2024-09-14T09:09:58.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:09:58.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:53.822307+0000", 2024-09-14T09:09:58.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4646e-05 2024-09-14T09:09:58.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:09:58.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:54.850919+0000", 2024-09-14T09:09:58.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.028612284 2024-09-14T09:09:58.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:09:58.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:54.851186+0000", 2024-09-14T09:09:58.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000267318 2024-09-14T09:09:58.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:09:58.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:09:58.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:09:58.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:54.851416+0000", 2024-09-14T09:09:58.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000229447 2024-09-14T09:09:58.791 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.791 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.791 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.791 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:09:58.791 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:09:58.792 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:09:58.793 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:09:58.793 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:09:58.794+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:09:58.811 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T09:09:58.893 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:58.896+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:58.914 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:09:58.915 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:58.924 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:09:59.009 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:59.011+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:59.068 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:59.069 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:59.069 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:09:59.069 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:09:59.069 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:59.077 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:09:59.118 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:59.120+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:59.196 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:09:59.198+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:09:59.226 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:59.226 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:09:59.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:09:59.226 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:09:59.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.226 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:249 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1638400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:59.227 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:59.227 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 87.427662142000003, 2024-09-14T09:09:59.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99070346899999995, 2024-09-14T09:09:59.227 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 249 2024-09-14T09:09:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.228 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:09:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796868+0000", 2024-09-14T09:09:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2024-09-14T09:09:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796870+0000", 2024-09-14T09:09:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7889999999999999e-06 2024-09-14T09:09:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796877+0000", 2024-09-14T09:09:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8549999999999996e-06 2024-09-14T09:09:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:59.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796883+0000", 2024-09-14T09:09:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.665e-06 2024-09-14T09:09:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796915+0000", 2024-09-14T09:09:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2215999999999998e-05 2024-09-14T09:09:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796920+0000", 2024-09-14T09:09:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.527e-06 2024-09-14T09:09:59.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787468+0000", 2024-09-14T09:09:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99054877100000005 2024-09-14T09:09:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787512+0000", 2024-09-14T09:09:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3958000000000002e-05 2024-09-14T09:09:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787571+0000", 2024-09-14T09:09:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8167000000000001e-05 2024-09-14T09:09:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:250 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2097152~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:59.234 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 87.427636075999999, 2024-09-14T09:09:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99079431100000004, 2024-09-14T09:09:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 250 2024-09-14T09:09:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:09:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796894+0000", 2024-09-14T09:09:59.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2024-09-14T09:09:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796896+0000", 2024-09-14T09:09:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5600000000000001e-06 2024-09-14T09:09:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:59.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796902+0000", 2024-09-14T09:09:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3090000000000001e-06 2024-09-14T09:09:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796909+0000", 2024-09-14T09:09:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:09:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796942+0000", 2024-09-14T09:09:59.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-05 2024-09-14T09:09:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796948+0000", 2024-09-14T09:09:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5910000000000001e-06 2024-09-14T09:09:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787596+0000", 2024-09-14T09:09:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99064781400000002 2024-09-14T09:09:59.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787636+0000", 2024-09-14T09:09:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9715000000000002e-05 2024-09-14T09:09:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787687+0000", 2024-09-14T09:09:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1674e-05 2024-09-14T09:09:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.240 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:251 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 87.427610641000001, 2024-09-14T09:09:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99091769600000001, 2024-09-14T09:09:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:59.241 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 251 2024-09-14T09:09:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:59.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:59.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:59.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:09:59.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000005e-07 2024-09-14T09:09:59.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:59.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796922+0000", 2024-09-14T09:09:59.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.875e-06 2024-09-14T09:09:59.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:59.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796929+0000", 2024-09-14T09:09:59.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0260000000000002e-06 2024-09-14T09:09:59.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:59.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796935+0000", 2024-09-14T09:09:59.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7030000000000003e-06 2024-09-14T09:09:59.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796963+0000", 2024-09-14T09:09:59.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8368999999999999e-05 2024-09-14T09:09:59.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:59.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796966+0000", 2024-09-14T09:09:59.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4130000000000002e-06 2024-09-14T09:09:59.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787718+0000", 2024-09-14T09:09:59.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99075151100000003 2024-09-14T09:09:59.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:59.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787779+0000", 2024-09-14T09:09:59.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.088e-05 2024-09-14T09:09:59.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:59.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787836+0000", 2024-09-14T09:09:59.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7380000000000003e-05 2024-09-14T09:09:59.247 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.247 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:59.247 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.247 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:252 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:59.247 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:59.248 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 87.427585187000005, 2024-09-14T09:09:59.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99102491400000003, 2024-09-14T09:09:59.248 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:59.248 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:59.248 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:59.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:59.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:59.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:59.248 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 252 2024-09-14T09:09:59.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.249 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:59.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:59.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:59.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:59.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:09:59.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:59.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796945+0000", 2024-09-14T09:09:59.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2900000000000003e-07 2024-09-14T09:09:59.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:59.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796947+0000", 2024-09-14T09:09:59.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4279999999999999e-06 2024-09-14T09:09:59.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:59.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796954+0000", 2024-09-14T09:09:59.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5479999999999998e-06 2024-09-14T09:09:59.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:59.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796959+0000", 2024-09-14T09:09:59.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.22e-06 2024-09-14T09:09:59.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796988+0000", 2024-09-14T09:09:59.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9473000000000001e-05 2024-09-14T09:09:59.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:59.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:09:59.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:09:59.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787850+0000", 2024-09-14T09:09:59.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99085651100000005 2024-09-14T09:09:59.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:59.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787891+0000", 2024-09-14T09:09:59.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602000000000002e-05 2024-09-14T09:09:59.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:59.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787969+0000", 2024-09-14T09:09:59.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8063000000000001e-05 2024-09-14T09:09:59.254 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.254 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:59.254 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.255 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:253 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:59.255 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:59.255 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 87.427561307000005, 2024-09-14T09:09:59.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99122695699999996, 2024-09-14T09:09:59.255 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:59.255 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:59.255 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:59.255 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:59.256 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:59.256 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:59.256 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 253 2024-09-14T09:09:59.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.256 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:59.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:59.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:59.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:59.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:59.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:59.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:09:59.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:09:59.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:59.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:09:59.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:09:59.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:59.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796977+0000", 2024-09-14T09:09:59.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5030000000000002e-06 2024-09-14T09:09:59.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:59.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796982+0000", 2024-09-14T09:09:59.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2024-09-14T09:09:59.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797013+0000", 2024-09-14T09:09:59.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0451e-05 2024-09-14T09:09:59.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:59.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:09:59.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1690000000000001e-06 2024-09-14T09:09:59.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788011+0000", 2024-09-14T09:09:59.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99099490300000004 2024-09-14T09:09:59.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:59.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788102+0000", 2024-09-14T09:09:59.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0730999999999996e-05 2024-09-14T09:09:59.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:59.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788195+0000", 2024-09-14T09:09:59.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3245999999999995e-05 2024-09-14T09:09:59.262 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.263 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:59.263 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.263 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:254 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3932160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:59.263 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:59.263 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 87.427529749000001, 2024-09-14T09:09:59.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99137410500000001, 2024-09-14T09:09:59.263 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:59.263 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:59.264 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:59.264 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:59.264 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:59.264 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:59.264 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 254 2024-09-14T09:09:59.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.264 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:59.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:59.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:59.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:59.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:09:59.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:59.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797000+0000", 2024-09-14T09:09:59.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:09:59.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:59.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797003+0000", 2024-09-14T09:09:59.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7659999999999999e-06 2024-09-14T09:09:59.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:59.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797010+0000", 2024-09-14T09:09:59.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.029e-06 2024-09-14T09:09:59.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:59.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:09:59.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2024-09-14T09:09:59.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797044+0000", 2024-09-14T09:09:59.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9213e-05 2024-09-14T09:09:59.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:59.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797048+0000", 2024-09-14T09:09:59.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3400000000000002e-06 2024-09-14T09:09:59.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788222+0000", 2024-09-14T09:09:59.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99117407400000002 2024-09-14T09:09:59.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:59.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788306+0000", 2024-09-14T09:09:59.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4512999999999995e-05 2024-09-14T09:09:59.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:59.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788374+0000", 2024-09-14T09:09:59.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7226999999999999e-05 2024-09-14T09:09:59.269 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.269 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:59.269 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.269 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:264 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:59.269 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:59.269 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 87.427503391000002, 2024-09-14T09:09:59.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99161474699999996, 2024-09-14T09:09:59.269 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:59.269 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:59.270 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:59.270 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:59.270 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:59.270 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:59.270 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 264 2024-09-14T09:09:59.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.270 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:59.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:59.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:59.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:09:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2024-09-14T09:09:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:59.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:09:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2800000000000002e-06 2024-09-14T09:09:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:09:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0979999999999999e-06 2024-09-14T09:09:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797040+0000", 2024-09-14T09:09:59.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:09:59.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797068+0000", 2024-09-14T09:09:59.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7302999999999999e-05 2024-09-14T09:09:59.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797071+0000", 2024-09-14T09:09:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3610000000000001e-06 2024-09-14T09:09:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788436+0000", 2024-09-14T09:09:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99136489500000002 2024-09-14T09:09:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788538+0000", 2024-09-14T09:09:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101931 2024-09-14T09:09:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788641+0000", 2024-09-14T09:09:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010273899999999999 2024-09-14T09:09:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:265 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 87.427480032000005, 2024-09-14T09:09:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99176878199999996, 2024-09-14T09:09:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:59.276 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 265 2024-09-14T09:09:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:09:59.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:09:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.39e-07 2024-09-14T09:09:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797052+0000", 2024-09-14T09:09:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.345e-06 2024-09-14T09:09:59.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797058+0000", 2024-09-14T09:09:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5429999999999999e-06 2024-09-14T09:09:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797064+0000", 2024-09-14T09:09:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2000000000000002e-06 2024-09-14T09:09:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797091+0000", 2024-09-14T09:09:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7804e-05 2024-09-14T09:09:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797095+0000", 2024-09-14T09:09:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2024-09-14T09:09:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788667+0000", 2024-09-14T09:09:59.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157211300000003 2024-09-14T09:09:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788742+0000", 2024-09-14T09:09:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5159000000000003e-05 2024-09-14T09:09:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788818+0000", 2024-09-14T09:09:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6038000000000006e-05 2024-09-14T09:09:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.281 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:266 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 87.427457200999996, 2024-09-14T09:09:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99193390100000001, 2024-09-14T09:09:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:59.282 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:59.283 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:59.283 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:59.283 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 266 2024-09-14T09:09:59.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.283 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:59.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:59.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:59.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:59.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:59.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:59.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:09:59.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:09:59.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:59.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797075+0000", 2024-09-14T09:09:59.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2570000000000002e-06 2024-09-14T09:09:59.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:59.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797082+0000", 2024-09-14T09:09:59.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8029999999999997e-06 2024-09-14T09:09:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797088+0000", 2024-09-14T09:09:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.468e-06 2024-09-14T09:09:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797116+0000", 2024-09-14T09:09:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7752000000000001e-05 2024-09-14T09:09:59.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:59.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797121+0000", 2024-09-14T09:09:59.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5960000000000003e-06 2024-09-14T09:09:59.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788846+0000", 2024-09-14T09:09:59.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99172512199999996 2024-09-14T09:09:59.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:59.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788916+0000", 2024-09-14T09:09:59.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9843000000000002e-05 2024-09-14T09:09:59.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789006+0000", 2024-09-14T09:09:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9608e-05 2024-09-14T09:09:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.290 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:267 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 87.427432393999993, 2024-09-14T09:09:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99210926799999999, 2024-09-14T09:09:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:59.291 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:59.292 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 267 2024-09-14T09:09:59.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.292 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:59.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:59.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:59.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:59.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:59.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:59.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:09:59.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2399999999999999e-07 2024-09-14T09:09:59.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:59.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797099+0000", 2024-09-14T09:09:59.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.091e-06 2024-09-14T09:09:59.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:59.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797105+0000", 2024-09-14T09:09:59.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-09-14T09:09:59.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:59.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797111+0000", 2024-09-14T09:09:59.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5130000000000004e-06 2024-09-14T09:09:59.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797140+0000", 2024-09-14T09:09:59.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9513999999999999e-05 2024-09-14T09:09:59.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:59.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797145+0000", 2024-09-14T09:09:59.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:09:59.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789037+0000", 2024-09-14T09:09:59.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99189253899999996 2024-09-14T09:09:59.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:59.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789110+0000", 2024-09-14T09:09:59.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2848000000000005e-05 2024-09-14T09:09:59.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:59.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789206+0000", 2024-09-14T09:09:59.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5778000000000004e-05 2024-09-14T09:09:59.299 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.299 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:59.299 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:268 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 87.427409155000007, 2024-09-14T09:09:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992276359, 2024-09-14T09:09:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:59.300 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:59.301 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 268 2024-09-14T09:09:59.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.301 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:59.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:59.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:59.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:59.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:09:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:09:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797123+0000", 2024-09-14T09:09:59.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2740000000000002e-06 2024-09-14T09:09:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797129+0000", 2024-09-14T09:09:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-06 2024-09-14T09:09:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797134+0000", 2024-09-14T09:09:59.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9099999999999996e-06 2024-09-14T09:09:59.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797163+0000", 2024-09-14T09:09:59.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9709999999999998e-05 2024-09-14T09:09:59.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:59.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:59.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8709999999999999e-06 2024-09-14T09:09:59.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789231+0000", 2024-09-14T09:09:59.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992063959 2024-09-14T09:09:59.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:59.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789306+0000", 2024-09-14T09:09:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5289000000000004e-05 2024-09-14T09:09:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789396+0000", 2024-09-14T09:09:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9939999999999996e-05 2024-09-14T09:09:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.306 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:269 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2457600~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 87.427385646000005, 2024-09-14T09:09:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99242174400000005, 2024-09-14T09:09:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 269 2024-09-14T09:09:59.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:59.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:09:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:09:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797146+0000", 2024-09-14T09:09:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5289999999999998e-06 2024-09-14T09:09:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797153+0000", 2024-09-14T09:09:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1920000000000002e-06 2024-09-14T09:09:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797158+0000", 2024-09-14T09:09:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099999999999998e-06 2024-09-14T09:09:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797188+0000", 2024-09-14T09:09:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0128e-05 2024-09-14T09:09:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797194+0000", 2024-09-14T09:09:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6250000000000004e-06 2024-09-14T09:09:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789439+0000", 2024-09-14T09:09:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99224531000000005 2024-09-14T09:09:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789489+0000", 2024-09-14T09:09:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9830000000000002e-05 2024-09-14T09:09:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789565+0000", 2024-09-14T09:09:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6229000000000005e-05 2024-09-14T09:09:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:59.312 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:270 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 87.427361824000002, 2024-09-14T09:09:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99257721899999996, 2024-09-14T09:09:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:59.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 270 2024-09-14T09:09:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:09:59.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797168+0000", 2024-09-14T09:09:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2024-09-14T09:09:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797170+0000", 2024-09-14T09:09:59.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3120000000000001e-06 2024-09-14T09:09:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797177+0000", 2024-09-14T09:09:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0960000000000003e-06 2024-09-14T09:09:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797183+0000", 2024-09-14T09:09:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1669999999999998e-06 2024-09-14T09:09:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797213+0000", 2024-09-14T09:09:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0494e-05 2024-09-14T09:09:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:09:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:09:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789586+0000", 2024-09-14T09:09:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99236692100000001 2024-09-14T09:09:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789658+0000", 2024-09-14T09:09:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2279000000000004e-05 2024-09-14T09:09:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789745+0000", 2024-09-14T09:09:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6698000000000002e-05 2024-09-14T09:09:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:271 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3375104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:59.319 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:59.320 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 87.427336625999999, 2024-09-14T09:09:59.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99274791699999998, 2024-09-14T09:09:59.320 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:59.320 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:59.320 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:59.320 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 271 2024-09-14T09:09:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:59.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:59.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:59.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:09:59.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:09:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797195+0000", 2024-09-14T09:09:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1639999999999999e-06 2024-09-14T09:09:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797201+0000", 2024-09-14T09:09:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1290000000000001e-06 2024-09-14T09:09:59.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:59.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797206+0000", 2024-09-14T09:09:59.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9300000000000002e-06 2024-09-14T09:09:59.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797237+0000", 2024-09-14T09:09:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1285000000000003e-05 2024-09-14T09:09:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797242+0000", 2024-09-14T09:09:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6e-06 2024-09-14T09:09:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789768+0000", 2024-09-14T09:09:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99252547400000002 2024-09-14T09:09:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789826+0000", 2024-09-14T09:09:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8155999999999997e-05 2024-09-14T09:09:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:59.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789940+0000", 2024-09-14T09:09:59.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114788 2024-09-14T09:09:59.327 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.327 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:59.327 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.327 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:272 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:09:59.327 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:59.327 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 87.427313232000003, 2024-09-14T09:09:59.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99285248800000003, 2024-09-14T09:09:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:09:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:09:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:09:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 272 2024-09-14T09:09:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:59.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:59.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:59.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:59.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:59.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:59.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:09:59.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:09:59.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:09:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5129999999999999e-06 2024-09-14T09:09:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797226+0000", 2024-09-14T09:09:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4529999999999996e-06 2024-09-14T09:09:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:59.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797232+0000", 2024-09-14T09:09:59.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1839999999999998e-06 2024-09-14T09:09:59.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797264+0000", 2024-09-14T09:09:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2691999999999998e-05 2024-09-14T09:09:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797270+0000", 2024-09-14T09:09:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-06 2024-09-14T09:09:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789965+0000", 2024-09-14T09:09:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99269526200000002 2024-09-14T09:09:59.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:09:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790021+0000", 2024-09-14T09:09:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5297000000000003e-05 2024-09-14T09:09:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790068+0000", 2024-09-14T09:09:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7664999999999998e-05 2024-09-14T09:09:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.334 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:09:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 42.437056785000003, 2024-09-14T09:09:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146649299999999, 2024-09-14T09:09:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:59.335 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 58987 2024-09-14T09:09:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:09:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:09:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787474+0000", 2024-09-14T09:09:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1799999999999999e-06 2024-09-14T09:09:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787483+0000", 2024-09-14T09:09:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9830000000000002e-06 2024-09-14T09:09:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787494+0000", 2024-09-14T09:09:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1496e-05 2024-09-14T09:09:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:59.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787502+0000", 2024-09-14T09:09:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8280000000000003e-06 2024-09-14T09:09:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787563+0000", 2024-09-14T09:09:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1583999999999999e-05 2024-09-14T09:09:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:09:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787571+0000", 2024-09-14T09:09:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.058e-06 2024-09-14T09:09:59.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.791999+0000", 2024-09-14T09:09:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004428675 2024-09-14T09:09:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792008+0000", 2024-09-14T09:09:59.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9069999999999996e-06 2024-09-14T09:09:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802124+0000", 2024-09-14T09:09:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0101154619999999 2024-09-14T09:09:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802137+0000", 2024-09-14T09:09:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3757000000000001e-05 2024-09-14T09:09:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.341 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:67110 3.5 3.6b6808c5 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:09:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 42.436923970000002, 2024-09-14T09:09:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0147494290000001, 2024-09-14T09:09:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:59.342 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 67110 2024-09-14T09:09:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:09:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:09:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787606+0000", 2024-09-14T09:09:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6300000000000005e-07 2024-09-14T09:09:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787609+0000", 2024-09-14T09:09:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2789999999999999e-06 2024-09-14T09:09:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787616+0000", 2024-09-14T09:09:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8349999999999998e-06 2024-09-14T09:09:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787622+0000", 2024-09-14T09:09:59.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6999999999999996e-06 2024-09-14T09:09:59.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787666+0000", 2024-09-14T09:09:59.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3887000000000002e-05 2024-09-14T09:09:59.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:59.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787672+0000", 2024-09-14T09:09:59.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-09-14T09:09:59.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792033+0000", 2024-09-14T09:09:59.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043614250000000004 2024-09-14T09:09:59.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:59.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792041+0000", 2024-09-14T09:09:59.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5449999999999998e-06 2024-09-14T09:09:59.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:09:59.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0103013569999999 2024-09-14T09:09:59.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:59.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802355+0000", 2024-09-14T09:09:59.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2717999999999999e-05 2024-09-14T09:09:59.348 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.348 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:59.348 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.349 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72029 3.5 3.3f02ac5 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:59.349 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:59.349 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 42.436846455000001, 2024-09-14T09:09:59.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.014715139, 2024-09-14T09:09:59.349 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:59.349 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:59.349 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:59.349 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:59.349 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:59.349 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:59.350 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72029 2024-09-14T09:09:59.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.350 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:59.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:59.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:59.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:59.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:59.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:59.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:09:59.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7599999999999997e-07 2024-09-14T09:09:59.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:59.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787686+0000", 2024-09-14T09:09:59.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3999999999999999e-06 2024-09-14T09:09:59.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:59.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787692+0000", 2024-09-14T09:09:59.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3489999999999997e-06 2024-09-14T09:09:59.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:59.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787697+0000", 2024-09-14T09:09:59.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2320000000000001e-06 2024-09-14T09:09:59.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787742+0000", 2024-09-14T09:09:59.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4557e-05 2024-09-14T09:09:59.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:59.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787748+0000", 2024-09-14T09:09:59.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7810000000000002e-06 2024-09-14T09:09:59.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792065+0000", 2024-09-14T09:09:59.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043178679999999999 2024-09-14T09:09:59.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:59.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792073+0000", 2024-09-14T09:09:59.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6329999999999996e-06 2024-09-14T09:09:59.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802388+0000", 2024-09-14T09:09:59.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010315394 2024-09-14T09:09:59.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:59.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802398+0000", 2024-09-14T09:09:59.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4490000000000005e-06 2024-09-14T09:09:59.355 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.355 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:59.356 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.356 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72038 3.5 3.c914e45 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:59.356 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:59.356 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 42.436770822, 2024-09-14T09:09:59.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146757740000001, 2024-09-14T09:09:59.356 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:59.356 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:59.356 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:59.356 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:59.357 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:59.357 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:59.357 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72038 2024-09-14T09:09:59.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.357 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:59.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:59.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:59.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:59.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:09:59.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:59.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787759+0000", 2024-09-14T09:09:59.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0100000000000005e-07 2024-09-14T09:09:59.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:59.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787761+0000", 2024-09-14T09:09:59.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4049999999999998e-06 2024-09-14T09:09:59.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:59.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787768+0000", 2024-09-14T09:09:59.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.314e-06 2024-09-14T09:09:59.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:59.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787773+0000", 2024-09-14T09:09:59.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2789999999999998e-06 2024-09-14T09:09:59.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787813+0000", 2024-09-14T09:09:59.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9582000000000002e-05 2024-09-14T09:09:59.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:09:59.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787818+0000", 2024-09-14T09:09:59.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7100000000000004e-06 2024-09-14T09:09:59.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792096+0000", 2024-09-14T09:09:59.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042776460000000004 2024-09-14T09:09:59.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:59.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792103+0000", 2024-09-14T09:09:59.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7129999999999999e-06 2024-09-14T09:09:59.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802427+0000", 2024-09-14T09:09:59.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010324805 2024-09-14T09:09:59.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:59.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802434+0000", 2024-09-14T09:09:59.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:09:59.363 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.364 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:59.364 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.364 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:74840 3.5 3.ab2c8d25 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:09:59.364 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:09:59.364 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 42.414718937000004, 2024-09-14T09:09:59.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99271963600000002, 2024-09-14T09:09:59.364 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:09:59.364 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:09:59.365 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:09:59.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:09:59.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:09:59.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:09:59.365 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74840 2024-09-14T09:09:59.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.365 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:09:59.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:09:59.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:09:59.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:09:59.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:09:59.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:09:59.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:09:59.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809812+0000", 2024-09-14T09:09:59.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2899999999999999e-06 2024-09-14T09:09:59.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:09:59.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809817+0000", 2024-09-14T09:09:59.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0139999999999998e-06 2024-09-14T09:09:59.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:09:59.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809834+0000", 2024-09-14T09:09:59.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7643e-05 2024-09-14T09:09:59.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:09:59.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809842+0000", 2024-09-14T09:09:59.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2970000000000004e-06 2024-09-14T09:09:59.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809902+0000", 2024-09-14T09:09:59.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9106e-05 2024-09-14T09:09:59.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:09:59.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809912+0000", 2024-09-14T09:09:59.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0101e-05 2024-09-14T09:09:59.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:09:59.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802520+0000", 2024-09-14T09:09:59.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99260828599999995 2024-09-14T09:09:59.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:09:59.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:09:59.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:09:59.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802530+0000", 2024-09-14T09:09:59.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8989999999999996e-06 2024-09-14T09:09:59.370 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.370 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:59.370 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.370 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:09:59.370 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:09:59.370 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:59.372 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:09:59.373 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:59.374+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:59.375 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:09:59.472 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:59.475+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:59.494 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:09:59.494 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:09:59.510 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:09:59.511 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:09:59.517 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:09:59.517 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:09:59.517 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:09:59.517 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:09:59.525 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:09:59.526 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:09:59.527 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:09:59.543 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:09:59.543 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:09:59.559 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:09:59.560 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:09:59.576 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:09:59.577 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:09:59.610 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:59.612+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:09:59.668 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:59.668 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:59.675 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:09:59.677+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:09:59.677 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:09:59.775 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:09:59.777+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:09:59.821 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:59.821 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:59.830 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:09:59.859 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is set 2024-09-14T09:09:59.860 INFO:teuthology.orchestra.run.smithi116.stderr:set 3.1c pg_upmap_items mapping to [1->5,0->3] 2024-09-14T09:09:59.876 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:09:59.878+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:09:59.939 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:09:59.939 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:09:59.948 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:09:59.992 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:09:59.994+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:00.053 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:00.054 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:00.062 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:10:00.078 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:00.080+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:00.179 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:00.181+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:00.208 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:00.208 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:00.217 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:10:00.280 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:00.282+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:00.322 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:00.323 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:00.331 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:10:00.416 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:00.418+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:00.475 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:00.475 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:00.481 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:00.484+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:00.483 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:10:00.582 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:00.584+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:00.627 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:00.627 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:00.635 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:10:00.683 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:00.685+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:00.738 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:00.739 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:00.748 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:10:00.783 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:00.786+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:00.849 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:00.849 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:00.858 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:10:00.901 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:00.903+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:00.978 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:00.978 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:00.986 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:00.988+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:00.988 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:10:01.087 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:01.089+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:01.132 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:01.132 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:01.141 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:10:01.187 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:01.189+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:01.244 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:01.244 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:01.252 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:10:01.289 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:01.291+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:01.389 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:01.391+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:01.394 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:01.394 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:01.403 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:10:01.490 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:01.492+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:01.520 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:01.520 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:01.529 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:10:01.588 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:10:01.591 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:01.593+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:01.633 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:01.633 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:01.641 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:10:01.706 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:10:01.706 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:10:01.722 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:10:01.722 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:10:01.725 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:01.728+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:01.738 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:10:01.738 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:10:01.754 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:10:01.754 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:10:01.771 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:10:01.771 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:10:01.788 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:01.788 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:10:01.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:10:01.789 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:10:01.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.789 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:249 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1638400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:01.789 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:10:01.789 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 89.992532060000002, 2024-09-14T09:10:01.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99070346899999995, 2024-09-14T09:10:01.789 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:01.789 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:01.789 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:01.789 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:01.790 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:01.790 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:01.790 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 249 2024-09-14T09:10:01.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.790 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:01.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:01.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:10:01.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:01.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:10:01.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:01.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796868+0000", 2024-09-14T09:10:01.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2024-09-14T09:10:01.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:01.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796870+0000", 2024-09-14T09:10:01.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7889999999999999e-06 2024-09-14T09:10:01.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:01.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796877+0000", 2024-09-14T09:10:01.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8549999999999996e-06 2024-09-14T09:10:01.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:01.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796883+0000", 2024-09-14T09:10:01.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.665e-06 2024-09-14T09:10:01.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796915+0000", 2024-09-14T09:10:01.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2215999999999998e-05 2024-09-14T09:10:01.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:01.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796920+0000", 2024-09-14T09:10:01.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.527e-06 2024-09-14T09:10:01.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787468+0000", 2024-09-14T09:10:01.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99054877100000005 2024-09-14T09:10:01.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:01.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787512+0000", 2024-09-14T09:10:01.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3958000000000002e-05 2024-09-14T09:10:01.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:01.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787571+0000", 2024-09-14T09:10:01.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8167000000000001e-05 2024-09-14T09:10:01.794 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.794 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:01.795 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.795 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:250 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2097152~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:01.795 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:10:01.795 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 89.992505993999998, 2024-09-14T09:10:01.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99079431100000004, 2024-09-14T09:10:01.795 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:01.795 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:01.796 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:01.796 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:01.796 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:01.796 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:01.796 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 250 2024-09-14T09:10:01.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.796 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:01.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:01.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:10:01.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:01.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:10:01.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:01.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796894+0000", 2024-09-14T09:10:01.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2024-09-14T09:10:01.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:01.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796896+0000", 2024-09-14T09:10:01.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5600000000000001e-06 2024-09-14T09:10:01.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:01.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796902+0000", 2024-09-14T09:10:01.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3090000000000001e-06 2024-09-14T09:10:01.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:01.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796909+0000", 2024-09-14T09:10:01.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:10:01.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796942+0000", 2024-09-14T09:10:01.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-05 2024-09-14T09:10:01.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:01.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796948+0000", 2024-09-14T09:10:01.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5910000000000001e-06 2024-09-14T09:10:01.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787596+0000", 2024-09-14T09:10:01.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99064781400000002 2024-09-14T09:10:01.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:01.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787636+0000", 2024-09-14T09:10:01.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9715000000000002e-05 2024-09-14T09:10:01.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:01.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787687+0000", 2024-09-14T09:10:01.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1674e-05 2024-09-14T09:10:01.800 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.800 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:01.800 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.801 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:251 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:01.801 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:10:01.801 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 89.992480559000001, 2024-09-14T09:10:01.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99091769600000001, 2024-09-14T09:10:01.801 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:01.801 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:01.801 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:01.801 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:01.801 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:01.801 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:01.801 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 251 2024-09-14T09:10:01.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.802 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:01.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:01.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:10:01.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:01.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:10:01.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:01.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:10:01.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000005e-07 2024-09-14T09:10:01.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:01.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796922+0000", 2024-09-14T09:10:01.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.875e-06 2024-09-14T09:10:01.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:01.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796929+0000", 2024-09-14T09:10:01.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0260000000000002e-06 2024-09-14T09:10:01.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:01.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796935+0000", 2024-09-14T09:10:01.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7030000000000003e-06 2024-09-14T09:10:01.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796963+0000", 2024-09-14T09:10:01.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8368999999999999e-05 2024-09-14T09:10:01.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:01.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796966+0000", 2024-09-14T09:10:01.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4130000000000002e-06 2024-09-14T09:10:01.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787718+0000", 2024-09-14T09:10:01.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99075151100000003 2024-09-14T09:10:01.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:01.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787779+0000", 2024-09-14T09:10:01.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.088e-05 2024-09-14T09:10:01.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:01.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787836+0000", 2024-09-14T09:10:01.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7380000000000003e-05 2024-09-14T09:10:01.806 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.806 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:01.806 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.806 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:252 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:01.806 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:10:01.806 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 89.992455105000005, 2024-09-14T09:10:01.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99102491400000003, 2024-09-14T09:10:01.806 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:01.806 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:01.806 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:01.807 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:01.807 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:01.807 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:01.807 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 252 2024-09-14T09:10:01.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.807 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:01.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:01.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:10:01.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:01.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:10:01.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:01.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796945+0000", 2024-09-14T09:10:01.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2900000000000003e-07 2024-09-14T09:10:01.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:01.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796947+0000", 2024-09-14T09:10:01.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4279999999999999e-06 2024-09-14T09:10:01.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:01.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796954+0000", 2024-09-14T09:10:01.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5479999999999998e-06 2024-09-14T09:10:01.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:01.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796959+0000", 2024-09-14T09:10:01.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.22e-06 2024-09-14T09:10:01.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796988+0000", 2024-09-14T09:10:01.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9473000000000001e-05 2024-09-14T09:10:01.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:01.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:10:01.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:10:01.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787850+0000", 2024-09-14T09:10:01.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99085651100000005 2024-09-14T09:10:01.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:01.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787891+0000", 2024-09-14T09:10:01.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602000000000002e-05 2024-09-14T09:10:01.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:01.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787969+0000", 2024-09-14T09:10:01.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8063000000000001e-05 2024-09-14T09:10:01.811 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.811 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:01.811 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.811 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:253 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:01.812 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:10:01.812 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 89.992431225000004, 2024-09-14T09:10:01.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99122695699999996, 2024-09-14T09:10:01.812 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:01.812 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:01.812 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:01.812 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:01.812 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:01.812 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:01.812 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 253 2024-09-14T09:10:01.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.812 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:01.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:01.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:10:01.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:01.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:10:01.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:01.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:10:01.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:10:01.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:01.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:10:01.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:10:01.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:01.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796977+0000", 2024-09-14T09:10:01.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5030000000000002e-06 2024-09-14T09:10:01.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:01.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796982+0000", 2024-09-14T09:10:01.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2024-09-14T09:10:01.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797013+0000", 2024-09-14T09:10:01.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0451e-05 2024-09-14T09:10:01.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:01.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:10:01.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1690000000000001e-06 2024-09-14T09:10:01.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788011+0000", 2024-09-14T09:10:01.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99099490300000004 2024-09-14T09:10:01.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:01.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788102+0000", 2024-09-14T09:10:01.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0730999999999996e-05 2024-09-14T09:10:01.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:01.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788195+0000", 2024-09-14T09:10:01.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3245999999999995e-05 2024-09-14T09:10:01.816 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.816 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:01.817 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.817 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:254 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3932160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:01.817 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:10:01.817 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 89.992399667000001, 2024-09-14T09:10:01.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99137410500000001, 2024-09-14T09:10:01.817 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:01.817 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:01.817 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:01.817 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:01.817 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:01.817 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:01.817 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 254 2024-09-14T09:10:01.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.818 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:01.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:01.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:10:01.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:01.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:10:01.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:01.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797000+0000", 2024-09-14T09:10:01.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:10:01.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:01.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797003+0000", 2024-09-14T09:10:01.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7659999999999999e-06 2024-09-14T09:10:01.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:01.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797010+0000", 2024-09-14T09:10:01.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.029e-06 2024-09-14T09:10:01.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:01.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:10:01.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2024-09-14T09:10:01.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797044+0000", 2024-09-14T09:10:01.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9213e-05 2024-09-14T09:10:01.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:01.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797048+0000", 2024-09-14T09:10:01.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3400000000000002e-06 2024-09-14T09:10:01.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788222+0000", 2024-09-14T09:10:01.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99117407400000002 2024-09-14T09:10:01.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:01.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788306+0000", 2024-09-14T09:10:01.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4512999999999995e-05 2024-09-14T09:10:01.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:01.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788374+0000", 2024-09-14T09:10:01.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7226999999999999e-05 2024-09-14T09:10:01.822 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.822 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:01.822 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.822 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:264 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:01.822 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:10:01.822 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 89.992373309000001, 2024-09-14T09:10:01.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99161474699999996, 2024-09-14T09:10:01.822 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:01.822 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:01.822 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:01.822 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:01.823 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:01.823 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:01.823 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 264 2024-09-14T09:10:01.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.823 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:01.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:01.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:10:01.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:01.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:10:01.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:01.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:10:01.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2024-09-14T09:10:01.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:01.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:10:01.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2800000000000002e-06 2024-09-14T09:10:01.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:01.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:10:01.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0979999999999999e-06 2024-09-14T09:10:01.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:01.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797040+0000", 2024-09-14T09:10:01.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:10:01.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797068+0000", 2024-09-14T09:10:01.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7302999999999999e-05 2024-09-14T09:10:01.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:01.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797071+0000", 2024-09-14T09:10:01.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3610000000000001e-06 2024-09-14T09:10:01.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788436+0000", 2024-09-14T09:10:01.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99136489500000002 2024-09-14T09:10:01.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:01.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788538+0000", 2024-09-14T09:10:01.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101931 2024-09-14T09:10:01.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:01.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788641+0000", 2024-09-14T09:10:01.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010273899999999999 2024-09-14T09:10:01.827 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.827 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:01.827 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.828 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:265 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:01.828 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:10:01.828 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 89.992349950000005, 2024-09-14T09:10:01.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99176878199999996, 2024-09-14T09:10:01.828 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:01.828 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:01.828 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:01.828 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:01.828 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:01.828 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:01.828 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 265 2024-09-14T09:10:01.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.828 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:01.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:01.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:10:01.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:01.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:10:01.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:01.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:10:01.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.39e-07 2024-09-14T09:10:01.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:01.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797052+0000", 2024-09-14T09:10:01.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.345e-06 2024-09-14T09:10:01.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:01.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797058+0000", 2024-09-14T09:10:01.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5429999999999999e-06 2024-09-14T09:10:01.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:01.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797064+0000", 2024-09-14T09:10:01.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2000000000000002e-06 2024-09-14T09:10:01.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797091+0000", 2024-09-14T09:10:01.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7804e-05 2024-09-14T09:10:01.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:01.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797095+0000", 2024-09-14T09:10:01.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2024-09-14T09:10:01.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788667+0000", 2024-09-14T09:10:01.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157211300000003 2024-09-14T09:10:01.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:01.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788742+0000", 2024-09-14T09:10:01.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5159000000000003e-05 2024-09-14T09:10:01.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:01.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788818+0000", 2024-09-14T09:10:01.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6038000000000006e-05 2024-09-14T09:10:01.833 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.833 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:01.833 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.833 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:266 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:01.833 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:10:01.833 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 89.992327118999995, 2024-09-14T09:10:01.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99193390100000001, 2024-09-14T09:10:01.833 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:01.834 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:01.834 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:01.834 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:01.834 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:01.834 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:01.834 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 266 2024-09-14T09:10:01.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.834 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:01.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:01.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:10:01.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:01.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:10:01.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:01.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:10:01.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:10:01.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:01.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797075+0000", 2024-09-14T09:10:01.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2570000000000002e-06 2024-09-14T09:10:01.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:01.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797082+0000", 2024-09-14T09:10:01.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8029999999999997e-06 2024-09-14T09:10:01.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:01.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797088+0000", 2024-09-14T09:10:01.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.468e-06 2024-09-14T09:10:01.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797116+0000", 2024-09-14T09:10:01.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7752000000000001e-05 2024-09-14T09:10:01.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:01.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797121+0000", 2024-09-14T09:10:01.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5960000000000003e-06 2024-09-14T09:10:01.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788846+0000", 2024-09-14T09:10:01.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99172512199999996 2024-09-14T09:10:01.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:01.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788916+0000", 2024-09-14T09:10:01.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9843000000000002e-05 2024-09-14T09:10:01.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:01.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789006+0000", 2024-09-14T09:10:01.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9608e-05 2024-09-14T09:10:01.838 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.838 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:01.838 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.839 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:267 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:01.839 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:10:01.839 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 89.992302312000007, 2024-09-14T09:10:01.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99210926799999999, 2024-09-14T09:10:01.839 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:01.839 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:01.839 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:01.839 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:01.839 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:01.839 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:01.839 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 267 2024-09-14T09:10:01.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.839 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:01.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:01.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:10:01.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:01.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:10:01.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:01.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:10:01.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2399999999999999e-07 2024-09-14T09:10:01.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:01.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797099+0000", 2024-09-14T09:10:01.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.091e-06 2024-09-14T09:10:01.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:01.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797105+0000", 2024-09-14T09:10:01.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-09-14T09:10:01.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:01.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797111+0000", 2024-09-14T09:10:01.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5130000000000004e-06 2024-09-14T09:10:01.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797140+0000", 2024-09-14T09:10:01.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9513999999999999e-05 2024-09-14T09:10:01.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:01.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797145+0000", 2024-09-14T09:10:01.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:10:01.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789037+0000", 2024-09-14T09:10:01.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99189253899999996 2024-09-14T09:10:01.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:01.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789110+0000", 2024-09-14T09:10:01.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2848000000000005e-05 2024-09-14T09:10:01.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:01.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789206+0000", 2024-09-14T09:10:01.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5778000000000004e-05 2024-09-14T09:10:01.844 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.844 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:01.844 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.844 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:268 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:01.844 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:10:01.844 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 89.992279073000006, 2024-09-14T09:10:01.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992276359, 2024-09-14T09:10:01.844 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:01.845 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:01.845 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:01.845 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:01.845 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:01.845 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:01.845 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 268 2024-09-14T09:10:01.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.845 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:01.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:01.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:10:01.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:01.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:10:01.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:01.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:10:01.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:10:01.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:01.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797123+0000", 2024-09-14T09:10:01.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2740000000000002e-06 2024-09-14T09:10:01.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:01.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797129+0000", 2024-09-14T09:10:01.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-06 2024-09-14T09:10:01.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:01.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797134+0000", 2024-09-14T09:10:01.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9099999999999996e-06 2024-09-14T09:10:01.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797163+0000", 2024-09-14T09:10:01.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9709999999999998e-05 2024-09-14T09:10:01.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:01.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:10:01.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8709999999999999e-06 2024-09-14T09:10:01.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789231+0000", 2024-09-14T09:10:01.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992063959 2024-09-14T09:10:01.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:01.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789306+0000", 2024-09-14T09:10:01.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5289000000000004e-05 2024-09-14T09:10:01.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:01.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789396+0000", 2024-09-14T09:10:01.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9939999999999996e-05 2024-09-14T09:10:01.849 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.849 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:01.849 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.849 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:269 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2457600~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:01.850 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:10:01.850 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 89.992255564000004, 2024-09-14T09:10:01.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99242174400000005, 2024-09-14T09:10:01.850 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:01.850 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:01.850 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:01.850 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:01.850 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:01.850 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:01.850 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 269 2024-09-14T09:10:01.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.850 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:01.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:01.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:10:01.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:01.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:10:01.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:01.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:10:01.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:10:01.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:01.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797146+0000", 2024-09-14T09:10:01.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5289999999999998e-06 2024-09-14T09:10:01.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:01.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797153+0000", 2024-09-14T09:10:01.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1920000000000002e-06 2024-09-14T09:10:01.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:01.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797158+0000", 2024-09-14T09:10:01.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099999999999998e-06 2024-09-14T09:10:01.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797188+0000", 2024-09-14T09:10:01.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0128e-05 2024-09-14T09:10:01.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:01.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797194+0000", 2024-09-14T09:10:01.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6250000000000004e-06 2024-09-14T09:10:01.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789439+0000", 2024-09-14T09:10:01.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99224531000000005 2024-09-14T09:10:01.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:01.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789489+0000", 2024-09-14T09:10:01.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9830000000000002e-05 2024-09-14T09:10:01.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:01.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789565+0000", 2024-09-14T09:10:01.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6229000000000005e-05 2024-09-14T09:10:01.854 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.855 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:01.855 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.855 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:270 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:01.855 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:10:01.855 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 89.992231742000001, 2024-09-14T09:10:01.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99257721899999996, 2024-09-14T09:10:01.855 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:01.855 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:01.855 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:01.855 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:01.855 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:01.856 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:01.856 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 270 2024-09-14T09:10:01.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.856 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:01.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:01.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:10:01.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:01.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:10:01.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:01.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797168+0000", 2024-09-14T09:10:01.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2024-09-14T09:10:01.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:01.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797170+0000", 2024-09-14T09:10:01.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3120000000000001e-06 2024-09-14T09:10:01.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:01.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797177+0000", 2024-09-14T09:10:01.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0960000000000003e-06 2024-09-14T09:10:01.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:01.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797183+0000", 2024-09-14T09:10:01.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1669999999999998e-06 2024-09-14T09:10:01.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797213+0000", 2024-09-14T09:10:01.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0494e-05 2024-09-14T09:10:01.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:01.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:10:01.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:10:01.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789586+0000", 2024-09-14T09:10:01.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99236692100000001 2024-09-14T09:10:01.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:01.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789658+0000", 2024-09-14T09:10:01.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2279000000000004e-05 2024-09-14T09:10:01.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:01.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789745+0000", 2024-09-14T09:10:01.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6698000000000002e-05 2024-09-14T09:10:01.860 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.860 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:01.860 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.860 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:271 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3375104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:01.860 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:10:01.860 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 89.992206543999998, 2024-09-14T09:10:01.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99274791699999998, 2024-09-14T09:10:01.861 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:01.861 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:01.861 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:01.861 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:01.861 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:01.861 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:01.861 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 271 2024-09-14T09:10:01.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.861 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:01.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:01.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:10:01.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:01.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:10:01.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:01.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:10:01.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:10:01.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:01.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797195+0000", 2024-09-14T09:10:01.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1639999999999999e-06 2024-09-14T09:10:01.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:01.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797201+0000", 2024-09-14T09:10:01.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1290000000000001e-06 2024-09-14T09:10:01.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:01.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797206+0000", 2024-09-14T09:10:01.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9300000000000002e-06 2024-09-14T09:10:01.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797237+0000", 2024-09-14T09:10:01.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1285000000000003e-05 2024-09-14T09:10:01.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:01.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797242+0000", 2024-09-14T09:10:01.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6e-06 2024-09-14T09:10:01.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789768+0000", 2024-09-14T09:10:01.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99252547400000002 2024-09-14T09:10:01.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:01.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789826+0000", 2024-09-14T09:10:01.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8155999999999997e-05 2024-09-14T09:10:01.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:01.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789940+0000", 2024-09-14T09:10:01.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114788 2024-09-14T09:10:01.865 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.865 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:01.865 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.866 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:272 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:01.866 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:10:01.866 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 89.992183150000002, 2024-09-14T09:10:01.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99285248800000003, 2024-09-14T09:10:01.866 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:01.866 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:01.866 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:01.866 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:01.866 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:01.866 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:01.866 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 272 2024-09-14T09:10:01.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.866 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:01.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:01.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:10:01.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:01.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:10:01.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:01.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:10:01.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:10:01.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:01.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:10:01.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5129999999999999e-06 2024-09-14T09:10:01.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:01.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797226+0000", 2024-09-14T09:10:01.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4529999999999996e-06 2024-09-14T09:10:01.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:01.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797232+0000", 2024-09-14T09:10:01.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1839999999999998e-06 2024-09-14T09:10:01.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797264+0000", 2024-09-14T09:10:01.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2691999999999998e-05 2024-09-14T09:10:01.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:01.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797270+0000", 2024-09-14T09:10:01.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-06 2024-09-14T09:10:01.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789965+0000", 2024-09-14T09:10:01.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99269526200000002 2024-09-14T09:10:01.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:01.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790021+0000", 2024-09-14T09:10:01.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5297000000000003e-05 2024-09-14T09:10:01.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:01.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790068+0000", 2024-09-14T09:10:01.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7664999999999998e-05 2024-09-14T09:10:01.871 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.871 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:01.871 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.871 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:01.871 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:10:01.871 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.001926703000002, 2024-09-14T09:10:01.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146649299999999, 2024-09-14T09:10:01.871 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:01.871 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:01.871 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:01.872 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:01.872 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:01.872 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:01.872 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 58987 2024-09-14T09:10:01.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.872 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:01.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:01.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:10:01.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:01.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:10:01.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:01.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787474+0000", 2024-09-14T09:10:01.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1799999999999999e-06 2024-09-14T09:10:01.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:01.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787483+0000", 2024-09-14T09:10:01.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9830000000000002e-06 2024-09-14T09:10:01.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:01.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787494+0000", 2024-09-14T09:10:01.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1496e-05 2024-09-14T09:10:01.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:01.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787502+0000", 2024-09-14T09:10:01.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8280000000000003e-06 2024-09-14T09:10:01.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787563+0000", 2024-09-14T09:10:01.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1583999999999999e-05 2024-09-14T09:10:01.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:10:01.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787571+0000", 2024-09-14T09:10:01.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.058e-06 2024-09-14T09:10:01.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.791999+0000", 2024-09-14T09:10:01.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004428675 2024-09-14T09:10:01.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:01.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792008+0000", 2024-09-14T09:10:01.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9069999999999996e-06 2024-09-14T09:10:01.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802124+0000", 2024-09-14T09:10:01.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0101154619999999 2024-09-14T09:10:01.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:01.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802137+0000", 2024-09-14T09:10:01.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3757000000000001e-05 2024-09-14T09:10:01.878 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.878 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:01.878 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.878 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:67110 3.5 3.6b6808c5 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:01.878 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:10:01.879 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.001793888000002, 2024-09-14T09:10:01.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0147494290000001, 2024-09-14T09:10:01.879 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:01.879 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:01.879 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:01.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:01.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:01.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:01.879 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 67110 2024-09-14T09:10:01.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.879 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:01.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:01.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:10:01.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:01.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:10:01.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:01.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787606+0000", 2024-09-14T09:10:01.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6300000000000005e-07 2024-09-14T09:10:01.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:01.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787609+0000", 2024-09-14T09:10:01.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2789999999999999e-06 2024-09-14T09:10:01.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:01.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787616+0000", 2024-09-14T09:10:01.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8349999999999998e-06 2024-09-14T09:10:01.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:01.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787622+0000", 2024-09-14T09:10:01.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6999999999999996e-06 2024-09-14T09:10:01.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787666+0000", 2024-09-14T09:10:01.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3887000000000002e-05 2024-09-14T09:10:01.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:01.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787672+0000", 2024-09-14T09:10:01.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-09-14T09:10:01.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792033+0000", 2024-09-14T09:10:01.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043614250000000004 2024-09-14T09:10:01.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:01.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792041+0000", 2024-09-14T09:10:01.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5449999999999998e-06 2024-09-14T09:10:01.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:10:01.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0103013569999999 2024-09-14T09:10:01.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:01.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802355+0000", 2024-09-14T09:10:01.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2717999999999999e-05 2024-09-14T09:10:01.884 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.884 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:01.884 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.884 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72029 3.5 3.3f02ac5 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:01.884 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:10:01.884 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.001716373000001, 2024-09-14T09:10:01.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.014715139, 2024-09-14T09:10:01.885 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:01.885 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:01.885 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:01.885 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:01.885 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:01.885 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:01.885 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72029 2024-09-14T09:10:01.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.885 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:01.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:01.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:10:01.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:01.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:10:01.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:01.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:10:01.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7599999999999997e-07 2024-09-14T09:10:01.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:01.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787686+0000", 2024-09-14T09:10:01.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3999999999999999e-06 2024-09-14T09:10:01.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:01.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787692+0000", 2024-09-14T09:10:01.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3489999999999997e-06 2024-09-14T09:10:01.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:01.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787697+0000", 2024-09-14T09:10:01.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2320000000000001e-06 2024-09-14T09:10:01.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787742+0000", 2024-09-14T09:10:01.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4557e-05 2024-09-14T09:10:01.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:01.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787748+0000", 2024-09-14T09:10:01.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7810000000000002e-06 2024-09-14T09:10:01.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792065+0000", 2024-09-14T09:10:01.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043178679999999999 2024-09-14T09:10:01.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:01.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792073+0000", 2024-09-14T09:10:01.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6329999999999996e-06 2024-09-14T09:10:01.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802388+0000", 2024-09-14T09:10:01.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010315394 2024-09-14T09:10:01.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:01.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802398+0000", 2024-09-14T09:10:01.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4490000000000005e-06 2024-09-14T09:10:01.890 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.890 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:01.890 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.890 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72038 3.5 3.c914e45 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:01.890 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:10:01.890 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.001640739999999, 2024-09-14T09:10:01.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146757740000001, 2024-09-14T09:10:01.890 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:01.890 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:01.890 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:01.890 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:01.891 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:01.891 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:01.891 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72038 2024-09-14T09:10:01.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.891 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:01.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:01.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:10:01.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:01.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:10:01.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:01.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787759+0000", 2024-09-14T09:10:01.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0100000000000005e-07 2024-09-14T09:10:01.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:01.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787761+0000", 2024-09-14T09:10:01.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4049999999999998e-06 2024-09-14T09:10:01.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:01.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787768+0000", 2024-09-14T09:10:01.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.314e-06 2024-09-14T09:10:01.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:01.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787773+0000", 2024-09-14T09:10:01.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2789999999999998e-06 2024-09-14T09:10:01.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787813+0000", 2024-09-14T09:10:01.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9582000000000002e-05 2024-09-14T09:10:01.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:01.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787818+0000", 2024-09-14T09:10:01.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7100000000000004e-06 2024-09-14T09:10:01.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792096+0000", 2024-09-14T09:10:01.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042776460000000004 2024-09-14T09:10:01.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:01.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792103+0000", 2024-09-14T09:10:01.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7129999999999999e-06 2024-09-14T09:10:01.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802427+0000", 2024-09-14T09:10:01.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010324805 2024-09-14T09:10:01.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:01.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802434+0000", 2024-09-14T09:10:01.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:10:01.895 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.895 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:01.895 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.896 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:74840 3.5 3.ab2c8d25 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:01.896 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:10:01.896 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 44.979588855000003, 2024-09-14T09:10:01.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99271963600000002, 2024-09-14T09:10:01.896 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:01.896 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:01.896 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:01.896 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:01.896 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:01.897 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:01.897 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74840 2024-09-14T09:10:01.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.897 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:01.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:01.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:10:01.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:01.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:10:01.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:01.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:01.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809812+0000", 2024-09-14T09:10:01.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2899999999999999e-06 2024-09-14T09:10:01.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:01.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809817+0000", 2024-09-14T09:10:01.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0139999999999998e-06 2024-09-14T09:10:01.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:01.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809834+0000", 2024-09-14T09:10:01.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7643e-05 2024-09-14T09:10:01.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:01.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809842+0000", 2024-09-14T09:10:01.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2970000000000004e-06 2024-09-14T09:10:01.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809902+0000", 2024-09-14T09:10:01.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9106e-05 2024-09-14T09:10:01.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:01.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809912+0000", 2024-09-14T09:10:01.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0101e-05 2024-09-14T09:10:01.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:01.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802520+0000", 2024-09-14T09:10:01.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99260828599999995 2024-09-14T09:10:01.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:01.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:01.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:01.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802530+0000", 2024-09-14T09:10:01.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8989999999999996e-06 2024-09-14T09:10:01.900 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.900 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:01.901 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.901 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:01.901 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:01.901 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:01.901 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T09:10:01.902 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:10:01.903 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:10:01.904 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:10:01.904 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:01.904+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:02.003 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:02.004+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:02.049 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:02.049 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:02.049 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:10:02.049 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:02.057 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:10:02.103 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:02.105+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:02.161 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:02.161 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:02.161 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:10:02.161 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:10:02.161 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:02.169 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:10:02.210 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:02.212+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:02.305 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:02.307+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:02.312 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:02.312 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:10:02.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:10:02.313 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:10:02.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.313 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5349 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8302592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:02.313 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:10:02.313 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 85.058134375999998, 2024-09-14T09:10:02.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039875928999999997, 2024-09-14T09:10:02.313 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.313 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.313 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:10:02.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:02.313 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5349 2024-09-14T09:10:02.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.314 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:10:02.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:10:02.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255874+0000", 2024-09-14T09:10:02.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4900000000000001e-07 2024-09-14T09:10:02.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255880+0000", 2024-09-14T09:10:02.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9939999999999997e-06 2024-09-14T09:10:02.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255886+0000", 2024-09-14T09:10:02.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3899999999999998e-06 2024-09-14T09:10:02.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255891+0000", 2024-09-14T09:10:02.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.938e-06 2024-09-14T09:10:02.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295580+0000", 2024-09-14T09:10:02.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039688681000000003 2024-09-14T09:10:02.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295653+0000", 2024-09-14T09:10:02.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3045000000000003e-05 2024-09-14T09:10:02.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295749+0000", 2024-09-14T09:10:02.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6532000000000003e-05 2024-09-14T09:10:02.317 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.317 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.317 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.317 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5350 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8364032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:02.318 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:10:02.318 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 85.058110568999993, 2024-09-14T09:10:02.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039989719, 2024-09-14T09:10:02.318 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.318 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.318 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.318 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.318 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:10:02.318 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:02.318 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5350 2024-09-14T09:10:02.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.318 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:10:02.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:10:02.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255898+0000", 2024-09-14T09:10:02.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2024-09-14T09:10:02.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255899+0000", 2024-09-14T09:10:02.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9139999999999998e-06 2024-09-14T09:10:02.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255905+0000", 2024-09-14T09:10:02.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7289999999999997e-06 2024-09-14T09:10:02.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255910+0000", 2024-09-14T09:10:02.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6210000000000003e-06 2024-09-14T09:10:02.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295775+0000", 2024-09-14T09:10:02.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039864973999999997 2024-09-14T09:10:02.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295828+0000", 2024-09-14T09:10:02.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3411000000000001e-05 2024-09-14T09:10:02.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295887+0000", 2024-09-14T09:10:02.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699000000000002e-05 2024-09-14T09:10:02.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.322 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.322 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4639 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1843200~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:02.322 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:10:02.322 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.114195109999997, 2024-09-14T09:10:02.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040843672999999997, 2024-09-14T09:10:02.322 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.322 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.323 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:02.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:02.323 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4639 2024-09-14T09:10:02.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.323 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:10:02.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:10:02.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:10:02.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:10:02.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199818+0000", 2024-09-14T09:10:02.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1450000000000001e-06 2024-09-14T09:10:02.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199827+0000", 2024-09-14T09:10:02.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3999999999999998e-06 2024-09-14T09:10:02.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199834+0000", 2024-09-14T09:10:02.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0809999999999996e-06 2024-09-14T09:10:02.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240541+0000", 2024-09-14T09:10:02.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040706941000000003 2024-09-14T09:10:02.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240584+0000", 2024-09-14T09:10:02.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3040999999999997e-05 2024-09-14T09:10:02.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240656+0000", 2024-09-14T09:10:02.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2200000000000007e-05 2024-09-14T09:10:02.326 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.326 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.326 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.327 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4640 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1871872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:02.327 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:10:02.327 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.114160624999997, 2024-09-14T09:10:02.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040967601999999999, 2024-09-14T09:10:02.327 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.327 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.327 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.327 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.327 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:02.327 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:02.327 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4640 2024-09-14T09:10:02.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.328 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:10:02.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:10:02.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199848+0000", 2024-09-14T09:10:02.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5400000000000002e-07 2024-09-14T09:10:02.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199850+0000", 2024-09-14T09:10:02.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2479999999999999e-06 2024-09-14T09:10:02.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199857+0000", 2024-09-14T09:10:02.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.187e-06 2024-09-14T09:10:02.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199862+0000", 2024-09-14T09:10:02.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5119999999999999e-06 2024-09-14T09:10:02.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240684+0000", 2024-09-14T09:10:02.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040821245999999999 2024-09-14T09:10:02.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240739+0000", 2024-09-14T09:10:02.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4991999999999998e-05 2024-09-14T09:10:02.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240815+0000", 2024-09-14T09:10:02.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5963000000000004e-05 2024-09-14T09:10:02.331 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.331 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.331 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.331 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4641 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1900544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:02.331 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:10:02.331 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.114138295000004, 2024-09-14T09:10:02.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041205512, 2024-09-14T09:10:02.332 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.332 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.332 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:02.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:02.332 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4641 2024-09-14T09:10:02.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.332 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:10:02.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:10:02.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199870+0000", 2024-09-14T09:10:02.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0600000000000001e-07 2024-09-14T09:10:02.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199872+0000", 2024-09-14T09:10:02.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.928e-06 2024-09-14T09:10:02.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199877+0000", 2024-09-14T09:10:02.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6949999999999997e-06 2024-09-14T09:10:02.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199882+0000", 2024-09-14T09:10:02.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8210000000000001e-06 2024-09-14T09:10:02.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240847+0000", 2024-09-14T09:10:02.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040965201999999999 2024-09-14T09:10:02.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240888+0000", 2024-09-14T09:10:02.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0754000000000003e-05 2024-09-14T09:10:02.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241075+0000", 2024-09-14T09:10:02.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000186706 2024-09-14T09:10:02.335 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.336 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.336 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.336 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4642 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1929216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:02.336 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:10:02.336 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.114119360000004, 2024-09-14T09:10:02.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041292575999999998, 2024-09-14T09:10:02.336 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.336 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.336 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.336 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.337 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:02.337 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:02.337 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4642 2024-09-14T09:10:02.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.337 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:10:02.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:10:02.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199889+0000", 2024-09-14T09:10:02.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2024-09-14T09:10:02.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199891+0000", 2024-09-14T09:10:02.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9e-06 2024-09-14T09:10:02.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199896+0000", 2024-09-14T09:10:02.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6960000000000002e-06 2024-09-14T09:10:02.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199901+0000", 2024-09-14T09:10:02.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6720000000000003e-06 2024-09-14T09:10:02.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241089+0000", 2024-09-14T09:10:02.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041187594000000001 2024-09-14T09:10:02.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241126+0000", 2024-09-14T09:10:02.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7490999999999997e-05 2024-09-14T09:10:02.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241181+0000", 2024-09-14T09:10:02.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4823e-05 2024-09-14T09:10:02.340 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.341 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.341 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.341 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4643 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1957888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:02.341 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:10:02.341 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.114100081000004, 2024-09-14T09:10:02.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041418333000000002, 2024-09-14T09:10:02.341 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.341 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.341 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.341 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.341 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:02.342 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:02.342 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4643 2024-09-14T09:10:02.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.342 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:10:02.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:10:02.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:10:02.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5699999999999998e-07 2024-09-14T09:10:02.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199910+0000", 2024-09-14T09:10:02.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.829e-06 2024-09-14T09:10:02.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199916+0000", 2024-09-14T09:10:02.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8499999999999999e-06 2024-09-14T09:10:02.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199920+0000", 2024-09-14T09:10:02.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6530000000000002e-06 2024-09-14T09:10:02.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241211+0000", 2024-09-14T09:10:02.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041290327000000002 2024-09-14T09:10:02.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241257+0000", 2024-09-14T09:10:02.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6347000000000002e-05 2024-09-14T09:10:02.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241326+0000", 2024-09-14T09:10:02.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8969999999999999e-05 2024-09-14T09:10:02.345 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.345 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.345 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.346 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4644 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1986560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:02.346 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:10:02.346 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.114081741000007, 2024-09-14T09:10:02.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041596269999999998, 2024-09-14T09:10:02.346 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.346 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.346 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.346 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.346 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:02.346 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:02.346 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4644 2024-09-14T09:10:02.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.347 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:10:02.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:10:02.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:10:02.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.41e-07 2024-09-14T09:10:02.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199928+0000", 2024-09-14T09:10:02.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8250000000000001e-06 2024-09-14T09:10:02.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199934+0000", 2024-09-14T09:10:02.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2280000000000003e-06 2024-09-14T09:10:02.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199939+0000", 2024-09-14T09:10:02.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8010000000000003e-06 2024-09-14T09:10:02.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241360+0000", 2024-09-14T09:10:02.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041421289 2024-09-14T09:10:02.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241435+0000", 2024-09-14T09:10:02.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4238000000000003e-05 2024-09-14T09:10:02.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241522+0000", 2024-09-14T09:10:02.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7547999999999996e-05 2024-09-14T09:10:02.350 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.350 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.350 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.350 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4645 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:02.350 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:10:02.350 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.114062833999995, 2024-09-14T09:10:02.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041714660000000001, 2024-09-14T09:10:02.350 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.351 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.351 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.351 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.351 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:02.351 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:02.351 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4645 2024-09-14T09:10:02.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.351 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:10:02.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:10:02.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:10:02.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4700000000000002e-07 2024-09-14T09:10:02.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199947+0000", 2024-09-14T09:10:02.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.801e-06 2024-09-14T09:10:02.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199953+0000", 2024-09-14T09:10:02.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.694e-06 2024-09-14T09:10:02.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199957+0000", 2024-09-14T09:10:02.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3069999999999996e-06 2024-09-14T09:10:02.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241547+0000", 2024-09-14T09:10:02.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041589895000000002 2024-09-14T09:10:02.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241590+0000", 2024-09-14T09:10:02.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2985000000000003e-05 2024-09-14T09:10:02.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241660+0000", 2024-09-14T09:10:02.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9630999999999998e-05 2024-09-14T09:10:02.355 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.355 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.355 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.355 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4646 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2043904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:02.355 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:10:02.355 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.114044845999999, 2024-09-14T09:10:02.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041827171000000003, 2024-09-14T09:10:02.355 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.355 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.355 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.355 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.356 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:02.356 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:02.356 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4646 2024-09-14T09:10:02.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.356 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:10:02.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:10:02.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:10:02.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6300000000000001e-07 2024-09-14T09:10:02.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199965+0000", 2024-09-14T09:10:02.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.035e-06 2024-09-14T09:10:02.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199973+0000", 2024-09-14T09:10:02.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9629999999999998e-06 2024-09-14T09:10:02.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199978+0000", 2024-09-14T09:10:02.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9069999999999998e-06 2024-09-14T09:10:02.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241677+0000", 2024-09-14T09:10:02.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041698662999999997 2024-09-14T09:10:02.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241717+0000", 2024-09-14T09:10:02.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602999999999997e-05 2024-09-14T09:10:02.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241790+0000", 2024-09-14T09:10:02.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2637000000000003e-05 2024-09-14T09:10:02.359 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.359 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.359 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.360 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4647 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2072576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:02.360 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:10:02.360 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.114016255999999, 2024-09-14T09:10:02.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041921189999999997, 2024-09-14T09:10:02.360 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.360 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.360 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.360 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.360 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:02.360 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:02.360 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4647 2024-09-14T09:10:02.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.360 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:10:02.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:10:02.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199992+0000", 2024-09-14T09:10:02.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3799999999999997e-07 2024-09-14T09:10:02.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199994+0000", 2024-09-14T09:10:02.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3020000000000002e-06 2024-09-14T09:10:02.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200004+0000", 2024-09-14T09:10:02.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3510000000000008e-06 2024-09-14T09:10:02.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200008+0000", 2024-09-14T09:10:02.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3329999999999998e-06 2024-09-14T09:10:02.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241814+0000", 2024-09-14T09:10:02.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041806280000000001 2024-09-14T09:10:02.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241855+0000", 2024-09-14T09:10:02.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0173999999999999e-05 2024-09-14T09:10:02.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241913+0000", 2024-09-14T09:10:02.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8112000000000002e-05 2024-09-14T09:10:02.364 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.364 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.364 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.364 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:59017 3.3 3:c1df81d6:::rbd_data.1112a10502fe.0000000000000189:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:02.364 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:10:02.364 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.526725655, 2024-09-14T09:10:02.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.024252111, 2024-09-14T09:10:02.364 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.365 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.365 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:02.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:02.365 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59017 2024-09-14T09:10:02.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.365 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:10:02.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:10:02.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787284+0000", 2024-09-14T09:10:02.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3879999999999998e-06 2024-09-14T09:10:02.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787297+0000", 2024-09-14T09:10:02.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2184999999999999e-05 2024-09-14T09:10:02.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787317+0000", 2024-09-14T09:10:02.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0054000000000001e-05 2024-09-14T09:10:02.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787327+0000", 2024-09-14T09:10:02.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0335e-05 2024-09-14T09:10:02.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787412+0000", 2024-09-14T09:10:02.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4691000000000006e-05 2024-09-14T09:10:02.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:10:02.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787422+0000", 2024-09-14T09:10:02.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0718e-05 2024-09-14T09:10:02.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790539+0000", 2024-09-14T09:10:02.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031164600000000002 2024-09-14T09:10:02.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790552+0000", 2024-09-14T09:10:02.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2736e-05 2024-09-14T09:10:02.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.798725+0000", 2024-09-14T09:10:02.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0081731860000001 2024-09-14T09:10:02.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.798824+0000", 2024-09-14T09:10:02.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9600999999999997e-05 2024-09-14T09:10:02.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.811534+0000", 2024-09-14T09:10:02.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012709757 2024-09-14T09:10:02.370 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.370 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.370 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.370 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:63586 3.3 3:c0d9272b:::rbd_data.1112a10502fe.00000000000001a2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:02.370 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:10:02.370 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.526654172000001, 2024-09-14T09:10:02.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0244069650000001, 2024-09-14T09:10:02.370 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.370 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.370 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:02.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:02.371 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 63586 2024-09-14T09:10:02.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.371 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:10:02.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:10:02.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:10:02.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2024-09-14T09:10:02.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787357+0000", 2024-09-14T09:10:02.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8720000000000002e-06 2024-09-14T09:10:02.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787365+0000", 2024-09-14T09:10:02.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9270000000000005e-06 2024-09-14T09:10:02.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787372+0000", 2024-09-14T09:10:02.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6810000000000001e-06 2024-09-14T09:10:02.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787479+0000", 2024-09-14T09:10:02.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010736800000000001 2024-09-14T09:10:02.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:02.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787485+0000", 2024-09-14T09:10:02.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.054e-06 2024-09-14T09:10:02.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790580+0000", 2024-09-14T09:10:02.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030949929999999999 2024-09-14T09:10:02.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790589+0000", 2024-09-14T09:10:02.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7600000000000008e-06 2024-09-14T09:10:02.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.799541+0000", 2024-09-14T09:10:02.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0089520110000001 2024-09-14T09:10:02.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.799620+0000", 2024-09-14T09:10:02.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8969999999999998e-05 2024-09-14T09:10:02.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.811760+0000", 2024-09-14T09:10:02.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012140748999999999 2024-09-14T09:10:02.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.376 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.376 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:65817 3.3 3:c2c49fe0:::rbd_data.1112a10502fe.00000000000001b3:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:02.376 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:10:02.376 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.526564370000003, 2024-09-14T09:10:02.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0253660200000001, 2024-09-14T09:10:02.376 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.376 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 65817 2024-09-14T09:10:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:10:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:10:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787444+0000", 2024-09-14T09:10:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999995e-07 2024-09-14T09:10:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787448+0000", 2024-09-14T09:10:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1420000000000003e-06 2024-09-14T09:10:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787497+0000", 2024-09-14T09:10:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8507999999999997e-05 2024-09-14T09:10:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787503+0000", 2024-09-14T09:10:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1319999999999999e-06 2024-09-14T09:10:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787595+0000", 2024-09-14T09:10:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1748000000000003e-05 2024-09-14T09:10:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787601+0000", 2024-09-14T09:10:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6150000000000002e-06 2024-09-14T09:10:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790613+0000", 2024-09-14T09:10:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003012228 2024-09-14T09:10:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790621+0000", 2024-09-14T09:10:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9219999999999997e-06 2024-09-14T09:10:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800130+0000", 2024-09-14T09:10:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.009508474 2024-09-14T09:10:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800257+0000", 2024-09-14T09:10:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012746900000000001 2024-09-14T09:10:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.812809+0000", 2024-09-14T09:10:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012552054 2024-09-14T09:10:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:68709 3.3 3:c4996abd:::rbd_data.1112a10502fe.00000000000001cd:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:10:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.526393423999998, 2024-09-14T09:10:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0254506109999999, 2024-09-14T09:10:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 68709 2024-09-14T09:10:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:10:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:10:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787615+0000", 2024-09-14T09:10:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4000000000000001e-07 2024-09-14T09:10:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787618+0000", 2024-09-14T09:10:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2780000000000002e-06 2024-09-14T09:10:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787626+0000", 2024-09-14T09:10:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0250000000000002e-06 2024-09-14T09:10:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787633+0000", 2024-09-14T09:10:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5660000000000003e-06 2024-09-14T09:10:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787714+0000", 2024-09-14T09:10:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1695999999999998e-05 2024-09-14T09:10:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787721+0000", 2024-09-14T09:10:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1109999999999996e-06 2024-09-14T09:10:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790646+0000", 2024-09-14T09:10:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029251730000000001 2024-09-14T09:10:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790653+0000", 2024-09-14T09:10:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4379999999999998e-06 2024-09-14T09:10:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800750+0000", 2024-09-14T09:10:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010097236 2024-09-14T09:10:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800883+0000", 2024-09-14T09:10:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000132466 2024-09-14T09:10:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813065+0000", 2024-09-14T09:10:02.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012181981999999999 2024-09-14T09:10:02.388 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.388 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.388 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.388 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:74823 3.3 3:c59acf89:::rbd_data.1112a10502fe.00000000000001fb:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:02.388 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:10:02.388 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.505558952000001, 2024-09-14T09:10:02.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.004859323, 2024-09-14T09:10:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74823 2024-09-14T09:10:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:10:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:10:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808450+0000", 2024-09-14T09:10:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.92e-07 2024-09-14T09:10:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808454+0000", 2024-09-14T09:10:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3660000000000002e-06 2024-09-14T09:10:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808463+0000", 2024-09-14T09:10:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1579999999999994e-06 2024-09-14T09:10:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808470+0000", 2024-09-14T09:10:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7599999999999997e-06 2024-09-14T09:10:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808540+0000", 2024-09-14T09:10:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9991000000000001e-05 2024-09-14T09:10:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808550+0000", 2024-09-14T09:10:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0282000000000001e-05 2024-09-14T09:10:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801352+0000", 2024-09-14T09:10:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99280192700000003 2024-09-14T09:10:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801472+0000", 2024-09-14T09:10:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120184 2024-09-14T09:10:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813308+0000", 2024-09-14T09:10:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011835863 2024-09-14T09:10:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:86789 3.3 3:c3063f19:::rbd_data.1112a10502fe.000000000000023a:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:10:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 44.733336227000002, 2024-09-14T09:10:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.23302192099999999, 2024-09-14T09:10:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86789 2024-09-14T09:10:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:10:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:10:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580672+0000", 2024-09-14T09:10:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7999999999999993e-07 2024-09-14T09:10:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580680+0000", 2024-09-14T09:10:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7540000000000006e-06 2024-09-14T09:10:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580694+0000", 2024-09-14T09:10:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3344e-05 2024-09-14T09:10:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580702+0000", 2024-09-14T09:10:02.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9510000000000006e-06 2024-09-14T09:10:02.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580778+0000", 2024-09-14T09:10:02.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6580000000000002e-05 2024-09-14T09:10:02.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580788+0000", 2024-09-14T09:10:02.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0327e-05 2024-09-14T09:10:02.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801980+0000", 2024-09-14T09:10:02.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.22119123900000001 2024-09-14T09:10:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802115+0000", 2024-09-14T09:10:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013572000000000001 2024-09-14T09:10:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813693+0000", 2024-09-14T09:10:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011578026 2024-09-14T09:10:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:89485 3.3 3:c3eae671:::rbd_data.1112a10502fe.0000000000000248:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:10:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 44.628479732999999, 2024-09-14T09:10:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.12841583300000001, 2024-09-14T09:10:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 89485 2024-09-14T09:10:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:10:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:10:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685529+0000", 2024-09-14T09:10:02.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.11e-06 2024-09-14T09:10:02.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685534+0000", 2024-09-14T09:10:02.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0289999999999996e-06 2024-09-14T09:10:02.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685546+0000", 2024-09-14T09:10:02.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2062000000000001e-05 2024-09-14T09:10:02.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685554+0000", 2024-09-14T09:10:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7889999999999995e-06 2024-09-14T09:10:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685618+0000", 2024-09-14T09:10:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4487999999999996e-05 2024-09-14T09:10:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685628+0000", 2024-09-14T09:10:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5840000000000001e-06 2024-09-14T09:10:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802613+0000", 2024-09-14T09:10:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.116984703 2024-09-14T09:10:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802768+0000", 2024-09-14T09:10:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015541599999999999 2024-09-14T09:10:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813944+0000", 2024-09-14T09:10:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011175651999999999 2024-09-14T09:10:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:90751 3.3 3:c22bfcfe:::rbd_data.1112a10502fe.000000000000024e:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:10:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 44.577408949000002, 2024-09-14T09:10:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077582650000000003, 2024-09-14T09:10:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 90751 2024-09-14T09:10:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:10:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:10:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736600+0000", 2024-09-14T09:10:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.71e-07 2024-09-14T09:10:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736608+0000", 2024-09-14T09:10:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2679999999999994e-06 2024-09-14T09:10:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736620+0000", 2024-09-14T09:10:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2064e-05 2024-09-14T09:10:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736627+0000", 2024-09-14T09:10:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8129999999999998e-06 2024-09-14T09:10:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736676+0000", 2024-09-14T09:10:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.901e-05 2024-09-14T09:10:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736685+0000", 2024-09-14T09:10:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:10:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803227+0000", 2024-09-14T09:10:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066541874000000001 2024-09-14T09:10:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803381+0000", 2024-09-14T09:10:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015482500000000001 2024-09-14T09:10:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.814181+0000", 2024-09-14T09:10:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010799944000000001 2024-09-14T09:10:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:90760 3.3 3:c116ad26:::rbd_data.1112a10502fe.0000000000000251:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:10:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 44.577306632000003, 2024-09-14T09:10:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077694599000000003, 2024-09-14T09:10:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 90760 2024-09-14T09:10:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:10:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:10:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736702+0000", 2024-09-14T09:10:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0999999999999998e-07 2024-09-14T09:10:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736705+0000", 2024-09-14T09:10:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0120000000000001e-06 2024-09-14T09:10:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736711+0000", 2024-09-14T09:10:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6279999999999999e-06 2024-09-14T09:10:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736717+0000", 2024-09-14T09:10:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6200000000000004e-06 2024-09-14T09:10:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736765+0000", 2024-09-14T09:10:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7688000000000001e-05 2024-09-14T09:10:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736772+0000", 2024-09-14T09:10:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6529999999999994e-06 2024-09-14T09:10:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803886+0000", 2024-09-14T09:10:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067113795000000004 2024-09-14T09:10:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.804024+0000", 2024-09-14T09:10:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013782000000000001 2024-09-14T09:10:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.814396+0000", 2024-09-14T09:10:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010371773000000001 2024-09-14T09:10:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.415 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:02.417 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:10:02.417 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:02.419+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:02.518 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:02.520+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:02.560 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:02.560 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:02.560 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:10:02.560 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:02.569 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:10:02.618 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:02.620+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:02.670 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:02.670 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:02.670 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:10:02.670 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:10:02.671 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:02.679 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:10:02.719 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:02.721+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:02.783 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:10:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:10:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:10:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:228 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 360448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:10:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 90.987202916000001, 2024-09-14T09:10:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99234476999999999, 2024-09-14T09:10:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 228 2024-09-14T09:10:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:10:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:10:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796906+0000", 2024-09-14T09:10:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9399999999999995e-07 2024-09-14T09:10:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796917+0000", 2024-09-14T09:10:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0801e-05 2024-09-14T09:10:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796924+0000", 2024-09-14T09:10:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7750000000000004e-06 2024-09-14T09:10:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:10:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9972000000000001e-05 2024-09-14T09:10:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798671+0000", 2024-09-14T09:10:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017271330000000001 2024-09-14T09:10:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798675+0000", 2024-09-14T09:10:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.194e-06 2024-09-14T09:10:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789003+0000", 2024-09-14T09:10:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99032768400000004 2024-09-14T09:10:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789115+0000", 2024-09-14T09:10:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112236 2024-09-14T09:10:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789250+0000", 2024-09-14T09:10:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013548100000000001 2024-09-14T09:10:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:229 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 819200~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:10:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 90.987150693000004, 2024-09-14T09:10:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99287024599999996, 2024-09-14T09:10:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 229 2024-09-14T09:10:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:10:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:10:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:10:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999999e-07 2024-09-14T09:10:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796962+0000", 2024-09-14T09:10:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1479999999999999e-06 2024-09-14T09:10:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796967+0000", 2024-09-14T09:10:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1499999999999998e-06 2024-09-14T09:10:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:10:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-06 2024-09-14T09:10:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798688+0000", 2024-09-14T09:10:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017172660000000001 2024-09-14T09:10:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798691+0000", 2024-09-14T09:10:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:10:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789599+0000", 2024-09-14T09:10:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99090839399999997 2024-09-14T09:10:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789716+0000", 2024-09-14T09:10:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116474 2024-09-14T09:10:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789828+0000", 2024-09-14T09:10:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112293 2024-09-14T09:10:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:230 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1277952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:10:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 90.987130045000001, 2024-09-14T09:10:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99307501600000003, 2024-09-14T09:10:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 230 2024-09-14T09:10:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:10:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:10:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796979+0000", 2024-09-14T09:10:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.34e-07 2024-09-14T09:10:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796980+0000", 2024-09-14T09:10:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.53e-06 2024-09-14T09:10:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796986+0000", 2024-09-14T09:10:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9989999999999997e-06 2024-09-14T09:10:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796989+0000", 2024-09-14T09:10:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0340000000000001e-06 2024-09-14T09:10:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798702+0000", 2024-09-14T09:10:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001712756 2024-09-14T09:10:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798705+0000", 2024-09-14T09:10:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7750000000000001e-06 2024-09-14T09:10:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789870+0000", 2024-09-14T09:10:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991165026 2024-09-14T09:10:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789955+0000", 2024-09-14T09:10:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4839999999999994e-05 2024-09-14T09:10:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790053+0000", 2024-09-14T09:10:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8721999999999994e-05 2024-09-14T09:10:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:231 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:10:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 90.987114716999997, 2024-09-14T09:10:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99319130300000003, 2024-09-14T09:10:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 231 2024-09-14T09:10:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:10:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:10:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:10:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2024-09-14T09:10:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796995+0000", 2024-09-14T09:10:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2500000000000001e-06 2024-09-14T09:10:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796998+0000", 2024-09-14T09:10:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3230000000000002e-06 2024-09-14T09:10:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797001+0000", 2024-09-14T09:10:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7099999999999999e-06 2024-09-14T09:10:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798718+0000", 2024-09-14T09:10:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017168070000000001 2024-09-14T09:10:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798721+0000", 2024-09-14T09:10:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.853e-06 2024-09-14T09:10:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790077+0000", 2024-09-14T09:10:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991356393 2024-09-14T09:10:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790129+0000", 2024-09-14T09:10:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2240999999999997e-05 2024-09-14T09:10:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790185+0000", 2024-09-14T09:10:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5515e-05 2024-09-14T09:10:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:232 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2195456~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:10:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 90.987104060999997, 2024-09-14T09:10:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99329117899999997, 2024-09-14T09:10:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 232 2024-09-14T09:10:02.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:10:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:10:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797005+0000", 2024-09-14T09:10:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2024-09-14T09:10:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797006+0000", 2024-09-14T09:10:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3200000000000001e-06 2024-09-14T09:10:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797009+0000", 2024-09-14T09:10:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4680000000000001e-06 2024-09-14T09:10:02.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797012+0000", 2024-09-14T09:10:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4770000000000002e-06 2024-09-14T09:10:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798743+0000", 2024-09-14T09:10:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017312 2024-09-14T09:10:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798747+0000", 2024-09-14T09:10:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.484e-06 2024-09-14T09:10:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790201+0000", 2024-09-14T09:10:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99145419499999998 2024-09-14T09:10:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790241+0000", 2024-09-14T09:10:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0587999999999998e-05 2024-09-14T09:10:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790296+0000", 2024-09-14T09:10:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4212000000000002e-05 2024-09-14T09:10:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:233 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2654208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:10:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 90.987093438000002, 2024-09-14T09:10:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99337220100000001, 2024-09-14T09:10:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.813 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 233 2024-09-14T09:10:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:10:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:10:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:10:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:10:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:10:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.269e-06 2024-09-14T09:10:02.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797019+0000", 2024-09-14T09:10:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9519999999999999e-06 2024-09-14T09:10:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797022+0000", 2024-09-14T09:10:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6079999999999998e-06 2024-09-14T09:10:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798759+0000", 2024-09-14T09:10:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001737342 2024-09-14T09:10:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798762+0000", 2024-09-14T09:10:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:10:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790310+0000", 2024-09-14T09:10:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99154738799999997 2024-09-14T09:10:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790349+0000", 2024-09-14T09:10:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9573000000000002e-05 2024-09-14T09:10:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790387+0000", 2024-09-14T09:10:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7985999999999998e-05 2024-09-14T09:10:02.818 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.819 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.819 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.819 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:234 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3112960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:02.819 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:10:02.819 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 90.987083393000006, 2024-09-14T09:10:02.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99345674500000003, 2024-09-14T09:10:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 234 2024-09-14T09:10:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:10:02.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:10:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:10:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0100000000000001e-07 2024-09-14T09:10:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:10:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0699999999999999e-06 2024-09-14T09:10:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:10:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.886e-06 2024-09-14T09:10:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797032+0000", 2024-09-14T09:10:02.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7149999999999998e-06 2024-09-14T09:10:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798778+0000", 2024-09-14T09:10:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017460329999999999 2024-09-14T09:10:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798783+0000", 2024-09-14T09:10:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0760000000000002e-06 2024-09-14T09:10:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790408+0000", 2024-09-14T09:10:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99162473299999998 2024-09-14T09:10:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790446+0000", 2024-09-14T09:10:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8389000000000001e-05 2024-09-14T09:10:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790482+0000", 2024-09-14T09:10:02.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5642000000000002e-05 2024-09-14T09:10:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:235 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3571712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:10:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 90.987073495000004, 2024-09-14T09:10:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993539477, 2024-09-14T09:10:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 235 2024-09-14T09:10:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:10:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:10:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:10:02.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9999999999999999e-07 2024-09-14T09:10:02.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797036+0000", 2024-09-14T09:10:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.051e-06 2024-09-14T09:10:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797039+0000", 2024-09-14T09:10:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:10:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797042+0000", 2024-09-14T09:10:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5280000000000002e-06 2024-09-14T09:10:02.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798809+0000", 2024-09-14T09:10:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001767394 2024-09-14T09:10:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798815+0000", 2024-09-14T09:10:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0859999999999998e-06 2024-09-14T09:10:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790502+0000", 2024-09-14T09:10:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99168652300000004 2024-09-14T09:10:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790539+0000", 2024-09-14T09:10:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7471000000000001e-05 2024-09-14T09:10:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790574+0000", 2024-09-14T09:10:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5292e-05 2024-09-14T09:10:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.830 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.831 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.831 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:236 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 4030464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:02.831 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:10:02.831 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 90.987063262000007, 2024-09-14T09:10:02.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993619743, 2024-09-14T09:10:02.831 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.831 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 236 2024-09-14T09:10:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:10:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:10:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:10:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1400000000000001e-07 2024-09-14T09:10:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797047+0000", 2024-09-14T09:10:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3400000000000001e-06 2024-09-14T09:10:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:10:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0699999999999998e-06 2024-09-14T09:10:02.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797053+0000", 2024-09-14T09:10:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7310000000000002e-06 2024-09-14T09:10:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798839+0000", 2024-09-14T09:10:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001786403 2024-09-14T09:10:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798844+0000", 2024-09-14T09:10:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3730000000000001e-06 2024-09-14T09:10:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790592+0000", 2024-09-14T09:10:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99174818099999995 2024-09-14T09:10:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790628+0000", 2024-09-14T09:10:02.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5831000000000003e-05 2024-09-14T09:10:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790665+0000", 2024-09-14T09:10:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-05 2024-09-14T09:10:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.837 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:365 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:10:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 90.984876233999998, 2024-09-14T09:10:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157278400000004, 2024-09-14T09:10:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 365 2024-09-14T09:10:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:10:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:10:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:10:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:10:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799233+0000", 2024-09-14T09:10:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.057e-06 2024-09-14T09:10:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799236+0000", 2024-09-14T09:10:02.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0249999999999998e-06 2024-09-14T09:10:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799239+0000", 2024-09-14T09:10:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.481e-06 2024-09-14T09:10:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800963+0000", 2024-09-14T09:10:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017240440000000001 2024-09-14T09:10:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800969+0000", 2024-09-14T09:10:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1410000000000002e-06 2024-09-14T09:10:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790682+0000", 2024-09-14T09:10:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98971330300000004 2024-09-14T09:10:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790753+0000", 2024-09-14T09:10:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0548000000000003e-05 2024-09-14T09:10:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790805+0000", 2024-09-14T09:10:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1981999999999998e-05 2024-09-14T09:10:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:366 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:10:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 90.984866140999998, 2024-09-14T09:10:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99173757299999998, 2024-09-14T09:10:02.843 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 366 2024-09-14T09:10:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:10:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:10:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:10:02.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-07 2024-09-14T09:10:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799244+0000", 2024-09-14T09:10:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.359e-06 2024-09-14T09:10:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799247+0000", 2024-09-14T09:10:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4929999999999998e-06 2024-09-14T09:10:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799250+0000", 2024-09-14T09:10:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:10:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800991+0000", 2024-09-14T09:10:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017412809999999999 2024-09-14T09:10:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800997+0000", 2024-09-14T09:10:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:10:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790824+0000", 2024-09-14T09:10:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98982735399999999 2024-09-14T09:10:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790891+0000", 2024-09-14T09:10:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7243999999999995e-05 2024-09-14T09:10:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790980+0000", 2024-09-14T09:10:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8608000000000003e-05 2024-09-14T09:10:02.848 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:367 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:10:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 90.984854768999995, 2024-09-14T09:10:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99188259999999995, 2024-09-14T09:10:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:02.849 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 367 2024-09-14T09:10:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:10:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:10:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:10:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-07 2024-09-14T09:10:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799255+0000", 2024-09-14T09:10:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.111e-06 2024-09-14T09:10:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799259+0000", 2024-09-14T09:10:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8650000000000003e-06 2024-09-14T09:10:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799262+0000", 2024-09-14T09:10:02.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.128e-06 2024-09-14T09:10:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801029+0000", 2024-09-14T09:10:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017668460000000001 2024-09-14T09:10:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801032+0000", 2024-09-14T09:10:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3179999999999998e-06 2024-09-14T09:10:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791011+0000", 2024-09-14T09:10:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98997920399999995 2024-09-14T09:10:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791077+0000", 2024-09-14T09:10:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5214000000000003e-05 2024-09-14T09:10:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791136+0000", 2024-09-14T09:10:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9710000000000003e-05 2024-09-14T09:10:02.854 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:368 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:10:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 90.984843225999995, 2024-09-14T09:10:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99201753800000003, 2024-09-14T09:10:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.855 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 368 2024-09-14T09:10:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:10:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:10:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:10:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4900000000000002e-07 2024-09-14T09:10:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799267+0000", 2024-09-14T09:10:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.079e-06 2024-09-14T09:10:02.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799270+0000", 2024-09-14T09:10:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.993e-06 2024-09-14T09:10:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799272+0000", 2024-09-14T09:10:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.695e-06 2024-09-14T09:10:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801043+0000", 2024-09-14T09:10:02.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001771105 2024-09-14T09:10:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801046+0000", 2024-09-14T09:10:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7999999999999999e-06 2024-09-14T09:10:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791150+0000", 2024-09-14T09:10:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99010348699999995 2024-09-14T09:10:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791193+0000", 2024-09-14T09:10:02.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3615999999999997e-05 2024-09-14T09:10:02.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791283+0000", 2024-09-14T09:10:02.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9513999999999997e-05 2024-09-14T09:10:02.860 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.860 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.860 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:369 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:10:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 90.984832888, 2024-09-14T09:10:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99213433600000001, 2024-09-14T09:10:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.861 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 369 2024-09-14T09:10:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:10:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:10:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:10:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:10:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799277+0000", 2024-09-14T09:10:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.108e-06 2024-09-14T09:10:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799280+0000", 2024-09-14T09:10:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:10:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799283+0000", 2024-09-14T09:10:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.531e-06 2024-09-14T09:10:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801058+0000", 2024-09-14T09:10:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001775085 2024-09-14T09:10:02.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801060+0000", 2024-09-14T09:10:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8260000000000001e-06 2024-09-14T09:10:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791299+0000", 2024-09-14T09:10:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99023856799999999 2024-09-14T09:10:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791352+0000", 2024-09-14T09:10:02.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2528000000000003e-05 2024-09-14T09:10:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791410+0000", 2024-09-14T09:10:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8298000000000003e-05 2024-09-14T09:10:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:370 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2457600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:10:02.866 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 90.984808121, 2024-09-14T09:10:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99220795399999995, 2024-09-14T09:10:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 370 2024-09-14T09:10:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:10:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:10:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799301+0000", 2024-09-14T09:10:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2024-09-14T09:10:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799303+0000", 2024-09-14T09:10:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9319999999999999e-06 2024-09-14T09:10:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799310+0000", 2024-09-14T09:10:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8680000000000001e-06 2024-09-14T09:10:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799315+0000", 2024-09-14T09:10:02.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.921e-06 2024-09-14T09:10:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801071+0000", 2024-09-14T09:10:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001756678 2024-09-14T09:10:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801080+0000", 2024-09-14T09:10:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6060000000000003e-06 2024-09-14T09:10:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791429+0000", 2024-09-14T09:10:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99034944599999997 2024-09-14T09:10:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791471+0000", 2024-09-14T09:10:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1279999999999998e-05 2024-09-14T09:10:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791508+0000", 2024-09-14T09:10:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7663999999999997e-05 2024-09-14T09:10:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.871 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:371 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2916352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:10:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 90.984786948999997, 2024-09-14T09:10:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99228692299999999, 2024-09-14T09:10:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 371 2024-09-14T09:10:02.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:10:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:10:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799322+0000", 2024-09-14T09:10:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:10:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799333+0000", 2024-09-14T09:10:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1044e-05 2024-09-14T09:10:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799341+0000", 2024-09-14T09:10:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8439999999999998e-06 2024-09-14T09:10:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799354+0000", 2024-09-14T09:10:02.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3114e-05 2024-09-14T09:10:02.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801093+0000", 2024-09-14T09:10:02.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017385910000000001 2024-09-14T09:10:02.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801096+0000", 2024-09-14T09:10:02.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0680000000000001e-06 2024-09-14T09:10:02.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791528+0000", 2024-09-14T09:10:02.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99043264200000003 2024-09-14T09:10:02.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791570+0000", 2024-09-14T09:10:02.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2144999999999997e-05 2024-09-14T09:10:02.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791608+0000", 2024-09-14T09:10:02.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7966000000000002e-05 2024-09-14T09:10:02.876 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.877 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.877 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.877 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:372 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3375104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:02.877 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:10:02.877 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 90.984746400999995, 2024-09-14T09:10:02.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992342897, 2024-09-14T09:10:02.877 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.877 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.877 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.878 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.878 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:02.878 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:02.878 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 372 2024-09-14T09:10:02.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.878 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:10:02.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:10:02.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799363+0000", 2024-09-14T09:10:02.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2024-09-14T09:10:02.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799365+0000", 2024-09-14T09:10:02.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5500000000000001e-06 2024-09-14T09:10:02.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799371+0000", 2024-09-14T09:10:02.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2500000000000003e-06 2024-09-14T09:10:02.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799377+0000", 2024-09-14T09:10:02.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7509999999999997e-06 2024-09-14T09:10:02.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801107+0000", 2024-09-14T09:10:02.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017298019999999999 2024-09-14T09:10:02.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801111+0000", 2024-09-14T09:10:02.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8619999999999996e-06 2024-09-14T09:10:02.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791626+0000", 2024-09-14T09:10:02.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99051563300000001 2024-09-14T09:10:02.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791668+0000", 2024-09-14T09:10:02.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1424000000000002e-05 2024-09-14T09:10:02.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791705+0000", 2024-09-14T09:10:02.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7035e-05 2024-09-14T09:10:02.882 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.882 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.882 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.883 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:373 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:02.883 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:10:02.883 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 90.984724455999995, 2024-09-14T09:10:02.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99253589399999997, 2024-09-14T09:10:02.883 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.883 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.883 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:02.883 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.883 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:02.883 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:02.883 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 373 2024-09-14T09:10:02.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.884 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:10:02.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:10:02.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:10:02.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2024-09-14T09:10:02.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799387+0000", 2024-09-14T09:10:02.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1019999999999999e-06 2024-09-14T09:10:02.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799393+0000", 2024-09-14T09:10:02.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0190000000000003e-06 2024-09-14T09:10:02.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799398+0000", 2024-09-14T09:10:02.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:10:02.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801123+0000", 2024-09-14T09:10:02.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017251949999999999 2024-09-14T09:10:02.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801126+0000", 2024-09-14T09:10:02.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9280000000000002e-06 2024-09-14T09:10:02.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791746+0000", 2024-09-14T09:10:02.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99062036899999995 2024-09-14T09:10:02.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:02.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791835+0000", 2024-09-14T09:10:02.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9004000000000004e-05 2024-09-14T09:10:02.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791920+0000", 2024-09-14T09:10:02.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4524000000000006e-05 2024-09-14T09:10:02.888 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.888 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.888 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.888 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:60352 3.0 3.6d62a5c0 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:02.888 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:10:02.888 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 46.402088618000001, 2024-09-14T09:10:02.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41710537399999997, 2024-09-14T09:10:02.888 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.888 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.889 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:02.889 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.889 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:02.889 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:02.889 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 60352 2024-09-14T09:10:02.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.889 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:10:02.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:10:02.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382044+0000", 2024-09-14T09:10:02.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4640000000000001e-05 2024-09-14T09:10:02.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382048+0000", 2024-09-14T09:10:02.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4690000000000002e-06 2024-09-14T09:10:02.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382053+0000", 2024-09-14T09:10:02.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:10:02.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382068+0000", 2024-09-14T09:10:02.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4399000000000001e-05 2024-09-14T09:10:02.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382121+0000", 2024-09-14T09:10:02.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3578000000000001e-05 2024-09-14T09:10:02.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382127+0000", 2024-09-14T09:10:02.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2024-09-14T09:10:02.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799116+0000", 2024-09-14T09:10:02.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.416988566 2024-09-14T09:10:02.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799125+0000", 2024-09-14T09:10:02.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3100000000000006e-06 2024-09-14T09:10:02.893 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.893 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.894 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.894 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:63559 3.0 3.95b285c0 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:02.894 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:10:02.894 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 46.396257245000001, 2024-09-14T09:10:02.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.411301215, 2024-09-14T09:10:02.894 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:02.894 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:02.894 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:02.894 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:02.894 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:02.894 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:02.895 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 63559 2024-09-14T09:10:02.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.895 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:02.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:02.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:10:02.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:02.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:10:02.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:02.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:02.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:10:02.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2499999999999999e-07 2024-09-14T09:10:02.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:02.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387853+0000", 2024-09-14T09:10:02.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.477e-06 2024-09-14T09:10:02.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:02.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387856+0000", 2024-09-14T09:10:02.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1429999999999998e-06 2024-09-14T09:10:02.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:02.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387859+0000", 2024-09-14T09:10:02.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.582e-06 2024-09-14T09:10:02.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387888+0000", 2024-09-14T09:10:02.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9609000000000001e-05 2024-09-14T09:10:02.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:02.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387893+0000", 2024-09-14T09:10:02.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6779999999999999e-06 2024-09-14T09:10:02.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:02.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799143+0000", 2024-09-14T09:10:02.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41124997099999999 2024-09-14T09:10:02.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:02.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:02.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:02.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799152+0000", 2024-09-14T09:10:02.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5300000000000002e-06 2024-09-14T09:10:02.902 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.902 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.902 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.902 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:02.902 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:02.902 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:02.903 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is unset 2024-09-14T09:10:02.904 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:02.905+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:02.904 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:10:03.004 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:03.006+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:03.057 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:03.057 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:03.057 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:10:03.058 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:03.066 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:10:03.106 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:03.108+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:03.167 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:03.167 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:03.167 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:10:03.167 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:10:03.167 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:03.175 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:10:03.220 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:03.222+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:03.279 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:03.279 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:10:03.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:10:03.279 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:10:03.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.280 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55979 3.e 3:740d1568:::rbd_data.1112a10502fe.0000000000000133:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:03.280 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:10:03.280 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 47.429975427000002, 2024-09-14T09:10:03.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.95211669700000001, 2024-09-14T09:10:03.280 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.280 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.280 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:10:03.280 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.280 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:03.280 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:03.280 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55979 2024-09-14T09:10:03.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.281 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:10:03.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:10:03.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850380+0000", 2024-09-14T09:10:03.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.615e-06 2024-09-14T09:10:03.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850386+0000", 2024-09-14T09:10:03.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8000000000000001e-06 2024-09-14T09:10:03.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850403+0000", 2024-09-14T09:10:03.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6339999999999999e-05 2024-09-14T09:10:03.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850413+0000", 2024-09-14T09:10:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8609999999999993e-06 2024-09-14T09:10:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851033+0000", 2024-09-14T09:10:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062034700000000004 2024-09-14T09:10:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:10:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851042+0000", 2024-09-14T09:10:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8340000000000005e-06 2024-09-14T09:10:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853175+0000", 2024-09-14T09:10:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0021332809999999999 2024-09-14T09:10:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853183+0000", 2024-09-14T09:10:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:10:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795232+0000", 2024-09-14T09:10:03.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94204854900000001 2024-09-14T09:10:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795413+0000", 2024-09-14T09:10:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018059200000000001 2024-09-14T09:10:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:10:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795717+0000", 2024-09-14T09:10:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000304636 2024-09-14T09:10:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:10:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799631+0000", 2024-09-14T09:10:03.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136910000000004 2024-09-14T09:10:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:10:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802290+0000", 2024-09-14T09:10:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026588010000000001 2024-09-14T09:10:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:10:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802362+0000", 2024-09-14T09:10:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2018000000000001e-05 2024-09-14T09:10:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802495+0000", 2024-09-14T09:10:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000132967 2024-09-14T09:10:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55990 3.e 3:72d6260e:::rbd_data.1112a10502fe.000000000000016c:head [stat,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:10:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 47.429914119999999, 2024-09-14T09:10:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.952433164, 2024-09-14T09:10:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.287 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55990 2024-09-14T09:10:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:10:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:10:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850440+0000", 2024-09-14T09:10:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5199999999999996e-07 2024-09-14T09:10:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850444+0000", 2024-09-14T09:10:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.019e-06 2024-09-14T09:10:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850452+0000", 2024-09-14T09:10:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0209999999999999e-06 2024-09-14T09:10:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850457+0000", 2024-09-14T09:10:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9529999999999998e-06 2024-09-14T09:10:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851100+0000", 2024-09-14T09:10:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00064299699999999997 2024-09-14T09:10:03.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851108+0000", 2024-09-14T09:10:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2279999999999998e-06 2024-09-14T09:10:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853208+0000", 2024-09-14T09:10:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020996579999999999 2024-09-14T09:10:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853213+0000", 2024-09-14T09:10:03.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4029999999999998e-06 2024-09-14T09:10:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796098+0000", 2024-09-14T09:10:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94288483700000003 2024-09-14T09:10:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796247+0000", 2024-09-14T09:10:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014925800000000001 2024-09-14T09:10:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802872+0000", 2024-09-14T09:10:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006625138 2024-09-14T09:10:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:10:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 47.265675346999998, 2024-09-14T09:10:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77465830800000002, 2024-09-14T09:10:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:03.293 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 58987 2024-09-14T09:10:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:10:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:10:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014680+0000", 2024-09-14T09:10:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9250000000000002e-06 2024-09-14T09:10:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014689+0000", 2024-09-14T09:10:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9730000000000003e-06 2024-09-14T09:10:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014709+0000", 2024-09-14T09:10:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9641999999999999e-05 2024-09-14T09:10:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014720+0000", 2024-09-14T09:10:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-09-14T09:10:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014796+0000", 2024-09-14T09:10:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6567000000000001e-05 2024-09-14T09:10:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014808+0000", 2024-09-14T09:10:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1435e-05 2024-09-14T09:10:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789325+0000", 2024-09-14T09:10:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77451705999999998 2024-09-14T09:10:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789336+0000", 2024-09-14T09:10:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1466e-05 2024-09-14T09:10:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:59017 3.3 3.6b81fb83 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:10:03.298 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 47.264022943000001, 2024-09-14T09:10:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77253447099999994, 2024-09-14T09:10:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 59017 2024-09-14T09:10:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:10:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:10:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016332+0000", 2024-09-14T09:10:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3459999999999999e-06 2024-09-14T09:10:03.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016337+0000", 2024-09-14T09:10:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.48e-06 2024-09-14T09:10:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016355+0000", 2024-09-14T09:10:03.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7955e-05 2024-09-14T09:10:03.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016364+0000", 2024-09-14T09:10:03.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.02e-06 2024-09-14T09:10:03.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016433+0000", 2024-09-14T09:10:03.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8398000000000005e-05 2024-09-14T09:10:03.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:03.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016442+0000", 2024-09-14T09:10:03.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1819999999999995e-06 2024-09-14T09:10:03.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788855+0000", 2024-09-14T09:10:03.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77241356299999997 2024-09-14T09:10:03.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788865+0000", 2024-09-14T09:10:03.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5270000000000004e-06 2024-09-14T09:10:03.305 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.305 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.306 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.308 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60343 3.e 3:721b16e6:::rbd_data.1112a10502fe.000000000000014b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:03.309 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:10:03.309 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 47.160053341000001, 2024-09-14T09:10:03.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68876920900000005, 2024-09-14T09:10:03.309 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.309 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.310 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:10:03.310 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.310 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:03.310 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:03.310 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60343 2024-09-14T09:10:03.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.310 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:10:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:10:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120302+0000", 2024-09-14T09:10:03.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0279999999999999e-06 2024-09-14T09:10:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120310+0000", 2024-09-14T09:10:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4330000000000004e-06 2024-09-14T09:10:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120333+0000", 2024-09-14T09:10:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2200000000000001e-05 2024-09-14T09:10:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120343+0000", 2024-09-14T09:10:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0560000000000001e-05 2024-09-14T09:10:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120414+0000", 2024-09-14T09:10:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0493000000000004e-05 2024-09-14T09:10:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120424+0000", 2024-09-14T09:10:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.059e-05 2024-09-14T09:10:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796679+0000", 2024-09-14T09:10:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67625512700000001 2024-09-14T09:10:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796833+0000", 2024-09-14T09:10:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015403500000000001 2024-09-14T09:10:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:10:03.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797239+0000", 2024-09-14T09:10:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040503000000000002 2024-09-14T09:10:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:10:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802918+0000", 2024-09-14T09:10:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056796199999999998 2024-09-14T09:10:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:10:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808655+0000", 2024-09-14T09:10:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057365089999999999 2024-09-14T09:10:03.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:10:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808850+0000", 2024-09-14T09:10:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000194904 2024-09-14T09:10:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809069+0000", 2024-09-14T09:10:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021968000000000001 2024-09-14T09:10:03.316 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60356 3.2 3:40f9e9e7:::rbd_data.1112a10502fe.0000000000000160:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:10:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 47.158990828, 2024-09-14T09:10:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68053790800000002, 2024-09-14T09:10:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:10:03.317 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60356 2024-09-14T09:10:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:10:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:10:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121364+0000", 2024-09-14T09:10:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.173e-06 2024-09-14T09:10:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121371+0000", 2024-09-14T09:10:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-09-14T09:10:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121386+0000", 2024-09-14T09:10:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4925e-05 2024-09-14T09:10:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121395+0000", 2024-09-14T09:10:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8190000000000003e-06 2024-09-14T09:10:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121464+0000", 2024-09-14T09:10:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8149000000000001e-05 2024-09-14T09:10:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121474+0000", 2024-09-14T09:10:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0927999999999999e-05 2024-09-14T09:10:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795901+0000", 2024-09-14T09:10:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67442645499999998 2024-09-14T09:10:03.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796068+0000", 2024-09-14T09:10:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016655700000000001 2024-09-14T09:10:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 3", 2024-09-14T09:10:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796354+0000", 2024-09-14T09:10:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00028646999999999999 2024-09-14T09:10:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:10:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.800348+0000", 2024-09-14T09:10:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039943119999999999 2024-09-14T09:10:03.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:10:03.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801690+0000", 2024-09-14T09:10:03.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013415090000000001 2024-09-14T09:10:03.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:10:03.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801771+0000", 2024-09-14T09:10:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1678e-05 2024-09-14T09:10:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801900+0000", 2024-09-14T09:10:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000128978 2024-09-14T09:10:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.324 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62163 3.e 3:713ab431:::rbd_data.1112a10502fe.0000000000000198:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:10:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 47.068620621000001, 2024-09-14T09:10:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.597552682, 2024-09-14T09:10:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:03.325 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62163 2024-09-14T09:10:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:10:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:10:03.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211735+0000", 2024-09-14T09:10:03.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1110000000000002e-06 2024-09-14T09:10:03.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211744+0000", 2024-09-14T09:10:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0790000000000007e-06 2024-09-14T09:10:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211765+0000", 2024-09-14T09:10:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1114000000000001e-05 2024-09-14T09:10:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211775+0000", 2024-09-14T09:10:03.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0033e-05 2024-09-14T09:10:03.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211847+0000", 2024-09-14T09:10:03.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1503999999999998e-05 2024-09-14T09:10:03.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211857+0000", 2024-09-14T09:10:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0378e-05 2024-09-14T09:10:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799140+0000", 2024-09-14T09:10:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.58728279100000003 2024-09-14T09:10:03.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799289+0000", 2024-09-14T09:10:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000148966 2024-09-14T09:10:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809285+0000", 2024-09-14T09:10:03.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099967059999999993 2024-09-14T09:10:03.332 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.332 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.332 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.332 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63582 3.2 3:467f2009:::rbd_data.1112a10502fe.00000000000001a1:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:03.332 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:10:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.993427504000003, 2024-09-14T09:10:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51869012999999997, 2024-09-14T09:10:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63582 2024-09-14T09:10:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:10:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:10:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286928+0000", 2024-09-14T09:10:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.812e-06 2024-09-14T09:10:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286936+0000", 2024-09-14T09:10:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2390000000000002e-06 2024-09-14T09:10:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286955+0000", 2024-09-14T09:10:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8853000000000001e-05 2024-09-14T09:10:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286972+0000", 2024-09-14T09:10:03.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7365000000000001e-05 2024-09-14T09:10:03.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287052+0000", 2024-09-14T09:10:03.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9491000000000002e-05 2024-09-14T09:10:03.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287063+0000", 2024-09-14T09:10:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1620999999999999e-05 2024-09-14T09:10:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796696+0000", 2024-09-14T09:10:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50963256999999995 2024-09-14T09:10:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796847+0000", 2024-09-14T09:10:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015126899999999999 2024-09-14T09:10:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.805616+0000", 2024-09-14T09:10:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087689099999999996 2024-09-14T09:10:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63586 3.3 3.d4e49b03 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:03.339 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:10:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.993343123000002, 2024-09-14T09:10:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50188935099999998, 2024-09-14T09:10:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63586 2024-09-14T09:10:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.340 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:10:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:10:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287011+0000", 2024-09-14T09:10:03.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.61e-07 2024-09-14T09:10:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287014+0000", 2024-09-14T09:10:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3900000000000002e-06 2024-09-14T09:10:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287023+0000", 2024-09-14T09:10:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3380000000000005e-06 2024-09-14T09:10:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287029+0000", 2024-09-14T09:10:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0079999999999999e-06 2024-09-14T09:10:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287087+0000", 2024-09-14T09:10:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8322000000000002e-05 2024-09-14T09:10:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287096+0000", 2024-09-14T09:10:03.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8580000000000006e-06 2024-09-14T09:10:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788891+0000", 2024-09-14T09:10:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50179498499999997 2024-09-14T09:10:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788900+0000", 2024-09-14T09:10:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.789e-06 2024-09-14T09:10:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60363 3.1d 3:b8b44067:::rbd_data.1112a10502fe.000000000000018b:head [stat,delete] snapc 21=[21] RETRY=12 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:10:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.492621385, 2024-09-14T09:10:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268612690000001, 2024-09-14T09:10:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.345 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60363 2024-09-14T09:10:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:10:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:10:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787733+0000", 2024-09-14T09:10:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.314e-06 2024-09-14T09:10:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787739+0000", 2024-09-14T09:10:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5300000000000004e-06 2024-09-14T09:10:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787750+0000", 2024-09-14T09:10:03.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1251e-05 2024-09-14T09:10:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:10:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0739999999999993e-06 2024-09-14T09:10:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787827+0000", 2024-09-14T09:10:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8861000000000004e-05 2024-09-14T09:10:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:10:03.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787836+0000", 2024-09-14T09:10:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1339999999999993e-06 2024-09-14T09:10:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789335+0000", 2024-09-14T09:10:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014988289999999999 2024-09-14T09:10:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789343+0000", 2024-09-14T09:10:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6639999999999998e-06 2024-09-14T09:10:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799170+0000", 2024-09-14T09:10:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098272500000001 2024-09-14T09:10:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799377+0000", 2024-09-14T09:10:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000207126 2024-09-14T09:10:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814593+0000", 2024-09-14T09:10:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015216235999999999 2024-09-14T09:10:03.350 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63565 3.1d 3:bdc63b28:::rbd_data.1112a10502fe.000000000000016d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=9 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:10:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.492575594000002, 2024-09-14T09:10:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0271114539999999, 2024-09-14T09:10:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:10:03.351 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.352 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:03.352 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:03.352 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63565 2024-09-14T09:10:03.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.352 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:10:03.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:10:03.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:10:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6899999999999998e-07 2024-09-14T09:10:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787781+0000", 2024-09-14T09:10:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8909999999999999e-06 2024-09-14T09:10:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787787+0000", 2024-09-14T09:10:03.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3230000000000003e-06 2024-09-14T09:10:03.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787793+0000", 2024-09-14T09:10:03.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-09-14T09:10:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789455+0000", 2024-09-14T09:10:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001661596 2024-09-14T09:10:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:03.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789463+0000", 2024-09-14T09:10:03.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4889999999999995e-06 2024-09-14T09:10:03.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800115+0000", 2024-09-14T09:10:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0106512670000001 2024-09-14T09:10:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800334+0000", 2024-09-14T09:10:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000219213 2024-09-14T09:10:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:10:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800651+0000", 2024-09-14T09:10:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00031765500000000002 2024-09-14T09:10:03.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:10:03.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.811875+0000", 2024-09-14T09:10:03.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011224032 2024-09-14T09:10:03.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:10:03.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814665+0000", 2024-09-14T09:10:03.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002789606 2024-09-14T09:10:03.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:10:03.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814742+0000", 2024-09-14T09:10:03.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6916999999999996e-05 2024-09-14T09:10:03.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814889+0000", 2024-09-14T09:10:03.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014725799999999999 2024-09-14T09:10:03.362 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.362 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.362 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.362 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:67113 3.1d 3:bba7fe0d:::rbd_data.1112a10502fe.00000000000001bf:head [stat,delete] snapc 21=[21] RETRY=4 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:03.363 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:10:03.363 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.491814736000002, 2024-09-14T09:10:03.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0265995649999999, 2024-09-14T09:10:03.363 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.363 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.363 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.363 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 67113 2024-09-14T09:10:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:10:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:10:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:10:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:10:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788543+0000", 2024-09-14T09:10:03.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-09-14T09:10:03.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788552+0000", 2024-09-14T09:10:03.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:10:03.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788559+0000", 2024-09-14T09:10:03.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:10:03.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789489+0000", 2024-09-14T09:10:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00092982199999999996 2024-09-14T09:10:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:03.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789497+0000", 2024-09-14T09:10:03.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6299999999999998e-06 2024-09-14T09:10:03.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801068+0000", 2024-09-14T09:10:03.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0115709530000001 2024-09-14T09:10:03.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801240+0000", 2024-09-14T09:10:03.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017276600000000001 2024-09-14T09:10:03.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815138+0000", 2024-09-14T09:10:03.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013897856 2024-09-14T09:10:03.371 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.371 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.371 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73412 3.1d 3:be4606c3:::rbd_data.1112a10502fe.00000000000001f2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:10:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.491783624, 2024-09-14T09:10:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026815928, 2024-09-14T09:10:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.372 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73412 2024-09-14T09:10:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:10:03.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:10:03.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:10:03.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5699999999999998e-07 2024-09-14T09:10:03.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788572+0000", 2024-09-14T09:10:03.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2809999999999998e-06 2024-09-14T09:10:03.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788579+0000", 2024-09-14T09:10:03.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5629999999999997e-06 2024-09-14T09:10:03.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788584+0000", 2024-09-14T09:10:03.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1710000000000001e-06 2024-09-14T09:10:03.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789521+0000", 2024-09-14T09:10:03.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00093657400000000002 2024-09-14T09:10:03.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:03.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789528+0000", 2024-09-14T09:10:03.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5719999999999997e-06 2024-09-14T09:10:03.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801631+0000", 2024-09-14T09:10:03.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0121023229999999 2024-09-14T09:10:03.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801792+0000", 2024-09-14T09:10:03.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016174000000000001 2024-09-14T09:10:03.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815386+0000", 2024-09-14T09:10:03.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013593246999999999 2024-09-14T09:10:03.379 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.379 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.379 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.379 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:77244 3.1d 3:b801be19:::rbd_data.1112a10502fe.0000000000000204:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:03.379 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:10:03.379 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.309919378000004, 2024-09-14T09:10:03.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.84519277100000001, 2024-09-14T09:10:03.380 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.380 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.380 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.380 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.380 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:03.380 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:03.380 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 77244 2024-09-14T09:10:03.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.380 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:10:03.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:10:03.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970436+0000", 2024-09-14T09:10:03.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.511e-06 2024-09-14T09:10:03.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970441+0000", 2024-09-14T09:10:03.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0470000000000001e-06 2024-09-14T09:10:03.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970453+0000", 2024-09-14T09:10:03.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2629999999999999e-05 2024-09-14T09:10:03.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970461+0000", 2024-09-14T09:10:03.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6850000000000001e-06 2024-09-14T09:10:03.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970524+0000", 2024-09-14T09:10:03.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3332999999999998e-05 2024-09-14T09:10:03.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:03.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970544+0000", 2024-09-14T09:10:03.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9731000000000001e-05 2024-09-14T09:10:03.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802188+0000", 2024-09-14T09:10:03.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.83164380000000004 2024-09-14T09:10:03.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:10:03.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015411999999999999 2024-09-14T09:10:03.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815627+0000", 2024-09-14T09:10:03.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013284914 2024-09-14T09:10:03.385 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.385 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.385 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.385 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:79796 3.1d 3:bc22caaf:::rbd_data.1112a10502fe.000000000000020c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:03.385 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:10:03.385 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.188610691999997, 2024-09-14T09:10:03.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72411694299999996, 2024-09-14T09:10:03.386 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.386 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.386 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.386 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.386 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:03.386 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:03.386 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 79796 2024-09-14T09:10:03.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.386 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:10:03.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:10:03.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091745+0000", 2024-09-14T09:10:03.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2000000000000001e-06 2024-09-14T09:10:03.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091752+0000", 2024-09-14T09:10:03.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-09-14T09:10:03.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091772+0000", 2024-09-14T09:10:03.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9822000000000001e-05 2024-09-14T09:10:03.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091791+0000", 2024-09-14T09:10:03.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9236e-05 2024-09-14T09:10:03.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091882+0000", 2024-09-14T09:10:03.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0783000000000001e-05 2024-09-14T09:10:03.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:03.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091892+0000", 2024-09-14T09:10:03.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7999999999999993e-06 2024-09-14T09:10:03.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802744+0000", 2024-09-14T09:10:03.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.710851868 2024-09-14T09:10:03.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802902+0000", 2024-09-14T09:10:03.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015814900000000001 2024-09-14T09:10:03.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815860+0000", 2024-09-14T09:10:03.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012957605000000001 2024-09-14T09:10:03.391 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.391 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.391 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.391 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80904 3.1d 3:be0e7f3d:::rbd_data.1112a10502fe.0000000000000214:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:03.391 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:10:03.392 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.108524844999998, 2024-09-14T09:10:03.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64435178100000001, 2024-09-14T09:10:03.392 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.392 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.392 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.392 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.392 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:03.392 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:03.392 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80904 2024-09-14T09:10:03.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.393 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:10:03.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:10:03.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171831+0000", 2024-09-14T09:10:03.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0729999999999999e-06 2024-09-14T09:10:03.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171839+0000", 2024-09-14T09:10:03.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9179999999999994e-06 2024-09-14T09:10:03.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171857+0000", 2024-09-14T09:10:03.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8957000000000002e-05 2024-09-14T09:10:03.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171867+0000", 2024-09-14T09:10:03.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7100000000000002e-06 2024-09-14T09:10:03.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171957+0000", 2024-09-14T09:10:03.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9932999999999994e-05 2024-09-14T09:10:03.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:03.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171974+0000", 2024-09-14T09:10:03.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6988999999999999e-05 2024-09-14T09:10:03.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803301+0000", 2024-09-14T09:10:03.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63132648599999996 2024-09-14T09:10:03.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803482+0000", 2024-09-14T09:10:03.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000181607 2024-09-14T09:10:03.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816180+0000", 2024-09-14T09:10:03.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012698108 2024-09-14T09:10:03.399 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.400 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.400 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.400 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80964 3.1d 3:be42e20f:::rbd_data.1112a10502fe.0000000000000219:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:03.400 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:10:03.400 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.102889277999999, 2024-09-14T09:10:03.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63896829799999999, 2024-09-14T09:10:03.400 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.400 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.400 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.400 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.400 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:03.400 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:03.401 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80964 2024-09-14T09:10:03.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.401 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:10:03.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:10:03.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177466+0000", 2024-09-14T09:10:03.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6610000000000001e-06 2024-09-14T09:10:03.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177472+0000", 2024-09-14T09:10:03.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3029999999999996e-06 2024-09-14T09:10:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177490+0000", 2024-09-14T09:10:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8099000000000001e-05 2024-09-14T09:10:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177499+0000", 2024-09-14T09:10:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:10:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177560+0000", 2024-09-14T09:10:03.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1334000000000006e-05 2024-09-14T09:10:03.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:03.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177578+0000", 2024-09-14T09:10:03.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8434999999999999e-05 2024-09-14T09:10:03.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803910+0000", 2024-09-14T09:10:03.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62633190699999997 2024-09-14T09:10:03.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.806612+0000", 2024-09-14T09:10:03.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002702257 2024-09-14T09:10:03.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816432+0000", 2024-09-14T09:10:03.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098199370000000008 2024-09-14T09:10:03.407 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.407 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.407 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.408 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83321 3.1d 3:bb24b47b:::rbd_data.1112a10502fe.0000000000000223:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:03.408 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:10:03.408 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.988435604000003, 2024-09-14T09:10:03.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52477628799999998, 2024-09-14T09:10:03.408 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.408 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.408 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.409 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.409 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:03.409 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:03.409 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83321 2024-09-14T09:10:03.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.409 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:10:03.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:10:03.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291920+0000", 2024-09-14T09:10:03.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.888e-06 2024-09-14T09:10:03.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291926+0000", 2024-09-14T09:10:03.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6059999999999999e-06 2024-09-14T09:10:03.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291943+0000", 2024-09-14T09:10:03.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6813e-05 2024-09-14T09:10:03.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291952+0000", 2024-09-14T09:10:03.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7439999999999996e-06 2024-09-14T09:10:03.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292023+0000", 2024-09-14T09:10:03.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1320000000000002e-05 2024-09-14T09:10:03.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:03.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292030+0000", 2024-09-14T09:10:03.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4219999999999997e-06 2024-09-14T09:10:03.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807221+0000", 2024-09-14T09:10:03.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51519140699999999 2024-09-14T09:10:03.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807406+0000", 2024-09-14T09:10:03.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018532800000000001 2024-09-14T09:10:03.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816694+0000", 2024-09-14T09:10:03.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092877600000000008 2024-09-14T09:10:03.416 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.416 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.416 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.416 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83358 3.1d 3:bb230e23:::rbd_data.1112a10502fe.000000000000022b:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:03.416 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:10:03.416 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.986915713999998, 2024-09-14T09:10:03.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52374808900000003, 2024-09-14T09:10:03.417 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.417 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.417 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.417 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.417 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:03.417 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:03.417 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83358 2024-09-14T09:10:03.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.417 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:10:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:10:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293439+0000", 2024-09-14T09:10:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5899999999999995e-07 2024-09-14T09:10:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293443+0000", 2024-09-14T09:10:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9309999999999999e-06 2024-09-14T09:10:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293457+0000", 2024-09-14T09:10:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3944999999999999e-05 2024-09-14T09:10:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293466+0000", 2024-09-14T09:10:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4319999999999999e-06 2024-09-14T09:10:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293530+0000", 2024-09-14T09:10:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3860000000000002e-05 2024-09-14T09:10:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293540+0000", 2024-09-14T09:10:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0107e-05 2024-09-14T09:10:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809096+0000", 2024-09-14T09:10:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51555587800000002 2024-09-14T09:10:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809265+0000", 2024-09-14T09:10:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000169092 2024-09-14T09:10:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817186+0000", 2024-09-14T09:10:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079209850000000002 2024-09-14T09:10:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83361 3.1d 3:bd571564:::rbd_data.1112a10502fe.000000000000022c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:10:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.986597637999999, 2024-09-14T09:10:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52373873100000001, 2024-09-14T09:10:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83361 2024-09-14T09:10:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:10:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:10:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293757+0000", 2024-09-14T09:10:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8000000000000004e-07 2024-09-14T09:10:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293762+0000", 2024-09-14T09:10:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8019999999999997e-06 2024-09-14T09:10:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293775+0000", 2024-09-14T09:10:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2884000000000001e-05 2024-09-14T09:10:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293783+0000", 2024-09-14T09:10:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:10:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293849+0000", 2024-09-14T09:10:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5859999999999996e-05 2024-09-14T09:10:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293861+0000", 2024-09-14T09:10:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2238999999999999e-05 2024-09-14T09:10:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809680+0000", 2024-09-14T09:10:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51581856800000003 2024-09-14T09:10:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809844+0000", 2024-09-14T09:10:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016441200000000001 2024-09-14T09:10:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817494+0000", 2024-09-14T09:10:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076502360000000004 2024-09-14T09:10:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.432 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:03.433 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:03.435+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:03.434 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:10:03.534 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:03.536+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:03.578 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:03.578 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:03.578 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:10:03.578 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:03.587 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:10:03.635 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:03.638+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:03.729 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:03.730 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:03.730 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:10:03.730 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:10:03.731 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:03.736 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:03.738+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:03.739 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:10:03.837 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:03.840+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:03.882 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:03.883 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:10:03.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:10:03.883 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:10:03.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.883 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2265 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4034560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:03.884 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:10:03.884 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 87.020976286000007, 2024-09-14T09:10:03.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073974829000000006, 2024-09-14T09:10:03.884 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.884 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.884 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.885 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.885 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:03.885 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:03.885 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2265 2024-09-14T09:10:03.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.885 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:10:03.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:10:03.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862542+0000", 2024-09-14T09:10:03.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:10:03.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862543+0000", 2024-09-14T09:10:03.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.81e-06 2024-09-14T09:10:03.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862549+0000", 2024-09-14T09:10:03.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8850000000000004e-06 2024-09-14T09:10:03.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862554+0000", 2024-09-14T09:10:03.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5279999999999997e-06 2024-09-14T09:10:03.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936318+0000", 2024-09-14T09:10:03.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073764422999999996 2024-09-14T09:10:03.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936412+0000", 2024-09-14T09:10:03.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3801000000000005e-05 2024-09-14T09:10:03.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936516+0000", 2024-09-14T09:10:03.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000104007 2024-09-14T09:10:03.893 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.894 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.894 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.894 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2266 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4096000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:03.894 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:10:03.895 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 87.020958422000007, 2024-09-14T09:10:03.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074208332000000002, 2024-09-14T09:10:03.895 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.895 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.895 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.895 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.895 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:03.895 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:03.895 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2266 2024-09-14T09:10:03.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.896 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:10:03.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:10:03.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862738+0000", 2024-09-14T09:10:03.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017920300000000001 2024-09-14T09:10:03.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862744+0000", 2024-09-14T09:10:03.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3000000000000001e-06 2024-09-14T09:10:03.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862753+0000", 2024-09-14T09:10:03.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8179999999999999e-06 2024-09-14T09:10:03.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862785+0000", 2024-09-14T09:10:03.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1949000000000002e-05 2024-09-14T09:10:03.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936556+0000", 2024-09-14T09:10:03.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073770268999999999 2024-09-14T09:10:03.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936657+0000", 2024-09-14T09:10:03.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101387 2024-09-14T09:10:03.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936767+0000", 2024-09-14T09:10:03.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110406 2024-09-14T09:10:03.901 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.901 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.901 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.901 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2267 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4157440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:03.901 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:10:03.901 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 87.020719839999998, 2024-09-14T09:10:03.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074200918000000005, 2024-09-14T09:10:03.901 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.901 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.902 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.902 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.902 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:03.902 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:03.902 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2267 2024-09-14T09:10:03.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.902 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:10:03.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:10:03.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863416+0000", 2024-09-14T09:10:03.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000618492 2024-09-14T09:10:03.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863421+0000", 2024-09-14T09:10:03.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1359999999999996e-06 2024-09-14T09:10:03.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863434+0000", 2024-09-14T09:10:03.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2291e-05 2024-09-14T09:10:03.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863444+0000", 2024-09-14T09:10:03.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9769999999999995e-06 2024-09-14T09:10:03.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936808+0000", 2024-09-14T09:10:03.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073364051999999999 2024-09-14T09:10:03.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.909 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.909 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936892+0000", 2024-09-14T09:10:03.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4641999999999994e-05 2024-09-14T09:10:03.909 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.909 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.909 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936999+0000", 2024-09-14T09:10:03.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106328 2024-09-14T09:10:03.910 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.910 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.910 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.911 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2329 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 106496~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:03.911 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:10:03.911 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 87.019991231000006, 2024-09-14T09:10:03.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074180251000000003, 2024-09-14T09:10:03.912 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.912 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.912 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.912 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.912 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:03.912 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:03.913 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2329 2024-09-14T09:10:03.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.913 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:10:03.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.914 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.914 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:10:03.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864203+0000", 2024-09-14T09:10:03.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000677015 2024-09-14T09:10:03.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864208+0000", 2024-09-14T09:10:03.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.972e-06 2024-09-14T09:10:03.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864221+0000", 2024-09-14T09:10:03.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2683e-05 2024-09-14T09:10:03.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864229+0000", 2024-09-14T09:10:03.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0809999999999994e-06 2024-09-14T09:10:03.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937430+0000", 2024-09-14T09:10:03.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073201231000000005 2024-09-14T09:10:03.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.919 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.919 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937513+0000", 2024-09-14T09:10:03.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2652999999999996e-05 2024-09-14T09:10:03.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.920 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937707+0000", 2024-09-14T09:10:03.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000193616 2024-09-14T09:10:03.920 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.920 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.921 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.921 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2331 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 229376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:03.921 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:10:03.922 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 87.019173734000006, 2024-09-14T09:10:03.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.07400843, 2024-09-14T09:10:03.922 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.922 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.922 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.922 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.922 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:03.923 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:03.923 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2331 2024-09-14T09:10:03.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.923 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:10:03.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:10:03.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868104+0000", 2024-09-14T09:10:03.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003760453 2024-09-14T09:10:03.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.926 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.926 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868109+0000", 2024-09-14T09:10:03.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9339999999999997e-06 2024-09-14T09:10:03.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.927 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.927 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868119+0000", 2024-09-14T09:10:03.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5389999999999996e-06 2024-09-14T09:10:03.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868126+0000", 2024-09-14T09:10:03.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4499999999999998e-06 2024-09-14T09:10:03.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938065+0000", 2024-09-14T09:10:03.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069938809000000005 2024-09-14T09:10:03.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938148+0000", 2024-09-14T09:10:03.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3171999999999996e-05 2024-09-14T09:10:03.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938352+0000", 2024-09-14T09:10:03.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020407300000000001 2024-09-14T09:10:03.930 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.930 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.930 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.931 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2380 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3239936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:03.931 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:10:03.931 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 87.004148705999995, 2024-09-14T09:10:03.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073985913, 2024-09-14T09:10:03.931 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.931 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.931 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.932 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.932 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:03.932 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:03.932 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2380 2024-09-14T09:10:03.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.932 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:10:03.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:10:03.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879697+0000", 2024-09-14T09:10:03.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032864100000000001 2024-09-14T09:10:03.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879702+0000", 2024-09-14T09:10:03.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.578e-06 2024-09-14T09:10:03.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879716+0000", 2024-09-14T09:10:03.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.413e-05 2024-09-14T09:10:03.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879724+0000", 2024-09-14T09:10:03.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.559e-06 2024-09-14T09:10:03.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953155+0000", 2024-09-14T09:10:03.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073431221000000005 2024-09-14T09:10:03.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953247+0000", 2024-09-14T09:10:03.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1662000000000004e-05 2024-09-14T09:10:03.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953355+0000", 2024-09-14T09:10:03.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010812200000000001 2024-09-14T09:10:03.938 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.938 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.938 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.939 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2501 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2850816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:03.939 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:10:03.939 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.985606402000002, 2024-09-14T09:10:03.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074288858999999999, 2024-09-14T09:10:03.939 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.939 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.939 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.939 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.939 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:03.939 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:03.939 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2501 2024-09-14T09:10:03.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.940 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:10:03.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:10:03.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:10:03.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.41e-07 2024-09-14T09:10:03.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897913+0000", 2024-09-14T09:10:03.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3090000000000001e-06 2024-09-14T09:10:03.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897918+0000", 2024-09-14T09:10:03.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8470000000000003e-06 2024-09-14T09:10:03.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897922+0000", 2024-09-14T09:10:03.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5549999999999996e-06 2024-09-14T09:10:03.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971872+0000", 2024-09-14T09:10:03.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073950057999999999 2024-09-14T09:10:03.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971958+0000", 2024-09-14T09:10:03.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5941999999999998e-05 2024-09-14T09:10:03.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972200+0000", 2024-09-14T09:10:03.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000241907 2024-09-14T09:10:03.944 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.944 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.944 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.944 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2502 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2912256~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:03.944 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:10:03.944 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.985567222, 2024-09-14T09:10:03.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074614080999999999, 2024-09-14T09:10:03.944 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.944 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.944 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.944 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.944 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:03.945 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:03.945 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2502 2024-09-14T09:10:03.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.945 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:10:03.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:10:03.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897951+0000", 2024-09-14T09:10:03.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:10:03.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897953+0000", 2024-09-14T09:10:03.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5670000000000002e-06 2024-09-14T09:10:03.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897970+0000", 2024-09-14T09:10:03.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6319000000000001e-05 2024-09-14T09:10:03.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897976+0000", 2024-09-14T09:10:03.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8760000000000002e-06 2024-09-14T09:10:03.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972245+0000", 2024-09-14T09:10:03.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074269186000000001 2024-09-14T09:10:03.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972333+0000", 2024-09-14T09:10:03.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7800999999999995e-05 2024-09-14T09:10:03.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972564+0000", 2024-09-14T09:10:03.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000231833 2024-09-14T09:10:03.948 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.948 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.948 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.948 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2503 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2973696~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:03.948 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:10:03.948 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.985533204999996, 2024-09-14T09:10:03.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074944286999999998, 2024-09-14T09:10:03.949 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.949 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.949 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.949 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.949 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:03.949 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:03.949 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2503 2024-09-14T09:10:03.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.949 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:10:03.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:10:03.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897985+0000", 2024-09-14T09:10:03.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999998e-07 2024-09-14T09:10:03.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897987+0000", 2024-09-14T09:10:03.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.401e-06 2024-09-14T09:10:03.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897999+0000", 2024-09-14T09:10:03.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1851999999999999e-05 2024-09-14T09:10:03.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898005+0000", 2024-09-14T09:10:03.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9789999999999998e-06 2024-09-14T09:10:03.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972609+0000", 2024-09-14T09:10:03.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074604217 2024-09-14T09:10:03.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972684+0000", 2024-09-14T09:10:03.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4777999999999995e-05 2024-09-14T09:10:03.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972929+0000", 2024-09-14T09:10:03.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024448100000000001 2024-09-14T09:10:03.953 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.953 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.953 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.953 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2504 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3035136~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:03.953 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:10:03.953 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.985505113000002, 2024-09-14T09:10:03.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075285131000000005, 2024-09-14T09:10:03.953 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.953 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.953 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.953 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.954 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:03.954 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:03.954 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2504 2024-09-14T09:10:03.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.954 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:10:03.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:10:03.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898078+0000", 2024-09-14T09:10:03.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5775e-05 2024-09-14T09:10:03.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898082+0000", 2024-09-14T09:10:03.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.49e-06 2024-09-14T09:10:03.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898092+0000", 2024-09-14T09:10:03.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0509999999999999e-05 2024-09-14T09:10:03.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898099+0000", 2024-09-14T09:10:03.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.81e-06 2024-09-14T09:10:03.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972971+0000", 2024-09-14T09:10:03.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074871788999999994 2024-09-14T09:10:03.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973055+0000", 2024-09-14T09:10:03.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3980000000000006e-05 2024-09-14T09:10:03.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973298+0000", 2024-09-14T09:10:03.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024277700000000001 2024-09-14T09:10:03.957 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.957 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.957 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.957 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2505 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3096576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:03.957 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:10:03.957 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.985408858, 2024-09-14T09:10:03.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075506668999999998, 2024-09-14T09:10:03.958 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.958 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.958 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.958 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.958 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:03.958 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:03.958 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2505 2024-09-14T09:10:03.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.958 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:10:03.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:10:03.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898370+0000", 2024-09-14T09:10:03.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026128799999999998 2024-09-14T09:10:03.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898374+0000", 2024-09-14T09:10:03.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8070000000000001e-06 2024-09-14T09:10:03.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898383+0000", 2024-09-14T09:10:03.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0520000000000007e-06 2024-09-14T09:10:03.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898389+0000", 2024-09-14T09:10:03.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2639999999999997e-06 2024-09-14T09:10:03.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973330+0000", 2024-09-14T09:10:03.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074940548999999995 2024-09-14T09:10:03.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973402+0000", 2024-09-14T09:10:03.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2556000000000001e-05 2024-09-14T09:10:03.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973615+0000", 2024-09-14T09:10:03.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000213153 2024-09-14T09:10:03.961 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.962 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.962 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.962 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2506 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3158016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:03.962 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:10:03.962 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.985115613999994, 2024-09-14T09:10:03.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075556110999999995, 2024-09-14T09:10:03.962 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.962 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.962 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.962 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.962 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:03.962 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:03.962 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2506 2024-09-14T09:10:03.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.963 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:10:03.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:10:03.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898497+0000", 2024-09-14T09:10:03.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4806e-05 2024-09-14T09:10:03.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898500+0000", 2024-09-14T09:10:03.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.54e-06 2024-09-14T09:10:03.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898507+0000", 2024-09-14T09:10:03.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1590000000000004e-06 2024-09-14T09:10:03.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898513+0000", 2024-09-14T09:10:03.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.015e-06 2024-09-14T09:10:03.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973656+0000", 2024-09-14T09:10:03.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075142929999999997 2024-09-14T09:10:03.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973742+0000", 2024-09-14T09:10:03.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5535e-05 2024-09-14T09:10:03.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973958+0000", 2024-09-14T09:10:03.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000216126 2024-09-14T09:10:03.968 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.968 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.968 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.969 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2507 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3219456~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:03.969 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:10:03.969 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.984987029999999, 2024-09-14T09:10:03.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075623459000000004, 2024-09-14T09:10:03.969 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.969 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.970 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.970 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.970 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:03.970 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:03.970 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2507 2024-09-14T09:10:03.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.970 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:10:03.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:10:03.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898761+0000", 2024-09-14T09:10:03.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000230614 2024-09-14T09:10:03.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898765+0000", 2024-09-14T09:10:03.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6629999999999999e-06 2024-09-14T09:10:03.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898774+0000", 2024-09-14T09:10:03.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6749999999999997e-06 2024-09-14T09:10:03.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898781+0000", 2024-09-14T09:10:03.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4640000000000003e-06 2024-09-14T09:10:03.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973985+0000", 2024-09-14T09:10:03.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075204101999999995 2024-09-14T09:10:03.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974063+0000", 2024-09-14T09:10:03.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7632000000000005e-05 2024-09-14T09:10:03.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974154+0000", 2024-09-14T09:10:03.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1309000000000003e-05 2024-09-14T09:10:03.974 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.974 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.975 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.975 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2508 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3280896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:03.975 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:10:03.975 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.984725267000002, 2024-09-14T09:10:03.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075576943999999993, 2024-09-14T09:10:03.975 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.975 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.975 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.975 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.975 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:03.976 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:03.976 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2508 2024-09-14T09:10:03.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.976 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:10:03.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:10:03.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899176+0000", 2024-09-14T09:10:03.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038340500000000002 2024-09-14T09:10:03.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899179+0000", 2024-09-14T09:10:03.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0290000000000001e-06 2024-09-14T09:10:03.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899186+0000", 2024-09-14T09:10:03.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8199999999999999e-06 2024-09-14T09:10:03.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899190+0000", 2024-09-14T09:10:03.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2050000000000004e-06 2024-09-14T09:10:03.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974193+0000", 2024-09-14T09:10:03.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075003632000000001 2024-09-14T09:10:03.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974276+0000", 2024-09-14T09:10:03.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2272000000000001e-05 2024-09-14T09:10:03.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974369+0000", 2024-09-14T09:10:03.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3580999999999997e-05 2024-09-14T09:10:03.983 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.983 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.983 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.984 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2509 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3342336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:03.984 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:10:03.984 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.984317649999994, 2024-09-14T09:10:03.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075356229999999996, 2024-09-14T09:10:03.985 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.985 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.985 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.986 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.986 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:03.986 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:03.986 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2509 2024-09-14T09:10:03.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.986 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:10:03.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:10:03.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899439+0000", 2024-09-14T09:10:03.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023958599999999999 2024-09-14T09:10:03.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899444+0000", 2024-09-14T09:10:03.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8790000000000002e-06 2024-09-14T09:10:03.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899455+0000", 2024-09-14T09:10:03.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0597999999999999e-05 2024-09-14T09:10:03.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899462+0000", 2024-09-14T09:10:03.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8179999999999998e-06 2024-09-14T09:10:03.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974400+0000", 2024-09-14T09:10:03.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074937999000000005 2024-09-14T09:10:03.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974465+0000", 2024-09-14T09:10:03.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5134000000000004e-05 2024-09-14T09:10:03.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974556+0000", 2024-09-14T09:10:03.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1216000000000002e-05 2024-09-14T09:10:03.993 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.993 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:03.993 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:03.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.994 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2510 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3403776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:03.994 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:10:03.994 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.984042256999999, 2024-09-14T09:10:03.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075295775999999995, 2024-09-14T09:10:03.995 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:03.995 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:03.995 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:03.995 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:03.995 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:03.995 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:03.996 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2510 2024-09-14T09:10:03.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.996 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:03.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:03.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:10:03.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:03.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:10:03.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:03.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:03.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899691+0000", 2024-09-14T09:10:03.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021615999999999999 2024-09-14T09:10:03.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:03.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899696+0000", 2024-09-14T09:10:03.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3200000000000001e-06 2024-09-14T09:10:03.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:03.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899704+0000", 2024-09-14T09:10:03.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9440000000000005e-06 2024-09-14T09:10:03.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:03.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899710+0000", 2024-09-14T09:10:03.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.584e-06 2024-09-14T09:10:03.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:03.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974594+0000", 2024-09-14T09:10:03.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074883551000000007 2024-09-14T09:10:03.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:03.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974679+0000", 2024-09-14T09:10:03.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5365999999999995e-05 2024-09-14T09:10:03.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:03.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:03.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:03.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974771+0000", 2024-09-14T09:10:03.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1850999999999999e-05 2024-09-14T09:10:04.000 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:04.000 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:04.000 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:04.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.000 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2511 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3465216~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:04.000 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:10:04.000 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.983796038999998, 2024-09-14T09:10:04.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075234668000000005, 2024-09-14T09:10:04.000 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:04.000 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:04.000 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:04.001 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:04.001 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:04.001 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:04.001 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2511 2024-09-14T09:10:04.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.001 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:04.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:04.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:10:04.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:04.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:04.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:10:04.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:04.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:04.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899951+0000", 2024-09-14T09:10:04.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000229569 2024-09-14T09:10:04.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:04.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899955+0000", 2024-09-14T09:10:04.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1010000000000002e-06 2024-09-14T09:10:04.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:04.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899971+0000", 2024-09-14T09:10:04.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5648999999999999e-05 2024-09-14T09:10:04.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:04.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899978+0000", 2024-09-14T09:10:04.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0829999999999998e-06 2024-09-14T09:10:04.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:04.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974806+0000", 2024-09-14T09:10:04.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074828092999999998 2024-09-14T09:10:04.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:04.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974870+0000", 2024-09-14T09:10:04.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4492000000000005e-05 2024-09-14T09:10:04.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:04.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974956+0000", 2024-09-14T09:10:04.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5680999999999995e-05 2024-09-14T09:10:04.005 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:04.005 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:04.005 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:04.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.006 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2512 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3526656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:04.006 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:10:04.006 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.983528493999998, 2024-09-14T09:10:04.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075178812999999997, 2024-09-14T09:10:04.006 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:04.006 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:04.006 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:04.006 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:04.006 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:04.006 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:04.006 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2512 2024-09-14T09:10:04.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.007 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:04.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:04.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:10:04.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:04.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:04.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:10:04.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:04.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:04.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904181+0000", 2024-09-14T09:10:04.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041919399999999999 2024-09-14T09:10:04.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:04.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904186+0000", 2024-09-14T09:10:04.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2390000000000002e-06 2024-09-14T09:10:04.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:04.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904199+0000", 2024-09-14T09:10:04.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2709e-05 2024-09-14T09:10:04.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:04.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904207+0000", 2024-09-14T09:10:04.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8150000000000006e-06 2024-09-14T09:10:04.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:04.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975000+0000", 2024-09-14T09:10:04.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.070793444999999997 2024-09-14T09:10:04.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:04.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975079+0000", 2024-09-14T09:10:04.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8480999999999996e-05 2024-09-14T09:10:04.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:04.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975168+0000", 2024-09-14T09:10:04.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9184000000000005e-05 2024-09-14T09:10:04.010 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:04.010 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:04.010 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:04.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.010 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:22840 3.15 3:a8cf3dc2:::rbd_header.1112a10502fe:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:04.010 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:10:04.011 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 47.323955472000002, 2024-09-14T09:10:04.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.119998785, 2024-09-14T09:10:04.011 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:04.011 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:04.011 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:04.011 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:04.011 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:10:04.011 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:10:04.011 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 22840 2024-09-14T09:10:04.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.011 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:04.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:04.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:10:04.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:04.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:04.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:10:04.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:04.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:04.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642492+0000", 2024-09-14T09:10:04.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.082930276999999997 2024-09-14T09:10:04.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:04.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642495+0000", 2024-09-14T09:10:04.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9809999999999999e-06 2024-09-14T09:10:04.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:04.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642501+0000", 2024-09-14T09:10:04.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-09-14T09:10:04.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:04.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642506+0000", 2024-09-14T09:10:04.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6650000000000002e-06 2024-09-14T09:10:04.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:04.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679483+0000", 2024-09-14T09:10:04.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036977777000000003 2024-09-14T09:10:04.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:04.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679517+0000", 2024-09-14T09:10:04.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.345e-05 2024-09-14T09:10:04.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:04.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679561+0000", 2024-09-14T09:10:04.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3930999999999997e-05 2024-09-14T09:10:04.015 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:04.015 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:04.015 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:04.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.016 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:22857 3.15 3:a8cf3dc2:::rbd_header.1112a10502fe:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:04.016 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:10:04.016 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 47.174061547000001, 2024-09-14T09:10:04.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.088427917999999994, 2024-09-14T09:10:04.016 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:04.016 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:04.016 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:04.016 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:04.016 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:10:04.016 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:10:04.016 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 22857 2024-09-14T09:10:04.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.016 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:04.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:04.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:10:04.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:04.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:04.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:10:04.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:04.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:04.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777685+0000", 2024-09-14T09:10:04.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.068229181999999999 2024-09-14T09:10:04.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:04.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777688+0000", 2024-09-14T09:10:04.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1980000000000001e-06 2024-09-14T09:10:04.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:04.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777695+0000", 2024-09-14T09:10:04.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:10:04.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:04.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777700+0000", 2024-09-14T09:10:04.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0919999999999997e-06 2024-09-14T09:10:04.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:04.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797735+0000", 2024-09-14T09:10:04.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0200351 2024-09-14T09:10:04.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:04.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797800+0000", 2024-09-14T09:10:04.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4305000000000002e-05 2024-09-14T09:10:04.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:04.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:04.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:04.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797884+0000", 2024-09-14T09:10:04.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4344000000000004e-05 2024-09-14T09:10:04.020 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:04.020 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:04.020 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:04.020 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:04.020 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:04.020 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:04.020 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:10:04.022 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:10:04.023 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:04.023+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:04.123 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:04.125+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:04.168 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:04.168 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:04.168 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:10:04.168 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:04.177 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:10:04.183 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:10:04.183 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:10:04.202 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:10:04.203 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:10:04.219 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:10:04.219 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:10:04.223 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:04.225+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:04.236 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:10:04.236 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:10:04.253 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:10:04.253 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:10:04.271 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:10:04.271 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:10:04.282 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:04.282 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:04.291 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:10:04.325 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:04.327+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:04.425 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:04.428+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:04.435 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:04.435 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:04.444 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:10:04.526 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:04.528+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:04.559 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:04.559 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:04.569 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:10:04.628 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:04.630+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:04.673 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:04.673 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:04.681 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:10:04.729 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:04.731+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:04.786 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:04.786 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:04.795 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:10:04.836 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:04.838+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:04.878 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 1] out_osds: [5] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 2] 2024-09-14T09:10:04.879 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:10:04.879 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-14T09:10:04.879 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 1.000000 2024-09-14T09:10:04.879 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-14T09:10:04.906 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T09:10:04.930 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:04.933+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:04.945 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:04.945 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:04.954 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:10:05.032 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:05.034+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:05.099 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:05.099 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:05.108 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:10:05.133 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:05.135+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:05.211 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:05.211 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:05.221 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:10:05.233 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:05.235+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:05.325 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:05.325 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:05.334 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:10:05.335 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:05.337+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:05.436 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:05.436 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:05.437 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:05.439+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:05.445 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:10:05.538 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:05.540+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:05.590 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:05.590 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:05.599 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:10:05.643 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:05.645+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:05.703 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:05.704 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:05.712 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:10:05.739 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:05.742+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:05.841 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:05.843+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:05.855 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:05.855 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:05.864 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:10:05.909 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is unset 2024-09-14T09:10:05.911 INFO:teuthology.orchestra.run.smithi116.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-14T09:10:05.942 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:05.945+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:05.984 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:05.985 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:05.995 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:10:06.043 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:06.045+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:06.099 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:06.099 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:06.108 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:10:06.144 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:06.147+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:06.246 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:06.247+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:06.251 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:06.251 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:06.260 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:10:06.282 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:10:06.346 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:06.349+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:06.406 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:06.407 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:06.416 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:10:06.421 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:10:06.421 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:10:06.438 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:10:06.438 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:10:06.447 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:06.449+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:06.455 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:10:06.455 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:10:06.471 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:10:06.472 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:10:06.489 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:10:06.489 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:10:06.505 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:10:06.506 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:10:06.521 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:06.521 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:06.521 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:10:06.521 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:06.530 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:10:06.548 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:06.550+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:06.649 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:06.651+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:06.673 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:06.673 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:06.673 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:10:06.673 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:10:06.673 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:06.682 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:10:06.750 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:06.752+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:06.789 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:06.789 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:10:06.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:10:06.789 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:10:06.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.789 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:987 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:06.789 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:10:06.789 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.928736291999996, 2024-09-14T09:10:06.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001359466, 2024-09-14T09:10:06.790 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:06.790 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:06.790 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:06.790 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:06.790 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:06.790 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:06.790 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 987 2024-09-14T09:10:06.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.790 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:06.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:06.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:10:06.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:06.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:10:06.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:06.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858333+0000", 2024-09-14T09:10:06.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.621e-06 2024-09-14T09:10:06.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:06.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858349+0000", 2024-09-14T09:10:06.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5758000000000001e-05 2024-09-14T09:10:06.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:06.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858366+0000", 2024-09-14T09:10:06.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7368e-05 2024-09-14T09:10:06.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:06.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858382+0000", 2024-09-14T09:10:06.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6039e-05 2024-09-14T09:10:06.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858441+0000", 2024-09-14T09:10:06.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8662999999999997e-05 2024-09-14T09:10:06.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858449+0000", 2024-09-14T09:10:06.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3960000000000006e-06 2024-09-14T09:10:06.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859682+0000", 2024-09-14T09:10:06.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001233096 2024-09-14T09:10:06.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:06.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859691+0000", 2024-09-14T09:10:06.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5250000000000005e-06 2024-09-14T09:10:06.794 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.794 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:06.794 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.794 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:988 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:06.794 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:10:06.794 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.928608421999996, 2024-09-14T09:10:06.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0012656799999999, 2024-09-14T09:10:06.794 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:06.795 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:06.795 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:06.795 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:06.795 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:06.795 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:06.795 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 988 2024-09-14T09:10:06.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.795 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:06.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:06.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:10:06.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:06.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:10:06.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:06.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858460+0000", 2024-09-14T09:10:06.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9999999999999997e-07 2024-09-14T09:10:06.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:06.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858463+0000", 2024-09-14T09:10:06.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7459999999999998e-06 2024-09-14T09:10:06.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:06.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858471+0000", 2024-09-14T09:10:06.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3900000000000004e-06 2024-09-14T09:10:06.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:06.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858478+0000", 2024-09-14T09:10:06.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7020000000000004e-06 2024-09-14T09:10:06.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859102+0000", 2024-09-14T09:10:06.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062419699999999995 2024-09-14T09:10:06.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859109+0000", 2024-09-14T09:10:06.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7419999999999997e-06 2024-09-14T09:10:06.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859718+0000", 2024-09-14T09:10:06.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006085629999999 2024-09-14T09:10:06.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:06.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859725+0000", 2024-09-14T09:10:06.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7399999999999998e-06 2024-09-14T09:10:06.799 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.799 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:06.799 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.799 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1003 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:06.799 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:10:06.799 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.927745185000006, 2024-09-14T09:10:06.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009495209999999, 2024-09-14T09:10:06.799 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:06.799 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:06.799 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:06.800 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:06.800 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:06.800 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:06.800 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1003 2024-09-14T09:10:06.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.800 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:06.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:06.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:10:06.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:06.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:10:06.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:06.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859323+0000", 2024-09-14T09:10:06.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3099999999999998e-07 2024-09-14T09:10:06.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:06.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859326+0000", 2024-09-14T09:10:06.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-06 2024-09-14T09:10:06.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:06.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859333+0000", 2024-09-14T09:10:06.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3300000000000001e-06 2024-09-14T09:10:06.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:06.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859339+0000", 2024-09-14T09:10:06.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6400000000000002e-06 2024-09-14T09:10:06.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859387+0000", 2024-09-14T09:10:06.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8448000000000001e-05 2024-09-14T09:10:06.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:10:06.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9540000000000004e-06 2024-09-14T09:10:06.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860260+0000", 2024-09-14T09:10:06.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000864921 2024-09-14T09:10:06.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:06.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860272+0000", 2024-09-14T09:10:06.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1993e-05 2024-09-14T09:10:06.804 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.804 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:06.804 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.804 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1004 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:06.804 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:10:06.804 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.927709609999994, 2024-09-14T09:10:06.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000947875, 2024-09-14T09:10:06.804 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:06.804 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:06.804 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:06.805 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:06.805 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:06.805 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:06.805 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1004 2024-09-14T09:10:06.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.805 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:06.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:06.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:10:06.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:06.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:10:06.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:06.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:10:06.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7199999999999999e-07 2024-09-14T09:10:06.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:06.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859361+0000", 2024-09-14T09:10:06.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.892e-06 2024-09-14T09:10:06.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:06.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859368+0000", 2024-09-14T09:10:06.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4370000000000004e-06 2024-09-14T09:10:06.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:06.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859373+0000", 2024-09-14T09:10:06.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6690000000000003e-06 2024-09-14T09:10:06.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859430+0000", 2024-09-14T09:10:06.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6456999999999998e-05 2024-09-14T09:10:06.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859434+0000", 2024-09-14T09:10:06.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8410000000000002e-06 2024-09-14T09:10:06.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860299+0000", 2024-09-14T09:10:06.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008650370000001 2024-09-14T09:10:06.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:06.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860306+0000", 2024-09-14T09:10:06.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0700000000000001e-06 2024-09-14T09:10:06.809 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.809 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:06.809 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.809 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1005 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:06.809 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:10:06.809 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.927685937000007, 2024-09-14T09:10:06.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009585480000001, 2024-09-14T09:10:06.809 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:06.809 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:06.809 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:06.810 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:06.810 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:06.810 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:06.810 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1005 2024-09-14T09:10:06.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.810 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:06.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:06.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:10:06.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:06.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:10:06.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:06.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:10:06.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9700000000000002e-07 2024-09-14T09:10:06.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:06.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859384+0000", 2024-09-14T09:10:06.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.024e-06 2024-09-14T09:10:06.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:06.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859390+0000", 2024-09-14T09:10:06.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7080000000000002e-06 2024-09-14T09:10:06.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:06.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:10:06.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8980000000000004e-06 2024-09-14T09:10:06.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859527+0000", 2024-09-14T09:10:06.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013228099999999999 2024-09-14T09:10:06.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859532+0000", 2024-09-14T09:10:06.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5899999999999998e-06 2024-09-14T09:10:06.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860330+0000", 2024-09-14T09:10:06.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0007973509999999 2024-09-14T09:10:06.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:06.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860340+0000", 2024-09-14T09:10:06.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0299000000000001e-05 2024-09-14T09:10:06.814 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.814 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:06.814 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.814 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1006 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:06.814 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:10:06.814 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.927662741000006, 2024-09-14T09:10:06.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001032039, 2024-09-14T09:10:06.814 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:06.815 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:06.815 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:06.815 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:06.815 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:06.815 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:06.815 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1006 2024-09-14T09:10:06.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.815 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:06.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:06.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:10:06.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:06.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:10:06.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:06.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:10:06.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6499999999999999e-07 2024-09-14T09:10:06.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:06.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859407+0000", 2024-09-14T09:10:06.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1160000000000002e-06 2024-09-14T09:10:06.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:06.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859413+0000", 2024-09-14T09:10:06.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8880000000000002e-06 2024-09-14T09:10:06.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:06.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859419+0000", 2024-09-14T09:10:06.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3550000000000004e-06 2024-09-14T09:10:06.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859558+0000", 2024-09-14T09:10:06.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000138942 2024-09-14T09:10:06.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859563+0000", 2024-09-14T09:10:06.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.665e-06 2024-09-14T09:10:06.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860427+0000", 2024-09-14T09:10:06.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008635299999999 2024-09-14T09:10:06.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:06.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860437+0000", 2024-09-14T09:10:06.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0078000000000001e-05 2024-09-14T09:10:06.819 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.819 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:06.819 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.819 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1045 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:06.819 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:10:06.820 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.927463261, 2024-09-14T09:10:06.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008612990000001, 2024-09-14T09:10:06.820 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:06.820 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:06.820 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:06.820 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:06.820 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:06.820 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:06.820 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1045 2024-09-14T09:10:06.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.820 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:06.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:06.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:10:06.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:06.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:10:06.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:06.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859605+0000", 2024-09-14T09:10:06.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6e-07 2024-09-14T09:10:06.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:06.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859606+0000", 2024-09-14T09:10:06.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8819999999999999e-06 2024-09-14T09:10:06.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:06.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859610+0000", 2024-09-14T09:10:06.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4290000000000001e-06 2024-09-14T09:10:06.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:06.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859612+0000", 2024-09-14T09:10:06.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6309999999999999e-06 2024-09-14T09:10:06.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859643+0000", 2024-09-14T09:10:06.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0224000000000001e-05 2024-09-14T09:10:06.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859647+0000", 2024-09-14T09:10:06.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9049999999999999e-06 2024-09-14T09:10:06.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860458+0000", 2024-09-14T09:10:06.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008111180000001 2024-09-14T09:10:06.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:06.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860466+0000", 2024-09-14T09:10:06.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:10:06.824 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.824 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:06.824 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.824 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1046 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:06.824 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:10:06.825 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.927449804000005, 2024-09-14T09:10:06.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000874262, 2024-09-14T09:10:06.825 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:06.825 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:06.825 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:06.825 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:06.825 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:06.825 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:06.825 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1046 2024-09-14T09:10:06.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.825 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:06.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:06.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:10:06.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:06.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:10:06.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:06.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:10:06.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:10:06.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:06.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859619+0000", 2024-09-14T09:10:06.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0559999999999999e-06 2024-09-14T09:10:06.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:06.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859622+0000", 2024-09-14T09:10:06.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0170000000000001e-06 2024-09-14T09:10:06.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:06.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859625+0000", 2024-09-14T09:10:06.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7209999999999999e-06 2024-09-14T09:10:06.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859666+0000", 2024-09-14T09:10:06.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1677000000000001e-05 2024-09-14T09:10:06.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859672+0000", 2024-09-14T09:10:06.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4609999999999999e-06 2024-09-14T09:10:06.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860485+0000", 2024-09-14T09:10:06.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000813505 2024-09-14T09:10:06.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:06.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860492+0000", 2024-09-14T09:10:06.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6159999999999998e-06 2024-09-14T09:10:06.829 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.829 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:06.829 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.830 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1047 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:06.830 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:10:06.830 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.927438469999998, 2024-09-14T09:10:06.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008950190000001, 2024-09-14T09:10:06.830 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:06.830 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:06.830 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:06.830 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:06.830 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:06.830 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:06.830 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1047 2024-09-14T09:10:06.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.831 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:06.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:06.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:10:06.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:06.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:10:06.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:06.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:10:06.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6600000000000003e-07 2024-09-14T09:10:06.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:06.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859631+0000", 2024-09-14T09:10:06.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5600000000000001e-06 2024-09-14T09:10:06.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:06.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859637+0000", 2024-09-14T09:10:06.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7309999999999998e-06 2024-09-14T09:10:06.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:06.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859641+0000", 2024-09-14T09:10:06.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0840000000000002e-06 2024-09-14T09:10:06.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859691+0000", 2024-09-14T09:10:06.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0587999999999997e-05 2024-09-14T09:10:06.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859696+0000", 2024-09-14T09:10:06.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8940000000000001e-06 2024-09-14T09:10:06.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860516+0000", 2024-09-14T09:10:06.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008200780000001 2024-09-14T09:10:06.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:06.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860524+0000", 2024-09-14T09:10:06.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8180000000000004e-06 2024-09-14T09:10:06.834 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.834 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:06.834 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.835 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1048 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:06.835 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:10:06.835 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.927406711000003, 2024-09-14T09:10:06.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008904780000001, 2024-09-14T09:10:06.835 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:06.835 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:06.835 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:06.835 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:06.835 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:06.835 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:06.835 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1048 2024-09-14T09:10:06.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.835 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:06.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:06.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:10:06.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:06.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:10:06.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:06.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:10:06.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4700000000000002e-07 2024-09-14T09:10:06.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:06.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859663+0000", 2024-09-14T09:10:06.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0420000000000001e-06 2024-09-14T09:10:06.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:06.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859669+0000", 2024-09-14T09:10:06.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8989999999999998e-06 2024-09-14T09:10:06.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:06.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859673+0000", 2024-09-14T09:10:06.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2209999999999999e-06 2024-09-14T09:10:06.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859719+0000", 2024-09-14T09:10:06.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5788000000000003e-05 2024-09-14T09:10:06.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859725+0000", 2024-09-14T09:10:06.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4770000000000002e-06 2024-09-14T09:10:06.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860544+0000", 2024-09-14T09:10:06.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008194669999999 2024-09-14T09:10:06.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:06.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860551+0000", 2024-09-14T09:10:06.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1369999999999996e-06 2024-09-14T09:10:06.839 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.839 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:06.839 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.839 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1089 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:06.840 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:10:06.840 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.927169718000002, 2024-09-14T09:10:06.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000733943, 2024-09-14T09:10:06.840 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:06.840 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:06.840 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:06.840 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:06.840 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:06.840 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:06.840 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1089 2024-09-14T09:10:06.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.840 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:06.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:06.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:10:06.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:06.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:10:06.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:06.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:10:06.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3000000000000002e-07 2024-09-14T09:10:06.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:06.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859900+0000", 2024-09-14T09:10:06.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9199999999999998e-06 2024-09-14T09:10:06.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:06.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859906+0000", 2024-09-14T09:10:06.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0889999999999996e-06 2024-09-14T09:10:06.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:06.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859911+0000", 2024-09-14T09:10:06.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6419999999999998e-06 2024-09-14T09:10:06.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860010+0000", 2024-09-14T09:10:06.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8956000000000006e-05 2024-09-14T09:10:06.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860014+0000", 2024-09-14T09:10:06.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.741e-06 2024-09-14T09:10:06.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860627+0000", 2024-09-14T09:10:06.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00061277 2024-09-14T09:10:06.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:06.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860632+0000", 2024-09-14T09:10:06.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:10:06.844 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.845 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:06.845 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.845 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1090 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:06.845 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:10:06.845 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 67.927150045999994, 2024-09-14T09:10:06.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000740763, 2024-09-14T09:10:06.845 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:06.845 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:06.845 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:06.845 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:06.845 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:06.846 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:06.846 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1090 2024-09-14T09:10:06.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.846 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:06.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:06.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:10:06.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:06.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:10:06.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:06.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859918+0000", 2024-09-14T09:10:06.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5199999999999998e-07 2024-09-14T09:10:06.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:06.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859920+0000", 2024-09-14T09:10:06.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9240000000000001e-06 2024-09-14T09:10:06.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:06.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859925+0000", 2024-09-14T09:10:06.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3929999999999999e-06 2024-09-14T09:10:06.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:06.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859929+0000", 2024-09-14T09:10:06.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4769999999999999e-06 2024-09-14T09:10:06.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860034+0000", 2024-09-14T09:10:06.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010549500000000001 2024-09-14T09:10:06.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860039+0000", 2024-09-14T09:10:06.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5700000000000003e-06 2024-09-14T09:10:06.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860650+0000", 2024-09-14T09:10:06.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006116119999999 2024-09-14T09:10:06.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:06.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860658+0000", 2024-09-14T09:10:06.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:10:06.849 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.849 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:06.849 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.850 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60374 3.14 3.6e2cd654 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:06.850 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:10:06.850 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 50.297271735999999, 2024-09-14T09:10:06.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3129433100000001, 2024-09-14T09:10:06.850 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:06.850 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:06.850 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:06.850 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:06.850 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:06.850 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:06.850 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60374 2024-09-14T09:10:06.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.850 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:06.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:06.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:10:06.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:06.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:10:06.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:06.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:10:06.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2100000000000002e-07 2024-09-14T09:10:06.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:06.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489799+0000", 2024-09-14T09:10:06.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3530000000000002e-06 2024-09-14T09:10:06.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:06.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489808+0000", 2024-09-14T09:10:06.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2e-06 2024-09-14T09:10:06.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:06.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489813+0000", 2024-09-14T09:10:06.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3249999999999998e-06 2024-09-14T09:10:06.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489866+0000", 2024-09-14T09:10:06.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3074e-05 2024-09-14T09:10:06.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489875+0000", 2024-09-14T09:10:06.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2760000000000006e-06 2024-09-14T09:10:06.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801379+0000", 2024-09-14T09:10:06.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.31150346200000001 2024-09-14T09:10:06.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801387+0000", 2024-09-14T09:10:06.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.038e-06 2024-09-14T09:10:06.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802728+0000", 2024-09-14T09:10:06.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013415569999999 2024-09-14T09:10:06.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:06.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802739+0000", 2024-09-14T09:10:06.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0604e-05 2024-09-14T09:10:06.855 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.855 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:06.855 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.855 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62179 3.14 3.78cf1974 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:06.855 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:10:06.855 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 50.297241106999998, 2024-09-14T09:10:06.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3129429109999999, 2024-09-14T09:10:06.855 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:06.855 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:06.855 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:06.855 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:06.855 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:06.856 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:06.856 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62179 2024-09-14T09:10:06.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.856 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:06.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:06.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:10:06.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:06.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:10:06.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:06.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489827+0000", 2024-09-14T09:10:06.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4300000000000003e-07 2024-09-14T09:10:06.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:06.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489829+0000", 2024-09-14T09:10:06.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2129999999999998e-06 2024-09-14T09:10:06.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:06.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489836+0000", 2024-09-14T09:10:06.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0360000000000001e-06 2024-09-14T09:10:06.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:06.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489841+0000", 2024-09-14T09:10:06.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0710000000000002e-06 2024-09-14T09:10:06.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489905+0000", 2024-09-14T09:10:06.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3578999999999996e-05 2024-09-14T09:10:06.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489913+0000", 2024-09-14T09:10:06.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2269999999999993e-06 2024-09-14T09:10:06.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801412+0000", 2024-09-14T09:10:06.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.311498989 2024-09-14T09:10:06.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801419+0000", 2024-09-14T09:10:06.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1400000000000002e-06 2024-09-14T09:10:06.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802761+0000", 2024-09-14T09:10:06.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013414620000001 2024-09-14T09:10:06.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:06.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802769+0000", 2024-09-14T09:10:06.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6510000000000007e-06 2024-09-14T09:10:06.860 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.860 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:06.860 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.860 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63551 3.14 3.88ccb734 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:06.860 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:10:06.860 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 50.297209477000003, 2024-09-14T09:10:06.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.312941181, 2024-09-14T09:10:06.860 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:06.860 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:06.861 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:06.861 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:06.861 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:06.861 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:06.861 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63551 2024-09-14T09:10:06.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.861 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:06.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:06.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:10:06.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:06.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:10:06.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:06.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489859+0000", 2024-09-14T09:10:06.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9200000000000001e-07 2024-09-14T09:10:06.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:06.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489862+0000", 2024-09-14T09:10:06.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9629999999999998e-06 2024-09-14T09:10:06.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:06.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489868+0000", 2024-09-14T09:10:06.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3890000000000002e-06 2024-09-14T09:10:06.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:06.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489875+0000", 2024-09-14T09:10:06.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7950000000000002e-06 2024-09-14T09:10:06.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489939+0000", 2024-09-14T09:10:06.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4704999999999998e-05 2024-09-14T09:10:06.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489949+0000", 2024-09-14T09:10:06.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7799999999999995e-06 2024-09-14T09:10:06.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801447+0000", 2024-09-14T09:10:06.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.311497527 2024-09-14T09:10:06.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801454+0000", 2024-09-14T09:10:06.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1080000000000004e-06 2024-09-14T09:10:06.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802790+0000", 2024-09-14T09:10:06.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013364330000001 2024-09-14T09:10:06.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:06.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802799+0000", 2024-09-14T09:10:06.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8890000000000008e-06 2024-09-14T09:10:06.865 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.865 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:06.865 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.866 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:68716 3.14 3.96fe1934 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:06.866 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:10:06.866 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 50.245639009999998, 2024-09-14T09:10:06.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2614012569999999, 2024-09-14T09:10:06.866 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:06.866 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:06.866 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:06.866 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:06.866 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:06.866 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:06.866 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 68716 2024-09-14T09:10:06.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.867 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:06.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:06.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:10:06.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:06.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:10:06.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:06.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541429+0000", 2024-09-14T09:10:06.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8899999999999998e-07 2024-09-14T09:10:06.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:06.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541433+0000", 2024-09-14T09:10:06.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7330000000000001e-06 2024-09-14T09:10:06.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:06.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541442+0000", 2024-09-14T09:10:06.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.346e-06 2024-09-14T09:10:06.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:06.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541449+0000", 2024-09-14T09:10:06.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.579e-06 2024-09-14T09:10:06.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541839+0000", 2024-09-14T09:10:06.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038993699999999998 2024-09-14T09:10:06.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541849+0000", 2024-09-14T09:10:06.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0217999999999999e-05 2024-09-14T09:10:06.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801480+0000", 2024-09-14T09:10:06.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.25963061399999998 2024-09-14T09:10:06.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801486+0000", 2024-09-14T09:10:06.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.776e-06 2024-09-14T09:10:06.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802821+0000", 2024-09-14T09:10:06.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00133435 2024-09-14T09:10:06.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:06.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802830+0000", 2024-09-14T09:10:06.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9150000000000002e-06 2024-09-14T09:10:06.871 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.871 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:06.871 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.871 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:69492 3.14 3.4a93714 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:06.871 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:10:06.871 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 50.185099313999999, 2024-09-14T09:10:06.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2008910690000001, 2024-09-14T09:10:06.871 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:06.872 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:06.872 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:06.872 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:06.872 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:06.872 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:06.872 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 69492 2024-09-14T09:10:06.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.872 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:06.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:06.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:10:06.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:06.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:10:06.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:06.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601969+0000", 2024-09-14T09:10:06.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3099999999999996e-07 2024-09-14T09:10:06.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:06.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601973+0000", 2024-09-14T09:10:06.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5899999999999999e-06 2024-09-14T09:10:06.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:06.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601983+0000", 2024-09-14T09:10:06.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098999999999999e-05 2024-09-14T09:10:06.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:06.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601989+0000", 2024-09-14T09:10:06.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0209999999999996e-06 2024-09-14T09:10:06.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.602066+0000", 2024-09-14T09:10:06.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7075000000000003e-05 2024-09-14T09:10:06.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.602075+0000", 2024-09-14T09:10:06.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8389999999999996e-06 2024-09-14T09:10:06.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801512+0000", 2024-09-14T09:10:06.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.199437225 2024-09-14T09:10:06.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801519+0000", 2024-09-14T09:10:06.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9970000000000001e-06 2024-09-14T09:10:06.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802851+0000", 2024-09-14T09:10:06.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001331711 2024-09-14T09:10:06.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:06.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802859+0000", 2024-09-14T09:10:06.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6810000000000004e-06 2024-09-14T09:10:06.877 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.877 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:06.877 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.877 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:72035 3.14 3.1cba9a34 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:06.877 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:10:06.877 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 50.065771425999998, 2024-09-14T09:10:06.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0815917340000001, 2024-09-14T09:10:06.877 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:06.877 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:06.878 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:06.878 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:06.878 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:06.878 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:06.878 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 72035 2024-09-14T09:10:06.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.878 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:06.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:06.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:10:06.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:06.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:10:06.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:06.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721297+0000", 2024-09-14T09:10:06.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5199999999999996e-07 2024-09-14T09:10:06.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:06.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721301+0000", 2024-09-14T09:10:06.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7790000000000002e-06 2024-09-14T09:10:06.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:06.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721309+0000", 2024-09-14T09:10:06.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8019999999999998e-06 2024-09-14T09:10:06.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:06.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721315+0000", 2024-09-14T09:10:06.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:10:06.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721367+0000", 2024-09-14T09:10:06.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2280000000000001e-05 2024-09-14T09:10:06.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721376+0000", 2024-09-14T09:10:06.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5439999999999999e-06 2024-09-14T09:10:06.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801545+0000", 2024-09-14T09:10:06.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.080169952000000003 2024-09-14T09:10:06.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801552+0000", 2024-09-14T09:10:06.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8390000000000001e-06 2024-09-14T09:10:06.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802879+0000", 2024-09-14T09:10:06.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001326846 2024-09-14T09:10:06.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:06.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802888+0000", 2024-09-14T09:10:06.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6330000000000002e-06 2024-09-14T09:10:06.882 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.882 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:06.883 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.883 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73403 3.14 3.87b99f94 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:06.883 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:10:06.883 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 50.023496764999997, 2024-09-14T09:10:06.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0393459899999999, 2024-09-14T09:10:06.883 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:06.883 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:06.883 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:06.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:06.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:06.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:06.883 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73403 2024-09-14T09:10:06.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.884 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:06.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:06.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:10:06.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:06.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:10:06.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:06.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:10:06.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9200000000000001e-07 2024-09-14T09:10:06.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:06.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763574+0000", 2024-09-14T09:10:06.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6510000000000001e-06 2024-09-14T09:10:06.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:06.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763582+0000", 2024-09-14T09:10:06.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2579999999999995e-06 2024-09-14T09:10:06.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:06.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763592+0000", 2024-09-14T09:10:06.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0193e-05 2024-09-14T09:10:06.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763643+0000", 2024-09-14T09:10:06.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0862000000000002e-05 2024-09-14T09:10:06.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763654+0000", 2024-09-14T09:10:06.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0890000000000001e-05 2024-09-14T09:10:06.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801577+0000", 2024-09-14T09:10:06.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037923074000000001 2024-09-14T09:10:06.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801584+0000", 2024-09-14T09:10:06.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0060000000000003e-06 2024-09-14T09:10:06.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802908+0000", 2024-09-14T09:10:06.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013235149999999 2024-09-14T09:10:06.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:06.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802917+0000", 2024-09-14T09:10:06.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9490000000000002e-06 2024-09-14T09:10:06.888 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.888 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:06.888 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.888 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:36215 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T09:10:06.888 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:52.846616+0000", 2024-09-14T09:10:06.888 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.940451161, 2024-09-14T09:10:06.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0047992570000002, 2024-09-14T09:10:06.888 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:06.888 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:06.888 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:06.889 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:06.889 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:10:06.889 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:10:06.889 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36215 2024-09-14T09:10:06.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.889 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:06.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:06.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846616+0000", 2024-09-14T09:10:06.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:06.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846616+0000", 2024-09-14T09:10:06.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:06.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:06.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846618+0000", 2024-09-14T09:10:06.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6700000000000001e-06 2024-09-14T09:10:06.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:06.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846626+0000", 2024-09-14T09:10:06.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0430000000000008e-06 2024-09-14T09:10:06.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:06.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846641+0000", 2024-09-14T09:10:06.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5009e-05 2024-09-14T09:10:06.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:06.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846650+0000", 2024-09-14T09:10:06.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7409999999999998e-06 2024-09-14T09:10:06.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846726+0000", 2024-09-14T09:10:06.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6149000000000006e-05 2024-09-14T09:10:06.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846736+0000", 2024-09-14T09:10:06.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7119999999999995e-06 2024-09-14T09:10:06.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:53.822292+0000", 2024-09-14T09:10:06.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.97555623800000002 2024-09-14T09:10:06.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:06.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:53.822307+0000", 2024-09-14T09:10:06.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4646e-05 2024-09-14T09:10:06.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:06.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:54.850919+0000", 2024-09-14T09:10:06.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.028612284 2024-09-14T09:10:06.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:06.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:54.851186+0000", 2024-09-14T09:10:06.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000267318 2024-09-14T09:10:06.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:06.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:06.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:06.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:54.851416+0000", 2024-09-14T09:10:06.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000229447 2024-09-14T09:10:06.893 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.893 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:06.893 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.893 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:06.893 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:06.894 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:06.895 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:10:06.895 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:06.896+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:06.996 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:06.998+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:07.000 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:07.001 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:07.001 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:10:07.001 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:07.010 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:10:07.097 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:07.098+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:07.152 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:07.152 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:07.152 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:10:07.152 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:10:07.152 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:07.161 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:10:07.198 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:07.200+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:07.266 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:07.266 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:10:07.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:10:07.266 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:10:07.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.266 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:249 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1638400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:07.266 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:10:07.266 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 95.470203347999998, 2024-09-14T09:10:07.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99070346899999995, 2024-09-14T09:10:07.266 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.266 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.267 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.267 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.267 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:07.267 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:07.267 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 249 2024-09-14T09:10:07.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.267 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:10:07.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:10:07.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796868+0000", 2024-09-14T09:10:07.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2024-09-14T09:10:07.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796870+0000", 2024-09-14T09:10:07.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7889999999999999e-06 2024-09-14T09:10:07.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796877+0000", 2024-09-14T09:10:07.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8549999999999996e-06 2024-09-14T09:10:07.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796883+0000", 2024-09-14T09:10:07.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.665e-06 2024-09-14T09:10:07.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796915+0000", 2024-09-14T09:10:07.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2215999999999998e-05 2024-09-14T09:10:07.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796920+0000", 2024-09-14T09:10:07.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.527e-06 2024-09-14T09:10:07.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787468+0000", 2024-09-14T09:10:07.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99054877100000005 2024-09-14T09:10:07.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787512+0000", 2024-09-14T09:10:07.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3958000000000002e-05 2024-09-14T09:10:07.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787571+0000", 2024-09-14T09:10:07.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8167000000000001e-05 2024-09-14T09:10:07.271 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.271 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.271 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.271 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:250 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2097152~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:07.271 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:10:07.271 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 95.470177281999995, 2024-09-14T09:10:07.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99079431100000004, 2024-09-14T09:10:07.272 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.272 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.272 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.272 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.272 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:07.272 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:07.272 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 250 2024-09-14T09:10:07.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.272 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:10:07.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:10:07.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796894+0000", 2024-09-14T09:10:07.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2024-09-14T09:10:07.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796896+0000", 2024-09-14T09:10:07.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5600000000000001e-06 2024-09-14T09:10:07.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796902+0000", 2024-09-14T09:10:07.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3090000000000001e-06 2024-09-14T09:10:07.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796909+0000", 2024-09-14T09:10:07.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:10:07.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796942+0000", 2024-09-14T09:10:07.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-05 2024-09-14T09:10:07.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796948+0000", 2024-09-14T09:10:07.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5910000000000001e-06 2024-09-14T09:10:07.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787596+0000", 2024-09-14T09:10:07.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99064781400000002 2024-09-14T09:10:07.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787636+0000", 2024-09-14T09:10:07.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9715000000000002e-05 2024-09-14T09:10:07.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787687+0000", 2024-09-14T09:10:07.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1674e-05 2024-09-14T09:10:07.276 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.277 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.277 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.277 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:251 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:07.277 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:10:07.277 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 95.470151846999997, 2024-09-14T09:10:07.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99091769600000001, 2024-09-14T09:10:07.277 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.278 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.278 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.278 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.278 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:07.278 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:07.278 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 251 2024-09-14T09:10:07.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.278 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:10:07.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:10:07.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:10:07.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000005e-07 2024-09-14T09:10:07.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796922+0000", 2024-09-14T09:10:07.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.875e-06 2024-09-14T09:10:07.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796929+0000", 2024-09-14T09:10:07.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0260000000000002e-06 2024-09-14T09:10:07.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796935+0000", 2024-09-14T09:10:07.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7030000000000003e-06 2024-09-14T09:10:07.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796963+0000", 2024-09-14T09:10:07.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8368999999999999e-05 2024-09-14T09:10:07.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796966+0000", 2024-09-14T09:10:07.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4130000000000002e-06 2024-09-14T09:10:07.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787718+0000", 2024-09-14T09:10:07.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99075151100000003 2024-09-14T09:10:07.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787779+0000", 2024-09-14T09:10:07.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.088e-05 2024-09-14T09:10:07.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787836+0000", 2024-09-14T09:10:07.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7380000000000003e-05 2024-09-14T09:10:07.282 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.282 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.282 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.282 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:252 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:07.282 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:10:07.283 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 95.470126393000001, 2024-09-14T09:10:07.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99102491400000003, 2024-09-14T09:10:07.283 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.283 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.283 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.283 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.283 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:07.283 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:07.283 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 252 2024-09-14T09:10:07.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.283 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:10:07.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:10:07.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796945+0000", 2024-09-14T09:10:07.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2900000000000003e-07 2024-09-14T09:10:07.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796947+0000", 2024-09-14T09:10:07.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4279999999999999e-06 2024-09-14T09:10:07.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796954+0000", 2024-09-14T09:10:07.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5479999999999998e-06 2024-09-14T09:10:07.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796959+0000", 2024-09-14T09:10:07.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.22e-06 2024-09-14T09:10:07.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796988+0000", 2024-09-14T09:10:07.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9473000000000001e-05 2024-09-14T09:10:07.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:10:07.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:10:07.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787850+0000", 2024-09-14T09:10:07.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99085651100000005 2024-09-14T09:10:07.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787891+0000", 2024-09-14T09:10:07.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602000000000002e-05 2024-09-14T09:10:07.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787969+0000", 2024-09-14T09:10:07.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8063000000000001e-05 2024-09-14T09:10:07.288 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.288 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.288 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.288 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:253 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:07.288 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:10:07.288 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 95.470102513, 2024-09-14T09:10:07.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99122695699999996, 2024-09-14T09:10:07.288 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.288 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.288 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.288 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.289 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:07.289 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:07.289 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 253 2024-09-14T09:10:07.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.289 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:10:07.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:10:07.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:10:07.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:10:07.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:10:07.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:10:07.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796977+0000", 2024-09-14T09:10:07.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5030000000000002e-06 2024-09-14T09:10:07.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796982+0000", 2024-09-14T09:10:07.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2024-09-14T09:10:07.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797013+0000", 2024-09-14T09:10:07.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0451e-05 2024-09-14T09:10:07.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:10:07.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1690000000000001e-06 2024-09-14T09:10:07.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788011+0000", 2024-09-14T09:10:07.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99099490300000004 2024-09-14T09:10:07.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788102+0000", 2024-09-14T09:10:07.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0730999999999996e-05 2024-09-14T09:10:07.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788195+0000", 2024-09-14T09:10:07.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3245999999999995e-05 2024-09-14T09:10:07.293 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.293 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.293 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.293 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:254 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3932160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:07.293 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:10:07.293 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 95.470070954999997, 2024-09-14T09:10:07.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99137410500000001, 2024-09-14T09:10:07.294 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.294 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.294 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.294 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.294 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:07.294 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:07.294 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 254 2024-09-14T09:10:07.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.294 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:10:07.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:10:07.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797000+0000", 2024-09-14T09:10:07.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:10:07.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797003+0000", 2024-09-14T09:10:07.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7659999999999999e-06 2024-09-14T09:10:07.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797010+0000", 2024-09-14T09:10:07.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.029e-06 2024-09-14T09:10:07.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:10:07.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2024-09-14T09:10:07.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797044+0000", 2024-09-14T09:10:07.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9213e-05 2024-09-14T09:10:07.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797048+0000", 2024-09-14T09:10:07.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3400000000000002e-06 2024-09-14T09:10:07.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788222+0000", 2024-09-14T09:10:07.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99117407400000002 2024-09-14T09:10:07.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788306+0000", 2024-09-14T09:10:07.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4512999999999995e-05 2024-09-14T09:10:07.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788374+0000", 2024-09-14T09:10:07.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7226999999999999e-05 2024-09-14T09:10:07.299 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.299 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.299 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.299 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:264 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:07.299 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:10:07.299 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 95.470044596999998, 2024-09-14T09:10:07.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99161474699999996, 2024-09-14T09:10:07.300 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.300 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.300 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.300 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.300 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:07.300 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:07.300 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 264 2024-09-14T09:10:07.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.300 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:10:07.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:10:07.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:10:07.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2024-09-14T09:10:07.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:10:07.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2800000000000002e-06 2024-09-14T09:10:07.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:10:07.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0979999999999999e-06 2024-09-14T09:10:07.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797040+0000", 2024-09-14T09:10:07.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:10:07.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797068+0000", 2024-09-14T09:10:07.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7302999999999999e-05 2024-09-14T09:10:07.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797071+0000", 2024-09-14T09:10:07.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3610000000000001e-06 2024-09-14T09:10:07.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788436+0000", 2024-09-14T09:10:07.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99136489500000002 2024-09-14T09:10:07.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788538+0000", 2024-09-14T09:10:07.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101931 2024-09-14T09:10:07.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788641+0000", 2024-09-14T09:10:07.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010273899999999999 2024-09-14T09:10:07.304 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.304 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.304 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.304 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:265 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:07.305 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:10:07.305 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 95.470021238000001, 2024-09-14T09:10:07.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99176878199999996, 2024-09-14T09:10:07.305 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.305 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.305 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.305 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.305 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:07.305 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:07.305 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 265 2024-09-14T09:10:07.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.305 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:10:07.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:10:07.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:10:07.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.39e-07 2024-09-14T09:10:07.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797052+0000", 2024-09-14T09:10:07.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.345e-06 2024-09-14T09:10:07.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797058+0000", 2024-09-14T09:10:07.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5429999999999999e-06 2024-09-14T09:10:07.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797064+0000", 2024-09-14T09:10:07.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2000000000000002e-06 2024-09-14T09:10:07.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797091+0000", 2024-09-14T09:10:07.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7804e-05 2024-09-14T09:10:07.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797095+0000", 2024-09-14T09:10:07.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2024-09-14T09:10:07.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788667+0000", 2024-09-14T09:10:07.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157211300000003 2024-09-14T09:10:07.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788742+0000", 2024-09-14T09:10:07.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5159000000000003e-05 2024-09-14T09:10:07.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788818+0000", 2024-09-14T09:10:07.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6038000000000006e-05 2024-09-14T09:10:07.310 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.310 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.310 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.310 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:266 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:07.310 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:10:07.310 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 95.469998407000006, 2024-09-14T09:10:07.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99193390100000001, 2024-09-14T09:10:07.310 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.310 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.310 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.310 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.311 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:07.311 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:07.311 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 266 2024-09-14T09:10:07.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.311 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:10:07.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:10:07.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:10:07.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:10:07.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797075+0000", 2024-09-14T09:10:07.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2570000000000002e-06 2024-09-14T09:10:07.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797082+0000", 2024-09-14T09:10:07.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8029999999999997e-06 2024-09-14T09:10:07.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797088+0000", 2024-09-14T09:10:07.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.468e-06 2024-09-14T09:10:07.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797116+0000", 2024-09-14T09:10:07.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7752000000000001e-05 2024-09-14T09:10:07.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797121+0000", 2024-09-14T09:10:07.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5960000000000003e-06 2024-09-14T09:10:07.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788846+0000", 2024-09-14T09:10:07.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99172512199999996 2024-09-14T09:10:07.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788916+0000", 2024-09-14T09:10:07.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9843000000000002e-05 2024-09-14T09:10:07.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789006+0000", 2024-09-14T09:10:07.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9608e-05 2024-09-14T09:10:07.315 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.315 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.315 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.315 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:267 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:07.315 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:10:07.315 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 95.469973600000003, 2024-09-14T09:10:07.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99210926799999999, 2024-09-14T09:10:07.315 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.315 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.315 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.316 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.316 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:07.316 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:07.316 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 267 2024-09-14T09:10:07.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.316 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:10:07.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:10:07.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:10:07.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2399999999999999e-07 2024-09-14T09:10:07.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797099+0000", 2024-09-14T09:10:07.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.091e-06 2024-09-14T09:10:07.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797105+0000", 2024-09-14T09:10:07.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-09-14T09:10:07.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797111+0000", 2024-09-14T09:10:07.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5130000000000004e-06 2024-09-14T09:10:07.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797140+0000", 2024-09-14T09:10:07.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9513999999999999e-05 2024-09-14T09:10:07.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797145+0000", 2024-09-14T09:10:07.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:10:07.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789037+0000", 2024-09-14T09:10:07.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99189253899999996 2024-09-14T09:10:07.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789110+0000", 2024-09-14T09:10:07.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2848000000000005e-05 2024-09-14T09:10:07.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789206+0000", 2024-09-14T09:10:07.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5778000000000004e-05 2024-09-14T09:10:07.320 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.320 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.321 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.321 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:268 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:07.321 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:10:07.321 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 95.469950361000002, 2024-09-14T09:10:07.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992276359, 2024-09-14T09:10:07.321 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.321 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.321 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.321 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.321 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:07.321 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:07.322 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 268 2024-09-14T09:10:07.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.322 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:10:07.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:10:07.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:10:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:10:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797123+0000", 2024-09-14T09:10:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2740000000000002e-06 2024-09-14T09:10:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797129+0000", 2024-09-14T09:10:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-06 2024-09-14T09:10:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797134+0000", 2024-09-14T09:10:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9099999999999996e-06 2024-09-14T09:10:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797163+0000", 2024-09-14T09:10:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9709999999999998e-05 2024-09-14T09:10:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:10:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8709999999999999e-06 2024-09-14T09:10:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789231+0000", 2024-09-14T09:10:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992063959 2024-09-14T09:10:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789306+0000", 2024-09-14T09:10:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5289000000000004e-05 2024-09-14T09:10:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789396+0000", 2024-09-14T09:10:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9939999999999996e-05 2024-09-14T09:10:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:269 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2457600~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:10:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 95.469926852, 2024-09-14T09:10:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99242174400000005, 2024-09-14T09:10:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 269 2024-09-14T09:10:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:10:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:10:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:10:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:10:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797146+0000", 2024-09-14T09:10:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5289999999999998e-06 2024-09-14T09:10:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797153+0000", 2024-09-14T09:10:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1920000000000002e-06 2024-09-14T09:10:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797158+0000", 2024-09-14T09:10:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099999999999998e-06 2024-09-14T09:10:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797188+0000", 2024-09-14T09:10:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0128e-05 2024-09-14T09:10:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797194+0000", 2024-09-14T09:10:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6250000000000004e-06 2024-09-14T09:10:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789439+0000", 2024-09-14T09:10:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99224531000000005 2024-09-14T09:10:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789489+0000", 2024-09-14T09:10:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9830000000000002e-05 2024-09-14T09:10:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789565+0000", 2024-09-14T09:10:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6229000000000005e-05 2024-09-14T09:10:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:270 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:10:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 95.469903029999998, 2024-09-14T09:10:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99257721899999996, 2024-09-14T09:10:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 270 2024-09-14T09:10:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:10:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:10:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797168+0000", 2024-09-14T09:10:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2024-09-14T09:10:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797170+0000", 2024-09-14T09:10:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3120000000000001e-06 2024-09-14T09:10:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797177+0000", 2024-09-14T09:10:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0960000000000003e-06 2024-09-14T09:10:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797183+0000", 2024-09-14T09:10:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1669999999999998e-06 2024-09-14T09:10:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797213+0000", 2024-09-14T09:10:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0494e-05 2024-09-14T09:10:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:10:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:10:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789586+0000", 2024-09-14T09:10:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99236692100000001 2024-09-14T09:10:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789658+0000", 2024-09-14T09:10:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2279000000000004e-05 2024-09-14T09:10:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789745+0000", 2024-09-14T09:10:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6698000000000002e-05 2024-09-14T09:10:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:271 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3375104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:10:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 95.469877831999995, 2024-09-14T09:10:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99274791699999998, 2024-09-14T09:10:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 271 2024-09-14T09:10:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:10:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:10:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:10:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:10:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797195+0000", 2024-09-14T09:10:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1639999999999999e-06 2024-09-14T09:10:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797201+0000", 2024-09-14T09:10:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1290000000000001e-06 2024-09-14T09:10:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797206+0000", 2024-09-14T09:10:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9300000000000002e-06 2024-09-14T09:10:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797237+0000", 2024-09-14T09:10:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1285000000000003e-05 2024-09-14T09:10:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797242+0000", 2024-09-14T09:10:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6e-06 2024-09-14T09:10:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789768+0000", 2024-09-14T09:10:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99252547400000002 2024-09-14T09:10:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789826+0000", 2024-09-14T09:10:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8155999999999997e-05 2024-09-14T09:10:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789940+0000", 2024-09-14T09:10:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114788 2024-09-14T09:10:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:272 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:10:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 95.469854437999999, 2024-09-14T09:10:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99285248800000003, 2024-09-14T09:10:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 272 2024-09-14T09:10:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:10:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:10:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:10:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:10:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:10:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5129999999999999e-06 2024-09-14T09:10:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797226+0000", 2024-09-14T09:10:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4529999999999996e-06 2024-09-14T09:10:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797232+0000", 2024-09-14T09:10:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1839999999999998e-06 2024-09-14T09:10:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797264+0000", 2024-09-14T09:10:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2691999999999998e-05 2024-09-14T09:10:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797270+0000", 2024-09-14T09:10:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-06 2024-09-14T09:10:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789965+0000", 2024-09-14T09:10:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99269526200000002 2024-09-14T09:10:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790021+0000", 2024-09-14T09:10:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5297000000000003e-05 2024-09-14T09:10:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790068+0000", 2024-09-14T09:10:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7664999999999998e-05 2024-09-14T09:10:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:10:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.479597990999999, 2024-09-14T09:10:07.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146649299999999, 2024-09-14T09:10:07.349 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.349 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.349 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:07.349 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.349 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:07.349 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:07.350 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 58987 2024-09-14T09:10:07.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.350 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:10:07.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:10:07.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787474+0000", 2024-09-14T09:10:07.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1799999999999999e-06 2024-09-14T09:10:07.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787483+0000", 2024-09-14T09:10:07.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9830000000000002e-06 2024-09-14T09:10:07.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787494+0000", 2024-09-14T09:10:07.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1496e-05 2024-09-14T09:10:07.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787502+0000", 2024-09-14T09:10:07.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8280000000000003e-06 2024-09-14T09:10:07.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787563+0000", 2024-09-14T09:10:07.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1583999999999999e-05 2024-09-14T09:10:07.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:10:07.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787571+0000", 2024-09-14T09:10:07.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.058e-06 2024-09-14T09:10:07.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.791999+0000", 2024-09-14T09:10:07.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004428675 2024-09-14T09:10:07.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792008+0000", 2024-09-14T09:10:07.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9069999999999996e-06 2024-09-14T09:10:07.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802124+0000", 2024-09-14T09:10:07.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0101154619999999 2024-09-14T09:10:07.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802137+0000", 2024-09-14T09:10:07.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3757000000000001e-05 2024-09-14T09:10:07.354 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.354 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.354 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.354 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:67110 3.5 3.6b6808c5 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:07.354 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:10:07.354 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.479465175999998, 2024-09-14T09:10:07.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0147494290000001, 2024-09-14T09:10:07.355 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.355 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.355 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:07.355 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.355 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:07.355 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:07.355 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 67110 2024-09-14T09:10:07.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.355 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:10:07.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:10:07.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787606+0000", 2024-09-14T09:10:07.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6300000000000005e-07 2024-09-14T09:10:07.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787609+0000", 2024-09-14T09:10:07.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2789999999999999e-06 2024-09-14T09:10:07.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787616+0000", 2024-09-14T09:10:07.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8349999999999998e-06 2024-09-14T09:10:07.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787622+0000", 2024-09-14T09:10:07.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6999999999999996e-06 2024-09-14T09:10:07.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787666+0000", 2024-09-14T09:10:07.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3887000000000002e-05 2024-09-14T09:10:07.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:07.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787672+0000", 2024-09-14T09:10:07.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-09-14T09:10:07.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792033+0000", 2024-09-14T09:10:07.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043614250000000004 2024-09-14T09:10:07.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792041+0000", 2024-09-14T09:10:07.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5449999999999998e-06 2024-09-14T09:10:07.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:10:07.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0103013569999999 2024-09-14T09:10:07.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802355+0000", 2024-09-14T09:10:07.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2717999999999999e-05 2024-09-14T09:10:07.360 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.360 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.360 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.360 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72029 3.5 3.3f02ac5 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:07.360 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:10:07.361 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.479387660999997, 2024-09-14T09:10:07.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.014715139, 2024-09-14T09:10:07.361 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.361 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.361 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:07.361 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.361 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:07.361 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:07.361 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72029 2024-09-14T09:10:07.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.361 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:10:07.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:10:07.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:10:07.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7599999999999997e-07 2024-09-14T09:10:07.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787686+0000", 2024-09-14T09:10:07.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3999999999999999e-06 2024-09-14T09:10:07.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787692+0000", 2024-09-14T09:10:07.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3489999999999997e-06 2024-09-14T09:10:07.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787697+0000", 2024-09-14T09:10:07.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2320000000000001e-06 2024-09-14T09:10:07.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787742+0000", 2024-09-14T09:10:07.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4557e-05 2024-09-14T09:10:07.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:07.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787748+0000", 2024-09-14T09:10:07.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7810000000000002e-06 2024-09-14T09:10:07.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792065+0000", 2024-09-14T09:10:07.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043178679999999999 2024-09-14T09:10:07.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792073+0000", 2024-09-14T09:10:07.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6329999999999996e-06 2024-09-14T09:10:07.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802388+0000", 2024-09-14T09:10:07.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010315394 2024-09-14T09:10:07.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802398+0000", 2024-09-14T09:10:07.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4490000000000005e-06 2024-09-14T09:10:07.366 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.366 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.366 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.366 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72038 3.5 3.c914e45 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:07.366 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:10:07.366 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.479312028000002, 2024-09-14T09:10:07.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146757740000001, 2024-09-14T09:10:07.366 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.366 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.367 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:07.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:07.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:07.367 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72038 2024-09-14T09:10:07.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.367 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:10:07.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:10:07.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787759+0000", 2024-09-14T09:10:07.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0100000000000005e-07 2024-09-14T09:10:07.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787761+0000", 2024-09-14T09:10:07.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4049999999999998e-06 2024-09-14T09:10:07.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787768+0000", 2024-09-14T09:10:07.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.314e-06 2024-09-14T09:10:07.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787773+0000", 2024-09-14T09:10:07.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2789999999999998e-06 2024-09-14T09:10:07.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787813+0000", 2024-09-14T09:10:07.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9582000000000002e-05 2024-09-14T09:10:07.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:07.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787818+0000", 2024-09-14T09:10:07.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7100000000000004e-06 2024-09-14T09:10:07.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792096+0000", 2024-09-14T09:10:07.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042776460000000004 2024-09-14T09:10:07.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792103+0000", 2024-09-14T09:10:07.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7129999999999999e-06 2024-09-14T09:10:07.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802427+0000", 2024-09-14T09:10:07.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010324805 2024-09-14T09:10:07.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802434+0000", 2024-09-14T09:10:07.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:10:07.372 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.372 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.372 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.372 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:74840 3.5 3.ab2c8d25 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:07.372 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:10:07.372 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.457260142999999, 2024-09-14T09:10:07.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99271963600000002, 2024-09-14T09:10:07.372 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.372 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.372 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:07.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:07.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:07.373 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74840 2024-09-14T09:10:07.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.373 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:10:07.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:10:07.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809812+0000", 2024-09-14T09:10:07.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2899999999999999e-06 2024-09-14T09:10:07.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809817+0000", 2024-09-14T09:10:07.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0139999999999998e-06 2024-09-14T09:10:07.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809834+0000", 2024-09-14T09:10:07.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7643e-05 2024-09-14T09:10:07.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809842+0000", 2024-09-14T09:10:07.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2970000000000004e-06 2024-09-14T09:10:07.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809902+0000", 2024-09-14T09:10:07.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9106e-05 2024-09-14T09:10:07.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809912+0000", 2024-09-14T09:10:07.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0101e-05 2024-09-14T09:10:07.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802520+0000", 2024-09-14T09:10:07.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99260828599999995 2024-09-14T09:10:07.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802530+0000", 2024-09-14T09:10:07.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8989999999999996e-06 2024-09-14T09:10:07.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.376 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.376 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.376 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:07.378 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:10:07.378 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:07.380+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:07.479 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:07.481+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:07.523 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:07.523 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:07.523 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:10:07.523 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:07.532 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:10:07.579 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:07.582+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:07.675 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:10:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:10:07.675 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:07.680 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:07.683+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:07.683 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:10:07.782 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:07.784+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:07.829 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:07.829 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:10:07.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:10:07.829 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:10:07.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.829 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5349 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8302592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:07.830 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:10:07.830 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 90.574464215999996, 2024-09-14T09:10:07.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039875928999999997, 2024-09-14T09:10:07.830 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.830 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.830 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.830 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.830 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:10:07.830 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:07.830 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5349 2024-09-14T09:10:07.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.830 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:10:07.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:10:07.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255874+0000", 2024-09-14T09:10:07.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4900000000000001e-07 2024-09-14T09:10:07.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255880+0000", 2024-09-14T09:10:07.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9939999999999997e-06 2024-09-14T09:10:07.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255886+0000", 2024-09-14T09:10:07.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3899999999999998e-06 2024-09-14T09:10:07.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255891+0000", 2024-09-14T09:10:07.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.938e-06 2024-09-14T09:10:07.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295580+0000", 2024-09-14T09:10:07.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039688681000000003 2024-09-14T09:10:07.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295653+0000", 2024-09-14T09:10:07.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3045000000000003e-05 2024-09-14T09:10:07.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295749+0000", 2024-09-14T09:10:07.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6532000000000003e-05 2024-09-14T09:10:07.834 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.834 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.834 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.834 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5350 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8364032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:07.834 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:10:07.834 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 90.574440409000005, 2024-09-14T09:10:07.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039989719, 2024-09-14T09:10:07.834 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.834 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.834 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.834 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.835 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:10:07.835 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:07.835 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5350 2024-09-14T09:10:07.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.835 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:10:07.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:10:07.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255898+0000", 2024-09-14T09:10:07.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2024-09-14T09:10:07.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255899+0000", 2024-09-14T09:10:07.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9139999999999998e-06 2024-09-14T09:10:07.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255905+0000", 2024-09-14T09:10:07.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7289999999999997e-06 2024-09-14T09:10:07.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255910+0000", 2024-09-14T09:10:07.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6210000000000003e-06 2024-09-14T09:10:07.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295775+0000", 2024-09-14T09:10:07.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039864973999999997 2024-09-14T09:10:07.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295828+0000", 2024-09-14T09:10:07.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3411000000000001e-05 2024-09-14T09:10:07.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295887+0000", 2024-09-14T09:10:07.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699000000000002e-05 2024-09-14T09:10:07.838 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.838 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.838 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.838 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4639 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1843200~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:07.838 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:10:07.838 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.630524949999995, 2024-09-14T09:10:07.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040843672999999997, 2024-09-14T09:10:07.838 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.838 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.839 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.839 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.839 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:07.839 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:07.839 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4639 2024-09-14T09:10:07.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.839 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:10:07.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:10:07.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:10:07.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:10:07.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199818+0000", 2024-09-14T09:10:07.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1450000000000001e-06 2024-09-14T09:10:07.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199827+0000", 2024-09-14T09:10:07.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3999999999999998e-06 2024-09-14T09:10:07.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199834+0000", 2024-09-14T09:10:07.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0809999999999996e-06 2024-09-14T09:10:07.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240541+0000", 2024-09-14T09:10:07.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040706941000000003 2024-09-14T09:10:07.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240584+0000", 2024-09-14T09:10:07.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3040999999999997e-05 2024-09-14T09:10:07.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240656+0000", 2024-09-14T09:10:07.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2200000000000007e-05 2024-09-14T09:10:07.843 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.843 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.843 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.843 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4640 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1871872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:07.843 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:10:07.843 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.630490464999994, 2024-09-14T09:10:07.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040967601999999999, 2024-09-14T09:10:07.843 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.843 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.843 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.843 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.844 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:07.844 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:07.844 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4640 2024-09-14T09:10:07.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.844 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:10:07.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:10:07.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199848+0000", 2024-09-14T09:10:07.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5400000000000002e-07 2024-09-14T09:10:07.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199850+0000", 2024-09-14T09:10:07.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2479999999999999e-06 2024-09-14T09:10:07.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199857+0000", 2024-09-14T09:10:07.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.187e-06 2024-09-14T09:10:07.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199862+0000", 2024-09-14T09:10:07.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5119999999999999e-06 2024-09-14T09:10:07.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240684+0000", 2024-09-14T09:10:07.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040821245999999999 2024-09-14T09:10:07.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240739+0000", 2024-09-14T09:10:07.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4991999999999998e-05 2024-09-14T09:10:07.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240815+0000", 2024-09-14T09:10:07.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5963000000000004e-05 2024-09-14T09:10:07.847 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.847 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.848 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.848 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4641 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1900544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:07.848 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:10:07.848 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.630468135000001, 2024-09-14T09:10:07.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041205512, 2024-09-14T09:10:07.848 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.848 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.848 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.848 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.848 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:07.848 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:07.849 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4641 2024-09-14T09:10:07.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.849 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:10:07.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:10:07.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199870+0000", 2024-09-14T09:10:07.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0600000000000001e-07 2024-09-14T09:10:07.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199872+0000", 2024-09-14T09:10:07.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.928e-06 2024-09-14T09:10:07.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199877+0000", 2024-09-14T09:10:07.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6949999999999997e-06 2024-09-14T09:10:07.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199882+0000", 2024-09-14T09:10:07.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8210000000000001e-06 2024-09-14T09:10:07.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240847+0000", 2024-09-14T09:10:07.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040965201999999999 2024-09-14T09:10:07.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240888+0000", 2024-09-14T09:10:07.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0754000000000003e-05 2024-09-14T09:10:07.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241075+0000", 2024-09-14T09:10:07.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000186706 2024-09-14T09:10:07.853 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.853 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.853 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.853 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4642 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1929216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:07.853 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:10:07.853 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.630449200000001, 2024-09-14T09:10:07.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041292575999999998, 2024-09-14T09:10:07.853 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.853 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.854 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.854 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.854 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:07.854 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:07.854 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4642 2024-09-14T09:10:07.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.854 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:10:07.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:10:07.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199889+0000", 2024-09-14T09:10:07.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2024-09-14T09:10:07.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199891+0000", 2024-09-14T09:10:07.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9e-06 2024-09-14T09:10:07.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199896+0000", 2024-09-14T09:10:07.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6960000000000002e-06 2024-09-14T09:10:07.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199901+0000", 2024-09-14T09:10:07.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6720000000000003e-06 2024-09-14T09:10:07.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241089+0000", 2024-09-14T09:10:07.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041187594000000001 2024-09-14T09:10:07.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241126+0000", 2024-09-14T09:10:07.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7490999999999997e-05 2024-09-14T09:10:07.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241181+0000", 2024-09-14T09:10:07.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4823e-05 2024-09-14T09:10:07.857 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.857 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.857 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.857 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4643 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1957888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:07.857 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:10:07.857 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.630429921000001, 2024-09-14T09:10:07.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041418333000000002, 2024-09-14T09:10:07.858 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.858 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.858 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.858 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.858 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:07.858 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:07.858 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4643 2024-09-14T09:10:07.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.858 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:10:07.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:10:07.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:10:07.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5699999999999998e-07 2024-09-14T09:10:07.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199910+0000", 2024-09-14T09:10:07.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.829e-06 2024-09-14T09:10:07.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199916+0000", 2024-09-14T09:10:07.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8499999999999999e-06 2024-09-14T09:10:07.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199920+0000", 2024-09-14T09:10:07.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6530000000000002e-06 2024-09-14T09:10:07.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241211+0000", 2024-09-14T09:10:07.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041290327000000002 2024-09-14T09:10:07.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241257+0000", 2024-09-14T09:10:07.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6347000000000002e-05 2024-09-14T09:10:07.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241326+0000", 2024-09-14T09:10:07.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8969999999999999e-05 2024-09-14T09:10:07.861 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.861 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.861 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.861 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4644 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1986560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:07.861 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:10:07.862 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.630411581000004, 2024-09-14T09:10:07.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041596269999999998, 2024-09-14T09:10:07.862 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.862 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.862 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.862 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.862 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:07.862 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:07.862 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4644 2024-09-14T09:10:07.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.862 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:10:07.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:10:07.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:10:07.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.41e-07 2024-09-14T09:10:07.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199928+0000", 2024-09-14T09:10:07.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8250000000000001e-06 2024-09-14T09:10:07.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199934+0000", 2024-09-14T09:10:07.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2280000000000003e-06 2024-09-14T09:10:07.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199939+0000", 2024-09-14T09:10:07.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8010000000000003e-06 2024-09-14T09:10:07.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241360+0000", 2024-09-14T09:10:07.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041421289 2024-09-14T09:10:07.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241435+0000", 2024-09-14T09:10:07.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4238000000000003e-05 2024-09-14T09:10:07.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241522+0000", 2024-09-14T09:10:07.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7547999999999996e-05 2024-09-14T09:10:07.866 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.866 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.866 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.866 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4645 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:07.866 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:10:07.866 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.630392674000007, 2024-09-14T09:10:07.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041714660000000001, 2024-09-14T09:10:07.866 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.866 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.866 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.866 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.866 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:07.866 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:07.867 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4645 2024-09-14T09:10:07.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.867 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:10:07.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:10:07.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:10:07.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4700000000000002e-07 2024-09-14T09:10:07.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199947+0000", 2024-09-14T09:10:07.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.801e-06 2024-09-14T09:10:07.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199953+0000", 2024-09-14T09:10:07.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.694e-06 2024-09-14T09:10:07.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199957+0000", 2024-09-14T09:10:07.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3069999999999996e-06 2024-09-14T09:10:07.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241547+0000", 2024-09-14T09:10:07.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041589895000000002 2024-09-14T09:10:07.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241590+0000", 2024-09-14T09:10:07.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2985000000000003e-05 2024-09-14T09:10:07.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241660+0000", 2024-09-14T09:10:07.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9630999999999998e-05 2024-09-14T09:10:07.870 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.870 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.870 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.870 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4646 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2043904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:07.870 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:10:07.870 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.630374685999996, 2024-09-14T09:10:07.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041827171000000003, 2024-09-14T09:10:07.870 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.870 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.870 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.871 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.871 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:07.871 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:07.871 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4646 2024-09-14T09:10:07.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.871 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:10:07.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:10:07.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:10:07.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6300000000000001e-07 2024-09-14T09:10:07.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199965+0000", 2024-09-14T09:10:07.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.035e-06 2024-09-14T09:10:07.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199973+0000", 2024-09-14T09:10:07.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9629999999999998e-06 2024-09-14T09:10:07.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199978+0000", 2024-09-14T09:10:07.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9069999999999998e-06 2024-09-14T09:10:07.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241677+0000", 2024-09-14T09:10:07.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041698662999999997 2024-09-14T09:10:07.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241717+0000", 2024-09-14T09:10:07.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602999999999997e-05 2024-09-14T09:10:07.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241790+0000", 2024-09-14T09:10:07.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2637000000000003e-05 2024-09-14T09:10:07.874 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.874 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.874 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.874 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4647 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2072576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:07.874 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:10:07.875 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 69.630346095999997, 2024-09-14T09:10:07.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041921189999999997, 2024-09-14T09:10:07.875 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.875 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.875 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.875 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.875 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:07.875 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:07.875 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4647 2024-09-14T09:10:07.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.875 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:10:07.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:10:07.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199992+0000", 2024-09-14T09:10:07.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3799999999999997e-07 2024-09-14T09:10:07.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199994+0000", 2024-09-14T09:10:07.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3020000000000002e-06 2024-09-14T09:10:07.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200004+0000", 2024-09-14T09:10:07.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3510000000000008e-06 2024-09-14T09:10:07.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200008+0000", 2024-09-14T09:10:07.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3329999999999998e-06 2024-09-14T09:10:07.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241814+0000", 2024-09-14T09:10:07.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041806280000000001 2024-09-14T09:10:07.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241855+0000", 2024-09-14T09:10:07.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0173999999999999e-05 2024-09-14T09:10:07.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241913+0000", 2024-09-14T09:10:07.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8112000000000002e-05 2024-09-14T09:10:07.878 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.878 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.878 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.879 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:59017 3.3 3:c1df81d6:::rbd_data.1112a10502fe.0000000000000189:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:07.879 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:10:07.879 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.043055494999997, 2024-09-14T09:10:07.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.024252111, 2024-09-14T09:10:07.879 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.879 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.879 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:07.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:07.879 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59017 2024-09-14T09:10:07.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.880 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:10:07.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:10:07.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787284+0000", 2024-09-14T09:10:07.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3879999999999998e-06 2024-09-14T09:10:07.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787297+0000", 2024-09-14T09:10:07.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2184999999999999e-05 2024-09-14T09:10:07.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787317+0000", 2024-09-14T09:10:07.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0054000000000001e-05 2024-09-14T09:10:07.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787327+0000", 2024-09-14T09:10:07.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0335e-05 2024-09-14T09:10:07.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787412+0000", 2024-09-14T09:10:07.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4691000000000006e-05 2024-09-14T09:10:07.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:10:07.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787422+0000", 2024-09-14T09:10:07.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0718e-05 2024-09-14T09:10:07.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790539+0000", 2024-09-14T09:10:07.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031164600000000002 2024-09-14T09:10:07.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790552+0000", 2024-09-14T09:10:07.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2736e-05 2024-09-14T09:10:07.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.798725+0000", 2024-09-14T09:10:07.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0081731860000001 2024-09-14T09:10:07.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.798824+0000", 2024-09-14T09:10:07.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9600999999999997e-05 2024-09-14T09:10:07.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.811534+0000", 2024-09-14T09:10:07.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012709757 2024-09-14T09:10:07.884 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.884 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.884 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.884 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:63586 3.3 3:c0d9272b:::rbd_data.1112a10502fe.00000000000001a2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:07.884 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:10:07.884 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.042984011999998, 2024-09-14T09:10:07.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0244069650000001, 2024-09-14T09:10:07.885 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.885 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.885 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.885 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.885 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:07.885 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:07.885 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 63586 2024-09-14T09:10:07.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.885 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:10:07.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:10:07.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:10:07.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2024-09-14T09:10:07.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787357+0000", 2024-09-14T09:10:07.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8720000000000002e-06 2024-09-14T09:10:07.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787365+0000", 2024-09-14T09:10:07.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9270000000000005e-06 2024-09-14T09:10:07.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787372+0000", 2024-09-14T09:10:07.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6810000000000001e-06 2024-09-14T09:10:07.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787479+0000", 2024-09-14T09:10:07.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010736800000000001 2024-09-14T09:10:07.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:07.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787485+0000", 2024-09-14T09:10:07.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.054e-06 2024-09-14T09:10:07.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790580+0000", 2024-09-14T09:10:07.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030949929999999999 2024-09-14T09:10:07.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790589+0000", 2024-09-14T09:10:07.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7600000000000008e-06 2024-09-14T09:10:07.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.799541+0000", 2024-09-14T09:10:07.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0089520110000001 2024-09-14T09:10:07.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.799620+0000", 2024-09-14T09:10:07.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8969999999999998e-05 2024-09-14T09:10:07.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.811760+0000", 2024-09-14T09:10:07.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012140748999999999 2024-09-14T09:10:07.889 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.889 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.889 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.890 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:65817 3.3 3:c2c49fe0:::rbd_data.1112a10502fe.00000000000001b3:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:07.890 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:10:07.890 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.04289421, 2024-09-14T09:10:07.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0253660200000001, 2024-09-14T09:10:07.890 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.890 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.890 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.890 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.890 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:07.890 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:07.890 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 65817 2024-09-14T09:10:07.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.890 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:10:07.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:10:07.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787444+0000", 2024-09-14T09:10:07.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999995e-07 2024-09-14T09:10:07.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787448+0000", 2024-09-14T09:10:07.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1420000000000003e-06 2024-09-14T09:10:07.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787497+0000", 2024-09-14T09:10:07.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8507999999999997e-05 2024-09-14T09:10:07.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787503+0000", 2024-09-14T09:10:07.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1319999999999999e-06 2024-09-14T09:10:07.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787595+0000", 2024-09-14T09:10:07.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1748000000000003e-05 2024-09-14T09:10:07.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:07.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787601+0000", 2024-09-14T09:10:07.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6150000000000002e-06 2024-09-14T09:10:07.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790613+0000", 2024-09-14T09:10:07.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003012228 2024-09-14T09:10:07.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790621+0000", 2024-09-14T09:10:07.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9219999999999997e-06 2024-09-14T09:10:07.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800130+0000", 2024-09-14T09:10:07.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.009508474 2024-09-14T09:10:07.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800257+0000", 2024-09-14T09:10:07.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012746900000000001 2024-09-14T09:10:07.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.812809+0000", 2024-09-14T09:10:07.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012552054 2024-09-14T09:10:07.895 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.895 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.895 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.895 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:68709 3.3 3:c4996abd:::rbd_data.1112a10502fe.00000000000001cd:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:07.895 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:10:07.895 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.042723264000003, 2024-09-14T09:10:07.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0254506109999999, 2024-09-14T09:10:07.895 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.895 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.895 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.895 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.895 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:07.896 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:07.896 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 68709 2024-09-14T09:10:07.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.896 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:10:07.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:10:07.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787615+0000", 2024-09-14T09:10:07.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4000000000000001e-07 2024-09-14T09:10:07.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787618+0000", 2024-09-14T09:10:07.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2780000000000002e-06 2024-09-14T09:10:07.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787626+0000", 2024-09-14T09:10:07.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0250000000000002e-06 2024-09-14T09:10:07.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787633+0000", 2024-09-14T09:10:07.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5660000000000003e-06 2024-09-14T09:10:07.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787714+0000", 2024-09-14T09:10:07.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1695999999999998e-05 2024-09-14T09:10:07.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:07.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787721+0000", 2024-09-14T09:10:07.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1109999999999996e-06 2024-09-14T09:10:07.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790646+0000", 2024-09-14T09:10:07.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029251730000000001 2024-09-14T09:10:07.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790653+0000", 2024-09-14T09:10:07.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4379999999999998e-06 2024-09-14T09:10:07.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800750+0000", 2024-09-14T09:10:07.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010097236 2024-09-14T09:10:07.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800883+0000", 2024-09-14T09:10:07.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000132466 2024-09-14T09:10:07.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813065+0000", 2024-09-14T09:10:07.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012181981999999999 2024-09-14T09:10:07.900 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.900 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.900 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.900 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:74823 3.3 3:c59acf89:::rbd_data.1112a10502fe.00000000000001fb:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:07.900 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:10:07.900 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.021888791999999, 2024-09-14T09:10:07.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.004859323, 2024-09-14T09:10:07.900 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.901 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.901 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.901 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.901 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:07.901 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:07.901 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74823 2024-09-14T09:10:07.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.901 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:10:07.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:10:07.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808450+0000", 2024-09-14T09:10:07.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.92e-07 2024-09-14T09:10:07.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808454+0000", 2024-09-14T09:10:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3660000000000002e-06 2024-09-14T09:10:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808463+0000", 2024-09-14T09:10:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1579999999999994e-06 2024-09-14T09:10:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808470+0000", 2024-09-14T09:10:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7599999999999997e-06 2024-09-14T09:10:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808540+0000", 2024-09-14T09:10:07.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9991000000000001e-05 2024-09-14T09:10:07.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808550+0000", 2024-09-14T09:10:07.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0282000000000001e-05 2024-09-14T09:10:07.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801352+0000", 2024-09-14T09:10:07.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99280192700000003 2024-09-14T09:10:07.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801472+0000", 2024-09-14T09:10:07.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120184 2024-09-14T09:10:07.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813308+0000", 2024-09-14T09:10:07.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011835863 2024-09-14T09:10:07.905 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.905 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.905 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.905 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:86789 3.3 3:c3063f19:::rbd_data.1112a10502fe.000000000000023a:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:07.905 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:10:07.905 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.249666067, 2024-09-14T09:10:07.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.23302192099999999, 2024-09-14T09:10:07.906 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.906 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.906 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.906 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.906 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:07.906 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:07.906 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86789 2024-09-14T09:10:07.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.906 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:10:07.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:10:07.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580672+0000", 2024-09-14T09:10:07.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7999999999999993e-07 2024-09-14T09:10:07.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580680+0000", 2024-09-14T09:10:07.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7540000000000006e-06 2024-09-14T09:10:07.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580694+0000", 2024-09-14T09:10:07.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3344e-05 2024-09-14T09:10:07.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580702+0000", 2024-09-14T09:10:07.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9510000000000006e-06 2024-09-14T09:10:07.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580778+0000", 2024-09-14T09:10:07.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6580000000000002e-05 2024-09-14T09:10:07.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580788+0000", 2024-09-14T09:10:07.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0327e-05 2024-09-14T09:10:07.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801980+0000", 2024-09-14T09:10:07.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.22119123900000001 2024-09-14T09:10:07.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802115+0000", 2024-09-14T09:10:07.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013572000000000001 2024-09-14T09:10:07.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813693+0000", 2024-09-14T09:10:07.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011578026 2024-09-14T09:10:07.910 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.910 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.910 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.910 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:89485 3.3 3:c3eae671:::rbd_data.1112a10502fe.0000000000000248:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:07.910 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:10:07.910 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.144809573000003, 2024-09-14T09:10:07.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.12841583300000001, 2024-09-14T09:10:07.910 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.910 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.910 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.910 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.911 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:07.911 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:07.911 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 89485 2024-09-14T09:10:07.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.911 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:10:07.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:10:07.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685529+0000", 2024-09-14T09:10:07.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.11e-06 2024-09-14T09:10:07.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685534+0000", 2024-09-14T09:10:07.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0289999999999996e-06 2024-09-14T09:10:07.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685546+0000", 2024-09-14T09:10:07.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2062000000000001e-05 2024-09-14T09:10:07.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685554+0000", 2024-09-14T09:10:07.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7889999999999995e-06 2024-09-14T09:10:07.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685618+0000", 2024-09-14T09:10:07.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4487999999999996e-05 2024-09-14T09:10:07.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685628+0000", 2024-09-14T09:10:07.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5840000000000001e-06 2024-09-14T09:10:07.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802613+0000", 2024-09-14T09:10:07.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.116984703 2024-09-14T09:10:07.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802768+0000", 2024-09-14T09:10:07.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015541599999999999 2024-09-14T09:10:07.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813944+0000", 2024-09-14T09:10:07.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011175651999999999 2024-09-14T09:10:07.915 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.915 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.915 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.915 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:90751 3.3 3:c22bfcfe:::rbd_data.1112a10502fe.000000000000024e:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:07.915 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:10:07.915 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.093738789, 2024-09-14T09:10:07.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077582650000000003, 2024-09-14T09:10:07.915 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.915 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.915 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.915 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.915 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:07.915 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:07.915 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 90751 2024-09-14T09:10:07.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.916 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:10:07.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:10:07.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736600+0000", 2024-09-14T09:10:07.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.71e-07 2024-09-14T09:10:07.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736608+0000", 2024-09-14T09:10:07.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2679999999999994e-06 2024-09-14T09:10:07.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736620+0000", 2024-09-14T09:10:07.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2064e-05 2024-09-14T09:10:07.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736627+0000", 2024-09-14T09:10:07.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8129999999999998e-06 2024-09-14T09:10:07.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736676+0000", 2024-09-14T09:10:07.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.901e-05 2024-09-14T09:10:07.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736685+0000", 2024-09-14T09:10:07.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:10:07.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803227+0000", 2024-09-14T09:10:07.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066541874000000001 2024-09-14T09:10:07.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803381+0000", 2024-09-14T09:10:07.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015482500000000001 2024-09-14T09:10:07.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.814181+0000", 2024-09-14T09:10:07.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010799944000000001 2024-09-14T09:10:07.920 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.920 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.920 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.920 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:90760 3.3 3:c116ad26:::rbd_data.1112a10502fe.0000000000000251:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:07.920 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:10:07.920 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.093636472, 2024-09-14T09:10:07.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077694599000000003, 2024-09-14T09:10:07.920 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:07.920 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:07.920 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:07.920 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:07.920 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:07.921 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:07.921 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 90760 2024-09-14T09:10:07.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.921 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:07.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:07.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:10:07.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:07.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:10:07.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:07.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:07.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736702+0000", 2024-09-14T09:10:07.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0999999999999998e-07 2024-09-14T09:10:07.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:07.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736705+0000", 2024-09-14T09:10:07.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0120000000000001e-06 2024-09-14T09:10:07.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:07.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736711+0000", 2024-09-14T09:10:07.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6279999999999999e-06 2024-09-14T09:10:07.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:07.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736717+0000", 2024-09-14T09:10:07.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6200000000000004e-06 2024-09-14T09:10:07.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736765+0000", 2024-09-14T09:10:07.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7688000000000001e-05 2024-09-14T09:10:07.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:07.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736772+0000", 2024-09-14T09:10:07.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6529999999999994e-06 2024-09-14T09:10:07.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:07.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803886+0000", 2024-09-14T09:10:07.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067113795000000004 2024-09-14T09:10:07.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:07.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.804024+0000", 2024-09-14T09:10:07.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013782000000000001 2024-09-14T09:10:07.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:07.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:07.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:07.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.814396+0000", 2024-09-14T09:10:07.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010371773000000001 2024-09-14T09:10:07.925 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.925 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.925 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.925 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:07.925 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:07.925 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:07.927 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:10:07.927 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:07.928+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:07.932 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T09:10:08.027 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:08.029+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:08.045 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:08.045 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:08.045 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:10:08.045 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:08.055 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:10:08.128 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:08.130+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:08.157 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:08.157 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:08.157 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:10:08.158 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:10:08.158 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:08.166 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:10:08.229 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:08.231+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:08.311 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:08.311 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:10:08.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:10:08.311 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:10:08.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.311 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:228 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 360448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:08.311 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:10:08.311 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 96.515404699000001, 2024-09-14T09:10:08.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99234476999999999, 2024-09-14T09:10:08.311 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:08.311 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 228 2024-09-14T09:10:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:10:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:10:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796906+0000", 2024-09-14T09:10:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9399999999999995e-07 2024-09-14T09:10:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796917+0000", 2024-09-14T09:10:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0801e-05 2024-09-14T09:10:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796924+0000", 2024-09-14T09:10:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7750000000000004e-06 2024-09-14T09:10:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:10:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9972000000000001e-05 2024-09-14T09:10:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798671+0000", 2024-09-14T09:10:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017271330000000001 2024-09-14T09:10:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798675+0000", 2024-09-14T09:10:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.194e-06 2024-09-14T09:10:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789003+0000", 2024-09-14T09:10:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99032768400000004 2024-09-14T09:10:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789115+0000", 2024-09-14T09:10:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112236 2024-09-14T09:10:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789250+0000", 2024-09-14T09:10:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013548100000000001 2024-09-14T09:10:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:229 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 819200~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:10:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 96.515352476000004, 2024-09-14T09:10:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99287024599999996, 2024-09-14T09:10:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 229 2024-09-14T09:10:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:10:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:08.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:10:08.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:08.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:10:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999999e-07 2024-09-14T09:10:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796962+0000", 2024-09-14T09:10:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1479999999999999e-06 2024-09-14T09:10:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796967+0000", 2024-09-14T09:10:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1499999999999998e-06 2024-09-14T09:10:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:10:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-06 2024-09-14T09:10:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798688+0000", 2024-09-14T09:10:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017172660000000001 2024-09-14T09:10:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798691+0000", 2024-09-14T09:10:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:10:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789599+0000", 2024-09-14T09:10:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99090839399999997 2024-09-14T09:10:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789716+0000", 2024-09-14T09:10:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116474 2024-09-14T09:10:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789828+0000", 2024-09-14T09:10:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112293 2024-09-14T09:10:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:230 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1277952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:10:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 96.515331828000001, 2024-09-14T09:10:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99307501600000003, 2024-09-14T09:10:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 230 2024-09-14T09:10:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:10:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:10:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796979+0000", 2024-09-14T09:10:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.34e-07 2024-09-14T09:10:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796980+0000", 2024-09-14T09:10:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.53e-06 2024-09-14T09:10:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796986+0000", 2024-09-14T09:10:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9989999999999997e-06 2024-09-14T09:10:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796989+0000", 2024-09-14T09:10:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0340000000000001e-06 2024-09-14T09:10:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798702+0000", 2024-09-14T09:10:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001712756 2024-09-14T09:10:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798705+0000", 2024-09-14T09:10:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7750000000000001e-06 2024-09-14T09:10:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789870+0000", 2024-09-14T09:10:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991165026 2024-09-14T09:10:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789955+0000", 2024-09-14T09:10:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4839999999999994e-05 2024-09-14T09:10:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790053+0000", 2024-09-14T09:10:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8721999999999994e-05 2024-09-14T09:10:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:231 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:10:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 96.515316499999997, 2024-09-14T09:10:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99319130300000003, 2024-09-14T09:10:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 231 2024-09-14T09:10:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:10:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:08.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:10:08.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:08.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:10:08.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2024-09-14T09:10:08.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796995+0000", 2024-09-14T09:10:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2500000000000001e-06 2024-09-14T09:10:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796998+0000", 2024-09-14T09:10:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3230000000000002e-06 2024-09-14T09:10:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797001+0000", 2024-09-14T09:10:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7099999999999999e-06 2024-09-14T09:10:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798718+0000", 2024-09-14T09:10:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017168070000000001 2024-09-14T09:10:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798721+0000", 2024-09-14T09:10:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.853e-06 2024-09-14T09:10:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790077+0000", 2024-09-14T09:10:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991356393 2024-09-14T09:10:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790129+0000", 2024-09-14T09:10:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2240999999999997e-05 2024-09-14T09:10:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790185+0000", 2024-09-14T09:10:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5515e-05 2024-09-14T09:10:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:232 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2195456~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:10:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 96.515305843999997, 2024-09-14T09:10:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99329117899999997, 2024-09-14T09:10:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 232 2024-09-14T09:10:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:10:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:10:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797005+0000", 2024-09-14T09:10:08.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2024-09-14T09:10:08.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:08.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797006+0000", 2024-09-14T09:10:08.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3200000000000001e-06 2024-09-14T09:10:08.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:08.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797009+0000", 2024-09-14T09:10:08.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4680000000000001e-06 2024-09-14T09:10:08.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:08.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797012+0000", 2024-09-14T09:10:08.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4770000000000002e-06 2024-09-14T09:10:08.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798743+0000", 2024-09-14T09:10:08.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017312 2024-09-14T09:10:08.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:08.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798747+0000", 2024-09-14T09:10:08.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.484e-06 2024-09-14T09:10:08.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790201+0000", 2024-09-14T09:10:08.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99145419499999998 2024-09-14T09:10:08.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:08.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790241+0000", 2024-09-14T09:10:08.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0587999999999998e-05 2024-09-14T09:10:08.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790296+0000", 2024-09-14T09:10:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4212000000000002e-05 2024-09-14T09:10:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:233 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2654208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:10:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 96.515295221000002, 2024-09-14T09:10:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99337220100000001, 2024-09-14T09:10:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 233 2024-09-14T09:10:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:10:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:08.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:10:08.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:08.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:10:08.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:10:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:10:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.269e-06 2024-09-14T09:10:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797019+0000", 2024-09-14T09:10:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9519999999999999e-06 2024-09-14T09:10:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797022+0000", 2024-09-14T09:10:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6079999999999998e-06 2024-09-14T09:10:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798759+0000", 2024-09-14T09:10:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001737342 2024-09-14T09:10:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798762+0000", 2024-09-14T09:10:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:10:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790310+0000", 2024-09-14T09:10:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99154738799999997 2024-09-14T09:10:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790349+0000", 2024-09-14T09:10:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9573000000000002e-05 2024-09-14T09:10:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790387+0000", 2024-09-14T09:10:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7985999999999998e-05 2024-09-14T09:10:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:234 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3112960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:10:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 96.515285176000006, 2024-09-14T09:10:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99345674500000003, 2024-09-14T09:10:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 234 2024-09-14T09:10:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:10:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:10:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:10:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0100000000000001e-07 2024-09-14T09:10:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:10:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0699999999999999e-06 2024-09-14T09:10:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:10:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.886e-06 2024-09-14T09:10:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:08.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797032+0000", 2024-09-14T09:10:08.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7149999999999998e-06 2024-09-14T09:10:08.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798778+0000", 2024-09-14T09:10:08.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017460329999999999 2024-09-14T09:10:08.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798783+0000", 2024-09-14T09:10:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0760000000000002e-06 2024-09-14T09:10:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790408+0000", 2024-09-14T09:10:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99162473299999998 2024-09-14T09:10:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790446+0000", 2024-09-14T09:10:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8389000000000001e-05 2024-09-14T09:10:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790482+0000", 2024-09-14T09:10:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5642000000000002e-05 2024-09-14T09:10:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:235 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3571712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:10:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 96.515275278000004, 2024-09-14T09:10:08.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993539477, 2024-09-14T09:10:08.350 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:08.350 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:08.350 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:08.350 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:08.350 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:08.350 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:08.350 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 235 2024-09-14T09:10:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:10:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:10:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:08.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:10:08.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9999999999999999e-07 2024-09-14T09:10:08.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:08.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797036+0000", 2024-09-14T09:10:08.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.051e-06 2024-09-14T09:10:08.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:08.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797039+0000", 2024-09-14T09:10:08.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:10:08.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:08.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797042+0000", 2024-09-14T09:10:08.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5280000000000002e-06 2024-09-14T09:10:08.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798809+0000", 2024-09-14T09:10:08.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001767394 2024-09-14T09:10:08.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:08.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798815+0000", 2024-09-14T09:10:08.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0859999999999998e-06 2024-09-14T09:10:08.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790502+0000", 2024-09-14T09:10:08.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99168652300000004 2024-09-14T09:10:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790539+0000", 2024-09-14T09:10:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7471000000000001e-05 2024-09-14T09:10:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790574+0000", 2024-09-14T09:10:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5292e-05 2024-09-14T09:10:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:236 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 4030464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:10:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 96.515265045000007, 2024-09-14T09:10:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993619743, 2024-09-14T09:10:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 236 2024-09-14T09:10:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:10:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:10:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:10:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1400000000000001e-07 2024-09-14T09:10:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797047+0000", 2024-09-14T09:10:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3400000000000001e-06 2024-09-14T09:10:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:10:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0699999999999998e-06 2024-09-14T09:10:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797053+0000", 2024-09-14T09:10:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7310000000000002e-06 2024-09-14T09:10:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798839+0000", 2024-09-14T09:10:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001786403 2024-09-14T09:10:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798844+0000", 2024-09-14T09:10:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3730000000000001e-06 2024-09-14T09:10:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790592+0000", 2024-09-14T09:10:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99174818099999995 2024-09-14T09:10:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790628+0000", 2024-09-14T09:10:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5831000000000003e-05 2024-09-14T09:10:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790665+0000", 2024-09-14T09:10:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-05 2024-09-14T09:10:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.361 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:365 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:08.361 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:10:08.361 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 96.513078016999998, 2024-09-14T09:10:08.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157278400000004, 2024-09-14T09:10:08.361 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:08.361 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:08.362 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:08.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:08.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:08.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:08.362 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 365 2024-09-14T09:10:08.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.362 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:08.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:08.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:10:08.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:10:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:10:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:10:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799233+0000", 2024-09-14T09:10:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.057e-06 2024-09-14T09:10:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799236+0000", 2024-09-14T09:10:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0249999999999998e-06 2024-09-14T09:10:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799239+0000", 2024-09-14T09:10:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.481e-06 2024-09-14T09:10:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800963+0000", 2024-09-14T09:10:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017240440000000001 2024-09-14T09:10:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800969+0000", 2024-09-14T09:10:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1410000000000002e-06 2024-09-14T09:10:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790682+0000", 2024-09-14T09:10:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98971330300000004 2024-09-14T09:10:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790753+0000", 2024-09-14T09:10:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0548000000000003e-05 2024-09-14T09:10:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790805+0000", 2024-09-14T09:10:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1981999999999998e-05 2024-09-14T09:10:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:366 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:10:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 96.513067923999998, 2024-09-14T09:10:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99173757299999998, 2024-09-14T09:10:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 366 2024-09-14T09:10:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:10:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:10:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:10:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-07 2024-09-14T09:10:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799244+0000", 2024-09-14T09:10:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.359e-06 2024-09-14T09:10:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799247+0000", 2024-09-14T09:10:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4929999999999998e-06 2024-09-14T09:10:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799250+0000", 2024-09-14T09:10:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:10:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800991+0000", 2024-09-14T09:10:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017412809999999999 2024-09-14T09:10:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800997+0000", 2024-09-14T09:10:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:10:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790824+0000", 2024-09-14T09:10:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98982735399999999 2024-09-14T09:10:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790891+0000", 2024-09-14T09:10:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7243999999999995e-05 2024-09-14T09:10:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790980+0000", 2024-09-14T09:10:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8608000000000003e-05 2024-09-14T09:10:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:367 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:10:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 96.513056551999995, 2024-09-14T09:10:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99188259999999995, 2024-09-14T09:10:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 367 2024-09-14T09:10:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:10:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:10:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:10:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-07 2024-09-14T09:10:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799255+0000", 2024-09-14T09:10:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.111e-06 2024-09-14T09:10:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799259+0000", 2024-09-14T09:10:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8650000000000003e-06 2024-09-14T09:10:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799262+0000", 2024-09-14T09:10:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.128e-06 2024-09-14T09:10:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801029+0000", 2024-09-14T09:10:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017668460000000001 2024-09-14T09:10:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801032+0000", 2024-09-14T09:10:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3179999999999998e-06 2024-09-14T09:10:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791011+0000", 2024-09-14T09:10:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98997920399999995 2024-09-14T09:10:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791077+0000", 2024-09-14T09:10:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5214000000000003e-05 2024-09-14T09:10:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791136+0000", 2024-09-14T09:10:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9710000000000003e-05 2024-09-14T09:10:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:368 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:10:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 96.513045008999995, 2024-09-14T09:10:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99201753800000003, 2024-09-14T09:10:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 368 2024-09-14T09:10:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:10:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:10:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:10:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4900000000000002e-07 2024-09-14T09:10:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799267+0000", 2024-09-14T09:10:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.079e-06 2024-09-14T09:10:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799270+0000", 2024-09-14T09:10:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.993e-06 2024-09-14T09:10:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799272+0000", 2024-09-14T09:10:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.695e-06 2024-09-14T09:10:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801043+0000", 2024-09-14T09:10:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001771105 2024-09-14T09:10:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801046+0000", 2024-09-14T09:10:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7999999999999999e-06 2024-09-14T09:10:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791150+0000", 2024-09-14T09:10:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99010348699999995 2024-09-14T09:10:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791193+0000", 2024-09-14T09:10:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3615999999999997e-05 2024-09-14T09:10:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791283+0000", 2024-09-14T09:10:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9513999999999997e-05 2024-09-14T09:10:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.382 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:369 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:08.382 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:10:08.382 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 96.513034671, 2024-09-14T09:10:08.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99213433600000001, 2024-09-14T09:10:08.382 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:08.382 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:08.382 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:08.382 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 369 2024-09-14T09:10:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:10:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:10:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:10:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:10:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799277+0000", 2024-09-14T09:10:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.108e-06 2024-09-14T09:10:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799280+0000", 2024-09-14T09:10:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:10:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799283+0000", 2024-09-14T09:10:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.531e-06 2024-09-14T09:10:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801058+0000", 2024-09-14T09:10:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001775085 2024-09-14T09:10:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801060+0000", 2024-09-14T09:10:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8260000000000001e-06 2024-09-14T09:10:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791299+0000", 2024-09-14T09:10:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99023856799999999 2024-09-14T09:10:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791352+0000", 2024-09-14T09:10:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2528000000000003e-05 2024-09-14T09:10:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791410+0000", 2024-09-14T09:10:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8298000000000003e-05 2024-09-14T09:10:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:370 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2457600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:10:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 96.513009904, 2024-09-14T09:10:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99220795399999995, 2024-09-14T09:10:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 370 2024-09-14T09:10:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:10:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:10:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799301+0000", 2024-09-14T09:10:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2024-09-14T09:10:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799303+0000", 2024-09-14T09:10:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9319999999999999e-06 2024-09-14T09:10:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799310+0000", 2024-09-14T09:10:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8680000000000001e-06 2024-09-14T09:10:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799315+0000", 2024-09-14T09:10:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.921e-06 2024-09-14T09:10:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801071+0000", 2024-09-14T09:10:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001756678 2024-09-14T09:10:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801080+0000", 2024-09-14T09:10:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6060000000000003e-06 2024-09-14T09:10:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791429+0000", 2024-09-14T09:10:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99034944599999997 2024-09-14T09:10:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791471+0000", 2024-09-14T09:10:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1279999999999998e-05 2024-09-14T09:10:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791508+0000", 2024-09-14T09:10:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7663999999999997e-05 2024-09-14T09:10:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.393 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:371 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2916352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:08.393 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:10:08.393 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 96.512988731999997, 2024-09-14T09:10:08.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99228692299999999, 2024-09-14T09:10:08.393 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:08.393 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:08.393 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:08.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 371 2024-09-14T09:10:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:10:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:10:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799322+0000", 2024-09-14T09:10:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:10:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799333+0000", 2024-09-14T09:10:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1044e-05 2024-09-14T09:10:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799341+0000", 2024-09-14T09:10:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8439999999999998e-06 2024-09-14T09:10:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799354+0000", 2024-09-14T09:10:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3114e-05 2024-09-14T09:10:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801093+0000", 2024-09-14T09:10:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017385910000000001 2024-09-14T09:10:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801096+0000", 2024-09-14T09:10:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0680000000000001e-06 2024-09-14T09:10:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791528+0000", 2024-09-14T09:10:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99043264200000003 2024-09-14T09:10:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791570+0000", 2024-09-14T09:10:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2144999999999997e-05 2024-09-14T09:10:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791608+0000", 2024-09-14T09:10:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7966000000000002e-05 2024-09-14T09:10:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:372 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3375104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:10:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 96.512948183999995, 2024-09-14T09:10:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992342897, 2024-09-14T09:10:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 372 2024-09-14T09:10:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:10:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:10:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799363+0000", 2024-09-14T09:10:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2024-09-14T09:10:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799365+0000", 2024-09-14T09:10:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5500000000000001e-06 2024-09-14T09:10:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799371+0000", 2024-09-14T09:10:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2500000000000003e-06 2024-09-14T09:10:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799377+0000", 2024-09-14T09:10:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7509999999999997e-06 2024-09-14T09:10:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801107+0000", 2024-09-14T09:10:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017298019999999999 2024-09-14T09:10:08.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:08.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801111+0000", 2024-09-14T09:10:08.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8619999999999996e-06 2024-09-14T09:10:08.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791626+0000", 2024-09-14T09:10:08.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99051563300000001 2024-09-14T09:10:08.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:08.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791668+0000", 2024-09-14T09:10:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1424000000000002e-05 2024-09-14T09:10:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791705+0000", 2024-09-14T09:10:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7035e-05 2024-09-14T09:10:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:373 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:10:08.404 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 96.512926238999995, 2024-09-14T09:10:08.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99253589399999997, 2024-09-14T09:10:08.404 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:08.404 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:08.404 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:08.404 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:08.404 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:08.404 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:08.404 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 373 2024-09-14T09:10:08.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:10:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:10:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:10:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2024-09-14T09:10:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799387+0000", 2024-09-14T09:10:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1019999999999999e-06 2024-09-14T09:10:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799393+0000", 2024-09-14T09:10:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0190000000000003e-06 2024-09-14T09:10:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799398+0000", 2024-09-14T09:10:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:10:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801123+0000", 2024-09-14T09:10:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017251949999999999 2024-09-14T09:10:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801126+0000", 2024-09-14T09:10:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9280000000000002e-06 2024-09-14T09:10:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791746+0000", 2024-09-14T09:10:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99062036899999995 2024-09-14T09:10:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791835+0000", 2024-09-14T09:10:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9004000000000004e-05 2024-09-14T09:10:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791920+0000", 2024-09-14T09:10:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4524000000000006e-05 2024-09-14T09:10:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:60352 3.0 3.6d62a5c0 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:10:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.930290401000001, 2024-09-14T09:10:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41710537399999997, 2024-09-14T09:10:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 60352 2024-09-14T09:10:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:10:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:10:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382044+0000", 2024-09-14T09:10:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4640000000000001e-05 2024-09-14T09:10:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382048+0000", 2024-09-14T09:10:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4690000000000002e-06 2024-09-14T09:10:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382053+0000", 2024-09-14T09:10:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:10:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382068+0000", 2024-09-14T09:10:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4399000000000001e-05 2024-09-14T09:10:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382121+0000", 2024-09-14T09:10:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3578000000000001e-05 2024-09-14T09:10:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382127+0000", 2024-09-14T09:10:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2024-09-14T09:10:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799116+0000", 2024-09-14T09:10:08.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.416988566 2024-09-14T09:10:08.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:08.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799125+0000", 2024-09-14T09:10:08.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3100000000000006e-06 2024-09-14T09:10:08.413 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.413 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:08.413 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.414 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:63559 3.0 3.95b285c0 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:08.414 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:10:08.414 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.924459028000001, 2024-09-14T09:10:08.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.411301215, 2024-09-14T09:10:08.414 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:08.414 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:08.414 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:08.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:08.415 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:08.415 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:08.415 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 63559 2024-09-14T09:10:08.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.415 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:08.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:08.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:10:08.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:08.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:10:08.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:08.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:08.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:10:08.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2499999999999999e-07 2024-09-14T09:10:08.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:08.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387853+0000", 2024-09-14T09:10:08.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.477e-06 2024-09-14T09:10:08.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:08.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387856+0000", 2024-09-14T09:10:08.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1429999999999998e-06 2024-09-14T09:10:08.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:08.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387859+0000", 2024-09-14T09:10:08.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.582e-06 2024-09-14T09:10:08.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387888+0000", 2024-09-14T09:10:08.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9609000000000001e-05 2024-09-14T09:10:08.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:08.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387893+0000", 2024-09-14T09:10:08.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6779999999999999e-06 2024-09-14T09:10:08.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:08.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799143+0000", 2024-09-14T09:10:08.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41124997099999999 2024-09-14T09:10:08.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:08.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:08.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:08.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799152+0000", 2024-09-14T09:10:08.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5300000000000002e-06 2024-09-14T09:10:08.419 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.419 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:08.419 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.419 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:08.419 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:08.419 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:08.420 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:10:08.421 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:08.422+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:08.517 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:10:08.521 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:08.523+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:08.525 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:08.525 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:08.525 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:10:08.525 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:08.534 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:10:08.621 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:08.623+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:08.638 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:10:08.639 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:10:08.655 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:10:08.656 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:10:08.672 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:10:08.672 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:10:08.680 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:08.680 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:08.689 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:10:08.689 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:10:08.690 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:10:08.706 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:10:08.706 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:10:08.722 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:08.724+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:08.723 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:10:08.723 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:10:08.809 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:08.810 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:08.818 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:10:08.823 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:08.826+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:08.911 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is set 2024-09-14T09:10:08.925 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:08.927+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:08.931 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:08.931 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:08.940 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:10:09.026 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:09.028+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:09.085 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:09.085 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:09.094 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:10:09.127 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:09.129+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:09.196 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:09.196 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:09.205 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:10:09.249 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:09.251+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:09.307 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:09.307 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:09.316 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:10:09.328 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:09.331+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:09.429 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:09.431+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:09.457 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:09.457 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:09.466 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:10:09.530 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:09.532+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:09.568 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:09.568 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:09.576 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:10:09.631 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:09.632+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:09.682 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:09.683 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:09.691 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:10:09.735 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:09.737+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:09.795 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:09.796 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:09.804 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:10:09.845 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:09.847+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:09.933 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:09.936+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:09.952 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:09.952 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:09.961 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:10:10.045 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:10.047+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:10.108 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:10.108 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:10.116 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:10:10.136 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:10.138+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:10.237 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:10.239+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:10.259 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:10.259 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:10.268 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:10:10.337 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:10.339+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:10.411 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:10.411 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:10.420 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:10:10.438 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:10.440+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:10.523 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:10.523 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:10.532 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:10:10.576 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:10.578+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:10.635 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:10.635 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:10.640 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:10.643+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:10.644 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:10:10.735 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:10:10.780 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:10.782+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:10.786 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:10.786 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:10.795 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:10:10.843 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:10.845+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:10.862 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:10:10.862 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:10:10.879 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:10:10.879 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:10:10.895 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:10:10.895 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:10:10.903 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:10.903 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:10.903 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:10:10.903 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:10.912 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:10:10.912 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:10:10.913 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:10:10.932 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T09:10:10.932 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 1] out_osds: [5] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 2] 2024-09-14T09:10:10.933 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:10:10.933 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-14T09:10:10.933 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T09:10:10.938 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:10:10.939 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:10:10.959 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:10:10.959 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:10:10.959 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:10.961+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:11.047 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:11.048+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:11.797 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:11.798 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:11.798 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:10:11.798 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:10:11.798 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:11.798 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:10:11.799 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:10:11.799 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:11.800 INFO:teuthology.orchestra.run.smithi116.stdout: "epoch": 139, 2024-09-14T09:10:11.800 INFO:teuthology.orchestra.run.smithi116.stdout: "fsid": "c991ac1c-978d-48b3-a540-4d3d4755e125", 2024-09-14T09:10:11.800 INFO:teuthology.orchestra.run.smithi116.stdout: "created": "2024-09-14T09:07:16.982473+0000", 2024-09-14T09:10:11.800 INFO:teuthology.orchestra.run.smithi116.stdout: "modified": "2024-09-14T09:10:10.917826+0000", 2024-09-14T09:10:11.800 INFO:teuthology.orchestra.run.smithi116.stdout: "last_up_change": "2024-09-14T09:09:15.843683+0000", 2024-09-14T09:10:11.800 INFO:teuthology.orchestra.run.smithi116.stdout: "last_in_change": "2024-09-14T09:09:52.811197+0000", 2024-09-14T09:10:11.800 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T09:10:11.800 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_num": 5801984, 2024-09-14T09:10:11.800 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_set": [ 2024-09-14T09:10:11.800 INFO:teuthology.orchestra.run.smithi116.stdout: "noscrub", 2024-09-14T09:10:11.800 INFO:teuthology.orchestra.run.smithi116.stdout: "pglog_hardlimit", 2024-09-14T09:10:11.800 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snapdirs", 2024-09-14T09:10:11.801 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_deletes", 2024-09-14T09:10:11.801 INFO:teuthology.orchestra.run.smithi116.stdout: "sortbitwise" 2024-09-14T09:10:11.801 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:10:11.801 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_version": 6, 2024-09-14T09:10:11.801 INFO:teuthology.orchestra.run.smithi116.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T09:10:11.801 INFO:teuthology.orchestra.run.smithi116.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T09:10:11.801 INFO:teuthology.orchestra.run.smithi116.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T09:10:11.801 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_snapshot": "", 2024-09-14T09:10:11.801 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_max": 3, 2024-09-14T09:10:11.801 INFO:teuthology.orchestra.run.smithi116.stdout: "max_osd": 6, 2024-09-14T09:10:11.801 INFO:teuthology.orchestra.run.smithi116.stdout: "require_min_compat_client": "luminous", 2024-09-14T09:10:11.801 INFO:teuthology.orchestra.run.smithi116.stdout: "min_compat_client": "jewel", 2024-09-14T09:10:11.801 INFO:teuthology.orchestra.run.smithi116.stdout: "require_osd_release": "squid", 2024-09-14T09:10:11.801 INFO:teuthology.orchestra.run.smithi116.stdout: "allow_crimson": false, 2024-09-14T09:10:11.802 INFO:teuthology.orchestra.run.smithi116.stdout: "pools": [ 2024-09-14T09:10:11.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.802 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 1, 2024-09-14T09:10:11.802 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": ".mgr", 2024-09-14T09:10:11.802 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:29.194849+0000", 2024-09-14T09:10:11.802 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 1, 2024-09-14T09:10:11.802 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool", 2024-09-14T09:10:11.802 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:10:11.802 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:10:11.802 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:10:11.802 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:10:11.802 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:10:11.802 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:10:11.802 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:10:11.803 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:10:11.803 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:10:11.803 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:10:11.803 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:10:11.803 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 1, 2024-09-14T09:10:11.803 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 1, 2024-09-14T09:10:11.803 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 1, 2024-09-14T09:10:11.803 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 1, 2024-09-14T09:10:11.803 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 1, 2024-09-14T09:10:11.803 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:10:11.803 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:10:11.803 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:10:11.803 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:10:11.803 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:10:11.804 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:10:11.804 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:10:11.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.804 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "16", 2024-09-14T09:10:11.804 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:10:11.804 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:10:11.804 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:10:11.804 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:10:11.804 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:10:11.804 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 0, 2024-09-14T09:10:11.804 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 0, 2024-09-14T09:10:11.804 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:10:11.804 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:10:11.805 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:10:11.805 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:10:11.805 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:10:11.805 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:10:11.805 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:10:11.805 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:10:11.805 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:10:11.805 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:10:11.805 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:10:11.805 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:10:11.805 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:10:11.805 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:10:11.805 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:10:11.806 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:10:11.806 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:10:11.806 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:10:11.806 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:10:11.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.806 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:10:11.806 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:10:11.806 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:10:11.806 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:10:11.806 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:10:11.806 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:10:11.806 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:10:11.806 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:10:11.806 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:10:11.806 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:10:11.807 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:10:11.807 INFO:teuthology.orchestra.run.smithi116.stdout: "options": { 2024-09-14T09:10:11.807 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_max": 32, 2024-09-14T09:10:11.807 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_min": 1 2024-09-14T09:10:11.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.807 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:10:11.807 INFO:teuthology.orchestra.run.smithi116.stdout: "mgr": {} 2024-09-14T09:10:11.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.807 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:10:11.807 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:10:11.807 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 6.059999942779541, 2024-09-14T09:10:11.807 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 6.059999942779541, 2024-09-14T09:10:11.807 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 0.33000001311302185, 2024-09-14T09:10:11.807 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 2, 2024-09-14T09:10:11.808 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 2, 2024-09-14T09:10:11.808 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:10:11.808 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:10:11.808 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:10:11.808 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.808 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 2, 2024-09-14T09:10:11.808 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": "rbd", 2024-09-14T09:10:11.808 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:33.684592+0000", 2024-09-14T09:10:11.808 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 8193, 2024-09-14T09:10:11.808 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T09:10:11.808 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:10:11.809 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:10:11.809 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:10:11.809 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:10:11.809 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:10:11.809 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:10:11.809 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:10:11.809 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:10:11.809 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:10:11.809 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:10:11.809 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:10:11.809 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 8, 2024-09-14T09:10:11.809 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 8, 2024-09-14T09:10:11.809 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 8, 2024-09-14T09:10:11.809 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 8, 2024-09-14T09:10:11.810 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 8, 2024-09-14T09:10:11.810 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:10:11.810 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:10:11.810 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:10:11.810 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:10:11.810 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:10:11.810 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:10:11.810 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:10:11.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.810 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "20", 2024-09-14T09:10:11.810 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:10:11.810 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:10:11.810 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:10:11.810 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:10:11.811 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:10:11.811 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 2, 2024-09-14T09:10:11.811 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 20, 2024-09-14T09:10:11.811 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:10:11.811 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:10:11.811 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:10:11.811 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:10:11.811 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:10:11.811 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:10:11.811 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:10:11.811 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:10:11.811 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:10:11.811 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:10:11.811 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:10:11.812 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:10:11.812 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:10:11.812 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:10:11.812 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:10:11.812 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:10:11.812 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:10:11.812 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:10:11.812 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:10:11.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.812 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:10:11.812 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:10:11.812 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:10:11.812 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:10:11.812 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:10:11.813 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:10:11.813 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:10:11.813 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:10:11.813 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:10:11.813 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:10:11.813 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:10:11.813 INFO:teuthology.orchestra.run.smithi116.stdout: "options": {}, 2024-09-14T09:10:11.813 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:10:11.813 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd": {} 2024-09-14T09:10:11.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.813 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:10:11.813 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:10:11.813 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 2.2699999809265137, 2024-09-14T09:10:11.813 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 2.2699999809265137, 2024-09-14T09:10:11.814 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 0.82999998331069946, 2024-09-14T09:10:11.814 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 1.8799999952316284, 2024-09-14T09:10:11.814 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 1.8799999952316284, 2024-09-14T09:10:11.814 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:10:11.814 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:10:11.814 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:10:11.814 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.814 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 3, 2024-09-14T09:10:11.814 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_name": "pool_client.0", 2024-09-14T09:10:11.814 INFO:teuthology.orchestra.run.smithi116.stdout: "create_time": "2024-09-14T09:07:43.363542+0000", 2024-09-14T09:10:11.814 INFO:teuthology.orchestra.run.smithi116.stdout: "flags": 8193, 2024-09-14T09:10:11.814 INFO:teuthology.orchestra.run.smithi116.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T09:10:11.815 INFO:teuthology.orchestra.run.smithi116.stdout: "type": 1, 2024-09-14T09:10:11.815 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 2, 2024-09-14T09:10:11.815 INFO:teuthology.orchestra.run.smithi116.stdout: "min_size": 1, 2024-09-14T09:10:11.815 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_rule": 0, 2024-09-14T09:10:11.815 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_count": 0, 2024-09-14T09:10:11.815 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_target": 0, 2024-09-14T09:10:11.815 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T09:10:11.815 INFO:teuthology.orchestra.run.smithi116.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T09:10:11.815 INFO:teuthology.orchestra.run.smithi116.stdout: "is_stretch_pool": false, 2024-09-14T09:10:11.815 INFO:teuthology.orchestra.run.smithi116.stdout: "object_hash": 2, 2024-09-14T09:10:11.815 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_autoscale_mode": "off", 2024-09-14T09:10:11.815 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num": 32, 2024-09-14T09:10:11.815 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num": 32, 2024-09-14T09:10:11.815 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_placement_num_target": 32, 2024-09-14T09:10:11.815 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_target": 32, 2024-09-14T09:10:11.816 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_num_pending": 32, 2024-09-14T09:10:11.816 INFO:teuthology.orchestra.run.smithi116.stdout: "last_pg_merge_meta": { 2024-09-14T09:10:11.816 INFO:teuthology.orchestra.run.smithi116.stdout: "source_pgid": "0.0", 2024-09-14T09:10:11.816 INFO:teuthology.orchestra.run.smithi116.stdout: "ready_epoch": 0, 2024-09-14T09:10:11.816 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_started": 0, 2024-09-14T09:10:11.816 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-14T09:10:11.816 INFO:teuthology.orchestra.run.smithi116.stdout: "source_version": "0'0", 2024-09-14T09:10:11.816 INFO:teuthology.orchestra.run.smithi116.stdout: "target_version": "0'0" 2024-09-14T09:10:11.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.816 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "139", 2024-09-14T09:10:11.816 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend": "0", 2024-09-14T09:10:11.816 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T09:10:11.816 INFO:teuthology.orchestra.run.smithi116.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T09:10:11.817 INFO:teuthology.orchestra.run.smithi116.stdout: "auid": 0, 2024-09-14T09:10:11.817 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_mode": "selfmanaged", 2024-09-14T09:10:11.817 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_seq": 43, 2024-09-14T09:10:11.817 INFO:teuthology.orchestra.run.smithi116.stdout: "snap_epoch": 139, 2024-09-14T09:10:11.817 INFO:teuthology.orchestra.run.smithi116.stdout: "pool_snaps": [], 2024-09-14T09:10:11.817 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps": "[]", 2024-09-14T09:10:11.817 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_bytes": 0, 2024-09-14T09:10:11.817 INFO:teuthology.orchestra.run.smithi116.stdout: "quota_max_objects": 0, 2024-09-14T09:10:11.817 INFO:teuthology.orchestra.run.smithi116.stdout: "tiers": [], 2024-09-14T09:10:11.817 INFO:teuthology.orchestra.run.smithi116.stdout: "tier_of": -1, 2024-09-14T09:10:11.817 INFO:teuthology.orchestra.run.smithi116.stdout: "read_tier": -1, 2024-09-14T09:10:11.817 INFO:teuthology.orchestra.run.smithi116.stdout: "write_tier": -1, 2024-09-14T09:10:11.817 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_mode": "none", 2024-09-14T09:10:11.817 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_bytes": 0, 2024-09-14T09:10:11.818 INFO:teuthology.orchestra.run.smithi116.stdout: "target_max_objects": 0, 2024-09-14T09:10:11.818 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T09:10:11.818 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T09:10:11.818 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T09:10:11.818 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_flush_age": 0, 2024-09-14T09:10:11.818 INFO:teuthology.orchestra.run.smithi116.stdout: "cache_min_evict_age": 0, 2024-09-14T09:10:11.818 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profile": "", 2024-09-14T09:10:11.818 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_params": { 2024-09-14T09:10:11.818 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "none" 2024-09-14T09:10:11.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.818 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_period": 0, 2024-09-14T09:10:11.818 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_count": 0, 2024-09-14T09:10:11.818 INFO:teuthology.orchestra.run.smithi116.stdout: "use_gmt_hitset": true, 2024-09-14T09:10:11.818 INFO:teuthology.orchestra.run.smithi116.stdout: "min_read_recency_for_promote": 0, 2024-09-14T09:10:11.819 INFO:teuthology.orchestra.run.smithi116.stdout: "min_write_recency_for_promote": 0, 2024-09-14T09:10:11.819 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T09:10:11.819 INFO:teuthology.orchestra.run.smithi116.stdout: "hit_set_search_last_n": 0, 2024-09-14T09:10:11.819 INFO:teuthology.orchestra.run.smithi116.stdout: "grade_table": [], 2024-09-14T09:10:11.819 INFO:teuthology.orchestra.run.smithi116.stdout: "stripe_width": 0, 2024-09-14T09:10:11.819 INFO:teuthology.orchestra.run.smithi116.stdout: "expected_num_objects": 0, 2024-09-14T09:10:11.819 INFO:teuthology.orchestra.run.smithi116.stdout: "fast_read": false, 2024-09-14T09:10:11.819 INFO:teuthology.orchestra.run.smithi116.stdout: "options": {}, 2024-09-14T09:10:11.819 INFO:teuthology.orchestra.run.smithi116.stdout: "application_metadata": { 2024-09-14T09:10:11.819 INFO:teuthology.orchestra.run.smithi116.stdout: "rbd": {} 2024-09-14T09:10:11.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.819 INFO:teuthology.orchestra.run.smithi116.stdout: "read_balance": { 2024-09-14T09:10:11.819 INFO:teuthology.orchestra.run.smithi116.stdout: "score_type": "Fair distribution", 2024-09-14T09:10:11.819 INFO:teuthology.orchestra.run.smithi116.stdout: "score_acting": 2.2699999809265137, 2024-09-14T09:10:11.820 INFO:teuthology.orchestra.run.smithi116.stdout: "score_stable": 2.2699999809265137, 2024-09-14T09:10:11.820 INFO:teuthology.orchestra.run.smithi116.stdout: "optimal_score": 0.82999998331069946, 2024-09-14T09:10:11.820 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_acting": 1.8799999952316284, 2024-09-14T09:10:11.820 INFO:teuthology.orchestra.run.smithi116.stdout: "raw_score_stable": 1.8799999952316284, 2024-09-14T09:10:11.820 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity_weighted": 0.87392938137054443, 2024-09-14T09:10:11.820 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-14T09:10:11.820 INFO:teuthology.orchestra.run.smithi116.stdout: "average_primary_affinity_weighted": 0.87000000476837158 2024-09-14T09:10:11.820 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.820 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.820 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:10:11.820 INFO:teuthology.orchestra.run.smithi116.stdout: "osds": [ 2024-09-14T09:10:11.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.820 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 0, 2024-09-14T09:10:11.821 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "b3c13086-1183-454b-8e62-3aec9b69cdf5", 2024-09-14T09:10:11.821 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:10:11.821 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:10:11.821 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 0.3199462890625, 2024-09-14T09:10:11.821 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:10:11.821 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:10:11.821 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:10:11.821 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 11, 2024-09-14T09:10:11.821 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 78, 2024-09-14T09:10:11.821 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:10:11.821 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:10:11.821 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:10:11.821 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.822 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.822 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6816", 2024-09-14T09:10:11.822 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:10:11.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.822 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.822 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6817", 2024-09-14T09:10:11.822 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:10:11.822 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.822 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.822 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:10:11.822 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.823 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.823 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6818", 2024-09-14T09:10:11.823 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:10:11.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.823 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.823 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6819", 2024-09-14T09:10:11.823 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:10:11.823 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.823 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.823 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:10:11.823 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.824 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.824 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6822", 2024-09-14T09:10:11.824 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:10:11.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.824 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.824 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6823", 2024-09-14T09:10:11.824 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:10:11.824 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.824 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.824 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:10:11.825 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.825 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.825 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6820", 2024-09-14T09:10:11.825 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:10:11.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.825 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.825 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6821", 2024-09-14T09:10:11.825 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 1856142608 2024-09-14T09:10:11.825 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.825 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.825 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6817/1856142608", 2024-09-14T09:10:11.826 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6819/1856142608", 2024-09-14T09:10:11.826 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6823/1856142608", 2024-09-14T09:10:11.826 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6821/1856142608", 2024-09-14T09:10:11.826 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:10:11.826 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:10:11.826 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:10:11.826 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.826 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 1, 2024-09-14T09:10:11.826 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "8ee6a373-9d0d-4cd2-96f4-9673de96f546", 2024-09-14T09:10:11.826 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:10:11.826 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:10:11.827 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:10:11.827 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:10:11.827 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:10:11.827 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:10:11.827 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 13, 2024-09-14T09:10:11.827 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 125, 2024-09-14T09:10:11.827 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:10:11.827 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:10:11.827 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:10:11.827 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.827 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.827 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6800", 2024-09-14T09:10:11.827 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:10:11.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.828 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.828 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6801", 2024-09-14T09:10:11.828 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:10:11.828 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.828 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.828 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:10:11.828 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.828 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.828 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6802", 2024-09-14T09:10:11.829 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:10:11.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.829 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.829 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6803", 2024-09-14T09:10:11.829 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:10:11.829 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.829 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.829 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:10:11.829 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.829 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.829 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6806", 2024-09-14T09:10:11.830 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:10:11.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.830 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.830 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6807", 2024-09-14T09:10:11.830 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:10:11.830 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.830 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.830 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:10:11.830 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.830 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.830 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6804", 2024-09-14T09:10:11.831 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:10:11.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.831 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.831 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6805", 2024-09-14T09:10:11.831 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 3469105275 2024-09-14T09:10:11.831 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.831 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.831 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6801/3469105275", 2024-09-14T09:10:11.831 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6803/3469105275", 2024-09-14T09:10:11.831 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6807/3469105275", 2024-09-14T09:10:11.831 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6805/3469105275", 2024-09-14T09:10:11.831 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:10:11.832 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:10:11.832 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:10:11.832 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.832 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 2, 2024-09-14T09:10:11.832 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "958a9363-d751-49c3-9ec7-7330d377ee53", 2024-09-14T09:10:11.832 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:10:11.832 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:10:11.832 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 0.59710693359375, 2024-09-14T09:10:11.832 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:10:11.832 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 13, 2024-09-14T09:10:11.832 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 67, 2024-09-14T09:10:11.832 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 87, 2024-09-14T09:10:11.833 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 124, 2024-09-14T09:10:11.833 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 68, 2024-09-14T09:10:11.833 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:10:11.833 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:10:11.833 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.833 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.833 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6808", 2024-09-14T09:10:11.833 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:10:11.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.834 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.834 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6809", 2024-09-14T09:10:11.834 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:10:11.834 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.834 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.834 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:10:11.834 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.835 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.835 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6810", 2024-09-14T09:10:11.835 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:10:11.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.835 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.835 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6811", 2024-09-14T09:10:11.835 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:10:11.835 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.835 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.835 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:10:11.835 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.836 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.836 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6814", 2024-09-14T09:10:11.836 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:10:11.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.836 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.836 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6815", 2024-09-14T09:10:11.836 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:10:11.836 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.836 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.837 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:10:11.837 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.837 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.837 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6812", 2024-09-14T09:10:11.837 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:10:11.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.837 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.837 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.116:6813", 2024-09-14T09:10:11.837 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2050490698 2024-09-14T09:10:11.837 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.837 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.838 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.116:6809/2050490698", 2024-09-14T09:10:11.838 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.116:6811/2050490698", 2024-09-14T09:10:11.838 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.116:6815/2050490698", 2024-09-14T09:10:11.838 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.116:6813/2050490698", 2024-09-14T09:10:11.838 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:10:11.838 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:10:11.838 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:10:11.838 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.838 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 3, 2024-09-14T09:10:11.838 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "7fafd519-b2e9-498c-a409-f55cfe45a51a", 2024-09-14T09:10:11.839 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:10:11.839 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:10:11.839 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:10:11.839 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 0.2435760498046875, 2024-09-14T09:10:11.839 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:10:11.839 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:10:11.839 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:10:11.839 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 124, 2024-09-14T09:10:11.839 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:10:11.839 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:10:11.839 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:10:11.839 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.840 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.840 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6816", 2024-09-14T09:10:11.840 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:10:11.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.840 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.840 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6817", 2024-09-14T09:10:11.840 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:10:11.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.840 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.840 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:10:11.840 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.841 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.841 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6818", 2024-09-14T09:10:11.841 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:10:11.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.841 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.841 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6819", 2024-09-14T09:10:11.841 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:10:11.841 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.841 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.841 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:10:11.842 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.842 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.842 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6822", 2024-09-14T09:10:11.842 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:10:11.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.842 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.842 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6823", 2024-09-14T09:10:11.842 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:10:11.842 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.842 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.842 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:10:11.843 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.843 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.843 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6820", 2024-09-14T09:10:11.843 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:10:11.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.843 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.843 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6821", 2024-09-14T09:10:11.843 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2855061278 2024-09-14T09:10:11.843 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.843 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.843 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6817/2855061278", 2024-09-14T09:10:11.843 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6819/2855061278", 2024-09-14T09:10:11.844 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6823/2855061278", 2024-09-14T09:10:11.844 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6821/2855061278", 2024-09-14T09:10:11.844 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:10:11.844 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:10:11.844 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:10:11.844 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.844 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 4, 2024-09-14T09:10:11.844 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "63d99552-5fea-4367-bf86-0addc8cceb98", 2024-09-14T09:10:11.844 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:10:11.844 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 1, 2024-09-14T09:10:11.844 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 1, 2024-09-14T09:10:11.845 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:10:11.845 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:10:11.845 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:10:11.845 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:10:11.845 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 124, 2024-09-14T09:10:11.845 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:10:11.845 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:10:11.845 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:10:11.845 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.845 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.845 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6808", 2024-09-14T09:10:11.845 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:10:11.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.846 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.846 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6809", 2024-09-14T09:10:11.846 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:10:11.846 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.846 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.846 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:10:11.846 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.846 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.846 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6810", 2024-09-14T09:10:11.846 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:10:11.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.847 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.847 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6811", 2024-09-14T09:10:11.847 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:10:11.847 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.847 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.847 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:10:11.847 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.847 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.847 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6814", 2024-09-14T09:10:11.847 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:10:11.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.848 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.848 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6815", 2024-09-14T09:10:11.848 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:10:11.848 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.848 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.848 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:10:11.848 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.848 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.848 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6812", 2024-09-14T09:10:11.848 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:10:11.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.849 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.849 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6813", 2024-09-14T09:10:11.849 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 369903047 2024-09-14T09:10:11.849 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.849 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.849 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6809/369903047", 2024-09-14T09:10:11.849 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6811/369903047", 2024-09-14T09:10:11.849 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6815/369903047", 2024-09-14T09:10:11.849 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6813/369903047", 2024-09-14T09:10:11.849 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:10:11.849 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:10:11.850 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:10:11.850 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.850 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 5, 2024-09-14T09:10:11.850 INFO:teuthology.orchestra.run.smithi116.stdout: "uuid": "e4bcb224-662f-4530-b477-c0dd9c4ddbf4", 2024-09-14T09:10:11.850 INFO:teuthology.orchestra.run.smithi116.stdout: "up": 1, 2024-09-14T09:10:11.850 INFO:teuthology.orchestra.run.smithi116.stdout: "in": 0, 2024-09-14T09:10:11.850 INFO:teuthology.orchestra.run.smithi116.stdout: "weight": 0, 2024-09-14T09:10:11.850 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_affinity": 1, 2024-09-14T09:10:11.850 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_begin": 0, 2024-09-14T09:10:11.850 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_end": 0, 2024-09-14T09:10:11.850 INFO:teuthology.orchestra.run.smithi116.stdout: "up_from": 12, 2024-09-14T09:10:11.850 INFO:teuthology.orchestra.run.smithi116.stdout: "up_thru": 87, 2024-09-14T09:10:11.850 INFO:teuthology.orchestra.run.smithi116.stdout: "down_at": 0, 2024-09-14T09:10:11.851 INFO:teuthology.orchestra.run.smithi116.stdout: "lost_at": 0, 2024-09-14T09:10:11.851 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addrs": { 2024-09-14T09:10:11.851 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.851 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.851 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6800", 2024-09-14T09:10:11.851 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:10:11.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.851 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.851 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6801", 2024-09-14T09:10:11.851 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:10:11.851 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.851 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.852 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addrs": { 2024-09-14T09:10:11.852 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.852 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.852 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6802", 2024-09-14T09:10:11.852 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:10:11.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.852 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.852 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6803", 2024-09-14T09:10:11.852 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:10:11.852 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.852 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.853 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addrs": { 2024-09-14T09:10:11.853 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.853 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.853 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6806", 2024-09-14T09:10:11.853 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:10:11.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.853 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.853 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6807", 2024-09-14T09:10:11.853 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:10:11.853 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.854 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.854 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addrs": { 2024-09-14T09:10:11.854 INFO:teuthology.orchestra.run.smithi116.stdout: "addrvec": [ 2024-09-14T09:10:11.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.854 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v2", 2024-09-14T09:10:11.854 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6804", 2024-09-14T09:10:11.854 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:10:11.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.854 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "v1", 2024-09-14T09:10:11.854 INFO:teuthology.orchestra.run.smithi116.stdout: "addr": "172.21.15.144:6805", 2024-09-14T09:10:11.854 INFO:teuthology.orchestra.run.smithi116.stdout: "nonce": 2878111293 2024-09-14T09:10:11.854 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.854 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.855 INFO:teuthology.orchestra.run.smithi116.stdout: "public_addr": "172.21.15.144:6801/2878111293", 2024-09-14T09:10:11.855 INFO:teuthology.orchestra.run.smithi116.stdout: "cluster_addr": "172.21.15.144:6803/2878111293", 2024-09-14T09:10:11.855 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_back_addr": "172.21.15.144:6807/2878111293", 2024-09-14T09:10:11.855 INFO:teuthology.orchestra.run.smithi116.stdout: "heartbeat_front_addr": "172.21.15.144:6805/2878111293", 2024-09-14T09:10:11.855 INFO:teuthology.orchestra.run.smithi116.stdout: "state": [ 2024-09-14T09:10:11.855 INFO:teuthology.orchestra.run.smithi116.stdout: "exists", 2024-09-14T09:10:11.855 INFO:teuthology.orchestra.run.smithi116.stdout: "up" 2024-09-14T09:10:11.855 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.855 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.855 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:10:11.855 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_xinfo": [ 2024-09-14T09:10:11.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.855 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 0, 2024-09-14T09:10:11.856 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:10:11.856 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:10:11.856 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:10:11.856 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:10:11.856 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:10:11.856 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:24.757990+0000", 2024-09-14T09:10:11.856 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:10:11.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.856 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 1, 2024-09-14T09:10:11.856 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:10:11.856 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:10:11.856 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:10:11.856 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:10:11.857 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:10:11.857 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.277795+0000", 2024-09-14T09:10:11.857 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:10:11.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.857 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 2, 2024-09-14T09:10:11.857 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:10:11.857 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:10:11.857 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:10:11.857 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:10:11.857 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:10:11.857 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.290172+0000", 2024-09-14T09:10:11.857 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 68 2024-09-14T09:10:11.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.858 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 3, 2024-09-14T09:10:11.858 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:10:11.858 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:10:11.858 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:10:11.858 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:10:11.858 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:10:11.858 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.324594+0000", 2024-09-14T09:10:11.858 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:10:11.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.858 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 4, 2024-09-14T09:10:11.858 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:10:11.859 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:10:11.859 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:10:11.859 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:10:11.859 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 0, 2024-09-14T09:10:11.859 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:24.865136+0000", 2024-09-14T09:10:11.859 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:10:11.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.859 INFO:teuthology.orchestra.run.smithi116.stdout: "osd": 5, 2024-09-14T09:10:11.859 INFO:teuthology.orchestra.run.smithi116.stdout: "down_stamp": "0.000000", 2024-09-14T09:10:11.859 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_probability": 0, 2024-09-14T09:10:11.859 INFO:teuthology.orchestra.run.smithi116.stdout: "laggy_interval": 0, 2024-09-14T09:10:11.859 INFO:teuthology.orchestra.run.smithi116.stdout: "features": 4540719139924082687, 2024-09-14T09:10:11.859 INFO:teuthology.orchestra.run.smithi116.stdout: "old_weight": 65536, 2024-09-14T09:10:11.860 INFO:teuthology.orchestra.run.smithi116.stdout: "last_purged_snaps_scrub": "2024-09-14T09:07:25.020572+0000", 2024-09-14T09:10:11.860 INFO:teuthology.orchestra.run.smithi116.stdout: "dead_epoch": 0 2024-09-14T09:10:11.860 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.860 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:10:11.860 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap": [], 2024-09-14T09:10:11.860 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap_items": [], 2024-09-14T09:10:11.860 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_upmap_primaries": [], 2024-09-14T09:10:11.860 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_temp": [], 2024-09-14T09:10:11.860 INFO:teuthology.orchestra.run.smithi116.stdout: "primary_temp": [], 2024-09-14T09:10:11.860 INFO:teuthology.orchestra.run.smithi116.stdout: "blocklist": {}, 2024-09-14T09:10:11.860 INFO:teuthology.orchestra.run.smithi116.stdout: "range_blocklist": {}, 2024-09-14T09:10:11.860 INFO:teuthology.orchestra.run.smithi116.stdout: "erasure_code_profiles": { 2024-09-14T09:10:11.860 INFO:teuthology.orchestra.run.smithi116.stdout: "default": { 2024-09-14T09:10:11.860 INFO:teuthology.orchestra.run.smithi116.stdout: "crush-failure-domain": "osd", 2024-09-14T09:10:11.861 INFO:teuthology.orchestra.run.smithi116.stdout: "k": "2", 2024-09-14T09:10:11.861 INFO:teuthology.orchestra.run.smithi116.stdout: "m": "1", 2024-09-14T09:10:11.861 INFO:teuthology.orchestra.run.smithi116.stdout: "plugin": "jerasure", 2024-09-14T09:10:11.861 INFO:teuthology.orchestra.run.smithi116.stdout: "technique": "reed_sol_van" 2024-09-14T09:10:11.861 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:11.861 INFO:teuthology.orchestra.run.smithi116.stdout: "removed_snaps_queue": [ 2024-09-14T09:10:11.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.861 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 3, 2024-09-14T09:10:11.861 INFO:teuthology.orchestra.run.smithi116.stdout: "snaps": [ 2024-09-14T09:10:11.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.861 INFO:teuthology.orchestra.run.smithi116.stdout: "begin": 16, 2024-09-14T09:10:11.861 INFO:teuthology.orchestra.run.smithi116.stdout: "length": 9 2024-09-14T09:10:11.862 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.862 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.862 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.862 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:10:11.862 INFO:teuthology.orchestra.run.smithi116.stdout: "new_removed_snaps": [ 2024-09-14T09:10:11.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.862 INFO:teuthology.orchestra.run.smithi116.stdout: "pool": 3, 2024-09-14T09:10:11.862 INFO:teuthology.orchestra.run.smithi116.stdout: "snaps": [ 2024-09-14T09:10:11.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:11.862 INFO:teuthology.orchestra.run.smithi116.stdout: "begin": 16, 2024-09-14T09:10:11.862 INFO:teuthology.orchestra.run.smithi116.stdout: "length": 1 2024-09-14T09:10:11.862 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.862 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:11.862 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.862 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T09:10:11.863 INFO:teuthology.orchestra.run.smithi116.stdout: "new_purged_snaps": [], 2024-09-14T09:10:11.863 INFO:teuthology.orchestra.run.smithi116.stdout: "crush_node_flags": {}, 2024-09-14T09:10:11.863 INFO:teuthology.orchestra.run.smithi116.stdout: "device_class_flags": {}, 2024-09-14T09:10:11.863 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode": { 2024-09-14T09:10:11.863 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode_enabled": false, 2024-09-14T09:10:11.863 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_bucket_count": 0, 2024-09-14T09:10:11.863 INFO:teuthology.orchestra.run.smithi116.stdout: "degraded_stretch_mode": 0, 2024-09-14T09:10:11.863 INFO:teuthology.orchestra.run.smithi116.stdout: "recovering_stretch_mode": 0, 2024-09-14T09:10:11.863 INFO:teuthology.orchestra.run.smithi116.stdout: "stretch_mode_bucket": 0 2024-09-14T09:10:11.863 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:11.863 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:11.864 INFO:tasks.thrashosds.thrasher:j is {'epoch': 139, 'fsid': 'c991ac1c-978d-48b3-a540-4d3d4755e125', 'created': '2024-09-14T09:07:16.982473+0000', 'modified': '2024-09-14T09:10:10.917826+0000', 'last_up_change': '2024-09-14T09:09:15.843683+0000', 'last_in_change': '2024-09-14T09:09:52.811197+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T09:07:29.194849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T09:07:33.684592+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.2699999809265137, 'score_stable': 2.2699999809265137, 'optimal_score': 0.8299999833106995, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-14T09:07:43.363542+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '139', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 43, 'snap_epoch': 139, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.2699999809265137, 'score_stable': 2.2699999809265137, 'optimal_score': 0.8299999833106995, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.8739293813705444, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}], 'osds': [{'osd': 0, 'uuid': 'b3c13086-1183-454b-8e62-3aec9b69cdf5', 'up': 1, 'in': 1, 'weight': 0.3199462890625, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 78, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6816', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6817', 'nonce': 1856142608}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6818', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6819', 'nonce': 1856142608}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6822', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6823', 'nonce': 1856142608}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6820', 'nonce': 1856142608}, {'type': 'v1', 'addr': '172.21.15.116:6821', 'nonce': 1856142608}]}, 'public_addr': '172.21.15.116:6817/1856142608', 'cluster_addr': '172.21.15.116:6819/1856142608', 'heartbeat_back_addr': '172.21.15.116:6823/1856142608', 'heartbeat_front_addr': '172.21.15.116:6821/1856142608', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '8ee6a373-9d0d-4cd2-96f4-9673de96f546', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 125, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6800', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6801', 'nonce': 3469105275}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6802', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6803', 'nonce': 3469105275}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6806', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6807', 'nonce': 3469105275}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6804', 'nonce': 3469105275}, {'type': 'v1', 'addr': '172.21.15.116:6805', 'nonce': 3469105275}]}, 'public_addr': '172.21.15.116:6801/3469105275', 'cluster_addr': '172.21.15.116:6803/3469105275', 'heartbeat_back_addr': '172.21.15.116:6807/3469105275', 'heartbeat_front_addr': '172.21.15.116:6805/3469105275', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '958a9363-d751-49c3-9ec7-7330d377ee53', 'up': 1, 'in': 1, 'weight': 0.59710693359375, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 67, 'up_from': 87, 'up_thru': 124, 'down_at': 68, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6808', 'nonce': 2050490698}, {'type': 'v1', 'addr': '172.21.15.116:6809', 'nonce': 2050490698}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6810', 'nonce': 2050490698}, {'type': 'v1', 'addr': '172.21.15.116:6811', 'nonce': 2050490698}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6814', 'nonce': 2050490698}, {'type': 'v1', 'addr': '172.21.15.116:6815', 'nonce': 2050490698}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6812', 'nonce': 2050490698}, {'type': 'v1', 'addr': '172.21.15.116:6813', 'nonce': 2050490698}]}, 'public_addr': '172.21.15.116:6809/2050490698', 'cluster_addr': '172.21.15.116:6811/2050490698', 'heartbeat_back_addr': '172.21.15.116:6815/2050490698', 'heartbeat_front_addr': '172.21.15.116:6813/2050490698', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '7fafd519-b2e9-498c-a409-f55cfe45a51a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.2435760498046875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 124, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6816', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6817', 'nonce': 2855061278}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6818', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6819', 'nonce': 2855061278}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6822', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6823', 'nonce': 2855061278}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6820', 'nonce': 2855061278}, {'type': 'v1', 'addr': '172.21.15.144:6821', 'nonce': 2855061278}]}, 'public_addr': '172.21.15.144:6817/2855061278', 'cluster_addr': '172.21.15.144:6819/2855061278', 'heartbeat_back_addr': '172.21.15.144:6823/2855061278', 'heartbeat_front_addr': '172.21.15.144:6821/2855061278', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '63d99552-5fea-4367-bf86-0addc8cceb98', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 124, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6808', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6809', 'nonce': 369903047}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6810', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6811', 'nonce': 369903047}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6814', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6815', 'nonce': 369903047}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6812', 'nonce': 369903047}, {'type': 'v1', 'addr': '172.21.15.144:6813', 'nonce': 369903047}]}, 'public_addr': '172.21.15.144:6809/369903047', 'cluster_addr': '172.21.15.144:6811/369903047', 'heartbeat_back_addr': '172.21.15.144:6815/369903047', 'heartbeat_front_addr': '172.21.15.144:6813/369903047', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'e4bcb224-662f-4530-b477-c0dd9c4ddbf4', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 87, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6800', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6801', 'nonce': 2878111293}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6802', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6803', 'nonce': 2878111293}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6806', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6807', 'nonce': 2878111293}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6804', 'nonce': 2878111293}, {'type': 'v1', 'addr': '172.21.15.144:6805', 'nonce': 2878111293}]}, 'public_addr': '172.21.15.144:6801/2878111293', 'cluster_addr': '172.21.15.144:6803/2878111293', 'heartbeat_back_addr': '172.21.15.144:6807/2878111293', 'heartbeat_front_addr': '172.21.15.144:6805/2878111293', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:24.757990+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.277795+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.290172+0000', 'dead_epoch': 68}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.324594+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T09:07:24.865136+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-14T09:07:25.020572+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 16, 'length': 9}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 16, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T09:10:11.865 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T09:10:11.865 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is set 2024-09-14T09:10:11.865 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:11.799+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:11.899 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:11.901+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:12.000 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:12.002+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:12.018 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:12.018 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:10:12.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:10:12.018 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:10:12.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.018 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55979 3.e 3:740d1568:::rbd_data.1112a10502fe.0000000000000133:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:12.018 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:10:12.018 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 56.168603376, 2024-09-14T09:10:12.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.95211669700000001, 2024-09-14T09:10:12.018 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.019 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.019 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:10:12.019 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.019 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:12.019 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:12.019 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55979 2024-09-14T09:10:12.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.019 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:10:12.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:10:12.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850380+0000", 2024-09-14T09:10:12.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.615e-06 2024-09-14T09:10:12.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850386+0000", 2024-09-14T09:10:12.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8000000000000001e-06 2024-09-14T09:10:12.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850403+0000", 2024-09-14T09:10:12.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6339999999999999e-05 2024-09-14T09:10:12.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850413+0000", 2024-09-14T09:10:12.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8609999999999993e-06 2024-09-14T09:10:12.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851033+0000", 2024-09-14T09:10:12.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062034700000000004 2024-09-14T09:10:12.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:10:12.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851042+0000", 2024-09-14T09:10:12.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8340000000000005e-06 2024-09-14T09:10:12.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853175+0000", 2024-09-14T09:10:12.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0021332809999999999 2024-09-14T09:10:12.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:12.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853183+0000", 2024-09-14T09:10:12.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:10:12.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795232+0000", 2024-09-14T09:10:12.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94204854900000001 2024-09-14T09:10:12.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795413+0000", 2024-09-14T09:10:12.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018059200000000001 2024-09-14T09:10:12.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:10:12.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795717+0000", 2024-09-14T09:10:12.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000304636 2024-09-14T09:10:12.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:10:12.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799631+0000", 2024-09-14T09:10:12.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136910000000004 2024-09-14T09:10:12.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:10:12.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802290+0000", 2024-09-14T09:10:12.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026588010000000001 2024-09-14T09:10:12.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:10:12.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802362+0000", 2024-09-14T09:10:12.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2018000000000001e-05 2024-09-14T09:10:12.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802495+0000", 2024-09-14T09:10:12.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000132967 2024-09-14T09:10:12.025 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.025 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.025 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.026 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55990 3.e 3:72d6260e:::rbd_data.1112a10502fe.000000000000016c:head [stat,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:12.026 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:10:12.026 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 56.168542068999997, 2024-09-14T09:10:12.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.952433164, 2024-09-14T09:10:12.026 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.026 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.026 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.026 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.026 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:12.026 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:12.026 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55990 2024-09-14T09:10:12.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.027 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:10:12.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:10:12.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850440+0000", 2024-09-14T09:10:12.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5199999999999996e-07 2024-09-14T09:10:12.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850444+0000", 2024-09-14T09:10:12.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.019e-06 2024-09-14T09:10:12.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850452+0000", 2024-09-14T09:10:12.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0209999999999999e-06 2024-09-14T09:10:12.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850457+0000", 2024-09-14T09:10:12.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9529999999999998e-06 2024-09-14T09:10:12.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851100+0000", 2024-09-14T09:10:12.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00064299699999999997 2024-09-14T09:10:12.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:12.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851108+0000", 2024-09-14T09:10:12.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2279999999999998e-06 2024-09-14T09:10:12.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853208+0000", 2024-09-14T09:10:12.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020996579999999999 2024-09-14T09:10:12.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:12.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853213+0000", 2024-09-14T09:10:12.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4029999999999998e-06 2024-09-14T09:10:12.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796098+0000", 2024-09-14T09:10:12.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94288483700000003 2024-09-14T09:10:12.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796247+0000", 2024-09-14T09:10:12.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014925800000000001 2024-09-14T09:10:12.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802872+0000", 2024-09-14T09:10:12.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006625138 2024-09-14T09:10:12.031 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.031 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.031 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.031 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:12.031 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:10:12.032 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 56.004303296000003, 2024-09-14T09:10:12.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77465830800000002, 2024-09-14T09:10:12.032 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.032 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.032 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:12.032 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.032 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:12.032 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:12.032 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 58987 2024-09-14T09:10:12.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.032 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:10:12.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:10:12.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014680+0000", 2024-09-14T09:10:12.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9250000000000002e-06 2024-09-14T09:10:12.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014689+0000", 2024-09-14T09:10:12.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9730000000000003e-06 2024-09-14T09:10:12.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014709+0000", 2024-09-14T09:10:12.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9641999999999999e-05 2024-09-14T09:10:12.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014720+0000", 2024-09-14T09:10:12.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-09-14T09:10:12.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014796+0000", 2024-09-14T09:10:12.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6567000000000001e-05 2024-09-14T09:10:12.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:12.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014808+0000", 2024-09-14T09:10:12.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1435e-05 2024-09-14T09:10:12.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789325+0000", 2024-09-14T09:10:12.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77451705999999998 2024-09-14T09:10:12.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789336+0000", 2024-09-14T09:10:12.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1466e-05 2024-09-14T09:10:12.036 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.036 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.036 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.037 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:59017 3.3 3.6b81fb83 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:12.037 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:10:12.037 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 56.002650891999998, 2024-09-14T09:10:12.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77253447099999994, 2024-09-14T09:10:12.037 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.037 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.037 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:12.037 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.037 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:12.037 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:12.037 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 59017 2024-09-14T09:10:12.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.038 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:10:12.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:10:12.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016332+0000", 2024-09-14T09:10:12.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3459999999999999e-06 2024-09-14T09:10:12.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016337+0000", 2024-09-14T09:10:12.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.48e-06 2024-09-14T09:10:12.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016355+0000", 2024-09-14T09:10:12.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7955e-05 2024-09-14T09:10:12.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016364+0000", 2024-09-14T09:10:12.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.02e-06 2024-09-14T09:10:12.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016433+0000", 2024-09-14T09:10:12.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8398000000000005e-05 2024-09-14T09:10:12.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:12.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016442+0000", 2024-09-14T09:10:12.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1819999999999995e-06 2024-09-14T09:10:12.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788855+0000", 2024-09-14T09:10:12.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77241356299999997 2024-09-14T09:10:12.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788865+0000", 2024-09-14T09:10:12.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5270000000000004e-06 2024-09-14T09:10:12.041 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.041 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.041 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.042 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60343 3.e 3:721b16e6:::rbd_data.1112a10502fe.000000000000014b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:12.042 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:10:12.042 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.898681289999999, 2024-09-14T09:10:12.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68876920900000005, 2024-09-14T09:10:12.042 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.042 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.042 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:10:12.042 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.042 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:12.042 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:12.042 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60343 2024-09-14T09:10:12.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.042 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:10:12.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:10:12.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120302+0000", 2024-09-14T09:10:12.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0279999999999999e-06 2024-09-14T09:10:12.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120310+0000", 2024-09-14T09:10:12.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4330000000000004e-06 2024-09-14T09:10:12.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120333+0000", 2024-09-14T09:10:12.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2200000000000001e-05 2024-09-14T09:10:12.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120343+0000", 2024-09-14T09:10:12.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0560000000000001e-05 2024-09-14T09:10:12.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120414+0000", 2024-09-14T09:10:12.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0493000000000004e-05 2024-09-14T09:10:12.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:12.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120424+0000", 2024-09-14T09:10:12.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.059e-05 2024-09-14T09:10:12.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796679+0000", 2024-09-14T09:10:12.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67625512700000001 2024-09-14T09:10:12.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796833+0000", 2024-09-14T09:10:12.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015403500000000001 2024-09-14T09:10:12.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:10:12.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797239+0000", 2024-09-14T09:10:12.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040503000000000002 2024-09-14T09:10:12.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:10:12.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802918+0000", 2024-09-14T09:10:12.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056796199999999998 2024-09-14T09:10:12.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:10:12.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808655+0000", 2024-09-14T09:10:12.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057365089999999999 2024-09-14T09:10:12.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:10:12.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808850+0000", 2024-09-14T09:10:12.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000194904 2024-09-14T09:10:12.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809069+0000", 2024-09-14T09:10:12.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021968000000000001 2024-09-14T09:10:12.048 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.048 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.048 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.048 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60356 3.2 3:40f9e9e7:::rbd_data.1112a10502fe.0000000000000160:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:12.048 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:10:12.048 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.897618776999998, 2024-09-14T09:10:12.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68053790800000002, 2024-09-14T09:10:12.048 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.048 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.048 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:10:12.048 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.049 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:12.049 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:12.049 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60356 2024-09-14T09:10:12.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.049 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:10:12.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:10:12.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121364+0000", 2024-09-14T09:10:12.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.173e-06 2024-09-14T09:10:12.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121371+0000", 2024-09-14T09:10:12.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-09-14T09:10:12.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121386+0000", 2024-09-14T09:10:12.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4925e-05 2024-09-14T09:10:12.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121395+0000", 2024-09-14T09:10:12.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8190000000000003e-06 2024-09-14T09:10:12.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121464+0000", 2024-09-14T09:10:12.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8149000000000001e-05 2024-09-14T09:10:12.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:12.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121474+0000", 2024-09-14T09:10:12.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0927999999999999e-05 2024-09-14T09:10:12.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795901+0000", 2024-09-14T09:10:12.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67442645499999998 2024-09-14T09:10:12.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796068+0000", 2024-09-14T09:10:12.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016655700000000001 2024-09-14T09:10:12.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 3", 2024-09-14T09:10:12.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796354+0000", 2024-09-14T09:10:12.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00028646999999999999 2024-09-14T09:10:12.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:10:12.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.800348+0000", 2024-09-14T09:10:12.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039943119999999999 2024-09-14T09:10:12.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:10:12.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801690+0000", 2024-09-14T09:10:12.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013415090000000001 2024-09-14T09:10:12.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:10:12.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801771+0000", 2024-09-14T09:10:12.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1678e-05 2024-09-14T09:10:12.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801900+0000", 2024-09-14T09:10:12.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000128978 2024-09-14T09:10:12.054 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.054 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.054 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.055 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62163 3.e 3:713ab431:::rbd_data.1112a10502fe.0000000000000198:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:12.055 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:10:12.055 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.807248569999999, 2024-09-14T09:10:12.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.597552682, 2024-09-14T09:10:12.055 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.055 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.055 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.055 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.055 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:12.055 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:12.055 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62163 2024-09-14T09:10:12.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.055 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:10:12.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:10:12.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211735+0000", 2024-09-14T09:10:12.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1110000000000002e-06 2024-09-14T09:10:12.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211744+0000", 2024-09-14T09:10:12.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0790000000000007e-06 2024-09-14T09:10:12.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211765+0000", 2024-09-14T09:10:12.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1114000000000001e-05 2024-09-14T09:10:12.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211775+0000", 2024-09-14T09:10:12.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0033e-05 2024-09-14T09:10:12.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211847+0000", 2024-09-14T09:10:12.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1503999999999998e-05 2024-09-14T09:10:12.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:12.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211857+0000", 2024-09-14T09:10:12.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0378e-05 2024-09-14T09:10:12.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799140+0000", 2024-09-14T09:10:12.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.58728279100000003 2024-09-14T09:10:12.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799289+0000", 2024-09-14T09:10:12.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000148966 2024-09-14T09:10:12.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809285+0000", 2024-09-14T09:10:12.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099967059999999993 2024-09-14T09:10:12.059 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.059 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.059 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.060 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63582 3.2 3:467f2009:::rbd_data.1112a10502fe.00000000000001a1:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:12.060 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:10:12.060 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.732055453000001, 2024-09-14T09:10:12.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51869012999999997, 2024-09-14T09:10:12.060 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.060 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.060 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.060 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.060 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:12.060 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:12.060 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63582 2024-09-14T09:10:12.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.060 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:10:12.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:10:12.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286928+0000", 2024-09-14T09:10:12.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.812e-06 2024-09-14T09:10:12.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286936+0000", 2024-09-14T09:10:12.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2390000000000002e-06 2024-09-14T09:10:12.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286955+0000", 2024-09-14T09:10:12.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8853000000000001e-05 2024-09-14T09:10:12.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286972+0000", 2024-09-14T09:10:12.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7365000000000001e-05 2024-09-14T09:10:12.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287052+0000", 2024-09-14T09:10:12.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9491000000000002e-05 2024-09-14T09:10:12.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:12.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287063+0000", 2024-09-14T09:10:12.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1620999999999999e-05 2024-09-14T09:10:12.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796696+0000", 2024-09-14T09:10:12.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50963256999999995 2024-09-14T09:10:12.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796847+0000", 2024-09-14T09:10:12.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015126899999999999 2024-09-14T09:10:12.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.805616+0000", 2024-09-14T09:10:12.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087689099999999996 2024-09-14T09:10:12.064 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.064 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.064 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.064 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63586 3.3 3.d4e49b03 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:12.065 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:10:12.065 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.731971072, 2024-09-14T09:10:12.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50188935099999998, 2024-09-14T09:10:12.065 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.065 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.065 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:12.065 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.065 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:12.065 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:12.065 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63586 2024-09-14T09:10:12.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.065 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:10:12.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:10:12.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287011+0000", 2024-09-14T09:10:12.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.61e-07 2024-09-14T09:10:12.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287014+0000", 2024-09-14T09:10:12.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3900000000000002e-06 2024-09-14T09:10:12.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287023+0000", 2024-09-14T09:10:12.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3380000000000005e-06 2024-09-14T09:10:12.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287029+0000", 2024-09-14T09:10:12.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0079999999999999e-06 2024-09-14T09:10:12.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287087+0000", 2024-09-14T09:10:12.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8322000000000002e-05 2024-09-14T09:10:12.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:12.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287096+0000", 2024-09-14T09:10:12.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8580000000000006e-06 2024-09-14T09:10:12.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788891+0000", 2024-09-14T09:10:12.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50179498499999997 2024-09-14T09:10:12.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788900+0000", 2024-09-14T09:10:12.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.789e-06 2024-09-14T09:10:12.069 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.069 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.069 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.070 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60363 3.1d 3:b8b44067:::rbd_data.1112a10502fe.000000000000018b:head [stat,delete] snapc 21=[21] RETRY=12 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:12.070 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:10:12.070 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.231249333999997, 2024-09-14T09:10:12.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268612690000001, 2024-09-14T09:10:12.070 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.070 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.070 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.070 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.070 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:12.070 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:12.070 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60363 2024-09-14T09:10:12.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.070 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:10:12.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:10:12.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787733+0000", 2024-09-14T09:10:12.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.314e-06 2024-09-14T09:10:12.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787739+0000", 2024-09-14T09:10:12.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5300000000000004e-06 2024-09-14T09:10:12.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787750+0000", 2024-09-14T09:10:12.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1251e-05 2024-09-14T09:10:12.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:10:12.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0739999999999993e-06 2024-09-14T09:10:12.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787827+0000", 2024-09-14T09:10:12.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8861000000000004e-05 2024-09-14T09:10:12.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:10:12.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787836+0000", 2024-09-14T09:10:12.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1339999999999993e-06 2024-09-14T09:10:12.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789335+0000", 2024-09-14T09:10:12.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014988289999999999 2024-09-14T09:10:12.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:12.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789343+0000", 2024-09-14T09:10:12.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6639999999999998e-06 2024-09-14T09:10:12.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799170+0000", 2024-09-14T09:10:12.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098272500000001 2024-09-14T09:10:12.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799377+0000", 2024-09-14T09:10:12.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000207126 2024-09-14T09:10:12.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814593+0000", 2024-09-14T09:10:12.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015216235999999999 2024-09-14T09:10:12.075 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.075 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.075 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.075 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63565 3.1d 3:bdc63b28:::rbd_data.1112a10502fe.000000000000016d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=9 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:12.075 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:10:12.075 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.231203542999999, 2024-09-14T09:10:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0271114539999999, 2024-09-14T09:10:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:10:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63565 2024-09-14T09:10:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:10:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:10:12.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:10:12.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6899999999999998e-07 2024-09-14T09:10:12.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787781+0000", 2024-09-14T09:10:12.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8909999999999999e-06 2024-09-14T09:10:12.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787787+0000", 2024-09-14T09:10:12.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3230000000000003e-06 2024-09-14T09:10:12.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787793+0000", 2024-09-14T09:10:12.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-09-14T09:10:12.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789455+0000", 2024-09-14T09:10:12.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001661596 2024-09-14T09:10:12.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:12.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789463+0000", 2024-09-14T09:10:12.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4889999999999995e-06 2024-09-14T09:10:12.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800115+0000", 2024-09-14T09:10:12.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0106512670000001 2024-09-14T09:10:12.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800334+0000", 2024-09-14T09:10:12.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000219213 2024-09-14T09:10:12.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:10:12.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800651+0000", 2024-09-14T09:10:12.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00031765500000000002 2024-09-14T09:10:12.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:10:12.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.811875+0000", 2024-09-14T09:10:12.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011224032 2024-09-14T09:10:12.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:10:12.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814665+0000", 2024-09-14T09:10:12.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002789606 2024-09-14T09:10:12.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:10:12.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814742+0000", 2024-09-14T09:10:12.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6916999999999996e-05 2024-09-14T09:10:12.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814889+0000", 2024-09-14T09:10:12.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014725799999999999 2024-09-14T09:10:12.081 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.081 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.081 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.082 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:67113 3.1d 3:bba7fe0d:::rbd_data.1112a10502fe.00000000000001bf:head [stat,delete] snapc 21=[21] RETRY=4 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:12.082 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:10:12.082 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.230442685, 2024-09-14T09:10:12.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0265995649999999, 2024-09-14T09:10:12.082 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.082 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.082 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.082 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.082 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:12.082 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:12.082 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 67113 2024-09-14T09:10:12.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.082 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:10:12.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:10:12.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:10:12.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:10:12.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788543+0000", 2024-09-14T09:10:12.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-09-14T09:10:12.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788552+0000", 2024-09-14T09:10:12.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:10:12.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788559+0000", 2024-09-14T09:10:12.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:10:12.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789489+0000", 2024-09-14T09:10:12.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00092982199999999996 2024-09-14T09:10:12.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:12.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789497+0000", 2024-09-14T09:10:12.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6299999999999998e-06 2024-09-14T09:10:12.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801068+0000", 2024-09-14T09:10:12.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0115709530000001 2024-09-14T09:10:12.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801240+0000", 2024-09-14T09:10:12.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017276600000000001 2024-09-14T09:10:12.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815138+0000", 2024-09-14T09:10:12.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013897856 2024-09-14T09:10:12.086 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.086 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.086 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.086 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73412 3.1d 3:be4606c3:::rbd_data.1112a10502fe.00000000000001f2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:12.086 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:10:12.086 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.230411572999998, 2024-09-14T09:10:12.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026815928, 2024-09-14T09:10:12.087 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.087 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.087 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.087 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.087 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:12.087 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:12.087 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73412 2024-09-14T09:10:12.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.087 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:10:12.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:10:12.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:10:12.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5699999999999998e-07 2024-09-14T09:10:12.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788572+0000", 2024-09-14T09:10:12.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2809999999999998e-06 2024-09-14T09:10:12.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788579+0000", 2024-09-14T09:10:12.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5629999999999997e-06 2024-09-14T09:10:12.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788584+0000", 2024-09-14T09:10:12.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1710000000000001e-06 2024-09-14T09:10:12.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789521+0000", 2024-09-14T09:10:12.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00093657400000000002 2024-09-14T09:10:12.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:12.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789528+0000", 2024-09-14T09:10:12.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5719999999999997e-06 2024-09-14T09:10:12.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801631+0000", 2024-09-14T09:10:12.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0121023229999999 2024-09-14T09:10:12.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801792+0000", 2024-09-14T09:10:12.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016174000000000001 2024-09-14T09:10:12.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815386+0000", 2024-09-14T09:10:12.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013593246999999999 2024-09-14T09:10:12.091 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.091 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.091 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.091 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:77244 3.1d 3:b801be19:::rbd_data.1112a10502fe.0000000000000204:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:12.091 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:10:12.091 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.048547327000001, 2024-09-14T09:10:12.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.84519277100000001, 2024-09-14T09:10:12.092 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.092 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.092 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.092 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.092 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:12.092 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:12.092 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 77244 2024-09-14T09:10:12.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.092 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:10:12.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:10:12.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970436+0000", 2024-09-14T09:10:12.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.511e-06 2024-09-14T09:10:12.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970441+0000", 2024-09-14T09:10:12.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0470000000000001e-06 2024-09-14T09:10:12.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970453+0000", 2024-09-14T09:10:12.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2629999999999999e-05 2024-09-14T09:10:12.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970461+0000", 2024-09-14T09:10:12.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6850000000000001e-06 2024-09-14T09:10:12.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970524+0000", 2024-09-14T09:10:12.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3332999999999998e-05 2024-09-14T09:10:12.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:12.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970544+0000", 2024-09-14T09:10:12.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9731000000000001e-05 2024-09-14T09:10:12.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802188+0000", 2024-09-14T09:10:12.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.83164380000000004 2024-09-14T09:10:12.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:10:12.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015411999999999999 2024-09-14T09:10:12.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815627+0000", 2024-09-14T09:10:12.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013284914 2024-09-14T09:10:12.096 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.096 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.096 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.096 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:79796 3.1d 3:bc22caaf:::rbd_data.1112a10502fe.000000000000020c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:12.097 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:10:12.097 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.927238641000002, 2024-09-14T09:10:12.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72411694299999996, 2024-09-14T09:10:12.097 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.097 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.097 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.097 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.097 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:12.097 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:12.097 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 79796 2024-09-14T09:10:12.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.097 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:10:12.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:10:12.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091745+0000", 2024-09-14T09:10:12.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2000000000000001e-06 2024-09-14T09:10:12.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091752+0000", 2024-09-14T09:10:12.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-09-14T09:10:12.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091772+0000", 2024-09-14T09:10:12.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9822000000000001e-05 2024-09-14T09:10:12.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091791+0000", 2024-09-14T09:10:12.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9236e-05 2024-09-14T09:10:12.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091882+0000", 2024-09-14T09:10:12.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0783000000000001e-05 2024-09-14T09:10:12.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:12.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091892+0000", 2024-09-14T09:10:12.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7999999999999993e-06 2024-09-14T09:10:12.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802744+0000", 2024-09-14T09:10:12.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.710851868 2024-09-14T09:10:12.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802902+0000", 2024-09-14T09:10:12.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015814900000000001 2024-09-14T09:10:12.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815860+0000", 2024-09-14T09:10:12.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012957605000000001 2024-09-14T09:10:12.101 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.101 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.101 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.101 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80904 3.1d 3:be0e7f3d:::rbd_data.1112a10502fe.0000000000000214:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:12.101 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:10:12.102 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.847152794000003, 2024-09-14T09:10:12.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64435178100000001, 2024-09-14T09:10:12.102 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.102 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.102 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:12.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:12.102 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80904 2024-09-14T09:10:12.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.102 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:10:12.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:10:12.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171831+0000", 2024-09-14T09:10:12.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0729999999999999e-06 2024-09-14T09:10:12.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171839+0000", 2024-09-14T09:10:12.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9179999999999994e-06 2024-09-14T09:10:12.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171857+0000", 2024-09-14T09:10:12.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8957000000000002e-05 2024-09-14T09:10:12.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171867+0000", 2024-09-14T09:10:12.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7100000000000002e-06 2024-09-14T09:10:12.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171957+0000", 2024-09-14T09:10:12.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9932999999999994e-05 2024-09-14T09:10:12.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:12.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171974+0000", 2024-09-14T09:10:12.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6988999999999999e-05 2024-09-14T09:10:12.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803301+0000", 2024-09-14T09:10:12.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63132648599999996 2024-09-14T09:10:12.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803482+0000", 2024-09-14T09:10:12.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000181607 2024-09-14T09:10:12.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816180+0000", 2024-09-14T09:10:12.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012698108 2024-09-14T09:10:12.106 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.106 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.106 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.106 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80964 3.1d 3:be42e20f:::rbd_data.1112a10502fe.0000000000000219:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:12.106 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:10:12.106 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.841517226999997, 2024-09-14T09:10:12.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63896829799999999, 2024-09-14T09:10:12.107 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.107 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.107 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.107 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.107 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:12.107 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:12.107 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80964 2024-09-14T09:10:12.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.107 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:10:12.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:10:12.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177466+0000", 2024-09-14T09:10:12.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6610000000000001e-06 2024-09-14T09:10:12.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177472+0000", 2024-09-14T09:10:12.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3029999999999996e-06 2024-09-14T09:10:12.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177490+0000", 2024-09-14T09:10:12.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8099000000000001e-05 2024-09-14T09:10:12.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177499+0000", 2024-09-14T09:10:12.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:10:12.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177560+0000", 2024-09-14T09:10:12.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1334000000000006e-05 2024-09-14T09:10:12.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:12.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177578+0000", 2024-09-14T09:10:12.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8434999999999999e-05 2024-09-14T09:10:12.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803910+0000", 2024-09-14T09:10:12.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62633190699999997 2024-09-14T09:10:12.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.806612+0000", 2024-09-14T09:10:12.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002702257 2024-09-14T09:10:12.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816432+0000", 2024-09-14T09:10:12.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098199370000000008 2024-09-14T09:10:12.111 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.111 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.111 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.111 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83321 3.1d 3:bb24b47b:::rbd_data.1112a10502fe.0000000000000223:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:12.111 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:10:12.111 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.727063553000001, 2024-09-14T09:10:12.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52477628799999998, 2024-09-14T09:10:12.111 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.111 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.111 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.112 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.112 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:12.112 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:12.112 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83321 2024-09-14T09:10:12.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.112 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:10:12.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:10:12.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291920+0000", 2024-09-14T09:10:12.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.888e-06 2024-09-14T09:10:12.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291926+0000", 2024-09-14T09:10:12.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6059999999999999e-06 2024-09-14T09:10:12.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291943+0000", 2024-09-14T09:10:12.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6813e-05 2024-09-14T09:10:12.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291952+0000", 2024-09-14T09:10:12.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7439999999999996e-06 2024-09-14T09:10:12.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292023+0000", 2024-09-14T09:10:12.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1320000000000002e-05 2024-09-14T09:10:12.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:12.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292030+0000", 2024-09-14T09:10:12.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4219999999999997e-06 2024-09-14T09:10:12.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807221+0000", 2024-09-14T09:10:12.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51519140699999999 2024-09-14T09:10:12.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807406+0000", 2024-09-14T09:10:12.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018532800000000001 2024-09-14T09:10:12.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816694+0000", 2024-09-14T09:10:12.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092877600000000008 2024-09-14T09:10:12.116 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.116 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.116 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.116 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83358 3.1d 3:bb230e23:::rbd_data.1112a10502fe.000000000000022b:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:12.116 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:10:12.116 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.725543663000003, 2024-09-14T09:10:12.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52374808900000003, 2024-09-14T09:10:12.116 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.116 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.116 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.116 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.117 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:12.117 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:12.117 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83358 2024-09-14T09:10:12.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.117 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:10:12.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:10:12.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293439+0000", 2024-09-14T09:10:12.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5899999999999995e-07 2024-09-14T09:10:12.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293443+0000", 2024-09-14T09:10:12.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9309999999999999e-06 2024-09-14T09:10:12.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293457+0000", 2024-09-14T09:10:12.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3944999999999999e-05 2024-09-14T09:10:12.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293466+0000", 2024-09-14T09:10:12.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4319999999999999e-06 2024-09-14T09:10:12.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293530+0000", 2024-09-14T09:10:12.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3860000000000002e-05 2024-09-14T09:10:12.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:12.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293540+0000", 2024-09-14T09:10:12.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0107e-05 2024-09-14T09:10:12.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809096+0000", 2024-09-14T09:10:12.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51555587800000002 2024-09-14T09:10:12.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809265+0000", 2024-09-14T09:10:12.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000169092 2024-09-14T09:10:12.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817186+0000", 2024-09-14T09:10:12.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079209850000000002 2024-09-14T09:10:12.121 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.121 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.121 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.121 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83361 3.1d 3:bd571564:::rbd_data.1112a10502fe.000000000000022c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:12.121 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:10:12.121 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.725225586999997, 2024-09-14T09:10:12.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52373873100000001, 2024-09-14T09:10:12.121 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.121 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.121 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.121 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.122 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:12.122 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:12.122 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83361 2024-09-14T09:10:12.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.122 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:10:12.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:10:12.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293757+0000", 2024-09-14T09:10:12.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8000000000000004e-07 2024-09-14T09:10:12.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293762+0000", 2024-09-14T09:10:12.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8019999999999997e-06 2024-09-14T09:10:12.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293775+0000", 2024-09-14T09:10:12.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2884000000000001e-05 2024-09-14T09:10:12.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293783+0000", 2024-09-14T09:10:12.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:10:12.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293849+0000", 2024-09-14T09:10:12.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5859999999999996e-05 2024-09-14T09:10:12.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:12.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293861+0000", 2024-09-14T09:10:12.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2238999999999999e-05 2024-09-14T09:10:12.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809680+0000", 2024-09-14T09:10:12.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51581856800000003 2024-09-14T09:10:12.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809844+0000", 2024-09-14T09:10:12.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016441200000000001 2024-09-14T09:10:12.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817494+0000", 2024-09-14T09:10:12.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076502360000000004 2024-09-14T09:10:12.126 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.126 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.126 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.126 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.126 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.126 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:12.127 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:10:12.128 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:12.130+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:12.198 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:10:12.198 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T09:10:12.210 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2024-09-14T09:10:11.796074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":544679814,"num_objects":1336,"num_object_clones":134,"num_object_copies":2672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1336,"num_whiteouts":953,"num_read":417287,"num_read_kb":1456770,"num_write":26562,"num_write_kb":495649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4524,"num_bytes_recovered":247103918,"num_keys_recovered":856,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23559,"ondisk_log_size":23559,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":378964,"kb_used_data":92020,"kb_used_omap":30,"kb_used_meta":286753,"kb_avail":471480236,"statfs":{"total":483183820800,"available":482795761664,"internally_reserved":0,"allocated":94228480,"data_stored":106215572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31300,"internal_metadata":293635516},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-156308687,"num_objects":-207,"num_object_clones":-47,"num_object_copies":-414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-207,"num_whiteouts":-34,"num_read":968,"num_read_kb":826,"num_write":273,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.880298"},"pg_stats":[{"pgid":"3.1f","version":"136'746","reported_seq":6470,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.927982+0000","last_change":"2024-09-14T09:10:08.928368+0000","last_active":"2024-09-14T09:10:08.927982+0000","last_peered":"2024-09-14T09:10:08.927982+0000","last_clean":"2024-09-14T09:10:08.927982+0000","last_became_active":"2024-09-14T09:09:56.799852+0000","last_became_peered":"2024-09-14T09:09:56.799852+0000","last_unstale":"2024-09-14T09:10:08.927982+0000","last_undegraded":"2024-09-14T09:10:08.927982+0000","last_fullsized":"2024-09-14T09:10:08.927982+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:36:11.622566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037952429999999998,"stat_sum":{"num_bytes":9205776,"num_objects":39,"num_object_clones":4,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":27,"num_read":6424,"num_read_kb":42400,"num_write":953,"num_write_kb":16264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":18399792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"12","length":"7"}]},{"pgid":"3.1e","version":"137'452","reported_seq":7795,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.969885+0000","last_change":"2024-09-14T09:10:08.927545+0000","last_active":"2024-09-14T09:10:08.969885+0000","last_peered":"2024-09-14T09:10:08.969885+0000","last_clean":"2024-09-14T09:10:08.969885+0000","last_became_active":"2024-09-14T09:09:02.797062+0000","last_became_peered":"2024-09-14T09:09:02.797062+0000","last_unstale":"2024-09-14T09:10:08.969885+0000","last_undegraded":"2024-09-14T09:10:08.969885+0000","last_fullsized":"2024-09-14T09:10:08.969885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:27.948037+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0032482800000000001,"stat_sum":{"num_bytes":12574720,"num_objects":40,"num_object_clones":3,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":29,"num_read":7547,"num_read_kb":35882,"num_write":435,"num_write_kb":5523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":7376960,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"12","length":"7"}]},{"pgid":"3.1d","version":"137'641","reported_seq":6487,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.923873+0000","last_change":"2024-09-14T09:10:08.924228+0000","last_active":"2024-09-14T09:10:08.923873+0000","last_peered":"2024-09-14T09:10:08.923873+0000","last_clean":"2024-09-14T09:10:08.923873+0000","last_became_active":"2024-09-14T09:09:17.797408+0000","last_became_peered":"2024-09-14T09:09:17.797408+0000","last_unstale":"2024-09-14T09:10:08.923873+0000","last_undegraded":"2024-09-14T09:10:08.923873+0000","last_fullsized":"2024-09-14T09:10:08.923873+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:30.143810+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.006240514,"stat_sum":{"num_bytes":40611840,"num_objects":37,"num_object_clones":4,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":25,"num_read":9971,"num_read_kb":74614,"num_write":697,"num_write_kb":20031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":31416461,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"12","length":"7"}]},{"pgid":"3.1c","version":"137'716","reported_seq":6102,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:09.035288+0000","last_change":"2024-09-14T09:10:08.928723+0000","last_active":"2024-09-14T09:10:09.035288+0000","last_peered":"2024-09-14T09:10:09.035288+0000","last_clean":"2024-09-14T09:10:09.035288+0000","last_became_active":"2024-09-14T09:09:56.796539+0000","last_became_peered":"2024-09-14T09:09:56.796539+0000","last_unstale":"2024-09-14T09:10:09.035288+0000","last_undegraded":"2024-09-14T09:10:09.035288+0000","last_fullsized":"2024-09-14T09:10:09.035288+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:20:46.752016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040628909999999999,"stat_sum":{"num_bytes":1982725,"num_objects":45,"num_object_clones":2,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":37,"num_read":7449,"num_read_kb":20706,"num_write":737,"num_write_kb":12454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":287,"num_bytes_recovered":2849546,"num_keys_recovered":242,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"12","length":"7"}]},{"pgid":"3.1b","version":"136'712","reported_seq":5908,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.019015+0000","last_change":"2024-09-14T09:10:07.914011+0000","last_active":"2024-09-14T09:10:08.019015+0000","last_peered":"2024-09-14T09:10:08.019015+0000","last_clean":"2024-09-14T09:10:08.019015+0000","last_became_active":"2024-09-14T09:09:03.794248+0000","last_became_peered":"2024-09-14T09:09:03.794248+0000","last_unstale":"2024-09-14T09:10:08.019015+0000","last_undegraded":"2024-09-14T09:10:08.019015+0000","last_fullsized":"2024-09-14T09:10:08.019015+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:56.439858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000448582,"stat_sum":{"num_bytes":25712128,"num_objects":39,"num_object_clones":6,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":26,"num_read":6852,"num_read_kb":42483,"num_write":955,"num_write_kb":14378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":16991946,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"13","length":"6"}]},{"pgid":"3.1a","version":"136'1067","reported_seq":45682,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:09.017716+0000","last_change":"2024-09-14T09:10:08.924974+0000","last_active":"2024-09-14T09:10:09.017716+0000","last_peered":"2024-09-14T09:10:09.017716+0000","last_clean":"2024-09-14T09:10:09.017716+0000","last_became_active":"2024-09-14T09:09:57.796692+0000","last_became_peered":"2024-09-14T09:09:57.796692+0000","last_unstale":"2024-09-14T09:10:09.017716+0000","last_undegraded":"2024-09-14T09:10:09.017716+0000","last_fullsized":"2024-09-14T09:10:09.017716+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:02.597820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096902499999999999,"stat_sum":{"num_bytes":15924299,"num_objects":34,"num_object_clones":1,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":23,"num_read":46191,"num_read_kb":91998,"num_write":1007,"num_write_kb":40125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":293,"num_bytes_recovered":16835297,"num_keys_recovered":71,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"12","length":"7"}]},{"pgid":"3.19","version":"136'510","reported_seq":8331,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.071673+0000","last_change":"2024-09-14T09:10:07.919170+0000","last_active":"2024-09-14T09:10:08.071673+0000","last_peered":"2024-09-14T09:10:08.071673+0000","last_clean":"2024-09-14T09:10:08.071673+0000","last_became_active":"2024-09-14T09:07:45.291261+0000","last_became_peered":"2024-09-14T09:07:45.291261+0000","last_unstale":"2024-09-14T09:10:08.071673+0000","last_undegraded":"2024-09-14T09:10:08.071673+0000","last_fullsized":"2024-09-14T09:10:08.071673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:35.995865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069628300000000001,"stat_sum":{"num_bytes":17034240,"num_objects":44,"num_object_clones":5,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":31,"num_read":8055,"num_read_kb":52380,"num_write":650,"num_write_kb":14132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"13","length":"6"}]},{"pgid":"3.18","version":"136'782","reported_seq":6075,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.010375+0000","last_change":"2024-09-14T09:10:07.919696+0000","last_active":"2024-09-14T09:10:08.010375+0000","last_peered":"2024-09-14T09:10:08.010375+0000","last_clean":"2024-09-14T09:10:08.010375+0000","last_became_active":"2024-09-14T09:07:45.290340+0000","last_became_peered":"2024-09-14T09:07:45.290340+0000","last_unstale":"2024-09-14T09:10:08.010375+0000","last_undegraded":"2024-09-14T09:10:08.010375+0000","last_fullsized":"2024-09-14T09:10:08.010375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:30.639688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010730640000000001,"stat_sum":{"num_bytes":3983360,"num_objects":30,"num_object_clones":2,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":21,"num_read":7244,"num_read_kb":25042,"num_write":1074,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"13","length":"6"}]},{"pgid":"3.17","version":"136'839","reported_seq":71901,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.928020+0000","last_change":"2024-09-14T09:10:08.928312+0000","last_active":"2024-09-14T09:10:08.928020+0000","last_peered":"2024-09-14T09:10:08.928020+0000","last_clean":"2024-09-14T09:10:08.928020+0000","last_became_active":"2024-09-14T09:09:56.796736+0000","last_became_peered":"2024-09-14T09:09:56.796736+0000","last_unstale":"2024-09-14T09:10:08.928020+0000","last_undegraded":"2024-09-14T09:10:08.928020+0000","last_fullsized":"2024-09-14T09:10:08.928020+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:57.086420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003662902,"stat_sum":{"num_bytes":24026654,"num_objects":37,"num_object_clones":3,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":29,"num_read":74377,"num_read_kb":113722,"num_write":987,"num_write_kb":72684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":30088824,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"12","length":"7"}]},{"pgid":"3.16","version":"136'536","reported_seq":21520,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-14T09:10:07.914264+0000","last_change":"2024-09-14T09:10:07.914264+0000","last_active":"2024-09-14T09:10:07.914264+0000","last_peered":"2024-09-14T09:10:07.914264+0000","last_clean":"2024-09-14T09:10:07.914264+0000","last_became_active":"2024-09-14T09:09:56.794357+0000","last_became_peered":"2024-09-14T09:09:56.794357+0000","last_unstale":"2024-09-14T09:10:07.914264+0000","last_undegraded":"2024-09-14T09:10:07.914264+0000","last_fullsized":"2024-09-14T09:10:07.914264+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:51:22.422917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041124299999999999,"stat_sum":{"num_bytes":17318912,"num_objects":42,"num_object_clones":6,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":32,"num_read":21018,"num_read_kb":58767,"num_write":566,"num_write_kb":35397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":7392256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"13","length":"6"}]},{"pgid":"3.15","version":"133'881","reported_seq":56791,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-14T09:10:06.796648+0000","last_change":"2024-09-14T09:10:06.796911+0000","last_active":"2024-09-14T09:10:06.796648+0000","last_peered":"2024-09-14T09:10:06.796648+0000","last_clean":"2024-09-14T09:10:06.796648+0000","last_became_active":"2024-09-14T09:07:45.293650+0000","last_became_peered":"2024-09-14T09:07:45.293650+0000","last_unstale":"2024-09-14T09:10:06.796648+0000","last_undegraded":"2024-09-14T09:10:06.796648+0000","last_fullsized":"2024-09-14T09:10:06.796648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:07.505704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058763100000000003,"stat_sum":{"num_bytes":7444565,"num_objects":43,"num_object_clones":4,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":29,"num_read":27355,"num_read_kb":68429,"num_write":731,"num_write_kb":21024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"14","length":"5"}]},{"pgid":"3.14","version":"136'618","reported_seq":6011,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.925564+0000","last_change":"2024-09-14T09:10:08.925980+0000","last_active":"2024-09-14T09:10:08.925564+0000","last_peered":"2024-09-14T09:10:08.925564+0000","last_clean":"2024-09-14T09:10:08.925564+0000","last_became_active":"2024-09-14T09:09:19.878805+0000","last_became_peered":"2024-09-14T09:09:19.878805+0000","last_unstale":"2024-09-14T09:10:08.925564+0000","last_undegraded":"2024-09-14T09:10:08.925564+0000","last_fullsized":"2024-09-14T09:10:08.925564+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:11:01.014042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017022179999999999,"stat_sum":{"num_bytes":12364816,"num_objects":35,"num_object_clones":3,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":27,"num_read":7586,"num_read_kb":24393,"num_write":593,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":4454614,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"12","length":"7"}]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.924841+0000","last_change":"2024-09-14T09:08:59.862372+0000","last_active":"2024-09-14T09:10:08.924841+0000","last_peered":"2024-09-14T09:10:08.924841+0000","last_clean":"2024-09-14T09:10:08.924841+0000","last_became_active":"2024-09-14T09:08:59.862110+0000","last_became_peered":"2024-09-14T09:08:59.862110+0000","last_unstale":"2024-09-14T09:10:08.924841+0000","last_undegraded":"2024-09-14T09:10:08.924841+0000","last_fullsized":"2024-09-14T09:10:08.924841+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:19.095016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061552199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"136'625","reported_seq":5039,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.071115+0000","last_change":"2024-09-14T09:10:07.920068+0000","last_active":"2024-09-14T09:10:08.071115+0000","last_peered":"2024-09-14T09:10:08.071115+0000","last_clean":"2024-09-14T09:10:08.071115+0000","last_became_active":"2024-09-14T09:07:45.290675+0000","last_became_peered":"2024-09-14T09:07:45.290675+0000","last_unstale":"2024-09-14T09:10:08.071115+0000","last_undegraded":"2024-09-14T09:10:08.071115+0000","last_fullsized":"2024-09-14T09:10:08.071115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:00.632323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001364121,"stat_sum":{"num_bytes":7371813,"num_objects":46,"num_object_clones":4,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":35,"num_read":6583,"num_read_kb":15366,"num_write":495,"num_write_kb":3571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"13","length":"6"}]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-14T09:10:07.918757+0000","last_change":"2024-09-14T09:08:28.924279+0000","last_active":"2024-09-14T09:10:07.918757+0000","last_peered":"2024-09-14T09:10:07.918757+0000","last_clean":"2024-09-14T09:10:07.918757+0000","last_became_active":"2024-09-14T09:08:28.923956+0000","last_became_peered":"2024-09-14T09:08:28.923956+0000","last_unstale":"2024-09-14T09:10:07.918757+0000","last_undegraded":"2024-09-14T09:10:07.918757+0000","last_fullsized":"2024-09-14T09:10:07.918757+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:10:28.827669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042190199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"136'700","reported_seq":8168,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.004012+0000","last_change":"2024-09-14T09:10:07.920420+0000","last_active":"2024-09-14T09:10:08.004012+0000","last_peered":"2024-09-14T09:10:08.004012+0000","last_clean":"2024-09-14T09:10:08.004012+0000","last_became_active":"2024-09-14T09:07:45.290313+0000","last_became_peered":"2024-09-14T09:07:45.290313+0000","last_unstale":"2024-09-14T09:10:08.004012+0000","last_undegraded":"2024-09-14T09:10:08.004012+0000","last_fullsized":"2024-09-14T09:10:08.004012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":700,"log_dups_size":0,"ondisk_log_size":700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:40.994308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014722590000000001,"stat_sum":{"num_bytes":9114708,"num_objects":38,"num_object_clones":3,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":28,"num_read":8982,"num_read_kb":43357,"num_write":812,"num_write_kb":5614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"13","length":"6"}]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.924393+0000","last_change":"2024-09-14T09:08:59.862420+0000","last_active":"2024-09-14T09:10:08.924393+0000","last_peered":"2024-09-14T09:10:08.924393+0000","last_clean":"2024-09-14T09:10:08.924393+0000","last_became_active":"2024-09-14T09:08:59.862144+0000","last_became_peered":"2024-09-14T09:08:59.862144+0000","last_unstale":"2024-09-14T09:10:08.924393+0000","last_undegraded":"2024-09-14T09:10:08.924393+0000","last_fullsized":"2024-09-14T09:10:08.924393+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:46.664994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"136'1006","reported_seq":6551,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.026611+0000","last_change":"2024-09-14T09:10:07.919816+0000","last_active":"2024-09-14T09:10:08.026611+0000","last_peered":"2024-09-14T09:10:08.026611+0000","last_clean":"2024-09-14T09:10:08.026611+0000","last_became_active":"2024-09-14T09:09:56.797889+0000","last_became_peered":"2024-09-14T09:09:56.797889+0000","last_unstale":"2024-09-14T09:10:08.026611+0000","last_undegraded":"2024-09-14T09:10:08.026611+0000","last_fullsized":"2024-09-14T09:10:08.026611+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1006,"log_dups_size":0,"ondisk_log_size":1006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:03.575033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001155803,"stat_sum":{"num_bytes":3383808,"num_objects":48,"num_object_clones":6,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":36,"num_read":7917,"num_read_kb":40050,"num_write":1435,"num_write_kb":11556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":7127704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"13","length":"6"}]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.916956+0000","last_change":"2024-09-14T09:09:53.824239+0000","last_active":"2024-09-14T09:10:08.916956+0000","last_peered":"2024-09-14T09:10:08.916956+0000","last_clean":"2024-09-14T09:10:08.916956+0000","last_became_active":"2024-09-14T09:09:53.823821+0000","last_became_peered":"2024-09-14T09:09:53.823821+0000","last_unstale":"2024-09-14T09:10:08.916956+0000","last_undegraded":"2024-09-14T09:10:08.916956+0000","last_fullsized":"2024-09-14T09:10:08.916956+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:52.230246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"133'763","reported_seq":9492,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.921772+0000","last_change":"2024-09-14T09:10:08.922482+0000","last_active":"2024-09-14T09:10:08.921772+0000","last_peered":"2024-09-14T09:10:08.921772+0000","last_clean":"2024-09-14T09:10:08.921772+0000","last_became_active":"2024-09-14T09:09:19.870716+0000","last_became_peered":"2024-09-14T09:09:19.870716+0000","last_unstale":"2024-09-14T09:10:08.921772+0000","last_undegraded":"2024-09-14T09:10:08.921772+0000","last_fullsized":"2024-09-14T09:10:08.921772+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:34:20.865584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047227770000000001,"stat_sum":{"num_bytes":22270140,"num_objects":50,"num_object_clones":5,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":31,"num_read":11440,"num_read_kb":51086,"num_write":676,"num_write_kb":9345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":2441232,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"12","length":"7"}]},{"pgid":"3.3","version":"137'1446","reported_seq":11010,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:09.032536+0000","last_change":"2024-09-14T09:10:08.921717+0000","last_active":"2024-09-14T09:10:09.032536+0000","last_peered":"2024-09-14T09:10:09.032536+0000","last_clean":"2024-09-14T09:10:09.032536+0000","last_became_active":"2024-09-14T09:09:19.869813+0000","last_became_peered":"2024-09-14T09:09:19.869813+0000","last_unstale":"2024-09-14T09:10:09.032536+0000","last_undegraded":"2024-09-14T09:10:09.032536+0000","last_fullsized":"2024-09-14T09:10:09.032536+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1446,"log_dups_size":0,"ondisk_log_size":1446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:37.555336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040478190000000002,"stat_sum":{"num_bytes":6053603,"num_objects":42,"num_object_clones":3,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":31,"num_read":15979,"num_read_kb":41345,"num_write":1853,"num_write_kb":7136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":2340129,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"12","length":"7"}]},{"pgid":"2.2","version":"20'2","reported_seq":253,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-14T09:10:06.796181+0000","last_change":"2024-09-14T09:07:37.260986+0000","last_active":"2024-09-14T09:10:06.796181+0000","last_peered":"2024-09-14T09:10:06.796181+0000","last_clean":"2024-09-14T09:10:06.796181+0000","last_became_active":"2024-09-14T09:07:35.254256+0000","last_became_peered":"2024-09-14T09:07:35.254256+0000","last_unstale":"2024-09-14T09:10:06.796181+0000","last_undegraded":"2024-09-14T09:10:06.796181+0000","last_fullsized":"2024-09-14T09:10:06.796181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:07.063058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096898500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"136'444","reported_seq":10322,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.917996+0000","last_change":"2024-09-14T09:10:08.918638+0000","last_active":"2024-09-14T09:10:08.917996+0000","last_peered":"2024-09-14T09:10:08.917996+0000","last_clean":"2024-09-14T09:10:08.917996+0000","last_became_active":"2024-09-14T09:09:56.794121+0000","last_became_peered":"2024-09-14T09:09:56.794121+0000","last_unstale":"2024-09-14T09:10:08.917996+0000","last_undegraded":"2024-09-14T09:10:08.917996+0000","last_fullsized":"2024-09-14T09:10:08.917996+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:30.793314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001485005,"stat_sum":{"num_bytes":12422214,"num_objects":36,"num_object_clones":6,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":20,"num_read":9580,"num_read_kb":58824,"num_write":511,"num_write_kb":14686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":8152899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"12","length":"7"}]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-14T09:10:07.918331+0000","last_change":"2024-09-14T09:09:53.819797+0000","last_active":"2024-09-14T09:10:07.918331+0000","last_peered":"2024-09-14T09:10:07.918331+0000","last_clean":"2024-09-14T09:10:07.918331+0000","last_became_active":"2024-09-14T09:09:53.819493+0000","last_became_peered":"2024-09-14T09:09:53.819493+0000","last_unstale":"2024-09-14T09:10:07.918331+0000","last_undegraded":"2024-09-14T09:10:07.918331+0000","last_fullsized":"2024-09-14T09:10:07.918331+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:29:18.869446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"136'755","reported_seq":6430,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.069244+0000","last_change":"2024-09-14T09:10:07.919364+0000","last_active":"2024-09-14T09:10:08.069244+0000","last_peered":"2024-09-14T09:10:08.069244+0000","last_clean":"2024-09-14T09:10:08.069244+0000","last_became_active":"2024-09-14T09:08:30.922755+0000","last_became_peered":"2024-09-14T09:08:30.922755+0000","last_unstale":"2024-09-14T09:10:08.069244+0000","last_undegraded":"2024-09-14T09:10:08.069244+0000","last_fullsized":"2024-09-14T09:10:08.069244+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:20.111635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084000800000000005,"stat_sum":{"num_bytes":35331108,"num_objects":35,"num_object_clones":4,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":23,"num_read":7599,"num_read_kb":31774,"num_write":874,"num_write_kb":10923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":49,"num_bytes_recovered":230948,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"13","length":"6"}]},{"pgid":"2.0","version":"0'0","reported_seq":222,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.916955+0000","last_change":"2024-09-14T09:09:53.824803+0000","last_active":"2024-09-14T09:10:08.916955+0000","last_peered":"2024-09-14T09:10:08.916955+0000","last_clean":"2024-09-14T09:10:08.916955+0000","last_became_active":"2024-09-14T09:09:53.824503+0000","last_became_peered":"2024-09-14T09:09:53.824503+0000","last_unstale":"2024-09-14T09:10:08.916955+0000","last_undegraded":"2024-09-14T09:10:08.916955+0000","last_fullsized":"2024-09-14T09:10:08.916955+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:00.876142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"137'421","reported_seq":1942,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:09.012257+0000","last_change":"2024-09-14T09:10:08.921761+0000","last_active":"2024-09-14T09:10:09.012257+0000","last_peered":"2024-09-14T09:10:09.012257+0000","last_clean":"2024-09-14T09:10:09.012257+0000","last_became_active":"2024-09-14T09:09:16.794591+0000","last_became_peered":"2024-09-14T09:09:16.794591+0000","last_unstale":"2024-09-14T09:10:09.012257+0000","last_undegraded":"2024-09-14T09:10:09.012257+0000","last_fullsized":"2024-09-14T09:10:09.012257+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:13.005438+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0042742680000000003,"stat_sum":{"num_bytes":33625120,"num_objects":45,"num_object_clones":6,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":33,"num_read":3109,"num_read_kb":25089,"num_write":388,"num_write_kb":10842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":1975296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"12","length":"7"}]},{"pgid":"2.3","version":"18'1","reported_seq":141,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.924189+0000","last_change":"2024-09-14T09:09:17.798249+0000","last_active":"2024-09-14T09:10:08.924189+0000","last_peered":"2024-09-14T09:10:08.924189+0000","last_clean":"2024-09-14T09:10:08.924189+0000","last_became_active":"2024-09-14T09:09:17.797925+0000","last_became_peered":"2024-09-14T09:09:17.797925+0000","last_unstale":"2024-09-14T09:10:08.924189+0000","last_undegraded":"2024-09-14T09:10:08.924189+0000","last_fullsized":"2024-09-14T09:10:08.924189+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:22.149422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":151,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.923888+0000","last_change":"2024-09-14T09:09:53.842602+0000","last_active":"2024-09-14T09:10:08.923888+0000","last_peered":"2024-09-14T09:10:08.923888+0000","last_clean":"2024-09-14T09:10:08.923888+0000","last_became_active":"2024-09-14T09:09:53.826122+0000","last_became_peered":"2024-09-14T09:09:53.826122+0000","last_unstale":"2024-09-14T09:10:08.923888+0000","last_undegraded":"2024-09-14T09:10:08.923888+0000","last_fullsized":"2024-09-14T09:10:08.923888+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_clean_scrub_stamp":"2024-09-14T09:07:29.211432+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:23:08.636902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"136'637","reported_seq":9352,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.013467+0000","last_change":"2024-09-14T09:10:07.920147+0000","last_active":"2024-09-14T09:10:08.013467+0000","last_peered":"2024-09-14T09:10:08.013467+0000","last_clean":"2024-09-14T09:10:08.013467+0000","last_became_active":"2024-09-14T09:08:33.788711+0000","last_became_peered":"2024-09-14T09:08:33.788711+0000","last_unstale":"2024-09-14T09:10:08.013467+0000","last_undegraded":"2024-09-14T09:10:08.013467+0000","last_fullsized":"2024-09-14T09:10:08.013467+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:08.267308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012614639999999999,"stat_sum":{"num_bytes":27441717,"num_objects":43,"num_object_clones":2,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":28,"num_read":10685,"num_read_kb":52437,"num_write":534,"num_write_kb":14203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":2555973,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"13","length":"6"}]},{"pgid":"3.9","version":"136'512","reported_seq":6856,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.006529+0000","last_change":"2024-09-14T09:10:07.914014+0000","last_active":"2024-09-14T09:10:08.006529+0000","last_peered":"2024-09-14T09:10:08.006529+0000","last_clean":"2024-09-14T09:10:08.006529+0000","last_became_active":"2024-09-14T09:09:16.800864+0000","last_became_peered":"2024-09-14T09:09:16.800864+0000","last_unstale":"2024-09-14T09:10:08.006529+0000","last_undegraded":"2024-09-14T09:10:08.006529+0000","last_fullsized":"2024-09-14T09:10:08.006529+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:29.940182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057340099999999997,"stat_sum":{"num_bytes":44904960,"num_objects":50,"num_object_clones":7,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":34,"num_read":5991,"num_read_kb":50679,"num_write":467,"num_write_kb":15575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":3599888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"13","length":"6"}]},{"pgid":"3.a","version":"134'884","reported_seq":8005,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-14T09:10:06.796930+0000","last_change":"2024-09-14T09:10:06.797198+0000","last_active":"2024-09-14T09:10:06.796930+0000","last_peered":"2024-09-14T09:10:06.796930+0000","last_clean":"2024-09-14T09:10:06.796930+0000","last_became_active":"2024-09-14T09:09:02.793112+0000","last_became_peered":"2024-09-14T09:09:02.793112+0000","last_unstale":"2024-09-14T09:10:06.796930+0000","last_undegraded":"2024-09-14T09:10:06.796930+0000","last_fullsized":"2024-09-14T09:10:06.796930+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:36:09.033845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077852399999999995,"stat_sum":{"num_bytes":17982634,"num_objects":51,"num_object_clones":3,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":36,"num_read":8962,"num_read_kb":44845,"num_write":1073,"num_write_kb":15904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":9779638,"num_keys_recovered":46,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"14","length":"5"}]},{"pgid":"3.b","version":"136'440","reported_seq":5095,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.019738+0000","last_change":"2024-09-14T09:10:07.919450+0000","last_active":"2024-09-14T09:10:08.019738+0000","last_peered":"2024-09-14T09:10:08.019738+0000","last_clean":"2024-09-14T09:10:08.019738+0000","last_became_active":"2024-09-14T09:08:30.922780+0000","last_became_peered":"2024-09-14T09:08:30.922780+0000","last_unstale":"2024-09-14T09:10:08.019738+0000","last_undegraded":"2024-09-14T09:10:08.019738+0000","last_fullsized":"2024-09-14T09:10:08.019738+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:37.664295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091094400000000001,"stat_sum":{"num_bytes":7484576,"num_objects":44,"num_object_clones":4,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":29,"num_read":4722,"num_read_kb":18672,"num_write":463,"num_write_kb":6044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":540832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"13","length":"6"}]},{"pgid":"3.c","version":"136'962","reported_seq":17415,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.924348+0000","last_change":"2024-09-14T09:10:08.925276+0000","last_active":"2024-09-14T09:10:08.924348+0000","last_peered":"2024-09-14T09:10:08.924348+0000","last_clean":"2024-09-14T09:10:08.924348+0000","last_became_active":"2024-09-14T09:09:03.794861+0000","last_became_peered":"2024-09-14T09:09:03.794861+0000","last_unstale":"2024-09-14T09:10:08.924348+0000","last_undegraded":"2024-09-14T09:10:08.924348+0000","last_fullsized":"2024-09-14T09:10:08.924348+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:00.200129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012958010000000001,"stat_sum":{"num_bytes":19673600,"num_objects":39,"num_object_clones":5,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":30,"num_read":13865,"num_read_kb":46941,"num_write":934,"num_write_kb":9955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":13533184,"num_keys_recovered":116,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"12","length":"7"}]},{"pgid":"3.d","version":"136'507","reported_seq":21116,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.927601+0000","last_change":"2024-09-14T09:10:08.927945+0000","last_active":"2024-09-14T09:10:08.927601+0000","last_peered":"2024-09-14T09:10:08.927601+0000","last_clean":"2024-09-14T09:10:08.927601+0000","last_became_active":"2024-09-14T09:09:03.794231+0000","last_became_peered":"2024-09-14T09:09:03.794231+0000","last_unstale":"2024-09-14T09:10:08.927601+0000","last_undegraded":"2024-09-14T09:10:08.927601+0000","last_fullsized":"2024-09-14T09:10:08.927601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:14.287999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033850830000000001,"stat_sum":{"num_bytes":33127936,"num_objects":43,"num_object_clones":2,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":33,"num_read":21382,"num_read_kb":52622,"num_write":618,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":140,"num_bytes_recovered":16325120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"12","length":"7"}]},{"pgid":"3.e","version":"137'538","reported_seq":3742,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.920752+0000","last_change":"2024-09-14T09:10:08.920997+0000","last_active":"2024-09-14T09:10:08.920752+0000","last_peered":"2024-09-14T09:10:08.920752+0000","last_clean":"2024-09-14T09:10:08.920752+0000","last_became_active":"2024-09-14T09:09:56.793875+0000","last_became_peered":"2024-09-14T09:09:56.793875+0000","last_unstale":"2024-09-14T09:10:08.920752+0000","last_undegraded":"2024-09-14T09:10:08.920752+0000","last_fullsized":"2024-09-14T09:10:08.920752+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:33.252842+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0038842680000000002,"stat_sum":{"num_bytes":13872128,"num_objects":54,"num_object_clones":9,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":37,"num_read":5433,"num_read_kb":39557,"num_write":467,"num_write_kb":12186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":263,"num_bytes_recovered":15375904,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"12","length":"7"}]},{"pgid":"3.f","version":"137'377","reported_seq":3495,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.929628+0000","last_change":"2024-09-14T09:10:08.929906+0000","last_active":"2024-09-14T09:10:08.929628+0000","last_peered":"2024-09-14T09:10:08.929628+0000","last_clean":"2024-09-14T09:10:08.929628+0000","last_became_active":"2024-09-14T09:09:02.795740+0000","last_became_peered":"2024-09-14T09:09:02.795740+0000","last_unstale":"2024-09-14T09:10:08.929628+0000","last_undegraded":"2024-09-14T09:10:08.929628+0000","last_fullsized":"2024-09-14T09:10:08.929628+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:10.398082+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0050675709999999999,"stat_sum":{"num_bytes":1327155,"num_objects":40,"num_object_clones":5,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":31,"num_read":2152,"num_read_kb":13855,"num_write":336,"num_write_kb":3973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":1385641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"12","length":"7"}]},{"pgid":"3.10","version":"136'553","reported_seq":9850,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.925326+0000","last_change":"2024-09-14T09:10:08.925688+0000","last_active":"2024-09-14T09:10:08.925326+0000","last_peered":"2024-09-14T09:10:08.925326+0000","last_clean":"2024-09-14T09:10:08.925326+0000","last_became_active":"2024-09-14T09:09:56.797780+0000","last_became_peered":"2024-09-14T09:09:56.797780+0000","last_unstale":"2024-09-14T09:10:08.925326+0000","last_undegraded":"2024-09-14T09:10:08.925326+0000","last_fullsized":"2024-09-14T09:10:08.925326+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:08:14.751608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001609145,"stat_sum":{"num_bytes":1425450,"num_objects":41,"num_object_clones":4,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":33,"num_read":9679,"num_read_kb":41429,"num_write":700,"num_write_kb":14542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":265,"num_bytes_recovered":6681771,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"12","length":"7"}]},{"pgid":"3.11","version":"137'781","reported_seq":9954,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.927569+0000","last_change":"2024-09-14T09:10:08.927920+0000","last_active":"2024-09-14T09:10:08.927569+0000","last_peered":"2024-09-14T09:10:08.927569+0000","last_clean":"2024-09-14T09:10:08.927569+0000","last_became_active":"2024-09-14T09:09:02.793611+0000","last_became_peered":"2024-09-14T09:09:02.793611+0000","last_unstale":"2024-09-14T09:10:08.927569+0000","last_undegraded":"2024-09-14T09:10:08.927569+0000","last_fullsized":"2024-09-14T09:10:08.927569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:15:27.457992+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.003574645,"stat_sum":{"num_bytes":20885730,"num_objects":47,"num_object_clones":5,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":33,"num_read":12558,"num_read_kb":58671,"num_write":659,"num_write_kb":13820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":10373286,"num_keys_recovered":102,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"12","length":"7"}]},{"pgid":"3.12","version":"136'470","reported_seq":4828,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.918715+0000","last_change":"2024-09-14T09:10:08.919404+0000","last_active":"2024-09-14T09:10:08.918715+0000","last_peered":"2024-09-14T09:10:08.918715+0000","last_clean":"2024-09-14T09:10:08.918715+0000","last_became_active":"2024-09-14T09:09:56.793725+0000","last_became_peered":"2024-09-14T09:09:56.793725+0000","last_unstale":"2024-09-14T09:10:08.918715+0000","last_undegraded":"2024-09-14T09:10:08.918715+0000","last_fullsized":"2024-09-14T09:10:08.918715+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:28.913442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021857869999999998,"stat_sum":{"num_bytes":23954432,"num_objects":41,"num_object_clones":3,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":34,"num_read":3997,"num_read_kb":34359,"num_write":403,"num_write_kb":6924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":2955870,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"12","length":"7"}]},{"pgid":"3.13","version":"136'2163","reported_seq":8844,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-14T09:10:08.925058+0000","last_change":"2024-09-14T09:10:08.925510+0000","last_active":"2024-09-14T09:10:08.925058+0000","last_peered":"2024-09-14T09:10:08.925058+0000","last_clean":"2024-09-14T09:10:08.925058+0000","last_became_active":"2024-09-14T09:09:03.794283+0000","last_became_peered":"2024-09-14T09:09:03.794283+0000","last_unstale":"2024-09-14T09:10:08.925058+0000","last_undegraded":"2024-09-14T09:10:08.925058+0000","last_fullsized":"2024-09-14T09:10:08.925058+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":2163,"log_dups_size":0,"ondisk_log_size":2163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:51:56.848842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001509505,"stat_sum":{"num_bytes":14252560,"num_objects":34,"num_object_clones":5,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":22,"num_read":16537,"num_read_kb":44941,"num_write":3376,"num_write_kb":14843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":4151803,"num_keys_recovered":53,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"12","length":"7"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":544089427,"num_objects":1332,"num_object_clones":134,"num_object_copies":2664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1332,"num_whiteouts":953,"num_read":417221,"num_read_kb":1456715,"num_write":26459,"num_write_kb":494019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4517,"num_bytes_recovered":245332814,"num_keys_recovered":856,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":136351744,"data_stored":166771957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12266,"internal_metadata":0},"log_size":23484,"ondisk_log_size":23484,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":87,"seq":373662154764,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56772,"kb_used_data":19532,"kb_used_omap":24,"kb_used_meta":37159,"kb_avail":94315068,"statfs":{"total":96636764160,"available":96578629632,"internally_reserved":0,"allocated":20000768,"data_stored":21552400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24922,"internal_metadata":38051494},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101960,"kb_used_data":26340,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94269880,"statfs":{"total":96636764160,"available":96532357120,"internally_reserved":0,"allocated":26972160,"data_stored":30548265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":0,"seq":51539607587,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607589,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61096,"kb_used_data":16016,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94310744,"statfs":{"total":96636764160,"available":96574201856,"internally_reserved":0,"allocated":16400384,"data_stored":18029180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607587,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79812,"kb_used_data":26412,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94292028,"statfs":{"total":96636764160,"available":96555036672,"internally_reserved":0,"allocated":27045888,"data_stored":32577229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640291,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79324,"kb_used_data":3720,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94292516,"statfs":{"total":96636764160,"available":96555536384,"internally_reserved":0,"allocated":3809280,"data_stored":3508498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2203648,"data_stored":2840847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24338432,"data_stored":28662151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17498112,"data_stored":19994133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12266,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23588864,"data_stored":30170063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":13537280,"data_stored":16210643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":55185408,"data_stored":68894120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T09:10:12.212 INFO:tasks.thrashosds.thrasher:Setting 2.4 to [0, 3] 2024-09-14T09:10:12.212 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '2.4', '0', '3'] 2024-09-14T09:10:12.212 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 2.4 0 3 2024-09-14T09:10:12.228 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:12.230+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:12.273 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:12.273 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:12.273 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:10:12.273 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:12.283 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:10:12.330 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:12.332+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:12.430 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:12.433+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:12.471 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:12.471 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:12.472 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:10:12.472 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:10:12.472 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:12.483 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:10:12.531 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:12.533+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:12.587 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:12.587 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:10:12.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:10:12.588 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:10:12.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.588 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2265 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4034560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:12.588 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:10:12.588 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.726271287000003, 2024-09-14T09:10:12.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073974829000000006, 2024-09-14T09:10:12.588 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.588 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.588 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.588 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.588 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:12.588 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:12.589 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2265 2024-09-14T09:10:12.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.589 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:10:12.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:10:12.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862542+0000", 2024-09-14T09:10:12.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:10:12.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862543+0000", 2024-09-14T09:10:12.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.81e-06 2024-09-14T09:10:12.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862549+0000", 2024-09-14T09:10:12.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8850000000000004e-06 2024-09-14T09:10:12.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862554+0000", 2024-09-14T09:10:12.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5279999999999997e-06 2024-09-14T09:10:12.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936318+0000", 2024-09-14T09:10:12.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073764422999999996 2024-09-14T09:10:12.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936412+0000", 2024-09-14T09:10:12.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3801000000000005e-05 2024-09-14T09:10:12.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936516+0000", 2024-09-14T09:10:12.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000104007 2024-09-14T09:10:12.592 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.592 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.592 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.593 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2266 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4096000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:12.593 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:10:12.593 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.726253423000003, 2024-09-14T09:10:12.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074208332000000002, 2024-09-14T09:10:12.593 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.593 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.593 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.593 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.593 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:12.593 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:12.593 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2266 2024-09-14T09:10:12.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.593 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:10:12.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:10:12.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862738+0000", 2024-09-14T09:10:12.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017920300000000001 2024-09-14T09:10:12.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862744+0000", 2024-09-14T09:10:12.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3000000000000001e-06 2024-09-14T09:10:12.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862753+0000", 2024-09-14T09:10:12.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8179999999999999e-06 2024-09-14T09:10:12.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862785+0000", 2024-09-14T09:10:12.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1949000000000002e-05 2024-09-14T09:10:12.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936556+0000", 2024-09-14T09:10:12.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073770268999999999 2024-09-14T09:10:12.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936657+0000", 2024-09-14T09:10:12.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101387 2024-09-14T09:10:12.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936767+0000", 2024-09-14T09:10:12.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110406 2024-09-14T09:10:12.597 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.597 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.597 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.597 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2267 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4157440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:12.597 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:10:12.597 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.726014840999994, 2024-09-14T09:10:12.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074200918000000005, 2024-09-14T09:10:12.597 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.598 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.598 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.598 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.598 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:12.598 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:12.598 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2267 2024-09-14T09:10:12.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.598 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:10:12.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:10:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863416+0000", 2024-09-14T09:10:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000618492 2024-09-14T09:10:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863421+0000", 2024-09-14T09:10:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1359999999999996e-06 2024-09-14T09:10:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863434+0000", 2024-09-14T09:10:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2291e-05 2024-09-14T09:10:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863444+0000", 2024-09-14T09:10:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9769999999999995e-06 2024-09-14T09:10:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936808+0000", 2024-09-14T09:10:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073364051999999999 2024-09-14T09:10:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936892+0000", 2024-09-14T09:10:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4641999999999994e-05 2024-09-14T09:10:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936999+0000", 2024-09-14T09:10:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106328 2024-09-14T09:10:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2329 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 106496~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:10:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.725286232000002, 2024-09-14T09:10:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074180251000000003, 2024-09-14T09:10:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2329 2024-09-14T09:10:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:10:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:10:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864203+0000", 2024-09-14T09:10:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000677015 2024-09-14T09:10:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864208+0000", 2024-09-14T09:10:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.972e-06 2024-09-14T09:10:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864221+0000", 2024-09-14T09:10:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2683e-05 2024-09-14T09:10:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864229+0000", 2024-09-14T09:10:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0809999999999994e-06 2024-09-14T09:10:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937430+0000", 2024-09-14T09:10:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073201231000000005 2024-09-14T09:10:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937513+0000", 2024-09-14T09:10:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2652999999999996e-05 2024-09-14T09:10:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937707+0000", 2024-09-14T09:10:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000193616 2024-09-14T09:10:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2331 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 229376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:10:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.724468735000002, 2024-09-14T09:10:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.07400843, 2024-09-14T09:10:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2331 2024-09-14T09:10:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:10:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:10:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868104+0000", 2024-09-14T09:10:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003760453 2024-09-14T09:10:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868109+0000", 2024-09-14T09:10:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9339999999999997e-06 2024-09-14T09:10:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868119+0000", 2024-09-14T09:10:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5389999999999996e-06 2024-09-14T09:10:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868126+0000", 2024-09-14T09:10:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4499999999999998e-06 2024-09-14T09:10:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938065+0000", 2024-09-14T09:10:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069938809000000005 2024-09-14T09:10:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938148+0000", 2024-09-14T09:10:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3171999999999996e-05 2024-09-14T09:10:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938352+0000", 2024-09-14T09:10:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020407300000000001 2024-09-14T09:10:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2380 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3239936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:10:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.709443707000005, 2024-09-14T09:10:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073985913, 2024-09-14T09:10:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2380 2024-09-14T09:10:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:10:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:10:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879697+0000", 2024-09-14T09:10:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032864100000000001 2024-09-14T09:10:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879702+0000", 2024-09-14T09:10:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.578e-06 2024-09-14T09:10:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879716+0000", 2024-09-14T09:10:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.413e-05 2024-09-14T09:10:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879724+0000", 2024-09-14T09:10:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.559e-06 2024-09-14T09:10:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953155+0000", 2024-09-14T09:10:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073431221000000005 2024-09-14T09:10:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953247+0000", 2024-09-14T09:10:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1662000000000004e-05 2024-09-14T09:10:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953355+0000", 2024-09-14T09:10:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010812200000000001 2024-09-14T09:10:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2501 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2850816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:10:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.690901402999998, 2024-09-14T09:10:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074288858999999999, 2024-09-14T09:10:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2501 2024-09-14T09:10:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:10:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:10:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:10:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.41e-07 2024-09-14T09:10:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897913+0000", 2024-09-14T09:10:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3090000000000001e-06 2024-09-14T09:10:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897918+0000", 2024-09-14T09:10:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8470000000000003e-06 2024-09-14T09:10:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897922+0000", 2024-09-14T09:10:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5549999999999996e-06 2024-09-14T09:10:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971872+0000", 2024-09-14T09:10:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073950057999999999 2024-09-14T09:10:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971958+0000", 2024-09-14T09:10:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5941999999999998e-05 2024-09-14T09:10:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972200+0000", 2024-09-14T09:10:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000241907 2024-09-14T09:10:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2502 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2912256~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:10:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.690862222999996, 2024-09-14T09:10:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074614080999999999, 2024-09-14T09:10:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2502 2024-09-14T09:10:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:10:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:10:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897951+0000", 2024-09-14T09:10:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:10:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897953+0000", 2024-09-14T09:10:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5670000000000002e-06 2024-09-14T09:10:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897970+0000", 2024-09-14T09:10:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6319000000000001e-05 2024-09-14T09:10:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897976+0000", 2024-09-14T09:10:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8760000000000002e-06 2024-09-14T09:10:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972245+0000", 2024-09-14T09:10:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074269186000000001 2024-09-14T09:10:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972333+0000", 2024-09-14T09:10:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7800999999999995e-05 2024-09-14T09:10:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972564+0000", 2024-09-14T09:10:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000231833 2024-09-14T09:10:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2503 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2973696~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:10:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.690828206000006, 2024-09-14T09:10:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074944286999999998, 2024-09-14T09:10:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2503 2024-09-14T09:10:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:10:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:10:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897985+0000", 2024-09-14T09:10:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999998e-07 2024-09-14T09:10:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897987+0000", 2024-09-14T09:10:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.401e-06 2024-09-14T09:10:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897999+0000", 2024-09-14T09:10:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1851999999999999e-05 2024-09-14T09:10:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898005+0000", 2024-09-14T09:10:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9789999999999998e-06 2024-09-14T09:10:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972609+0000", 2024-09-14T09:10:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074604217 2024-09-14T09:10:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972684+0000", 2024-09-14T09:10:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4777999999999995e-05 2024-09-14T09:10:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972929+0000", 2024-09-14T09:10:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024448100000000001 2024-09-14T09:10:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2504 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3035136~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:10:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.690800113999998, 2024-09-14T09:10:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075285131000000005, 2024-09-14T09:10:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2504 2024-09-14T09:10:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:10:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:10:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898078+0000", 2024-09-14T09:10:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5775e-05 2024-09-14T09:10:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898082+0000", 2024-09-14T09:10:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.49e-06 2024-09-14T09:10:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898092+0000", 2024-09-14T09:10:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0509999999999999e-05 2024-09-14T09:10:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898099+0000", 2024-09-14T09:10:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.81e-06 2024-09-14T09:10:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972971+0000", 2024-09-14T09:10:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074871788999999994 2024-09-14T09:10:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973055+0000", 2024-09-14T09:10:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3980000000000006e-05 2024-09-14T09:10:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973298+0000", 2024-09-14T09:10:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024277700000000001 2024-09-14T09:10:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2505 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3096576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:10:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.690703858999996, 2024-09-14T09:10:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075506668999999998, 2024-09-14T09:10:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2505 2024-09-14T09:10:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:10:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:10:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898370+0000", 2024-09-14T09:10:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026128799999999998 2024-09-14T09:10:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898374+0000", 2024-09-14T09:10:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8070000000000001e-06 2024-09-14T09:10:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898383+0000", 2024-09-14T09:10:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0520000000000007e-06 2024-09-14T09:10:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898389+0000", 2024-09-14T09:10:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2639999999999997e-06 2024-09-14T09:10:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973330+0000", 2024-09-14T09:10:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074940548999999995 2024-09-14T09:10:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973402+0000", 2024-09-14T09:10:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2556000000000001e-05 2024-09-14T09:10:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973615+0000", 2024-09-14T09:10:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000213153 2024-09-14T09:10:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2506 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3158016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:10:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.690410615000005, 2024-09-14T09:10:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075556110999999995, 2024-09-14T09:10:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2506 2024-09-14T09:10:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:10:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:10:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898497+0000", 2024-09-14T09:10:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4806e-05 2024-09-14T09:10:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898500+0000", 2024-09-14T09:10:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.54e-06 2024-09-14T09:10:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898507+0000", 2024-09-14T09:10:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1590000000000004e-06 2024-09-14T09:10:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898513+0000", 2024-09-14T09:10:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.015e-06 2024-09-14T09:10:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973656+0000", 2024-09-14T09:10:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075142929999999997 2024-09-14T09:10:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973742+0000", 2024-09-14T09:10:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5535e-05 2024-09-14T09:10:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973958+0000", 2024-09-14T09:10:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000216126 2024-09-14T09:10:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2507 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3219456~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:10:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.690282030999995, 2024-09-14T09:10:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075623459000000004, 2024-09-14T09:10:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2507 2024-09-14T09:10:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:10:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:10:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898761+0000", 2024-09-14T09:10:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000230614 2024-09-14T09:10:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898765+0000", 2024-09-14T09:10:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6629999999999999e-06 2024-09-14T09:10:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898774+0000", 2024-09-14T09:10:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6749999999999997e-06 2024-09-14T09:10:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898781+0000", 2024-09-14T09:10:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4640000000000003e-06 2024-09-14T09:10:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973985+0000", 2024-09-14T09:10:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075204101999999995 2024-09-14T09:10:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974063+0000", 2024-09-14T09:10:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7632000000000005e-05 2024-09-14T09:10:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974154+0000", 2024-09-14T09:10:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1309000000000003e-05 2024-09-14T09:10:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2508 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3280896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:10:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.690020267999998, 2024-09-14T09:10:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075576943999999993, 2024-09-14T09:10:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2508 2024-09-14T09:10:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:10:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:10:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899176+0000", 2024-09-14T09:10:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038340500000000002 2024-09-14T09:10:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899179+0000", 2024-09-14T09:10:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0290000000000001e-06 2024-09-14T09:10:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899186+0000", 2024-09-14T09:10:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8199999999999999e-06 2024-09-14T09:10:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899190+0000", 2024-09-14T09:10:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2050000000000004e-06 2024-09-14T09:10:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974193+0000", 2024-09-14T09:10:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075003632000000001 2024-09-14T09:10:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974276+0000", 2024-09-14T09:10:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2272000000000001e-05 2024-09-14T09:10:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974369+0000", 2024-09-14T09:10:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3580999999999997e-05 2024-09-14T09:10:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2509 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3342336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:10:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.689612651000004, 2024-09-14T09:10:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075356229999999996, 2024-09-14T09:10:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2509 2024-09-14T09:10:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:10:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:10:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899439+0000", 2024-09-14T09:10:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023958599999999999 2024-09-14T09:10:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899444+0000", 2024-09-14T09:10:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8790000000000002e-06 2024-09-14T09:10:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899455+0000", 2024-09-14T09:10:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0597999999999999e-05 2024-09-14T09:10:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899462+0000", 2024-09-14T09:10:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8179999999999998e-06 2024-09-14T09:10:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974400+0000", 2024-09-14T09:10:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074937999000000005 2024-09-14T09:10:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974465+0000", 2024-09-14T09:10:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5134000000000004e-05 2024-09-14T09:10:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974556+0000", 2024-09-14T09:10:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1216000000000002e-05 2024-09-14T09:10:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2510 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3403776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:10:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.689337257999995, 2024-09-14T09:10:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075295775999999995, 2024-09-14T09:10:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2510 2024-09-14T09:10:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:10:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:10:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899691+0000", 2024-09-14T09:10:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021615999999999999 2024-09-14T09:10:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899696+0000", 2024-09-14T09:10:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3200000000000001e-06 2024-09-14T09:10:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899704+0000", 2024-09-14T09:10:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9440000000000005e-06 2024-09-14T09:10:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899710+0000", 2024-09-14T09:10:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.584e-06 2024-09-14T09:10:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974594+0000", 2024-09-14T09:10:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074883551000000007 2024-09-14T09:10:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974679+0000", 2024-09-14T09:10:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5365999999999995e-05 2024-09-14T09:10:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974771+0000", 2024-09-14T09:10:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1850999999999999e-05 2024-09-14T09:10:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2511 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3465216~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:10:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.689091039999994, 2024-09-14T09:10:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075234668000000005, 2024-09-14T09:10:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2511 2024-09-14T09:10:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:10:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:10:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899951+0000", 2024-09-14T09:10:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000229569 2024-09-14T09:10:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899955+0000", 2024-09-14T09:10:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1010000000000002e-06 2024-09-14T09:10:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899971+0000", 2024-09-14T09:10:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5648999999999999e-05 2024-09-14T09:10:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899978+0000", 2024-09-14T09:10:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0829999999999998e-06 2024-09-14T09:10:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974806+0000", 2024-09-14T09:10:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074828092999999998 2024-09-14T09:10:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974870+0000", 2024-09-14T09:10:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4492000000000005e-05 2024-09-14T09:10:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974956+0000", 2024-09-14T09:10:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5680999999999995e-05 2024-09-14T09:10:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2512 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3526656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:10:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.688823494999994, 2024-09-14T09:10:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075178812999999997, 2024-09-14T09:10:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2512 2024-09-14T09:10:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:10:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:10:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904181+0000", 2024-09-14T09:10:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041919399999999999 2024-09-14T09:10:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904186+0000", 2024-09-14T09:10:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2390000000000002e-06 2024-09-14T09:10:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904199+0000", 2024-09-14T09:10:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2709e-05 2024-09-14T09:10:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904207+0000", 2024-09-14T09:10:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8150000000000006e-06 2024-09-14T09:10:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975000+0000", 2024-09-14T09:10:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.070793444999999997 2024-09-14T09:10:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975079+0000", 2024-09-14T09:10:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8480999999999996e-05 2024-09-14T09:10:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975168+0000", 2024-09-14T09:10:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9184000000000005e-05 2024-09-14T09:10:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:22840 3.15 3:a8cf3dc2:::rbd_header.1112a10502fe:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:10:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 56.029250472999998, 2024-09-14T09:10:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.119998785, 2024-09-14T09:10:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:10:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:10:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 22840 2024-09-14T09:10:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:10:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:10:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642492+0000", 2024-09-14T09:10:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.082930276999999997 2024-09-14T09:10:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642495+0000", 2024-09-14T09:10:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9809999999999999e-06 2024-09-14T09:10:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642501+0000", 2024-09-14T09:10:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-09-14T09:10:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642506+0000", 2024-09-14T09:10:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6650000000000002e-06 2024-09-14T09:10:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679483+0000", 2024-09-14T09:10:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036977777000000003 2024-09-14T09:10:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679517+0000", 2024-09-14T09:10:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.345e-05 2024-09-14T09:10:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679561+0000", 2024-09-14T09:10:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3930999999999997e-05 2024-09-14T09:10:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:22857 3.15 3:a8cf3dc2:::rbd_header.1112a10502fe:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:10:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.879356547999997, 2024-09-14T09:10:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.088427917999999994, 2024-09-14T09:10:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:10:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:10:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 22857 2024-09-14T09:10:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:10:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:10:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777685+0000", 2024-09-14T09:10:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.068229181999999999 2024-09-14T09:10:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777688+0000", 2024-09-14T09:10:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1980000000000001e-06 2024-09-14T09:10:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777695+0000", 2024-09-14T09:10:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:10:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777700+0000", 2024-09-14T09:10:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0919999999999997e-06 2024-09-14T09:10:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797735+0000", 2024-09-14T09:10:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0200351 2024-09-14T09:10:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797800+0000", 2024-09-14T09:10:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4305000000000002e-05 2024-09-14T09:10:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797884+0000", 2024-09-14T09:10:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4344000000000004e-05 2024-09-14T09:10:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:12.678 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:12.680 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:10:12.680 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:12.682+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:12.781 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:12.783+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:12.824 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:12.824 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:12.824 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:10:12.824 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:12.832 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:10:12.881 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:12.884+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:12.937 INFO:teuthology.orchestra.run.smithi116.stderr:set 2.4 pg_upmap mapping to [0,3] 2024-09-14T09:10:12.977 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:10:12.982 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:12.983 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:12.983 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:10:12.983 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:10:12.983 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:12.983 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:12.985+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:12.992 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:10:13.083 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:13.086+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:13.104 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:10:13.105 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:10:13.121 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:10:13.122 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:10:13.138 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:10:13.138 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:10:13.142 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:13.143 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:13.152 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:10:13.155 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:10:13.155 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:10:13.171 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:10:13.172 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:10:13.188 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:10:13.188 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:10:13.196 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:13.198+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:13.258 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:13.258 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:13.266 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:10:13.307 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:13.309+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:13.385 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:13.388+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:13.409 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:13.410 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:13.418 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:10:13.486 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:13.488+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:13.562 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:13.562 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:13.571 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:10:13.614 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:13.617+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:13.673 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:13.673 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:13.681 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:10:13.688 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:13.690+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:13.789 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:13.791+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:13.825 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:13.825 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:13.834 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:10:13.867 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T09:10:13.889 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:13.892+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:13.936 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:13.936 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:13.947 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:10:13.991 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:13.992+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:14.091 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:14.093+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:14.094 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:14.094 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:14.103 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:10:14.192 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:14.194+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:14.246 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:14.246 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:14.254 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:10:14.296 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:14.298+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:14.394 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:14.396+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:14.399 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:14.399 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:14.408 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:10:14.495 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:14.498+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:14.511 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:14.511 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:14.520 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:10:14.596 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:14.599+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:14.621 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:14.622 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:14.630 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:10:14.697 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:14.700+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:14.732 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:14.732 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:14.741 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:10:14.798 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:14.800+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:14.844 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:14.844 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:14.852 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:10:14.899 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:14.901+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:14.945 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is unset 2024-09-14T09:10:14.957 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:14.957 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:14.967 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:10:14.999 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:15.002+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:15.101 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:15.103+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:15.114 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:15.114 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:15.123 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:10:15.199 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:10:15.207 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:15.209+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:15.269 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:15.269 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:15.278 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:10:15.302 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:15.305+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:15.327 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:10:15.328 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:10:15.344 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:10:15.345 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:10:15.361 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:10:15.361 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:10:15.377 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:10:15.378 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:10:15.385 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:15.385 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:15.385 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:10:15.385 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:10:15.385 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:15.394 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:10:15.395 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:10:15.395 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:10:15.411 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:10:15.412 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:10:15.412 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:15.414+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:15.500 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:15.500 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:10:15.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:10:15.500 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:10:15.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.500 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:987 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:15.501 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:10:15.501 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.643040361000004, 2024-09-14T09:10:15.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001359466, 2024-09-14T09:10:15.501 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:15.501 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:15.501 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:15.501 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:15.501 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:15.501 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:15.501 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 987 2024-09-14T09:10:15.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.501 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:15.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:15.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:10:15.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:15.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:10:15.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:15.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858333+0000", 2024-09-14T09:10:15.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.621e-06 2024-09-14T09:10:15.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:15.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858349+0000", 2024-09-14T09:10:15.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5758000000000001e-05 2024-09-14T09:10:15.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:15.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858366+0000", 2024-09-14T09:10:15.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7368e-05 2024-09-14T09:10:15.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858382+0000", 2024-09-14T09:10:15.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6039e-05 2024-09-14T09:10:15.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858441+0000", 2024-09-14T09:10:15.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8662999999999997e-05 2024-09-14T09:10:15.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858449+0000", 2024-09-14T09:10:15.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3960000000000006e-06 2024-09-14T09:10:15.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859682+0000", 2024-09-14T09:10:15.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001233096 2024-09-14T09:10:15.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:15.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859691+0000", 2024-09-14T09:10:15.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5250000000000005e-06 2024-09-14T09:10:15.505 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.505 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:15.505 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.505 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:988 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:15.505 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:10:15.505 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.642912491000004, 2024-09-14T09:10:15.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0012656799999999, 2024-09-14T09:10:15.506 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:15.506 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:15.506 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:15.506 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:15.506 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:15.506 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:15.506 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 988 2024-09-14T09:10:15.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.506 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:15.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:15.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:10:15.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:15.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:10:15.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:15.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858460+0000", 2024-09-14T09:10:15.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9999999999999997e-07 2024-09-14T09:10:15.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:15.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858463+0000", 2024-09-14T09:10:15.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7459999999999998e-06 2024-09-14T09:10:15.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:15.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858471+0000", 2024-09-14T09:10:15.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3900000000000004e-06 2024-09-14T09:10:15.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858478+0000", 2024-09-14T09:10:15.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7020000000000004e-06 2024-09-14T09:10:15.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859102+0000", 2024-09-14T09:10:15.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062419699999999995 2024-09-14T09:10:15.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859109+0000", 2024-09-14T09:10:15.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7419999999999997e-06 2024-09-14T09:10:15.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859718+0000", 2024-09-14T09:10:15.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006085629999999 2024-09-14T09:10:15.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:15.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859725+0000", 2024-09-14T09:10:15.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7399999999999998e-06 2024-09-14T09:10:15.510 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.510 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:15.510 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.510 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1003 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:15.510 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:10:15.510 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.642049254, 2024-09-14T09:10:15.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009495209999999, 2024-09-14T09:10:15.510 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:15.511 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:15.511 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:15.511 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:15.511 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:15.511 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:15.511 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1003 2024-09-14T09:10:15.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.511 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:15.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:15.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:10:15.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:15.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:10:15.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:15.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859323+0000", 2024-09-14T09:10:15.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3099999999999998e-07 2024-09-14T09:10:15.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:15.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859326+0000", 2024-09-14T09:10:15.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-06 2024-09-14T09:10:15.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:15.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859333+0000", 2024-09-14T09:10:15.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3300000000000001e-06 2024-09-14T09:10:15.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859339+0000", 2024-09-14T09:10:15.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6400000000000002e-06 2024-09-14T09:10:15.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859387+0000", 2024-09-14T09:10:15.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8448000000000001e-05 2024-09-14T09:10:15.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:10:15.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9540000000000004e-06 2024-09-14T09:10:15.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860260+0000", 2024-09-14T09:10:15.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000864921 2024-09-14T09:10:15.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:15.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860272+0000", 2024-09-14T09:10:15.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1993e-05 2024-09-14T09:10:15.515 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.515 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:15.515 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.515 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1004 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:15.515 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:10:15.515 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.642013679000002, 2024-09-14T09:10:15.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000947875, 2024-09-14T09:10:15.515 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:15.515 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:15.515 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:15.515 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:15.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:15.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:15.516 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1004 2024-09-14T09:10:15.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.516 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:15.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:15.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:10:15.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:15.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:10:15.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:15.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:10:15.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7199999999999999e-07 2024-09-14T09:10:15.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:15.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859361+0000", 2024-09-14T09:10:15.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.892e-06 2024-09-14T09:10:15.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:15.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859368+0000", 2024-09-14T09:10:15.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4370000000000004e-06 2024-09-14T09:10:15.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859373+0000", 2024-09-14T09:10:15.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6690000000000003e-06 2024-09-14T09:10:15.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859430+0000", 2024-09-14T09:10:15.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6456999999999998e-05 2024-09-14T09:10:15.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859434+0000", 2024-09-14T09:10:15.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8410000000000002e-06 2024-09-14T09:10:15.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860299+0000", 2024-09-14T09:10:15.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008650370000001 2024-09-14T09:10:15.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:15.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860306+0000", 2024-09-14T09:10:15.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0700000000000001e-06 2024-09-14T09:10:15.519 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.520 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:15.520 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.520 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1005 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:15.520 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:10:15.520 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.641990006, 2024-09-14T09:10:15.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009585480000001, 2024-09-14T09:10:15.520 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:15.520 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:15.520 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:15.520 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:15.520 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:15.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:15.521 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1005 2024-09-14T09:10:15.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.521 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:15.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:15.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:10:15.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:15.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:10:15.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:15.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:10:15.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9700000000000002e-07 2024-09-14T09:10:15.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:15.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859384+0000", 2024-09-14T09:10:15.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.024e-06 2024-09-14T09:10:15.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:15.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859390+0000", 2024-09-14T09:10:15.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7080000000000002e-06 2024-09-14T09:10:15.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:10:15.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8980000000000004e-06 2024-09-14T09:10:15.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859527+0000", 2024-09-14T09:10:15.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013228099999999999 2024-09-14T09:10:15.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859532+0000", 2024-09-14T09:10:15.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5899999999999998e-06 2024-09-14T09:10:15.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860330+0000", 2024-09-14T09:10:15.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0007973509999999 2024-09-14T09:10:15.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:15.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860340+0000", 2024-09-14T09:10:15.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0299000000000001e-05 2024-09-14T09:10:15.524 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.525 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:15.525 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.525 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1006 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:15.525 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:10:15.525 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.64196681, 2024-09-14T09:10:15.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001032039, 2024-09-14T09:10:15.525 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:15.525 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:15.525 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:15.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:15.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:15.526 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:15.526 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1006 2024-09-14T09:10:15.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.526 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:15.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:15.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:10:15.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:15.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:10:15.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:15.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:10:15.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6499999999999999e-07 2024-09-14T09:10:15.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:15.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859407+0000", 2024-09-14T09:10:15.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1160000000000002e-06 2024-09-14T09:10:15.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:15.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859413+0000", 2024-09-14T09:10:15.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8880000000000002e-06 2024-09-14T09:10:15.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859419+0000", 2024-09-14T09:10:15.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3550000000000004e-06 2024-09-14T09:10:15.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859558+0000", 2024-09-14T09:10:15.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000138942 2024-09-14T09:10:15.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859563+0000", 2024-09-14T09:10:15.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.665e-06 2024-09-14T09:10:15.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860427+0000", 2024-09-14T09:10:15.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008635299999999 2024-09-14T09:10:15.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:15.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860437+0000", 2024-09-14T09:10:15.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0078000000000001e-05 2024-09-14T09:10:15.529 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.529 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:15.530 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.530 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1045 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:15.530 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:10:15.530 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.641767329999993, 2024-09-14T09:10:15.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008612990000001, 2024-09-14T09:10:15.530 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:15.530 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:15.530 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:15.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:15.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:15.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:15.531 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1045 2024-09-14T09:10:15.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.531 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:15.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:15.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:10:15.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:15.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:10:15.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:15.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859605+0000", 2024-09-14T09:10:15.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6e-07 2024-09-14T09:10:15.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:15.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859606+0000", 2024-09-14T09:10:15.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8819999999999999e-06 2024-09-14T09:10:15.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:15.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859610+0000", 2024-09-14T09:10:15.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4290000000000001e-06 2024-09-14T09:10:15.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859612+0000", 2024-09-14T09:10:15.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6309999999999999e-06 2024-09-14T09:10:15.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859643+0000", 2024-09-14T09:10:15.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0224000000000001e-05 2024-09-14T09:10:15.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859647+0000", 2024-09-14T09:10:15.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9049999999999999e-06 2024-09-14T09:10:15.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860458+0000", 2024-09-14T09:10:15.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008111180000001 2024-09-14T09:10:15.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:15.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860466+0000", 2024-09-14T09:10:15.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:10:15.534 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.534 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:15.534 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.535 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1046 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:15.535 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:10:15.535 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.641753872999999, 2024-09-14T09:10:15.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000874262, 2024-09-14T09:10:15.535 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:15.535 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:15.535 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:15.535 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:15.535 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:15.535 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:15.535 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1046 2024-09-14T09:10:15.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.535 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:15.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:15.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:10:15.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:15.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:10:15.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:15.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:10:15.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:10:15.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:15.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859619+0000", 2024-09-14T09:10:15.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0559999999999999e-06 2024-09-14T09:10:15.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:15.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859622+0000", 2024-09-14T09:10:15.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0170000000000001e-06 2024-09-14T09:10:15.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859625+0000", 2024-09-14T09:10:15.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7209999999999999e-06 2024-09-14T09:10:15.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859666+0000", 2024-09-14T09:10:15.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1677000000000001e-05 2024-09-14T09:10:15.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859672+0000", 2024-09-14T09:10:15.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4609999999999999e-06 2024-09-14T09:10:15.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860485+0000", 2024-09-14T09:10:15.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000813505 2024-09-14T09:10:15.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:15.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860492+0000", 2024-09-14T09:10:15.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6159999999999998e-06 2024-09-14T09:10:15.539 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.539 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:15.540 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.540 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1047 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:15.540 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:10:15.540 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.641742539000006, 2024-09-14T09:10:15.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008950190000001, 2024-09-14T09:10:15.540 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:15.540 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:15.540 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:15.540 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:15.540 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:15.540 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:15.541 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1047 2024-09-14T09:10:15.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.541 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:15.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:15.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:10:15.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:15.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:10:15.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:15.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:10:15.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6600000000000003e-07 2024-09-14T09:10:15.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:15.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859631+0000", 2024-09-14T09:10:15.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5600000000000001e-06 2024-09-14T09:10:15.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:15.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859637+0000", 2024-09-14T09:10:15.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7309999999999998e-06 2024-09-14T09:10:15.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859641+0000", 2024-09-14T09:10:15.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0840000000000002e-06 2024-09-14T09:10:15.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859691+0000", 2024-09-14T09:10:15.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0587999999999997e-05 2024-09-14T09:10:15.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859696+0000", 2024-09-14T09:10:15.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8940000000000001e-06 2024-09-14T09:10:15.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860516+0000", 2024-09-14T09:10:15.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008200780000001 2024-09-14T09:10:15.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:15.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860524+0000", 2024-09-14T09:10:15.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8180000000000004e-06 2024-09-14T09:10:15.544 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.545 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:15.545 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.545 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1048 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:15.545 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:10:15.545 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.641710779999997, 2024-09-14T09:10:15.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008904780000001, 2024-09-14T09:10:15.545 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:15.545 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:15.545 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:15.545 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:15.545 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:15.545 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:15.546 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1048 2024-09-14T09:10:15.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.546 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:15.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:15.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:10:15.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:15.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:10:15.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:15.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:10:15.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4700000000000002e-07 2024-09-14T09:10:15.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:15.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859663+0000", 2024-09-14T09:10:15.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0420000000000001e-06 2024-09-14T09:10:15.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:15.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859669+0000", 2024-09-14T09:10:15.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8989999999999998e-06 2024-09-14T09:10:15.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859673+0000", 2024-09-14T09:10:15.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2209999999999999e-06 2024-09-14T09:10:15.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859719+0000", 2024-09-14T09:10:15.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5788000000000003e-05 2024-09-14T09:10:15.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859725+0000", 2024-09-14T09:10:15.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4770000000000002e-06 2024-09-14T09:10:15.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860544+0000", 2024-09-14T09:10:15.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008194669999999 2024-09-14T09:10:15.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:15.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860551+0000", 2024-09-14T09:10:15.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1369999999999996e-06 2024-09-14T09:10:15.549 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.549 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:15.550 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.550 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1089 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:15.550 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:10:15.550 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.641473786999995, 2024-09-14T09:10:15.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000733943, 2024-09-14T09:10:15.550 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:15.550 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:15.550 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:15.550 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:15.550 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:15.550 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:15.550 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1089 2024-09-14T09:10:15.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.551 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:15.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:15.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:10:15.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:15.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:10:15.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:15.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:10:15.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3000000000000002e-07 2024-09-14T09:10:15.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:15.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859900+0000", 2024-09-14T09:10:15.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9199999999999998e-06 2024-09-14T09:10:15.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:15.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859906+0000", 2024-09-14T09:10:15.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0889999999999996e-06 2024-09-14T09:10:15.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859911+0000", 2024-09-14T09:10:15.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6419999999999998e-06 2024-09-14T09:10:15.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860010+0000", 2024-09-14T09:10:15.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8956000000000006e-05 2024-09-14T09:10:15.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860014+0000", 2024-09-14T09:10:15.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.741e-06 2024-09-14T09:10:15.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860627+0000", 2024-09-14T09:10:15.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00061277 2024-09-14T09:10:15.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:15.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860632+0000", 2024-09-14T09:10:15.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:10:15.554 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.554 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:15.554 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.555 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1090 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:15.555 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:10:15.555 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.641454115000002, 2024-09-14T09:10:15.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000740763, 2024-09-14T09:10:15.555 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:15.555 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:15.555 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:15.555 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:15.555 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:15.555 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:15.555 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1090 2024-09-14T09:10:15.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.555 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:15.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:15.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:10:15.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:15.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:10:15.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:15.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859918+0000", 2024-09-14T09:10:15.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5199999999999998e-07 2024-09-14T09:10:15.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:15.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859920+0000", 2024-09-14T09:10:15.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9240000000000001e-06 2024-09-14T09:10:15.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:15.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859925+0000", 2024-09-14T09:10:15.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3929999999999999e-06 2024-09-14T09:10:15.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859929+0000", 2024-09-14T09:10:15.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4769999999999999e-06 2024-09-14T09:10:15.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860034+0000", 2024-09-14T09:10:15.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010549500000000001 2024-09-14T09:10:15.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860039+0000", 2024-09-14T09:10:15.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5700000000000003e-06 2024-09-14T09:10:15.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860650+0000", 2024-09-14T09:10:15.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006116119999999 2024-09-14T09:10:15.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:15.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860658+0000", 2024-09-14T09:10:15.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:10:15.559 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.559 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:15.559 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.559 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60374 3.14 3.6e2cd654 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:15.559 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:10:15.559 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.011575805, 2024-09-14T09:10:15.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3129433100000001, 2024-09-14T09:10:15.560 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:15.560 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:15.560 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:15.560 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:15.560 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:15.560 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:15.560 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60374 2024-09-14T09:10:15.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.560 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:15.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:15.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:10:15.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:15.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:10:15.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:15.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:10:15.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2100000000000002e-07 2024-09-14T09:10:15.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:15.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489799+0000", 2024-09-14T09:10:15.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3530000000000002e-06 2024-09-14T09:10:15.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:15.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489808+0000", 2024-09-14T09:10:15.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2e-06 2024-09-14T09:10:15.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489813+0000", 2024-09-14T09:10:15.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3249999999999998e-06 2024-09-14T09:10:15.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489866+0000", 2024-09-14T09:10:15.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3074e-05 2024-09-14T09:10:15.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489875+0000", 2024-09-14T09:10:15.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2760000000000006e-06 2024-09-14T09:10:15.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801379+0000", 2024-09-14T09:10:15.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.31150346200000001 2024-09-14T09:10:15.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801387+0000", 2024-09-14T09:10:15.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.038e-06 2024-09-14T09:10:15.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802728+0000", 2024-09-14T09:10:15.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013415569999999 2024-09-14T09:10:15.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:15.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802739+0000", 2024-09-14T09:10:15.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0604e-05 2024-09-14T09:10:15.565 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.565 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:15.565 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.565 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62179 3.14 3.78cf1974 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:15.565 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:10:15.565 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.011545175999998, 2024-09-14T09:10:15.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3129429109999999, 2024-09-14T09:10:15.565 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:15.565 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:15.566 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:15.566 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:15.566 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:15.566 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:15.566 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62179 2024-09-14T09:10:15.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.566 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:15.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:15.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:10:15.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:15.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:10:15.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:15.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489827+0000", 2024-09-14T09:10:15.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4300000000000003e-07 2024-09-14T09:10:15.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:15.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489829+0000", 2024-09-14T09:10:15.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2129999999999998e-06 2024-09-14T09:10:15.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:15.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489836+0000", 2024-09-14T09:10:15.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0360000000000001e-06 2024-09-14T09:10:15.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489841+0000", 2024-09-14T09:10:15.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0710000000000002e-06 2024-09-14T09:10:15.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489905+0000", 2024-09-14T09:10:15.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3578999999999996e-05 2024-09-14T09:10:15.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489913+0000", 2024-09-14T09:10:15.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2269999999999993e-06 2024-09-14T09:10:15.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801412+0000", 2024-09-14T09:10:15.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.311498989 2024-09-14T09:10:15.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801419+0000", 2024-09-14T09:10:15.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1400000000000002e-06 2024-09-14T09:10:15.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802761+0000", 2024-09-14T09:10:15.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013414620000001 2024-09-14T09:10:15.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:15.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802769+0000", 2024-09-14T09:10:15.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6510000000000007e-06 2024-09-14T09:10:15.570 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.570 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:15.570 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.571 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63551 3.14 3.88ccb734 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:15.571 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:10:15.571 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.011513546000003, 2024-09-14T09:10:15.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.312941181, 2024-09-14T09:10:15.571 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:15.571 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:15.571 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:15.571 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:15.571 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:15.571 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:15.571 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63551 2024-09-14T09:10:15.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.571 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:15.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:15.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:10:15.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:15.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:10:15.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:15.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489859+0000", 2024-09-14T09:10:15.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9200000000000001e-07 2024-09-14T09:10:15.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:15.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489862+0000", 2024-09-14T09:10:15.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9629999999999998e-06 2024-09-14T09:10:15.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:15.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489868+0000", 2024-09-14T09:10:15.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3890000000000002e-06 2024-09-14T09:10:15.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489875+0000", 2024-09-14T09:10:15.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7950000000000002e-06 2024-09-14T09:10:15.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489939+0000", 2024-09-14T09:10:15.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4704999999999998e-05 2024-09-14T09:10:15.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489949+0000", 2024-09-14T09:10:15.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7799999999999995e-06 2024-09-14T09:10:15.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801447+0000", 2024-09-14T09:10:15.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.311497527 2024-09-14T09:10:15.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801454+0000", 2024-09-14T09:10:15.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1080000000000004e-06 2024-09-14T09:10:15.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802790+0000", 2024-09-14T09:10:15.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013364330000001 2024-09-14T09:10:15.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:15.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802799+0000", 2024-09-14T09:10:15.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8890000000000008e-06 2024-09-14T09:10:15.576 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.576 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:15.576 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.576 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:68716 3.14 3.96fe1934 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:15.577 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:10:15.577 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.959943078999999, 2024-09-14T09:10:15.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2614012569999999, 2024-09-14T09:10:15.577 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:15.577 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:15.577 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:15.577 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:15.577 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:15.577 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:15.577 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 68716 2024-09-14T09:10:15.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.577 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:15.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:15.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:10:15.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:15.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:10:15.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:15.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541429+0000", 2024-09-14T09:10:15.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8899999999999998e-07 2024-09-14T09:10:15.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:15.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541433+0000", 2024-09-14T09:10:15.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7330000000000001e-06 2024-09-14T09:10:15.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:15.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541442+0000", 2024-09-14T09:10:15.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.346e-06 2024-09-14T09:10:15.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541449+0000", 2024-09-14T09:10:15.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.579e-06 2024-09-14T09:10:15.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541839+0000", 2024-09-14T09:10:15.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038993699999999998 2024-09-14T09:10:15.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541849+0000", 2024-09-14T09:10:15.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0217999999999999e-05 2024-09-14T09:10:15.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801480+0000", 2024-09-14T09:10:15.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.25963061399999998 2024-09-14T09:10:15.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801486+0000", 2024-09-14T09:10:15.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.776e-06 2024-09-14T09:10:15.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802821+0000", 2024-09-14T09:10:15.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00133435 2024-09-14T09:10:15.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:15.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802830+0000", 2024-09-14T09:10:15.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9150000000000002e-06 2024-09-14T09:10:15.582 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.582 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:15.582 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.582 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:69492 3.14 3.4a93714 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:15.582 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:10:15.582 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.899403382999999, 2024-09-14T09:10:15.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2008910690000001, 2024-09-14T09:10:15.583 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:15.583 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:15.583 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:15.583 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:15.583 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:15.583 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:15.583 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 69492 2024-09-14T09:10:15.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.583 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:15.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:15.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:10:15.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:15.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:10:15.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:15.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601969+0000", 2024-09-14T09:10:15.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3099999999999996e-07 2024-09-14T09:10:15.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:15.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601973+0000", 2024-09-14T09:10:15.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5899999999999999e-06 2024-09-14T09:10:15.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:15.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601983+0000", 2024-09-14T09:10:15.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098999999999999e-05 2024-09-14T09:10:15.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601989+0000", 2024-09-14T09:10:15.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0209999999999996e-06 2024-09-14T09:10:15.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.602066+0000", 2024-09-14T09:10:15.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7075000000000003e-05 2024-09-14T09:10:15.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.602075+0000", 2024-09-14T09:10:15.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8389999999999996e-06 2024-09-14T09:10:15.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801512+0000", 2024-09-14T09:10:15.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.199437225 2024-09-14T09:10:15.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801519+0000", 2024-09-14T09:10:15.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9970000000000001e-06 2024-09-14T09:10:15.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802851+0000", 2024-09-14T09:10:15.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001331711 2024-09-14T09:10:15.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:15.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802859+0000", 2024-09-14T09:10:15.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6810000000000004e-06 2024-09-14T09:10:15.587 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.588 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:15.588 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.588 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:72035 3.14 3.1cba9a34 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:15.588 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:10:15.588 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.780075494999998, 2024-09-14T09:10:15.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0815917340000001, 2024-09-14T09:10:15.588 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:15.588 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:15.588 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:15.588 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:15.588 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:15.589 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:15.589 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 72035 2024-09-14T09:10:15.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.589 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:15.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:15.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:10:15.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:15.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:10:15.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:15.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721297+0000", 2024-09-14T09:10:15.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5199999999999996e-07 2024-09-14T09:10:15.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:15.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721301+0000", 2024-09-14T09:10:15.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7790000000000002e-06 2024-09-14T09:10:15.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:15.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721309+0000", 2024-09-14T09:10:15.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8019999999999998e-06 2024-09-14T09:10:15.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721315+0000", 2024-09-14T09:10:15.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:10:15.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721367+0000", 2024-09-14T09:10:15.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2280000000000001e-05 2024-09-14T09:10:15.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721376+0000", 2024-09-14T09:10:15.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5439999999999999e-06 2024-09-14T09:10:15.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801545+0000", 2024-09-14T09:10:15.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.080169952000000003 2024-09-14T09:10:15.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801552+0000", 2024-09-14T09:10:15.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8390000000000001e-06 2024-09-14T09:10:15.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802879+0000", 2024-09-14T09:10:15.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001326846 2024-09-14T09:10:15.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:15.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802888+0000", 2024-09-14T09:10:15.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6330000000000002e-06 2024-09-14T09:10:15.593 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.593 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:15.593 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.593 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73403 3.14 3.87b99f94 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:15.593 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:10:15.593 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.737800833999998, 2024-09-14T09:10:15.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0393459899999999, 2024-09-14T09:10:15.593 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:15.594 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:15.594 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:15.594 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:15.594 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:15.594 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:15.594 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73403 2024-09-14T09:10:15.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.594 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:15.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:15.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:10:15.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:15.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:10:15.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:15.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:10:15.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9200000000000001e-07 2024-09-14T09:10:15.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:15.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763574+0000", 2024-09-14T09:10:15.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6510000000000001e-06 2024-09-14T09:10:15.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.595 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:15.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763582+0000", 2024-09-14T09:10:15.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2579999999999995e-06 2024-09-14T09:10:15.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763592+0000", 2024-09-14T09:10:15.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0193e-05 2024-09-14T09:10:15.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763643+0000", 2024-09-14T09:10:15.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0862000000000002e-05 2024-09-14T09:10:15.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763654+0000", 2024-09-14T09:10:15.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0890000000000001e-05 2024-09-14T09:10:15.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801577+0000", 2024-09-14T09:10:15.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037923074000000001 2024-09-14T09:10:15.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801584+0000", 2024-09-14T09:10:15.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0060000000000003e-06 2024-09-14T09:10:15.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802908+0000", 2024-09-14T09:10:15.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013235149999999 2024-09-14T09:10:15.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:15.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802917+0000", 2024-09-14T09:10:15.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9490000000000002e-06 2024-09-14T09:10:15.598 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.598 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:15.598 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.599 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:36215 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T09:10:15.599 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:52.846616+0000", 2024-09-14T09:10:15.599 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.654755229999999, 2024-09-14T09:10:15.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0047992570000002, 2024-09-14T09:10:15.599 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:15.599 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:15.599 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:15.599 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:15.599 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:10:15.599 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:10:15.599 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36215 2024-09-14T09:10:15.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.599 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:15.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:15.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846616+0000", 2024-09-14T09:10:15.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:15.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846616+0000", 2024-09-14T09:10:15.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:15.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:15.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846618+0000", 2024-09-14T09:10:15.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6700000000000001e-06 2024-09-14T09:10:15.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:15.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846626+0000", 2024-09-14T09:10:15.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0430000000000008e-06 2024-09-14T09:10:15.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:15.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846641+0000", 2024-09-14T09:10:15.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5009e-05 2024-09-14T09:10:15.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846650+0000", 2024-09-14T09:10:15.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7409999999999998e-06 2024-09-14T09:10:15.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846726+0000", 2024-09-14T09:10:15.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6149000000000006e-05 2024-09-14T09:10:15.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846736+0000", 2024-09-14T09:10:15.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7119999999999995e-06 2024-09-14T09:10:15.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:53.822292+0000", 2024-09-14T09:10:15.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.97555623800000002 2024-09-14T09:10:15.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:53.822307+0000", 2024-09-14T09:10:15.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4646e-05 2024-09-14T09:10:15.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:15.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:54.850919+0000", 2024-09-14T09:10:15.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.028612284 2024-09-14T09:10:15.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:15.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:54.851186+0000", 2024-09-14T09:10:15.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000267318 2024-09-14T09:10:15.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:15.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:15.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:15.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:54.851416+0000", 2024-09-14T09:10:15.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000229447 2024-09-14T09:10:15.604 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.604 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:15.604 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.604 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:15.604 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:15.604 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:15.606 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:10:15.606 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:15.608+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:15.707 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:15.709+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:15.712 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:15.712 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:15.712 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:10:15.712 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:15.721 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:10:15.808 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:15.811+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:15.823 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:15.824 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:15.824 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:10:15.824 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:10:15.824 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:15.832 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:10:15.909 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:15.911+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:15.937 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:15.937 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:10:15.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:10:15.937 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:10:15.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.937 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:249 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1638400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:15.937 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:10:15.937 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 104.141373441, 2024-09-14T09:10:15.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99070346899999995, 2024-09-14T09:10:15.938 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:15.938 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:15.938 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:15.938 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:15.938 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:15.938 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:15.938 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 249 2024-09-14T09:10:15.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.938 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:15.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:15.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:10:15.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:15.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:10:15.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:15.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796868+0000", 2024-09-14T09:10:15.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2024-09-14T09:10:15.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:15.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796870+0000", 2024-09-14T09:10:15.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7889999999999999e-06 2024-09-14T09:10:15.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:15.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796877+0000", 2024-09-14T09:10:15.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8549999999999996e-06 2024-09-14T09:10:15.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796883+0000", 2024-09-14T09:10:15.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.665e-06 2024-09-14T09:10:15.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796915+0000", 2024-09-14T09:10:15.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2215999999999998e-05 2024-09-14T09:10:15.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796920+0000", 2024-09-14T09:10:15.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.527e-06 2024-09-14T09:10:15.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787468+0000", 2024-09-14T09:10:15.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99054877100000005 2024-09-14T09:10:15.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:15.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787512+0000", 2024-09-14T09:10:15.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3958000000000002e-05 2024-09-14T09:10:15.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:15.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787571+0000", 2024-09-14T09:10:15.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8167000000000001e-05 2024-09-14T09:10:15.942 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:15.942 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:15.942 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:15.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.943 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:250 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2097152~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:15.943 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:10:15.943 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 104.141347375, 2024-09-14T09:10:15.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99079431100000004, 2024-09-14T09:10:15.943 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:15.943 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:15.943 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:15.943 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:15.943 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:15.943 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:15.943 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 250 2024-09-14T09:10:15.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.944 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:15.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:15.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:10:15.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:15.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:10:15.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:15.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796894+0000", 2024-09-14T09:10:15.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2024-09-14T09:10:15.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:15.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796896+0000", 2024-09-14T09:10:15.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5600000000000001e-06 2024-09-14T09:10:15.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:15.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796902+0000", 2024-09-14T09:10:15.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3090000000000001e-06 2024-09-14T09:10:15.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796909+0000", 2024-09-14T09:10:15.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:10:15.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796942+0000", 2024-09-14T09:10:15.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-05 2024-09-14T09:10:15.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796948+0000", 2024-09-14T09:10:15.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5910000000000001e-06 2024-09-14T09:10:15.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787596+0000", 2024-09-14T09:10:15.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99064781400000002 2024-09-14T09:10:15.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:15.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787636+0000", 2024-09-14T09:10:15.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9715000000000002e-05 2024-09-14T09:10:15.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:15.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787687+0000", 2024-09-14T09:10:15.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1674e-05 2024-09-14T09:10:15.948 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:15.948 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:15.948 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:15.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.948 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:251 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:15.948 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:10:15.948 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 104.14132194, 2024-09-14T09:10:15.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99091769600000001, 2024-09-14T09:10:15.949 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:15.949 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:15.949 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:15.949 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:15.949 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:15.949 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:15.949 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 251 2024-09-14T09:10:15.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.949 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:15.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:15.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:10:15.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:15.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:10:15.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:15.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:10:15.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000005e-07 2024-09-14T09:10:15.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:15.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796922+0000", 2024-09-14T09:10:15.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.875e-06 2024-09-14T09:10:15.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:15.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796929+0000", 2024-09-14T09:10:15.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0260000000000002e-06 2024-09-14T09:10:15.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796935+0000", 2024-09-14T09:10:15.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7030000000000003e-06 2024-09-14T09:10:15.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796963+0000", 2024-09-14T09:10:15.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8368999999999999e-05 2024-09-14T09:10:15.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796966+0000", 2024-09-14T09:10:15.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4130000000000002e-06 2024-09-14T09:10:15.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787718+0000", 2024-09-14T09:10:15.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99075151100000003 2024-09-14T09:10:15.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:15.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787779+0000", 2024-09-14T09:10:15.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.088e-05 2024-09-14T09:10:15.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:15.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787836+0000", 2024-09-14T09:10:15.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7380000000000003e-05 2024-09-14T09:10:15.953 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:15.953 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:15.953 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:15.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.954 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:252 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:15.954 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:10:15.954 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 104.141296486, 2024-09-14T09:10:15.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99102491400000003, 2024-09-14T09:10:15.954 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:15.954 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:15.954 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:15.954 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:15.954 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:15.954 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:15.954 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 252 2024-09-14T09:10:15.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.954 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:15.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:15.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:10:15.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:15.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:10:15.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:15.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796945+0000", 2024-09-14T09:10:15.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2900000000000003e-07 2024-09-14T09:10:15.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:15.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796947+0000", 2024-09-14T09:10:15.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4279999999999999e-06 2024-09-14T09:10:15.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:15.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796954+0000", 2024-09-14T09:10:15.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5479999999999998e-06 2024-09-14T09:10:15.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796959+0000", 2024-09-14T09:10:15.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.22e-06 2024-09-14T09:10:15.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796988+0000", 2024-09-14T09:10:15.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9473000000000001e-05 2024-09-14T09:10:15.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:10:15.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:10:15.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787850+0000", 2024-09-14T09:10:15.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99085651100000005 2024-09-14T09:10:15.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:15.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787891+0000", 2024-09-14T09:10:15.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602000000000002e-05 2024-09-14T09:10:15.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:15.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787969+0000", 2024-09-14T09:10:15.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8063000000000001e-05 2024-09-14T09:10:15.959 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:15.959 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:15.959 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:15.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.959 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:253 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:15.959 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:10:15.959 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 104.141272606, 2024-09-14T09:10:15.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99122695699999996, 2024-09-14T09:10:15.960 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:15.960 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:15.960 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:15.960 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:15.960 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:15.960 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:15.960 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 253 2024-09-14T09:10:15.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.960 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:15.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:15.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:10:15.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:15.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:10:15.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:15.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:10:15.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:10:15.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:15.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:10:15.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:10:15.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:15.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796977+0000", 2024-09-14T09:10:15.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5030000000000002e-06 2024-09-14T09:10:15.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796982+0000", 2024-09-14T09:10:15.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2024-09-14T09:10:15.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797013+0000", 2024-09-14T09:10:15.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0451e-05 2024-09-14T09:10:15.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:10:15.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1690000000000001e-06 2024-09-14T09:10:15.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788011+0000", 2024-09-14T09:10:15.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99099490300000004 2024-09-14T09:10:15.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:15.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788102+0000", 2024-09-14T09:10:15.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0730999999999996e-05 2024-09-14T09:10:15.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:15.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788195+0000", 2024-09-14T09:10:15.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3245999999999995e-05 2024-09-14T09:10:15.964 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:15.964 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:15.964 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:15.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.964 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:254 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3932160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:15.964 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:10:15.964 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 104.141241048, 2024-09-14T09:10:15.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99137410500000001, 2024-09-14T09:10:15.965 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:15.965 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:15.965 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:15.965 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:15.965 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:15.965 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:15.965 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 254 2024-09-14T09:10:15.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.965 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:15.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:15.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:10:15.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:15.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:10:15.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:15.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797000+0000", 2024-09-14T09:10:15.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:10:15.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:15.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797003+0000", 2024-09-14T09:10:15.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7659999999999999e-06 2024-09-14T09:10:15.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:15.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797010+0000", 2024-09-14T09:10:15.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.029e-06 2024-09-14T09:10:15.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:10:15.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2024-09-14T09:10:15.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797044+0000", 2024-09-14T09:10:15.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9213e-05 2024-09-14T09:10:15.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797048+0000", 2024-09-14T09:10:15.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3400000000000002e-06 2024-09-14T09:10:15.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788222+0000", 2024-09-14T09:10:15.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99117407400000002 2024-09-14T09:10:15.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:15.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788306+0000", 2024-09-14T09:10:15.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4512999999999995e-05 2024-09-14T09:10:15.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:15.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788374+0000", 2024-09-14T09:10:15.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7226999999999999e-05 2024-09-14T09:10:15.969 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:15.969 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:15.970 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:15.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.970 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:264 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:15.970 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:10:15.970 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 104.14121469, 2024-09-14T09:10:15.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99161474699999996, 2024-09-14T09:10:15.970 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:15.970 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:15.970 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:15.970 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:15.970 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:15.970 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:15.970 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 264 2024-09-14T09:10:15.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.971 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:15.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:15.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:10:15.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:15.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:10:15.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:15.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:10:15.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2024-09-14T09:10:15.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:15.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:10:15.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2800000000000002e-06 2024-09-14T09:10:15.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:15.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:10:15.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0979999999999999e-06 2024-09-14T09:10:15.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797040+0000", 2024-09-14T09:10:15.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:10:15.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797068+0000", 2024-09-14T09:10:15.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7302999999999999e-05 2024-09-14T09:10:15.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797071+0000", 2024-09-14T09:10:15.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3610000000000001e-06 2024-09-14T09:10:15.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788436+0000", 2024-09-14T09:10:15.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99136489500000002 2024-09-14T09:10:15.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:15.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788538+0000", 2024-09-14T09:10:15.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101931 2024-09-14T09:10:15.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:15.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788641+0000", 2024-09-14T09:10:15.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010273899999999999 2024-09-14T09:10:15.975 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:15.975 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:15.975 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:15.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.975 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:265 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:15.975 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:10:15.975 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 104.141191331, 2024-09-14T09:10:15.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99176878199999996, 2024-09-14T09:10:15.975 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:15.975 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:15.975 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:15.976 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:15.976 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:15.976 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:15.976 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 265 2024-09-14T09:10:15.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.976 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:15.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:15.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:10:15.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:15.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:10:15.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:15.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:10:15.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.39e-07 2024-09-14T09:10:15.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:15.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797052+0000", 2024-09-14T09:10:15.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.345e-06 2024-09-14T09:10:15.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:15.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797058+0000", 2024-09-14T09:10:15.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5429999999999999e-06 2024-09-14T09:10:15.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797064+0000", 2024-09-14T09:10:15.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2000000000000002e-06 2024-09-14T09:10:15.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797091+0000", 2024-09-14T09:10:15.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7804e-05 2024-09-14T09:10:15.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797095+0000", 2024-09-14T09:10:15.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2024-09-14T09:10:15.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788667+0000", 2024-09-14T09:10:15.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157211300000003 2024-09-14T09:10:15.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:15.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788742+0000", 2024-09-14T09:10:15.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5159000000000003e-05 2024-09-14T09:10:15.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:15.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788818+0000", 2024-09-14T09:10:15.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6038000000000006e-05 2024-09-14T09:10:15.980 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:15.981 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:15.981 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:15.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.981 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:266 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:15.981 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:10:15.981 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 104.14116850000001, 2024-09-14T09:10:15.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99193390100000001, 2024-09-14T09:10:15.981 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:15.981 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:15.982 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:15.982 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:15.982 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:15.982 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:15.982 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 266 2024-09-14T09:10:15.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.982 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:15.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:15.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:10:15.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:15.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:10:15.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:15.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:10:15.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:10:15.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:15.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797075+0000", 2024-09-14T09:10:15.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2570000000000002e-06 2024-09-14T09:10:15.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:15.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797082+0000", 2024-09-14T09:10:15.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8029999999999997e-06 2024-09-14T09:10:15.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797088+0000", 2024-09-14T09:10:15.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.468e-06 2024-09-14T09:10:15.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797116+0000", 2024-09-14T09:10:15.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7752000000000001e-05 2024-09-14T09:10:15.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797121+0000", 2024-09-14T09:10:15.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5960000000000003e-06 2024-09-14T09:10:15.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788846+0000", 2024-09-14T09:10:15.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99172512199999996 2024-09-14T09:10:15.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:15.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788916+0000", 2024-09-14T09:10:15.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9843000000000002e-05 2024-09-14T09:10:15.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:15.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789006+0000", 2024-09-14T09:10:15.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9608e-05 2024-09-14T09:10:15.986 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:15.986 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:15.986 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:15.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.986 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:267 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:15.986 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:10:15.986 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 104.141143693, 2024-09-14T09:10:15.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99210926799999999, 2024-09-14T09:10:15.986 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:15.986 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:15.987 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:15.987 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:15.987 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:15.987 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:15.987 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 267 2024-09-14T09:10:15.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.987 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:15.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:15.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:10:15.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:15.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:10:15.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:15.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:10:15.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2399999999999999e-07 2024-09-14T09:10:15.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:15.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797099+0000", 2024-09-14T09:10:15.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.091e-06 2024-09-14T09:10:15.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:15.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797105+0000", 2024-09-14T09:10:15.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-09-14T09:10:15.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797111+0000", 2024-09-14T09:10:15.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5130000000000004e-06 2024-09-14T09:10:15.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797140+0000", 2024-09-14T09:10:15.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9513999999999999e-05 2024-09-14T09:10:15.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797145+0000", 2024-09-14T09:10:15.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:10:15.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789037+0000", 2024-09-14T09:10:15.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99189253899999996 2024-09-14T09:10:15.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:15.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789110+0000", 2024-09-14T09:10:15.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2848000000000005e-05 2024-09-14T09:10:15.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:15.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789206+0000", 2024-09-14T09:10:15.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5778000000000004e-05 2024-09-14T09:10:15.991 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:15.991 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:15.991 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:15.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.991 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:268 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:15.991 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:10:15.991 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 104.141120454, 2024-09-14T09:10:15.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992276359, 2024-09-14T09:10:15.991 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:15.991 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:15.992 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:15.992 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:15.992 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:15.992 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:15.992 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 268 2024-09-14T09:10:15.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.992 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:15.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:15.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:10:15.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:15.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:10:15.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:15.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:10:15.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:10:15.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:15.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797123+0000", 2024-09-14T09:10:15.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2740000000000002e-06 2024-09-14T09:10:15.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:15.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797129+0000", 2024-09-14T09:10:15.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-06 2024-09-14T09:10:15.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797134+0000", 2024-09-14T09:10:15.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9099999999999996e-06 2024-09-14T09:10:15.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797163+0000", 2024-09-14T09:10:15.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9709999999999998e-05 2024-09-14T09:10:15.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:15.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:10:15.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8709999999999999e-06 2024-09-14T09:10:15.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789231+0000", 2024-09-14T09:10:15.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992063959 2024-09-14T09:10:15.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:15.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789306+0000", 2024-09-14T09:10:15.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5289000000000004e-05 2024-09-14T09:10:15.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:15.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789396+0000", 2024-09-14T09:10:15.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9939999999999996e-05 2024-09-14T09:10:15.996 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:15.996 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:15.996 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:15.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.996 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:269 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2457600~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:15.996 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:10:15.996 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 104.141096945, 2024-09-14T09:10:15.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99242174400000005, 2024-09-14T09:10:15.996 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:15.996 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:15.997 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:15.997 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:15.997 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:15.997 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:15.997 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 269 2024-09-14T09:10:15.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.997 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:15.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:15.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:10:15.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:15.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:10:15.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:15.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:15.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:10:15.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:10:15.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:15.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797146+0000", 2024-09-14T09:10:15.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5289999999999998e-06 2024-09-14T09:10:15.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:15.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797153+0000", 2024-09-14T09:10:15.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1920000000000002e-06 2024-09-14T09:10:15.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:15.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797158+0000", 2024-09-14T09:10:15.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099999999999998e-06 2024-09-14T09:10:15.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:15.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:15.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:15.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797188+0000", 2024-09-14T09:10:15.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0128e-05 2024-09-14T09:10:16.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797194+0000", 2024-09-14T09:10:16.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6250000000000004e-06 2024-09-14T09:10:16.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789439+0000", 2024-09-14T09:10:16.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99224531000000005 2024-09-14T09:10:16.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789489+0000", 2024-09-14T09:10:16.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9830000000000002e-05 2024-09-14T09:10:16.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789565+0000", 2024-09-14T09:10:16.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6229000000000005e-05 2024-09-14T09:10:16.001 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.001 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.001 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.001 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:270 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:16.001 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:10:16.002 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 104.141073123, 2024-09-14T09:10:16.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99257721899999996, 2024-09-14T09:10:16.002 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.002 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.002 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.002 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.002 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:16.002 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:16.002 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 270 2024-09-14T09:10:16.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.002 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:10:16.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:10:16.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797168+0000", 2024-09-14T09:10:16.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2024-09-14T09:10:16.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797170+0000", 2024-09-14T09:10:16.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3120000000000001e-06 2024-09-14T09:10:16.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797177+0000", 2024-09-14T09:10:16.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0960000000000003e-06 2024-09-14T09:10:16.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797183+0000", 2024-09-14T09:10:16.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1669999999999998e-06 2024-09-14T09:10:16.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797213+0000", 2024-09-14T09:10:16.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0494e-05 2024-09-14T09:10:16.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:10:16.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:10:16.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789586+0000", 2024-09-14T09:10:16.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99236692100000001 2024-09-14T09:10:16.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789658+0000", 2024-09-14T09:10:16.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2279000000000004e-05 2024-09-14T09:10:16.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789745+0000", 2024-09-14T09:10:16.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6698000000000002e-05 2024-09-14T09:10:16.006 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.006 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.006 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.006 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:271 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3375104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:16.006 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:10:16.007 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 104.141047925, 2024-09-14T09:10:16.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99274791699999998, 2024-09-14T09:10:16.007 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.007 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.007 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.007 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.007 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:16.007 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:16.007 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 271 2024-09-14T09:10:16.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.007 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:10:16.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:10:16.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:10:16.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:10:16.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797195+0000", 2024-09-14T09:10:16.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1639999999999999e-06 2024-09-14T09:10:16.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797201+0000", 2024-09-14T09:10:16.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1290000000000001e-06 2024-09-14T09:10:16.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797206+0000", 2024-09-14T09:10:16.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9300000000000002e-06 2024-09-14T09:10:16.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797237+0000", 2024-09-14T09:10:16.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1285000000000003e-05 2024-09-14T09:10:16.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797242+0000", 2024-09-14T09:10:16.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6e-06 2024-09-14T09:10:16.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789768+0000", 2024-09-14T09:10:16.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99252547400000002 2024-09-14T09:10:16.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789826+0000", 2024-09-14T09:10:16.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8155999999999997e-05 2024-09-14T09:10:16.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789940+0000", 2024-09-14T09:10:16.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114788 2024-09-14T09:10:16.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.011 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.011 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:272 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:16.011 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:10:16.012 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 104.141024531, 2024-09-14T09:10:16.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99285248800000003, 2024-09-14T09:10:16.012 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.012 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.012 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:16.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:16.012 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 272 2024-09-14T09:10:16.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.012 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:10:16.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:10:16.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:10:16.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:10:16.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:10:16.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5129999999999999e-06 2024-09-14T09:10:16.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797226+0000", 2024-09-14T09:10:16.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4529999999999996e-06 2024-09-14T09:10:16.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797232+0000", 2024-09-14T09:10:16.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1839999999999998e-06 2024-09-14T09:10:16.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797264+0000", 2024-09-14T09:10:16.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2691999999999998e-05 2024-09-14T09:10:16.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797270+0000", 2024-09-14T09:10:16.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-06 2024-09-14T09:10:16.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789965+0000", 2024-09-14T09:10:16.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99269526200000002 2024-09-14T09:10:16.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790021+0000", 2024-09-14T09:10:16.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5297000000000003e-05 2024-09-14T09:10:16.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790068+0000", 2024-09-14T09:10:16.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7664999999999998e-05 2024-09-14T09:10:16.016 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.016 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.016 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.016 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:16.016 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:10:16.016 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 59.150768083999999, 2024-09-14T09:10:16.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146649299999999, 2024-09-14T09:10:16.017 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.017 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.017 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:16.017 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.017 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:16.017 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:16.017 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 58987 2024-09-14T09:10:16.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.017 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:10:16.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:10:16.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787474+0000", 2024-09-14T09:10:16.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1799999999999999e-06 2024-09-14T09:10:16.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787483+0000", 2024-09-14T09:10:16.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9830000000000002e-06 2024-09-14T09:10:16.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787494+0000", 2024-09-14T09:10:16.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1496e-05 2024-09-14T09:10:16.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787502+0000", 2024-09-14T09:10:16.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8280000000000003e-06 2024-09-14T09:10:16.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787563+0000", 2024-09-14T09:10:16.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1583999999999999e-05 2024-09-14T09:10:16.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:10:16.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787571+0000", 2024-09-14T09:10:16.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.058e-06 2024-09-14T09:10:16.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.791999+0000", 2024-09-14T09:10:16.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004428675 2024-09-14T09:10:16.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792008+0000", 2024-09-14T09:10:16.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9069999999999996e-06 2024-09-14T09:10:16.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802124+0000", 2024-09-14T09:10:16.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0101154619999999 2024-09-14T09:10:16.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802137+0000", 2024-09-14T09:10:16.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3757000000000001e-05 2024-09-14T09:10:16.021 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.021 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.021 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.021 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:67110 3.5 3.6b6808c5 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:16.021 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:10:16.021 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 59.150635268999999, 2024-09-14T09:10:16.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0147494290000001, 2024-09-14T09:10:16.022 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.022 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.022 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:16.022 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.022 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:16.022 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:16.022 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 67110 2024-09-14T09:10:16.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.022 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:10:16.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:10:16.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787606+0000", 2024-09-14T09:10:16.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6300000000000005e-07 2024-09-14T09:10:16.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787609+0000", 2024-09-14T09:10:16.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2789999999999999e-06 2024-09-14T09:10:16.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787616+0000", 2024-09-14T09:10:16.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8349999999999998e-06 2024-09-14T09:10:16.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787622+0000", 2024-09-14T09:10:16.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6999999999999996e-06 2024-09-14T09:10:16.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787666+0000", 2024-09-14T09:10:16.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3887000000000002e-05 2024-09-14T09:10:16.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:16.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787672+0000", 2024-09-14T09:10:16.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-09-14T09:10:16.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792033+0000", 2024-09-14T09:10:16.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043614250000000004 2024-09-14T09:10:16.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792041+0000", 2024-09-14T09:10:16.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5449999999999998e-06 2024-09-14T09:10:16.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:10:16.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0103013569999999 2024-09-14T09:10:16.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802355+0000", 2024-09-14T09:10:16.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2717999999999999e-05 2024-09-14T09:10:16.026 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.026 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.026 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.026 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72029 3.5 3.3f02ac5 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:16.026 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:10:16.027 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 59.150557753999998, 2024-09-14T09:10:16.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.014715139, 2024-09-14T09:10:16.027 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.027 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.027 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:16.027 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.027 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:16.027 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:16.027 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72029 2024-09-14T09:10:16.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.027 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:10:16.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:10:16.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:10:16.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7599999999999997e-07 2024-09-14T09:10:16.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787686+0000", 2024-09-14T09:10:16.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3999999999999999e-06 2024-09-14T09:10:16.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787692+0000", 2024-09-14T09:10:16.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3489999999999997e-06 2024-09-14T09:10:16.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787697+0000", 2024-09-14T09:10:16.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2320000000000001e-06 2024-09-14T09:10:16.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787742+0000", 2024-09-14T09:10:16.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4557e-05 2024-09-14T09:10:16.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:16.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787748+0000", 2024-09-14T09:10:16.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7810000000000002e-06 2024-09-14T09:10:16.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792065+0000", 2024-09-14T09:10:16.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043178679999999999 2024-09-14T09:10:16.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792073+0000", 2024-09-14T09:10:16.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6329999999999996e-06 2024-09-14T09:10:16.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802388+0000", 2024-09-14T09:10:16.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010315394 2024-09-14T09:10:16.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802398+0000", 2024-09-14T09:10:16.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4490000000000005e-06 2024-09-14T09:10:16.031 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.031 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.032 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.032 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72038 3.5 3.c914e45 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:16.032 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:10:16.032 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 59.150482121000003, 2024-09-14T09:10:16.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146757740000001, 2024-09-14T09:10:16.032 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.032 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.032 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:16.032 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.032 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:16.032 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:16.032 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72038 2024-09-14T09:10:16.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.033 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:10:16.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:10:16.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787759+0000", 2024-09-14T09:10:16.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0100000000000005e-07 2024-09-14T09:10:16.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787761+0000", 2024-09-14T09:10:16.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4049999999999998e-06 2024-09-14T09:10:16.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787768+0000", 2024-09-14T09:10:16.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.314e-06 2024-09-14T09:10:16.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787773+0000", 2024-09-14T09:10:16.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2789999999999998e-06 2024-09-14T09:10:16.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787813+0000", 2024-09-14T09:10:16.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9582000000000002e-05 2024-09-14T09:10:16.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:16.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787818+0000", 2024-09-14T09:10:16.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7100000000000004e-06 2024-09-14T09:10:16.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792096+0000", 2024-09-14T09:10:16.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042776460000000004 2024-09-14T09:10:16.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792103+0000", 2024-09-14T09:10:16.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7129999999999999e-06 2024-09-14T09:10:16.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802427+0000", 2024-09-14T09:10:16.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010324805 2024-09-14T09:10:16.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802434+0000", 2024-09-14T09:10:16.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:10:16.038 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.038 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.039 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.039 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:74840 3.5 3.ab2c8d25 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:16.039 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:10:16.039 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 59.128430236, 2024-09-14T09:10:16.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99271963600000002, 2024-09-14T09:10:16.039 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.039 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.039 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:16.039 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.039 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:16.039 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:16.039 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74840 2024-09-14T09:10:16.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.040 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:10:16.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:10:16.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809812+0000", 2024-09-14T09:10:16.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2899999999999999e-06 2024-09-14T09:10:16.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809817+0000", 2024-09-14T09:10:16.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0139999999999998e-06 2024-09-14T09:10:16.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809834+0000", 2024-09-14T09:10:16.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7643e-05 2024-09-14T09:10:16.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809842+0000", 2024-09-14T09:10:16.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2970000000000004e-06 2024-09-14T09:10:16.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809902+0000", 2024-09-14T09:10:16.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9106e-05 2024-09-14T09:10:16.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809912+0000", 2024-09-14T09:10:16.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0101e-05 2024-09-14T09:10:16.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802520+0000", 2024-09-14T09:10:16.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99260828599999995 2024-09-14T09:10:16.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802530+0000", 2024-09-14T09:10:16.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8989999999999996e-06 2024-09-14T09:10:16.043 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.043 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.043 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.043 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.043 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.044 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:16.045 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:10:16.046 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:16.046+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:16.146 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:16.148+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:16.148 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:16.148 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:16.148 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:10:16.148 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:16.157 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:10:16.246 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:16.249+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:16.261 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:16.261 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:16.261 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:10:16.261 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:10:16.261 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:16.269 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:10:16.348 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:16.350+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:16.414 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:16.414 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:10:16.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:10:16.414 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:10:16.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.414 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5349 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8302592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:10:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 99.159488944000003, 2024-09-14T09:10:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039875928999999997, 2024-09-14T09:10:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:10:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5349 2024-09-14T09:10:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:10:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:10:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255874+0000", 2024-09-14T09:10:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4900000000000001e-07 2024-09-14T09:10:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255880+0000", 2024-09-14T09:10:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9939999999999997e-06 2024-09-14T09:10:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255886+0000", 2024-09-14T09:10:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3899999999999998e-06 2024-09-14T09:10:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255891+0000", 2024-09-14T09:10:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.938e-06 2024-09-14T09:10:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295580+0000", 2024-09-14T09:10:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039688681000000003 2024-09-14T09:10:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295653+0000", 2024-09-14T09:10:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3045000000000003e-05 2024-09-14T09:10:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295749+0000", 2024-09-14T09:10:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6532000000000003e-05 2024-09-14T09:10:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5350 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8364032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:10:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 99.159465136999998, 2024-09-14T09:10:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039989719, 2024-09-14T09:10:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:10:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5350 2024-09-14T09:10:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:10:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:10:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255898+0000", 2024-09-14T09:10:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2024-09-14T09:10:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255899+0000", 2024-09-14T09:10:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9139999999999998e-06 2024-09-14T09:10:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255905+0000", 2024-09-14T09:10:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7289999999999997e-06 2024-09-14T09:10:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255910+0000", 2024-09-14T09:10:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6210000000000003e-06 2024-09-14T09:10:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295775+0000", 2024-09-14T09:10:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039864973999999997 2024-09-14T09:10:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295828+0000", 2024-09-14T09:10:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3411000000000001e-05 2024-09-14T09:10:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295887+0000", 2024-09-14T09:10:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699000000000002e-05 2024-09-14T09:10:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4639 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1843200~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:10:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 78.215549678000002, 2024-09-14T09:10:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040843672999999997, 2024-09-14T09:10:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4639 2024-09-14T09:10:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:10:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:10:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:10:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:10:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199818+0000", 2024-09-14T09:10:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1450000000000001e-06 2024-09-14T09:10:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199827+0000", 2024-09-14T09:10:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3999999999999998e-06 2024-09-14T09:10:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199834+0000", 2024-09-14T09:10:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0809999999999996e-06 2024-09-14T09:10:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240541+0000", 2024-09-14T09:10:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040706941000000003 2024-09-14T09:10:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240584+0000", 2024-09-14T09:10:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3040999999999997e-05 2024-09-14T09:10:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240656+0000", 2024-09-14T09:10:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2200000000000007e-05 2024-09-14T09:10:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4640 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1871872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:10:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 78.215515193000002, 2024-09-14T09:10:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040967601999999999, 2024-09-14T09:10:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4640 2024-09-14T09:10:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:10:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:10:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199848+0000", 2024-09-14T09:10:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5400000000000002e-07 2024-09-14T09:10:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199850+0000", 2024-09-14T09:10:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2479999999999999e-06 2024-09-14T09:10:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199857+0000", 2024-09-14T09:10:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.187e-06 2024-09-14T09:10:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199862+0000", 2024-09-14T09:10:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5119999999999999e-06 2024-09-14T09:10:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240684+0000", 2024-09-14T09:10:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040821245999999999 2024-09-14T09:10:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240739+0000", 2024-09-14T09:10:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4991999999999998e-05 2024-09-14T09:10:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240815+0000", 2024-09-14T09:10:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5963000000000004e-05 2024-09-14T09:10:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4641 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1900544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:10:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 78.215492862999994, 2024-09-14T09:10:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041205512, 2024-09-14T09:10:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4641 2024-09-14T09:10:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:10:16.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:10:16.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199870+0000", 2024-09-14T09:10:16.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0600000000000001e-07 2024-09-14T09:10:16.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199872+0000", 2024-09-14T09:10:16.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.928e-06 2024-09-14T09:10:16.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199877+0000", 2024-09-14T09:10:16.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6949999999999997e-06 2024-09-14T09:10:16.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199882+0000", 2024-09-14T09:10:16.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8210000000000001e-06 2024-09-14T09:10:16.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240847+0000", 2024-09-14T09:10:16.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040965201999999999 2024-09-14T09:10:16.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240888+0000", 2024-09-14T09:10:16.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0754000000000003e-05 2024-09-14T09:10:16.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241075+0000", 2024-09-14T09:10:16.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000186706 2024-09-14T09:10:16.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.440 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.441 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4642 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1929216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:16.441 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:10:16.441 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 78.215473927999994, 2024-09-14T09:10:16.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041292575999999998, 2024-09-14T09:10:16.442 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.442 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.442 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.442 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.442 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:16.442 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:16.443 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4642 2024-09-14T09:10:16.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.443 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:10:16.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:10:16.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199889+0000", 2024-09-14T09:10:16.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2024-09-14T09:10:16.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199891+0000", 2024-09-14T09:10:16.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9e-06 2024-09-14T09:10:16.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199896+0000", 2024-09-14T09:10:16.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6960000000000002e-06 2024-09-14T09:10:16.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199901+0000", 2024-09-14T09:10:16.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6720000000000003e-06 2024-09-14T09:10:16.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241089+0000", 2024-09-14T09:10:16.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041187594000000001 2024-09-14T09:10:16.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241126+0000", 2024-09-14T09:10:16.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7490999999999997e-05 2024-09-14T09:10:16.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241181+0000", 2024-09-14T09:10:16.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4823e-05 2024-09-14T09:10:16.451 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.451 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.451 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.452 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4643 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1957888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:16.452 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:10:16.452 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 78.215454648999994, 2024-09-14T09:10:16.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041418333000000002, 2024-09-14T09:10:16.452 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.452 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.453 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.453 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.453 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:16.453 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:16.453 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4643 2024-09-14T09:10:16.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.454 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:10:16.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:10:16.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:10:16.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5699999999999998e-07 2024-09-14T09:10:16.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199910+0000", 2024-09-14T09:10:16.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.829e-06 2024-09-14T09:10:16.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199916+0000", 2024-09-14T09:10:16.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8499999999999999e-06 2024-09-14T09:10:16.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199920+0000", 2024-09-14T09:10:16.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6530000000000002e-06 2024-09-14T09:10:16.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241211+0000", 2024-09-14T09:10:16.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041290327000000002 2024-09-14T09:10:16.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241257+0000", 2024-09-14T09:10:16.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6347000000000002e-05 2024-09-14T09:10:16.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241326+0000", 2024-09-14T09:10:16.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8969999999999999e-05 2024-09-14T09:10:16.462 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.462 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.462 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.463 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4644 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1986560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:16.463 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:10:16.463 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 78.215436308999998, 2024-09-14T09:10:16.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041596269999999998, 2024-09-14T09:10:16.463 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.463 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.464 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:16.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:16.464 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4644 2024-09-14T09:10:16.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.465 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:10:16.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:10:16.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:10:16.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.41e-07 2024-09-14T09:10:16.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199928+0000", 2024-09-14T09:10:16.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8250000000000001e-06 2024-09-14T09:10:16.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199934+0000", 2024-09-14T09:10:16.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2280000000000003e-06 2024-09-14T09:10:16.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199939+0000", 2024-09-14T09:10:16.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8010000000000003e-06 2024-09-14T09:10:16.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241360+0000", 2024-09-14T09:10:16.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041421289 2024-09-14T09:10:16.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241435+0000", 2024-09-14T09:10:16.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4238000000000003e-05 2024-09-14T09:10:16.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241522+0000", 2024-09-14T09:10:16.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7547999999999996e-05 2024-09-14T09:10:16.472 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.473 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.473 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.473 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4645 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:16.473 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:10:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 78.215417402, 2024-09-14T09:10:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041714660000000001, 2024-09-14T09:10:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4645 2024-09-14T09:10:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.475 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:10:16.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:10:16.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:10:16.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4700000000000002e-07 2024-09-14T09:10:16.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199947+0000", 2024-09-14T09:10:16.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.801e-06 2024-09-14T09:10:16.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199953+0000", 2024-09-14T09:10:16.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.694e-06 2024-09-14T09:10:16.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199957+0000", 2024-09-14T09:10:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3069999999999996e-06 2024-09-14T09:10:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241547+0000", 2024-09-14T09:10:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041589895000000002 2024-09-14T09:10:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241590+0000", 2024-09-14T09:10:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2985000000000003e-05 2024-09-14T09:10:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241660+0000", 2024-09-14T09:10:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9630999999999998e-05 2024-09-14T09:10:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4646 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2043904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:10:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 78.215399414000004, 2024-09-14T09:10:16.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041827171000000003, 2024-09-14T09:10:16.481 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.481 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.481 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:16.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:16.481 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4646 2024-09-14T09:10:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:10:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:10:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:10:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6300000000000001e-07 2024-09-14T09:10:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199965+0000", 2024-09-14T09:10:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.035e-06 2024-09-14T09:10:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199973+0000", 2024-09-14T09:10:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9629999999999998e-06 2024-09-14T09:10:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199978+0000", 2024-09-14T09:10:16.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9069999999999998e-06 2024-09-14T09:10:16.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241677+0000", 2024-09-14T09:10:16.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041698662999999997 2024-09-14T09:10:16.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241717+0000", 2024-09-14T09:10:16.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602999999999997e-05 2024-09-14T09:10:16.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241790+0000", 2024-09-14T09:10:16.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2637000000000003e-05 2024-09-14T09:10:16.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.488 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.488 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.488 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4647 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2072576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:16.489 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:10:16.489 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 78.215370824000004, 2024-09-14T09:10:16.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041921189999999997, 2024-09-14T09:10:16.489 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.489 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.489 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.490 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.490 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:16.490 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:16.490 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4647 2024-09-14T09:10:16.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.490 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:10:16.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:10:16.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199992+0000", 2024-09-14T09:10:16.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3799999999999997e-07 2024-09-14T09:10:16.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199994+0000", 2024-09-14T09:10:16.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3020000000000002e-06 2024-09-14T09:10:16.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200004+0000", 2024-09-14T09:10:16.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3510000000000008e-06 2024-09-14T09:10:16.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200008+0000", 2024-09-14T09:10:16.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3329999999999998e-06 2024-09-14T09:10:16.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241814+0000", 2024-09-14T09:10:16.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041806280000000001 2024-09-14T09:10:16.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241855+0000", 2024-09-14T09:10:16.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0173999999999999e-05 2024-09-14T09:10:16.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241913+0000", 2024-09-14T09:10:16.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8112000000000002e-05 2024-09-14T09:10:16.499 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.499 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.499 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.499 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:59017 3.3 3:c1df81d6:::rbd_data.1112a10502fe.0000000000000189:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:16.499 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:10:16.499 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 59.628080222999998, 2024-09-14T09:10:16.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.024252111, 2024-09-14T09:10:16.500 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.500 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.500 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:16.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:16.500 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59017 2024-09-14T09:10:16.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.500 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:10:16.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:10:16.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787284+0000", 2024-09-14T09:10:16.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3879999999999998e-06 2024-09-14T09:10:16.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787297+0000", 2024-09-14T09:10:16.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2184999999999999e-05 2024-09-14T09:10:16.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787317+0000", 2024-09-14T09:10:16.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0054000000000001e-05 2024-09-14T09:10:16.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787327+0000", 2024-09-14T09:10:16.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0335e-05 2024-09-14T09:10:16.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787412+0000", 2024-09-14T09:10:16.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4691000000000006e-05 2024-09-14T09:10:16.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:10:16.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787422+0000", 2024-09-14T09:10:16.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0718e-05 2024-09-14T09:10:16.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790539+0000", 2024-09-14T09:10:16.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031164600000000002 2024-09-14T09:10:16.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790552+0000", 2024-09-14T09:10:16.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2736e-05 2024-09-14T09:10:16.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.798725+0000", 2024-09-14T09:10:16.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0081731860000001 2024-09-14T09:10:16.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.798824+0000", 2024-09-14T09:10:16.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9600999999999997e-05 2024-09-14T09:10:16.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.811534+0000", 2024-09-14T09:10:16.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012709757 2024-09-14T09:10:16.505 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.505 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.505 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.505 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:63586 3.3 3:c0d9272b:::rbd_data.1112a10502fe.00000000000001a2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:16.505 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:10:16.506 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 59.628008739999999, 2024-09-14T09:10:16.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0244069650000001, 2024-09-14T09:10:16.506 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.506 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.506 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.506 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.506 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:16.506 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:16.506 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 63586 2024-09-14T09:10:16.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.506 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:10:16.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:10:16.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:10:16.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2024-09-14T09:10:16.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787357+0000", 2024-09-14T09:10:16.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8720000000000002e-06 2024-09-14T09:10:16.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787365+0000", 2024-09-14T09:10:16.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9270000000000005e-06 2024-09-14T09:10:16.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787372+0000", 2024-09-14T09:10:16.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6810000000000001e-06 2024-09-14T09:10:16.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787479+0000", 2024-09-14T09:10:16.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010736800000000001 2024-09-14T09:10:16.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:16.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787485+0000", 2024-09-14T09:10:16.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.054e-06 2024-09-14T09:10:16.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790580+0000", 2024-09-14T09:10:16.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030949929999999999 2024-09-14T09:10:16.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790589+0000", 2024-09-14T09:10:16.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7600000000000008e-06 2024-09-14T09:10:16.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.799541+0000", 2024-09-14T09:10:16.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0089520110000001 2024-09-14T09:10:16.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.799620+0000", 2024-09-14T09:10:16.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8969999999999998e-05 2024-09-14T09:10:16.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.811760+0000", 2024-09-14T09:10:16.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012140748999999999 2024-09-14T09:10:16.511 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.511 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.511 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.512 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:65817 3.3 3:c2c49fe0:::rbd_data.1112a10502fe.00000000000001b3:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:16.512 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:10:16.512 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 59.627918938000001, 2024-09-14T09:10:16.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0253660200000001, 2024-09-14T09:10:16.512 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.512 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.512 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.512 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.512 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:16.512 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:16.512 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 65817 2024-09-14T09:10:16.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.512 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:10:16.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:10:16.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787444+0000", 2024-09-14T09:10:16.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999995e-07 2024-09-14T09:10:16.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787448+0000", 2024-09-14T09:10:16.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1420000000000003e-06 2024-09-14T09:10:16.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787497+0000", 2024-09-14T09:10:16.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8507999999999997e-05 2024-09-14T09:10:16.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787503+0000", 2024-09-14T09:10:16.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1319999999999999e-06 2024-09-14T09:10:16.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787595+0000", 2024-09-14T09:10:16.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1748000000000003e-05 2024-09-14T09:10:16.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:16.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787601+0000", 2024-09-14T09:10:16.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6150000000000002e-06 2024-09-14T09:10:16.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790613+0000", 2024-09-14T09:10:16.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003012228 2024-09-14T09:10:16.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790621+0000", 2024-09-14T09:10:16.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9219999999999997e-06 2024-09-14T09:10:16.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800130+0000", 2024-09-14T09:10:16.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.009508474 2024-09-14T09:10:16.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800257+0000", 2024-09-14T09:10:16.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012746900000000001 2024-09-14T09:10:16.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.812809+0000", 2024-09-14T09:10:16.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012552054 2024-09-14T09:10:16.517 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.517 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.517 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.518 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:68709 3.3 3:c4996abd:::rbd_data.1112a10502fe.00000000000001cd:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:16.518 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:10:16.518 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 59.627747992000003, 2024-09-14T09:10:16.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0254506109999999, 2024-09-14T09:10:16.518 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.518 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.518 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.518 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.518 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:16.518 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:16.518 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 68709 2024-09-14T09:10:16.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.518 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:10:16.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:10:16.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787615+0000", 2024-09-14T09:10:16.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4000000000000001e-07 2024-09-14T09:10:16.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787618+0000", 2024-09-14T09:10:16.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2780000000000002e-06 2024-09-14T09:10:16.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787626+0000", 2024-09-14T09:10:16.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0250000000000002e-06 2024-09-14T09:10:16.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787633+0000", 2024-09-14T09:10:16.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5660000000000003e-06 2024-09-14T09:10:16.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787714+0000", 2024-09-14T09:10:16.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1695999999999998e-05 2024-09-14T09:10:16.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:16.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787721+0000", 2024-09-14T09:10:16.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1109999999999996e-06 2024-09-14T09:10:16.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790646+0000", 2024-09-14T09:10:16.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029251730000000001 2024-09-14T09:10:16.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790653+0000", 2024-09-14T09:10:16.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4379999999999998e-06 2024-09-14T09:10:16.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800750+0000", 2024-09-14T09:10:16.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010097236 2024-09-14T09:10:16.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800883+0000", 2024-09-14T09:10:16.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000132466 2024-09-14T09:10:16.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813065+0000", 2024-09-14T09:10:16.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012181981999999999 2024-09-14T09:10:16.523 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.523 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.523 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.523 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:74823 3.3 3:c59acf89:::rbd_data.1112a10502fe.00000000000001fb:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:16.524 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:10:16.524 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 59.606913519999999, 2024-09-14T09:10:16.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.004859323, 2024-09-14T09:10:16.524 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.524 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.524 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.524 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.524 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:16.524 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:16.524 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74823 2024-09-14T09:10:16.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.524 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:10:16.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:10:16.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808450+0000", 2024-09-14T09:10:16.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.92e-07 2024-09-14T09:10:16.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808454+0000", 2024-09-14T09:10:16.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3660000000000002e-06 2024-09-14T09:10:16.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808463+0000", 2024-09-14T09:10:16.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1579999999999994e-06 2024-09-14T09:10:16.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808470+0000", 2024-09-14T09:10:16.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7599999999999997e-06 2024-09-14T09:10:16.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808540+0000", 2024-09-14T09:10:16.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9991000000000001e-05 2024-09-14T09:10:16.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808550+0000", 2024-09-14T09:10:16.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0282000000000001e-05 2024-09-14T09:10:16.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801352+0000", 2024-09-14T09:10:16.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99280192700000003 2024-09-14T09:10:16.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801472+0000", 2024-09-14T09:10:16.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120184 2024-09-14T09:10:16.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813308+0000", 2024-09-14T09:10:16.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011835863 2024-09-14T09:10:16.528 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.528 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.528 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.528 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:86789 3.3 3:c3063f19:::rbd_data.1112a10502fe.000000000000023a:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:16.528 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:10:16.528 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.834690795, 2024-09-14T09:10:16.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.23302192099999999, 2024-09-14T09:10:16.529 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.529 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.529 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.529 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.529 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:16.529 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:16.529 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86789 2024-09-14T09:10:16.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.529 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:10:16.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:10:16.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580672+0000", 2024-09-14T09:10:16.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7999999999999993e-07 2024-09-14T09:10:16.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580680+0000", 2024-09-14T09:10:16.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7540000000000006e-06 2024-09-14T09:10:16.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580694+0000", 2024-09-14T09:10:16.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3344e-05 2024-09-14T09:10:16.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580702+0000", 2024-09-14T09:10:16.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9510000000000006e-06 2024-09-14T09:10:16.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580778+0000", 2024-09-14T09:10:16.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6580000000000002e-05 2024-09-14T09:10:16.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580788+0000", 2024-09-14T09:10:16.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0327e-05 2024-09-14T09:10:16.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801980+0000", 2024-09-14T09:10:16.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.22119123900000001 2024-09-14T09:10:16.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802115+0000", 2024-09-14T09:10:16.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013572000000000001 2024-09-14T09:10:16.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813693+0000", 2024-09-14T09:10:16.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011578026 2024-09-14T09:10:16.533 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.533 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.533 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.534 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:89485 3.3 3:c3eae671:::rbd_data.1112a10502fe.0000000000000248:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:16.534 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:10:16.534 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.729834300999997, 2024-09-14T09:10:16.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.12841583300000001, 2024-09-14T09:10:16.534 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.534 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.534 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.534 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.534 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:16.534 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:16.534 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 89485 2024-09-14T09:10:16.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.535 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:10:16.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:10:16.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685529+0000", 2024-09-14T09:10:16.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.11e-06 2024-09-14T09:10:16.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685534+0000", 2024-09-14T09:10:16.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0289999999999996e-06 2024-09-14T09:10:16.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685546+0000", 2024-09-14T09:10:16.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2062000000000001e-05 2024-09-14T09:10:16.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685554+0000", 2024-09-14T09:10:16.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7889999999999995e-06 2024-09-14T09:10:16.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685618+0000", 2024-09-14T09:10:16.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4487999999999996e-05 2024-09-14T09:10:16.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685628+0000", 2024-09-14T09:10:16.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5840000000000001e-06 2024-09-14T09:10:16.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802613+0000", 2024-09-14T09:10:16.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.116984703 2024-09-14T09:10:16.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802768+0000", 2024-09-14T09:10:16.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015541599999999999 2024-09-14T09:10:16.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813944+0000", 2024-09-14T09:10:16.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011175651999999999 2024-09-14T09:10:16.538 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.538 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.538 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.539 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:90751 3.3 3:c22bfcfe:::rbd_data.1112a10502fe.000000000000024e:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:16.539 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:10:16.539 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.678763517, 2024-09-14T09:10:16.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077582650000000003, 2024-09-14T09:10:16.539 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.539 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.539 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.539 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.539 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:16.539 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:16.539 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 90751 2024-09-14T09:10:16.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.540 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:10:16.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:10:16.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736600+0000", 2024-09-14T09:10:16.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.71e-07 2024-09-14T09:10:16.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736608+0000", 2024-09-14T09:10:16.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2679999999999994e-06 2024-09-14T09:10:16.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736620+0000", 2024-09-14T09:10:16.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2064e-05 2024-09-14T09:10:16.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736627+0000", 2024-09-14T09:10:16.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8129999999999998e-06 2024-09-14T09:10:16.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736676+0000", 2024-09-14T09:10:16.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.901e-05 2024-09-14T09:10:16.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736685+0000", 2024-09-14T09:10:16.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:10:16.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803227+0000", 2024-09-14T09:10:16.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066541874000000001 2024-09-14T09:10:16.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803381+0000", 2024-09-14T09:10:16.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015482500000000001 2024-09-14T09:10:16.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.814181+0000", 2024-09-14T09:10:16.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010799944000000001 2024-09-14T09:10:16.544 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.544 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.544 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.544 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:90760 3.3 3:c116ad26:::rbd_data.1112a10502fe.0000000000000251:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:16.544 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:10:16.544 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.678661200000001, 2024-09-14T09:10:16.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077694599000000003, 2024-09-14T09:10:16.544 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.544 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.544 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:16.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:16.545 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 90760 2024-09-14T09:10:16.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.545 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:10:16.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:10:16.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736702+0000", 2024-09-14T09:10:16.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0999999999999998e-07 2024-09-14T09:10:16.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736705+0000", 2024-09-14T09:10:16.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0120000000000001e-06 2024-09-14T09:10:16.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736711+0000", 2024-09-14T09:10:16.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6279999999999999e-06 2024-09-14T09:10:16.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736717+0000", 2024-09-14T09:10:16.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6200000000000004e-06 2024-09-14T09:10:16.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736765+0000", 2024-09-14T09:10:16.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7688000000000001e-05 2024-09-14T09:10:16.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736772+0000", 2024-09-14T09:10:16.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6529999999999994e-06 2024-09-14T09:10:16.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803886+0000", 2024-09-14T09:10:16.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067113795000000004 2024-09-14T09:10:16.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.804024+0000", 2024-09-14T09:10:16.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013782000000000001 2024-09-14T09:10:16.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.814396+0000", 2024-09-14T09:10:16.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010371773000000001 2024-09-14T09:10:16.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.549 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.549 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.549 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:16.551 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:16.553+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:16.551 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:10:16.652 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:16.653+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:16.655 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:16.655 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:16.655 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:10:16.655 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:16.664 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:10:16.752 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:16.754+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:16.813 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:16.813 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:16.813 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:10:16.813 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:10:16.813 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:16.822 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:10:16.863 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:16.864+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:16.954 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:16.956+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:16.961 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T09:10:16.970 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:16.970 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:10:16.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:10:16.970 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:10:16.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.971 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:228 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 360448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:16.971 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:10:16.971 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 105.174955837, 2024-09-14T09:10:16.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99234476999999999, 2024-09-14T09:10:16.971 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.971 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.971 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:16.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:16.971 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 228 2024-09-14T09:10:16.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.971 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:10:16.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:10:16.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796906+0000", 2024-09-14T09:10:16.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9399999999999995e-07 2024-09-14T09:10:16.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796917+0000", 2024-09-14T09:10:16.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0801e-05 2024-09-14T09:10:16.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796924+0000", 2024-09-14T09:10:16.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7750000000000004e-06 2024-09-14T09:10:16.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:10:16.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9972000000000001e-05 2024-09-14T09:10:16.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798671+0000", 2024-09-14T09:10:16.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017271330000000001 2024-09-14T09:10:16.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798675+0000", 2024-09-14T09:10:16.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.194e-06 2024-09-14T09:10:16.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789003+0000", 2024-09-14T09:10:16.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99032768400000004 2024-09-14T09:10:16.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789115+0000", 2024-09-14T09:10:16.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112236 2024-09-14T09:10:16.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789250+0000", 2024-09-14T09:10:16.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013548100000000001 2024-09-14T09:10:16.975 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.975 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.975 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.976 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:229 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 819200~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:16.976 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:10:16.976 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 105.174903614, 2024-09-14T09:10:16.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99287024599999996, 2024-09-14T09:10:16.976 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.976 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.976 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.976 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.976 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:16.976 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:16.976 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 229 2024-09-14T09:10:16.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.977 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:10:16.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:10:16.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:10:16.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999999e-07 2024-09-14T09:10:16.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796962+0000", 2024-09-14T09:10:16.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1479999999999999e-06 2024-09-14T09:10:16.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796967+0000", 2024-09-14T09:10:16.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1499999999999998e-06 2024-09-14T09:10:16.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:10:16.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-06 2024-09-14T09:10:16.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798688+0000", 2024-09-14T09:10:16.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017172660000000001 2024-09-14T09:10:16.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798691+0000", 2024-09-14T09:10:16.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:10:16.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789599+0000", 2024-09-14T09:10:16.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99090839399999997 2024-09-14T09:10:16.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789716+0000", 2024-09-14T09:10:16.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116474 2024-09-14T09:10:16.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789828+0000", 2024-09-14T09:10:16.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112293 2024-09-14T09:10:16.981 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.981 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.981 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.981 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:230 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1277952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:16.981 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:10:16.981 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 105.174882966, 2024-09-14T09:10:16.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99307501600000003, 2024-09-14T09:10:16.981 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.982 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.982 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.982 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.982 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:16.982 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:16.982 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 230 2024-09-14T09:10:16.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.982 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:10:16.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:10:16.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796979+0000", 2024-09-14T09:10:16.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.34e-07 2024-09-14T09:10:16.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796980+0000", 2024-09-14T09:10:16.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.53e-06 2024-09-14T09:10:16.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796986+0000", 2024-09-14T09:10:16.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9989999999999997e-06 2024-09-14T09:10:16.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796989+0000", 2024-09-14T09:10:16.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0340000000000001e-06 2024-09-14T09:10:16.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798702+0000", 2024-09-14T09:10:16.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001712756 2024-09-14T09:10:16.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798705+0000", 2024-09-14T09:10:16.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7750000000000001e-06 2024-09-14T09:10:16.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789870+0000", 2024-09-14T09:10:16.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991165026 2024-09-14T09:10:16.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789955+0000", 2024-09-14T09:10:16.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4839999999999994e-05 2024-09-14T09:10:16.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790053+0000", 2024-09-14T09:10:16.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8721999999999994e-05 2024-09-14T09:10:16.986 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.987 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.987 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.987 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:231 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:16.987 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:10:16.987 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 105.17486763799999, 2024-09-14T09:10:16.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99319130300000003, 2024-09-14T09:10:16.987 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.987 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.987 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.987 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.987 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:16.987 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:16.988 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 231 2024-09-14T09:10:16.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.988 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:10:16.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:10:16.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:10:16.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2024-09-14T09:10:16.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796995+0000", 2024-09-14T09:10:16.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2500000000000001e-06 2024-09-14T09:10:16.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796998+0000", 2024-09-14T09:10:16.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3230000000000002e-06 2024-09-14T09:10:16.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797001+0000", 2024-09-14T09:10:16.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7099999999999999e-06 2024-09-14T09:10:16.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798718+0000", 2024-09-14T09:10:16.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017168070000000001 2024-09-14T09:10:16.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798721+0000", 2024-09-14T09:10:16.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.853e-06 2024-09-14T09:10:16.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790077+0000", 2024-09-14T09:10:16.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991356393 2024-09-14T09:10:16.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790129+0000", 2024-09-14T09:10:16.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2240999999999997e-05 2024-09-14T09:10:16.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790185+0000", 2024-09-14T09:10:16.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5515e-05 2024-09-14T09:10:16.992 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.992 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.992 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.992 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:232 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2195456~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:16.992 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:10:16.992 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 105.17485698199999, 2024-09-14T09:10:16.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99329117899999997, 2024-09-14T09:10:16.993 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.993 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.993 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.993 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.993 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:16.993 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:16.993 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 232 2024-09-14T09:10:16.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.993 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:10:16.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:10:16.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:16.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797005+0000", 2024-09-14T09:10:16.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2024-09-14T09:10:16.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:16.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797006+0000", 2024-09-14T09:10:16.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3200000000000001e-06 2024-09-14T09:10:16.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:16.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797009+0000", 2024-09-14T09:10:16.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4680000000000001e-06 2024-09-14T09:10:16.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:16.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797012+0000", 2024-09-14T09:10:16.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4770000000000002e-06 2024-09-14T09:10:16.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798743+0000", 2024-09-14T09:10:16.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017312 2024-09-14T09:10:16.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:16.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798747+0000", 2024-09-14T09:10:16.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.484e-06 2024-09-14T09:10:16.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:16.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790201+0000", 2024-09-14T09:10:16.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99145419499999998 2024-09-14T09:10:16.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:16.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790241+0000", 2024-09-14T09:10:16.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0587999999999998e-05 2024-09-14T09:10:16.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:16.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790296+0000", 2024-09-14T09:10:16.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4212000000000002e-05 2024-09-14T09:10:16.997 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.997 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:16.998 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:16.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.998 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:233 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2654208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:16.998 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:10:16.998 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 105.174846359, 2024-09-14T09:10:16.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99337220100000001, 2024-09-14T09:10:16.998 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:16.998 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:16.998 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:16.998 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:16.998 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:16.998 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:16.998 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 233 2024-09-14T09:10:16.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.999 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:16.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:16.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:10:16.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:16.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:10:16.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:16.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:16.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:16.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:17.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:10:17.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:10:17.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:17.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:10:17.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.269e-06 2024-09-14T09:10:17.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:17.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797019+0000", 2024-09-14T09:10:17.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9519999999999999e-06 2024-09-14T09:10:17.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797022+0000", 2024-09-14T09:10:17.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6079999999999998e-06 2024-09-14T09:10:17.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798759+0000", 2024-09-14T09:10:17.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001737342 2024-09-14T09:10:17.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798762+0000", 2024-09-14T09:10:17.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:10:17.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790310+0000", 2024-09-14T09:10:17.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99154738799999997 2024-09-14T09:10:17.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:17.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790349+0000", 2024-09-14T09:10:17.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9573000000000002e-05 2024-09-14T09:10:17.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:17.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790387+0000", 2024-09-14T09:10:17.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7985999999999998e-05 2024-09-14T09:10:17.003 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.003 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:17.003 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.003 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:234 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3112960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:17.003 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:10:17.003 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 105.174836314, 2024-09-14T09:10:17.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99345674500000003, 2024-09-14T09:10:17.003 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:17.003 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:17.003 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:17.003 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:17.003 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:17.004 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:17.004 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 234 2024-09-14T09:10:17.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.004 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:17.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:17.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:10:17.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:17.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:10:17.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:17.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:10:17.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0100000000000001e-07 2024-09-14T09:10:17.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:17.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:10:17.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0699999999999999e-06 2024-09-14T09:10:17.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:17.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:10:17.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.886e-06 2024-09-14T09:10:17.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797032+0000", 2024-09-14T09:10:17.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7149999999999998e-06 2024-09-14T09:10:17.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798778+0000", 2024-09-14T09:10:17.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017460329999999999 2024-09-14T09:10:17.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798783+0000", 2024-09-14T09:10:17.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0760000000000002e-06 2024-09-14T09:10:17.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790408+0000", 2024-09-14T09:10:17.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99162473299999998 2024-09-14T09:10:17.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:17.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790446+0000", 2024-09-14T09:10:17.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8389000000000001e-05 2024-09-14T09:10:17.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:17.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790482+0000", 2024-09-14T09:10:17.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5642000000000002e-05 2024-09-14T09:10:17.008 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.008 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:17.008 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.008 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:235 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3571712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:17.008 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:10:17.008 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 105.174826416, 2024-09-14T09:10:17.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993539477, 2024-09-14T09:10:17.009 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:17.009 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:17.009 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:17.009 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:17.009 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:17.009 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:17.009 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 235 2024-09-14T09:10:17.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.009 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:17.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:17.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:10:17.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:17.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:10:17.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:17.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:10:17.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9999999999999999e-07 2024-09-14T09:10:17.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:17.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797036+0000", 2024-09-14T09:10:17.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.051e-06 2024-09-14T09:10:17.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:17.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797039+0000", 2024-09-14T09:10:17.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:10:17.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797042+0000", 2024-09-14T09:10:17.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5280000000000002e-06 2024-09-14T09:10:17.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798809+0000", 2024-09-14T09:10:17.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001767394 2024-09-14T09:10:17.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798815+0000", 2024-09-14T09:10:17.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0859999999999998e-06 2024-09-14T09:10:17.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790502+0000", 2024-09-14T09:10:17.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99168652300000004 2024-09-14T09:10:17.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:17.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790539+0000", 2024-09-14T09:10:17.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7471000000000001e-05 2024-09-14T09:10:17.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:17.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790574+0000", 2024-09-14T09:10:17.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5292e-05 2024-09-14T09:10:17.013 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.013 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:17.013 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.013 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:236 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 4030464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:17.014 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:10:17.014 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 105.174816183, 2024-09-14T09:10:17.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993619743, 2024-09-14T09:10:17.014 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:17.014 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:17.014 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:17.014 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:17.014 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:17.014 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:17.014 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 236 2024-09-14T09:10:17.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.014 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:17.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:17.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:10:17.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:17.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:10:17.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:17.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:10:17.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1400000000000001e-07 2024-09-14T09:10:17.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:17.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797047+0000", 2024-09-14T09:10:17.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3400000000000001e-06 2024-09-14T09:10:17.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:17.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:10:17.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0699999999999998e-06 2024-09-14T09:10:17.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797053+0000", 2024-09-14T09:10:17.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7310000000000002e-06 2024-09-14T09:10:17.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798839+0000", 2024-09-14T09:10:17.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001786403 2024-09-14T09:10:17.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798844+0000", 2024-09-14T09:10:17.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3730000000000001e-06 2024-09-14T09:10:17.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790592+0000", 2024-09-14T09:10:17.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99174818099999995 2024-09-14T09:10:17.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:17.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790628+0000", 2024-09-14T09:10:17.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5831000000000003e-05 2024-09-14T09:10:17.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:17.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790665+0000", 2024-09-14T09:10:17.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-05 2024-09-14T09:10:17.018 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.018 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:17.019 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.019 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:365 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:17.019 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:10:17.019 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 105.172629155, 2024-09-14T09:10:17.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157278400000004, 2024-09-14T09:10:17.019 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:17.019 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:17.019 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:17.019 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:17.019 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:17.019 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:17.019 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 365 2024-09-14T09:10:17.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.020 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:17.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:17.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:10:17.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:17.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:10:17.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:17.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:10:17.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:10:17.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:17.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799233+0000", 2024-09-14T09:10:17.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.057e-06 2024-09-14T09:10:17.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:17.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799236+0000", 2024-09-14T09:10:17.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0249999999999998e-06 2024-09-14T09:10:17.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799239+0000", 2024-09-14T09:10:17.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.481e-06 2024-09-14T09:10:17.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800963+0000", 2024-09-14T09:10:17.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017240440000000001 2024-09-14T09:10:17.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800969+0000", 2024-09-14T09:10:17.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1410000000000002e-06 2024-09-14T09:10:17.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790682+0000", 2024-09-14T09:10:17.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98971330300000004 2024-09-14T09:10:17.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:17.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790753+0000", 2024-09-14T09:10:17.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0548000000000003e-05 2024-09-14T09:10:17.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:17.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790805+0000", 2024-09-14T09:10:17.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1981999999999998e-05 2024-09-14T09:10:17.024 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.024 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:17.024 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.024 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:366 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:17.024 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:10:17.024 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 105.172619062, 2024-09-14T09:10:17.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99173757299999998, 2024-09-14T09:10:17.024 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:17.024 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:17.024 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:17.024 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:17.024 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:17.025 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:17.025 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 366 2024-09-14T09:10:17.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.025 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:17.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:17.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:10:17.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:17.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:10:17.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:17.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:10:17.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-07 2024-09-14T09:10:17.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:17.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799244+0000", 2024-09-14T09:10:17.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.359e-06 2024-09-14T09:10:17.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:17.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799247+0000", 2024-09-14T09:10:17.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4929999999999998e-06 2024-09-14T09:10:17.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799250+0000", 2024-09-14T09:10:17.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:10:17.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800991+0000", 2024-09-14T09:10:17.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017412809999999999 2024-09-14T09:10:17.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800997+0000", 2024-09-14T09:10:17.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:10:17.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790824+0000", 2024-09-14T09:10:17.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98982735399999999 2024-09-14T09:10:17.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:17.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790891+0000", 2024-09-14T09:10:17.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7243999999999995e-05 2024-09-14T09:10:17.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:17.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790980+0000", 2024-09-14T09:10:17.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8608000000000003e-05 2024-09-14T09:10:17.029 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.029 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:17.029 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.029 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:367 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:17.029 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:10:17.029 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 105.17260769000001, 2024-09-14T09:10:17.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99188259999999995, 2024-09-14T09:10:17.029 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:17.030 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:17.030 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:17.030 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:17.030 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:17.030 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:17.030 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 367 2024-09-14T09:10:17.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.030 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:17.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:17.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:10:17.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:17.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:10:17.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:17.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:10:17.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-07 2024-09-14T09:10:17.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:17.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799255+0000", 2024-09-14T09:10:17.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.111e-06 2024-09-14T09:10:17.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:17.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799259+0000", 2024-09-14T09:10:17.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8650000000000003e-06 2024-09-14T09:10:17.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799262+0000", 2024-09-14T09:10:17.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.128e-06 2024-09-14T09:10:17.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801029+0000", 2024-09-14T09:10:17.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017668460000000001 2024-09-14T09:10:17.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801032+0000", 2024-09-14T09:10:17.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3179999999999998e-06 2024-09-14T09:10:17.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791011+0000", 2024-09-14T09:10:17.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98997920399999995 2024-09-14T09:10:17.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:17.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791077+0000", 2024-09-14T09:10:17.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5214000000000003e-05 2024-09-14T09:10:17.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:17.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791136+0000", 2024-09-14T09:10:17.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9710000000000003e-05 2024-09-14T09:10:17.034 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.034 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:17.034 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.034 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:368 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:17.035 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:10:17.035 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 105.17259614699999, 2024-09-14T09:10:17.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99201753800000003, 2024-09-14T09:10:17.035 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:17.035 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:17.035 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:17.035 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:17.035 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:17.035 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:17.035 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 368 2024-09-14T09:10:17.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.035 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:17.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:17.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:10:17.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:17.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:10:17.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:17.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:10:17.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4900000000000002e-07 2024-09-14T09:10:17.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:17.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799267+0000", 2024-09-14T09:10:17.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.079e-06 2024-09-14T09:10:17.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:17.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799270+0000", 2024-09-14T09:10:17.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.993e-06 2024-09-14T09:10:17.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799272+0000", 2024-09-14T09:10:17.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.695e-06 2024-09-14T09:10:17.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801043+0000", 2024-09-14T09:10:17.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001771105 2024-09-14T09:10:17.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801046+0000", 2024-09-14T09:10:17.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7999999999999999e-06 2024-09-14T09:10:17.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791150+0000", 2024-09-14T09:10:17.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99010348699999995 2024-09-14T09:10:17.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:17.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791193+0000", 2024-09-14T09:10:17.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3615999999999997e-05 2024-09-14T09:10:17.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:17.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791283+0000", 2024-09-14T09:10:17.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9513999999999997e-05 2024-09-14T09:10:17.039 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.039 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:17.040 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.040 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:369 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:17.040 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:10:17.040 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 105.172585809, 2024-09-14T09:10:17.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99213433600000001, 2024-09-14T09:10:17.040 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:17.040 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:17.040 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:17.040 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:17.040 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:17.040 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:17.041 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 369 2024-09-14T09:10:17.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.041 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:17.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:17.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:10:17.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:17.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:10:17.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:17.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:10:17.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:10:17.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:17.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799277+0000", 2024-09-14T09:10:17.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.108e-06 2024-09-14T09:10:17.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:17.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799280+0000", 2024-09-14T09:10:17.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:10:17.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799283+0000", 2024-09-14T09:10:17.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.531e-06 2024-09-14T09:10:17.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801058+0000", 2024-09-14T09:10:17.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001775085 2024-09-14T09:10:17.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801060+0000", 2024-09-14T09:10:17.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8260000000000001e-06 2024-09-14T09:10:17.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791299+0000", 2024-09-14T09:10:17.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99023856799999999 2024-09-14T09:10:17.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791352+0000", 2024-09-14T09:10:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2528000000000003e-05 2024-09-14T09:10:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791410+0000", 2024-09-14T09:10:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8298000000000003e-05 2024-09-14T09:10:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.045 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:370 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2457600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:10:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 105.172561042, 2024-09-14T09:10:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99220795399999995, 2024-09-14T09:10:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 370 2024-09-14T09:10:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:10:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:10:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799301+0000", 2024-09-14T09:10:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2024-09-14T09:10:17.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799303+0000", 2024-09-14T09:10:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9319999999999999e-06 2024-09-14T09:10:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799310+0000", 2024-09-14T09:10:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8680000000000001e-06 2024-09-14T09:10:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799315+0000", 2024-09-14T09:10:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.921e-06 2024-09-14T09:10:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801071+0000", 2024-09-14T09:10:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001756678 2024-09-14T09:10:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801080+0000", 2024-09-14T09:10:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6060000000000003e-06 2024-09-14T09:10:17.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791429+0000", 2024-09-14T09:10:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99034944599999997 2024-09-14T09:10:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791471+0000", 2024-09-14T09:10:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1279999999999998e-05 2024-09-14T09:10:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:17.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791508+0000", 2024-09-14T09:10:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7663999999999997e-05 2024-09-14T09:10:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:371 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2916352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:10:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 105.17253986999999, 2024-09-14T09:10:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99228692299999999, 2024-09-14T09:10:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:17.051 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:17.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:17.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:17.052 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 371 2024-09-14T09:10:17.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.052 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:17.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:17.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:10:17.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:17.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:10:17.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:17.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799322+0000", 2024-09-14T09:10:17.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:10:17.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:17.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799333+0000", 2024-09-14T09:10:17.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1044e-05 2024-09-14T09:10:17.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:17.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799341+0000", 2024-09-14T09:10:17.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8439999999999998e-06 2024-09-14T09:10:17.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799354+0000", 2024-09-14T09:10:17.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3114e-05 2024-09-14T09:10:17.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801093+0000", 2024-09-14T09:10:17.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017385910000000001 2024-09-14T09:10:17.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801096+0000", 2024-09-14T09:10:17.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0680000000000001e-06 2024-09-14T09:10:17.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791528+0000", 2024-09-14T09:10:17.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99043264200000003 2024-09-14T09:10:17.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:17.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791570+0000", 2024-09-14T09:10:17.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2144999999999997e-05 2024-09-14T09:10:17.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:17.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791608+0000", 2024-09-14T09:10:17.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7966000000000002e-05 2024-09-14T09:10:17.056 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.056 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:17.056 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.056 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:372 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3375104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:17.057 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:10:17.057 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 105.17249932199999, 2024-09-14T09:10:17.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992342897, 2024-09-14T09:10:17.057 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:17.057 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:17.057 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:17.057 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:17.057 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:17.057 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:17.057 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 372 2024-09-14T09:10:17.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.057 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:17.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:17.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:10:17.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:17.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:10:17.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:17.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799363+0000", 2024-09-14T09:10:17.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2024-09-14T09:10:17.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:17.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799365+0000", 2024-09-14T09:10:17.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5500000000000001e-06 2024-09-14T09:10:17.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:17.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799371+0000", 2024-09-14T09:10:17.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2500000000000003e-06 2024-09-14T09:10:17.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799377+0000", 2024-09-14T09:10:17.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7509999999999997e-06 2024-09-14T09:10:17.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801107+0000", 2024-09-14T09:10:17.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017298019999999999 2024-09-14T09:10:17.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801111+0000", 2024-09-14T09:10:17.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8619999999999996e-06 2024-09-14T09:10:17.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791626+0000", 2024-09-14T09:10:17.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99051563300000001 2024-09-14T09:10:17.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:17.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791668+0000", 2024-09-14T09:10:17.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1424000000000002e-05 2024-09-14T09:10:17.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:17.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791705+0000", 2024-09-14T09:10:17.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7035e-05 2024-09-14T09:10:17.062 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.062 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:17.062 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.062 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:373 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:17.062 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:10:17.062 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 105.17247737700001, 2024-09-14T09:10:17.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99253589399999997, 2024-09-14T09:10:17.063 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:17.063 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:17.063 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:17.063 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:17.063 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:17.063 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:17.063 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 373 2024-09-14T09:10:17.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.063 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:17.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:17.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:10:17.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:17.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:10:17.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:17.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:10:17.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2024-09-14T09:10:17.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:17.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799387+0000", 2024-09-14T09:10:17.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1019999999999999e-06 2024-09-14T09:10:17.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:17.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799393+0000", 2024-09-14T09:10:17.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0190000000000003e-06 2024-09-14T09:10:17.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799398+0000", 2024-09-14T09:10:17.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:10:17.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801123+0000", 2024-09-14T09:10:17.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017251949999999999 2024-09-14T09:10:17.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801126+0000", 2024-09-14T09:10:17.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9280000000000002e-06 2024-09-14T09:10:17.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791746+0000", 2024-09-14T09:10:17.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99062036899999995 2024-09-14T09:10:17.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:17.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791835+0000", 2024-09-14T09:10:17.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9004000000000004e-05 2024-09-14T09:10:17.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:17.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791920+0000", 2024-09-14T09:10:17.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4524000000000006e-05 2024-09-14T09:10:17.067 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.067 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:17.067 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.068 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:60352 3.0 3.6d62a5c0 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:17.068 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:10:17.068 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.589841538999998, 2024-09-14T09:10:17.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41710537399999997, 2024-09-14T09:10:17.068 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:17.068 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:17.068 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:17.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:17.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:17.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:17.068 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 60352 2024-09-14T09:10:17.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.069 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:17.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:17.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:10:17.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:17.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:10:17.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:17.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382044+0000", 2024-09-14T09:10:17.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4640000000000001e-05 2024-09-14T09:10:17.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:17.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382048+0000", 2024-09-14T09:10:17.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4690000000000002e-06 2024-09-14T09:10:17.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:17.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382053+0000", 2024-09-14T09:10:17.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:10:17.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382068+0000", 2024-09-14T09:10:17.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4399000000000001e-05 2024-09-14T09:10:17.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382121+0000", 2024-09-14T09:10:17.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3578000000000001e-05 2024-09-14T09:10:17.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382127+0000", 2024-09-14T09:10:17.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2024-09-14T09:10:17.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799116+0000", 2024-09-14T09:10:17.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.416988566 2024-09-14T09:10:17.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:17.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799125+0000", 2024-09-14T09:10:17.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3100000000000006e-06 2024-09-14T09:10:17.072 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.072 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:17.072 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.072 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:63559 3.0 3.95b285c0 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:17.073 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:10:17.073 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.584010165999999, 2024-09-14T09:10:17.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.411301215, 2024-09-14T09:10:17.073 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:17.073 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:17.073 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:17.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:17.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:17.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:17.073 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 63559 2024-09-14T09:10:17.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.073 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:17.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:17.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:10:17.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:17.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:10:17.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:17.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:17.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:10:17.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2499999999999999e-07 2024-09-14T09:10:17.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:17.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387853+0000", 2024-09-14T09:10:17.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.477e-06 2024-09-14T09:10:17.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:17.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387856+0000", 2024-09-14T09:10:17.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1429999999999998e-06 2024-09-14T09:10:17.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387859+0000", 2024-09-14T09:10:17.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.582e-06 2024-09-14T09:10:17.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387888+0000", 2024-09-14T09:10:17.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9609000000000001e-05 2024-09-14T09:10:17.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387893+0000", 2024-09-14T09:10:17.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6779999999999999e-06 2024-09-14T09:10:17.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:17.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799143+0000", 2024-09-14T09:10:17.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41124997099999999 2024-09-14T09:10:17.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:17.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:17.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:17.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799152+0000", 2024-09-14T09:10:17.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5300000000000002e-06 2024-09-14T09:10:17.077 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.077 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:17.077 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.077 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:17.077 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:17.077 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:17.079 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:10:17.079 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:17.080+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:17.180 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:17.181+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:17.184 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:17.184 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:17.184 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:10:17.184 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:17.193 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:10:17.281 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:17.283+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:17.297 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:17.297 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:17.297 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:10:17.297 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:10:17.297 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:17.306 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:10:17.381 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:17.383+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:17.423 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:10:17.453 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:17.453 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:10:17.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:10:17.453 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:10:17.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.453 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55979 3.e 3:740d1568:::rbd_data.1112a10502fe.0000000000000133:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:17.453 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:10:17.453 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 61.603130532999998, 2024-09-14T09:10:17.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.95211669700000001, 2024-09-14T09:10:17.454 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:17.454 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:17.454 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:10:17.454 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:17.454 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:17.454 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:17.454 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55979 2024-09-14T09:10:17.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.454 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:17.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:17.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:10:17.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:17.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:10:17.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:17.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850380+0000", 2024-09-14T09:10:17.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.615e-06 2024-09-14T09:10:17.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:17.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850386+0000", 2024-09-14T09:10:17.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8000000000000001e-06 2024-09-14T09:10:17.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:17.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850403+0000", 2024-09-14T09:10:17.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6339999999999999e-05 2024-09-14T09:10:17.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850413+0000", 2024-09-14T09:10:17.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8609999999999993e-06 2024-09-14T09:10:17.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851033+0000", 2024-09-14T09:10:17.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062034700000000004 2024-09-14T09:10:17.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:10:17.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851042+0000", 2024-09-14T09:10:17.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8340000000000005e-06 2024-09-14T09:10:17.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853175+0000", 2024-09-14T09:10:17.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0021332809999999999 2024-09-14T09:10:17.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853183+0000", 2024-09-14T09:10:17.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:10:17.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795232+0000", 2024-09-14T09:10:17.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94204854900000001 2024-09-14T09:10:17.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:17.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795413+0000", 2024-09-14T09:10:17.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018059200000000001 2024-09-14T09:10:17.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:10:17.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795717+0000", 2024-09-14T09:10:17.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000304636 2024-09-14T09:10:17.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:10:17.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799631+0000", 2024-09-14T09:10:17.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136910000000004 2024-09-14T09:10:17.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:10:17.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802290+0000", 2024-09-14T09:10:17.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026588010000000001 2024-09-14T09:10:17.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:10:17.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802362+0000", 2024-09-14T09:10:17.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2018000000000001e-05 2024-09-14T09:10:17.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:17.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802495+0000", 2024-09-14T09:10:17.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000132967 2024-09-14T09:10:17.460 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.460 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:17.461 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.461 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55990 3.e 3:72d6260e:::rbd_data.1112a10502fe.000000000000016c:head [stat,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:17.461 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:10:17.461 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 61.603069226000002, 2024-09-14T09:10:17.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.952433164, 2024-09-14T09:10:17.461 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:17.461 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:17.461 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:17.461 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:17.461 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:17.461 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:17.462 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55990 2024-09-14T09:10:17.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.462 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:17.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:17.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:10:17.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:17.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:10:17.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:17.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850440+0000", 2024-09-14T09:10:17.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5199999999999996e-07 2024-09-14T09:10:17.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:17.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850444+0000", 2024-09-14T09:10:17.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.019e-06 2024-09-14T09:10:17.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:17.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850452+0000", 2024-09-14T09:10:17.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0209999999999999e-06 2024-09-14T09:10:17.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850457+0000", 2024-09-14T09:10:17.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9529999999999998e-06 2024-09-14T09:10:17.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851100+0000", 2024-09-14T09:10:17.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00064299699999999997 2024-09-14T09:10:17.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:17.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851108+0000", 2024-09-14T09:10:17.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2279999999999998e-06 2024-09-14T09:10:17.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853208+0000", 2024-09-14T09:10:17.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020996579999999999 2024-09-14T09:10:17.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853213+0000", 2024-09-14T09:10:17.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4029999999999998e-06 2024-09-14T09:10:17.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796098+0000", 2024-09-14T09:10:17.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94288483700000003 2024-09-14T09:10:17.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:17.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796247+0000", 2024-09-14T09:10:17.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014925800000000001 2024-09-14T09:10:17.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:17.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802872+0000", 2024-09-14T09:10:17.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006625138 2024-09-14T09:10:17.466 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.467 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:17.467 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.467 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:17.467 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:10:17.467 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 61.438830453000001, 2024-09-14T09:10:17.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77465830800000002, 2024-09-14T09:10:17.467 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:17.467 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:17.467 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:17.467 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:17.467 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:17.467 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:17.467 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 58987 2024-09-14T09:10:17.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.468 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:17.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:17.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:10:17.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:17.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:10:17.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:17.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014680+0000", 2024-09-14T09:10:17.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9250000000000002e-06 2024-09-14T09:10:17.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:17.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014689+0000", 2024-09-14T09:10:17.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9730000000000003e-06 2024-09-14T09:10:17.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:17.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014709+0000", 2024-09-14T09:10:17.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9641999999999999e-05 2024-09-14T09:10:17.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014720+0000", 2024-09-14T09:10:17.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-09-14T09:10:17.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014796+0000", 2024-09-14T09:10:17.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6567000000000001e-05 2024-09-14T09:10:17.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014808+0000", 2024-09-14T09:10:17.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1435e-05 2024-09-14T09:10:17.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789325+0000", 2024-09-14T09:10:17.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77451705999999998 2024-09-14T09:10:17.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:17.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789336+0000", 2024-09-14T09:10:17.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1466e-05 2024-09-14T09:10:17.471 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.471 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:17.471 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.471 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:59017 3.3 3.6b81fb83 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:17.471 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:10:17.471 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 61.437178049000003, 2024-09-14T09:10:17.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77253447099999994, 2024-09-14T09:10:17.471 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:17.471 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:17.472 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:17.472 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:17.472 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:17.472 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:17.472 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 59017 2024-09-14T09:10:17.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.472 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:17.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:17.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:10:17.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:17.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:10:17.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:17.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016332+0000", 2024-09-14T09:10:17.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3459999999999999e-06 2024-09-14T09:10:17.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:17.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016337+0000", 2024-09-14T09:10:17.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.48e-06 2024-09-14T09:10:17.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:17.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016355+0000", 2024-09-14T09:10:17.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7955e-05 2024-09-14T09:10:17.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016364+0000", 2024-09-14T09:10:17.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.02e-06 2024-09-14T09:10:17.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016433+0000", 2024-09-14T09:10:17.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8398000000000005e-05 2024-09-14T09:10:17.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016442+0000", 2024-09-14T09:10:17.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1819999999999995e-06 2024-09-14T09:10:17.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788855+0000", 2024-09-14T09:10:17.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77241356299999997 2024-09-14T09:10:17.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:17.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788865+0000", 2024-09-14T09:10:17.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5270000000000004e-06 2024-09-14T09:10:17.475 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.476 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:17.476 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.476 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60343 3.e 3:721b16e6:::rbd_data.1112a10502fe.000000000000014b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:17.476 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:10:17.476 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 61.333208446999997, 2024-09-14T09:10:17.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68876920900000005, 2024-09-14T09:10:17.476 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:17.476 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:17.476 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:10:17.476 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:17.476 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:17.476 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:17.477 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60343 2024-09-14T09:10:17.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.477 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:17.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:17.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:10:17.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:17.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:10:17.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:17.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120302+0000", 2024-09-14T09:10:17.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0279999999999999e-06 2024-09-14T09:10:17.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:17.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120310+0000", 2024-09-14T09:10:17.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4330000000000004e-06 2024-09-14T09:10:17.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:17.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120333+0000", 2024-09-14T09:10:17.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2200000000000001e-05 2024-09-14T09:10:17.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120343+0000", 2024-09-14T09:10:17.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0560000000000001e-05 2024-09-14T09:10:17.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120414+0000", 2024-09-14T09:10:17.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0493000000000004e-05 2024-09-14T09:10:17.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120424+0000", 2024-09-14T09:10:17.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.059e-05 2024-09-14T09:10:17.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796679+0000", 2024-09-14T09:10:17.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67625512700000001 2024-09-14T09:10:17.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:17.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796833+0000", 2024-09-14T09:10:17.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015403500000000001 2024-09-14T09:10:17.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:10:17.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797239+0000", 2024-09-14T09:10:17.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040503000000000002 2024-09-14T09:10:17.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:10:17.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802918+0000", 2024-09-14T09:10:17.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056796199999999998 2024-09-14T09:10:17.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:10:17.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808655+0000", 2024-09-14T09:10:17.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057365089999999999 2024-09-14T09:10:17.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:10:17.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808850+0000", 2024-09-14T09:10:17.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000194904 2024-09-14T09:10:17.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:17.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809069+0000", 2024-09-14T09:10:17.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021968000000000001 2024-09-14T09:10:17.482 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.482 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:17.482 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.482 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60356 3.2 3:40f9e9e7:::rbd_data.1112a10502fe.0000000000000160:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:17.482 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:10:17.482 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 61.332145934000003, 2024-09-14T09:10:17.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68053790800000002, 2024-09-14T09:10:17.483 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:17.483 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:17.483 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:10:17.483 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:17.483 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:17.483 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:17.483 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60356 2024-09-14T09:10:17.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.483 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:17.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:17.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:10:17.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:10:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121364+0000", 2024-09-14T09:10:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.173e-06 2024-09-14T09:10:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121371+0000", 2024-09-14T09:10:17.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-09-14T09:10:17.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:17.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121386+0000", 2024-09-14T09:10:17.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4925e-05 2024-09-14T09:10:17.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121395+0000", 2024-09-14T09:10:17.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8190000000000003e-06 2024-09-14T09:10:17.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121464+0000", 2024-09-14T09:10:17.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8149000000000001e-05 2024-09-14T09:10:17.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121474+0000", 2024-09-14T09:10:17.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0927999999999999e-05 2024-09-14T09:10:17.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795901+0000", 2024-09-14T09:10:17.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67442645499999998 2024-09-14T09:10:17.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:17.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796068+0000", 2024-09-14T09:10:17.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016655700000000001 2024-09-14T09:10:17.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 3", 2024-09-14T09:10:17.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796354+0000", 2024-09-14T09:10:17.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00028646999999999999 2024-09-14T09:10:17.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:10:17.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.800348+0000", 2024-09-14T09:10:17.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039943119999999999 2024-09-14T09:10:17.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:10:17.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801690+0000", 2024-09-14T09:10:17.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013415090000000001 2024-09-14T09:10:17.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:10:17.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801771+0000", 2024-09-14T09:10:17.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1678e-05 2024-09-14T09:10:17.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:17.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801900+0000", 2024-09-14T09:10:17.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000128978 2024-09-14T09:10:17.488 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.488 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:17.488 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.489 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62163 3.e 3:713ab431:::rbd_data.1112a10502fe.0000000000000198:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:17.489 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:10:17.489 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 61.241775726999997, 2024-09-14T09:10:17.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.597552682, 2024-09-14T09:10:17.489 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:17.489 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:17.489 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:17.489 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:17.489 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:17.489 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:17.489 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62163 2024-09-14T09:10:17.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.489 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:17.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:17.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:10:17.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:17.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:10:17.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:17.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211735+0000", 2024-09-14T09:10:17.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1110000000000002e-06 2024-09-14T09:10:17.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:17.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211744+0000", 2024-09-14T09:10:17.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0790000000000007e-06 2024-09-14T09:10:17.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:17.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211765+0000", 2024-09-14T09:10:17.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1114000000000001e-05 2024-09-14T09:10:17.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211775+0000", 2024-09-14T09:10:17.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0033e-05 2024-09-14T09:10:17.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211847+0000", 2024-09-14T09:10:17.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1503999999999998e-05 2024-09-14T09:10:17.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211857+0000", 2024-09-14T09:10:17.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0378e-05 2024-09-14T09:10:17.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799140+0000", 2024-09-14T09:10:17.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.58728279100000003 2024-09-14T09:10:17.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:17.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799289+0000", 2024-09-14T09:10:17.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000148966 2024-09-14T09:10:17.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:17.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809285+0000", 2024-09-14T09:10:17.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099967059999999993 2024-09-14T09:10:17.493 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.493 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:17.493 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.493 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63582 3.2 3:467f2009:::rbd_data.1112a10502fe.00000000000001a1:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:17.494 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:10:17.494 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 61.166582609999999, 2024-09-14T09:10:17.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51869012999999997, 2024-09-14T09:10:17.494 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:17.494 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:17.494 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:17.494 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:17.494 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:17.494 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:17.494 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63582 2024-09-14T09:10:17.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.494 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:17.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:17.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:10:17.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:17.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:10:17.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:17.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286928+0000", 2024-09-14T09:10:17.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.812e-06 2024-09-14T09:10:17.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:17.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286936+0000", 2024-09-14T09:10:17.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2390000000000002e-06 2024-09-14T09:10:17.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:17.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286955+0000", 2024-09-14T09:10:17.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8853000000000001e-05 2024-09-14T09:10:17.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286972+0000", 2024-09-14T09:10:17.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7365000000000001e-05 2024-09-14T09:10:17.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287052+0000", 2024-09-14T09:10:17.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9491000000000002e-05 2024-09-14T09:10:17.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287063+0000", 2024-09-14T09:10:17.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1620999999999999e-05 2024-09-14T09:10:17.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796696+0000", 2024-09-14T09:10:17.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50963256999999995 2024-09-14T09:10:17.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:17.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796847+0000", 2024-09-14T09:10:17.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015126899999999999 2024-09-14T09:10:17.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:17.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.805616+0000", 2024-09-14T09:10:17.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087689099999999996 2024-09-14T09:10:17.498 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.498 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:17.498 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.498 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63586 3.3 3.d4e49b03 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:17.498 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:10:17.499 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 61.166498228999998, 2024-09-14T09:10:17.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50188935099999998, 2024-09-14T09:10:17.499 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:17.499 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:17.499 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:17.499 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:17.499 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:17.499 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:17.499 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63586 2024-09-14T09:10:17.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.499 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:17.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:17.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:10:17.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:17.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:10:17.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:17.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287011+0000", 2024-09-14T09:10:17.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.61e-07 2024-09-14T09:10:17.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:17.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287014+0000", 2024-09-14T09:10:17.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3900000000000002e-06 2024-09-14T09:10:17.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:17.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287023+0000", 2024-09-14T09:10:17.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3380000000000005e-06 2024-09-14T09:10:17.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287029+0000", 2024-09-14T09:10:17.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0079999999999999e-06 2024-09-14T09:10:17.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287087+0000", 2024-09-14T09:10:17.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8322000000000002e-05 2024-09-14T09:10:17.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287096+0000", 2024-09-14T09:10:17.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8580000000000006e-06 2024-09-14T09:10:17.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788891+0000", 2024-09-14T09:10:17.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50179498499999997 2024-09-14T09:10:17.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:17.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788900+0000", 2024-09-14T09:10:17.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.789e-06 2024-09-14T09:10:17.503 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.503 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:17.503 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.503 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60363 3.1d 3:b8b44067:::rbd_data.1112a10502fe.000000000000018b:head [stat,delete] snapc 21=[21] RETRY=12 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:17.503 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:10:17.503 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 60.665776491000003, 2024-09-14T09:10:17.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268612690000001, 2024-09-14T09:10:17.503 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:17.503 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:17.503 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:17.503 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:17.504 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:17.504 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:17.504 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60363 2024-09-14T09:10:17.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.504 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:17.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:17.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:10:17.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:17.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:10:17.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:17.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787733+0000", 2024-09-14T09:10:17.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.314e-06 2024-09-14T09:10:17.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:17.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787739+0000", 2024-09-14T09:10:17.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5300000000000004e-06 2024-09-14T09:10:17.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:17.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787750+0000", 2024-09-14T09:10:17.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1251e-05 2024-09-14T09:10:17.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:10:17.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0739999999999993e-06 2024-09-14T09:10:17.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787827+0000", 2024-09-14T09:10:17.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8861000000000004e-05 2024-09-14T09:10:17.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:10:17.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787836+0000", 2024-09-14T09:10:17.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1339999999999993e-06 2024-09-14T09:10:17.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789335+0000", 2024-09-14T09:10:17.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014988289999999999 2024-09-14T09:10:17.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789343+0000", 2024-09-14T09:10:17.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6639999999999998e-06 2024-09-14T09:10:17.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799170+0000", 2024-09-14T09:10:17.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098272500000001 2024-09-14T09:10:17.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:17.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799377+0000", 2024-09-14T09:10:17.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000207126 2024-09-14T09:10:17.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:17.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814593+0000", 2024-09-14T09:10:17.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015216235999999999 2024-09-14T09:10:17.508 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.508 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:17.508 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.508 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63565 3.1d 3:bdc63b28:::rbd_data.1112a10502fe.000000000000016d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=9 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:17.509 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:10:17.509 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 60.665730699999997, 2024-09-14T09:10:17.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0271114539999999, 2024-09-14T09:10:17.509 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:17.509 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:17.509 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:10:17.509 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:17.509 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:17.509 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:17.509 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63565 2024-09-14T09:10:17.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.509 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:17.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:17.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:10:17.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:17.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:10:17.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:17.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:10:17.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6899999999999998e-07 2024-09-14T09:10:17.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:17.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787781+0000", 2024-09-14T09:10:17.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8909999999999999e-06 2024-09-14T09:10:17.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:17.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787787+0000", 2024-09-14T09:10:17.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3230000000000003e-06 2024-09-14T09:10:17.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787793+0000", 2024-09-14T09:10:17.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-09-14T09:10:17.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789455+0000", 2024-09-14T09:10:17.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001661596 2024-09-14T09:10:17.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789463+0000", 2024-09-14T09:10:17.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4889999999999995e-06 2024-09-14T09:10:17.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800115+0000", 2024-09-14T09:10:17.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0106512670000001 2024-09-14T09:10:17.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:17.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800334+0000", 2024-09-14T09:10:17.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000219213 2024-09-14T09:10:17.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:10:17.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800651+0000", 2024-09-14T09:10:17.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00031765500000000002 2024-09-14T09:10:17.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:10:17.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.811875+0000", 2024-09-14T09:10:17.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011224032 2024-09-14T09:10:17.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:10:17.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814665+0000", 2024-09-14T09:10:17.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002789606 2024-09-14T09:10:17.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:10:17.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814742+0000", 2024-09-14T09:10:17.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6916999999999996e-05 2024-09-14T09:10:17.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:17.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814889+0000", 2024-09-14T09:10:17.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014725799999999999 2024-09-14T09:10:17.515 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.515 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:17.515 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.515 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:67113 3.1d 3:bba7fe0d:::rbd_data.1112a10502fe.00000000000001bf:head [stat,delete] snapc 21=[21] RETRY=4 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:17.515 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:10:17.515 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 60.664969841999998, 2024-09-14T09:10:17.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0265995649999999, 2024-09-14T09:10:17.515 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:17.515 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:17.515 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:17.515 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:17.515 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:17.515 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:17.515 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 67113 2024-09-14T09:10:17.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.516 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:17.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:17.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:10:17.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:17.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:10:17.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:17.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:10:17.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:10:17.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:17.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788543+0000", 2024-09-14T09:10:17.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-09-14T09:10:17.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:17.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788552+0000", 2024-09-14T09:10:17.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:10:17.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788559+0000", 2024-09-14T09:10:17.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:10:17.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789489+0000", 2024-09-14T09:10:17.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00092982199999999996 2024-09-14T09:10:17.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789497+0000", 2024-09-14T09:10:17.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6299999999999998e-06 2024-09-14T09:10:17.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801068+0000", 2024-09-14T09:10:17.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0115709530000001 2024-09-14T09:10:17.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:17.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801240+0000", 2024-09-14T09:10:17.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017276600000000001 2024-09-14T09:10:17.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:17.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815138+0000", 2024-09-14T09:10:17.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013897856 2024-09-14T09:10:17.519 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.519 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:17.519 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.520 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73412 3.1d 3:be4606c3:::rbd_data.1112a10502fe.00000000000001f2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:17.520 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:10:17.520 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 60.664938730000003, 2024-09-14T09:10:17.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026815928, 2024-09-14T09:10:17.520 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:17.520 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:17.520 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:17.520 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:17.520 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:17.520 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:17.520 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73412 2024-09-14T09:10:17.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.521 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:17.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:17.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:10:17.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:17.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:10:17.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:17.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:10:17.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5699999999999998e-07 2024-09-14T09:10:17.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:17.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788572+0000", 2024-09-14T09:10:17.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2809999999999998e-06 2024-09-14T09:10:17.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:17.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788579+0000", 2024-09-14T09:10:17.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5629999999999997e-06 2024-09-14T09:10:17.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788584+0000", 2024-09-14T09:10:17.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1710000000000001e-06 2024-09-14T09:10:17.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789521+0000", 2024-09-14T09:10:17.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00093657400000000002 2024-09-14T09:10:17.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789528+0000", 2024-09-14T09:10:17.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5719999999999997e-06 2024-09-14T09:10:17.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801631+0000", 2024-09-14T09:10:17.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0121023229999999 2024-09-14T09:10:17.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:17.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801792+0000", 2024-09-14T09:10:17.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016174000000000001 2024-09-14T09:10:17.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:17.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815386+0000", 2024-09-14T09:10:17.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013593246999999999 2024-09-14T09:10:17.525 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.525 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:17.525 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.525 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:77244 3.1d 3:b801be19:::rbd_data.1112a10502fe.0000000000000204:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:17.525 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:10:17.525 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 60.483074483999999, 2024-09-14T09:10:17.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.84519277100000001, 2024-09-14T09:10:17.525 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:17.525 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:17.525 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:17.526 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:17.526 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:17.526 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:17.526 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 77244 2024-09-14T09:10:17.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.526 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:17.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:17.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:10:17.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:17.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:10:17.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:17.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970436+0000", 2024-09-14T09:10:17.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.511e-06 2024-09-14T09:10:17.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:17.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970441+0000", 2024-09-14T09:10:17.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0470000000000001e-06 2024-09-14T09:10:17.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:17.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970453+0000", 2024-09-14T09:10:17.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2629999999999999e-05 2024-09-14T09:10:17.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970461+0000", 2024-09-14T09:10:17.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6850000000000001e-06 2024-09-14T09:10:17.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970524+0000", 2024-09-14T09:10:17.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3332999999999998e-05 2024-09-14T09:10:17.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970544+0000", 2024-09-14T09:10:17.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9731000000000001e-05 2024-09-14T09:10:17.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802188+0000", 2024-09-14T09:10:17.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.83164380000000004 2024-09-14T09:10:17.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:17.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:10:17.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015411999999999999 2024-09-14T09:10:17.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:17.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815627+0000", 2024-09-14T09:10:17.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013284914 2024-09-14T09:10:17.530 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.530 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:17.530 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.530 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:79796 3.1d 3:bc22caaf:::rbd_data.1112a10502fe.000000000000020c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:17.530 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:10:17.530 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 60.361765798, 2024-09-14T09:10:17.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72411694299999996, 2024-09-14T09:10:17.530 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:17.531 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:17.531 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:17.531 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:17.531 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:17.531 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:17.531 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 79796 2024-09-14T09:10:17.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.531 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:17.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:17.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:10:17.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:17.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:10:17.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:17.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091745+0000", 2024-09-14T09:10:17.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2000000000000001e-06 2024-09-14T09:10:17.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:17.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091752+0000", 2024-09-14T09:10:17.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-09-14T09:10:17.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:17.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091772+0000", 2024-09-14T09:10:17.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9822000000000001e-05 2024-09-14T09:10:17.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091791+0000", 2024-09-14T09:10:17.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9236e-05 2024-09-14T09:10:17.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091882+0000", 2024-09-14T09:10:17.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0783000000000001e-05 2024-09-14T09:10:17.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091892+0000", 2024-09-14T09:10:17.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7999999999999993e-06 2024-09-14T09:10:17.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802744+0000", 2024-09-14T09:10:17.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.710851868 2024-09-14T09:10:17.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:17.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802902+0000", 2024-09-14T09:10:17.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015814900000000001 2024-09-14T09:10:17.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:17.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815860+0000", 2024-09-14T09:10:17.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012957605000000001 2024-09-14T09:10:17.535 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.535 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:17.535 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.535 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80904 3.1d 3:be0e7f3d:::rbd_data.1112a10502fe.0000000000000214:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:17.535 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:10:17.535 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 60.281679951000001, 2024-09-14T09:10:17.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64435178100000001, 2024-09-14T09:10:17.535 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:17.536 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:17.536 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:17.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:17.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:17.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:17.536 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80904 2024-09-14T09:10:17.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.536 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:17.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:17.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:10:17.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:17.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:10:17.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:17.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171831+0000", 2024-09-14T09:10:17.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0729999999999999e-06 2024-09-14T09:10:17.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:17.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171839+0000", 2024-09-14T09:10:17.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9179999999999994e-06 2024-09-14T09:10:17.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:17.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171857+0000", 2024-09-14T09:10:17.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8957000000000002e-05 2024-09-14T09:10:17.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171867+0000", 2024-09-14T09:10:17.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7100000000000002e-06 2024-09-14T09:10:17.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171957+0000", 2024-09-14T09:10:17.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9932999999999994e-05 2024-09-14T09:10:17.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171974+0000", 2024-09-14T09:10:17.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6988999999999999e-05 2024-09-14T09:10:17.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803301+0000", 2024-09-14T09:10:17.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63132648599999996 2024-09-14T09:10:17.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:17.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803482+0000", 2024-09-14T09:10:17.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000181607 2024-09-14T09:10:17.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:17.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816180+0000", 2024-09-14T09:10:17.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012698108 2024-09-14T09:10:17.540 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.540 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:17.540 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.540 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80964 3.1d 3:be42e20f:::rbd_data.1112a10502fe.0000000000000219:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:17.540 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:10:17.540 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 60.276044384000002, 2024-09-14T09:10:17.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63896829799999999, 2024-09-14T09:10:17.540 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:17.540 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:17.540 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:17.541 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:17.541 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:17.541 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:17.541 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80964 2024-09-14T09:10:17.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.541 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:17.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:17.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:10:17.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:17.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:10:17.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:17.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177466+0000", 2024-09-14T09:10:17.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6610000000000001e-06 2024-09-14T09:10:17.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:17.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177472+0000", 2024-09-14T09:10:17.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3029999999999996e-06 2024-09-14T09:10:17.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:17.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177490+0000", 2024-09-14T09:10:17.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8099000000000001e-05 2024-09-14T09:10:17.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177499+0000", 2024-09-14T09:10:17.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:10:17.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177560+0000", 2024-09-14T09:10:17.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1334000000000006e-05 2024-09-14T09:10:17.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177578+0000", 2024-09-14T09:10:17.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8434999999999999e-05 2024-09-14T09:10:17.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803910+0000", 2024-09-14T09:10:17.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62633190699999997 2024-09-14T09:10:17.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:17.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.806612+0000", 2024-09-14T09:10:17.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002702257 2024-09-14T09:10:17.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:17.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816432+0000", 2024-09-14T09:10:17.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098199370000000008 2024-09-14T09:10:17.545 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.545 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:17.545 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.545 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83321 3.1d 3:bb24b47b:::rbd_data.1112a10502fe.0000000000000223:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:17.545 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:10:17.545 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 60.161590709999999, 2024-09-14T09:10:17.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52477628799999998, 2024-09-14T09:10:17.545 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:17.545 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:17.546 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:17.546 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:17.546 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:17.546 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:17.546 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83321 2024-09-14T09:10:17.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.546 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:17.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:17.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:10:17.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:17.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:10:17.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:17.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291920+0000", 2024-09-14T09:10:17.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.888e-06 2024-09-14T09:10:17.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:17.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291926+0000", 2024-09-14T09:10:17.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6059999999999999e-06 2024-09-14T09:10:17.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:17.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291943+0000", 2024-09-14T09:10:17.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6813e-05 2024-09-14T09:10:17.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291952+0000", 2024-09-14T09:10:17.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7439999999999996e-06 2024-09-14T09:10:17.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292023+0000", 2024-09-14T09:10:17.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1320000000000002e-05 2024-09-14T09:10:17.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292030+0000", 2024-09-14T09:10:17.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4219999999999997e-06 2024-09-14T09:10:17.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807221+0000", 2024-09-14T09:10:17.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51519140699999999 2024-09-14T09:10:17.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:17.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807406+0000", 2024-09-14T09:10:17.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018532800000000001 2024-09-14T09:10:17.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:17.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816694+0000", 2024-09-14T09:10:17.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092877600000000008 2024-09-14T09:10:17.550 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.550 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:17.550 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.550 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83358 3.1d 3:bb230e23:::rbd_data.1112a10502fe.000000000000022b:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:17.550 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:10:17.550 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 60.160070820000001, 2024-09-14T09:10:17.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52374808900000003, 2024-09-14T09:10:17.550 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:17.550 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:17.550 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:17.551 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:17.551 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:17.551 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:17.551 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83358 2024-09-14T09:10:17.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.551 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:17.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:17.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:10:17.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:17.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:10:17.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:17.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293439+0000", 2024-09-14T09:10:17.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5899999999999995e-07 2024-09-14T09:10:17.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:17.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293443+0000", 2024-09-14T09:10:17.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9309999999999999e-06 2024-09-14T09:10:17.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:17.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293457+0000", 2024-09-14T09:10:17.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3944999999999999e-05 2024-09-14T09:10:17.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293466+0000", 2024-09-14T09:10:17.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4319999999999999e-06 2024-09-14T09:10:17.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293530+0000", 2024-09-14T09:10:17.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3860000000000002e-05 2024-09-14T09:10:17.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293540+0000", 2024-09-14T09:10:17.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0107e-05 2024-09-14T09:10:17.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809096+0000", 2024-09-14T09:10:17.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51555587800000002 2024-09-14T09:10:17.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:17.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809265+0000", 2024-09-14T09:10:17.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000169092 2024-09-14T09:10:17.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:17.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817186+0000", 2024-09-14T09:10:17.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079209850000000002 2024-09-14T09:10:17.555 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.555 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:17.555 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.555 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83361 3.1d 3:bd571564:::rbd_data.1112a10502fe.000000000000022c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:17.555 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:10:17.555 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 60.159752744000002, 2024-09-14T09:10:17.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52373873100000001, 2024-09-14T09:10:17.556 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:17.556 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:17.556 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:17.556 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:17.556 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:17.556 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:17.556 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83361 2024-09-14T09:10:17.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.556 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:17.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:17.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:10:17.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:17.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:10:17.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:17.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:17.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293757+0000", 2024-09-14T09:10:17.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8000000000000004e-07 2024-09-14T09:10:17.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:17.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293762+0000", 2024-09-14T09:10:17.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8019999999999997e-06 2024-09-14T09:10:17.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:17.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293775+0000", 2024-09-14T09:10:17.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2884000000000001e-05 2024-09-14T09:10:17.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:17.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293783+0000", 2024-09-14T09:10:17.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:10:17.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293849+0000", 2024-09-14T09:10:17.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5859999999999996e-05 2024-09-14T09:10:17.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:17.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293861+0000", 2024-09-14T09:10:17.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2238999999999999e-05 2024-09-14T09:10:17.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:17.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809680+0000", 2024-09-14T09:10:17.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51581856800000003 2024-09-14T09:10:17.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:17.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809844+0000", 2024-09-14T09:10:17.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016441200000000001 2024-09-14T09:10:17.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:17.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:17.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:17.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817494+0000", 2024-09-14T09:10:17.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076502360000000004 2024-09-14T09:10:17.560 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.560 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:17.560 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.560 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:17.560 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:17.560 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:17.562 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:10:17.562 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:10:17.562 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:10:17.562 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:10:17.563 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:10:17.563 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:17.563+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:17.574 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:10:17.574 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:10:17.591 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:10:17.591 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:10:17.608 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:10:17.608 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:10:17.624 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:10:17.624 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:10:17.662 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:17.664+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:17.678 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:17.678 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:17.687 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:10:17.763 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:17.764+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:17.790 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:17.790 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:17.794 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is unset 2024-09-14T09:10:17.803 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:10:17.897 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:17.899+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:17.954 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 1] out_osds: [5] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 2] 2024-09-14T09:10:17.955 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:10:17.955 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-14T09:10:17.955 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.363998 2024-09-14T09:10:17.955 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0.363998493143215 2024-09-14T09:10:17.965 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:17.967+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:17.966 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:17.966 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:17.975 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:10:18.066 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:18.068+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:18.121 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:18.121 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:18.130 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:10:18.166 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:18.168+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:18.268 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:18.270+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:18.274 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:18.274 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:18.283 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:10:18.369 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:18.370+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:18.386 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:18.386 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:18.395 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:10:18.469 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:18.471+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:18.498 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:18.499 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:18.507 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:10:18.591 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:18.592+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:18.650 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:18.650 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:18.658 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:10:18.699 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:18.700+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:18.772 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:18.773+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:18.800 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:18.801 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:18.809 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:10:18.873 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:18.875+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:18.954 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:18.954 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:18.957 INFO:teuthology.orchestra.run.smithi116.stderr:set osd.1 primary-affinity to 0.363998 (8238552) 2024-09-14T09:10:18.966 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:10:19.009 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:19.011+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:19.069 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:19.069 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:19.075 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:19.076+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:19.078 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:10:19.176 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:19.178+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:19.222 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:19.222 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:19.230 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:10:19.276 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:19.278+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:19.334 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:19.334 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:19.343 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:10:19.386 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:19.387+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:19.445 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:19.445 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:19.453 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:10:19.478 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:19.480+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:19.579 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:19.581+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:19.598 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:19.598 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:19.607 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:10:19.636 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:10:19.694 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:19.696+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:19.725 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:19.726 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:19.735 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:10:19.776 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:10:19.777 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:10:19.781 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:19.782+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:19.794 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:10:19.794 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:10:19.810 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:10:19.811 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:10:19.815 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T09:10:19.829 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:10:19.829 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:10:19.851 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:10:19.851 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:10:19.869 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:10:19.869 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:10:19.881 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:19.881 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:19.881 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:10:19.881 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:10:19.881 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:19.882 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:19.883+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:19.891 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:10:19.982 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:19.984+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:20.049 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:20.049 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:10:20.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:10:20.049 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:10:20.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.049 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55979 3.e 3:740d1568:::rbd_data.1112a10502fe.0000000000000133:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:20.050 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:10:20.050 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 64.199366174000005, 2024-09-14T09:10:20.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.95211669700000001, 2024-09-14T09:10:20.050 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.050 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.050 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:10:20.050 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.050 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:20.050 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:20.050 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55979 2024-09-14T09:10:20.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.050 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:10:20.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:10:20.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850380+0000", 2024-09-14T09:10:20.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.615e-06 2024-09-14T09:10:20.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850386+0000", 2024-09-14T09:10:20.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8000000000000001e-06 2024-09-14T09:10:20.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850403+0000", 2024-09-14T09:10:20.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6339999999999999e-05 2024-09-14T09:10:20.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850413+0000", 2024-09-14T09:10:20.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8609999999999993e-06 2024-09-14T09:10:20.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851033+0000", 2024-09-14T09:10:20.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062034700000000004 2024-09-14T09:10:20.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:10:20.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851042+0000", 2024-09-14T09:10:20.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8340000000000005e-06 2024-09-14T09:10:20.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853175+0000", 2024-09-14T09:10:20.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0021332809999999999 2024-09-14T09:10:20.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:20.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853183+0000", 2024-09-14T09:10:20.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:10:20.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795232+0000", 2024-09-14T09:10:20.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94204854900000001 2024-09-14T09:10:20.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795413+0000", 2024-09-14T09:10:20.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018059200000000001 2024-09-14T09:10:20.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:10:20.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795717+0000", 2024-09-14T09:10:20.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000304636 2024-09-14T09:10:20.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:10:20.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799631+0000", 2024-09-14T09:10:20.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136910000000004 2024-09-14T09:10:20.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:10:20.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802290+0000", 2024-09-14T09:10:20.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026588010000000001 2024-09-14T09:10:20.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:10:20.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802362+0000", 2024-09-14T09:10:20.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2018000000000001e-05 2024-09-14T09:10:20.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802495+0000", 2024-09-14T09:10:20.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000132967 2024-09-14T09:10:20.057 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.057 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.057 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.057 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55990 3.e 3:72d6260e:::rbd_data.1112a10502fe.000000000000016c:head [stat,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:20.057 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:10:20.057 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 64.199304866999995, 2024-09-14T09:10:20.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.952433164, 2024-09-14T09:10:20.057 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.057 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.058 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.058 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.058 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:20.058 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:20.058 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55990 2024-09-14T09:10:20.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.058 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:10:20.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:10:20.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850440+0000", 2024-09-14T09:10:20.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5199999999999996e-07 2024-09-14T09:10:20.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850444+0000", 2024-09-14T09:10:20.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.019e-06 2024-09-14T09:10:20.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850452+0000", 2024-09-14T09:10:20.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0209999999999999e-06 2024-09-14T09:10:20.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850457+0000", 2024-09-14T09:10:20.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9529999999999998e-06 2024-09-14T09:10:20.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851100+0000", 2024-09-14T09:10:20.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00064299699999999997 2024-09-14T09:10:20.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:20.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851108+0000", 2024-09-14T09:10:20.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2279999999999998e-06 2024-09-14T09:10:20.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853208+0000", 2024-09-14T09:10:20.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020996579999999999 2024-09-14T09:10:20.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:20.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853213+0000", 2024-09-14T09:10:20.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4029999999999998e-06 2024-09-14T09:10:20.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796098+0000", 2024-09-14T09:10:20.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94288483700000003 2024-09-14T09:10:20.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796247+0000", 2024-09-14T09:10:20.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014925800000000001 2024-09-14T09:10:20.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802872+0000", 2024-09-14T09:10:20.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006625138 2024-09-14T09:10:20.063 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.063 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.063 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.063 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:20.063 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:10:20.063 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 64.035066094000001, 2024-09-14T09:10:20.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77465830800000002, 2024-09-14T09:10:20.063 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.064 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.064 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:20.064 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.064 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:20.064 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:20.064 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 58987 2024-09-14T09:10:20.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.064 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:10:20.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:10:20.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014680+0000", 2024-09-14T09:10:20.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9250000000000002e-06 2024-09-14T09:10:20.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014689+0000", 2024-09-14T09:10:20.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9730000000000003e-06 2024-09-14T09:10:20.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014709+0000", 2024-09-14T09:10:20.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9641999999999999e-05 2024-09-14T09:10:20.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014720+0000", 2024-09-14T09:10:20.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-09-14T09:10:20.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014796+0000", 2024-09-14T09:10:20.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6567000000000001e-05 2024-09-14T09:10:20.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:20.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014808+0000", 2024-09-14T09:10:20.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1435e-05 2024-09-14T09:10:20.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789325+0000", 2024-09-14T09:10:20.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77451705999999998 2024-09-14T09:10:20.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789336+0000", 2024-09-14T09:10:20.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1466e-05 2024-09-14T09:10:20.068 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.068 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.068 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.068 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:59017 3.3 3.6b81fb83 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:20.068 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:10:20.068 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 64.033413690000003, 2024-09-14T09:10:20.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77253447099999994, 2024-09-14T09:10:20.068 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.068 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.068 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:20.068 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.069 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:20.069 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:20.069 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 59017 2024-09-14T09:10:20.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.069 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:10:20.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:10:20.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016332+0000", 2024-09-14T09:10:20.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3459999999999999e-06 2024-09-14T09:10:20.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016337+0000", 2024-09-14T09:10:20.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.48e-06 2024-09-14T09:10:20.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016355+0000", 2024-09-14T09:10:20.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7955e-05 2024-09-14T09:10:20.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016364+0000", 2024-09-14T09:10:20.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.02e-06 2024-09-14T09:10:20.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016433+0000", 2024-09-14T09:10:20.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8398000000000005e-05 2024-09-14T09:10:20.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:20.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016442+0000", 2024-09-14T09:10:20.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1819999999999995e-06 2024-09-14T09:10:20.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788855+0000", 2024-09-14T09:10:20.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77241356299999997 2024-09-14T09:10:20.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788865+0000", 2024-09-14T09:10:20.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5270000000000004e-06 2024-09-14T09:10:20.072 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.072 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.072 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.073 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60343 3.e 3:721b16e6:::rbd_data.1112a10502fe.000000000000014b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:20.073 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:10:20.073 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.929444087999997, 2024-09-14T09:10:20.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68876920900000005, 2024-09-14T09:10:20.073 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.073 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.073 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:10:20.073 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.073 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:20.073 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:20.073 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60343 2024-09-14T09:10:20.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.073 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:10:20.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:10:20.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120302+0000", 2024-09-14T09:10:20.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0279999999999999e-06 2024-09-14T09:10:20.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120310+0000", 2024-09-14T09:10:20.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4330000000000004e-06 2024-09-14T09:10:20.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120333+0000", 2024-09-14T09:10:20.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2200000000000001e-05 2024-09-14T09:10:20.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120343+0000", 2024-09-14T09:10:20.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0560000000000001e-05 2024-09-14T09:10:20.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120414+0000", 2024-09-14T09:10:20.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0493000000000004e-05 2024-09-14T09:10:20.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:20.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120424+0000", 2024-09-14T09:10:20.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.059e-05 2024-09-14T09:10:20.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796679+0000", 2024-09-14T09:10:20.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67625512700000001 2024-09-14T09:10:20.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796833+0000", 2024-09-14T09:10:20.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015403500000000001 2024-09-14T09:10:20.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:10:20.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797239+0000", 2024-09-14T09:10:20.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040503000000000002 2024-09-14T09:10:20.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:10:20.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802918+0000", 2024-09-14T09:10:20.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056796199999999998 2024-09-14T09:10:20.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:10:20.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808655+0000", 2024-09-14T09:10:20.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057365089999999999 2024-09-14T09:10:20.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:10:20.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808850+0000", 2024-09-14T09:10:20.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000194904 2024-09-14T09:10:20.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809069+0000", 2024-09-14T09:10:20.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021968000000000001 2024-09-14T09:10:20.079 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.079 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.079 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.079 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60356 3.2 3:40f9e9e7:::rbd_data.1112a10502fe.0000000000000160:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:20.079 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:10:20.079 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.928381575000003, 2024-09-14T09:10:20.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68053790800000002, 2024-09-14T09:10:20.079 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.080 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.080 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:10:20.080 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.080 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:20.080 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:20.080 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60356 2024-09-14T09:10:20.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.080 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:10:20.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:10:20.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121364+0000", 2024-09-14T09:10:20.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.173e-06 2024-09-14T09:10:20.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121371+0000", 2024-09-14T09:10:20.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-09-14T09:10:20.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121386+0000", 2024-09-14T09:10:20.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4925e-05 2024-09-14T09:10:20.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121395+0000", 2024-09-14T09:10:20.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8190000000000003e-06 2024-09-14T09:10:20.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121464+0000", 2024-09-14T09:10:20.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8149000000000001e-05 2024-09-14T09:10:20.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:20.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121474+0000", 2024-09-14T09:10:20.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0927999999999999e-05 2024-09-14T09:10:20.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795901+0000", 2024-09-14T09:10:20.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67442645499999998 2024-09-14T09:10:20.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796068+0000", 2024-09-14T09:10:20.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016655700000000001 2024-09-14T09:10:20.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 3", 2024-09-14T09:10:20.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796354+0000", 2024-09-14T09:10:20.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00028646999999999999 2024-09-14T09:10:20.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:10:20.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.800348+0000", 2024-09-14T09:10:20.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039943119999999999 2024-09-14T09:10:20.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:10:20.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801690+0000", 2024-09-14T09:10:20.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013415090000000001 2024-09-14T09:10:20.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:10:20.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801771+0000", 2024-09-14T09:10:20.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1678e-05 2024-09-14T09:10:20.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801900+0000", 2024-09-14T09:10:20.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000128978 2024-09-14T09:10:20.086 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.086 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.086 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.086 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62163 3.e 3:713ab431:::rbd_data.1112a10502fe.0000000000000198:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:20.086 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:10:20.086 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.838011367999997, 2024-09-14T09:10:20.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.597552682, 2024-09-14T09:10:20.086 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.086 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.086 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.086 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.087 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:20.087 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:20.087 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62163 2024-09-14T09:10:20.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.087 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:10:20.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:10:20.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211735+0000", 2024-09-14T09:10:20.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1110000000000002e-06 2024-09-14T09:10:20.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211744+0000", 2024-09-14T09:10:20.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0790000000000007e-06 2024-09-14T09:10:20.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211765+0000", 2024-09-14T09:10:20.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1114000000000001e-05 2024-09-14T09:10:20.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211775+0000", 2024-09-14T09:10:20.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0033e-05 2024-09-14T09:10:20.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211847+0000", 2024-09-14T09:10:20.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1503999999999998e-05 2024-09-14T09:10:20.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:20.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211857+0000", 2024-09-14T09:10:20.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0378e-05 2024-09-14T09:10:20.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799140+0000", 2024-09-14T09:10:20.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.58728279100000003 2024-09-14T09:10:20.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799289+0000", 2024-09-14T09:10:20.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000148966 2024-09-14T09:10:20.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809285+0000", 2024-09-14T09:10:20.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099967059999999993 2024-09-14T09:10:20.091 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.091 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.091 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.091 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63582 3.2 3:467f2009:::rbd_data.1112a10502fe.00000000000001a1:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:20.091 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:10:20.091 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.762818250999999, 2024-09-14T09:10:20.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51869012999999997, 2024-09-14T09:10:20.091 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.092 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.092 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.092 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.092 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:20.092 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:20.092 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63582 2024-09-14T09:10:20.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.092 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:10:20.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:10:20.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286928+0000", 2024-09-14T09:10:20.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.812e-06 2024-09-14T09:10:20.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286936+0000", 2024-09-14T09:10:20.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2390000000000002e-06 2024-09-14T09:10:20.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286955+0000", 2024-09-14T09:10:20.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8853000000000001e-05 2024-09-14T09:10:20.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286972+0000", 2024-09-14T09:10:20.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7365000000000001e-05 2024-09-14T09:10:20.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287052+0000", 2024-09-14T09:10:20.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9491000000000002e-05 2024-09-14T09:10:20.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:20.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287063+0000", 2024-09-14T09:10:20.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1620999999999999e-05 2024-09-14T09:10:20.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796696+0000", 2024-09-14T09:10:20.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50963256999999995 2024-09-14T09:10:20.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796847+0000", 2024-09-14T09:10:20.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015126899999999999 2024-09-14T09:10:20.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.805616+0000", 2024-09-14T09:10:20.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087689099999999996 2024-09-14T09:10:20.096 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.096 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.096 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.097 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63586 3.3 3.d4e49b03 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:20.097 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:10:20.097 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.762733869999998, 2024-09-14T09:10:20.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50188935099999998, 2024-09-14T09:10:20.097 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.097 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.097 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:20.097 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.097 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:20.097 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:20.097 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63586 2024-09-14T09:10:20.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.097 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:10:20.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:10:20.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287011+0000", 2024-09-14T09:10:20.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.61e-07 2024-09-14T09:10:20.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287014+0000", 2024-09-14T09:10:20.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3900000000000002e-06 2024-09-14T09:10:20.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287023+0000", 2024-09-14T09:10:20.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3380000000000005e-06 2024-09-14T09:10:20.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287029+0000", 2024-09-14T09:10:20.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0079999999999999e-06 2024-09-14T09:10:20.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287087+0000", 2024-09-14T09:10:20.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8322000000000002e-05 2024-09-14T09:10:20.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:20.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287096+0000", 2024-09-14T09:10:20.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8580000000000006e-06 2024-09-14T09:10:20.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788891+0000", 2024-09-14T09:10:20.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50179498499999997 2024-09-14T09:10:20.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788900+0000", 2024-09-14T09:10:20.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.789e-06 2024-09-14T09:10:20.101 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.101 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.101 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.101 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60363 3.1d 3:b8b44067:::rbd_data.1112a10502fe.000000000000018b:head [stat,delete] snapc 21=[21] RETRY=12 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:20.101 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:10:20.102 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.262012132000002, 2024-09-14T09:10:20.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268612690000001, 2024-09-14T09:10:20.102 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.102 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.102 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:20.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:20.102 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60363 2024-09-14T09:10:20.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.102 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:10:20.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:10:20.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787733+0000", 2024-09-14T09:10:20.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.314e-06 2024-09-14T09:10:20.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787739+0000", 2024-09-14T09:10:20.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5300000000000004e-06 2024-09-14T09:10:20.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787750+0000", 2024-09-14T09:10:20.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1251e-05 2024-09-14T09:10:20.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:10:20.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0739999999999993e-06 2024-09-14T09:10:20.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787827+0000", 2024-09-14T09:10:20.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8861000000000004e-05 2024-09-14T09:10:20.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:10:20.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787836+0000", 2024-09-14T09:10:20.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1339999999999993e-06 2024-09-14T09:10:20.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789335+0000", 2024-09-14T09:10:20.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014988289999999999 2024-09-14T09:10:20.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:20.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789343+0000", 2024-09-14T09:10:20.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6639999999999998e-06 2024-09-14T09:10:20.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799170+0000", 2024-09-14T09:10:20.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098272500000001 2024-09-14T09:10:20.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799377+0000", 2024-09-14T09:10:20.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000207126 2024-09-14T09:10:20.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814593+0000", 2024-09-14T09:10:20.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015216235999999999 2024-09-14T09:10:20.107 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.107 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.107 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.107 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63565 3.1d 3:bdc63b28:::rbd_data.1112a10502fe.000000000000016d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=9 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:20.108 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:10:20.108 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.261966340999997, 2024-09-14T09:10:20.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0271114539999999, 2024-09-14T09:10:20.108 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.108 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.108 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:10:20.108 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.108 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:20.108 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:20.108 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63565 2024-09-14T09:10:20.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.108 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:10:20.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:10:20.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:10:20.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6899999999999998e-07 2024-09-14T09:10:20.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787781+0000", 2024-09-14T09:10:20.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8909999999999999e-06 2024-09-14T09:10:20.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787787+0000", 2024-09-14T09:10:20.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3230000000000003e-06 2024-09-14T09:10:20.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787793+0000", 2024-09-14T09:10:20.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-09-14T09:10:20.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789455+0000", 2024-09-14T09:10:20.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001661596 2024-09-14T09:10:20.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:20.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789463+0000", 2024-09-14T09:10:20.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4889999999999995e-06 2024-09-14T09:10:20.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800115+0000", 2024-09-14T09:10:20.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0106512670000001 2024-09-14T09:10:20.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800334+0000", 2024-09-14T09:10:20.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000219213 2024-09-14T09:10:20.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:10:20.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800651+0000", 2024-09-14T09:10:20.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00031765500000000002 2024-09-14T09:10:20.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:10:20.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.811875+0000", 2024-09-14T09:10:20.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011224032 2024-09-14T09:10:20.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:10:20.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814665+0000", 2024-09-14T09:10:20.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002789606 2024-09-14T09:10:20.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:10:20.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814742+0000", 2024-09-14T09:10:20.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6916999999999996e-05 2024-09-14T09:10:20.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814889+0000", 2024-09-14T09:10:20.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014725799999999999 2024-09-14T09:10:20.114 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.114 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.114 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.114 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:67113 3.1d 3:bba7fe0d:::rbd_data.1112a10502fe.00000000000001bf:head [stat,delete] snapc 21=[21] RETRY=4 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:20.114 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:10:20.114 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.261205482999998, 2024-09-14T09:10:20.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0265995649999999, 2024-09-14T09:10:20.114 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.114 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.115 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.115 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.115 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:20.115 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:20.115 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 67113 2024-09-14T09:10:20.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.115 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:10:20.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:10:20.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:10:20.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:10:20.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788543+0000", 2024-09-14T09:10:20.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-09-14T09:10:20.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788552+0000", 2024-09-14T09:10:20.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:10:20.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788559+0000", 2024-09-14T09:10:20.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:10:20.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789489+0000", 2024-09-14T09:10:20.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00092982199999999996 2024-09-14T09:10:20.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:20.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789497+0000", 2024-09-14T09:10:20.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6299999999999998e-06 2024-09-14T09:10:20.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801068+0000", 2024-09-14T09:10:20.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0115709530000001 2024-09-14T09:10:20.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801240+0000", 2024-09-14T09:10:20.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017276600000000001 2024-09-14T09:10:20.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815138+0000", 2024-09-14T09:10:20.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013897856 2024-09-14T09:10:20.119 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.119 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.120 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.120 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73412 3.1d 3:be4606c3:::rbd_data.1112a10502fe.00000000000001f2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:20.120 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:10:20.120 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.261174371000003, 2024-09-14T09:10:20.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026815928, 2024-09-14T09:10:20.120 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.120 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.120 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.120 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.120 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:20.120 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:20.121 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73412 2024-09-14T09:10:20.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.121 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:10:20.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:10:20.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:10:20.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5699999999999998e-07 2024-09-14T09:10:20.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788572+0000", 2024-09-14T09:10:20.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2809999999999998e-06 2024-09-14T09:10:20.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788579+0000", 2024-09-14T09:10:20.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5629999999999997e-06 2024-09-14T09:10:20.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788584+0000", 2024-09-14T09:10:20.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1710000000000001e-06 2024-09-14T09:10:20.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789521+0000", 2024-09-14T09:10:20.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00093657400000000002 2024-09-14T09:10:20.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:20.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789528+0000", 2024-09-14T09:10:20.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5719999999999997e-06 2024-09-14T09:10:20.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801631+0000", 2024-09-14T09:10:20.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0121023229999999 2024-09-14T09:10:20.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801792+0000", 2024-09-14T09:10:20.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016174000000000001 2024-09-14T09:10:20.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815386+0000", 2024-09-14T09:10:20.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013593246999999999 2024-09-14T09:10:20.125 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.125 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.125 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.125 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:77244 3.1d 3:b801be19:::rbd_data.1112a10502fe.0000000000000204:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:20.125 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:10:20.125 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.079310124999999, 2024-09-14T09:10:20.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.84519277100000001, 2024-09-14T09:10:20.125 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.125 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.125 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.126 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.126 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:20.126 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:20.126 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 77244 2024-09-14T09:10:20.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.126 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:10:20.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:10:20.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970436+0000", 2024-09-14T09:10:20.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.511e-06 2024-09-14T09:10:20.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970441+0000", 2024-09-14T09:10:20.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0470000000000001e-06 2024-09-14T09:10:20.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970453+0000", 2024-09-14T09:10:20.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2629999999999999e-05 2024-09-14T09:10:20.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970461+0000", 2024-09-14T09:10:20.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6850000000000001e-06 2024-09-14T09:10:20.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970524+0000", 2024-09-14T09:10:20.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3332999999999998e-05 2024-09-14T09:10:20.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:20.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970544+0000", 2024-09-14T09:10:20.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9731000000000001e-05 2024-09-14T09:10:20.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802188+0000", 2024-09-14T09:10:20.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.83164380000000004 2024-09-14T09:10:20.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:10:20.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015411999999999999 2024-09-14T09:10:20.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815627+0000", 2024-09-14T09:10:20.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013284914 2024-09-14T09:10:20.130 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.130 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.130 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.130 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:79796 3.1d 3:bc22caaf:::rbd_data.1112a10502fe.000000000000020c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:20.130 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:10:20.130 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.958001439, 2024-09-14T09:10:20.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72411694299999996, 2024-09-14T09:10:20.130 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.131 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.131 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.131 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.131 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:20.131 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:20.131 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 79796 2024-09-14T09:10:20.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.131 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:10:20.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:10:20.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091745+0000", 2024-09-14T09:10:20.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2000000000000001e-06 2024-09-14T09:10:20.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091752+0000", 2024-09-14T09:10:20.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-09-14T09:10:20.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091772+0000", 2024-09-14T09:10:20.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9822000000000001e-05 2024-09-14T09:10:20.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091791+0000", 2024-09-14T09:10:20.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9236e-05 2024-09-14T09:10:20.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091882+0000", 2024-09-14T09:10:20.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0783000000000001e-05 2024-09-14T09:10:20.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:20.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091892+0000", 2024-09-14T09:10:20.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7999999999999993e-06 2024-09-14T09:10:20.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802744+0000", 2024-09-14T09:10:20.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.710851868 2024-09-14T09:10:20.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802902+0000", 2024-09-14T09:10:20.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015814900000000001 2024-09-14T09:10:20.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815860+0000", 2024-09-14T09:10:20.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012957605000000001 2024-09-14T09:10:20.135 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.135 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.135 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.135 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80904 3.1d 3:be0e7f3d:::rbd_data.1112a10502fe.0000000000000214:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:20.135 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:10:20.136 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.877915592000001, 2024-09-14T09:10:20.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64435178100000001, 2024-09-14T09:10:20.136 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.136 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.136 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.136 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.136 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:20.136 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:20.136 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80904 2024-09-14T09:10:20.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.136 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:10:20.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:10:20.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171831+0000", 2024-09-14T09:10:20.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0729999999999999e-06 2024-09-14T09:10:20.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171839+0000", 2024-09-14T09:10:20.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9179999999999994e-06 2024-09-14T09:10:20.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171857+0000", 2024-09-14T09:10:20.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8957000000000002e-05 2024-09-14T09:10:20.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171867+0000", 2024-09-14T09:10:20.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7100000000000002e-06 2024-09-14T09:10:20.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171957+0000", 2024-09-14T09:10:20.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9932999999999994e-05 2024-09-14T09:10:20.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:20.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171974+0000", 2024-09-14T09:10:20.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6988999999999999e-05 2024-09-14T09:10:20.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803301+0000", 2024-09-14T09:10:20.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63132648599999996 2024-09-14T09:10:20.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803482+0000", 2024-09-14T09:10:20.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000181607 2024-09-14T09:10:20.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816180+0000", 2024-09-14T09:10:20.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012698108 2024-09-14T09:10:20.140 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.140 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.140 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.140 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80964 3.1d 3:be42e20f:::rbd_data.1112a10502fe.0000000000000219:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:20.141 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:10:20.141 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.872280025000002, 2024-09-14T09:10:20.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63896829799999999, 2024-09-14T09:10:20.141 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.141 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.141 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.141 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.141 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:20.141 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:20.141 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80964 2024-09-14T09:10:20.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.141 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:10:20.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:10:20.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177466+0000", 2024-09-14T09:10:20.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6610000000000001e-06 2024-09-14T09:10:20.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177472+0000", 2024-09-14T09:10:20.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3029999999999996e-06 2024-09-14T09:10:20.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177490+0000", 2024-09-14T09:10:20.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8099000000000001e-05 2024-09-14T09:10:20.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177499+0000", 2024-09-14T09:10:20.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:10:20.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177560+0000", 2024-09-14T09:10:20.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1334000000000006e-05 2024-09-14T09:10:20.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:20.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177578+0000", 2024-09-14T09:10:20.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8434999999999999e-05 2024-09-14T09:10:20.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803910+0000", 2024-09-14T09:10:20.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62633190699999997 2024-09-14T09:10:20.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.806612+0000", 2024-09-14T09:10:20.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002702257 2024-09-14T09:10:20.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816432+0000", 2024-09-14T09:10:20.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098199370000000008 2024-09-14T09:10:20.145 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.145 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.145 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.146 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83321 3.1d 3:bb24b47b:::rbd_data.1112a10502fe.0000000000000223:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:20.146 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:10:20.146 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.757826350999999, 2024-09-14T09:10:20.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52477628799999998, 2024-09-14T09:10:20.146 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.146 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.146 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.146 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.146 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:20.146 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:20.146 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83321 2024-09-14T09:10:20.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.147 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:10:20.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:10:20.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291920+0000", 2024-09-14T09:10:20.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.888e-06 2024-09-14T09:10:20.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291926+0000", 2024-09-14T09:10:20.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6059999999999999e-06 2024-09-14T09:10:20.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291943+0000", 2024-09-14T09:10:20.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6813e-05 2024-09-14T09:10:20.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291952+0000", 2024-09-14T09:10:20.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7439999999999996e-06 2024-09-14T09:10:20.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292023+0000", 2024-09-14T09:10:20.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1320000000000002e-05 2024-09-14T09:10:20.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:20.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292030+0000", 2024-09-14T09:10:20.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4219999999999997e-06 2024-09-14T09:10:20.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807221+0000", 2024-09-14T09:10:20.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51519140699999999 2024-09-14T09:10:20.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807406+0000", 2024-09-14T09:10:20.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018532800000000001 2024-09-14T09:10:20.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816694+0000", 2024-09-14T09:10:20.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092877600000000008 2024-09-14T09:10:20.151 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.151 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.151 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.151 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83358 3.1d 3:bb230e23:::rbd_data.1112a10502fe.000000000000022b:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:20.151 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:10:20.151 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.756306461000001, 2024-09-14T09:10:20.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52374808900000003, 2024-09-14T09:10:20.151 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.151 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.151 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.151 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.152 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:20.152 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:20.152 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83358 2024-09-14T09:10:20.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.152 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:10:20.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:10:20.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293439+0000", 2024-09-14T09:10:20.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5899999999999995e-07 2024-09-14T09:10:20.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293443+0000", 2024-09-14T09:10:20.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9309999999999999e-06 2024-09-14T09:10:20.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293457+0000", 2024-09-14T09:10:20.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3944999999999999e-05 2024-09-14T09:10:20.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293466+0000", 2024-09-14T09:10:20.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4319999999999999e-06 2024-09-14T09:10:20.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293530+0000", 2024-09-14T09:10:20.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3860000000000002e-05 2024-09-14T09:10:20.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:20.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293540+0000", 2024-09-14T09:10:20.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0107e-05 2024-09-14T09:10:20.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809096+0000", 2024-09-14T09:10:20.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51555587800000002 2024-09-14T09:10:20.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809265+0000", 2024-09-14T09:10:20.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000169092 2024-09-14T09:10:20.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817186+0000", 2024-09-14T09:10:20.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079209850000000002 2024-09-14T09:10:20.156 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.156 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.156 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.156 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83361 3.1d 3:bd571564:::rbd_data.1112a10502fe.000000000000022c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:20.156 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:10:20.156 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 62.755988385000002, 2024-09-14T09:10:20.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52373873100000001, 2024-09-14T09:10:20.157 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.157 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.157 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.157 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.157 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:20.157 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:20.157 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83361 2024-09-14T09:10:20.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.157 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:10:20.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:10:20.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293757+0000", 2024-09-14T09:10:20.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8000000000000004e-07 2024-09-14T09:10:20.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293762+0000", 2024-09-14T09:10:20.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8019999999999997e-06 2024-09-14T09:10:20.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293775+0000", 2024-09-14T09:10:20.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2884000000000001e-05 2024-09-14T09:10:20.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293783+0000", 2024-09-14T09:10:20.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:10:20.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293849+0000", 2024-09-14T09:10:20.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5859999999999996e-05 2024-09-14T09:10:20.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:20.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293861+0000", 2024-09-14T09:10:20.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2238999999999999e-05 2024-09-14T09:10:20.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809680+0000", 2024-09-14T09:10:20.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51581856800000003 2024-09-14T09:10:20.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809844+0000", 2024-09-14T09:10:20.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016441200000000001 2024-09-14T09:10:20.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817494+0000", 2024-09-14T09:10:20.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076502360000000004 2024-09-14T09:10:20.161 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.161 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.161 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.161 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.161 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.161 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:20.163 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:20.165+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:20.164 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:10:20.264 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:20.266+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:20.306 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:20.307 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:20.307 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:10:20.307 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:20.315 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:10:20.399 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:20.401+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:20.458 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:10:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:10:20.458 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:20.466 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:20.467+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:20.467 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:10:20.567 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:20.569+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:20.612 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:20.612 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:10:20.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:10:20.612 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:10:20.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.612 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2265 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4034560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:20.612 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:10:20.612 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.75006668100001, 2024-09-14T09:10:20.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073974829000000006, 2024-09-14T09:10:20.613 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.613 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.613 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.613 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.613 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:20.613 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:20.613 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2265 2024-09-14T09:10:20.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.613 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:10:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:10:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862542+0000", 2024-09-14T09:10:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:10:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862543+0000", 2024-09-14T09:10:20.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.81e-06 2024-09-14T09:10:20.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862549+0000", 2024-09-14T09:10:20.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8850000000000004e-06 2024-09-14T09:10:20.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862554+0000", 2024-09-14T09:10:20.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5279999999999997e-06 2024-09-14T09:10:20.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936318+0000", 2024-09-14T09:10:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073764422999999996 2024-09-14T09:10:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936412+0000", 2024-09-14T09:10:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3801000000000005e-05 2024-09-14T09:10:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936516+0000", 2024-09-14T09:10:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000104007 2024-09-14T09:10:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2266 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4096000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:10:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.75004881700001, 2024-09-14T09:10:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074208332000000002, 2024-09-14T09:10:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2266 2024-09-14T09:10:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:10:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:10:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862738+0000", 2024-09-14T09:10:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017920300000000001 2024-09-14T09:10:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862744+0000", 2024-09-14T09:10:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3000000000000001e-06 2024-09-14T09:10:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862753+0000", 2024-09-14T09:10:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8179999999999999e-06 2024-09-14T09:10:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862785+0000", 2024-09-14T09:10:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1949000000000002e-05 2024-09-14T09:10:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936556+0000", 2024-09-14T09:10:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073770268999999999 2024-09-14T09:10:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936657+0000", 2024-09-14T09:10:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101387 2024-09-14T09:10:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936767+0000", 2024-09-14T09:10:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110406 2024-09-14T09:10:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2267 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4157440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:10:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.749810235, 2024-09-14T09:10:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074200918000000005, 2024-09-14T09:10:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2267 2024-09-14T09:10:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:10:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:10:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863416+0000", 2024-09-14T09:10:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000618492 2024-09-14T09:10:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863421+0000", 2024-09-14T09:10:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1359999999999996e-06 2024-09-14T09:10:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863434+0000", 2024-09-14T09:10:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2291e-05 2024-09-14T09:10:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863444+0000", 2024-09-14T09:10:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9769999999999995e-06 2024-09-14T09:10:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936808+0000", 2024-09-14T09:10:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073364051999999999 2024-09-14T09:10:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936892+0000", 2024-09-14T09:10:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4641999999999994e-05 2024-09-14T09:10:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936999+0000", 2024-09-14T09:10:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106328 2024-09-14T09:10:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2329 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 106496~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:10:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.74908162600001, 2024-09-14T09:10:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074180251000000003, 2024-09-14T09:10:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2329 2024-09-14T09:10:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:10:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:10:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864203+0000", 2024-09-14T09:10:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000677015 2024-09-14T09:10:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864208+0000", 2024-09-14T09:10:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.972e-06 2024-09-14T09:10:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864221+0000", 2024-09-14T09:10:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2683e-05 2024-09-14T09:10:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864229+0000", 2024-09-14T09:10:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0809999999999994e-06 2024-09-14T09:10:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937430+0000", 2024-09-14T09:10:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073201231000000005 2024-09-14T09:10:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937513+0000", 2024-09-14T09:10:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2652999999999996e-05 2024-09-14T09:10:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937707+0000", 2024-09-14T09:10:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000193616 2024-09-14T09:10:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2331 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 229376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:10:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.74826412900001, 2024-09-14T09:10:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.07400843, 2024-09-14T09:10:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2331 2024-09-14T09:10:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:10:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:10:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868104+0000", 2024-09-14T09:10:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003760453 2024-09-14T09:10:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868109+0000", 2024-09-14T09:10:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9339999999999997e-06 2024-09-14T09:10:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868119+0000", 2024-09-14T09:10:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5389999999999996e-06 2024-09-14T09:10:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868126+0000", 2024-09-14T09:10:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4499999999999998e-06 2024-09-14T09:10:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938065+0000", 2024-09-14T09:10:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069938809000000005 2024-09-14T09:10:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938148+0000", 2024-09-14T09:10:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3171999999999996e-05 2024-09-14T09:10:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938352+0000", 2024-09-14T09:10:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020407300000000001 2024-09-14T09:10:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2380 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3239936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:10:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.733239101, 2024-09-14T09:10:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073985913, 2024-09-14T09:10:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2380 2024-09-14T09:10:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:10:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:10:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879697+0000", 2024-09-14T09:10:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032864100000000001 2024-09-14T09:10:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879702+0000", 2024-09-14T09:10:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.578e-06 2024-09-14T09:10:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879716+0000", 2024-09-14T09:10:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.413e-05 2024-09-14T09:10:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879724+0000", 2024-09-14T09:10:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.559e-06 2024-09-14T09:10:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953155+0000", 2024-09-14T09:10:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073431221000000005 2024-09-14T09:10:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953247+0000", 2024-09-14T09:10:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1662000000000004e-05 2024-09-14T09:10:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953355+0000", 2024-09-14T09:10:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010812200000000001 2024-09-14T09:10:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2501 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2850816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:10:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.714696797, 2024-09-14T09:10:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074288858999999999, 2024-09-14T09:10:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2501 2024-09-14T09:10:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:10:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:10:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:10:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.41e-07 2024-09-14T09:10:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897913+0000", 2024-09-14T09:10:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3090000000000001e-06 2024-09-14T09:10:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897918+0000", 2024-09-14T09:10:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8470000000000003e-06 2024-09-14T09:10:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897922+0000", 2024-09-14T09:10:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5549999999999996e-06 2024-09-14T09:10:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971872+0000", 2024-09-14T09:10:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073950057999999999 2024-09-14T09:10:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971958+0000", 2024-09-14T09:10:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5941999999999998e-05 2024-09-14T09:10:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972200+0000", 2024-09-14T09:10:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000241907 2024-09-14T09:10:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2502 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2912256~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:10:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.714657617, 2024-09-14T09:10:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074614080999999999, 2024-09-14T09:10:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2502 2024-09-14T09:10:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:10:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:10:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897951+0000", 2024-09-14T09:10:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:10:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897953+0000", 2024-09-14T09:10:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5670000000000002e-06 2024-09-14T09:10:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897970+0000", 2024-09-14T09:10:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6319000000000001e-05 2024-09-14T09:10:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897976+0000", 2024-09-14T09:10:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8760000000000002e-06 2024-09-14T09:10:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972245+0000", 2024-09-14T09:10:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074269186000000001 2024-09-14T09:10:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972333+0000", 2024-09-14T09:10:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7800999999999995e-05 2024-09-14T09:10:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972564+0000", 2024-09-14T09:10:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000231833 2024-09-14T09:10:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2503 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2973696~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:10:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.7146236, 2024-09-14T09:10:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074944286999999998, 2024-09-14T09:10:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2503 2024-09-14T09:10:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:10:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:10:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897985+0000", 2024-09-14T09:10:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999998e-07 2024-09-14T09:10:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897987+0000", 2024-09-14T09:10:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.401e-06 2024-09-14T09:10:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897999+0000", 2024-09-14T09:10:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1851999999999999e-05 2024-09-14T09:10:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898005+0000", 2024-09-14T09:10:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9789999999999998e-06 2024-09-14T09:10:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972609+0000", 2024-09-14T09:10:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074604217 2024-09-14T09:10:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972684+0000", 2024-09-14T09:10:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4777999999999995e-05 2024-09-14T09:10:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972929+0000", 2024-09-14T09:10:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024448100000000001 2024-09-14T09:10:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2504 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3035136~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:10:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.714595508, 2024-09-14T09:10:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075285131000000005, 2024-09-14T09:10:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2504 2024-09-14T09:10:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:10:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:10:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898078+0000", 2024-09-14T09:10:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5775e-05 2024-09-14T09:10:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898082+0000", 2024-09-14T09:10:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.49e-06 2024-09-14T09:10:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898092+0000", 2024-09-14T09:10:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0509999999999999e-05 2024-09-14T09:10:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898099+0000", 2024-09-14T09:10:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.81e-06 2024-09-14T09:10:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972971+0000", 2024-09-14T09:10:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074871788999999994 2024-09-14T09:10:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973055+0000", 2024-09-14T09:10:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3980000000000006e-05 2024-09-14T09:10:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973298+0000", 2024-09-14T09:10:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024277700000000001 2024-09-14T09:10:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2505 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3096576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:10:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.714499253, 2024-09-14T09:10:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075506668999999998, 2024-09-14T09:10:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.659 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.659 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.659 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.659 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:20.659 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:20.659 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2505 2024-09-14T09:10:20.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.659 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:10:20.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:10:20.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898370+0000", 2024-09-14T09:10:20.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026128799999999998 2024-09-14T09:10:20.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898374+0000", 2024-09-14T09:10:20.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8070000000000001e-06 2024-09-14T09:10:20.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898383+0000", 2024-09-14T09:10:20.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0520000000000007e-06 2024-09-14T09:10:20.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898389+0000", 2024-09-14T09:10:20.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2639999999999997e-06 2024-09-14T09:10:20.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973330+0000", 2024-09-14T09:10:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074940548999999995 2024-09-14T09:10:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973402+0000", 2024-09-14T09:10:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2556000000000001e-05 2024-09-14T09:10:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973615+0000", 2024-09-14T09:10:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000213153 2024-09-14T09:10:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2506 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3158016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:10:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.71420600899999, 2024-09-14T09:10:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075556110999999995, 2024-09-14T09:10:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2506 2024-09-14T09:10:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.664 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:10:20.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:10:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898497+0000", 2024-09-14T09:10:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4806e-05 2024-09-14T09:10:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898500+0000", 2024-09-14T09:10:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.54e-06 2024-09-14T09:10:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898507+0000", 2024-09-14T09:10:20.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1590000000000004e-06 2024-09-14T09:10:20.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898513+0000", 2024-09-14T09:10:20.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.015e-06 2024-09-14T09:10:20.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973656+0000", 2024-09-14T09:10:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075142929999999997 2024-09-14T09:10:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973742+0000", 2024-09-14T09:10:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5535e-05 2024-09-14T09:10:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973958+0000", 2024-09-14T09:10:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000216126 2024-09-14T09:10:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2507 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3219456~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:10:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.714077425, 2024-09-14T09:10:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075623459000000004, 2024-09-14T09:10:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2507 2024-09-14T09:10:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:10:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:10:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898761+0000", 2024-09-14T09:10:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000230614 2024-09-14T09:10:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898765+0000", 2024-09-14T09:10:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6629999999999999e-06 2024-09-14T09:10:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898774+0000", 2024-09-14T09:10:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6749999999999997e-06 2024-09-14T09:10:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898781+0000", 2024-09-14T09:10:20.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4640000000000003e-06 2024-09-14T09:10:20.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973985+0000", 2024-09-14T09:10:20.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075204101999999995 2024-09-14T09:10:20.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974063+0000", 2024-09-14T09:10:20.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7632000000000005e-05 2024-09-14T09:10:20.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974154+0000", 2024-09-14T09:10:20.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1309000000000003e-05 2024-09-14T09:10:20.673 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.673 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.673 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.673 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2508 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3280896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:20.674 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:10:20.674 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.713815662, 2024-09-14T09:10:20.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075576943999999993, 2024-09-14T09:10:20.674 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.674 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.674 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.674 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.674 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:20.674 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:20.674 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2508 2024-09-14T09:10:20.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.674 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:10:20.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:10:20.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899176+0000", 2024-09-14T09:10:20.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038340500000000002 2024-09-14T09:10:20.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899179+0000", 2024-09-14T09:10:20.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0290000000000001e-06 2024-09-14T09:10:20.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899186+0000", 2024-09-14T09:10:20.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8199999999999999e-06 2024-09-14T09:10:20.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899190+0000", 2024-09-14T09:10:20.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2050000000000004e-06 2024-09-14T09:10:20.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974193+0000", 2024-09-14T09:10:20.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075003632000000001 2024-09-14T09:10:20.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974276+0000", 2024-09-14T09:10:20.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2272000000000001e-05 2024-09-14T09:10:20.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974369+0000", 2024-09-14T09:10:20.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3580999999999997e-05 2024-09-14T09:10:20.677 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.678 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.678 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.678 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2509 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3342336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:20.678 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:10:20.678 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.71340804499999, 2024-09-14T09:10:20.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075356229999999996, 2024-09-14T09:10:20.678 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.678 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.678 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.678 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.679 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:20.679 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:20.679 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2509 2024-09-14T09:10:20.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.679 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:10:20.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:10:20.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899439+0000", 2024-09-14T09:10:20.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023958599999999999 2024-09-14T09:10:20.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899444+0000", 2024-09-14T09:10:20.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8790000000000002e-06 2024-09-14T09:10:20.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899455+0000", 2024-09-14T09:10:20.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0597999999999999e-05 2024-09-14T09:10:20.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899462+0000", 2024-09-14T09:10:20.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8179999999999998e-06 2024-09-14T09:10:20.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974400+0000", 2024-09-14T09:10:20.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074937999000000005 2024-09-14T09:10:20.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974465+0000", 2024-09-14T09:10:20.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5134000000000004e-05 2024-09-14T09:10:20.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974556+0000", 2024-09-14T09:10:20.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1216000000000002e-05 2024-09-14T09:10:20.682 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.682 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.683 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.683 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2510 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3403776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:20.683 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:10:20.683 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.713132652, 2024-09-14T09:10:20.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075295775999999995, 2024-09-14T09:10:20.683 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.683 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.683 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.683 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.683 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:20.683 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:20.683 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2510 2024-09-14T09:10:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:10:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:10:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899691+0000", 2024-09-14T09:10:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021615999999999999 2024-09-14T09:10:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899696+0000", 2024-09-14T09:10:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3200000000000001e-06 2024-09-14T09:10:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899704+0000", 2024-09-14T09:10:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9440000000000005e-06 2024-09-14T09:10:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899710+0000", 2024-09-14T09:10:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.584e-06 2024-09-14T09:10:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974594+0000", 2024-09-14T09:10:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074883551000000007 2024-09-14T09:10:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974679+0000", 2024-09-14T09:10:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5365999999999995e-05 2024-09-14T09:10:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974771+0000", 2024-09-14T09:10:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1850999999999999e-05 2024-09-14T09:10:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2511 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3465216~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:10:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.712886434, 2024-09-14T09:10:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075234668000000005, 2024-09-14T09:10:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2511 2024-09-14T09:10:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:10:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:10:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899951+0000", 2024-09-14T09:10:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000229569 2024-09-14T09:10:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899955+0000", 2024-09-14T09:10:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1010000000000002e-06 2024-09-14T09:10:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899971+0000", 2024-09-14T09:10:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5648999999999999e-05 2024-09-14T09:10:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899978+0000", 2024-09-14T09:10:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0829999999999998e-06 2024-09-14T09:10:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974806+0000", 2024-09-14T09:10:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074828092999999998 2024-09-14T09:10:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974870+0000", 2024-09-14T09:10:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4492000000000005e-05 2024-09-14T09:10:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974956+0000", 2024-09-14T09:10:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5680999999999995e-05 2024-09-14T09:10:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2512 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3526656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:10:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 103.712618889, 2024-09-14T09:10:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075178812999999997, 2024-09-14T09:10:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2512 2024-09-14T09:10:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:10:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:10:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904181+0000", 2024-09-14T09:10:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041919399999999999 2024-09-14T09:10:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904186+0000", 2024-09-14T09:10:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2390000000000002e-06 2024-09-14T09:10:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904199+0000", 2024-09-14T09:10:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2709e-05 2024-09-14T09:10:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904207+0000", 2024-09-14T09:10:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8150000000000006e-06 2024-09-14T09:10:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975000+0000", 2024-09-14T09:10:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.070793444999999997 2024-09-14T09:10:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975079+0000", 2024-09-14T09:10:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8480999999999996e-05 2024-09-14T09:10:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975168+0000", 2024-09-14T09:10:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9184000000000005e-05 2024-09-14T09:10:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:22840 3.15 3:a8cf3dc2:::rbd_header.1112a10502fe:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:10:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 64.053045866999994, 2024-09-14T09:10:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.119998785, 2024-09-14T09:10:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:10:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:10:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 22840 2024-09-14T09:10:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:10:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:10:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642492+0000", 2024-09-14T09:10:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.082930276999999997 2024-09-14T09:10:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642495+0000", 2024-09-14T09:10:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9809999999999999e-06 2024-09-14T09:10:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642501+0000", 2024-09-14T09:10:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-09-14T09:10:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642506+0000", 2024-09-14T09:10:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6650000000000002e-06 2024-09-14T09:10:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679483+0000", 2024-09-14T09:10:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036977777000000003 2024-09-14T09:10:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679517+0000", 2024-09-14T09:10:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.345e-05 2024-09-14T09:10:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679561+0000", 2024-09-14T09:10:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3930999999999997e-05 2024-09-14T09:10:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:22857 3.15 3:a8cf3dc2:::rbd_header.1112a10502fe:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:10:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.903151942000001, 2024-09-14T09:10:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.088427917999999994, 2024-09-14T09:10:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:10:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:10:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 22857 2024-09-14T09:10:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:10:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:10:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777685+0000", 2024-09-14T09:10:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.068229181999999999 2024-09-14T09:10:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777688+0000", 2024-09-14T09:10:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1980000000000001e-06 2024-09-14T09:10:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777695+0000", 2024-09-14T09:10:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:10:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777700+0000", 2024-09-14T09:10:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0919999999999997e-06 2024-09-14T09:10:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797735+0000", 2024-09-14T09:10:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0200351 2024-09-14T09:10:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797800+0000", 2024-09-14T09:10:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4305000000000002e-05 2024-09-14T09:10:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797884+0000", 2024-09-14T09:10:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4344000000000004e-05 2024-09-14T09:10:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:20.703 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:20.705 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:10:20.706 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:20.707+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:20.805 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:20.807+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:20.849 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:20.849 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:20.849 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:10:20.850 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:20.858 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:10:20.906 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:20.908+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:20.960 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:20.960 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:20.960 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:10:20.960 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:10:20.960 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:20.966 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is set 2024-09-14T09:10:20.969 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:10:21.007 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:21.008+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:21.087 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:21.087 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:10:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:10:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:10:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:987 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:10:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 82.230111281000006, 2024-09-14T09:10:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001359466, 2024-09-14T09:10:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 987 2024-09-14T09:10:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:10:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858331+0000", 2024-09-14T09:10:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858333+0000", 2024-09-14T09:10:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.621e-06 2024-09-14T09:10:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858349+0000", 2024-09-14T09:10:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5758000000000001e-05 2024-09-14T09:10:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858366+0000", 2024-09-14T09:10:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7368e-05 2024-09-14T09:10:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858382+0000", 2024-09-14T09:10:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6039e-05 2024-09-14T09:10:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858441+0000", 2024-09-14T09:10:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8662999999999997e-05 2024-09-14T09:10:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858449+0000", 2024-09-14T09:10:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3960000000000006e-06 2024-09-14T09:10:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859682+0000", 2024-09-14T09:10:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001233096 2024-09-14T09:10:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859691+0000", 2024-09-14T09:10:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5250000000000005e-06 2024-09-14T09:10:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.093 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:21.093 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.093 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:988 3.10 3.e1157110 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:21.093 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:10:21.093 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 82.229983411000006, 2024-09-14T09:10:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0012656799999999, 2024-09-14T09:10:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 988 2024-09-14T09:10:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:10:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858459+0000", 2024-09-14T09:10:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858460+0000", 2024-09-14T09:10:21.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9999999999999997e-07 2024-09-14T09:10:21.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:21.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858463+0000", 2024-09-14T09:10:21.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7459999999999998e-06 2024-09-14T09:10:21.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:21.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858471+0000", 2024-09-14T09:10:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3900000000000004e-06 2024-09-14T09:10:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.858478+0000", 2024-09-14T09:10:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7020000000000004e-06 2024-09-14T09:10:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859102+0000", 2024-09-14T09:10:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062419699999999995 2024-09-14T09:10:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859109+0000", 2024-09-14T09:10:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7419999999999997e-06 2024-09-14T09:10:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859718+0000", 2024-09-14T09:10:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006085629999999 2024-09-14T09:10:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.859725+0000", 2024-09-14T09:10:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7399999999999998e-06 2024-09-14T09:10:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1003 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:10:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 82.229120174000002, 2024-09-14T09:10:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009495209999999, 2024-09-14T09:10:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1003 2024-09-14T09:10:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:10:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859322+0000", 2024-09-14T09:10:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859323+0000", 2024-09-14T09:10:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3099999999999998e-07 2024-09-14T09:10:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859326+0000", 2024-09-14T09:10:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-06 2024-09-14T09:10:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859333+0000", 2024-09-14T09:10:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3300000000000001e-06 2024-09-14T09:10:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859339+0000", 2024-09-14T09:10:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6400000000000002e-06 2024-09-14T09:10:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859387+0000", 2024-09-14T09:10:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8448000000000001e-05 2024-09-14T09:10:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:10:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9540000000000004e-06 2024-09-14T09:10:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860260+0000", 2024-09-14T09:10:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000864921 2024-09-14T09:10:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860272+0000", 2024-09-14T09:10:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1993e-05 2024-09-14T09:10:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1004 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:10:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 82.229084599000004, 2024-09-14T09:10:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000947875, 2024-09-14T09:10:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1004 2024-09-14T09:10:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:10:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:10:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859358+0000", 2024-09-14T09:10:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7199999999999999e-07 2024-09-14T09:10:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859361+0000", 2024-09-14T09:10:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.892e-06 2024-09-14T09:10:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859368+0000", 2024-09-14T09:10:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4370000000000004e-06 2024-09-14T09:10:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859373+0000", 2024-09-14T09:10:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6690000000000003e-06 2024-09-14T09:10:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859430+0000", 2024-09-14T09:10:21.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6456999999999998e-05 2024-09-14T09:10:21.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859434+0000", 2024-09-14T09:10:21.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8410000000000002e-06 2024-09-14T09:10:21.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860299+0000", 2024-09-14T09:10:21.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008650370000001 2024-09-14T09:10:21.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:21.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860306+0000", 2024-09-14T09:10:21.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0700000000000001e-06 2024-09-14T09:10:21.109 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.109 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:21.109 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.109 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1005 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:21.109 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:10:21.109 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 82.229060926000002, 2024-09-14T09:10:21.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0009585480000001, 2024-09-14T09:10:21.110 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:21.110 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:21.110 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.110 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:21.110 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:21.110 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:21.110 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1005 2024-09-14T09:10:21.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.110 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:21.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:21.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:10:21.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:21.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:10:21.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:21.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859382+0000", 2024-09-14T09:10:21.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9700000000000002e-07 2024-09-14T09:10:21.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:21.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859384+0000", 2024-09-14T09:10:21.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.024e-06 2024-09-14T09:10:21.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:21.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859390+0000", 2024-09-14T09:10:21.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7080000000000002e-06 2024-09-14T09:10:21.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859395+0000", 2024-09-14T09:10:21.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8980000000000004e-06 2024-09-14T09:10:21.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859527+0000", 2024-09-14T09:10:21.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013228099999999999 2024-09-14T09:10:21.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859532+0000", 2024-09-14T09:10:21.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5899999999999998e-06 2024-09-14T09:10:21.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860330+0000", 2024-09-14T09:10:21.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0007973509999999 2024-09-14T09:10:21.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:21.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860340+0000", 2024-09-14T09:10:21.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0299000000000001e-05 2024-09-14T09:10:21.115 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.115 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:21.115 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.115 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1006 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:21.115 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:10:21.115 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 82.229037730000002, 2024-09-14T09:10:21.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001032039, 2024-09-14T09:10:21.116 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:21.116 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:21.116 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.116 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:21.116 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:21.116 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:21.116 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1006 2024-09-14T09:10:21.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.116 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:21.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:21.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:10:21.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:21.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:10:21.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:21.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859405+0000", 2024-09-14T09:10:21.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6499999999999999e-07 2024-09-14T09:10:21.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:21.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859407+0000", 2024-09-14T09:10:21.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1160000000000002e-06 2024-09-14T09:10:21.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:21.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859413+0000", 2024-09-14T09:10:21.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8880000000000002e-06 2024-09-14T09:10:21.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859419+0000", 2024-09-14T09:10:21.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3550000000000004e-06 2024-09-14T09:10:21.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859558+0000", 2024-09-14T09:10:21.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000138942 2024-09-14T09:10:21.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859563+0000", 2024-09-14T09:10:21.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.665e-06 2024-09-14T09:10:21.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860427+0000", 2024-09-14T09:10:21.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008635299999999 2024-09-14T09:10:21.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:21.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860437+0000", 2024-09-14T09:10:21.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0078000000000001e-05 2024-09-14T09:10:21.119 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.120 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:21.120 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.120 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1045 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:21.120 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:10:21.120 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 82.228838249999995, 2024-09-14T09:10:21.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008612990000001, 2024-09-14T09:10:21.120 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:21.120 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:21.120 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.120 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:21.120 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:21.120 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:21.120 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1045 2024-09-14T09:10:21.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.121 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:21.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:21.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:10:21.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:21.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859604+0000", 2024-09-14T09:10:21.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:21.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859605+0000", 2024-09-14T09:10:21.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6e-07 2024-09-14T09:10:21.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:21.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859606+0000", 2024-09-14T09:10:21.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8819999999999999e-06 2024-09-14T09:10:21.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:21.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859610+0000", 2024-09-14T09:10:21.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4290000000000001e-06 2024-09-14T09:10:21.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859612+0000", 2024-09-14T09:10:21.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6309999999999999e-06 2024-09-14T09:10:21.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859643+0000", 2024-09-14T09:10:21.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0224000000000001e-05 2024-09-14T09:10:21.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859647+0000", 2024-09-14T09:10:21.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9049999999999999e-06 2024-09-14T09:10:21.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860458+0000", 2024-09-14T09:10:21.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008111180000001 2024-09-14T09:10:21.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:21.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860466+0000", 2024-09-14T09:10:21.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:10:21.124 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.124 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:21.124 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.125 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1046 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:21.125 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:10:21.125 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 82.228824793000001, 2024-09-14T09:10:21.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000874262, 2024-09-14T09:10:21.125 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:21.125 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:21.125 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.125 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:21.125 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:21.125 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:21.125 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1046 2024-09-14T09:10:21.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.125 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:21.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:21.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:10:21.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:21.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:10:21.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:21.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859618+0000", 2024-09-14T09:10:21.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0900000000000001e-07 2024-09-14T09:10:21.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:21.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859619+0000", 2024-09-14T09:10:21.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0559999999999999e-06 2024-09-14T09:10:21.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:21.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859622+0000", 2024-09-14T09:10:21.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0170000000000001e-06 2024-09-14T09:10:21.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859625+0000", 2024-09-14T09:10:21.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7209999999999999e-06 2024-09-14T09:10:21.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859666+0000", 2024-09-14T09:10:21.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1677000000000001e-05 2024-09-14T09:10:21.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859672+0000", 2024-09-14T09:10:21.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4609999999999999e-06 2024-09-14T09:10:21.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860485+0000", 2024-09-14T09:10:21.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000813505 2024-09-14T09:10:21.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:21.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860492+0000", 2024-09-14T09:10:21.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6159999999999998e-06 2024-09-14T09:10:21.129 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.129 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:21.129 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.130 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1047 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:21.130 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:10:21.130 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 82.228813458999994, 2024-09-14T09:10:21.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008950190000001, 2024-09-14T09:10:21.130 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:21.130 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:21.130 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.130 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:21.130 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:21.130 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:21.130 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1047 2024-09-14T09:10:21.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.130 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:21.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:21.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:10:21.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:21.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:10:21.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:21.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859629+0000", 2024-09-14T09:10:21.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6600000000000003e-07 2024-09-14T09:10:21.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:21.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859631+0000", 2024-09-14T09:10:21.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5600000000000001e-06 2024-09-14T09:10:21.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:21.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859637+0000", 2024-09-14T09:10:21.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7309999999999998e-06 2024-09-14T09:10:21.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859641+0000", 2024-09-14T09:10:21.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0840000000000002e-06 2024-09-14T09:10:21.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859691+0000", 2024-09-14T09:10:21.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0587999999999997e-05 2024-09-14T09:10:21.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859696+0000", 2024-09-14T09:10:21.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8940000000000001e-06 2024-09-14T09:10:21.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860516+0000", 2024-09-14T09:10:21.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008200780000001 2024-09-14T09:10:21.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:21.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860524+0000", 2024-09-14T09:10:21.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8180000000000004e-06 2024-09-14T09:10:21.134 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.134 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:21.134 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.134 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1048 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:21.135 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:10:21.135 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 82.228781699999999, 2024-09-14T09:10:21.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008904780000001, 2024-09-14T09:10:21.135 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:21.135 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:21.135 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.135 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:21.135 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:21.135 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:21.135 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1048 2024-09-14T09:10:21.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.135 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:21.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:21.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:10:21.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:21.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:10:21.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:21.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859661+0000", 2024-09-14T09:10:21.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4700000000000002e-07 2024-09-14T09:10:21.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:21.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859663+0000", 2024-09-14T09:10:21.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0420000000000001e-06 2024-09-14T09:10:21.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:21.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859669+0000", 2024-09-14T09:10:21.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8989999999999998e-06 2024-09-14T09:10:21.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859673+0000", 2024-09-14T09:10:21.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2209999999999999e-06 2024-09-14T09:10:21.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859719+0000", 2024-09-14T09:10:21.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5788000000000003e-05 2024-09-14T09:10:21.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859725+0000", 2024-09-14T09:10:21.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4770000000000002e-06 2024-09-14T09:10:21.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860544+0000", 2024-09-14T09:10:21.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0008194669999999 2024-09-14T09:10:21.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:21.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860551+0000", 2024-09-14T09:10:21.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1369999999999996e-06 2024-09-14T09:10:21.140 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.140 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:21.140 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.141 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1089 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:21.141 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:10:21.141 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 82.228544706999998, 2024-09-14T09:10:21.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000733943, 2024-09-14T09:10:21.141 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:21.141 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:21.141 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.141 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:21.141 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:21.141 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:21.141 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1089 2024-09-14T09:10:21.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.142 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:21.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:21.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:10:21.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:21.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:10:21.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:21.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859898+0000", 2024-09-14T09:10:21.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3000000000000002e-07 2024-09-14T09:10:21.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:21.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859900+0000", 2024-09-14T09:10:21.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9199999999999998e-06 2024-09-14T09:10:21.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:21.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859906+0000", 2024-09-14T09:10:21.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0889999999999996e-06 2024-09-14T09:10:21.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859911+0000", 2024-09-14T09:10:21.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6419999999999998e-06 2024-09-14T09:10:21.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860010+0000", 2024-09-14T09:10:21.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8956000000000006e-05 2024-09-14T09:10:21.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860014+0000", 2024-09-14T09:10:21.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.741e-06 2024-09-14T09:10:21.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860627+0000", 2024-09-14T09:10:21.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00061277 2024-09-14T09:10:21.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:21.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860632+0000", 2024-09-14T09:10:21.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:10:21.145 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.145 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:21.146 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.146 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5117.0:1090 3.11 3.83c50f11 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-14T09:10:21.146 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:10:21.146 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 82.228525035000004, 2024-09-14T09:10:21.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.000740763, 2024-09-14T09:10:21.146 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:21.146 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:21.146 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.146 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:21.146 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5117", 2024-09-14T09:10:21.147 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1908424007", 2024-09-14T09:10:21.147 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 1090 2024-09-14T09:10:21.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.147 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:21.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:21.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:10:21.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:21.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859917+0000", 2024-09-14T09:10:21.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:21.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859918+0000", 2024-09-14T09:10:21.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5199999999999998e-07 2024-09-14T09:10:21.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:21.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859920+0000", 2024-09-14T09:10:21.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9240000000000001e-06 2024-09-14T09:10:21.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:21.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859925+0000", 2024-09-14T09:10:21.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3929999999999999e-06 2024-09-14T09:10:21.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.859929+0000", 2024-09-14T09:10:21.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4769999999999999e-06 2024-09-14T09:10:21.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860034+0000", 2024-09-14T09:10:21.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010549500000000001 2024-09-14T09:10:21.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:58.860039+0000", 2024-09-14T09:10:21.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5700000000000003e-06 2024-09-14T09:10:21.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860650+0000", 2024-09-14T09:10:21.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0006116119999999 2024-09-14T09:10:21.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:21.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:59.860658+0000", 2024-09-14T09:10:21.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9400000000000002e-06 2024-09-14T09:10:21.151 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.151 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:21.151 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.151 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60374 3.14 3.6e2cd654 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:21.151 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:10:21.151 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 64.598646724999995, 2024-09-14T09:10:21.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3129433100000001, 2024-09-14T09:10:21.151 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:21.152 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:21.152 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.152 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:21.152 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:21.152 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:21.152 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60374 2024-09-14T09:10:21.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.152 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:21.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:21.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:10:21.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:21.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:10:21.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:21.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489796+0000", 2024-09-14T09:10:21.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2100000000000002e-07 2024-09-14T09:10:21.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:21.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489799+0000", 2024-09-14T09:10:21.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3530000000000002e-06 2024-09-14T09:10:21.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:21.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489808+0000", 2024-09-14T09:10:21.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2e-06 2024-09-14T09:10:21.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489813+0000", 2024-09-14T09:10:21.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3249999999999998e-06 2024-09-14T09:10:21.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489866+0000", 2024-09-14T09:10:21.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3074e-05 2024-09-14T09:10:21.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489875+0000", 2024-09-14T09:10:21.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2760000000000006e-06 2024-09-14T09:10:21.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801379+0000", 2024-09-14T09:10:21.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.31150346200000001 2024-09-14T09:10:21.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801387+0000", 2024-09-14T09:10:21.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.038e-06 2024-09-14T09:10:21.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802728+0000", 2024-09-14T09:10:21.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013415569999999 2024-09-14T09:10:21.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:21.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802739+0000", 2024-09-14T09:10:21.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0604e-05 2024-09-14T09:10:21.158 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.158 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:21.159 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.159 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62179 3.14 3.78cf1974 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:21.159 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:10:21.159 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 64.598616096000001, 2024-09-14T09:10:21.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3129429109999999, 2024-09-14T09:10:21.160 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:21.160 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:21.160 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.160 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:21.160 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:21.160 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:21.161 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62179 2024-09-14T09:10:21.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.161 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:21.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:21.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:10:21.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:21.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489826+0000", 2024-09-14T09:10:21.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:21.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489827+0000", 2024-09-14T09:10:21.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4300000000000003e-07 2024-09-14T09:10:21.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:21.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489829+0000", 2024-09-14T09:10:21.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2129999999999998e-06 2024-09-14T09:10:21.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:21.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489836+0000", 2024-09-14T09:10:21.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0360000000000001e-06 2024-09-14T09:10:21.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489841+0000", 2024-09-14T09:10:21.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0710000000000002e-06 2024-09-14T09:10:21.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489905+0000", 2024-09-14T09:10:21.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3578999999999996e-05 2024-09-14T09:10:21.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489913+0000", 2024-09-14T09:10:21.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2269999999999993e-06 2024-09-14T09:10:21.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801412+0000", 2024-09-14T09:10:21.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.311498989 2024-09-14T09:10:21.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801419+0000", 2024-09-14T09:10:21.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1400000000000002e-06 2024-09-14T09:10:21.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802761+0000", 2024-09-14T09:10:21.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013414620000001 2024-09-14T09:10:21.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:21.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802769+0000", 2024-09-14T09:10:21.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6510000000000007e-06 2024-09-14T09:10:21.168 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.168 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:21.168 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.168 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63551 3.14 3.88ccb734 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:21.168 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:10:21.168 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 64.598584466000005, 2024-09-14T09:10:21.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.312941181, 2024-09-14T09:10:21.168 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:21.168 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:21.168 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.168 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:21.169 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:21.169 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:21.169 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63551 2024-09-14T09:10:21.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.169 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:21.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:21.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:10:21.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:21.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489858+0000", 2024-09-14T09:10:21.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:21.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489859+0000", 2024-09-14T09:10:21.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9200000000000001e-07 2024-09-14T09:10:21.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:21.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489862+0000", 2024-09-14T09:10:21.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9629999999999998e-06 2024-09-14T09:10:21.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:21.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489868+0000", 2024-09-14T09:10:21.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3890000000000002e-06 2024-09-14T09:10:21.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489875+0000", 2024-09-14T09:10:21.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7950000000000002e-06 2024-09-14T09:10:21.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489939+0000", 2024-09-14T09:10:21.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4704999999999998e-05 2024-09-14T09:10:21.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.489949+0000", 2024-09-14T09:10:21.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7799999999999995e-06 2024-09-14T09:10:21.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801447+0000", 2024-09-14T09:10:21.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.311497527 2024-09-14T09:10:21.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801454+0000", 2024-09-14T09:10:21.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1080000000000004e-06 2024-09-14T09:10:21.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802790+0000", 2024-09-14T09:10:21.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013364330000001 2024-09-14T09:10:21.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:21.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802799+0000", 2024-09-14T09:10:21.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8890000000000008e-06 2024-09-14T09:10:21.173 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.173 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:21.173 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.174 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:68716 3.14 3.96fe1934 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:21.174 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:10:21.174 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 64.547013999000001, 2024-09-14T09:10:21.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2614012569999999, 2024-09-14T09:10:21.174 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:21.174 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:21.174 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.174 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:21.175 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:21.175 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:21.175 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 68716 2024-09-14T09:10:21.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.175 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:21.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:21.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:10:21.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:21.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541428+0000", 2024-09-14T09:10:21.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:21.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541429+0000", 2024-09-14T09:10:21.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8899999999999998e-07 2024-09-14T09:10:21.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:21.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541433+0000", 2024-09-14T09:10:21.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7330000000000001e-06 2024-09-14T09:10:21.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:21.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541442+0000", 2024-09-14T09:10:21.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.346e-06 2024-09-14T09:10:21.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541449+0000", 2024-09-14T09:10:21.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.579e-06 2024-09-14T09:10:21.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541839+0000", 2024-09-14T09:10:21.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038993699999999998 2024-09-14T09:10:21.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.541849+0000", 2024-09-14T09:10:21.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0217999999999999e-05 2024-09-14T09:10:21.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801480+0000", 2024-09-14T09:10:21.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.25963061399999998 2024-09-14T09:10:21.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801486+0000", 2024-09-14T09:10:21.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.776e-06 2024-09-14T09:10:21.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802821+0000", 2024-09-14T09:10:21.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.00133435 2024-09-14T09:10:21.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:21.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802830+0000", 2024-09-14T09:10:21.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9150000000000002e-06 2024-09-14T09:10:21.180 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.180 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:21.180 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.180 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:69492 3.14 3.4a93714 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:21.180 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:10:21.180 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 64.486474302999994, 2024-09-14T09:10:21.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2008910690000001, 2024-09-14T09:10:21.180 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:21.180 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:21.180 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.180 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:21.181 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:21.181 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:21.181 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 69492 2024-09-14T09:10:21.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.181 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:21.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:21.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:10:21.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:21.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601968+0000", 2024-09-14T09:10:21.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:21.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601969+0000", 2024-09-14T09:10:21.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3099999999999996e-07 2024-09-14T09:10:21.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:21.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601973+0000", 2024-09-14T09:10:21.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5899999999999999e-06 2024-09-14T09:10:21.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:21.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601983+0000", 2024-09-14T09:10:21.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098999999999999e-05 2024-09-14T09:10:21.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.601989+0000", 2024-09-14T09:10:21.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0209999999999996e-06 2024-09-14T09:10:21.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.602066+0000", 2024-09-14T09:10:21.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7075000000000003e-05 2024-09-14T09:10:21.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.602075+0000", 2024-09-14T09:10:21.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8389999999999996e-06 2024-09-14T09:10:21.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801512+0000", 2024-09-14T09:10:21.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.199437225 2024-09-14T09:10:21.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801519+0000", 2024-09-14T09:10:21.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9970000000000001e-06 2024-09-14T09:10:21.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802851+0000", 2024-09-14T09:10:21.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001331711 2024-09-14T09:10:21.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:21.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802859+0000", 2024-09-14T09:10:21.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6810000000000004e-06 2024-09-14T09:10:21.186 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.186 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:21.186 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.187 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:72035 3.14 3.1cba9a34 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:21.187 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:10:21.187 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 64.367146414999993, 2024-09-14T09:10:21.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0815917340000001, 2024-09-14T09:10:21.187 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:21.187 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:21.187 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.187 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:21.187 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:21.187 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:21.188 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 72035 2024-09-14T09:10:21.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.188 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:21.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:21.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:10:21.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:21.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721296+0000", 2024-09-14T09:10:21.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:21.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721297+0000", 2024-09-14T09:10:21.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5199999999999996e-07 2024-09-14T09:10:21.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:21.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721301+0000", 2024-09-14T09:10:21.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7790000000000002e-06 2024-09-14T09:10:21.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:21.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721309+0000", 2024-09-14T09:10:21.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8019999999999998e-06 2024-09-14T09:10:21.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721315+0000", 2024-09-14T09:10:21.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:10:21.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721367+0000", 2024-09-14T09:10:21.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2280000000000001e-05 2024-09-14T09:10:21.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.721376+0000", 2024-09-14T09:10:21.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5439999999999999e-06 2024-09-14T09:10:21.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801545+0000", 2024-09-14T09:10:21.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.080169952000000003 2024-09-14T09:10:21.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801552+0000", 2024-09-14T09:10:21.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8390000000000001e-06 2024-09-14T09:10:21.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.192 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802879+0000", 2024-09-14T09:10:21.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.001326846 2024-09-14T09:10:21.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.192 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:21.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802888+0000", 2024-09-14T09:10:21.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6330000000000002e-06 2024-09-14T09:10:21.192 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.192 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:21.192 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.193 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73403 3.14 3.87b99f94 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:21.193 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:10:21.193 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 64.324871754, 2024-09-14T09:10:21.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0393459899999999, 2024-09-14T09:10:21.193 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:21.193 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:21.193 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.193 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:21.193 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:21.193 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:21.193 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73403 2024-09-14T09:10:21.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.193 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:21.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:21.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:10:21.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:21.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:10:21.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:21.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763571+0000", 2024-09-14T09:10:21.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9200000000000001e-07 2024-09-14T09:10:21.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:21.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763574+0000", 2024-09-14T09:10:21.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6510000000000001e-06 2024-09-14T09:10:21.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:21.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763582+0000", 2024-09-14T09:10:21.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2579999999999995e-06 2024-09-14T09:10:21.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763592+0000", 2024-09-14T09:10:21.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0193e-05 2024-09-14T09:10:21.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763643+0000", 2024-09-14T09:10:21.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0862000000000002e-05 2024-09-14T09:10:21.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.763654+0000", 2024-09-14T09:10:21.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0890000000000001e-05 2024-09-14T09:10:21.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801577+0000", 2024-09-14T09:10:21.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037923074000000001 2024-09-14T09:10:21.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801584+0000", 2024-09-14T09:10:21.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0060000000000003e-06 2024-09-14T09:10:21.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802908+0000", 2024-09-14T09:10:21.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0013235149999999 2024-09-14T09:10:21.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:21.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802917+0000", 2024-09-14T09:10:21.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9490000000000002e-06 2024-09-14T09:10:21.198 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.198 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:21.198 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.199 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:36215 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-09-14T09:10:21.199 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:52.846616+0000", 2024-09-14T09:10:21.199 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.241826150000001, 2024-09-14T09:10:21.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0047992570000002, 2024-09-14T09:10:21.199 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:21.199 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:21.199 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:21.199 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:21.199 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:10:21.199 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:10:21.199 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36215 2024-09-14T09:10:21.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.200 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:21.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:21.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846616+0000", 2024-09-14T09:10:21.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:21.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846616+0000", 2024-09-14T09:10:21.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:21.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:21.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846618+0000", 2024-09-14T09:10:21.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6700000000000001e-06 2024-09-14T09:10:21.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:21.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846626+0000", 2024-09-14T09:10:21.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0430000000000008e-06 2024-09-14T09:10:21.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:21.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846641+0000", 2024-09-14T09:10:21.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5009e-05 2024-09-14T09:10:21.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846650+0000", 2024-09-14T09:10:21.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7409999999999998e-06 2024-09-14T09:10:21.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846726+0000", 2024-09-14T09:10:21.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6149000000000006e-05 2024-09-14T09:10:21.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:52.846736+0000", 2024-09-14T09:10:21.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7119999999999995e-06 2024-09-14T09:10:21.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:53.822292+0000", 2024-09-14T09:10:21.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.97555623800000002 2024-09-14T09:10:21.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:53.822307+0000", 2024-09-14T09:10:21.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4646e-05 2024-09-14T09:10:21.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:21.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:54.850919+0000", 2024-09-14T09:10:21.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.028612284 2024-09-14T09:10:21.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:21.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:54.851186+0000", 2024-09-14T09:10:21.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000267318 2024-09-14T09:10:21.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:21.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:21.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:21.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:54.851416+0000", 2024-09-14T09:10:21.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000229447 2024-09-14T09:10:21.204 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.204 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:21.204 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.204 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:21.204 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:21.204 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:21.205 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:21.207+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:21.206 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:10:21.306 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:21.309+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:21.310 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:21.310 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:21.311 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:10:21.311 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:21.319 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:10:21.407 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:21.408+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:21.423 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:10:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:10:21.423 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:21.432 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:10:21.508 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:21.510+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:21.576 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:21.577 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:10:21.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:10:21.577 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:10:21.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.577 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:249 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 1638400~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:21.577 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:10:21.577 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 109.780950112, 2024-09-14T09:10:21.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99070346899999995, 2024-09-14T09:10:21.577 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:21.577 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:21.577 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:21.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:21.578 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:21.578 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:21.578 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 249 2024-09-14T09:10:21.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.578 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:21.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:21.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:10:21.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:21.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796867+0000", 2024-09-14T09:10:21.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:21.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796868+0000", 2024-09-14T09:10:21.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2024-09-14T09:10:21.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:21.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796870+0000", 2024-09-14T09:10:21.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7889999999999999e-06 2024-09-14T09:10:21.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:21.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796877+0000", 2024-09-14T09:10:21.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8549999999999996e-06 2024-09-14T09:10:21.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796883+0000", 2024-09-14T09:10:21.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.665e-06 2024-09-14T09:10:21.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796915+0000", 2024-09-14T09:10:21.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2215999999999998e-05 2024-09-14T09:10:21.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796920+0000", 2024-09-14T09:10:21.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.527e-06 2024-09-14T09:10:21.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787468+0000", 2024-09-14T09:10:21.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99054877100000005 2024-09-14T09:10:21.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:21.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787512+0000", 2024-09-14T09:10:21.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3958000000000002e-05 2024-09-14T09:10:21.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:21.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787571+0000", 2024-09-14T09:10:21.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8167000000000001e-05 2024-09-14T09:10:21.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.582 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:21.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.582 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:250 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2097152~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:21.582 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:10:21.582 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 109.780924046, 2024-09-14T09:10:21.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99079431100000004, 2024-09-14T09:10:21.583 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:21.583 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:21.583 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:21.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:21.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:21.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:21.583 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 250 2024-09-14T09:10:21.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.583 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:21.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:21.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:10:21.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:21.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796893+0000", 2024-09-14T09:10:21.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:21.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796894+0000", 2024-09-14T09:10:21.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2024-09-14T09:10:21.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:21.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796896+0000", 2024-09-14T09:10:21.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5600000000000001e-06 2024-09-14T09:10:21.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:21.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796902+0000", 2024-09-14T09:10:21.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3090000000000001e-06 2024-09-14T09:10:21.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796909+0000", 2024-09-14T09:10:21.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:10:21.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796942+0000", 2024-09-14T09:10:21.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-05 2024-09-14T09:10:21.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796948+0000", 2024-09-14T09:10:21.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5910000000000001e-06 2024-09-14T09:10:21.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787596+0000", 2024-09-14T09:10:21.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99064781400000002 2024-09-14T09:10:21.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:21.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787636+0000", 2024-09-14T09:10:21.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9715000000000002e-05 2024-09-14T09:10:21.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:21.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787687+0000", 2024-09-14T09:10:21.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1674e-05 2024-09-14T09:10:21.587 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.587 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:21.587 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.587 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:251 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 2555904~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:21.587 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:10:21.587 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 109.780898611, 2024-09-14T09:10:21.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99091769600000001, 2024-09-14T09:10:21.588 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:21.588 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:21.588 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:21.588 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:21.588 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:21.588 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:21.588 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 251 2024-09-14T09:10:21.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.588 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:21.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:21.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:10:21.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:21.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:10:21.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:21.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796919+0000", 2024-09-14T09:10:21.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000005e-07 2024-09-14T09:10:21.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:21.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796922+0000", 2024-09-14T09:10:21.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.875e-06 2024-09-14T09:10:21.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:21.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796929+0000", 2024-09-14T09:10:21.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0260000000000002e-06 2024-09-14T09:10:21.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796935+0000", 2024-09-14T09:10:21.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7030000000000003e-06 2024-09-14T09:10:21.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796963+0000", 2024-09-14T09:10:21.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8368999999999999e-05 2024-09-14T09:10:21.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796966+0000", 2024-09-14T09:10:21.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4130000000000002e-06 2024-09-14T09:10:21.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787718+0000", 2024-09-14T09:10:21.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99075151100000003 2024-09-14T09:10:21.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:21.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787779+0000", 2024-09-14T09:10:21.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.088e-05 2024-09-14T09:10:21.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:21.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787836+0000", 2024-09-14T09:10:21.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7380000000000003e-05 2024-09-14T09:10:21.592 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.592 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:21.592 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.592 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:252 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3014656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:21.592 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:10:21.592 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 109.780873157, 2024-09-14T09:10:21.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99102491400000003, 2024-09-14T09:10:21.592 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:21.593 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:21.593 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:21.593 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:21.593 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:21.593 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:21.593 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 252 2024-09-14T09:10:21.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.593 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:21.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:21.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:10:21.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:21.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:10:21.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:21.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796945+0000", 2024-09-14T09:10:21.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2900000000000003e-07 2024-09-14T09:10:21.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:21.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796947+0000", 2024-09-14T09:10:21.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4279999999999999e-06 2024-09-14T09:10:21.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:21.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796954+0000", 2024-09-14T09:10:21.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5479999999999998e-06 2024-09-14T09:10:21.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796959+0000", 2024-09-14T09:10:21.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.22e-06 2024-09-14T09:10:21.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796988+0000", 2024-09-14T09:10:21.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9473000000000001e-05 2024-09-14T09:10:21.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:10:21.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4399999999999996e-06 2024-09-14T09:10:21.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787850+0000", 2024-09-14T09:10:21.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99085651100000005 2024-09-14T09:10:21.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:21.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787891+0000", 2024-09-14T09:10:21.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602000000000002e-05 2024-09-14T09:10:21.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:21.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.787969+0000", 2024-09-14T09:10:21.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8063000000000001e-05 2024-09-14T09:10:21.597 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.597 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:21.597 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.597 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:253 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3473408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:21.597 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:10:21.597 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 109.780849277, 2024-09-14T09:10:21.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99122695699999996, 2024-09-14T09:10:21.598 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:21.598 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:21.598 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:21.598 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:21.598 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:21.598 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:21.598 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 253 2024-09-14T09:10:21.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.598 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:21.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:21.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:10:21.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:21.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:10:21.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:21.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796968+0000", 2024-09-14T09:10:21.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:10:21.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:21.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:10:21.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2850000000000001e-06 2024-09-14T09:10:21.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:21.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796977+0000", 2024-09-14T09:10:21.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5030000000000002e-06 2024-09-14T09:10:21.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796982+0000", 2024-09-14T09:10:21.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2024-09-14T09:10:21.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797013+0000", 2024-09-14T09:10:21.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0451e-05 2024-09-14T09:10:21.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:10:21.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1690000000000001e-06 2024-09-14T09:10:21.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788011+0000", 2024-09-14T09:10:21.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99099490300000004 2024-09-14T09:10:21.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:21.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788102+0000", 2024-09-14T09:10:21.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0730999999999996e-05 2024-09-14T09:10:21.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:21.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788195+0000", 2024-09-14T09:10:21.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3245999999999995e-05 2024-09-14T09:10:21.602 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.602 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:21.602 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.602 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:254 3.16 3:69f1b733:::rbd_data.1112cb42b44.0000000000000004:16 [read 3932160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:21.602 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:10:21.603 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 109.780817719, 2024-09-14T09:10:21.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99137410500000001, 2024-09-14T09:10:21.603 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:21.603 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:21.603 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:21.603 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:21.603 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:21.603 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:21.603 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 254 2024-09-14T09:10:21.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.603 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:21.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:21.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:10:21.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:21.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796999+0000", 2024-09-14T09:10:21.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:21.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797000+0000", 2024-09-14T09:10:21.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2024-09-14T09:10:21.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:21.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797003+0000", 2024-09-14T09:10:21.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7659999999999999e-06 2024-09-14T09:10:21.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:21.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797010+0000", 2024-09-14T09:10:21.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.029e-06 2024-09-14T09:10:21.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:10:21.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2024-09-14T09:10:21.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797044+0000", 2024-09-14T09:10:21.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9213e-05 2024-09-14T09:10:21.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797048+0000", 2024-09-14T09:10:21.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3400000000000002e-06 2024-09-14T09:10:21.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788222+0000", 2024-09-14T09:10:21.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99117407400000002 2024-09-14T09:10:21.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:21.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788306+0000", 2024-09-14T09:10:21.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4512999999999995e-05 2024-09-14T09:10:21.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:21.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788374+0000", 2024-09-14T09:10:21.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7226999999999999e-05 2024-09-14T09:10:21.607 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.608 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:21.608 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.608 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:264 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:21.608 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:10:21.608 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 109.780791361, 2024-09-14T09:10:21.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99161474699999996, 2024-09-14T09:10:21.608 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:21.608 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:21.608 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:21.608 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:21.608 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:21.608 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:21.608 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 264 2024-09-14T09:10:21.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.609 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:21.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:21.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:10:21.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:21.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:10:21.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:21.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:10:21.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2024-09-14T09:10:21.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:21.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:10:21.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2800000000000002e-06 2024-09-14T09:10:21.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:21.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:10:21.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0979999999999999e-06 2024-09-14T09:10:21.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797040+0000", 2024-09-14T09:10:21.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:10:21.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797068+0000", 2024-09-14T09:10:21.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7302999999999999e-05 2024-09-14T09:10:21.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797071+0000", 2024-09-14T09:10:21.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3610000000000001e-06 2024-09-14T09:10:21.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788436+0000", 2024-09-14T09:10:21.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99136489500000002 2024-09-14T09:10:21.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:21.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788538+0000", 2024-09-14T09:10:21.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101931 2024-09-14T09:10:21.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:21.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788641+0000", 2024-09-14T09:10:21.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010273899999999999 2024-09-14T09:10:21.612 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.613 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:21.613 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.613 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:265 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:21.613 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:10:21.613 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 109.780768002, 2024-09-14T09:10:21.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99176878199999996, 2024-09-14T09:10:21.613 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:21.613 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:21.613 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:21.613 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:21.613 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:21.613 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:21.614 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 265 2024-09-14T09:10:21.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.614 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:21.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:21.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:10:21.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:21.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797049+0000", 2024-09-14T09:10:21.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:21.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:10:21.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.39e-07 2024-09-14T09:10:21.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:21.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797052+0000", 2024-09-14T09:10:21.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.345e-06 2024-09-14T09:10:21.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:21.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797058+0000", 2024-09-14T09:10:21.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5429999999999999e-06 2024-09-14T09:10:21.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797064+0000", 2024-09-14T09:10:21.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2000000000000002e-06 2024-09-14T09:10:21.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797091+0000", 2024-09-14T09:10:21.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7804e-05 2024-09-14T09:10:21.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797095+0000", 2024-09-14T09:10:21.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2024-09-14T09:10:21.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788667+0000", 2024-09-14T09:10:21.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157211300000003 2024-09-14T09:10:21.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:21.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788742+0000", 2024-09-14T09:10:21.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5159000000000003e-05 2024-09-14T09:10:21.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:21.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788818+0000", 2024-09-14T09:10:21.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6038000000000006e-05 2024-09-14T09:10:21.617 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.617 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:21.618 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.618 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:266 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:21.618 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:10:21.618 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 109.78074517100001, 2024-09-14T09:10:21.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99193390100000001, 2024-09-14T09:10:21.618 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:21.618 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:21.618 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:21.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:21.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:21.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:21.618 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 266 2024-09-14T09:10:21.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.619 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:21.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:21.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:10:21.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:21.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:10:21.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:21.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797072+0000", 2024-09-14T09:10:21.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:10:21.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:21.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797075+0000", 2024-09-14T09:10:21.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2570000000000002e-06 2024-09-14T09:10:21.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:21.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797082+0000", 2024-09-14T09:10:21.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8029999999999997e-06 2024-09-14T09:10:21.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797088+0000", 2024-09-14T09:10:21.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.468e-06 2024-09-14T09:10:21.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797116+0000", 2024-09-14T09:10:21.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7752000000000001e-05 2024-09-14T09:10:21.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797121+0000", 2024-09-14T09:10:21.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5960000000000003e-06 2024-09-14T09:10:21.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788846+0000", 2024-09-14T09:10:21.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99172512199999996 2024-09-14T09:10:21.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:21.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.788916+0000", 2024-09-14T09:10:21.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9843000000000002e-05 2024-09-14T09:10:21.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:21.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789006+0000", 2024-09-14T09:10:21.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9608e-05 2024-09-14T09:10:21.622 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.622 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:21.622 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.623 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:267 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:21.623 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:10:21.623 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 109.780720364, 2024-09-14T09:10:21.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99210926799999999, 2024-09-14T09:10:21.623 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:21.623 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:21.623 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:21.623 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:21.623 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:21.623 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:21.623 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 267 2024-09-14T09:10:21.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.624 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:21.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:21.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:10:21.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:21.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:10:21.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:21.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797097+0000", 2024-09-14T09:10:21.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2399999999999999e-07 2024-09-14T09:10:21.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:21.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797099+0000", 2024-09-14T09:10:21.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.091e-06 2024-09-14T09:10:21.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:21.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797105+0000", 2024-09-14T09:10:21.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-09-14T09:10:21.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797111+0000", 2024-09-14T09:10:21.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5130000000000004e-06 2024-09-14T09:10:21.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797140+0000", 2024-09-14T09:10:21.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9513999999999999e-05 2024-09-14T09:10:21.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797145+0000", 2024-09-14T09:10:21.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4950000000000002e-06 2024-09-14T09:10:21.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789037+0000", 2024-09-14T09:10:21.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99189253899999996 2024-09-14T09:10:21.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:21.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789110+0000", 2024-09-14T09:10:21.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2848000000000005e-05 2024-09-14T09:10:21.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:21.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789206+0000", 2024-09-14T09:10:21.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5778000000000004e-05 2024-09-14T09:10:21.627 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.627 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:21.628 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.628 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:268 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:21.628 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:10:21.628 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 109.780697125, 2024-09-14T09:10:21.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992276359, 2024-09-14T09:10:21.628 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:21.628 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:21.628 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:21.628 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:21.628 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:21.628 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:21.628 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 268 2024-09-14T09:10:21.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.629 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:21.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:21.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:10:21.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:21.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:10:21.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:21.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797120+0000", 2024-09-14T09:10:21.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2024-09-14T09:10:21.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:21.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797123+0000", 2024-09-14T09:10:21.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2740000000000002e-06 2024-09-14T09:10:21.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:21.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797129+0000", 2024-09-14T09:10:21.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-06 2024-09-14T09:10:21.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797134+0000", 2024-09-14T09:10:21.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9099999999999996e-06 2024-09-14T09:10:21.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797163+0000", 2024-09-14T09:10:21.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9709999999999998e-05 2024-09-14T09:10:21.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:10:21.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8709999999999999e-06 2024-09-14T09:10:21.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789231+0000", 2024-09-14T09:10:21.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992063959 2024-09-14T09:10:21.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:21.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789306+0000", 2024-09-14T09:10:21.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5289000000000004e-05 2024-09-14T09:10:21.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:21.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789396+0000", 2024-09-14T09:10:21.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9939999999999996e-05 2024-09-14T09:10:21.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.632 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:21.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.632 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:269 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2457600~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:21.633 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:10:21.633 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 109.780673616, 2024-09-14T09:10:21.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99242174400000005, 2024-09-14T09:10:21.633 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:21.633 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:21.633 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:21.633 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:21.633 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:21.633 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:21.633 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 269 2024-09-14T09:10:21.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.633 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:21.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:21.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:10:21.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:21.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:10:21.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:21.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797144+0000", 2024-09-14T09:10:21.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:10:21.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:21.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797146+0000", 2024-09-14T09:10:21.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5289999999999998e-06 2024-09-14T09:10:21.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:21.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797153+0000", 2024-09-14T09:10:21.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1920000000000002e-06 2024-09-14T09:10:21.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797158+0000", 2024-09-14T09:10:21.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099999999999998e-06 2024-09-14T09:10:21.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797188+0000", 2024-09-14T09:10:21.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0128e-05 2024-09-14T09:10:21.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797194+0000", 2024-09-14T09:10:21.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6250000000000004e-06 2024-09-14T09:10:21.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789439+0000", 2024-09-14T09:10:21.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99224531000000005 2024-09-14T09:10:21.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:21.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789489+0000", 2024-09-14T09:10:21.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9830000000000002e-05 2024-09-14T09:10:21.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:21.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789565+0000", 2024-09-14T09:10:21.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6229000000000005e-05 2024-09-14T09:10:21.637 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.637 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:21.637 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.637 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:270 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 2916352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:21.637 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:10:21.637 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 109.780649794, 2024-09-14T09:10:21.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99257721899999996, 2024-09-14T09:10:21.638 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:21.638 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:21.638 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:21.638 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:21.638 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:21.638 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:21.638 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 270 2024-09-14T09:10:21.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.638 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:21.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:21.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:10:21.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:21.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797167+0000", 2024-09-14T09:10:21.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:21.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797168+0000", 2024-09-14T09:10:21.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2024-09-14T09:10:21.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:21.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797170+0000", 2024-09-14T09:10:21.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3120000000000001e-06 2024-09-14T09:10:21.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:21.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797177+0000", 2024-09-14T09:10:21.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0960000000000003e-06 2024-09-14T09:10:21.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797183+0000", 2024-09-14T09:10:21.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1669999999999998e-06 2024-09-14T09:10:21.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797213+0000", 2024-09-14T09:10:21.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0494e-05 2024-09-14T09:10:21.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:10:21.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-09-14T09:10:21.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789586+0000", 2024-09-14T09:10:21.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99236692100000001 2024-09-14T09:10:21.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:21.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789658+0000", 2024-09-14T09:10:21.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2279000000000004e-05 2024-09-14T09:10:21.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:21.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789745+0000", 2024-09-14T09:10:21.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6698000000000002e-05 2024-09-14T09:10:21.642 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.642 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:21.642 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.642 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:271 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3375104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:21.642 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:10:21.642 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 109.780624596, 2024-09-14T09:10:21.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99274791699999998, 2024-09-14T09:10:21.642 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:21.642 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:21.642 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:21.642 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:21.643 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:21.643 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:21.643 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 271 2024-09-14T09:10:21.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.643 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:21.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:21.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:10:21.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:21.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:10:21.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:21.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797193+0000", 2024-09-14T09:10:21.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9099999999999999e-07 2024-09-14T09:10:21.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:21.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797195+0000", 2024-09-14T09:10:21.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1639999999999999e-06 2024-09-14T09:10:21.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:21.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797201+0000", 2024-09-14T09:10:21.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1290000000000001e-06 2024-09-14T09:10:21.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797206+0000", 2024-09-14T09:10:21.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9300000000000002e-06 2024-09-14T09:10:21.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797237+0000", 2024-09-14T09:10:21.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1285000000000003e-05 2024-09-14T09:10:21.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797242+0000", 2024-09-14T09:10:21.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6e-06 2024-09-14T09:10:21.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789768+0000", 2024-09-14T09:10:21.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99252547400000002 2024-09-14T09:10:21.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:21.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789826+0000", 2024-09-14T09:10:21.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8155999999999997e-05 2024-09-14T09:10:21.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:21.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789940+0000", 2024-09-14T09:10:21.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114788 2024-09-14T09:10:21.647 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.647 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:21.647 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.647 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:272 3.16 3:6e737a71:::rbd_data.1112cb42b44.0000000000000006:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:21.647 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:10:21.647 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 109.780601202, 2024-09-14T09:10:21.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99285248800000003, 2024-09-14T09:10:21.648 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:21.648 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:21.648 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:21.648 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:21.648 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:21.648 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:21.648 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 272 2024-09-14T09:10:21.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.648 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:21.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:21.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:10:21.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:21.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:10:21.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:21.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797216+0000", 2024-09-14T09:10:21.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2024-09-14T09:10:21.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:21.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797219+0000", 2024-09-14T09:10:21.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5129999999999999e-06 2024-09-14T09:10:21.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:21.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797226+0000", 2024-09-14T09:10:21.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4529999999999996e-06 2024-09-14T09:10:21.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797232+0000", 2024-09-14T09:10:21.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1839999999999998e-06 2024-09-14T09:10:21.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797264+0000", 2024-09-14T09:10:21.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2691999999999998e-05 2024-09-14T09:10:21.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797270+0000", 2024-09-14T09:10:21.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-06 2024-09-14T09:10:21.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789965+0000", 2024-09-14T09:10:21.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99269526200000002 2024-09-14T09:10:21.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:21.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790021+0000", 2024-09-14T09:10:21.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5297000000000003e-05 2024-09-14T09:10:21.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:21.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790068+0000", 2024-09-14T09:10:21.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7664999999999998e-05 2024-09-14T09:10:21.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.652 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:21.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.652 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:21.652 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:10:21.652 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.790344755000007, 2024-09-14T09:10:21.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146649299999999, 2024-09-14T09:10:21.653 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:21.653 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:21.653 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.653 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:21.653 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:21.653 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:21.653 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 58987 2024-09-14T09:10:21.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.653 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:21.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:21.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:10:21.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:21.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787472+0000", 2024-09-14T09:10:21.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:21.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787474+0000", 2024-09-14T09:10:21.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1799999999999999e-06 2024-09-14T09:10:21.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:21.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787483+0000", 2024-09-14T09:10:21.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9830000000000002e-06 2024-09-14T09:10:21.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:21.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787494+0000", 2024-09-14T09:10:21.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1496e-05 2024-09-14T09:10:21.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787502+0000", 2024-09-14T09:10:21.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8280000000000003e-06 2024-09-14T09:10:21.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787563+0000", 2024-09-14T09:10:21.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1583999999999999e-05 2024-09-14T09:10:21.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:10:21.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787571+0000", 2024-09-14T09:10:21.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.058e-06 2024-09-14T09:10:21.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.791999+0000", 2024-09-14T09:10:21.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004428675 2024-09-14T09:10:21.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792008+0000", 2024-09-14T09:10:21.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9069999999999996e-06 2024-09-14T09:10:21.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802124+0000", 2024-09-14T09:10:21.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0101154619999999 2024-09-14T09:10:21.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:21.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802137+0000", 2024-09-14T09:10:21.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3757000000000001e-05 2024-09-14T09:10:21.657 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.657 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:21.657 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.658 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:67110 3.5 3.6b6808c5 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:21.658 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:10:21.658 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.790211940000006, 2024-09-14T09:10:21.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0147494290000001, 2024-09-14T09:10:21.658 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:21.658 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:21.658 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.658 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:21.658 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:21.658 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:21.658 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 67110 2024-09-14T09:10:21.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.658 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:21.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:21.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:10:21.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:21.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787605+0000", 2024-09-14T09:10:21.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:21.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787606+0000", 2024-09-14T09:10:21.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6300000000000005e-07 2024-09-14T09:10:21.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:21.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787609+0000", 2024-09-14T09:10:21.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2789999999999999e-06 2024-09-14T09:10:21.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:21.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787616+0000", 2024-09-14T09:10:21.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8349999999999998e-06 2024-09-14T09:10:21.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787622+0000", 2024-09-14T09:10:21.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6999999999999996e-06 2024-09-14T09:10:21.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787666+0000", 2024-09-14T09:10:21.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3887000000000002e-05 2024-09-14T09:10:21.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:21.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787672+0000", 2024-09-14T09:10:21.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-09-14T09:10:21.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792033+0000", 2024-09-14T09:10:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043614250000000004 2024-09-14T09:10:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792041+0000", 2024-09-14T09:10:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5449999999999998e-06 2024-09-14T09:10:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:10:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0103013569999999 2024-09-14T09:10:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:21.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802355+0000", 2024-09-14T09:10:21.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2717999999999999e-05 2024-09-14T09:10:21.663 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.663 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:21.663 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.663 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72029 3.5 3.3f02ac5 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:21.663 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:10:21.663 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.790134425000005, 2024-09-14T09:10:21.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.014715139, 2024-09-14T09:10:21.663 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:21.663 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:21.663 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.664 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:21.664 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:21.664 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:21.664 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72029 2024-09-14T09:10:21.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.664 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:21.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:21.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:10:21.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:21.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:10:21.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:21.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787683+0000", 2024-09-14T09:10:21.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7599999999999997e-07 2024-09-14T09:10:21.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:21.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787686+0000", 2024-09-14T09:10:21.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3999999999999999e-06 2024-09-14T09:10:21.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:21.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787692+0000", 2024-09-14T09:10:21.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3489999999999997e-06 2024-09-14T09:10:21.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787697+0000", 2024-09-14T09:10:21.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2320000000000001e-06 2024-09-14T09:10:21.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787742+0000", 2024-09-14T09:10:21.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4557e-05 2024-09-14T09:10:21.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:21.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787748+0000", 2024-09-14T09:10:21.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7810000000000002e-06 2024-09-14T09:10:21.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792065+0000", 2024-09-14T09:10:21.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043178679999999999 2024-09-14T09:10:21.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792073+0000", 2024-09-14T09:10:21.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6329999999999996e-06 2024-09-14T09:10:21.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802388+0000", 2024-09-14T09:10:21.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010315394 2024-09-14T09:10:21.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:21.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802398+0000", 2024-09-14T09:10:21.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4490000000000005e-06 2024-09-14T09:10:21.668 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.668 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:21.669 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.669 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:72038 3.5 3.c914e45 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:21.669 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:10:21.669 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.790058791999996, 2024-09-14T09:10:21.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146757740000001, 2024-09-14T09:10:21.669 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:21.669 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:21.669 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.669 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:21.669 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:21.669 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:21.669 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72038 2024-09-14T09:10:21.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.670 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:21.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:21.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:10:21.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:21.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:10:21.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:21.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787759+0000", 2024-09-14T09:10:21.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0100000000000005e-07 2024-09-14T09:10:21.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:21.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787761+0000", 2024-09-14T09:10:21.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4049999999999998e-06 2024-09-14T09:10:21.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:21.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787768+0000", 2024-09-14T09:10:21.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.314e-06 2024-09-14T09:10:21.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787773+0000", 2024-09-14T09:10:21.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2789999999999998e-06 2024-09-14T09:10:21.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787813+0000", 2024-09-14T09:10:21.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9582000000000002e-05 2024-09-14T09:10:21.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:21.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787818+0000", 2024-09-14T09:10:21.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7100000000000004e-06 2024-09-14T09:10:21.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792096+0000", 2024-09-14T09:10:21.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042776460000000004 2024-09-14T09:10:21.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.792103+0000", 2024-09-14T09:10:21.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7129999999999999e-06 2024-09-14T09:10:21.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802427+0000", 2024-09-14T09:10:21.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010324805 2024-09-14T09:10:21.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:21.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802434+0000", 2024-09-14T09:10:21.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:10:21.673 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.674 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:21.674 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.674 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:74840 3.5 3.ab2c8d25 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:21.674 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:10:21.674 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.768006907, 2024-09-14T09:10:21.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99271963600000002, 2024-09-14T09:10:21.674 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:21.674 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:21.674 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:21.674 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:21.674 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:21.674 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:21.674 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74840 2024-09-14T09:10:21.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.675 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:21.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:21.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:10:21.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:21.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809810+0000", 2024-09-14T09:10:21.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:21.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:21.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809812+0000", 2024-09-14T09:10:21.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2899999999999999e-06 2024-09-14T09:10:21.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:21.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809817+0000", 2024-09-14T09:10:21.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0139999999999998e-06 2024-09-14T09:10:21.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:21.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809834+0000", 2024-09-14T09:10:21.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7643e-05 2024-09-14T09:10:21.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:21.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809842+0000", 2024-09-14T09:10:21.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2970000000000004e-06 2024-09-14T09:10:21.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809902+0000", 2024-09-14T09:10:21.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9106e-05 2024-09-14T09:10:21.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:21.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.809912+0000", 2024-09-14T09:10:21.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0101e-05 2024-09-14T09:10:21.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:21.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802520+0000", 2024-09-14T09:10:21.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99260828599999995 2024-09-14T09:10:21.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:21.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:21.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:21.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802530+0000", 2024-09-14T09:10:21.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8989999999999996e-06 2024-09-14T09:10:21.678 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.678 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:21.678 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.678 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:21.678 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:21.678 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:21.679 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:10:21.680 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:21.681+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:21.780 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:21.783+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:21.830 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:21.830 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:21.830 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:10:21.831 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:21.839 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:10:21.881 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:10:21.882 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:21.883+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:21.950 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:21.950 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:21.950 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:10:21.950 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:10:21.950 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:21.958 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:10:22.002 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:22.003+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:22.009 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:10:22.009 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:10:22.025 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:10:22.025 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:10:22.041 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:10:22.041 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:10:22.058 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:10:22.058 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:10:22.064 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:22.064 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:10:22.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:10:22.064 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:10:22.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.065 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5349 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8302592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:22.065 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:10:22.065 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 104.81002954500001, 2024-09-14T09:10:22.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039875928999999997, 2024-09-14T09:10:22.065 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:22.065 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:22.065 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:22.065 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:22.065 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:10:22.065 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:22.065 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5349 2024-09-14T09:10:22.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.065 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:22.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:22.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:10:22.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:22.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:10:22.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:22.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255874+0000", 2024-09-14T09:10:22.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4900000000000001e-07 2024-09-14T09:10:22.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:22.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255880+0000", 2024-09-14T09:10:22.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9939999999999997e-06 2024-09-14T09:10:22.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:22.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255886+0000", 2024-09-14T09:10:22.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3899999999999998e-06 2024-09-14T09:10:22.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:22.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255891+0000", 2024-09-14T09:10:22.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.938e-06 2024-09-14T09:10:22.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295580+0000", 2024-09-14T09:10:22.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039688681000000003 2024-09-14T09:10:22.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:22.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295653+0000", 2024-09-14T09:10:22.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3045000000000003e-05 2024-09-14T09:10:22.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:22.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295749+0000", 2024-09-14T09:10:22.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6532000000000003e-05 2024-09-14T09:10:22.069 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.069 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:22.069 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.069 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5350 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8364032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:22.070 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:10:22.070 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 104.810005738, 2024-09-14T09:10:22.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039989719, 2024-09-14T09:10:22.070 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:22.070 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:22.070 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:22.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:22.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:10:22.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:22.070 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5350 2024-09-14T09:10:22.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.070 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:22.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:22.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:10:22.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:22.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:10:22.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:22.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255898+0000", 2024-09-14T09:10:22.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2024-09-14T09:10:22.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:22.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255899+0000", 2024-09-14T09:10:22.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9139999999999998e-06 2024-09-14T09:10:22.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:22.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255905+0000", 2024-09-14T09:10:22.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7289999999999997e-06 2024-09-14T09:10:22.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:22.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255910+0000", 2024-09-14T09:10:22.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6210000000000003e-06 2024-09-14T09:10:22.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295775+0000", 2024-09-14T09:10:22.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039864973999999997 2024-09-14T09:10:22.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:22.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295828+0000", 2024-09-14T09:10:22.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3411000000000001e-05 2024-09-14T09:10:22.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:22.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295887+0000", 2024-09-14T09:10:22.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699000000000002e-05 2024-09-14T09:10:22.074 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.074 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:22.074 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.074 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4639 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1843200~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:22.074 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:10:22.074 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 83.866090279000005, 2024-09-14T09:10:22.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040843672999999997, 2024-09-14T09:10:22.074 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:22.074 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:22.074 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:22.074 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:22.075 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:22.075 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:22.075 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4639 2024-09-14T09:10:22.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.075 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:22.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:22.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:10:22.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:22.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:10:22.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:22.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:10:22.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:10:22.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:22.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199818+0000", 2024-09-14T09:10:22.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1450000000000001e-06 2024-09-14T09:10:22.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:22.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199827+0000", 2024-09-14T09:10:22.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3999999999999998e-06 2024-09-14T09:10:22.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:22.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199834+0000", 2024-09-14T09:10:22.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0809999999999996e-06 2024-09-14T09:10:22.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240541+0000", 2024-09-14T09:10:22.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040706941000000003 2024-09-14T09:10:22.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:22.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240584+0000", 2024-09-14T09:10:22.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3040999999999997e-05 2024-09-14T09:10:22.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:22.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240656+0000", 2024-09-14T09:10:22.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2200000000000007e-05 2024-09-14T09:10:22.078 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.078 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:22.078 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.078 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4640 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1871872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:22.079 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:10:22.079 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 83.866055794000005, 2024-09-14T09:10:22.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040967601999999999, 2024-09-14T09:10:22.079 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:22.079 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:22.079 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:22.079 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:22.079 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:22.079 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:22.079 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4640 2024-09-14T09:10:22.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.079 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:22.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:22.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:10:22.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:22.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:10:22.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:22.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199848+0000", 2024-09-14T09:10:22.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5400000000000002e-07 2024-09-14T09:10:22.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:22.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199850+0000", 2024-09-14T09:10:22.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2479999999999999e-06 2024-09-14T09:10:22.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:22.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199857+0000", 2024-09-14T09:10:22.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.187e-06 2024-09-14T09:10:22.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:22.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199862+0000", 2024-09-14T09:10:22.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5119999999999999e-06 2024-09-14T09:10:22.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240684+0000", 2024-09-14T09:10:22.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040821245999999999 2024-09-14T09:10:22.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:22.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240739+0000", 2024-09-14T09:10:22.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4991999999999998e-05 2024-09-14T09:10:22.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:22.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240815+0000", 2024-09-14T09:10:22.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5963000000000004e-05 2024-09-14T09:10:22.083 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.083 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:22.083 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.083 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4641 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1900544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:22.083 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:10:22.083 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 83.866033463999997, 2024-09-14T09:10:22.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041205512, 2024-09-14T09:10:22.083 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:22.083 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:22.083 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:22.083 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:22.083 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:22.084 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:22.084 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4641 2024-09-14T09:10:22.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.084 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:22.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:22.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:10:22.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:22.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:10:22.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:22.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199870+0000", 2024-09-14T09:10:22.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0600000000000001e-07 2024-09-14T09:10:22.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:22.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199872+0000", 2024-09-14T09:10:22.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.928e-06 2024-09-14T09:10:22.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:22.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199877+0000", 2024-09-14T09:10:22.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6949999999999997e-06 2024-09-14T09:10:22.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:22.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199882+0000", 2024-09-14T09:10:22.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8210000000000001e-06 2024-09-14T09:10:22.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240847+0000", 2024-09-14T09:10:22.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040965201999999999 2024-09-14T09:10:22.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:22.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240888+0000", 2024-09-14T09:10:22.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0754000000000003e-05 2024-09-14T09:10:22.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:22.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241075+0000", 2024-09-14T09:10:22.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000186706 2024-09-14T09:10:22.087 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.087 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:22.087 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.087 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4642 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1929216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:22.088 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:10:22.088 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 83.866014528999997, 2024-09-14T09:10:22.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041292575999999998, 2024-09-14T09:10:22.088 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:22.088 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:22.088 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:22.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:22.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:22.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:22.088 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4642 2024-09-14T09:10:22.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.088 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:22.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:22.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:10:22.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:22.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:10:22.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:22.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199889+0000", 2024-09-14T09:10:22.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2024-09-14T09:10:22.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:22.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199891+0000", 2024-09-14T09:10:22.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9e-06 2024-09-14T09:10:22.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:22.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199896+0000", 2024-09-14T09:10:22.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6960000000000002e-06 2024-09-14T09:10:22.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:22.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199901+0000", 2024-09-14T09:10:22.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6720000000000003e-06 2024-09-14T09:10:22.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241089+0000", 2024-09-14T09:10:22.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041187594000000001 2024-09-14T09:10:22.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:22.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241126+0000", 2024-09-14T09:10:22.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7490999999999997e-05 2024-09-14T09:10:22.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:22.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241181+0000", 2024-09-14T09:10:22.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4823e-05 2024-09-14T09:10:22.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.092 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:22.092 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.092 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4643 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1957888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:22.092 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:10:22.092 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 83.865995249999997, 2024-09-14T09:10:22.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041418333000000002, 2024-09-14T09:10:22.092 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:22.092 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:22.092 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:22.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:22.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:22.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:22.093 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4643 2024-09-14T09:10:22.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.093 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:22.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:22.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:10:22.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:22.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:10:22.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:22.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:10:22.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5699999999999998e-07 2024-09-14T09:10:22.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:22.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199910+0000", 2024-09-14T09:10:22.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.829e-06 2024-09-14T09:10:22.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:22.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199916+0000", 2024-09-14T09:10:22.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8499999999999999e-06 2024-09-14T09:10:22.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:22.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199920+0000", 2024-09-14T09:10:22.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6530000000000002e-06 2024-09-14T09:10:22.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241211+0000", 2024-09-14T09:10:22.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041290327000000002 2024-09-14T09:10:22.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:22.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241257+0000", 2024-09-14T09:10:22.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6347000000000002e-05 2024-09-14T09:10:22.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:22.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241326+0000", 2024-09-14T09:10:22.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8969999999999999e-05 2024-09-14T09:10:22.096 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.096 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:22.096 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.096 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4644 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1986560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:22.096 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:10:22.097 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 83.865976910000001, 2024-09-14T09:10:22.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041596269999999998, 2024-09-14T09:10:22.097 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:22.097 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:22.097 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:22.097 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:22.097 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:22.097 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:22.097 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4644 2024-09-14T09:10:22.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.097 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:22.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:22.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:10:22.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:22.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:10:22.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:22.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:10:22.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.41e-07 2024-09-14T09:10:22.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:22.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199928+0000", 2024-09-14T09:10:22.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8250000000000001e-06 2024-09-14T09:10:22.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:22.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199934+0000", 2024-09-14T09:10:22.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2280000000000003e-06 2024-09-14T09:10:22.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:22.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199939+0000", 2024-09-14T09:10:22.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8010000000000003e-06 2024-09-14T09:10:22.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241360+0000", 2024-09-14T09:10:22.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041421289 2024-09-14T09:10:22.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:22.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241435+0000", 2024-09-14T09:10:22.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4238000000000003e-05 2024-09-14T09:10:22.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:22.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241522+0000", 2024-09-14T09:10:22.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7547999999999996e-05 2024-09-14T09:10:22.101 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.101 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:22.101 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.101 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4645 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:22.101 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:10:22.101 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 83.865958003000003, 2024-09-14T09:10:22.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041714660000000001, 2024-09-14T09:10:22.101 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:22.101 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:22.101 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:22.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:22.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:22.102 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:22.102 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4645 2024-09-14T09:10:22.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.102 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:22.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:22.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:10:22.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:22.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:10:22.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:22.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:10:22.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4700000000000002e-07 2024-09-14T09:10:22.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:22.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199947+0000", 2024-09-14T09:10:22.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.801e-06 2024-09-14T09:10:22.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:22.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199953+0000", 2024-09-14T09:10:22.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.694e-06 2024-09-14T09:10:22.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:22.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199957+0000", 2024-09-14T09:10:22.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3069999999999996e-06 2024-09-14T09:10:22.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241547+0000", 2024-09-14T09:10:22.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041589895000000002 2024-09-14T09:10:22.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:22.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241590+0000", 2024-09-14T09:10:22.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2985000000000003e-05 2024-09-14T09:10:22.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:22.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241660+0000", 2024-09-14T09:10:22.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9630999999999998e-05 2024-09-14T09:10:22.105 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.105 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:22.105 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.105 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4646 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2043904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:22.105 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:10:22.105 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 83.865940015000007, 2024-09-14T09:10:22.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041827171000000003, 2024-09-14T09:10:22.106 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:22.106 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:22.106 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:22.106 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:22.106 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:22.106 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:22.106 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4646 2024-09-14T09:10:22.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.106 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:22.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:22.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:10:22.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:22.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:10:22.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:22.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:10:22.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6300000000000001e-07 2024-09-14T09:10:22.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:22.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199965+0000", 2024-09-14T09:10:22.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.035e-06 2024-09-14T09:10:22.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:22.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199973+0000", 2024-09-14T09:10:22.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9629999999999998e-06 2024-09-14T09:10:22.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:22.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199978+0000", 2024-09-14T09:10:22.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9069999999999998e-06 2024-09-14T09:10:22.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241677+0000", 2024-09-14T09:10:22.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041698662999999997 2024-09-14T09:10:22.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:22.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241717+0000", 2024-09-14T09:10:22.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602999999999997e-05 2024-09-14T09:10:22.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:22.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241790+0000", 2024-09-14T09:10:22.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2637000000000003e-05 2024-09-14T09:10:22.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.110 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:22.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.110 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4647 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2072576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:22.110 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:10:22.110 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 83.865911424999993, 2024-09-14T09:10:22.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041921189999999997, 2024-09-14T09:10:22.111 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:22.111 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:22.111 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:22.111 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:22.111 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:22.111 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:22.111 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4647 2024-09-14T09:10:22.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.111 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:22.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:22.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:10:22.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:22.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:10:22.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:22.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199992+0000", 2024-09-14T09:10:22.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3799999999999997e-07 2024-09-14T09:10:22.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:22.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199994+0000", 2024-09-14T09:10:22.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3020000000000002e-06 2024-09-14T09:10:22.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:22.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200004+0000", 2024-09-14T09:10:22.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3510000000000008e-06 2024-09-14T09:10:22.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:22.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200008+0000", 2024-09-14T09:10:22.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3329999999999998e-06 2024-09-14T09:10:22.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241814+0000", 2024-09-14T09:10:22.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041806280000000001 2024-09-14T09:10:22.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:22.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241855+0000", 2024-09-14T09:10:22.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0173999999999999e-05 2024-09-14T09:10:22.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:22.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241913+0000", 2024-09-14T09:10:22.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8112000000000002e-05 2024-09-14T09:10:22.115 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.115 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:22.115 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.115 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:59017 3.3 3:c1df81d6:::rbd_data.1112a10502fe.0000000000000189:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:22.115 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:10:22.115 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 65.278620824000001, 2024-09-14T09:10:22.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.024252111, 2024-09-14T09:10:22.115 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:22.115 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:22.115 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:22.115 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:22.116 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:22.116 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:22.116 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59017 2024-09-14T09:10:22.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.116 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:22.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:22.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:10:22.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:22.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:10:22.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:22.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787284+0000", 2024-09-14T09:10:22.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3879999999999998e-06 2024-09-14T09:10:22.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:22.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787297+0000", 2024-09-14T09:10:22.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2184999999999999e-05 2024-09-14T09:10:22.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:22.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787317+0000", 2024-09-14T09:10:22.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0054000000000001e-05 2024-09-14T09:10:22.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:22.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787327+0000", 2024-09-14T09:10:22.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0335e-05 2024-09-14T09:10:22.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787412+0000", 2024-09-14T09:10:22.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4691000000000006e-05 2024-09-14T09:10:22.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:10:22.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787422+0000", 2024-09-14T09:10:22.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0718e-05 2024-09-14T09:10:22.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790539+0000", 2024-09-14T09:10:22.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031164600000000002 2024-09-14T09:10:22.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:22.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790552+0000", 2024-09-14T09:10:22.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2736e-05 2024-09-14T09:10:22.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.798725+0000", 2024-09-14T09:10:22.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0081731860000001 2024-09-14T09:10:22.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:22.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.798824+0000", 2024-09-14T09:10:22.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9600999999999997e-05 2024-09-14T09:10:22.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:22.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.811534+0000", 2024-09-14T09:10:22.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012709757 2024-09-14T09:10:22.120 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.121 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:22.121 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.121 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:63586 3.3 3:c0d9272b:::rbd_data.1112a10502fe.00000000000001a2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:22.121 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:10:22.121 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 65.278549341000002, 2024-09-14T09:10:22.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0244069650000001, 2024-09-14T09:10:22.121 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:22.121 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:22.121 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:22.121 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:22.121 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:22.121 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:22.122 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 63586 2024-09-14T09:10:22.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.122 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:22.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:22.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:10:22.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:22.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:10:22.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:22.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:10:22.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2024-09-14T09:10:22.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:22.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787357+0000", 2024-09-14T09:10:22.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8720000000000002e-06 2024-09-14T09:10:22.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:22.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787365+0000", 2024-09-14T09:10:22.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9270000000000005e-06 2024-09-14T09:10:22.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:22.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787372+0000", 2024-09-14T09:10:22.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6810000000000001e-06 2024-09-14T09:10:22.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787479+0000", 2024-09-14T09:10:22.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010736800000000001 2024-09-14T09:10:22.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:22.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787485+0000", 2024-09-14T09:10:22.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.054e-06 2024-09-14T09:10:22.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790580+0000", 2024-09-14T09:10:22.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030949929999999999 2024-09-14T09:10:22.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:22.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790589+0000", 2024-09-14T09:10:22.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7600000000000008e-06 2024-09-14T09:10:22.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.799541+0000", 2024-09-14T09:10:22.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0089520110000001 2024-09-14T09:10:22.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:22.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.799620+0000", 2024-09-14T09:10:22.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8969999999999998e-05 2024-09-14T09:10:22.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:22.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.811760+0000", 2024-09-14T09:10:22.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012140748999999999 2024-09-14T09:10:22.126 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.127 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:22.127 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.127 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:65817 3.3 3:c2c49fe0:::rbd_data.1112a10502fe.00000000000001b3:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:22.127 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:10:22.127 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 65.278459538999996, 2024-09-14T09:10:22.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0253660200000001, 2024-09-14T09:10:22.127 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:22.127 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:22.127 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:22.127 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:22.127 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:22.128 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:22.128 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 65817 2024-09-14T09:10:22.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.128 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:22.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:22.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:10:22.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:22.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:10:22.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:22.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787444+0000", 2024-09-14T09:10:22.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999995e-07 2024-09-14T09:10:22.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:22.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787448+0000", 2024-09-14T09:10:22.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1420000000000003e-06 2024-09-14T09:10:22.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:22.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787497+0000", 2024-09-14T09:10:22.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8507999999999997e-05 2024-09-14T09:10:22.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:22.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787503+0000", 2024-09-14T09:10:22.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1319999999999999e-06 2024-09-14T09:10:22.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787595+0000", 2024-09-14T09:10:22.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1748000000000003e-05 2024-09-14T09:10:22.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:22.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787601+0000", 2024-09-14T09:10:22.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6150000000000002e-06 2024-09-14T09:10:22.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790613+0000", 2024-09-14T09:10:22.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003012228 2024-09-14T09:10:22.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:22.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790621+0000", 2024-09-14T09:10:22.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9219999999999997e-06 2024-09-14T09:10:22.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800130+0000", 2024-09-14T09:10:22.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.009508474 2024-09-14T09:10:22.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:22.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800257+0000", 2024-09-14T09:10:22.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012746900000000001 2024-09-14T09:10:22.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:22.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.812809+0000", 2024-09-14T09:10:22.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012552054 2024-09-14T09:10:22.132 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.132 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:22.132 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.132 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:68709 3.3 3:c4996abd:::rbd_data.1112a10502fe.00000000000001cd:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:22.132 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:10:22.133 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 65.278288592999999, 2024-09-14T09:10:22.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0254506109999999, 2024-09-14T09:10:22.133 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:22.133 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:22.133 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:22.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:22.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:22.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:22.133 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 68709 2024-09-14T09:10:22.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.133 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:22.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:22.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:10:22.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:22.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:10:22.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:22.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787615+0000", 2024-09-14T09:10:22.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4000000000000001e-07 2024-09-14T09:10:22.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:22.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787618+0000", 2024-09-14T09:10:22.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2780000000000002e-06 2024-09-14T09:10:22.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:22.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787626+0000", 2024-09-14T09:10:22.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0250000000000002e-06 2024-09-14T09:10:22.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:22.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787633+0000", 2024-09-14T09:10:22.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5660000000000003e-06 2024-09-14T09:10:22.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787714+0000", 2024-09-14T09:10:22.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1695999999999998e-05 2024-09-14T09:10:22.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:22.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787721+0000", 2024-09-14T09:10:22.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1109999999999996e-06 2024-09-14T09:10:22.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790646+0000", 2024-09-14T09:10:22.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029251730000000001 2024-09-14T09:10:22.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:22.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790653+0000", 2024-09-14T09:10:22.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4379999999999998e-06 2024-09-14T09:10:22.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800750+0000", 2024-09-14T09:10:22.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010097236 2024-09-14T09:10:22.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:22.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800883+0000", 2024-09-14T09:10:22.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000132466 2024-09-14T09:10:22.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:22.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813065+0000", 2024-09-14T09:10:22.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012181981999999999 2024-09-14T09:10:22.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.138 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:22.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.138 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:74823 3.3 3:c59acf89:::rbd_data.1112a10502fe.00000000000001fb:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:22.138 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:10:22.138 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 65.257454120999995, 2024-09-14T09:10:22.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.004859323, 2024-09-14T09:10:22.138 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:22.139 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:22.139 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:22.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:22.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:22.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:22.139 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74823 2024-09-14T09:10:22.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.139 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:22.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:22.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:10:22.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:22.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:10:22.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:22.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808450+0000", 2024-09-14T09:10:22.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.92e-07 2024-09-14T09:10:22.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:22.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808454+0000", 2024-09-14T09:10:22.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3660000000000002e-06 2024-09-14T09:10:22.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:22.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808463+0000", 2024-09-14T09:10:22.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1579999999999994e-06 2024-09-14T09:10:22.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:22.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808470+0000", 2024-09-14T09:10:22.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7599999999999997e-06 2024-09-14T09:10:22.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808540+0000", 2024-09-14T09:10:22.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9991000000000001e-05 2024-09-14T09:10:22.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:22.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808550+0000", 2024-09-14T09:10:22.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0282000000000001e-05 2024-09-14T09:10:22.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801352+0000", 2024-09-14T09:10:22.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99280192700000003 2024-09-14T09:10:22.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:22.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801472+0000", 2024-09-14T09:10:22.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120184 2024-09-14T09:10:22.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:22.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813308+0000", 2024-09-14T09:10:22.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011835863 2024-09-14T09:10:22.143 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.143 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:22.143 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.143 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:86789 3.3 3:c3063f19:::rbd_data.1112a10502fe.000000000000023a:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:22.143 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:10:22.143 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.485231396000003, 2024-09-14T09:10:22.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.23302192099999999, 2024-09-14T09:10:22.144 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:22.144 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:22.144 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:22.144 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:22.144 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:22.144 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:22.144 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86789 2024-09-14T09:10:22.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.144 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:22.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:22.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:10:22.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:22.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:10:22.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:22.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580672+0000", 2024-09-14T09:10:22.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7999999999999993e-07 2024-09-14T09:10:22.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:22.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580680+0000", 2024-09-14T09:10:22.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7540000000000006e-06 2024-09-14T09:10:22.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:22.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580694+0000", 2024-09-14T09:10:22.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3344e-05 2024-09-14T09:10:22.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:22.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580702+0000", 2024-09-14T09:10:22.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9510000000000006e-06 2024-09-14T09:10:22.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580778+0000", 2024-09-14T09:10:22.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6580000000000002e-05 2024-09-14T09:10:22.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:22.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580788+0000", 2024-09-14T09:10:22.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0327e-05 2024-09-14T09:10:22.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801980+0000", 2024-09-14T09:10:22.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.22119123900000001 2024-09-14T09:10:22.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:22.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802115+0000", 2024-09-14T09:10:22.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013572000000000001 2024-09-14T09:10:22.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:22.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813693+0000", 2024-09-14T09:10:22.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011578026 2024-09-14T09:10:22.148 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.148 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:22.148 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.148 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:89485 3.3 3:c3eae671:::rbd_data.1112a10502fe.0000000000000248:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:22.148 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:10:22.148 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.380374902, 2024-09-14T09:10:22.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.12841583300000001, 2024-09-14T09:10:22.149 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:22.149 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:22.149 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:22.149 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:22.149 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:22.149 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:22.149 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 89485 2024-09-14T09:10:22.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.149 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:22.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:22.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:10:22.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:22.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:10:22.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:22.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685529+0000", 2024-09-14T09:10:22.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.11e-06 2024-09-14T09:10:22.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:22.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685534+0000", 2024-09-14T09:10:22.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0289999999999996e-06 2024-09-14T09:10:22.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:22.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685546+0000", 2024-09-14T09:10:22.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2062000000000001e-05 2024-09-14T09:10:22.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:22.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685554+0000", 2024-09-14T09:10:22.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7889999999999995e-06 2024-09-14T09:10:22.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685618+0000", 2024-09-14T09:10:22.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4487999999999996e-05 2024-09-14T09:10:22.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:22.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685628+0000", 2024-09-14T09:10:22.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5840000000000001e-06 2024-09-14T09:10:22.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802613+0000", 2024-09-14T09:10:22.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.116984703 2024-09-14T09:10:22.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:22.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802768+0000", 2024-09-14T09:10:22.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015541599999999999 2024-09-14T09:10:22.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:22.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813944+0000", 2024-09-14T09:10:22.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011175651999999999 2024-09-14T09:10:22.153 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.153 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:22.153 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.154 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:90751 3.3 3:c22bfcfe:::rbd_data.1112a10502fe.000000000000024e:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:22.154 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:10:22.154 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.329304117999996, 2024-09-14T09:10:22.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077582650000000003, 2024-09-14T09:10:22.154 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:22.154 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:22.154 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:22.154 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:22.154 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:22.154 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:22.154 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 90751 2024-09-14T09:10:22.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.154 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:22.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:22.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:10:22.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:22.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:10:22.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:22.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736600+0000", 2024-09-14T09:10:22.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.71e-07 2024-09-14T09:10:22.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:22.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736608+0000", 2024-09-14T09:10:22.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2679999999999994e-06 2024-09-14T09:10:22.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:22.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736620+0000", 2024-09-14T09:10:22.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2064e-05 2024-09-14T09:10:22.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:22.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736627+0000", 2024-09-14T09:10:22.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8129999999999998e-06 2024-09-14T09:10:22.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736676+0000", 2024-09-14T09:10:22.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.901e-05 2024-09-14T09:10:22.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:22.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736685+0000", 2024-09-14T09:10:22.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:10:22.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803227+0000", 2024-09-14T09:10:22.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066541874000000001 2024-09-14T09:10:22.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:22.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803381+0000", 2024-09-14T09:10:22.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015482500000000001 2024-09-14T09:10:22.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:22.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.814181+0000", 2024-09-14T09:10:22.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010799944000000001 2024-09-14T09:10:22.158 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.158 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:22.158 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.158 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:90760 3.3 3:c116ad26:::rbd_data.1112a10502fe.0000000000000251:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:22.159 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:10:22.159 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.329201800999996, 2024-09-14T09:10:22.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077694599000000003, 2024-09-14T09:10:22.159 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:22.159 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:22.159 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:22.159 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:22.159 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:22.159 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:22.159 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 90760 2024-09-14T09:10:22.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.159 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:22.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:22.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:10:22.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:22.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:10:22.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:22.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:22.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736702+0000", 2024-09-14T09:10:22.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0999999999999998e-07 2024-09-14T09:10:22.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:22.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736705+0000", 2024-09-14T09:10:22.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0120000000000001e-06 2024-09-14T09:10:22.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:22.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736711+0000", 2024-09-14T09:10:22.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6279999999999999e-06 2024-09-14T09:10:22.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:22.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736717+0000", 2024-09-14T09:10:22.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6200000000000004e-06 2024-09-14T09:10:22.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736765+0000", 2024-09-14T09:10:22.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7688000000000001e-05 2024-09-14T09:10:22.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:22.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736772+0000", 2024-09-14T09:10:22.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6529999999999994e-06 2024-09-14T09:10:22.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:22.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803886+0000", 2024-09-14T09:10:22.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067113795000000004 2024-09-14T09:10:22.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:22.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.804024+0000", 2024-09-14T09:10:22.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013782000000000001 2024-09-14T09:10:22.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:22.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:22.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:22.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.814396+0000", 2024-09-14T09:10:22.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010371773000000001 2024-09-14T09:10:22.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.163 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:22.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:22.163 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:22.164 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:22.164 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:10:22.165 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:10:22.166 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:10:22.166 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:10:22.167 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:10:22.167 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:22.167+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:22.266 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:22.268+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:22.310 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:22.310 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:22.318 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:10:22.367 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:22.369+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:22.421 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:22.421 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:22.430 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:10:22.468 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:22.470+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:22.532 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:22.532 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:22.540 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:10:22.584 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:22.586+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:22.646 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:22.646 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:22.654 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:10:22.695 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:22.697+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:22.771 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:22.772+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:22.801 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:22.801 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:22.811 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:10:22.872 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:22.874+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:22.920 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:22.920 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:22.929 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:10:22.974 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:22.976+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:22.988 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T09:10:23.035 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:23.035 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:23.045 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:10:23.088 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:23.090+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:23.152 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:23.153 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:23.161 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:10:23.176 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:23.178+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:23.277 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:23.278+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:23.305 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:23.305 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:23.315 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:10:23.378 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:23.380+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:23.417 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:23.417 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:23.426 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:10:23.479 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:23.481+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:23.569 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:23.570 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:23.578 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:10:23.580 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:23.581+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:23.680 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:23.680 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:23.681 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:23.682+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:23.689 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:10:23.782 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:23.783+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:23.793 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is set 2024-09-14T09:10:23.798 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:23.798 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:23.809 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:10:23.894 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:23.895+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:23.955 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:23.955 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:23.963 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:10:23.975 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 1] out_osds: [5] dead_osds: [] live_osds: [0, 1, 3, 4, 5, 2] 2024-09-14T09:10:23.975 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T09:10:23.975 INFO:tasks.thrashosds.thrasher:Removing osd 3, in_osds are: [0, 2, 3, 4, 1] 2024-09-14T09:10:23.976 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 3 2024-09-14T09:10:24.020 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:24.022+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:24.084 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:24.086+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:24.108 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:24.109 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:24.117 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:10:24.168 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T09:10:24.212 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:24.214+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:24.262 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:24.262 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:24.271 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:10:24.272 INFO:tasks.ceph.mon.a.smithi116.stderr:2024-09-14T09:10:24.274+0000 7f4999343640 -1 mon.a@0(leader).osd e152 definitely_dead 0 2024-09-14T09:10:24.288 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:10:24.288 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:10:24.304 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:10:24.305 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:10:24.316 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:24.317+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:24.320 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:10:24.320 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:10:24.337 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:10:24.337 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:10:24.353 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:10:24.354 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:10:24.370 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:10:24.370 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:10:24.376 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:24.376 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:24.377 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:10:24.377 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:10:24.377 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:24.385 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:10:24.427 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:24.428+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:24.487 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:24.490+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:24.530 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:24.531 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:10:24.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:10:24.531 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:10:24.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.531 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5349 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8302592~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:24.531 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:10:24.531 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 107.276278523, 2024-09-14T09:10:24.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039875928999999997, 2024-09-14T09:10:24.532 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:24.532 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:24.532 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:24.532 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:24.532 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:10:24.532 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:24.532 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5349 2024-09-14T09:10:24.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.532 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:24.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:24.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:10:24.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:24.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255873+0000", 2024-09-14T09:10:24.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:24.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255874+0000", 2024-09-14T09:10:24.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4900000000000001e-07 2024-09-14T09:10:24.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:24.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255880+0000", 2024-09-14T09:10:24.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9939999999999997e-06 2024-09-14T09:10:24.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:24.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255886+0000", 2024-09-14T09:10:24.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3899999999999998e-06 2024-09-14T09:10:24.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:24.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255891+0000", 2024-09-14T09:10:24.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.938e-06 2024-09-14T09:10:24.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295580+0000", 2024-09-14T09:10:24.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039688681000000003 2024-09-14T09:10:24.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:24.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295653+0000", 2024-09-14T09:10:24.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3045000000000003e-05 2024-09-14T09:10:24.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:24.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295749+0000", 2024-09-14T09:10:24.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6532000000000003e-05 2024-09-14T09:10:24.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.535 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:24.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.536 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5127.0:5350 3.19 3:9f4808da:::rbd_data.111228c3791c.0000000000000008:18 [read 8364032~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:24.536 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:10:24.536 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 107.276254716, 2024-09-14T09:10:24.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039989719, 2024-09-14T09:10:24.536 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:24.536 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:24.536 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:24.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:24.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5127", 2024-09-14T09:10:24.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:24.536 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 5350 2024-09-14T09:10:24.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.536 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:24.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:24.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:10:24.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:24.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255897+0000", 2024-09-14T09:10:24.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:24.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255898+0000", 2024-09-14T09:10:24.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2024-09-14T09:10:24.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:24.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255899+0000", 2024-09-14T09:10:24.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9139999999999998e-06 2024-09-14T09:10:24.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:24.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255905+0000", 2024-09-14T09:10:24.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7289999999999997e-06 2024-09-14T09:10:24.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:24.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.255910+0000", 2024-09-14T09:10:24.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6210000000000003e-06 2024-09-14T09:10:24.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295775+0000", 2024-09-14T09:10:24.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039864973999999997 2024-09-14T09:10:24.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:24.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295828+0000", 2024-09-14T09:10:24.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3411000000000001e-05 2024-09-14T09:10:24.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:24.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:37.295887+0000", 2024-09-14T09:10:24.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699000000000002e-05 2024-09-14T09:10:24.540 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.540 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:24.540 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.540 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4639 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1843200~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:24.540 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:10:24.540 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 86.332339257000001, 2024-09-14T09:10:24.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040843672999999997, 2024-09-14T09:10:24.540 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:24.540 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:24.540 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:24.540 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:24.541 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:24.541 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:24.541 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4639 2024-09-14T09:10:24.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.541 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:24.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:24.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:10:24.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:24.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:10:24.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:24.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199813+0000", 2024-09-14T09:10:24.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:10:24.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:24.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199818+0000", 2024-09-14T09:10:24.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1450000000000001e-06 2024-09-14T09:10:24.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:24.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199827+0000", 2024-09-14T09:10:24.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3999999999999998e-06 2024-09-14T09:10:24.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:24.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199834+0000", 2024-09-14T09:10:24.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0809999999999996e-06 2024-09-14T09:10:24.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240541+0000", 2024-09-14T09:10:24.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040706941000000003 2024-09-14T09:10:24.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:24.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240584+0000", 2024-09-14T09:10:24.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3040999999999997e-05 2024-09-14T09:10:24.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:24.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240656+0000", 2024-09-14T09:10:24.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2200000000000007e-05 2024-09-14T09:10:24.544 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.544 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:24.544 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.545 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4640 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1871872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:24.545 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:10:24.545 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 86.332304772000001, 2024-09-14T09:10:24.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040967601999999999, 2024-09-14T09:10:24.545 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:24.545 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:24.545 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:24.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:24.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:24.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:24.545 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4640 2024-09-14T09:10:24.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.546 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:24.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:24.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:10:24.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:24.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199847+0000", 2024-09-14T09:10:24.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:24.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199848+0000", 2024-09-14T09:10:24.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5400000000000002e-07 2024-09-14T09:10:24.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:24.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199850+0000", 2024-09-14T09:10:24.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2479999999999999e-06 2024-09-14T09:10:24.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:24.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199857+0000", 2024-09-14T09:10:24.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.187e-06 2024-09-14T09:10:24.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:24.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199862+0000", 2024-09-14T09:10:24.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5119999999999999e-06 2024-09-14T09:10:24.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240684+0000", 2024-09-14T09:10:24.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040821245999999999 2024-09-14T09:10:24.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:24.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240739+0000", 2024-09-14T09:10:24.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4991999999999998e-05 2024-09-14T09:10:24.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:24.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240815+0000", 2024-09-14T09:10:24.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5963000000000004e-05 2024-09-14T09:10:24.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.549 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:24.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.549 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4641 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1900544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:24.549 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:10:24.549 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 86.332282441999993, 2024-09-14T09:10:24.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041205512, 2024-09-14T09:10:24.549 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:24.549 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:24.549 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:24.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:24.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:24.550 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:24.550 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4641 2024-09-14T09:10:24.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.550 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:24.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:24.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:10:24.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:24.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199869+0000", 2024-09-14T09:10:24.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:24.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199870+0000", 2024-09-14T09:10:24.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0600000000000001e-07 2024-09-14T09:10:24.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:24.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199872+0000", 2024-09-14T09:10:24.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.928e-06 2024-09-14T09:10:24.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:24.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199877+0000", 2024-09-14T09:10:24.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6949999999999997e-06 2024-09-14T09:10:24.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:24.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199882+0000", 2024-09-14T09:10:24.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8210000000000001e-06 2024-09-14T09:10:24.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240847+0000", 2024-09-14T09:10:24.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040965201999999999 2024-09-14T09:10:24.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:24.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.240888+0000", 2024-09-14T09:10:24.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0754000000000003e-05 2024-09-14T09:10:24.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:24.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241075+0000", 2024-09-14T09:10:24.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000186706 2024-09-14T09:10:24.553 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.553 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:24.553 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.553 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4642 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1929216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:24.554 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:10:24.554 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 86.332263506999993, 2024-09-14T09:10:24.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041292575999999998, 2024-09-14T09:10:24.554 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:24.554 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:24.554 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:24.554 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:24.554 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:24.554 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:24.554 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4642 2024-09-14T09:10:24.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.554 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:24.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:24.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:10:24.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:24.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199888+0000", 2024-09-14T09:10:24.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:24.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199889+0000", 2024-09-14T09:10:24.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2024-09-14T09:10:24.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:24.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199891+0000", 2024-09-14T09:10:24.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9e-06 2024-09-14T09:10:24.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:24.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199896+0000", 2024-09-14T09:10:24.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6960000000000002e-06 2024-09-14T09:10:24.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:24.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199901+0000", 2024-09-14T09:10:24.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6720000000000003e-06 2024-09-14T09:10:24.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241089+0000", 2024-09-14T09:10:24.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041187594000000001 2024-09-14T09:10:24.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:24.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241126+0000", 2024-09-14T09:10:24.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7490999999999997e-05 2024-09-14T09:10:24.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:24.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241181+0000", 2024-09-14T09:10:24.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4823e-05 2024-09-14T09:10:24.557 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.557 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:24.557 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.558 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4643 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1957888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:24.558 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:10:24.558 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 86.332244227999993, 2024-09-14T09:10:24.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041418333000000002, 2024-09-14T09:10:24.558 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:24.558 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:24.558 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:24.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:24.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:24.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:24.558 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4643 2024-09-14T09:10:24.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.558 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:24.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:24.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:10:24.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:24.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:10:24.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:24.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199908+0000", 2024-09-14T09:10:24.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5699999999999998e-07 2024-09-14T09:10:24.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:24.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199910+0000", 2024-09-14T09:10:24.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.829e-06 2024-09-14T09:10:24.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:24.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199916+0000", 2024-09-14T09:10:24.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8499999999999999e-06 2024-09-14T09:10:24.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:24.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199920+0000", 2024-09-14T09:10:24.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6530000000000002e-06 2024-09-14T09:10:24.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241211+0000", 2024-09-14T09:10:24.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041290327000000002 2024-09-14T09:10:24.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:24.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241257+0000", 2024-09-14T09:10:24.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6347000000000002e-05 2024-09-14T09:10:24.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:24.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241326+0000", 2024-09-14T09:10:24.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8969999999999999e-05 2024-09-14T09:10:24.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.562 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:24.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.564 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4644 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 1986560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:24.564 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:10:24.564 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 86.332225887999996, 2024-09-14T09:10:24.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041596269999999998, 2024-09-14T09:10:24.564 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:24.564 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:24.564 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:24.564 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:24.564 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:24.564 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:24.564 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4644 2024-09-14T09:10:24.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.565 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:24.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:24.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:10:24.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:24.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:10:24.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:24.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199926+0000", 2024-09-14T09:10:24.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.41e-07 2024-09-14T09:10:24.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:24.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199928+0000", 2024-09-14T09:10:24.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8250000000000001e-06 2024-09-14T09:10:24.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:24.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199934+0000", 2024-09-14T09:10:24.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2280000000000003e-06 2024-09-14T09:10:24.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:24.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199939+0000", 2024-09-14T09:10:24.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8010000000000003e-06 2024-09-14T09:10:24.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241360+0000", 2024-09-14T09:10:24.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041421289 2024-09-14T09:10:24.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:24.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241435+0000", 2024-09-14T09:10:24.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4238000000000003e-05 2024-09-14T09:10:24.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:24.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241522+0000", 2024-09-14T09:10:24.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7547999999999996e-05 2024-09-14T09:10:24.568 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.568 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:24.568 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.568 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4645 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:24.568 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:10:24.568 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 86.332206980999999, 2024-09-14T09:10:24.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041714660000000001, 2024-09-14T09:10:24.569 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:24.569 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:24.569 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:24.569 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:24.569 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:24.569 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:24.569 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4645 2024-09-14T09:10:24.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.569 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:24.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:24.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:10:24.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:24.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:10:24.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:24.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199945+0000", 2024-09-14T09:10:24.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4700000000000002e-07 2024-09-14T09:10:24.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:24.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199947+0000", 2024-09-14T09:10:24.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.801e-06 2024-09-14T09:10:24.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:24.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199953+0000", 2024-09-14T09:10:24.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.694e-06 2024-09-14T09:10:24.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:24.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199957+0000", 2024-09-14T09:10:24.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3069999999999996e-06 2024-09-14T09:10:24.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241547+0000", 2024-09-14T09:10:24.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041589895000000002 2024-09-14T09:10:24.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:24.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241590+0000", 2024-09-14T09:10:24.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2985000000000003e-05 2024-09-14T09:10:24.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:24.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241660+0000", 2024-09-14T09:10:24.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9630999999999998e-05 2024-09-14T09:10:24.572 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.572 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:24.573 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.573 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4646 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2043904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:24.573 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:10:24.573 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 86.332188993000003, 2024-09-14T09:10:24.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041827171000000003, 2024-09-14T09:10:24.573 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:24.573 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:24.573 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:24.573 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:24.573 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:24.573 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:24.573 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4646 2024-09-14T09:10:24.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.574 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:24.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:24.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:10:24.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:24.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:10:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199963+0000", 2024-09-14T09:10:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6300000000000001e-07 2024-09-14T09:10:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199965+0000", 2024-09-14T09:10:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.035e-06 2024-09-14T09:10:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:24.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199973+0000", 2024-09-14T09:10:24.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9629999999999998e-06 2024-09-14T09:10:24.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:24.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199978+0000", 2024-09-14T09:10:24.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9069999999999998e-06 2024-09-14T09:10:24.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241677+0000", 2024-09-14T09:10:24.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041698662999999997 2024-09-14T09:10:24.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:24.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241717+0000", 2024-09-14T09:10:24.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0602999999999997e-05 2024-09-14T09:10:24.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:24.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241790+0000", 2024-09-14T09:10:24.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2637000000000003e-05 2024-09-14T09:10:24.577 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.577 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:24.577 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.578 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5093.0:4647 3.3 3:c49abf53:::rbd_data.1112dd51a8c2.0000000000000007:1c [read 2072576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T09:10:24.578 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:10:24.578 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 86.332160403000003, 2024-09-14T09:10:24.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041921189999999997, 2024-09-14T09:10:24.578 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:24.578 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:24.578 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:24.578 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:24.579 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5093", 2024-09-14T09:10:24.579 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/1738521242", 2024-09-14T09:10:24.579 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4647 2024-09-14T09:10:24.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.579 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:24.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:24.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:10:24.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:24.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199991+0000", 2024-09-14T09:10:24.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199992+0000", 2024-09-14T09:10:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3799999999999997e-07 2024-09-14T09:10:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.199994+0000", 2024-09-14T09:10:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3020000000000002e-06 2024-09-14T09:10:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200004+0000", 2024-09-14T09:10:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3510000000000008e-06 2024-09-14T09:10:24.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:24.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.200008+0000", 2024-09-14T09:10:24.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3329999999999998e-06 2024-09-14T09:10:24.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241814+0000", 2024-09-14T09:10:24.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041806280000000001 2024-09-14T09:10:24.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:24.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241855+0000", 2024-09-14T09:10:24.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0173999999999999e-05 2024-09-14T09:10:24.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:24.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:58.241913+0000", 2024-09-14T09:10:24.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8112000000000002e-05 2024-09-14T09:10:24.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.582 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:24.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.582 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:59017 3.3 3:c1df81d6:::rbd_data.1112a10502fe.0000000000000189:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:24.582 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:10:24.582 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.744869801999997, 2024-09-14T09:10:24.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.024252111, 2024-09-14T09:10:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59017 2024-09-14T09:10:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:10:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787282+0000", 2024-09-14T09:10:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787284+0000", 2024-09-14T09:10:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3879999999999998e-06 2024-09-14T09:10:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787297+0000", 2024-09-14T09:10:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2184999999999999e-05 2024-09-14T09:10:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:24.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787317+0000", 2024-09-14T09:10:24.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0054000000000001e-05 2024-09-14T09:10:24.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:24.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787327+0000", 2024-09-14T09:10:24.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0335e-05 2024-09-14T09:10:24.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787412+0000", 2024-09-14T09:10:24.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4691000000000006e-05 2024-09-14T09:10:24.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-09-14T09:10:24.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787422+0000", 2024-09-14T09:10:24.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0718e-05 2024-09-14T09:10:24.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790539+0000", 2024-09-14T09:10:24.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031164600000000002 2024-09-14T09:10:24.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:24.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790552+0000", 2024-09-14T09:10:24.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2736e-05 2024-09-14T09:10:24.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.798725+0000", 2024-09-14T09:10:24.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0081731860000001 2024-09-14T09:10:24.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:24.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.798824+0000", 2024-09-14T09:10:24.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9600999999999997e-05 2024-09-14T09:10:24.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:24.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.811534+0000", 2024-09-14T09:10:24.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012709757 2024-09-14T09:10:24.590 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.590 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:24.591 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.591 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:63586 3.3 3:c0d9272b:::rbd_data.1112a10502fe.00000000000001a2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:24.591 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:10:24.591 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.744798318999997, 2024-09-14T09:10:24.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0244069650000001, 2024-09-14T09:10:24.592 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:24.592 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:24.592 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:24.592 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:24.592 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:24.592 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:24.593 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 63586 2024-09-14T09:10:24.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.593 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:24.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:24.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:10:24.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:24.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:10:24.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:24.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787354+0000", 2024-09-14T09:10:24.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2024-09-14T09:10:24.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:24.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787357+0000", 2024-09-14T09:10:24.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8720000000000002e-06 2024-09-14T09:10:24.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:24.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787365+0000", 2024-09-14T09:10:24.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9270000000000005e-06 2024-09-14T09:10:24.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:24.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787372+0000", 2024-09-14T09:10:24.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6810000000000001e-06 2024-09-14T09:10:24.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787479+0000", 2024-09-14T09:10:24.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010736800000000001 2024-09-14T09:10:24.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:24.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787485+0000", 2024-09-14T09:10:24.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.054e-06 2024-09-14T09:10:24.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790580+0000", 2024-09-14T09:10:24.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030949929999999999 2024-09-14T09:10:24.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:24.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790589+0000", 2024-09-14T09:10:24.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7600000000000008e-06 2024-09-14T09:10:24.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.799541+0000", 2024-09-14T09:10:24.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0089520110000001 2024-09-14T09:10:24.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:24.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.799620+0000", 2024-09-14T09:10:24.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8969999999999998e-05 2024-09-14T09:10:24.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:24.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.811760+0000", 2024-09-14T09:10:24.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012140748999999999 2024-09-14T09:10:24.603 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.603 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:24.603 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.604 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:65817 3.3 3:c2c49fe0:::rbd_data.1112a10502fe.00000000000001b3:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:24.604 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:10:24.604 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.744708517000007, 2024-09-14T09:10:24.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0253660200000001, 2024-09-14T09:10:24.605 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:24.605 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:24.605 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:24.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:24.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:24.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:24.606 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 65817 2024-09-14T09:10:24.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.606 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:24.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:24.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:10:24.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:24.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787443+0000", 2024-09-14T09:10:24.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:24.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787444+0000", 2024-09-14T09:10:24.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999995e-07 2024-09-14T09:10:24.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:24.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787448+0000", 2024-09-14T09:10:24.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1420000000000003e-06 2024-09-14T09:10:24.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:24.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787497+0000", 2024-09-14T09:10:24.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8507999999999997e-05 2024-09-14T09:10:24.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:24.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787503+0000", 2024-09-14T09:10:24.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1319999999999999e-06 2024-09-14T09:10:24.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787595+0000", 2024-09-14T09:10:24.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1748000000000003e-05 2024-09-14T09:10:24.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:24.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787601+0000", 2024-09-14T09:10:24.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6150000000000002e-06 2024-09-14T09:10:24.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790613+0000", 2024-09-14T09:10:24.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003012228 2024-09-14T09:10:24.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:24.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790621+0000", 2024-09-14T09:10:24.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9219999999999997e-06 2024-09-14T09:10:24.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800130+0000", 2024-09-14T09:10:24.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.009508474 2024-09-14T09:10:24.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:24.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800257+0000", 2024-09-14T09:10:24.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012746900000000001 2024-09-14T09:10:24.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:24.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.812809+0000", 2024-09-14T09:10:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012552054 2024-09-14T09:10:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:68709 3.3 3:c4996abd:::rbd_data.1112a10502fe.00000000000001cd:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:10:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.744537570999995, 2024-09-14T09:10:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0254506109999999, 2024-09-14T09:10:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 68709 2024-09-14T09:10:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:10:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787614+0000", 2024-09-14T09:10:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787615+0000", 2024-09-14T09:10:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4000000000000001e-07 2024-09-14T09:10:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787618+0000", 2024-09-14T09:10:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2780000000000002e-06 2024-09-14T09:10:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787626+0000", 2024-09-14T09:10:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0250000000000002e-06 2024-09-14T09:10:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787633+0000", 2024-09-14T09:10:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5660000000000003e-06 2024-09-14T09:10:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787714+0000", 2024-09-14T09:10:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1695999999999998e-05 2024-09-14T09:10:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.787721+0000", 2024-09-14T09:10:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1109999999999996e-06 2024-09-14T09:10:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790646+0000", 2024-09-14T09:10:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029251730000000001 2024-09-14T09:10:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.790653+0000", 2024-09-14T09:10:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4379999999999998e-06 2024-09-14T09:10:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800750+0000", 2024-09-14T09:10:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010097236 2024-09-14T09:10:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.800883+0000", 2024-09-14T09:10:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000132466 2024-09-14T09:10:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813065+0000", 2024-09-14T09:10:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012181981999999999 2024-09-14T09:10:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:74823 3.3 3:c59acf89:::rbd_data.1112a10502fe.00000000000001fb:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:10:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.723703099000005, 2024-09-14T09:10:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.004859323, 2024-09-14T09:10:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74823 2024-09-14T09:10:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:10:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808449+0000", 2024-09-14T09:10:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808450+0000", 2024-09-14T09:10:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.92e-07 2024-09-14T09:10:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808454+0000", 2024-09-14T09:10:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3660000000000002e-06 2024-09-14T09:10:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808463+0000", 2024-09-14T09:10:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1579999999999994e-06 2024-09-14T09:10:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808470+0000", 2024-09-14T09:10:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7599999999999997e-06 2024-09-14T09:10:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808540+0000", 2024-09-14T09:10:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9991000000000001e-05 2024-09-14T09:10:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.808550+0000", 2024-09-14T09:10:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0282000000000001e-05 2024-09-14T09:10:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801352+0000", 2024-09-14T09:10:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99280192700000003 2024-09-14T09:10:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801472+0000", 2024-09-14T09:10:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120184 2024-09-14T09:10:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813308+0000", 2024-09-14T09:10:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011835863 2024-09-14T09:10:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:86789 3.3 3:c3063f19:::rbd_data.1112a10502fe.000000000000023a:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:10:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 66.951480373999999, 2024-09-14T09:10:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.23302192099999999, 2024-09-14T09:10:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86789 2024-09-14T09:10:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:10:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580671+0000", 2024-09-14T09:10:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580672+0000", 2024-09-14T09:10:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7999999999999993e-07 2024-09-14T09:10:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580680+0000", 2024-09-14T09:10:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7540000000000006e-06 2024-09-14T09:10:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580694+0000", 2024-09-14T09:10:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3344e-05 2024-09-14T09:10:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580702+0000", 2024-09-14T09:10:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9510000000000006e-06 2024-09-14T09:10:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580778+0000", 2024-09-14T09:10:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6580000000000002e-05 2024-09-14T09:10:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.580788+0000", 2024-09-14T09:10:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0327e-05 2024-09-14T09:10:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.801980+0000", 2024-09-14T09:10:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.22119123900000001 2024-09-14T09:10:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802115+0000", 2024-09-14T09:10:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013572000000000001 2024-09-14T09:10:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813693+0000", 2024-09-14T09:10:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011578026 2024-09-14T09:10:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:89485 3.3 3:c3eae671:::rbd_data.1112a10502fe.0000000000000248:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:10:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 66.846623879999996, 2024-09-14T09:10:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.12841583300000001, 2024-09-14T09:10:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 89485 2024-09-14T09:10:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:10:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685528+0000", 2024-09-14T09:10:24.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:24.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685529+0000", 2024-09-14T09:10:24.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.11e-06 2024-09-14T09:10:24.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:24.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685534+0000", 2024-09-14T09:10:24.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0289999999999996e-06 2024-09-14T09:10:24.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:24.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685546+0000", 2024-09-14T09:10:24.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2062000000000001e-05 2024-09-14T09:10:24.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:24.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685554+0000", 2024-09-14T09:10:24.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7889999999999995e-06 2024-09-14T09:10:24.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685618+0000", 2024-09-14T09:10:24.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4487999999999996e-05 2024-09-14T09:10:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.685628+0000", 2024-09-14T09:10:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5840000000000001e-06 2024-09-14T09:10:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802613+0000", 2024-09-14T09:10:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.116984703 2024-09-14T09:10:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.802768+0000", 2024-09-14T09:10:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015541599999999999 2024-09-14T09:10:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.813944+0000", 2024-09-14T09:10:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011175651999999999 2024-09-14T09:10:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:90751 3.3 3:c22bfcfe:::rbd_data.1112a10502fe.000000000000024e:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:10:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 66.795553096000006, 2024-09-14T09:10:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077582650000000003, 2024-09-14T09:10:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 90751 2024-09-14T09:10:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:10:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736599+0000", 2024-09-14T09:10:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736600+0000", 2024-09-14T09:10:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.71e-07 2024-09-14T09:10:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736608+0000", 2024-09-14T09:10:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2679999999999994e-06 2024-09-14T09:10:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736620+0000", 2024-09-14T09:10:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2064e-05 2024-09-14T09:10:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736627+0000", 2024-09-14T09:10:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8129999999999998e-06 2024-09-14T09:10:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736676+0000", 2024-09-14T09:10:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.901e-05 2024-09-14T09:10:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736685+0000", 2024-09-14T09:10:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:10:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803227+0000", 2024-09-14T09:10:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066541874000000001 2024-09-14T09:10:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803381+0000", 2024-09-14T09:10:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015482500000000001 2024-09-14T09:10:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.814181+0000", 2024-09-14T09:10:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010799944000000001 2024-09-14T09:10:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:90760 3.3 3:c116ad26:::rbd_data.1112a10502fe.0000000000000251:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:10:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 66.795450779000006, 2024-09-14T09:10:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077694599000000003, 2024-09-14T09:10:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 90760 2024-09-14T09:10:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:10:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736701+0000", 2024-09-14T09:10:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736702+0000", 2024-09-14T09:10:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0999999999999998e-07 2024-09-14T09:10:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736705+0000", 2024-09-14T09:10:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0120000000000001e-06 2024-09-14T09:10:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736711+0000", 2024-09-14T09:10:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6279999999999999e-06 2024-09-14T09:10:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736717+0000", 2024-09-14T09:10:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6200000000000004e-06 2024-09-14T09:10:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736765+0000", 2024-09-14T09:10:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7688000000000001e-05 2024-09-14T09:10:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.736772+0000", 2024-09-14T09:10:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6529999999999994e-06 2024-09-14T09:10:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.803886+0000", 2024-09-14T09:10:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067113795000000004 2024-09-14T09:10:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.804024+0000", 2024-09-14T09:10:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013782000000000001 2024-09-14T09:10:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:17.814396+0000", 2024-09-14T09:10:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010371773000000001 2024-09-14T09:10:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.647 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:24.647 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.647 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:24.647 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:24.647 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:24.648 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:10:24.649 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:24.649+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:24.749 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:24.752+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:24.792 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:24.793 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:24.793 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-09-14T09:10:24.793 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:24.799 INFO:teuthology.orchestra.run.smithi116.stderr:marked out osd.3. 2024-09-14T09:10:24.806 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:10:24.857 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:24.859+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:24.909 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:24.909 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-09-14T09:10:24.909 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-09-14T09:10:24.909 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-09-14T09:10:24.909 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:24.917 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:10:24.961 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:24.962+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:25.023 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-14T09:10:25.023 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-09-14T09:10:25.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-09-14T09:10:25.024 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-09-14T09:10:25.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.024 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:228 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 360448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:25.024 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:10:25.024 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 113.227902493, 2024-09-14T09:10:25.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99234476999999999, 2024-09-14T09:10:25.024 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:25.024 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:25.024 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:25.024 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:25.024 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:25.024 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:25.025 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 228 2024-09-14T09:10:25.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.025 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:25.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:25.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:10:25.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:25.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796905+0000", 2024-09-14T09:10:25.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:25.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796906+0000", 2024-09-14T09:10:25.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9399999999999995e-07 2024-09-14T09:10:25.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:25.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796917+0000", 2024-09-14T09:10:25.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0801e-05 2024-09-14T09:10:25.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:25.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796924+0000", 2024-09-14T09:10:25.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7750000000000004e-06 2024-09-14T09:10:25.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796944+0000", 2024-09-14T09:10:25.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9972000000000001e-05 2024-09-14T09:10:25.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798671+0000", 2024-09-14T09:10:25.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017271330000000001 2024-09-14T09:10:25.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798675+0000", 2024-09-14T09:10:25.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.194e-06 2024-09-14T09:10:25.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789003+0000", 2024-09-14T09:10:25.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99032768400000004 2024-09-14T09:10:25.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:25.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789115+0000", 2024-09-14T09:10:25.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112236 2024-09-14T09:10:25.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:25.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789250+0000", 2024-09-14T09:10:25.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013548100000000001 2024-09-14T09:10:25.029 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.029 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:25.029 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.029 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:229 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 819200~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:25.029 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:10:25.029 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 113.22785027, 2024-09-14T09:10:25.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99287024599999996, 2024-09-14T09:10:25.029 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:25.029 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:25.029 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:25.029 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:25.030 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:25.030 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:25.030 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 229 2024-09-14T09:10:25.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.030 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:25.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:25.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:10:25.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:25.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:10:25.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:25.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796958+0000", 2024-09-14T09:10:25.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999999e-07 2024-09-14T09:10:25.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:25.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796962+0000", 2024-09-14T09:10:25.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1479999999999999e-06 2024-09-14T09:10:25.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:25.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796967+0000", 2024-09-14T09:10:25.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1499999999999998e-06 2024-09-14T09:10:25.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796971+0000", 2024-09-14T09:10:25.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2480000000000001e-06 2024-09-14T09:10:25.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798688+0000", 2024-09-14T09:10:25.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017172660000000001 2024-09-14T09:10:25.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798691+0000", 2024-09-14T09:10:25.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:10:25.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789599+0000", 2024-09-14T09:10:25.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99090839399999997 2024-09-14T09:10:25.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:25.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789716+0000", 2024-09-14T09:10:25.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116474 2024-09-14T09:10:25.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:25.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789828+0000", 2024-09-14T09:10:25.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112293 2024-09-14T09:10:25.034 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.034 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:25.034 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.034 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:230 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1277952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:25.034 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:10:25.034 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 113.227829622, 2024-09-14T09:10:25.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99307501600000003, 2024-09-14T09:10:25.034 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:25.035 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:25.035 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:25.035 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:25.035 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:25.035 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:25.035 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 230 2024-09-14T09:10:25.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.035 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:25.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:25.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:10:25.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:25.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796978+0000", 2024-09-14T09:10:25.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:25.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796979+0000", 2024-09-14T09:10:25.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.34e-07 2024-09-14T09:10:25.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:25.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796980+0000", 2024-09-14T09:10:25.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.53e-06 2024-09-14T09:10:25.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:25.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796986+0000", 2024-09-14T09:10:25.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9989999999999997e-06 2024-09-14T09:10:25.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796989+0000", 2024-09-14T09:10:25.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0340000000000001e-06 2024-09-14T09:10:25.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798702+0000", 2024-09-14T09:10:25.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001712756 2024-09-14T09:10:25.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798705+0000", 2024-09-14T09:10:25.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7750000000000001e-06 2024-09-14T09:10:25.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789870+0000", 2024-09-14T09:10:25.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991165026 2024-09-14T09:10:25.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:25.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.789955+0000", 2024-09-14T09:10:25.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4839999999999994e-05 2024-09-14T09:10:25.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:25.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790053+0000", 2024-09-14T09:10:25.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8721999999999994e-05 2024-09-14T09:10:25.040 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.040 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:25.040 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.040 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:231 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:25.040 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:10:25.040 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 113.227814294, 2024-09-14T09:10:25.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99319130300000003, 2024-09-14T09:10:25.040 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:25.040 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:25.040 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:25.040 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:25.041 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:25.041 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:25.041 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 231 2024-09-14T09:10:25.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.041 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:25.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:25.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:10:25.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:25.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:10:25.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:25.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796994+0000", 2024-09-14T09:10:25.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2024-09-14T09:10:25.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:25.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796995+0000", 2024-09-14T09:10:25.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2500000000000001e-06 2024-09-14T09:10:25.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:25.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.796998+0000", 2024-09-14T09:10:25.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3230000000000002e-06 2024-09-14T09:10:25.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797001+0000", 2024-09-14T09:10:25.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7099999999999999e-06 2024-09-14T09:10:25.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798718+0000", 2024-09-14T09:10:25.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017168070000000001 2024-09-14T09:10:25.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798721+0000", 2024-09-14T09:10:25.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.853e-06 2024-09-14T09:10:25.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790077+0000", 2024-09-14T09:10:25.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.991356393 2024-09-14T09:10:25.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:25.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790129+0000", 2024-09-14T09:10:25.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2240999999999997e-05 2024-09-14T09:10:25.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:25.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790185+0000", 2024-09-14T09:10:25.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5515e-05 2024-09-14T09:10:25.045 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.045 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:25.045 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.046 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:232 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2195456~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:25.046 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:10:25.046 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 113.227803638, 2024-09-14T09:10:25.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99329117899999997, 2024-09-14T09:10:25.046 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:25.046 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:25.046 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:25.046 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:25.046 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:25.046 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:25.046 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 232 2024-09-14T09:10:25.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.046 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:25.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:25.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:10:25.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:25.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797004+0000", 2024-09-14T09:10:25.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:25.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797005+0000", 2024-09-14T09:10:25.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2024-09-14T09:10:25.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:25.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797006+0000", 2024-09-14T09:10:25.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3200000000000001e-06 2024-09-14T09:10:25.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:25.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797009+0000", 2024-09-14T09:10:25.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4680000000000001e-06 2024-09-14T09:10:25.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797012+0000", 2024-09-14T09:10:25.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4770000000000002e-06 2024-09-14T09:10:25.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798743+0000", 2024-09-14T09:10:25.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017312 2024-09-14T09:10:25.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798747+0000", 2024-09-14T09:10:25.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.484e-06 2024-09-14T09:10:25.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790201+0000", 2024-09-14T09:10:25.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99145419499999998 2024-09-14T09:10:25.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:25.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790241+0000", 2024-09-14T09:10:25.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0587999999999998e-05 2024-09-14T09:10:25.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:25.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790296+0000", 2024-09-14T09:10:25.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4212000000000002e-05 2024-09-14T09:10:25.050 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.050 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:25.050 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.050 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:233 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 2654208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:25.050 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:10:25.051 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 113.227793015, 2024-09-14T09:10:25.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99337220100000001, 2024-09-14T09:10:25.051 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:25.051 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:25.051 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:25.051 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:25.051 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:25.051 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:25.051 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 233 2024-09-14T09:10:25.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.051 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:25.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:25.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:10:25.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:25.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:10:25.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:25.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797015+0000", 2024-09-14T09:10:25.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:10:25.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:25.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797016+0000", 2024-09-14T09:10:25.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.269e-06 2024-09-14T09:10:25.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:25.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797019+0000", 2024-09-14T09:10:25.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9519999999999999e-06 2024-09-14T09:10:25.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797022+0000", 2024-09-14T09:10:25.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6079999999999998e-06 2024-09-14T09:10:25.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798759+0000", 2024-09-14T09:10:25.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001737342 2024-09-14T09:10:25.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798762+0000", 2024-09-14T09:10:25.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.88e-06 2024-09-14T09:10:25.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790310+0000", 2024-09-14T09:10:25.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99154738799999997 2024-09-14T09:10:25.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:25.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790349+0000", 2024-09-14T09:10:25.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9573000000000002e-05 2024-09-14T09:10:25.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:25.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790387+0000", 2024-09-14T09:10:25.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7985999999999998e-05 2024-09-14T09:10:25.055 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.055 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:25.055 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.055 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:234 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3112960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:25.056 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:10:25.056 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 113.22778297000001, 2024-09-14T09:10:25.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99345674500000003, 2024-09-14T09:10:25.056 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:25.056 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:25.056 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:25.056 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:25.056 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:25.056 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:25.056 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 234 2024-09-14T09:10:25.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.056 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:25.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:25.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:10:25.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:25.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:10:25.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:25.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797025+0000", 2024-09-14T09:10:25.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0100000000000001e-07 2024-09-14T09:10:25.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:25.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797026+0000", 2024-09-14T09:10:25.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0699999999999999e-06 2024-09-14T09:10:25.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:25.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797029+0000", 2024-09-14T09:10:25.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.886e-06 2024-09-14T09:10:25.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797032+0000", 2024-09-14T09:10:25.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7149999999999998e-06 2024-09-14T09:10:25.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798778+0000", 2024-09-14T09:10:25.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017460329999999999 2024-09-14T09:10:25.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798783+0000", 2024-09-14T09:10:25.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0760000000000002e-06 2024-09-14T09:10:25.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790408+0000", 2024-09-14T09:10:25.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99162473299999998 2024-09-14T09:10:25.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:25.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790446+0000", 2024-09-14T09:10:25.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8389000000000001e-05 2024-09-14T09:10:25.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:25.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790482+0000", 2024-09-14T09:10:25.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5642000000000002e-05 2024-09-14T09:10:25.060 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.060 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:25.060 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.060 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:235 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 3571712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:25.060 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:10:25.061 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 113.22777307200001, 2024-09-14T09:10:25.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993539477, 2024-09-14T09:10:25.061 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:25.061 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:25.061 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:25.061 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:25.061 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:25.061 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:25.061 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 235 2024-09-14T09:10:25.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.061 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:25.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:25.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:10:25.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:25.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:10:25.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:25.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797035+0000", 2024-09-14T09:10:25.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9999999999999999e-07 2024-09-14T09:10:25.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:25.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797036+0000", 2024-09-14T09:10:25.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.051e-06 2024-09-14T09:10:25.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:25.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797039+0000", 2024-09-14T09:10:25.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:10:25.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797042+0000", 2024-09-14T09:10:25.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5280000000000002e-06 2024-09-14T09:10:25.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798809+0000", 2024-09-14T09:10:25.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001767394 2024-09-14T09:10:25.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798815+0000", 2024-09-14T09:10:25.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0859999999999998e-06 2024-09-14T09:10:25.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790502+0000", 2024-09-14T09:10:25.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99168652300000004 2024-09-14T09:10:25.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:25.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790539+0000", 2024-09-14T09:10:25.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7471000000000001e-05 2024-09-14T09:10:25.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:25.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790574+0000", 2024-09-14T09:10:25.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5292e-05 2024-09-14T09:10:25.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.065 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:25.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.066 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:236 3.17 3:ef96c44b:::rbd_data.1112cb42b44.0000000000000002:16 [read 4030464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:25.066 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:10:25.066 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 113.22776283899999, 2024-09-14T09:10:25.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.993619743, 2024-09-14T09:10:25.066 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:25.066 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:25.066 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:25.066 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:25.066 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:25.066 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:25.066 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 236 2024-09-14T09:10:25.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.066 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:25.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:25.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:10:25.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:25.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:10:25.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:25.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797045+0000", 2024-09-14T09:10:25.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1400000000000001e-07 2024-09-14T09:10:25.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:25.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797047+0000", 2024-09-14T09:10:25.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3400000000000001e-06 2024-09-14T09:10:25.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:25.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797050+0000", 2024-09-14T09:10:25.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0699999999999998e-06 2024-09-14T09:10:25.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.797053+0000", 2024-09-14T09:10:25.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7310000000000002e-06 2024-09-14T09:10:25.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798839+0000", 2024-09-14T09:10:25.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001786403 2024-09-14T09:10:25.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.798844+0000", 2024-09-14T09:10:25.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3730000000000001e-06 2024-09-14T09:10:25.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790592+0000", 2024-09-14T09:10:25.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99174818099999995 2024-09-14T09:10:25.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:25.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790628+0000", 2024-09-14T09:10:25.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5831000000000003e-05 2024-09-14T09:10:25.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:25.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790665+0000", 2024-09-14T09:10:25.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-05 2024-09-14T09:10:25.070 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.070 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:25.070 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.071 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:365 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:25.071 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:10:25.071 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 113.225575811, 2024-09-14T09:10:25.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99157278400000004, 2024-09-14T09:10:25.071 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:25.071 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:25.071 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:25.071 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:25.071 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:25.071 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:25.071 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 365 2024-09-14T09:10:25.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.071 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:25.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:25.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:10:25.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:25.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:10:25.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:25.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799232+0000", 2024-09-14T09:10:25.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.03e-07 2024-09-14T09:10:25.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:25.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799233+0000", 2024-09-14T09:10:25.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.057e-06 2024-09-14T09:10:25.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:25.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799236+0000", 2024-09-14T09:10:25.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0249999999999998e-06 2024-09-14T09:10:25.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799239+0000", 2024-09-14T09:10:25.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.481e-06 2024-09-14T09:10:25.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800963+0000", 2024-09-14T09:10:25.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017240440000000001 2024-09-14T09:10:25.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800969+0000", 2024-09-14T09:10:25.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1410000000000002e-06 2024-09-14T09:10:25.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790682+0000", 2024-09-14T09:10:25.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98971330300000004 2024-09-14T09:10:25.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:25.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790753+0000", 2024-09-14T09:10:25.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0548000000000003e-05 2024-09-14T09:10:25.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:25.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790805+0000", 2024-09-14T09:10:25.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1981999999999998e-05 2024-09-14T09:10:25.075 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.076 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:25.076 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.076 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:366 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:25.076 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:10:25.076 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 113.225565718, 2024-09-14T09:10:25.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99173757299999998, 2024-09-14T09:10:25.076 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:25.076 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:25.076 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:25.076 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:25.076 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:25.076 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:25.077 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 366 2024-09-14T09:10:25.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.077 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:25.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:25.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:10:25.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:25.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:10:25.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:25.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799242+0000", 2024-09-14T09:10:25.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0200000000000001e-07 2024-09-14T09:10:25.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:25.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799244+0000", 2024-09-14T09:10:25.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.359e-06 2024-09-14T09:10:25.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:25.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799247+0000", 2024-09-14T09:10:25.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4929999999999998e-06 2024-09-14T09:10:25.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799250+0000", 2024-09-14T09:10:25.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5459999999999998e-06 2024-09-14T09:10:25.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800991+0000", 2024-09-14T09:10:25.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017412809999999999 2024-09-14T09:10:25.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.800997+0000", 2024-09-14T09:10:25.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:10:25.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790824+0000", 2024-09-14T09:10:25.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98982735399999999 2024-09-14T09:10:25.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:25.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790891+0000", 2024-09-14T09:10:25.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7243999999999995e-05 2024-09-14T09:10:25.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:25.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.790980+0000", 2024-09-14T09:10:25.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8608000000000003e-05 2024-09-14T09:10:25.081 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.081 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:25.081 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.081 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:367 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1081344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:25.081 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:10:25.081 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 113.225554346, 2024-09-14T09:10:25.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99188259999999995, 2024-09-14T09:10:25.081 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:25.082 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:25.082 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:25.082 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:25.082 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:25.082 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:25.082 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 367 2024-09-14T09:10:25.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.082 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:25.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:25.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:10:25.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:25.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:10:25.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:25.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799254+0000", 2024-09-14T09:10:25.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-07 2024-09-14T09:10:25.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:25.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799255+0000", 2024-09-14T09:10:25.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.111e-06 2024-09-14T09:10:25.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:25.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799259+0000", 2024-09-14T09:10:25.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8650000000000003e-06 2024-09-14T09:10:25.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799262+0000", 2024-09-14T09:10:25.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.128e-06 2024-09-14T09:10:25.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801029+0000", 2024-09-14T09:10:25.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017668460000000001 2024-09-14T09:10:25.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801032+0000", 2024-09-14T09:10:25.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3179999999999998e-06 2024-09-14T09:10:25.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791011+0000", 2024-09-14T09:10:25.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98997920399999995 2024-09-14T09:10:25.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:25.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791077+0000", 2024-09-14T09:10:25.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5214000000000003e-05 2024-09-14T09:10:25.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:25.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791136+0000", 2024-09-14T09:10:25.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9710000000000003e-05 2024-09-14T09:10:25.086 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.086 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:25.086 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.086 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:368 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:25.086 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:10:25.087 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 113.225542803, 2024-09-14T09:10:25.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99201753800000003, 2024-09-14T09:10:25.087 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:25.087 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:25.087 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:25.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:25.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:25.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:25.087 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 368 2024-09-14T09:10:25.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.087 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:25.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:25.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:10:25.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:25.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:10:25.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:25.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799265+0000", 2024-09-14T09:10:25.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4900000000000002e-07 2024-09-14T09:10:25.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:25.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799267+0000", 2024-09-14T09:10:25.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.079e-06 2024-09-14T09:10:25.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:25.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799270+0000", 2024-09-14T09:10:25.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.993e-06 2024-09-14T09:10:25.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799272+0000", 2024-09-14T09:10:25.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.695e-06 2024-09-14T09:10:25.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801043+0000", 2024-09-14T09:10:25.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001771105 2024-09-14T09:10:25.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801046+0000", 2024-09-14T09:10:25.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7999999999999999e-06 2024-09-14T09:10:25.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791150+0000", 2024-09-14T09:10:25.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99010348699999995 2024-09-14T09:10:25.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:25.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791193+0000", 2024-09-14T09:10:25.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3615999999999997e-05 2024-09-14T09:10:25.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:25.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791283+0000", 2024-09-14T09:10:25.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9513999999999997e-05 2024-09-14T09:10:25.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.091 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:25.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.091 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:369 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 1998848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:25.092 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:10:25.092 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 113.225532465, 2024-09-14T09:10:25.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99213433600000001, 2024-09-14T09:10:25.092 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:25.092 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:25.092 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:25.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:25.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:25.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:25.092 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 369 2024-09-14T09:10:25.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.092 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:25.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:25.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:10:25.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:25.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:10:25.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:25.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799276+0000", 2024-09-14T09:10:25.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2024-09-14T09:10:25.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:25.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799277+0000", 2024-09-14T09:10:25.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.108e-06 2024-09-14T09:10:25.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:25.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799280+0000", 2024-09-14T09:10:25.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2024-09-14T09:10:25.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799283+0000", 2024-09-14T09:10:25.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.531e-06 2024-09-14T09:10:25.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801058+0000", 2024-09-14T09:10:25.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001775085 2024-09-14T09:10:25.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801060+0000", 2024-09-14T09:10:25.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8260000000000001e-06 2024-09-14T09:10:25.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791299+0000", 2024-09-14T09:10:25.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99023856799999999 2024-09-14T09:10:25.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:25.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791352+0000", 2024-09-14T09:10:25.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2528000000000003e-05 2024-09-14T09:10:25.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:25.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791410+0000", 2024-09-14T09:10:25.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8298000000000003e-05 2024-09-14T09:10:25.096 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.096 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:25.096 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.096 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:370 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2457600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:25.096 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:10:25.097 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 113.225507698, 2024-09-14T09:10:25.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99220795399999995, 2024-09-14T09:10:25.097 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:25.097 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:25.097 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:25.097 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:25.097 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:25.097 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:25.097 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 370 2024-09-14T09:10:25.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.097 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:25.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:25.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:10:25.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:25.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799300+0000", 2024-09-14T09:10:25.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:25.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799301+0000", 2024-09-14T09:10:25.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2024-09-14T09:10:25.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:25.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799303+0000", 2024-09-14T09:10:25.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9319999999999999e-06 2024-09-14T09:10:25.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:25.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799310+0000", 2024-09-14T09:10:25.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8680000000000001e-06 2024-09-14T09:10:25.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799315+0000", 2024-09-14T09:10:25.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.921e-06 2024-09-14T09:10:25.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801071+0000", 2024-09-14T09:10:25.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001756678 2024-09-14T09:10:25.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801080+0000", 2024-09-14T09:10:25.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6060000000000003e-06 2024-09-14T09:10:25.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791429+0000", 2024-09-14T09:10:25.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99034944599999997 2024-09-14T09:10:25.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:25.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791471+0000", 2024-09-14T09:10:25.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1279999999999998e-05 2024-09-14T09:10:25.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:25.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791508+0000", 2024-09-14T09:10:25.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7663999999999997e-05 2024-09-14T09:10:25.101 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.101 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:25.101 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.102 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:371 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 2916352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:25.102 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:10:25.102 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 113.225486526, 2024-09-14T09:10:25.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99228692299999999, 2024-09-14T09:10:25.102 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:25.102 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:25.102 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:25.102 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:25.102 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:25.102 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:25.102 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 371 2024-09-14T09:10:25.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.102 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:25.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:25.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:10:25.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:25.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799321+0000", 2024-09-14T09:10:25.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:25.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799322+0000", 2024-09-14T09:10:25.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2024-09-14T09:10:25.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:25.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799333+0000", 2024-09-14T09:10:25.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1044e-05 2024-09-14T09:10:25.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:25.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799341+0000", 2024-09-14T09:10:25.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8439999999999998e-06 2024-09-14T09:10:25.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799354+0000", 2024-09-14T09:10:25.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3114e-05 2024-09-14T09:10:25.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801093+0000", 2024-09-14T09:10:25.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017385910000000001 2024-09-14T09:10:25.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801096+0000", 2024-09-14T09:10:25.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0680000000000001e-06 2024-09-14T09:10:25.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791528+0000", 2024-09-14T09:10:25.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99043264200000003 2024-09-14T09:10:25.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:25.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791570+0000", 2024-09-14T09:10:25.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2144999999999997e-05 2024-09-14T09:10:25.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:25.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791608+0000", 2024-09-14T09:10:25.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7966000000000002e-05 2024-09-14T09:10:25.106 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.106 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:25.106 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.106 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:372 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3375104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:25.106 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:10:25.106 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 113.225445978, 2024-09-14T09:10:25.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992342897, 2024-09-14T09:10:25.107 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:25.107 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:25.107 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:25.107 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:25.107 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:25.107 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:25.107 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 372 2024-09-14T09:10:25.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.107 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:25.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:25.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:10:25.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:25.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799362+0000", 2024-09-14T09:10:25.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:25.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799363+0000", 2024-09-14T09:10:25.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2024-09-14T09:10:25.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:25.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799365+0000", 2024-09-14T09:10:25.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5500000000000001e-06 2024-09-14T09:10:25.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:25.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799371+0000", 2024-09-14T09:10:25.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2500000000000003e-06 2024-09-14T09:10:25.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799377+0000", 2024-09-14T09:10:25.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7509999999999997e-06 2024-09-14T09:10:25.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801107+0000", 2024-09-14T09:10:25.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017298019999999999 2024-09-14T09:10:25.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801111+0000", 2024-09-14T09:10:25.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8619999999999996e-06 2024-09-14T09:10:25.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791626+0000", 2024-09-14T09:10:25.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99051563300000001 2024-09-14T09:10:25.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:25.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791668+0000", 2024-09-14T09:10:25.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1424000000000002e-05 2024-09-14T09:10:25.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:25.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791705+0000", 2024-09-14T09:10:25.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7035e-05 2024-09-14T09:10:25.111 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.111 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:25.111 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.111 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5023.0:373 3.17 3:eb9765a4:::rbd_data.1112cb42b44.0000000000000020:16 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-09-14T09:10:25.111 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:10:25.111 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 113.225424033, 2024-09-14T09:10:25.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99253589399999997, 2024-09-14T09:10:25.111 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:25.111 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:25.111 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-09-14T09:10:25.111 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:25.111 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5023", 2024-09-14T09:10:25.112 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/2349000150", 2024-09-14T09:10:25.112 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 373 2024-09-14T09:10:25.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.112 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:25.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:25.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:10:25.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:25.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:10:25.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:25.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799384+0000", 2024-09-14T09:10:25.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2024-09-14T09:10:25.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:25.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799387+0000", 2024-09-14T09:10:25.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1019999999999999e-06 2024-09-14T09:10:25.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:25.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799393+0000", 2024-09-14T09:10:25.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0190000000000003e-06 2024-09-14T09:10:25.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.799398+0000", 2024-09-14T09:10:25.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3070000000000002e-06 2024-09-14T09:10:25.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801123+0000", 2024-09-14T09:10:25.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017251949999999999 2024-09-14T09:10:25.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:31.801126+0000", 2024-09-14T09:10:25.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9280000000000002e-06 2024-09-14T09:10:25.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791746+0000", 2024-09-14T09:10:25.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99062036899999995 2024-09-14T09:10:25.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-09-14T09:10:25.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791835+0000", 2024-09-14T09:10:25.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9004000000000004e-05 2024-09-14T09:10:25.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:25.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:08:32.791920+0000", 2024-09-14T09:10:25.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4524000000000006e-05 2024-09-14T09:10:25.116 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.116 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:25.116 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.116 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:60352 3.0 3.6d62a5c0 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:25.116 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:10:25.116 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.642788194999994, 2024-09-14T09:10:25.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41710537399999997, 2024-09-14T09:10:25.116 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:25.116 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:25.116 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:25.116 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:25.116 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:25.117 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:25.117 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 60352 2024-09-14T09:10:25.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.117 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:25.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:25.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:10:25.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:25.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382020+0000", 2024-09-14T09:10:25.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:25.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382044+0000", 2024-09-14T09:10:25.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4640000000000001e-05 2024-09-14T09:10:25.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:25.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382048+0000", 2024-09-14T09:10:25.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4690000000000002e-06 2024-09-14T09:10:25.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:25.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382053+0000", 2024-09-14T09:10:25.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2024-09-14T09:10:25.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382068+0000", 2024-09-14T09:10:25.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4399000000000001e-05 2024-09-14T09:10:25.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382121+0000", 2024-09-14T09:10:25.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3578000000000001e-05 2024-09-14T09:10:25.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.382127+0000", 2024-09-14T09:10:25.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2024-09-14T09:10:25.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799116+0000", 2024-09-14T09:10:25.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.416988566 2024-09-14T09:10:25.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:25.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799125+0000", 2024-09-14T09:10:25.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3100000000000006e-06 2024-09-14T09:10:25.120 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.120 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:25.120 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.120 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.5469.0:63559 3.0 3.95b285c0 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:25.120 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:10:25.121 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.636956822000002, 2024-09-14T09:10:25.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.411301215, 2024-09-14T09:10:25.121 INFO:teuthology.orchestra.run.smithi144.stdout: "continuous": false, 2024-09-14T09:10:25.121 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-09-14T09:10:25.121 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-09-14T09:10:25.121 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-09-14T09:10:25.121 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.5469", 2024-09-14T09:10:25.121 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:25.121 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 63559 2024-09-14T09:10:25.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.121 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-09-14T09:10:25.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-09-14T09:10:25.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:10:25.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-09-14T09:10:25.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:10:25.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-09-14T09:10:25.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-09-14T09:10:25.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387851+0000", 2024-09-14T09:10:25.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2499999999999999e-07 2024-09-14T09:10:25.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-09-14T09:10:25.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387853+0000", 2024-09-14T09:10:25.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.477e-06 2024-09-14T09:10:25.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-09-14T09:10:25.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387856+0000", 2024-09-14T09:10:25.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1429999999999998e-06 2024-09-14T09:10:25.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387859+0000", 2024-09-14T09:10:25.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.582e-06 2024-09-14T09:10:25.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387888+0000", 2024-09-14T09:10:25.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9609000000000001e-05 2024-09-14T09:10:25.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.387893+0000", 2024-09-14T09:10:25.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6779999999999999e-06 2024-09-14T09:10:25.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-09-14T09:10:25.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799143+0000", 2024-09-14T09:10:25.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41124997099999999 2024-09-14T09:10:25.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-14T09:10:25.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-14T09:10:25.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-09-14T09:10:25.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-09-14T09:09:16.799152+0000", 2024-09-14T09:10:25.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5300000000000002e-06 2024-09-14T09:10:25.125 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.125 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:25.125 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.125 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-14T09:10:25.125 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-14T09:10:25.125 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-14T09:10:25.127 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:10:25.127 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:25.129+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:25.227 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T09:10:25.229+0000 7f0dba356640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31867) UID: 0 2024-09-14T09:10:25.230 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:10:25.231 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:25.239 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:10:25.330 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:25.331+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:25.384 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:25.384 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:25.384 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:10:25.384 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:10:25.384 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:25.390 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:10:25.430 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:25.432+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:25.531 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-14T09:10:25.533+0000 7faa4d460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 31846) UID: 0 2024-09-14T09:10:25.535 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:25.535 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:10:25.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:10:25.535 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:10:25.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.535 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55979 3.e 3:740d1568:::rbd_data.1112a10502fe.0000000000000133:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:25.535 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:10:25.535 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 69.685752980999993, 2024-09-14T09:10:25.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.95211669700000001, 2024-09-14T09:10:25.536 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:25.536 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:25.536 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:10:25.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:25.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:25.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:25.536 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55979 2024-09-14T09:10:25.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.536 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:25.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:25.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:10:25.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:25.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850378+0000", 2024-09-14T09:10:25.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:25.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850380+0000", 2024-09-14T09:10:25.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.615e-06 2024-09-14T09:10:25.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:25.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850386+0000", 2024-09-14T09:10:25.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8000000000000001e-06 2024-09-14T09:10:25.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:25.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850403+0000", 2024-09-14T09:10:25.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6339999999999999e-05 2024-09-14T09:10:25.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850413+0000", 2024-09-14T09:10:25.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8609999999999993e-06 2024-09-14T09:10:25.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851033+0000", 2024-09-14T09:10:25.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062034700000000004 2024-09-14T09:10:25.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:10:25.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851042+0000", 2024-09-14T09:10:25.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8340000000000005e-06 2024-09-14T09:10:25.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853175+0000", 2024-09-14T09:10:25.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0021332809999999999 2024-09-14T09:10:25.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853183+0000", 2024-09-14T09:10:25.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:10:25.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795232+0000", 2024-09-14T09:10:25.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94204854900000001 2024-09-14T09:10:25.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:25.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795413+0000", 2024-09-14T09:10:25.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018059200000000001 2024-09-14T09:10:25.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:10:25.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795717+0000", 2024-09-14T09:10:25.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000304636 2024-09-14T09:10:25.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:10:25.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799631+0000", 2024-09-14T09:10:25.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039136910000000004 2024-09-14T09:10:25.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:10:25.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802290+0000", 2024-09-14T09:10:25.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026588010000000001 2024-09-14T09:10:25.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:10:25.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802362+0000", 2024-09-14T09:10:25.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2018000000000001e-05 2024-09-14T09:10:25.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:25.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802495+0000", 2024-09-14T09:10:25.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000132967 2024-09-14T09:10:25.542 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.542 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:25.542 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.543 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:55990 3.e 3:72d6260e:::rbd_data.1112a10502fe.000000000000016c:head [stat,delete] snapc 21=[21] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:25.543 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:10:25.543 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 69.685691673999997, 2024-09-14T09:10:25.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.952433164, 2024-09-14T09:10:25.543 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:25.543 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:25.543 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:25.543 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:25.543 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:25.543 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:25.543 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 55990 2024-09-14T09:10:25.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.544 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:25.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:25.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:10:25.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:25.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850439+0000", 2024-09-14T09:10:25.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:25.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850440+0000", 2024-09-14T09:10:25.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5199999999999996e-07 2024-09-14T09:10:25.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:25.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850444+0000", 2024-09-14T09:10:25.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.019e-06 2024-09-14T09:10:25.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:25.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850452+0000", 2024-09-14T09:10:25.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0209999999999999e-06 2024-09-14T09:10:25.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.850457+0000", 2024-09-14T09:10:25.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9529999999999998e-06 2024-09-14T09:10:25.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851100+0000", 2024-09-14T09:10:25.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00064299699999999997 2024-09-14T09:10:25.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-09-14T09:10:25.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.851108+0000", 2024-09-14T09:10:25.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2279999999999998e-06 2024-09-14T09:10:25.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853208+0000", 2024-09-14T09:10:25.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020996579999999999 2024-09-14T09:10:25.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:15.853213+0000", 2024-09-14T09:10:25.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4029999999999998e-06 2024-09-14T09:10:25.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796098+0000", 2024-09-14T09:10:25.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.94288483700000003 2024-09-14T09:10:25.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:25.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796247+0000", 2024-09-14T09:10:25.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014925800000000001 2024-09-14T09:10:25.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:25.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802872+0000", 2024-09-14T09:10:25.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006625138 2024-09-14T09:10:25.548 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.548 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:25.548 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.549 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:58987 3.5 3.ba1b5f65 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:25.549 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:10:25.549 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 69.521452901000004, 2024-09-14T09:10:25.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77465830800000002, 2024-09-14T09:10:25.549 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:25.549 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:25.549 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:25.549 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:25.549 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:25.549 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:25.549 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 58987 2024-09-14T09:10:25.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.550 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:25.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:25.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:10:25.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:25.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014678+0000", 2024-09-14T09:10:25.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:25.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014680+0000", 2024-09-14T09:10:25.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9250000000000002e-06 2024-09-14T09:10:25.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:25.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014689+0000", 2024-09-14T09:10:25.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9730000000000003e-06 2024-09-14T09:10:25.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:25.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014709+0000", 2024-09-14T09:10:25.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9641999999999999e-05 2024-09-14T09:10:25.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014720+0000", 2024-09-14T09:10:25.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1240000000000001e-05 2024-09-14T09:10:25.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014796+0000", 2024-09-14T09:10:25.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6567000000000001e-05 2024-09-14T09:10:25.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.014808+0000", 2024-09-14T09:10:25.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1435e-05 2024-09-14T09:10:25.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789325+0000", 2024-09-14T09:10:25.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77451705999999998 2024-09-14T09:10:25.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:25.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789336+0000", 2024-09-14T09:10:25.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1466e-05 2024-09-14T09:10:25.553 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.553 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:25.553 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.554 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:59017 3.3 3.6b81fb83 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:25.554 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:10:25.554 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 69.519800497000006, 2024-09-14T09:10:25.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77253447099999994, 2024-09-14T09:10:25.554 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:25.554 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:25.554 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:25.554 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:25.554 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:25.554 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:25.554 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 59017 2024-09-14T09:10:25.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.554 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:25.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:25.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:10:25.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:25.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016330+0000", 2024-09-14T09:10:25.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:25.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016332+0000", 2024-09-14T09:10:25.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3459999999999999e-06 2024-09-14T09:10:25.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:25.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016337+0000", 2024-09-14T09:10:25.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.48e-06 2024-09-14T09:10:25.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:25.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016355+0000", 2024-09-14T09:10:25.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7955e-05 2024-09-14T09:10:25.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016364+0000", 2024-09-14T09:10:25.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.02e-06 2024-09-14T09:10:25.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016433+0000", 2024-09-14T09:10:25.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8398000000000005e-05 2024-09-14T09:10:25.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.016442+0000", 2024-09-14T09:10:25.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1819999999999995e-06 2024-09-14T09:10:25.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788855+0000", 2024-09-14T09:10:25.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.77241356299999997 2024-09-14T09:10:25.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:25.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788865+0000", 2024-09-14T09:10:25.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5270000000000004e-06 2024-09-14T09:10:25.558 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.558 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:25.558 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.558 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60343 3.e 3:721b16e6:::rbd_data.1112a10502fe.000000000000014b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:25.558 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:10:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 69.415830894999999, 2024-09-14T09:10:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68876920900000005, 2024-09-14T09:10:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:10:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60343 2024-09-14T09:10:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:10:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120300+0000", 2024-09-14T09:10:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120302+0000", 2024-09-14T09:10:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0279999999999999e-06 2024-09-14T09:10:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120310+0000", 2024-09-14T09:10:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4330000000000004e-06 2024-09-14T09:10:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120333+0000", 2024-09-14T09:10:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2200000000000001e-05 2024-09-14T09:10:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120343+0000", 2024-09-14T09:10:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0560000000000001e-05 2024-09-14T09:10:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120414+0000", 2024-09-14T09:10:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0493000000000004e-05 2024-09-14T09:10:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.120424+0000", 2024-09-14T09:10:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.059e-05 2024-09-14T09:10:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796679+0000", 2024-09-14T09:10:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67625512700000001 2024-09-14T09:10:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796833+0000", 2024-09-14T09:10:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015403500000000001 2024-09-14T09:10:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 5", 2024-09-14T09:10:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797239+0000", 2024-09-14T09:10:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040503000000000002 2024-09-14T09:10:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:10:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.802918+0000", 2024-09-14T09:10:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056796199999999998 2024-09-14T09:10:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:10:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808655+0000", 2024-09-14T09:10:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057365089999999999 2024-09-14T09:10:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:10:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.808850+0000", 2024-09-14T09:10:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000194904 2024-09-14T09:10:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809069+0000", 2024-09-14T09:10:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021968000000000001 2024-09-14T09:10:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60356 3.2 3:40f9e9e7:::rbd_data.1112a10502fe.0000000000000160:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:10:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 69.414768382000005, 2024-09-14T09:10:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.68053790800000002, 2024-09-14T09:10:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:10:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60356 2024-09-14T09:10:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:10:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121363+0000", 2024-09-14T09:10:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121364+0000", 2024-09-14T09:10:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.173e-06 2024-09-14T09:10:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121371+0000", 2024-09-14T09:10:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-09-14T09:10:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121386+0000", 2024-09-14T09:10:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4925e-05 2024-09-14T09:10:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121395+0000", 2024-09-14T09:10:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8190000000000003e-06 2024-09-14T09:10:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121464+0000", 2024-09-14T09:10:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8149000000000001e-05 2024-09-14T09:10:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.121474+0000", 2024-09-14T09:10:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0927999999999999e-05 2024-09-14T09:10:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.795901+0000", 2024-09-14T09:10:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.67442645499999998 2024-09-14T09:10:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796068+0000", 2024-09-14T09:10:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016655700000000001 2024-09-14T09:10:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 3", 2024-09-14T09:10:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796354+0000", 2024-09-14T09:10:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00028646999999999999 2024-09-14T09:10:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:10:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.800348+0000", 2024-09-14T09:10:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039943119999999999 2024-09-14T09:10:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:10:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801690+0000", 2024-09-14T09:10:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0013415090000000001 2024-09-14T09:10:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:10:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801771+0000", 2024-09-14T09:10:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1678e-05 2024-09-14T09:10:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.801900+0000", 2024-09-14T09:10:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000128978 2024-09-14T09:10:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:62163 3.e 3:713ab431:::rbd_data.1112a10502fe.0000000000000198:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:10:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 69.324398174999999, 2024-09-14T09:10:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.597552682, 2024-09-14T09:10:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 62163 2024-09-14T09:10:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:10:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211733+0000", 2024-09-14T09:10:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211735+0000", 2024-09-14T09:10:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1110000000000002e-06 2024-09-14T09:10:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211744+0000", 2024-09-14T09:10:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0790000000000007e-06 2024-09-14T09:10:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211765+0000", 2024-09-14T09:10:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1114000000000001e-05 2024-09-14T09:10:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211775+0000", 2024-09-14T09:10:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0033e-05 2024-09-14T09:10:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211847+0000", 2024-09-14T09:10:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1503999999999998e-05 2024-09-14T09:10:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.211857+0000", 2024-09-14T09:10:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0378e-05 2024-09-14T09:10:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799140+0000", 2024-09-14T09:10:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.58728279100000003 2024-09-14T09:10:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.799289+0000", 2024-09-14T09:10:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000148966 2024-09-14T09:10:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.809285+0000", 2024-09-14T09:10:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0099967059999999993 2024-09-14T09:10:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63582 3.2 3:467f2009:::rbd_data.1112a10502fe.00000000000001a1:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:10:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 69.249205058000001, 2024-09-14T09:10:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51869012999999997, 2024-09-14T09:10:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63582 2024-09-14T09:10:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:10:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286926+0000", 2024-09-14T09:10:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286928+0000", 2024-09-14T09:10:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.812e-06 2024-09-14T09:10:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286936+0000", 2024-09-14T09:10:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2390000000000002e-06 2024-09-14T09:10:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286955+0000", 2024-09-14T09:10:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8853000000000001e-05 2024-09-14T09:10:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.286972+0000", 2024-09-14T09:10:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7365000000000001e-05 2024-09-14T09:10:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287052+0000", 2024-09-14T09:10:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9491000000000002e-05 2024-09-14T09:10:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287063+0000", 2024-09-14T09:10:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1620999999999999e-05 2024-09-14T09:10:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796696+0000", 2024-09-14T09:10:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50963256999999995 2024-09-14T09:10:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.796847+0000", 2024-09-14T09:10:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015126899999999999 2024-09-14T09:10:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.805616+0000", 2024-09-14T09:10:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087689099999999996 2024-09-14T09:10:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63586 3.3 3.d4e49b03 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:10:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 69.249120676999993, 2024-09-14T09:10:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50188935099999998, 2024-09-14T09:10:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-09-14T09:10:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63586 2024-09-14T09:10:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:10:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287010+0000", 2024-09-14T09:10:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287011+0000", 2024-09-14T09:10:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.61e-07 2024-09-14T09:10:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287014+0000", 2024-09-14T09:10:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3900000000000002e-06 2024-09-14T09:10:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287023+0000", 2024-09-14T09:10:25.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3380000000000005e-06 2024-09-14T09:10:25.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287029+0000", 2024-09-14T09:10:25.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0079999999999999e-06 2024-09-14T09:10:25.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287087+0000", 2024-09-14T09:10:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8322000000000002e-05 2024-09-14T09:10:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.287096+0000", 2024-09-14T09:10:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8580000000000006e-06 2024-09-14T09:10:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788891+0000", 2024-09-14T09:10:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50179498499999997 2024-09-14T09:10:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788900+0000", 2024-09-14T09:10:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.789e-06 2024-09-14T09:10:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:60363 3.1d 3:b8b44067:::rbd_data.1112a10502fe.000000000000018b:head [stat,delete] snapc 21=[21] RETRY=12 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:10:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.748398938999998, 2024-09-14T09:10:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268612690000001, 2024-09-14T09:10:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 60363 2024-09-14T09:10:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:10:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787732+0000", 2024-09-14T09:10:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787733+0000", 2024-09-14T09:10:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.314e-06 2024-09-14T09:10:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787739+0000", 2024-09-14T09:10:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5300000000000004e-06 2024-09-14T09:10:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787750+0000", 2024-09-14T09:10:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1251e-05 2024-09-14T09:10:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787758+0000", 2024-09-14T09:10:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0739999999999993e-06 2024-09-14T09:10:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787827+0000", 2024-09-14T09:10:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8861000000000004e-05 2024-09-14T09:10:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-09-14T09:10:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787836+0000", 2024-09-14T09:10:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1339999999999993e-06 2024-09-14T09:10:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789335+0000", 2024-09-14T09:10:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014988289999999999 2024-09-14T09:10:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789343+0000", 2024-09-14T09:10:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6639999999999998e-06 2024-09-14T09:10:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799170+0000", 2024-09-14T09:10:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0098272500000001 2024-09-14T09:10:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.799377+0000", 2024-09-14T09:10:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000207126 2024-09-14T09:10:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814593+0000", 2024-09-14T09:10:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015216235999999999 2024-09-14T09:10:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:63565 3.1d 3:bdc63b28:::rbd_data.1112a10502fe.000000000000016d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,delete] snapc 21=[21] RETRY=9 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:10:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.748353148000007, 2024-09-14T09:10:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0271114539999999, 2024-09-14T09:10:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T09:10:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 63565 2024-09-14T09:10:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:10:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:10:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787778+0000", 2024-09-14T09:10:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6899999999999998e-07 2024-09-14T09:10:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787781+0000", 2024-09-14T09:10:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8909999999999999e-06 2024-09-14T09:10:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787787+0000", 2024-09-14T09:10:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3230000000000003e-06 2024-09-14T09:10:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.787793+0000", 2024-09-14T09:10:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-09-14T09:10:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789455+0000", 2024-09-14T09:10:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001661596 2024-09-14T09:10:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789463+0000", 2024-09-14T09:10:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4889999999999995e-06 2024-09-14T09:10:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800115+0000", 2024-09-14T09:10:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0106512670000001 2024-09-14T09:10:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800334+0000", 2024-09-14T09:10:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000219213 2024-09-14T09:10:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 1", 2024-09-14T09:10:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.800651+0000", 2024-09-14T09:10:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00031765500000000002 2024-09-14T09:10:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-09-14T09:10:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.811875+0000", 2024-09-14T09:10:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011224032 2024-09-14T09:10:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-09-14T09:10:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814665+0000", 2024-09-14T09:10:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002789606 2024-09-14T09:10:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-09-14T09:10:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814742+0000", 2024-09-14T09:10:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6916999999999996e-05 2024-09-14T09:10:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.814889+0000", 2024-09-14T09:10:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014725799999999999 2024-09-14T09:10:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:67113 3.1d 3:bba7fe0d:::rbd_data.1112a10502fe.00000000000001bf:head [stat,delete] snapc 21=[21] RETRY=4 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:10:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.74759229, 2024-09-14T09:10:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0265995649999999, 2024-09-14T09:10:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 67113 2024-09-14T09:10:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:10:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:10:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788539+0000", 2024-09-14T09:10:25.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6499999999999998e-07 2024-09-14T09:10:25.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:25.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788543+0000", 2024-09-14T09:10:25.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-09-14T09:10:25.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:25.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788552+0000", 2024-09-14T09:10:25.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9809999999999992e-06 2024-09-14T09:10:25.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788559+0000", 2024-09-14T09:10:25.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7190000000000004e-06 2024-09-14T09:10:25.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789489+0000", 2024-09-14T09:10:25.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00092982199999999996 2024-09-14T09:10:25.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789497+0000", 2024-09-14T09:10:25.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6299999999999998e-06 2024-09-14T09:10:25.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801068+0000", 2024-09-14T09:10:25.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0115709530000001 2024-09-14T09:10:25.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:25.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801240+0000", 2024-09-14T09:10:25.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017276600000000001 2024-09-14T09:10:25.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:25.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815138+0000", 2024-09-14T09:10:25.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013897856 2024-09-14T09:10:25.607 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.607 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:25.607 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.607 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:73412 3.1d 3:be4606c3:::rbd_data.1112a10502fe.00000000000001f2:head [stat,delete] snapc 21=[21] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:25.607 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:10:25.607 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.747561177999998, 2024-09-14T09:10:25.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026815928, 2024-09-14T09:10:25.607 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:25.607 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:25.607 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:25.607 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:25.607 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:25.608 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:25.608 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 73412 2024-09-14T09:10:25.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.608 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:25.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:25.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:10:25.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:25.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:10:25.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:25.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788570+0000", 2024-09-14T09:10:25.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5699999999999998e-07 2024-09-14T09:10:25.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:25.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788572+0000", 2024-09-14T09:10:25.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2809999999999998e-06 2024-09-14T09:10:25.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:25.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788579+0000", 2024-09-14T09:10:25.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5629999999999997e-06 2024-09-14T09:10:25.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.788584+0000", 2024-09-14T09:10:25.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1710000000000001e-06 2024-09-14T09:10:25.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789521+0000", 2024-09-14T09:10:25.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00093657400000000002 2024-09-14T09:10:25.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.789528+0000", 2024-09-14T09:10:25.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5719999999999997e-06 2024-09-14T09:10:25.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801631+0000", 2024-09-14T09:10:25.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0121023229999999 2024-09-14T09:10:25.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:25.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.801792+0000", 2024-09-14T09:10:25.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016174000000000001 2024-09-14T09:10:25.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:25.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815386+0000", 2024-09-14T09:10:25.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013593246999999999 2024-09-14T09:10:25.612 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.612 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:25.612 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.612 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:77244 3.1d 3:b801be19:::rbd_data.1112a10502fe.0000000000000204:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:25.612 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:10:25.612 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.565696931999994, 2024-09-14T09:10:25.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.84519277100000001, 2024-09-14T09:10:25.612 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:25.613 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:25.613 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:25.613 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:25.613 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:25.613 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:25.613 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 77244 2024-09-14T09:10:25.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.613 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:25.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:25.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:10:25.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:25.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970434+0000", 2024-09-14T09:10:25.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:25.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970436+0000", 2024-09-14T09:10:25.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.511e-06 2024-09-14T09:10:25.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:25.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970441+0000", 2024-09-14T09:10:25.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0470000000000001e-06 2024-09-14T09:10:25.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:25.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970453+0000", 2024-09-14T09:10:25.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2629999999999999e-05 2024-09-14T09:10:25.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970461+0000", 2024-09-14T09:10:25.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6850000000000001e-06 2024-09-14T09:10:25.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970524+0000", 2024-09-14T09:10:25.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3332999999999998e-05 2024-09-14T09:10:25.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.970544+0000", 2024-09-14T09:10:25.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9731000000000001e-05 2024-09-14T09:10:25.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802188+0000", 2024-09-14T09:10:25.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.83164380000000004 2024-09-14T09:10:25.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:25.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802342+0000", 2024-09-14T09:10:25.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015411999999999999 2024-09-14T09:10:25.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:25.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815627+0000", 2024-09-14T09:10:25.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013284914 2024-09-14T09:10:25.617 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.617 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:25.617 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.617 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:79796 3.1d 3:bc22caaf:::rbd_data.1112a10502fe.000000000000020c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:25.617 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:10:25.618 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.444388246000003, 2024-09-14T09:10:25.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.72411694299999996, 2024-09-14T09:10:25.618 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:25.618 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:25.618 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:25.618 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:25.618 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:25.618 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:25.618 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 79796 2024-09-14T09:10:25.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.618 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:25.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:25.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:10:25.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:25.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091743+0000", 2024-09-14T09:10:25.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:25.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091745+0000", 2024-09-14T09:10:25.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2000000000000001e-06 2024-09-14T09:10:25.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:25.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091752+0000", 2024-09-14T09:10:25.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4800000000000004e-06 2024-09-14T09:10:25.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:25.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091772+0000", 2024-09-14T09:10:25.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9822000000000001e-05 2024-09-14T09:10:25.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091791+0000", 2024-09-14T09:10:25.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9236e-05 2024-09-14T09:10:25.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091882+0000", 2024-09-14T09:10:25.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0783000000000001e-05 2024-09-14T09:10:25.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.091892+0000", 2024-09-14T09:10:25.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7999999999999993e-06 2024-09-14T09:10:25.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802744+0000", 2024-09-14T09:10:25.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.710851868 2024-09-14T09:10:25.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:25.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.802902+0000", 2024-09-14T09:10:25.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015814900000000001 2024-09-14T09:10:25.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:25.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.815860+0000", 2024-09-14T09:10:25.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012957605000000001 2024-09-14T09:10:25.623 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.623 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:25.623 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.623 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80904 3.1d 3:be0e7f3d:::rbd_data.1112a10502fe.0000000000000214:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:25.623 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:10:25.623 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.364302398999996, 2024-09-14T09:10:25.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64435178100000001, 2024-09-14T09:10:25.623 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:25.623 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:25.623 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:25.624 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:25.624 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:25.624 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:25.624 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80904 2024-09-14T09:10:25.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.624 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:25.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:25.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:10:25.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:25.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171829+0000", 2024-09-14T09:10:25.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:25.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171831+0000", 2024-09-14T09:10:25.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0729999999999999e-06 2024-09-14T09:10:25.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:25.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171839+0000", 2024-09-14T09:10:25.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9179999999999994e-06 2024-09-14T09:10:25.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:25.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171857+0000", 2024-09-14T09:10:25.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8957000000000002e-05 2024-09-14T09:10:25.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171867+0000", 2024-09-14T09:10:25.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7100000000000002e-06 2024-09-14T09:10:25.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171957+0000", 2024-09-14T09:10:25.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9932999999999994e-05 2024-09-14T09:10:25.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.171974+0000", 2024-09-14T09:10:25.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6988999999999999e-05 2024-09-14T09:10:25.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803301+0000", 2024-09-14T09:10:25.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63132648599999996 2024-09-14T09:10:25.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:25.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803482+0000", 2024-09-14T09:10:25.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000181607 2024-09-14T09:10:25.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:25.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816180+0000", 2024-09-14T09:10:25.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012698108 2024-09-14T09:10:25.628 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.628 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:25.628 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.628 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:80964 3.1d 3:be42e20f:::rbd_data.1112a10502fe.0000000000000219:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:25.628 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:10:25.628 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.358666831999997, 2024-09-14T09:10:25.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63896829799999999, 2024-09-14T09:10:25.629 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:25.629 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:25.629 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:25.629 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:25.629 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:25.629 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:25.629 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 80964 2024-09-14T09:10:25.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.629 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:25.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:25.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:10:25.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:25.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177464+0000", 2024-09-14T09:10:25.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:25.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177466+0000", 2024-09-14T09:10:25.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6610000000000001e-06 2024-09-14T09:10:25.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:25.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177472+0000", 2024-09-14T09:10:25.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3029999999999996e-06 2024-09-14T09:10:25.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:25.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177490+0000", 2024-09-14T09:10:25.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8099000000000001e-05 2024-09-14T09:10:25.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177499+0000", 2024-09-14T09:10:25.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3650000000000004e-06 2024-09-14T09:10:25.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177560+0000", 2024-09-14T09:10:25.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1334000000000006e-05 2024-09-14T09:10:25.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.177578+0000", 2024-09-14T09:10:25.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8434999999999999e-05 2024-09-14T09:10:25.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.803910+0000", 2024-09-14T09:10:25.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62633190699999997 2024-09-14T09:10:25.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:25.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.806612+0000", 2024-09-14T09:10:25.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002702257 2024-09-14T09:10:25.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:25.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816432+0000", 2024-09-14T09:10:25.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0098199370000000008 2024-09-14T09:10:25.633 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.633 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:25.633 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.633 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83321 3.1d 3:bb24b47b:::rbd_data.1112a10502fe.0000000000000223:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:25.633 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:10:25.634 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.244213157999994, 2024-09-14T09:10:25.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52477628799999998, 2024-09-14T09:10:25.634 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:25.634 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:25.634 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:25.634 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:25.634 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:25.634 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:25.634 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83321 2024-09-14T09:10:25.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.634 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:25.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:25.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:10:25.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:25.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291918+0000", 2024-09-14T09:10:25.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:25.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291920+0000", 2024-09-14T09:10:25.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.888e-06 2024-09-14T09:10:25.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:25.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291926+0000", 2024-09-14T09:10:25.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6059999999999999e-06 2024-09-14T09:10:25.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:25.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291943+0000", 2024-09-14T09:10:25.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6813e-05 2024-09-14T09:10:25.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.291952+0000", 2024-09-14T09:10:25.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7439999999999996e-06 2024-09-14T09:10:25.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292023+0000", 2024-09-14T09:10:25.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1320000000000002e-05 2024-09-14T09:10:25.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.292030+0000", 2024-09-14T09:10:25.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4219999999999997e-06 2024-09-14T09:10:25.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807221+0000", 2024-09-14T09:10:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51519140699999999 2024-09-14T09:10:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.807406+0000", 2024-09-14T09:10:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018532800000000001 2024-09-14T09:10:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:25.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.816694+0000", 2024-09-14T09:10:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092877600000000008 2024-09-14T09:10:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83358 3.1d 3:bb230e23:::rbd_data.1112a10502fe.000000000000022b:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:10:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.242693267999996, 2024-09-14T09:10:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52374808900000003, 2024-09-14T09:10:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:25.639 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83358 2024-09-14T09:10:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:10:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293438+0000", 2024-09-14T09:10:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293439+0000", 2024-09-14T09:10:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5899999999999995e-07 2024-09-14T09:10:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293443+0000", 2024-09-14T09:10:25.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9309999999999999e-06 2024-09-14T09:10:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293457+0000", 2024-09-14T09:10:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3944999999999999e-05 2024-09-14T09:10:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293466+0000", 2024-09-14T09:10:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4319999999999999e-06 2024-09-14T09:10:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293530+0000", 2024-09-14T09:10:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3860000000000002e-05 2024-09-14T09:10:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293540+0000", 2024-09-14T09:10:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0107e-05 2024-09-14T09:10:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809096+0000", 2024-09-14T09:10:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51555587800000002 2024-09-14T09:10:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809265+0000", 2024-09-14T09:10:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000169092 2024-09-14T09:10:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817186+0000", 2024-09-14T09:10:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079209850000000002 2024-09-14T09:10:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.645 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5469.0:83361 3.1d 3:bd571564:::rbd_data.1112a10502fe.000000000000022c:head [stat,delete] snapc 21=[21] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-14T09:10:25.645 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:10:25.645 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.242375191999997, 2024-09-14T09:10:25.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52373873100000001, 2024-09-14T09:10:25.645 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:25.645 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:25.645 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:25.645 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:25.645 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5469", 2024-09-14T09:10:25.645 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/472975583", 2024-09-14T09:10:25.645 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 83361 2024-09-14T09:10:25.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.645 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:25.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:25.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:10:25.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:25.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293756+0000", 2024-09-14T09:10:25.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:25.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:25.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293757+0000", 2024-09-14T09:10:25.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8000000000000004e-07 2024-09-14T09:10:25.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:25.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293762+0000", 2024-09-14T09:10:25.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8019999999999997e-06 2024-09-14T09:10:25.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:25.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293775+0000", 2024-09-14T09:10:25.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2884000000000001e-05 2024-09-14T09:10:25.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:25.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293783+0000", 2024-09-14T09:10:25.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8499999999999994e-06 2024-09-14T09:10:25.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293849+0000", 2024-09-14T09:10:25.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5859999999999996e-05 2024-09-14T09:10:25.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-09-14T09:10:25.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.293861+0000", 2024-09-14T09:10:25.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2238999999999999e-05 2024-09-14T09:10:25.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:25.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809680+0000", 2024-09-14T09:10:25.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51581856800000003 2024-09-14T09:10:25.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:25.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.809844+0000", 2024-09-14T09:10:25.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016441200000000001 2024-09-14T09:10:25.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:25.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:25.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:25.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:17.817494+0000", 2024-09-14T09:10:25.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076502360000000004 2024-09-14T09:10:25.649 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.649 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:25.649 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.649 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:25.649 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:25.650 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:25.651 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:25.653+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:25.651 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T09:10:25.752 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:25.754+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:25.794 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:25.794 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:25.794 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:10:25.794 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:25.807 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T09:10:25.812 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T09:10:25.853 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:25.855+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:25.952 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:25.952 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:25.952 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:10:25.953 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:10:25.953 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:25.953 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-09-14T09:10:25.955+0000 7f1dd98b4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31849) UID: 0 2024-09-14T09:10:25.962 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T09:10:26.055 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:26.057+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:26.070 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:26.070 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-09-14T09:10:26.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-09-14T09:10:26.070 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-09-14T09:10:26.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.070 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2265 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4034560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:26.070 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:10:26.070 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.20834597299999, 2024-09-14T09:10:26.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073974829000000006, 2024-09-14T09:10:26.070 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:26.071 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:26.071 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:26.071 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:26.071 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:26.071 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:26.071 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2265 2024-09-14T09:10:26.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.071 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:26.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:26.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:10:26.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:26.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862541+0000", 2024-09-14T09:10:26.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:26.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862542+0000", 2024-09-14T09:10:26.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-07 2024-09-14T09:10:26.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:26.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862543+0000", 2024-09-14T09:10:26.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.81e-06 2024-09-14T09:10:26.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:26.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862549+0000", 2024-09-14T09:10:26.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8850000000000004e-06 2024-09-14T09:10:26.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:26.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862554+0000", 2024-09-14T09:10:26.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5279999999999997e-06 2024-09-14T09:10:26.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:26.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936318+0000", 2024-09-14T09:10:26.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073764422999999996 2024-09-14T09:10:26.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:26.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936412+0000", 2024-09-14T09:10:26.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3801000000000005e-05 2024-09-14T09:10:26.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:26.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936516+0000", 2024-09-14T09:10:26.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000104007 2024-09-14T09:10:26.074 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.074 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:26.074 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.075 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2266 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4096000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:26.075 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:10:26.075 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.20832810900001, 2024-09-14T09:10:26.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074208332000000002, 2024-09-14T09:10:26.075 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:26.075 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:26.075 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:26.075 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:26.075 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:26.075 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:26.075 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2266 2024-09-14T09:10:26.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.075 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:26.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:26.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:10:26.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:26.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862559+0000", 2024-09-14T09:10:26.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:26.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862738+0000", 2024-09-14T09:10:26.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017920300000000001 2024-09-14T09:10:26.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:26.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862744+0000", 2024-09-14T09:10:26.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3000000000000001e-06 2024-09-14T09:10:26.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:26.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862753+0000", 2024-09-14T09:10:26.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8179999999999999e-06 2024-09-14T09:10:26.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:26.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862785+0000", 2024-09-14T09:10:26.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1949000000000002e-05 2024-09-14T09:10:26.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:26.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936556+0000", 2024-09-14T09:10:26.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073770268999999999 2024-09-14T09:10:26.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:26.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936657+0000", 2024-09-14T09:10:26.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101387 2024-09-14T09:10:26.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:26.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936767+0000", 2024-09-14T09:10:26.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110406 2024-09-14T09:10:26.079 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.079 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:26.079 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.079 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2267 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 4157440~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:26.079 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:10:26.079 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.208089527, 2024-09-14T09:10:26.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074200918000000005, 2024-09-14T09:10:26.079 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:26.079 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:26.079 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:26.079 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:26.080 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:26.080 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:26.080 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2267 2024-09-14T09:10:26.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.080 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:26.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:26.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:10:26.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:26.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.862798+0000", 2024-09-14T09:10:26.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:26.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863416+0000", 2024-09-14T09:10:26.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000618492 2024-09-14T09:10:26.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:26.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863421+0000", 2024-09-14T09:10:26.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1359999999999996e-06 2024-09-14T09:10:26.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:26.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863434+0000", 2024-09-14T09:10:26.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2291e-05 2024-09-14T09:10:26.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:26.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863444+0000", 2024-09-14T09:10:26.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9769999999999995e-06 2024-09-14T09:10:26.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:26.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936808+0000", 2024-09-14T09:10:26.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073364051999999999 2024-09-14T09:10:26.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:26.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936892+0000", 2024-09-14T09:10:26.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4641999999999994e-05 2024-09-14T09:10:26.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:26.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.936999+0000", 2024-09-14T09:10:26.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106328 2024-09-14T09:10:26.083 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.083 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:26.083 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.083 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2329 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 106496~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:26.084 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:10:26.084 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.20736091800001, 2024-09-14T09:10:26.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074180251000000003, 2024-09-14T09:10:26.084 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:26.084 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:26.084 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:26.084 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:26.084 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:26.084 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:26.084 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2329 2024-09-14T09:10:26.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.085 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:26.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:26.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:10:26.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:26.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.863526+0000", 2024-09-14T09:10:26.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:26.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864203+0000", 2024-09-14T09:10:26.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000677015 2024-09-14T09:10:26.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:26.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864208+0000", 2024-09-14T09:10:26.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.972e-06 2024-09-14T09:10:26.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:26.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864221+0000", 2024-09-14T09:10:26.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2683e-05 2024-09-14T09:10:26.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:26.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864229+0000", 2024-09-14T09:10:26.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0809999999999994e-06 2024-09-14T09:10:26.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:26.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937430+0000", 2024-09-14T09:10:26.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073201231000000005 2024-09-14T09:10:26.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:26.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937513+0000", 2024-09-14T09:10:26.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2652999999999996e-05 2024-09-14T09:10:26.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:26.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.937707+0000", 2024-09-14T09:10:26.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000193616 2024-09-14T09:10:26.088 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.088 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:26.088 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.088 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2331 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 229376~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:26.088 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:10:26.089 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.20654342100001, 2024-09-14T09:10:26.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.07400843, 2024-09-14T09:10:26.089 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:26.089 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:26.089 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:26.089 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:26.089 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:26.089 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:26.089 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2331 2024-09-14T09:10:26.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.089 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:26.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:26.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:10:26.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:26.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.864344+0000", 2024-09-14T09:10:26.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:26.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868104+0000", 2024-09-14T09:10:26.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003760453 2024-09-14T09:10:26.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:26.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868109+0000", 2024-09-14T09:10:26.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9339999999999997e-06 2024-09-14T09:10:26.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:26.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868119+0000", 2024-09-14T09:10:26.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5389999999999996e-06 2024-09-14T09:10:26.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:26.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.868126+0000", 2024-09-14T09:10:26.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4499999999999998e-06 2024-09-14T09:10:26.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:26.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938065+0000", 2024-09-14T09:10:26.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.069938809000000005 2024-09-14T09:10:26.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:26.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938148+0000", 2024-09-14T09:10:26.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3171999999999996e-05 2024-09-14T09:10:26.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:26.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.938352+0000", 2024-09-14T09:10:26.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020407300000000001 2024-09-14T09:10:26.093 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.093 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:26.093 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.093 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2380 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3239936~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:26.093 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:10:26.093 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.191518393, 2024-09-14T09:10:26.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073985913, 2024-09-14T09:10:26.094 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:26.094 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:26.094 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:26.094 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:26.094 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:26.094 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:26.094 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2380 2024-09-14T09:10:26.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.094 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:26.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:26.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:10:26.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:26.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879369+0000", 2024-09-14T09:10:26.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:26.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879697+0000", 2024-09-14T09:10:26.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032864100000000001 2024-09-14T09:10:26.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:26.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879702+0000", 2024-09-14T09:10:26.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.578e-06 2024-09-14T09:10:26.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:26.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879716+0000", 2024-09-14T09:10:26.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.413e-05 2024-09-14T09:10:26.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:26.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.879724+0000", 2024-09-14T09:10:26.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.559e-06 2024-09-14T09:10:26.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:26.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953155+0000", 2024-09-14T09:10:26.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073431221000000005 2024-09-14T09:10:26.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:26.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953247+0000", 2024-09-14T09:10:26.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1662000000000004e-05 2024-09-14T09:10:26.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:26.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.953355+0000", 2024-09-14T09:10:26.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010812200000000001 2024-09-14T09:10:26.097 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.097 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:26.097 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.098 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2501 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2850816~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:26.098 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:10:26.098 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.172976089, 2024-09-14T09:10:26.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074288858999999999, 2024-09-14T09:10:26.098 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:26.098 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:26.098 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:26.098 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:26.098 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:26.098 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:26.098 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2501 2024-09-14T09:10:26.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.098 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:26.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:26.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:10:26.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:26.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:10:26.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:26.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897911+0000", 2024-09-14T09:10:26.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.41e-07 2024-09-14T09:10:26.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:26.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897913+0000", 2024-09-14T09:10:26.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3090000000000001e-06 2024-09-14T09:10:26.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:26.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897918+0000", 2024-09-14T09:10:26.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8470000000000003e-06 2024-09-14T09:10:26.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:26.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897922+0000", 2024-09-14T09:10:26.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5549999999999996e-06 2024-09-14T09:10:26.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:26.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971872+0000", 2024-09-14T09:10:26.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.073950057999999999 2024-09-14T09:10:26.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:26.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.971958+0000", 2024-09-14T09:10:26.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5941999999999998e-05 2024-09-14T09:10:26.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:26.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972200+0000", 2024-09-14T09:10:26.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000241907 2024-09-14T09:10:26.102 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.102 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:26.102 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.102 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2502 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2912256~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:26.102 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:10:26.102 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.172936909, 2024-09-14T09:10:26.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074614080999999999, 2024-09-14T09:10:26.102 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:26.102 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:26.102 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:26.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:26.102 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:26.103 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:26.103 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2502 2024-09-14T09:10:26.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.103 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:26.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:26.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:10:26.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:26.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897950+0000", 2024-09-14T09:10:26.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:26.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897951+0000", 2024-09-14T09:10:26.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9900000000000001e-07 2024-09-14T09:10:26.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:26.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897953+0000", 2024-09-14T09:10:26.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5670000000000002e-06 2024-09-14T09:10:26.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:26.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897970+0000", 2024-09-14T09:10:26.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6319000000000001e-05 2024-09-14T09:10:26.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:26.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897976+0000", 2024-09-14T09:10:26.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8760000000000002e-06 2024-09-14T09:10:26.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:26.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972245+0000", 2024-09-14T09:10:26.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074269186000000001 2024-09-14T09:10:26.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:26.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972333+0000", 2024-09-14T09:10:26.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7800999999999995e-05 2024-09-14T09:10:26.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:26.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972564+0000", 2024-09-14T09:10:26.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000231833 2024-09-14T09:10:26.106 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.106 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:26.106 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.106 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2503 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 2973696~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:26.106 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:10:26.106 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.172902892, 2024-09-14T09:10:26.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074944286999999998, 2024-09-14T09:10:26.107 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:26.107 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:26.107 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:26.107 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:26.107 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:26.107 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:26.107 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2503 2024-09-14T09:10:26.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.107 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:26.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:26.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:10:26.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:26.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897984+0000", 2024-09-14T09:10:26.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:26.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897985+0000", 2024-09-14T09:10:26.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999998e-07 2024-09-14T09:10:26.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:26.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897987+0000", 2024-09-14T09:10:26.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.401e-06 2024-09-14T09:10:26.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:26.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.897999+0000", 2024-09-14T09:10:26.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1851999999999999e-05 2024-09-14T09:10:26.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:26.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898005+0000", 2024-09-14T09:10:26.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9789999999999998e-06 2024-09-14T09:10:26.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:26.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972609+0000", 2024-09-14T09:10:26.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074604217 2024-09-14T09:10:26.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:26.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972684+0000", 2024-09-14T09:10:26.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4777999999999995e-05 2024-09-14T09:10:26.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:26.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972929+0000", 2024-09-14T09:10:26.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024448100000000001 2024-09-14T09:10:26.110 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.110 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:26.110 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.111 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2504 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3035136~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:26.111 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:10:26.111 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.1728748, 2024-09-14T09:10:26.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075285131000000005, 2024-09-14T09:10:26.111 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:26.111 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:26.111 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:26.111 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:26.111 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:26.111 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:26.111 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2504 2024-09-14T09:10:26.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.111 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:26.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:26.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:10:26.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:26.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898012+0000", 2024-09-14T09:10:26.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:26.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898078+0000", 2024-09-14T09:10:26.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5775e-05 2024-09-14T09:10:26.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:26.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898082+0000", 2024-09-14T09:10:26.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.49e-06 2024-09-14T09:10:26.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:26.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898092+0000", 2024-09-14T09:10:26.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0509999999999999e-05 2024-09-14T09:10:26.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:26.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898099+0000", 2024-09-14T09:10:26.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.81e-06 2024-09-14T09:10:26.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:26.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.972971+0000", 2024-09-14T09:10:26.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074871788999999994 2024-09-14T09:10:26.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:26.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973055+0000", 2024-09-14T09:10:26.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3980000000000006e-05 2024-09-14T09:10:26.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:26.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973298+0000", 2024-09-14T09:10:26.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00024277700000000001 2024-09-14T09:10:26.114 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.115 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:26.115 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.115 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2505 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3096576~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:26.115 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:10:26.115 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.172778545, 2024-09-14T09:10:26.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075506668999999998, 2024-09-14T09:10:26.115 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:26.115 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:26.115 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:26.115 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:26.115 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:26.115 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:26.115 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2505 2024-09-14T09:10:26.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.116 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:26.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:26.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:10:26.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:26.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898109+0000", 2024-09-14T09:10:26.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:26.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898370+0000", 2024-09-14T09:10:26.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026128799999999998 2024-09-14T09:10:26.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:26.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898374+0000", 2024-09-14T09:10:26.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8070000000000001e-06 2024-09-14T09:10:26.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:26.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898383+0000", 2024-09-14T09:10:26.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0520000000000007e-06 2024-09-14T09:10:26.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:26.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898389+0000", 2024-09-14T09:10:26.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2639999999999997e-06 2024-09-14T09:10:26.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:26.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973330+0000", 2024-09-14T09:10:26.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074940548999999995 2024-09-14T09:10:26.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:26.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973402+0000", 2024-09-14T09:10:26.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2556000000000001e-05 2024-09-14T09:10:26.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:26.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973615+0000", 2024-09-14T09:10:26.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000213153 2024-09-14T09:10:26.119 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.119 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:26.119 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.119 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2506 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3158016~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:26.119 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:10:26.119 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.17248530099999, 2024-09-14T09:10:26.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075556110999999995, 2024-09-14T09:10:26.119 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:26.120 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:26.120 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:26.120 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:26.120 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:26.120 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:26.120 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2506 2024-09-14T09:10:26.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.120 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:26.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:26.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:10:26.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:26.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898402+0000", 2024-09-14T09:10:26.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:26.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898497+0000", 2024-09-14T09:10:26.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4806e-05 2024-09-14T09:10:26.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:26.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898500+0000", 2024-09-14T09:10:26.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.54e-06 2024-09-14T09:10:26.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:26.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898507+0000", 2024-09-14T09:10:26.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1590000000000004e-06 2024-09-14T09:10:26.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:26.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898513+0000", 2024-09-14T09:10:26.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.015e-06 2024-09-14T09:10:26.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:26.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973656+0000", 2024-09-14T09:10:26.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075142929999999997 2024-09-14T09:10:26.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:26.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973742+0000", 2024-09-14T09:10:26.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5535e-05 2024-09-14T09:10:26.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:26.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973958+0000", 2024-09-14T09:10:26.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000216126 2024-09-14T09:10:26.123 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.123 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:26.124 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.124 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2507 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3219456~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:26.124 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:10:26.124 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.172356717, 2024-09-14T09:10:26.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075623459000000004, 2024-09-14T09:10:26.124 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:26.124 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:26.124 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:26.124 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:26.124 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:26.124 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:26.125 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2507 2024-09-14T09:10:26.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.125 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:26.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:26.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:10:26.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:26.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898530+0000", 2024-09-14T09:10:26.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:26.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898761+0000", 2024-09-14T09:10:26.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000230614 2024-09-14T09:10:26.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:26.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898765+0000", 2024-09-14T09:10:26.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6629999999999999e-06 2024-09-14T09:10:26.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:26.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898774+0000", 2024-09-14T09:10:26.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6749999999999997e-06 2024-09-14T09:10:26.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898781+0000", 2024-09-14T09:10:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4640000000000003e-06 2024-09-14T09:10:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.973985+0000", 2024-09-14T09:10:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075204101999999995 2024-09-14T09:10:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974063+0000", 2024-09-14T09:10:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7632000000000005e-05 2024-09-14T09:10:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974154+0000", 2024-09-14T09:10:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1309000000000003e-05 2024-09-14T09:10:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2508 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3280896~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:10:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.172094954, 2024-09-14T09:10:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075576943999999993, 2024-09-14T09:10:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:26.129 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:26.129 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:26.129 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:26.129 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2508 2024-09-14T09:10:26.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.129 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:26.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:26.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:10:26.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:26.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.898792+0000", 2024-09-14T09:10:26.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:26.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899176+0000", 2024-09-14T09:10:26.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038340500000000002 2024-09-14T09:10:26.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:26.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899179+0000", 2024-09-14T09:10:26.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0290000000000001e-06 2024-09-14T09:10:26.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:26.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899186+0000", 2024-09-14T09:10:26.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8199999999999999e-06 2024-09-14T09:10:26.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:26.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899190+0000", 2024-09-14T09:10:26.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2050000000000004e-06 2024-09-14T09:10:26.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:26.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974193+0000", 2024-09-14T09:10:26.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075003632000000001 2024-09-14T09:10:26.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:26.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974276+0000", 2024-09-14T09:10:26.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2272000000000001e-05 2024-09-14T09:10:26.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:26.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974369+0000", 2024-09-14T09:10:26.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3580999999999997e-05 2024-09-14T09:10:26.132 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.132 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:26.132 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.132 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2509 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3342336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:26.132 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:10:26.132 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.17168733699999, 2024-09-14T09:10:26.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075356229999999996, 2024-09-14T09:10:26.132 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:26.133 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:26.133 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:26.133 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:26.133 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:26.133 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:26.133 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2509 2024-09-14T09:10:26.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.133 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:26.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:26.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:10:26.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:26.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899200+0000", 2024-09-14T09:10:26.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:26.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899439+0000", 2024-09-14T09:10:26.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00023958599999999999 2024-09-14T09:10:26.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:26.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899444+0000", 2024-09-14T09:10:26.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8790000000000002e-06 2024-09-14T09:10:26.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:26.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899455+0000", 2024-09-14T09:10:26.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0597999999999999e-05 2024-09-14T09:10:26.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:26.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899462+0000", 2024-09-14T09:10:26.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8179999999999998e-06 2024-09-14T09:10:26.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:26.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974400+0000", 2024-09-14T09:10:26.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074937999000000005 2024-09-14T09:10:26.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:26.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974465+0000", 2024-09-14T09:10:26.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5134000000000004e-05 2024-09-14T09:10:26.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:26.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974556+0000", 2024-09-14T09:10:26.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1216000000000002e-05 2024-09-14T09:10:26.136 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.136 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:26.136 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.137 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2510 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3403776~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:26.137 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:10:26.137 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.171411944, 2024-09-14T09:10:26.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075295775999999995, 2024-09-14T09:10:26.137 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:26.137 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:26.137 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:26.137 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:26.137 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:26.137 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:26.137 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2510 2024-09-14T09:10:26.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.137 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:26.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:26.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:10:26.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:26.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899475+0000", 2024-09-14T09:10:26.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:26.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899691+0000", 2024-09-14T09:10:26.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021615999999999999 2024-09-14T09:10:26.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:26.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899696+0000", 2024-09-14T09:10:26.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3200000000000001e-06 2024-09-14T09:10:26.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:26.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899704+0000", 2024-09-14T09:10:26.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9440000000000005e-06 2024-09-14T09:10:26.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:26.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899710+0000", 2024-09-14T09:10:26.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.584e-06 2024-09-14T09:10:26.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:26.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974594+0000", 2024-09-14T09:10:26.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074883551000000007 2024-09-14T09:10:26.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:26.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974679+0000", 2024-09-14T09:10:26.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5365999999999995e-05 2024-09-14T09:10:26.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:26.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974771+0000", 2024-09-14T09:10:26.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1850999999999999e-05 2024-09-14T09:10:26.140 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.141 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:26.141 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.141 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2511 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3465216~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:26.141 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:10:26.141 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.171165726, 2024-09-14T09:10:26.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075234668000000005, 2024-09-14T09:10:26.141 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:26.141 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:26.141 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:26.141 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:26.141 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:26.141 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:26.141 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2511 2024-09-14T09:10:26.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.142 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:26.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:26.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:10:26.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:26.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899721+0000", 2024-09-14T09:10:26.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:26.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899951+0000", 2024-09-14T09:10:26.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000229569 2024-09-14T09:10:26.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:26.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899955+0000", 2024-09-14T09:10:26.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1010000000000002e-06 2024-09-14T09:10:26.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:26.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899971+0000", 2024-09-14T09:10:26.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5648999999999999e-05 2024-09-14T09:10:26.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:26.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899978+0000", 2024-09-14T09:10:26.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0829999999999998e-06 2024-09-14T09:10:26.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:26.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974806+0000", 2024-09-14T09:10:26.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.074828092999999998 2024-09-14T09:10:26.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:26.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974870+0000", 2024-09-14T09:10:26.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4492000000000005e-05 2024-09-14T09:10:26.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:26.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.974956+0000", 2024-09-14T09:10:26.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5680999999999995e-05 2024-09-14T09:10:26.145 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.145 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:26.145 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.145 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.5127.0:2512 3.a 3:537140a7:::rbd_data.111228c3791c.0000000000000002:18 [read 3526656~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-14T09:10:26.145 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:10:26.145 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 109.170898181, 2024-09-14T09:10:26.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.075178812999999997, 2024-09-14T09:10:26.145 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:26.145 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:26.145 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:26.146 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:26.146 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.5127", 2024-09-14T09:10:26.146 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1101288070", 2024-09-14T09:10:26.146 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 2512 2024-09-14T09:10:26.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.146 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:26.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:26.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:10:26.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:26.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.899989+0000", 2024-09-14T09:10:26.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:26.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904181+0000", 2024-09-14T09:10:26.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041919399999999999 2024-09-14T09:10:26.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:26.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904186+0000", 2024-09-14T09:10:26.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2390000000000002e-06 2024-09-14T09:10:26.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:26.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904199+0000", 2024-09-14T09:10:26.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2709e-05 2024-09-14T09:10:26.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:26.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.904207+0000", 2024-09-14T09:10:26.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8150000000000006e-06 2024-09-14T09:10:26.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:26.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975000+0000", 2024-09-14T09:10:26.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.070793444999999997 2024-09-14T09:10:26.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:26.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975079+0000", 2024-09-14T09:10:26.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8480999999999996e-05 2024-09-14T09:10:26.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:26.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:08:36.975168+0000", 2024-09-14T09:10:26.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9184000000000005e-05 2024-09-14T09:10:26.149 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.149 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:26.149 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.150 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:22840 3.15 3:a8cf3dc2:::rbd_header.1112a10502fe:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:26.150 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:10:26.150 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 69.511325158999995, 2024-09-14T09:10:26.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.119998785, 2024-09-14T09:10:26.150 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:26.150 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:26.150 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:26.150 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:26.150 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:10:26.150 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:10:26.150 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 22840 2024-09-14T09:10:26.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.150 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:26.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:26.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:10:26.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:26.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.559562+0000", 2024-09-14T09:10:26.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:26.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642492+0000", 2024-09-14T09:10:26.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.082930276999999997 2024-09-14T09:10:26.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:26.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642495+0000", 2024-09-14T09:10:26.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9809999999999999e-06 2024-09-14T09:10:26.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:26.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642501+0000", 2024-09-14T09:10:26.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-09-14T09:10:26.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:26.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.642506+0000", 2024-09-14T09:10:26.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6650000000000002e-06 2024-09-14T09:10:26.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:26.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679483+0000", 2024-09-14T09:10:26.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036977777000000003 2024-09-14T09:10:26.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:26.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679517+0000", 2024-09-14T09:10:26.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.345e-05 2024-09-14T09:10:26.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:26.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.679561+0000", 2024-09-14T09:10:26.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3930999999999997e-05 2024-09-14T09:10:26.154 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.154 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:26.154 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.154 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4370.0:22857 3.15 3:a8cf3dc2:::rbd_header.1112a10502fe:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T09:10:26.154 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:10:26.154 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 69.361431233999994, 2024-09-14T09:10:26.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.088427917999999994, 2024-09-14T09:10:26.154 INFO:teuthology.orchestra.run.smithi116.stdout: "continuous": false, 2024-09-14T09:10:26.154 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-09-14T09:10:26.154 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-09-14T09:10:26.154 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-09-14T09:10:26.155 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4370", 2024-09-14T09:10:26.155 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "172.21.15.148:0/1734100231", 2024-09-14T09:10:26.155 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 22857 2024-09-14T09:10:26.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.155 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-09-14T09:10:26.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-09-14T09:10:26.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:10:26.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-09-14T09:10:26.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.709456+0000", 2024-09-14T09:10:26.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-09-14T09:10:26.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-09-14T09:10:26.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777685+0000", 2024-09-14T09:10:26.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.068229181999999999 2024-09-14T09:10:26.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-09-14T09:10:26.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777688+0000", 2024-09-14T09:10:26.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1980000000000001e-06 2024-09-14T09:10:26.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-09-14T09:10:26.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777695+0000", 2024-09-14T09:10:26.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6969999999999996e-06 2024-09-14T09:10:26.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-09-14T09:10:26.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.777700+0000", 2024-09-14T09:10:26.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0919999999999997e-06 2024-09-14T09:10:26.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-09-14T09:10:26.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797735+0000", 2024-09-14T09:10:26.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0200351 2024-09-14T09:10:26.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-09-14T09:10:26.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797800+0000", 2024-09-14T09:10:26.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4305000000000002e-05 2024-09-14T09:10:26.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T09:10:26.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T09:10:26.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-09-14T09:10:26.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-09-14T09:09:16.797884+0000", 2024-09-14T09:10:26.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4344000000000004e-05 2024-09-14T09:10:26.158 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.158 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:26.158 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.158 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T09:10:26.158 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-14T09:10:26.158 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:26.160 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T09:10:26.160 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:26.161+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:26.260 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:26.262+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:26.304 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:26.304 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:26.304 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-09-14T09:10:26.304 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:26.312 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T09:10:26.382 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T09:10:26.397 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:26.399+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:26.458 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:26.458 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-09-14T09:10:26.458 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-09-14T09:10:26.458 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-09-14T09:10:26.458 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:26.461 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-09-14T09:10:26.463+0000 7f1fda378640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31851) UID: 0 2024-09-14T09:10:26.467 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T09:10:26.532 INFO:teuthology.orchestra.run.smithi116.stdout:osd.0: {} 2024-09-14T09:10:26.532 INFO:teuthology.orchestra.run.smithi116.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T09:10:26.563 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:26.565+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:26.563 INFO:teuthology.orchestra.run.smithi116.stdout:osd.1: {} 2024-09-14T09:10:26.563 INFO:teuthology.orchestra.run.smithi116.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T09:10:26.594 INFO:teuthology.orchestra.run.smithi116.stdout:osd.2: {} 2024-09-14T09:10:26.595 INFO:teuthology.orchestra.run.smithi116.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T09:10:26.617 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:26.617 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:26.628 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T09:10:26.629 INFO:teuthology.orchestra.run.smithi116.stdout:osd.3: {} 2024-09-14T09:10:26.629 INFO:teuthology.orchestra.run.smithi116.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T09:10:26.645 INFO:teuthology.orchestra.run.smithi116.stdout:osd.4: {} 2024-09-14T09:10:26.645 INFO:teuthology.orchestra.run.smithi116.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T09:10:26.662 INFO:teuthology.orchestra.run.smithi116.stdout:osd.5: {} 2024-09-14T09:10:26.662 INFO:teuthology.orchestra.run.smithi116.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T09:10:26.663 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:26.665+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:26.742 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:26.743 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:26.752 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T09:10:26.764 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T09:10:26.766+0000 7f99cb0de640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31864) UID: 0 2024-09-14T09:10:26.805 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is unset 2024-09-14T09:10:26.869 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T09:10:26.871+0000 7f0df2402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 48548) UID: 0 2024-09-14T09:10:26.883 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:26.884 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:26.893 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T09:10:26.951 INFO:teuthology.orchestra.run.smithi148.stdout:All operations completed A-OK! 2024-09-14T09:10:26.963 DEBUG:teuthology.parallel:result is None 2024-09-14T09:10:26.963 DEBUG:teuthology.run_tasks:Unwinding manager rbd_fsx 2024-09-14T09:10:26.974 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-14T09:10:26.986 INFO:tasks.thrashosds:joining thrashosds 2024-09-14T09:10:27.023 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:27.023 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:27.032 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T09:10:27.141 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:27.141 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:27.150 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T09:10:27.273 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:27.273 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:27.284 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T09:10:27.394 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:27.394 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:27.403 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T09:10:27.525 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:27.525 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:27.534 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T09:10:27.652 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:27.652 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:27.663 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T09:10:27.770 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:27.770 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:27.779 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T09:10:27.912 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:27.912 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:27.922 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T09:10:28.040 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:28.040 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:28.050 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T09:10:28.162 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-09-14T09:10:28.162 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T09:10:28.828 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T09:10:29.816 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-14T09:10:29.817 INFO:tasks.thrashosds.thrasher:Adding osd 5 2024-09-14T09:10:29.817 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 5 2024-09-14T09:10:29.818 INFO:teuthology.orchestra.run.smithi116.stderr:noscrub is unset 2024-09-14T09:10:29.836 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T09:10:30.122 INFO:tasks.ceph.mon.a.smithi116.stderr:2024-09-14T09:10:30.124+0000 7f4999343640 -1 mon.a@0(leader).osd e158 definitely_dead 0 2024-09-14T09:10:30.834 INFO:teuthology.orchestra.run.smithi116.stderr:nodeep-scrub is unset 2024-09-14T09:10:30.834 INFO:teuthology.orchestra.run.smithi116.stderr:marked in osd.5. 2024-09-14T09:10:30.853 INFO:tasks.thrashosds.thrasher:Added osd 5 2024-09-14T09:10:30.853 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-14T09:10:30.853 INFO:tasks.thrashosds.thrasher:Adding osd 3 2024-09-14T09:10:30.853 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 3 2024-09-14T09:10:31.147 INFO:tasks.ceph.mon.a.smithi116.stderr:2024-09-14T09:10:31.149+0000 7f4999343640 -1 mon.a@0(leader).osd e159 definitely_dead 0 2024-09-14T09:10:31.797 INFO:teuthology.orchestra.run.smithi116.stderr:marked in osd.3. 2024-09-14T09:10:31.817 INFO:tasks.thrashosds.thrasher:Added osd 3 2024-09-14T09:10:31.818 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-14T09:10:31.931 INFO:teuthology.orchestra.run.smithi116.stdout:mon.a: {} 2024-09-14T09:10:31.932 INFO:teuthology.orchestra.run.smithi116.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T09:10:31.941 INFO:teuthology.orchestra.run.smithi116.stdout:mon.b: {} 2024-09-14T09:10:31.941 INFO:teuthology.orchestra.run.smithi116.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T09:10:31.949 INFO:teuthology.orchestra.run.smithi116.stdout:mon.c: {} 2024-09-14T09:10:31.949 INFO:teuthology.orchestra.run.smithi116.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T09:10:31.960 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-14T09:10:32.795 INFO:teuthology.orchestra.run.smithi116.stderr:reweighted osd.0 to 1 (10000) 2024-09-14T09:10:32.821 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-14T09:10:33.800 INFO:teuthology.orchestra.run.smithi116.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-14T09:10:33.827 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-14T09:10:34.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T09:10:34.169+0000 7f2ca5ca7640 0 --2- 172.21.15.116:0/81979287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ca00a4ca0 0x7f2ca013ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T09:10:34.797 INFO:teuthology.orchestra.run.smithi116.stderr:reweighted osd.1 to 1 (10000) 2024-09-14T09:10:34.816 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-14T09:10:35.798 INFO:teuthology.orchestra.run.smithi116.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-14T09:10:35.819 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-14T09:10:36.794 INFO:teuthology.orchestra.run.smithi116.stderr:reweighted osd.3 to 1 (10000) 2024-09-14T09:10:36.816 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-14T09:10:37.805 INFO:teuthology.orchestra.run.smithi116.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-14T09:10:37.822 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-14T09:10:38.797 INFO:teuthology.orchestra.run.smithi116.stderr:reweighted osd.4 to 1 (10000) 2024-09-14T09:10:38.815 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-14T09:10:39.875 INFO:teuthology.orchestra.run.smithi116.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-14T09:10:39.891 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-14T09:10:40.883 INFO:teuthology.orchestra.run.smithi116.stderr:reweighted osd.5 to 1 (10000) 2024-09-14T09:10:40.898 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-14T09:10:41.892 INFO:teuthology.orchestra.run.smithi116.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-14T09:10:41.906 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-14T09:10:42.902 INFO:teuthology.orchestra.run.smithi116.stderr:reweighted osd.2 to 1 (10000) 2024-09-14T09:10:42.918 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-14T09:10:43.898 INFO:teuthology.orchestra.run.smithi116.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-14T09:10:43.916 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-14T09:10:43.916 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-14T09:10:43.916 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-14T09:10:43.916 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-14T09:10:43.916 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T09:10:43.916 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T09:10:44.202 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:10:44.203 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":172,"fsid":"c991ac1c-978d-48b3-a540-4d3d4755e125","created":"2024-09-14T09:07:16.982473+0000","modified":"2024-09-14T09:10:43.899711+0000","last_up_change":"2024-09-14T09:09:15.843683+0000","last_in_change":"2024-09-14T09:10:31.794349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T09:07:29.194849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T09:07:33.684592+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-14T09:07:43.363542+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":43,"snap_epoch":153,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3c13086-1183-454b-8e62-3aec9b69cdf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6817","nonce":1856142608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6819","nonce":1856142608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6823","nonce":1856142608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6821","nonce":1856142608}]},"public_addr":"172.21.15.116:6817/1856142608","cluster_addr":"172.21.15.116:6819/1856142608","heartbeat_back_addr":"172.21.15.116:6823/1856142608","heartbeat_front_addr":"172.21.15.116:6821/1856142608","state":["exists","up"]},{"osd":1,"uuid":"8ee6a373-9d0d-4cd2-96f4-9673de96f546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6801","nonce":3469105275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6803","nonce":3469105275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6807","nonce":3469105275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6805","nonce":3469105275}]},"public_addr":"172.21.15.116:6801/3469105275","cluster_addr":"172.21.15.116:6803/3469105275","heartbeat_back_addr":"172.21.15.116:6807/3469105275","heartbeat_front_addr":"172.21.15.116:6805/3469105275","state":["exists","up"]},{"osd":2,"uuid":"958a9363-d751-49c3-9ec7-7330d377ee53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":67,"up_from":87,"up_thru":171,"down_at":68,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2050490698},{"type":"v1","addr":"172.21.15.116:6809","nonce":2050490698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2050490698},{"type":"v1","addr":"172.21.15.116:6811","nonce":2050490698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2050490698},{"type":"v1","addr":"172.21.15.116:6815","nonce":2050490698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2050490698},{"type":"v1","addr":"172.21.15.116:6813","nonce":2050490698}]},"public_addr":"172.21.15.116:6809/2050490698","cluster_addr":"172.21.15.116:6811/2050490698","heartbeat_back_addr":"172.21.15.116:6815/2050490698","heartbeat_front_addr":"172.21.15.116:6813/2050490698","state":["exists","up"]},{"osd":3,"uuid":"7fafd519-b2e9-498c-a409-f55cfe45a51a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6817","nonce":2855061278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6819","nonce":2855061278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6823","nonce":2855061278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6821","nonce":2855061278}]},"public_addr":"172.21.15.144:6817/2855061278","cluster_addr":"172.21.15.144:6819/2855061278","heartbeat_back_addr":"172.21.15.144:6823/2855061278","heartbeat_front_addr":"172.21.15.144:6821/2855061278","state":["exists","up"]},{"osd":4,"uuid":"63d99552-5fea-4367-bf86-0addc8cceb98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6809","nonce":369903047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6811","nonce":369903047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6815","nonce":369903047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6813","nonce":369903047}]},"public_addr":"172.21.15.144:6809/369903047","cluster_addr":"172.21.15.144:6811/369903047","heartbeat_back_addr":"172.21.15.144:6815/369903047","heartbeat_front_addr":"172.21.15.144:6813/369903047","state":["exists","up"]},{"osd":5,"uuid":"e4bcb224-662f-4530-b477-c0dd9c4ddbf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6801","nonce":2878111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6803","nonce":2878111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6807","nonce":2878111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6805","nonce":2878111293}]},"public_addr":"172.21.15.144:6801/2878111293","cluster_addr":"172.21.15.144:6803/2878111293","heartbeat_back_addr":"172.21.15.144:6807/2878111293","heartbeat_front_addr":"172.21.15.144:6805/2878111293","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:24.757990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.277795+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.290172+0000","dead_epoch":68},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.324594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:24.865136+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.020572+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.4","osds":[0,3]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"3.1","osds":[4]},{"pgid":"3.8","osds":[4]},{"pgid":"3.11","osds":[1]},{"pgid":"3.16","osds":[3]},{"pgid":"3.1e","osds":[3]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":3,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T09:10:44.215 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T09:10:44.216 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T09:10:44.499 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:10:44.499 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":172,"fsid":"c991ac1c-978d-48b3-a540-4d3d4755e125","created":"2024-09-14T09:07:16.982473+0000","modified":"2024-09-14T09:10:43.899711+0000","last_up_change":"2024-09-14T09:09:15.843683+0000","last_in_change":"2024-09-14T09:10:31.794349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T09:07:29.194849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T09:07:33.684592+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-14T09:07:43.363542+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":43,"snap_epoch":153,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3c13086-1183-454b-8e62-3aec9b69cdf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6817","nonce":1856142608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6819","nonce":1856142608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6823","nonce":1856142608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6821","nonce":1856142608}]},"public_addr":"172.21.15.116:6817/1856142608","cluster_addr":"172.21.15.116:6819/1856142608","heartbeat_back_addr":"172.21.15.116:6823/1856142608","heartbeat_front_addr":"172.21.15.116:6821/1856142608","state":["exists","up"]},{"osd":1,"uuid":"8ee6a373-9d0d-4cd2-96f4-9673de96f546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6801","nonce":3469105275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6803","nonce":3469105275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6807","nonce":3469105275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6805","nonce":3469105275}]},"public_addr":"172.21.15.116:6801/3469105275","cluster_addr":"172.21.15.116:6803/3469105275","heartbeat_back_addr":"172.21.15.116:6807/3469105275","heartbeat_front_addr":"172.21.15.116:6805/3469105275","state":["exists","up"]},{"osd":2,"uuid":"958a9363-d751-49c3-9ec7-7330d377ee53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":67,"up_from":87,"up_thru":171,"down_at":68,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2050490698},{"type":"v1","addr":"172.21.15.116:6809","nonce":2050490698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2050490698},{"type":"v1","addr":"172.21.15.116:6811","nonce":2050490698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2050490698},{"type":"v1","addr":"172.21.15.116:6815","nonce":2050490698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2050490698},{"type":"v1","addr":"172.21.15.116:6813","nonce":2050490698}]},"public_addr":"172.21.15.116:6809/2050490698","cluster_addr":"172.21.15.116:6811/2050490698","heartbeat_back_addr":"172.21.15.116:6815/2050490698","heartbeat_front_addr":"172.21.15.116:6813/2050490698","state":["exists","up"]},{"osd":3,"uuid":"7fafd519-b2e9-498c-a409-f55cfe45a51a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6817","nonce":2855061278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6819","nonce":2855061278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6823","nonce":2855061278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6821","nonce":2855061278}]},"public_addr":"172.21.15.144:6817/2855061278","cluster_addr":"172.21.15.144:6819/2855061278","heartbeat_back_addr":"172.21.15.144:6823/2855061278","heartbeat_front_addr":"172.21.15.144:6821/2855061278","state":["exists","up"]},{"osd":4,"uuid":"63d99552-5fea-4367-bf86-0addc8cceb98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6809","nonce":369903047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6811","nonce":369903047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6815","nonce":369903047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6813","nonce":369903047}]},"public_addr":"172.21.15.144:6809/369903047","cluster_addr":"172.21.15.144:6811/369903047","heartbeat_back_addr":"172.21.15.144:6815/369903047","heartbeat_front_addr":"172.21.15.144:6813/369903047","state":["exists","up"]},{"osd":5,"uuid":"e4bcb224-662f-4530-b477-c0dd9c4ddbf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6801","nonce":2878111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6803","nonce":2878111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6807","nonce":2878111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6805","nonce":2878111293}]},"public_addr":"172.21.15.144:6801/2878111293","cluster_addr":"172.21.15.144:6803/2878111293","heartbeat_back_addr":"172.21.15.144:6807/2878111293","heartbeat_front_addr":"172.21.15.144:6805/2878111293","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:24.757990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.277795+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.290172+0000","dead_epoch":68},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.324594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:24.865136+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.020572+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.4","osds":[0,3]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"3.1","osds":[4]},{"pgid":"3.8","osds":[4]},{"pgid":"3.11","osds":[1]},{"pgid":"3.16","osds":[3]},{"pgid":"3.1e","osds":[3]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":3,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T09:10:44.512 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T09:10:44.512 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T09:10:44.513 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T09:10:44.513 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T09:10:44.514 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T09:10:44.514 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T09:10:44.677 INFO:teuthology.orchestra.run.smithi116.stdout:55834574892 2024-09-14T09:10:44.677 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T09:10:44.680 INFO:teuthology.orchestra.run.smithi116.stdout:373662154771 2024-09-14T09:10:44.681 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T09:10:44.717 INFO:teuthology.orchestra.run.smithi116.stdout:51539607597 2024-09-14T09:10:44.717 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T09:10:44.718 INFO:teuthology.orchestra.run.smithi116.stdout:51539607595 2024-09-14T09:10:44.719 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T09:10:44.720 INFO:teuthology.orchestra.run.smithi116.stdout:47244640299 2024-09-14T09:10:44.720 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T09:10:44.722 INFO:teuthology.orchestra.run.smithi116.stdout:51539607595 2024-09-14T09:10:44.722 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T09:10:45.123 INFO:teuthology.orchestra.run.smithi116.stdout:55834574890 2024-09-14T09:10:45.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574890 for osd.1 2024-09-14T09:10:45.141 INFO:teuthology.orchestra.run.smithi116.stdout:51539607595 2024-09-14T09:10:45.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607597 got 51539607595 for osd.4 2024-09-14T09:10:45.191 INFO:teuthology.orchestra.run.smithi116.stdout:373662154770 2024-09-14T09:10:45.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 373662154771 got 373662154770 for osd.2 2024-09-14T09:10:45.290 INFO:teuthology.orchestra.run.smithi116.stdout:47244640298 2024-09-14T09:10:45.292 INFO:teuthology.orchestra.run.smithi116.stdout:51539607593 2024-09-14T09:10:45.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640299 got 47244640298 for osd.0 2024-09-14T09:10:45.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607595 got 51539607593 for osd.5 2024-09-14T09:10:45.319 INFO:teuthology.orchestra.run.smithi116.stdout:51539607593 2024-09-14T09:10:45.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607595 got 51539607593 for osd.3 2024-09-14T09:10:46.141 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T09:10:46.159 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T09:10:46.207 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T09:10:46.307 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T09:10:46.309 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T09:10:46.334 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T09:10:46.467 INFO:teuthology.orchestra.run.smithi116.stdout:55834574892 2024-09-14T09:10:46.481 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574892 for osd.1 2024-09-14T09:10:46.481 DEBUG:teuthology.parallel:result is None 2024-09-14T09:10:46.641 INFO:teuthology.orchestra.run.smithi116.stdout:51539607595 2024-09-14T09:10:46.649 INFO:teuthology.orchestra.run.smithi116.stdout:47244640299 2024-09-14T09:10:46.655 INFO:teuthology.orchestra.run.smithi116.stdout:51539607597 2024-09-14T09:10:46.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607595 got 51539607595 for osd.5 2024-09-14T09:10:46.661 DEBUG:teuthology.parallel:result is None 2024-09-14T09:10:46.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640299 got 47244640299 for osd.0 2024-09-14T09:10:46.664 DEBUG:teuthology.parallel:result is None 2024-09-14T09:10:46.671 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607597 got 51539607597 for osd.4 2024-09-14T09:10:46.671 DEBUG:teuthology.parallel:result is None 2024-09-14T09:10:46.696 INFO:teuthology.orchestra.run.smithi116.stdout:51539607595 2024-09-14T09:10:46.706 INFO:teuthology.orchestra.run.smithi116.stdout:373662154772 2024-09-14T09:10:46.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607595 got 51539607595 for osd.3 2024-09-14T09:10:46.709 DEBUG:teuthology.parallel:result is None 2024-09-14T09:10:46.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 373662154771 got 373662154772 for osd.2 2024-09-14T09:10:46.719 DEBUG:teuthology.parallel:result is None 2024-09-14T09:10:46.719 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-14T09:10:46.719 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T09:10:47.049 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:10:47.051 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T09:10:47.062 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2024-09-14T09:10:46.798981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":884,"num_object_clones":0,"num_object_copies":1768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":884,"num_whiteouts":876,"num_read":421386,"num_read_kb":1460282,"num_write":27348,"num_write_kb":495853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10436,"num_bytes_recovered":247694321,"num_keys_recovered":856,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24673,"ondisk_log_size":24673,"up":82,"acting":77,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":403420,"kb_used_data":13200,"kb_used_omap":32,"kb_used_meta":390047,"kb_avail":565827620,"statfs":{"total":579820584960,"available":579407482880,"internally_reserved":0,"allocated":13516800,"data_stored":6373060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32895,"internal_metadata":399409025},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.898390"},"pg_stats":[{"pgid":"3.1f","version":"155'762","reported_seq":6889,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907856+0000","last_change":"2024-09-14T09:10:34.813822+0000","last_active":"2024-09-14T09:10:43.907856+0000","last_peered":"2024-09-14T09:10:43.907856+0000","last_clean":"2024-09-14T09:10:43.907856+0000","last_became_active":"2024-09-14T09:10:34.812378+0000","last_became_peered":"2024-09-14T09:10:34.812378+0000","last_unstale":"2024-09-14T09:10:43.907856+0000","last_undegraded":"2024-09-14T09:10:43.907856+0000","last_fullsized":"2024-09-14T09:10:43.907856+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:30.774451+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0042793429999999997,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":6424,"num_read_kb":42400,"num_write":961,"num_write_kb":16264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":566,"num_bytes_recovered":18399808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.1e","version":"151'487","reported_seq":8287,"reported_epoch":171,"state":"remapped+peering","last_fresh":"2024-09-14T09:10:42.905308+0000","last_change":"2024-09-14T09:10:43.905969+0000","last_active":"2024-09-14T09:10:42.905308+0000","last_peered":"2024-09-14T09:10:42.161579+0000","last_clean":"2024-09-14T09:10:42.161579+0000","last_became_active":"2024-09-14T09:10:38.806696+0000","last_became_peered":"2024-09-14T09:10:38.806696+0000","last_unstale":"2024-09-14T09:10:42.905308+0000","last_undegraded":"2024-09-14T09:10:42.905308+0000","last_fullsized":"2024-09-14T09:10:42.905308+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001792068,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":7749,"num_read_kb":36057,"num_write":459,"num_write_kb":5529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":280,"num_bytes_recovered":7376960,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.1d","version":"155'678","reported_seq":7042,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907710+0000","last_change":"2024-09-14T09:10:36.808697+0000","last_active":"2024-09-14T09:10:43.907710+0000","last_peered":"2024-09-14T09:10:43.907710+0000","last_clean":"2024-09-14T09:10:43.907710+0000","last_became_active":"2024-09-14T09:10:36.806572+0000","last_became_peered":"2024-09-14T09:10:36.806572+0000","last_unstale":"2024-09-14T09:10:43.907710+0000","last_undegraded":"2024-09-14T09:10:43.907710+0000","last_fullsized":"2024-09-14T09:10:43.907710+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:14.168101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097120599999999996,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":10173,"num_read_kb":74789,"num_write":721,"num_write_kb":20037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":358,"num_bytes_recovered":31416461,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.1c","version":"155'783","reported_seq":6756,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.909160+0000","last_change":"2024-09-14T09:10:38.808376+0000","last_active":"2024-09-14T09:10:43.909160+0000","last_peered":"2024-09-14T09:10:43.909160+0000","last_clean":"2024-09-14T09:10:43.909160+0000","last_became_active":"2024-09-14T09:10:38.806707+0000","last_became_peered":"2024-09-14T09:10:38.806707+0000","last_unstale":"2024-09-14T09:10:43.909160+0000","last_undegraded":"2024-09-14T09:10:43.909160+0000","last_fullsized":"2024-09-14T09:10:43.909160+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:32.661615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017015209999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":7807,"num_read_kb":21023,"num_write":814,"num_write_kb":12470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":2849546,"num_keys_recovered":242,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.1b","version":"152'752","reported_seq":6445,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.905328+0000","last_change":"2024-09-14T09:10:36.810578+0000","last_active":"2024-09-14T09:10:43.905328+0000","last_peered":"2024-09-14T09:10:43.905328+0000","last_clean":"2024-09-14T09:10:43.905328+0000","last_became_active":"2024-09-14T09:10:36.808440+0000","last_became_peered":"2024-09-14T09:10:36.808440+0000","last_unstale":"2024-09-14T09:10:43.905328+0000","last_undegraded":"2024-09-14T09:10:43.905328+0000","last_fullsized":"2024-09-14T09:10:43.905328+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:32.467757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084872500000000004,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":7088,"num_read_kb":42687,"num_write":978,"num_write_kb":14384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":417,"num_bytes_recovered":16991946,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.1a","version":"155'1100","reported_seq":46320,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907702+0000","last_change":"2024-09-14T09:10:36.817314+0000","last_active":"2024-09-14T09:10:43.907702+0000","last_peered":"2024-09-14T09:10:43.907702+0000","last_clean":"2024-09-14T09:10:43.907702+0000","last_became_active":"2024-09-14T09:10:36.814993+0000","last_became_peered":"2024-09-14T09:10:36.814993+0000","last_unstale":"2024-09-14T09:10:43.907702+0000","last_undegraded":"2024-09-14T09:10:43.907702+0000","last_fullsized":"2024-09-14T09:10:43.907702+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1100,"log_dups_size":0,"ondisk_log_size":1100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:01.751040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002639925,"stat_sum":{"num_bytes":19,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":23,"num_read":46462,"num_read_kb":92242,"num_write":1032,"num_write_kb":40131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":432,"num_bytes_recovered":16835316,"num_keys_recovered":71,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.19","version":"150'528","reported_seq":8991,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.903195+0000","last_change":"2024-09-14T09:10:35.807979+0000","last_active":"2024-09-14T09:10:43.903195+0000","last_peered":"2024-09-14T09:10:43.903195+0000","last_clean":"2024-09-14T09:10:43.903195+0000","last_became_active":"2024-09-14T09:10:35.806694+0000","last_became_peered":"2024-09-14T09:10:35.806694+0000","last_unstale":"2024-09-14T09:10:43.903195+0000","last_undegraded":"2024-09-14T09:10:43.903195+0000","last_fullsized":"2024-09-14T09:10:43.903195+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:30.197773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081109400000000005,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":8055,"num_read_kb":52380,"num_write":658,"num_write_kb":14132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.18","version":"150'793","reported_seq":6492,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.905272+0000","last_change":"2024-09-14T09:10:38.808926+0000","last_active":"2024-09-14T09:10:43.905272+0000","last_peered":"2024-09-14T09:10:43.905272+0000","last_clean":"2024-09-14T09:10:43.905272+0000","last_became_active":"2024-09-14T09:10:38.807058+0000","last_became_peered":"2024-09-14T09:10:38.807058+0000","last_unstale":"2024-09-14T09:10:43.905272+0000","last_undegraded":"2024-09-14T09:10:43.905272+0000","last_fullsized":"2024-09-14T09:10:43.905272+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:21.481048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001015438,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":7244,"num_read_kb":25042,"num_write":1081,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.17","version":"152'859","reported_seq":72049,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907791+0000","last_change":"2024-09-14T09:10:37.809948+0000","last_active":"2024-09-14T09:10:43.907791+0000","last_peered":"2024-09-14T09:10:43.907791+0000","last_clean":"2024-09-14T09:10:43.907791+0000","last_became_active":"2024-09-14T09:10:37.807994+0000","last_became_peered":"2024-09-14T09:10:37.807994+0000","last_unstale":"2024-09-14T09:10:43.907791+0000","last_undegraded":"2024-09-14T09:10:43.907791+0000","last_fullsized":"2024-09-14T09:10:43.907791+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:21.137544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017200060000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":74396,"num_read_kb":113736,"num_write":1000,"num_write_kb":72684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":501,"num_bytes_recovered":30088824,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.16","version":"145'552","reported_seq":21625,"reported_epoch":170,"state":"remapped+peering","last_fresh":"2024-09-14T09:10:42.161524+0000","last_change":"2024-09-14T09:10:43.906125+0000","last_active":"2024-09-14T09:10:43.906125+0000","last_peered":"2024-09-14T09:10:42.161524+0000","last_clean":"2024-09-14T09:10:42.161524+0000","last_became_active":"2024-09-14T09:10:35.808145+0000","last_became_peered":"2024-09-14T09:10:35.808145+0000","last_unstale":"2024-09-14T09:10:42.161524+0000","last_undegraded":"2024-09-14T09:10:42.161524+0000","last_fullsized":"2024-09-14T09:10:42.161524+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00073203199999999997,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":21018,"num_read_kb":58767,"num_write":570,"num_write_kb":35397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":7392256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,5],"up_primary":2,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.15","version":"150'952","reported_seq":57755,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.906866+0000","last_change":"2024-09-14T09:10:35.811768+0000","last_active":"2024-09-14T09:10:43.906866+0000","last_peered":"2024-09-14T09:10:43.906866+0000","last_clean":"2024-09-14T09:10:43.906866+0000","last_became_active":"2024-09-14T09:10:35.810160+0000","last_became_peered":"2024-09-14T09:10:35.810160+0000","last_unstale":"2024-09-14T09:10:43.906866+0000","last_undegraded":"2024-09-14T09:10:43.906866+0000","last_fullsized":"2024-09-14T09:10:43.906866+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:21:57.677481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068915899999999995,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":27804,"num_read_kb":68813,"num_write":785,"num_write_kb":21040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.14","version":"152'650","reported_seq":6232,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.909090+0000","last_change":"2024-09-14T09:10:36.813886+0000","last_active":"2024-09-14T09:10:43.909090+0000","last_peered":"2024-09-14T09:10:43.909090+0000","last_clean":"2024-09-14T09:10:43.909090+0000","last_became_active":"2024-09-14T09:10:36.812242+0000","last_became_peered":"2024-09-14T09:10:36.812242+0000","last_unstale":"2024-09-14T09:10:43.909090+0000","last_undegraded":"2024-09-14T09:10:43.909090+0000","last_fullsized":"2024-09-14T09:10:43.909090+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:17.220451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067904769999999996,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":7788,"num_read_kb":24568,"num_write":614,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":4454614,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":174,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.909058+0000","last_change":"2024-09-14T09:10:36.818028+0000","last_active":"2024-09-14T09:10:43.909058+0000","last_peered":"2024-09-14T09:10:43.909058+0000","last_clean":"2024-09-14T09:10:43.909058+0000","last_became_active":"2024-09-14T09:10:36.817650+0000","last_became_peered":"2024-09-14T09:10:36.817650+0000","last_unstale":"2024-09-14T09:10:43.909058+0000","last_undegraded":"2024-09-14T09:10:43.909058+0000","last_fullsized":"2024-09-14T09:10:43.909058+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:05.095616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061552199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"155'693","reported_seq":5991,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.903209+0000","last_change":"2024-09-14T09:10:35.809230+0000","last_active":"2024-09-14T09:10:43.903209+0000","last_peered":"2024-09-14T09:10:43.903209+0000","last_clean":"2024-09-14T09:10:43.903209+0000","last_became_active":"2024-09-14T09:10:35.806954+0000","last_became_peered":"2024-09-14T09:10:35.806954+0000","last_unstale":"2024-09-14T09:10:43.903209+0000","last_undegraded":"2024-09-14T09:10:43.903209+0000","last_fullsized":"2024-09-14T09:10:43.903209+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:07.626647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010903849999999999,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":6998,"num_read_kb":15727,"num_write":528,"num_write_kb":3578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":341,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.903286+0000","last_change":"2024-09-14T09:10:33.814092+0000","last_active":"2024-09-14T09:10:43.903286+0000","last_peered":"2024-09-14T09:10:43.903286+0000","last_clean":"2024-09-14T09:10:43.903286+0000","last_became_active":"2024-09-14T09:10:33.813809+0000","last_became_peered":"2024-09-14T09:10:33.813809+0000","last_unstale":"2024-09-14T09:10:43.903286+0000","last_undegraded":"2024-09-14T09:10:43.903286+0000","last_fullsized":"2024-09-14T09:10:43.903286+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:55.810760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042190199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"150'724","reported_seq":8919,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.903279+0000","last_change":"2024-09-14T09:10:36.803816+0000","last_active":"2024-09-14T09:10:43.903279+0000","last_peered":"2024-09-14T09:10:43.903279+0000","last_clean":"2024-09-14T09:10:43.903279+0000","last_became_active":"2024-09-14T09:10:36.802005+0000","last_became_peered":"2024-09-14T09:10:36.802005+0000","last_unstale":"2024-09-14T09:10:43.903279+0000","last_undegraded":"2024-09-14T09:10:43.903279+0000","last_fullsized":"2024-09-14T09:10:43.903279+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:36.656797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064676800000000004,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":9017,"num_read_kb":43383,"num_write":832,"num_write_kb":5619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":174,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.908497+0000","last_change":"2024-09-14T09:10:36.805095+0000","last_active":"2024-09-14T09:10:43.908497+0000","last_peered":"2024-09-14T09:10:43.908497+0000","last_clean":"2024-09-14T09:10:43.908497+0000","last_became_active":"2024-09-14T09:10:36.804806+0000","last_became_peered":"2024-09-14T09:10:36.804806+0000","last_unstale":"2024-09-14T09:10:43.908497+0000","last_undegraded":"2024-09-14T09:10:43.908497+0000","last_fullsized":"2024-09-14T09:10:43.908497+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:45.011748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"146'1024","reported_seq":7035,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.903218+0000","last_change":"2024-09-14T09:10:34.807002+0000","last_active":"2024-09-14T09:10:43.903218+0000","last_peered":"2024-09-14T09:10:43.903218+0000","last_clean":"2024-09-14T09:10:43.903218+0000","last_became_active":"2024-09-14T09:10:34.805260+0000","last_became_peered":"2024-09-14T09:10:34.805260+0000","last_unstale":"2024-09-14T09:10:43.903218+0000","last_undegraded":"2024-09-14T09:10:43.903218+0000","last_fullsized":"2024-09-14T09:10:43.903218+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:21.009093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093108500000000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":7917,"num_read_kb":40050,"num_write":1441,"num_write_kb":11556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":306,"num_bytes_recovered":7127704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907482+0000","last_change":"2024-09-14T09:10:32.806891+0000","last_active":"2024-09-14T09:10:43.907482+0000","last_peered":"2024-09-14T09:10:43.907482+0000","last_clean":"2024-09-14T09:10:43.907482+0000","last_became_active":"2024-09-14T09:10:32.806571+0000","last_became_peered":"2024-09-14T09:10:32.806571+0000","last_unstale":"2024-09-14T09:10:43.907482+0000","last_undegraded":"2024-09-14T09:10:43.907482+0000","last_fullsized":"2024-09-14T09:10:43.907482+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:52:32.672580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"152'830","reported_seq":10428,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907618+0000","last_change":"2024-09-14T09:10:36.803840+0000","last_active":"2024-09-14T09:10:43.907618+0000","last_peered":"2024-09-14T09:10:43.907618+0000","last_clean":"2024-09-14T09:10:43.907618+0000","last_became_active":"2024-09-14T09:10:36.801544+0000","last_became_peered":"2024-09-14T09:10:36.801544+0000","last_unstale":"2024-09-14T09:10:43.907618+0000","last_undegraded":"2024-09-14T09:10:43.907618+0000","last_fullsized":"2024-09-14T09:10:43.907618+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:22.359490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001749932,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":11788,"num_read_kb":51374,"num_write":731,"num_write_kb":9360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":344,"num_bytes_recovered":2441232,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.3","version":"155'1550","reported_seq":11331,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907410+0000","last_change":"2024-09-14T09:10:37.810044+0000","last_active":"2024-09-14T09:10:43.907410+0000","last_peered":"2024-09-14T09:10:43.907410+0000","last_clean":"2024-09-14T09:10:43.907410+0000","last_became_active":"2024-09-14T09:10:37.808020+0000","last_became_peered":"2024-09-14T09:10:37.808020+0000","last_unstale":"2024-09-14T09:10:43.907410+0000","last_undegraded":"2024-09-14T09:10:43.907410+0000","last_fullsized":"2024-09-14T09:10:43.907410+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1550,"log_dups_size":0,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:37.794250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011665530000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":29,"num_read":16156,"num_read_kb":41503,"num_write":1957,"num_write_kb":7195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":2340129,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":327,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907255+0000","last_change":"2024-09-14T09:07:37.260986+0000","last_active":"2024-09-14T09:10:43.907255+0000","last_peered":"2024-09-14T09:10:43.907255+0000","last_clean":"2024-09-14T09:10:43.907255+0000","last_became_active":"2024-09-14T09:07:35.254256+0000","last_became_peered":"2024-09-14T09:07:35.254256+0000","last_unstale":"2024-09-14T09:10:43.907255+0000","last_undegraded":"2024-09-14T09:10:43.907255+0000","last_fullsized":"2024-09-14T09:10:43.907255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:07.063058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096898500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"152'477","reported_seq":10512,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907533+0000","last_change":"2024-09-14T09:10:34.810738+0000","last_active":"2024-09-14T09:10:43.907533+0000","last_peered":"2024-09-14T09:10:43.907533+0000","last_clean":"2024-09-14T09:10:43.907533+0000","last_became_active":"2024-09-14T09:10:34.808686+0000","last_became_peered":"2024-09-14T09:10:34.808686+0000","last_unstale":"2024-09-14T09:10:43.907533+0000","last_undegraded":"2024-09-14T09:10:43.907533+0000","last_fullsized":"2024-09-14T09:10:43.907533+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:03.253962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011386840000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":9617,"num_read_kb":58850,"num_write":533,"num_write_kb":14690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":275,"num_bytes_recovered":8152899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.905985+0000","last_change":"2024-09-14T09:10:38.806538+0000","last_active":"2024-09-14T09:10:43.905985+0000","last_peered":"2024-09-14T09:10:43.905985+0000","last_clean":"2024-09-14T09:10:43.905985+0000","last_became_active":"2024-09-14T09:10:38.806119+0000","last_became_peered":"2024-09-14T09:10:38.806119+0000","last_unstale":"2024-09-14T09:10:43.905985+0000","last_undegraded":"2024-09-14T09:10:43.905985+0000","last_fullsized":"2024-09-14T09:10:43.905985+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:44.063513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"155'780","reported_seq":7213,"reported_epoch":171,"state":"remapped+peering","last_fresh":"2024-09-14T09:10:42.902699+0000","last_change":"2024-09-14T09:10:43.903710+0000","last_active":"2024-09-14T09:10:42.902699+0000","last_peered":"2024-09-14T09:10:42.902098+0000","last_clean":"2024-09-14T09:10:42.902098+0000","last_became_active":"2024-09-14T09:10:34.807002+0000","last_became_peered":"2024-09-14T09:10:34.807002+0000","last_unstale":"2024-09-14T09:10:42.902699+0000","last_undegraded":"2024-09-14T09:10:42.902699+0000","last_fullsized":"2024-09-14T09:10:42.902699+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000844446,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":7624,"num_read_kb":31794,"num_write":893,"num_write_kb":10927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":230948,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":298,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.906718+0000","last_change":"2024-09-14T09:10:31.806103+0000","last_active":"2024-09-14T09:10:43.906718+0000","last_peered":"2024-09-14T09:10:43.906718+0000","last_clean":"2024-09-14T09:10:43.906718+0000","last_became_active":"2024-09-14T09:10:31.805768+0000","last_became_peered":"2024-09-14T09:10:31.805768+0000","last_unstale":"2024-09-14T09:10:43.906718+0000","last_undegraded":"2024-09-14T09:10:43.906718+0000","last_fullsized":"2024-09-14T09:10:43.906718+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:40.795499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"152'439","reported_seq":2380,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.905327+0000","last_change":"2024-09-14T09:10:38.807701+0000","last_active":"2024-09-14T09:10:43.905327+0000","last_peered":"2024-09-14T09:10:43.905327+0000","last_clean":"2024-09-14T09:10:43.905327+0000","last_became_active":"2024-09-14T09:10:38.805463+0000","last_became_peered":"2024-09-14T09:10:38.805463+0000","last_unstale":"2024-09-14T09:10:43.905327+0000","last_undegraded":"2024-09-14T09:10:43.905327+0000","last_fullsized":"2024-09-14T09:10:43.905327+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:08.537012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012021849999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":3112,"num_read_kb":25090,"num_write":394,"num_write_kb":10842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":1975296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":210,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.908812+0000","last_change":"2024-09-14T09:09:17.798249+0000","last_active":"2024-09-14T09:10:43.908812+0000","last_peered":"2024-09-14T09:10:43.908812+0000","last_clean":"2024-09-14T09:10:43.908812+0000","last_became_active":"2024-09-14T09:09:17.797925+0000","last_became_peered":"2024-09-14T09:09:17.797925+0000","last_unstale":"2024-09-14T09:10:43.908812+0000","last_undegraded":"2024-09-14T09:10:43.908812+0000","last_fullsized":"2024-09-14T09:10:43.908812+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:22.149422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":232,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907624+0000","last_change":"2024-09-14T09:10:31.813147+0000","last_active":"2024-09-14T09:10:43.907624+0000","last_peered":"2024-09-14T09:10:43.907624+0000","last_clean":"2024-09-14T09:10:43.907624+0000","last_became_active":"2024-09-14T09:10:31.808373+0000","last_became_peered":"2024-09-14T09:10:31.808373+0000","last_unstale":"2024-09-14T09:10:43.907624+0000","last_undegraded":"2024-09-14T09:10:43.907624+0000","last_fullsized":"2024-09-14T09:10:43.907624+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_clean_scrub_stamp":"2024-09-14T09:07:29.211432+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:57:57.332555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"151'696","reported_seq":10230,"reported_epoch":171,"state":"remapped+peering","last_fresh":"2024-09-14T09:10:42.902704+0000","last_change":"2024-09-14T09:10:43.903709+0000","last_active":"2024-09-14T09:10:42.902704+0000","last_peered":"2024-09-14T09:10:42.902212+0000","last_clean":"2024-09-14T09:10:42.902212+0000","last_became_active":"2024-09-14T09:10:36.803394+0000","last_became_peered":"2024-09-14T09:10:36.803394+0000","last_unstale":"2024-09-14T09:10:42.902704+0000","last_undegraded":"2024-09-14T09:10:42.902704+0000","last_fullsized":"2024-09-14T09:10:42.902704+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012882099999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":11028,"num_read_kb":52732,"num_write":579,"num_write_kb":14215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":296,"num_bytes_recovered":2555973,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.9","version":"155'535","reported_seq":7283,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.906613+0000","last_change":"2024-09-14T09:10:36.806606+0000","last_active":"2024-09-14T09:10:43.906613+0000","last_peered":"2024-09-14T09:10:43.906613+0000","last_clean":"2024-09-14T09:10:43.906613+0000","last_became_active":"2024-09-14T09:10:36.804585+0000","last_became_peered":"2024-09-14T09:10:36.804585+0000","last_unstale":"2024-09-14T09:10:43.906613+0000","last_undegraded":"2024-09-14T09:10:43.906613+0000","last_fullsized":"2024-09-14T09:10:43.906613+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:37.635151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013332999999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":5991,"num_read_kb":50679,"num_write":476,"num_write_kb":15575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":3599888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.a","version":"155'923","reported_seq":8211,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907215+0000","last_change":"2024-09-14T09:10:24.802207+0000","last_active":"2024-09-14T09:10:43.907215+0000","last_peered":"2024-09-14T09:10:43.907215+0000","last_clean":"2024-09-14T09:10:43.907215+0000","last_became_active":"2024-09-14T09:09:02.793112+0000","last_became_peered":"2024-09-14T09:09:02.793112+0000","last_unstale":"2024-09-14T09:10:43.907215+0000","last_undegraded":"2024-09-14T09:10:43.907215+0000","last_fullsized":"2024-09-14T09:10:43.907215+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:20.589668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001478858,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":9011,"num_read_kb":44883,"num_write":1107,"num_write_kb":15908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":9779638,"num_keys_recovered":46,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.b","version":"155'481","reported_seq":5574,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.905387+0000","last_change":"2024-09-14T09:10:38.808915+0000","last_active":"2024-09-14T09:10:43.905387+0000","last_peered":"2024-09-14T09:10:43.905387+0000","last_clean":"2024-09-14T09:10:43.905387+0000","last_became_active":"2024-09-14T09:10:38.807014+0000","last_became_peered":"2024-09-14T09:10:38.807014+0000","last_unstale":"2024-09-14T09:10:43.905387+0000","last_undegraded":"2024-09-14T09:10:43.905387+0000","last_fullsized":"2024-09-14T09:10:43.905387+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:33.459042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060512200000000004,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":4794,"num_read_kb":18724,"num_write":499,"num_write_kb":6053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":540832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.c","version":"152'976","reported_seq":17832,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907387+0000","last_change":"2024-09-14T09:10:37.810417+0000","last_active":"2024-09-14T09:10:43.907387+0000","last_peered":"2024-09-14T09:10:43.907387+0000","last_clean":"2024-09-14T09:10:43.907387+0000","last_became_active":"2024-09-14T09:10:37.808431+0000","last_became_peered":"2024-09-14T09:10:37.808431+0000","last_unstale":"2024-09-14T09:10:43.907387+0000","last_undegraded":"2024-09-14T09:10:43.907387+0000","last_fullsized":"2024-09-14T09:10:43.907387+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":976,"log_dups_size":0,"ondisk_log_size":976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:01.165563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017008710000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":13865,"num_read_kb":46941,"num_write":938,"num_write_kb":9955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":415,"num_bytes_recovered":13533184,"num_keys_recovered":116,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.d","version":"155'519","reported_seq":21759,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.908601+0000","last_change":"2024-09-14T09:10:35.815411+0000","last_active":"2024-09-14T09:10:43.908601+0000","last_peered":"2024-09-14T09:10:43.908601+0000","last_clean":"2024-09-14T09:10:43.908601+0000","last_became_active":"2024-09-14T09:10:35.813901+0000","last_became_peered":"2024-09-14T09:10:35.813901+0000","last_unstale":"2024-09-14T09:10:43.908601+0000","last_undegraded":"2024-09-14T09:10:43.908601+0000","last_fullsized":"2024-09-14T09:10:43.908601+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:37.344370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029838349999999998,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":21382,"num_read_kb":52622,"num_write":626,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":374,"num_bytes_recovered":16325120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.e","version":"151'564","reported_seq":4573,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.908526+0000","last_change":"2024-09-14T09:10:35.813746+0000","last_active":"2024-09-14T09:10:43.908526+0000","last_peered":"2024-09-14T09:10:43.908526+0000","last_clean":"2024-09-14T09:10:43.908526+0000","last_became_active":"2024-09-14T09:10:35.811599+0000","last_became_peered":"2024-09-14T09:10:35.811599+0000","last_unstale":"2024-09-14T09:10:43.908526+0000","last_undegraded":"2024-09-14T09:10:43.908526+0000","last_fullsized":"2024-09-14T09:10:43.908526+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:01.203388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001022088,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":5433,"num_read_kb":39557,"num_write":475,"num_write_kb":12186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":585,"num_bytes_recovered":15375904,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.f","version":"146'391","reported_seq":3661,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.906678+0000","last_change":"2024-09-14T09:10:37.813721+0000","last_active":"2024-09-14T09:10:43.906678+0000","last_peered":"2024-09-14T09:10:43.906678+0000","last_clean":"2024-09-14T09:10:43.906678+0000","last_became_active":"2024-09-14T09:10:37.811679+0000","last_became_peered":"2024-09-14T09:10:37.811679+0000","last_unstale":"2024-09-14T09:10:43.906678+0000","last_undegraded":"2024-09-14T09:10:43.906678+0000","last_fullsized":"2024-09-14T09:10:43.906678+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:33:03.454799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010483549999999999,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":2165,"num_read_kb":13861,"num_write":340,"num_write_kb":3973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":1385641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.10","version":"146'576","reported_seq":10517,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907738+0000","last_change":"2024-09-14T09:10:36.816638+0000","last_active":"2024-09-14T09:10:43.907738+0000","last_peered":"2024-09-14T09:10:43.907738+0000","last_clean":"2024-09-14T09:10:43.907738+0000","last_became_active":"2024-09-14T09:10:36.814772+0000","last_became_peered":"2024-09-14T09:10:36.814772+0000","last_unstale":"2024-09-14T09:10:43.907738+0000","last_undegraded":"2024-09-14T09:10:43.907738+0000","last_fullsized":"2024-09-14T09:10:43.907738+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:22.267528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024013369999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":9710,"num_read_kb":41453,"num_write":717,"num_write_kb":14547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":515,"num_bytes_recovered":6681771,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.11","version":"151'842","reported_seq":10949,"reported_epoch":170,"state":"remapped+peering","last_fresh":"2024-09-14T09:10:42.908037+0000","last_change":"2024-09-14T09:10:43.909151+0000","last_active":"2024-09-14T09:10:43.909151+0000","last_peered":"2024-09-14T09:10:42.908037+0000","last_clean":"2024-09-14T09:10:42.908037+0000","last_became_active":"2024-09-14T09:10:34.807844+0000","last_became_peered":"2024-09-14T09:10:34.807844+0000","last_unstale":"2024-09-14T09:10:42.908037+0000","last_undegraded":"2024-09-14T09:10:42.908037+0000","last_fullsized":"2024-09-14T09:10:42.908037+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001545701,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":12979,"num_read_kb":59033,"num_write":700,"num_write_kb":13832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":497,"num_bytes_recovered":10373286,"num_keys_recovered":102,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":2,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.12","version":"152'480","reported_seq":4972,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907726+0000","last_change":"2024-09-14T09:10:35.811341+0000","last_active":"2024-09-14T09:10:43.907726+0000","last_peered":"2024-09-14T09:10:43.907726+0000","last_clean":"2024-09-14T09:10:43.907726+0000","last_became_active":"2024-09-14T09:10:35.809716+0000","last_became_peered":"2024-09-14T09:10:35.809716+0000","last_unstale":"2024-09-14T09:10:43.907726+0000","last_undegraded":"2024-09-14T09:10:43.907726+0000","last_fullsized":"2024-09-14T09:10:43.907726+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:34.306889+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0036893669999999998,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3997,"num_read_kb":34359,"num_write":407,"num_write_kb":6924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":317,"num_bytes_recovered":2955870,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.13","version":"155'2202","reported_seq":9105,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.908715+0000","last_change":"2024-09-14T09:10:24.806079+0000","last_active":"2024-09-14T09:10:43.908715+0000","last_peered":"2024-09-14T09:10:43.908715+0000","last_clean":"2024-09-14T09:10:43.908715+0000","last_became_active":"2024-09-14T09:09:03.794283+0000","last_became_peered":"2024-09-14T09:09:03.794283+0000","last_unstale":"2024-09-14T09:10:43.908715+0000","last_undegraded":"2024-09-14T09:10:43.908715+0000","last_fullsized":"2024-09-14T09:10:43.908715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":2202,"log_dups_size":0,"ondisk_log_size":2202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:28.286762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013071960000000001,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":16728,"num_read_kb":45108,"num_write":3399,"num_write_kb":14849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":4151803,"num_keys_recovered":53,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":880,"num_object_clones":0,"num_object_copies":1760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":880,"num_whiteouts":876,"num_read":421320,"num_read_kb":1460227,"num_write":27245,"num_write_kb":494223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10427,"num_bytes_recovered":245332849,"num_keys_recovered":856,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12266,"internal_metadata":0},"log_size":24598,"ondisk_log_size":24598,"up":64,"acting":59,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":87,"seq":373662154772,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39200,"kb_used_data":1996,"kb_used_omap":24,"kb_used_meta":37159,"kb_avail":94332640,"statfs":{"total":96636764160,"available":96596623360,"internally_reserved":0,"allocated":2043904,"data_stored":861860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24922,"internal_metadata":38051494},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96244,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94275596,"statfs":{"total":96636764160,"available":96538210304,"internally_reserved":0,"allocated":2654208,"data_stored":1457519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607595,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51824,"kb_used_data":2580,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320016,"statfs":{"total":96636764160,"available":96583696384,"internally_reserved":0,"allocated":2641920,"data_stored":1452247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607597,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47092,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324748,"statfs":{"total":96636764160,"available":96588541952,"internally_reserved":0,"allocated":2060288,"data_stored":867151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607595,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95600,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94276240,"statfs":{"total":96636764160,"available":96538869760,"internally_reserved":0,"allocated":2056192,"data_stored":867132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":95812039},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640299,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73460,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298380,"statfs":{"total":96636764160,"available":96561541120,"internally_reserved":0,"allocated":2060288,"data_stored":867151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12266,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T09:10:47.065 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T09:10:47.346 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:10:47.347 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T09:10:47.360 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":270,"stamp":"2024-09-14T09:10:47.213523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":884,"num_object_clones":0,"num_object_copies":1768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":884,"num_whiteouts":876,"num_read":421386,"num_read_kb":1460282,"num_write":27348,"num_write_kb":495853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10436,"num_bytes_recovered":247694321,"num_keys_recovered":856,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24673,"ondisk_log_size":24673,"up":82,"acting":77,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":403440,"kb_used_data":13224,"kb_used_omap":32,"kb_used_meta":390047,"kb_avail":565827600,"statfs":{"total":579820584960,"available":579407462400,"internally_reserved":0,"allocated":13541376,"data_stored":6383318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32895,"internal_metadata":399409025},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000714"},"pg_stats":[{"pgid":"3.1f","version":"155'762","reported_seq":6889,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907856+0000","last_change":"2024-09-14T09:10:34.813822+0000","last_active":"2024-09-14T09:10:43.907856+0000","last_peered":"2024-09-14T09:10:43.907856+0000","last_clean":"2024-09-14T09:10:43.907856+0000","last_became_active":"2024-09-14T09:10:34.812378+0000","last_became_peered":"2024-09-14T09:10:34.812378+0000","last_unstale":"2024-09-14T09:10:43.907856+0000","last_undegraded":"2024-09-14T09:10:43.907856+0000","last_fullsized":"2024-09-14T09:10:43.907856+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:30.774451+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0042793429999999997,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":6424,"num_read_kb":42400,"num_write":961,"num_write_kb":16264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":566,"num_bytes_recovered":18399808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.1e","version":"151'487","reported_seq":8287,"reported_epoch":171,"state":"remapped+peering","last_fresh":"2024-09-14T09:10:42.905308+0000","last_change":"2024-09-14T09:10:43.905969+0000","last_active":"2024-09-14T09:10:42.905308+0000","last_peered":"2024-09-14T09:10:42.161579+0000","last_clean":"2024-09-14T09:10:42.161579+0000","last_became_active":"2024-09-14T09:10:38.806696+0000","last_became_peered":"2024-09-14T09:10:38.806696+0000","last_unstale":"2024-09-14T09:10:42.905308+0000","last_undegraded":"2024-09-14T09:10:42.905308+0000","last_fullsized":"2024-09-14T09:10:42.905308+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001792068,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":7749,"num_read_kb":36057,"num_write":459,"num_write_kb":5529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":280,"num_bytes_recovered":7376960,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.1d","version":"155'678","reported_seq":7042,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907710+0000","last_change":"2024-09-14T09:10:36.808697+0000","last_active":"2024-09-14T09:10:43.907710+0000","last_peered":"2024-09-14T09:10:43.907710+0000","last_clean":"2024-09-14T09:10:43.907710+0000","last_became_active":"2024-09-14T09:10:36.806572+0000","last_became_peered":"2024-09-14T09:10:36.806572+0000","last_unstale":"2024-09-14T09:10:43.907710+0000","last_undegraded":"2024-09-14T09:10:43.907710+0000","last_fullsized":"2024-09-14T09:10:43.907710+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:14.168101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097120599999999996,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":10173,"num_read_kb":74789,"num_write":721,"num_write_kb":20037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":358,"num_bytes_recovered":31416461,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.1c","version":"155'783","reported_seq":6756,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.909160+0000","last_change":"2024-09-14T09:10:38.808376+0000","last_active":"2024-09-14T09:10:43.909160+0000","last_peered":"2024-09-14T09:10:43.909160+0000","last_clean":"2024-09-14T09:10:43.909160+0000","last_became_active":"2024-09-14T09:10:38.806707+0000","last_became_peered":"2024-09-14T09:10:38.806707+0000","last_unstale":"2024-09-14T09:10:43.909160+0000","last_undegraded":"2024-09-14T09:10:43.909160+0000","last_fullsized":"2024-09-14T09:10:43.909160+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:32.661615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017015209999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":7807,"num_read_kb":21023,"num_write":814,"num_write_kb":12470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":2849546,"num_keys_recovered":242,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.1b","version":"152'752","reported_seq":6445,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.905328+0000","last_change":"2024-09-14T09:10:36.810578+0000","last_active":"2024-09-14T09:10:43.905328+0000","last_peered":"2024-09-14T09:10:43.905328+0000","last_clean":"2024-09-14T09:10:43.905328+0000","last_became_active":"2024-09-14T09:10:36.808440+0000","last_became_peered":"2024-09-14T09:10:36.808440+0000","last_unstale":"2024-09-14T09:10:43.905328+0000","last_undegraded":"2024-09-14T09:10:43.905328+0000","last_fullsized":"2024-09-14T09:10:43.905328+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:32.467757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084872500000000004,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":7088,"num_read_kb":42687,"num_write":978,"num_write_kb":14384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":417,"num_bytes_recovered":16991946,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.1a","version":"155'1100","reported_seq":46320,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907702+0000","last_change":"2024-09-14T09:10:36.817314+0000","last_active":"2024-09-14T09:10:43.907702+0000","last_peered":"2024-09-14T09:10:43.907702+0000","last_clean":"2024-09-14T09:10:43.907702+0000","last_became_active":"2024-09-14T09:10:36.814993+0000","last_became_peered":"2024-09-14T09:10:36.814993+0000","last_unstale":"2024-09-14T09:10:43.907702+0000","last_undegraded":"2024-09-14T09:10:43.907702+0000","last_fullsized":"2024-09-14T09:10:43.907702+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1100,"log_dups_size":0,"ondisk_log_size":1100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:01.751040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002639925,"stat_sum":{"num_bytes":19,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":23,"num_read":46462,"num_read_kb":92242,"num_write":1032,"num_write_kb":40131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":432,"num_bytes_recovered":16835316,"num_keys_recovered":71,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.19","version":"150'528","reported_seq":8991,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.903195+0000","last_change":"2024-09-14T09:10:35.807979+0000","last_active":"2024-09-14T09:10:43.903195+0000","last_peered":"2024-09-14T09:10:43.903195+0000","last_clean":"2024-09-14T09:10:43.903195+0000","last_became_active":"2024-09-14T09:10:35.806694+0000","last_became_peered":"2024-09-14T09:10:35.806694+0000","last_unstale":"2024-09-14T09:10:43.903195+0000","last_undegraded":"2024-09-14T09:10:43.903195+0000","last_fullsized":"2024-09-14T09:10:43.903195+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:30.197773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081109400000000005,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":8055,"num_read_kb":52380,"num_write":658,"num_write_kb":14132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.18","version":"150'793","reported_seq":6492,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.905272+0000","last_change":"2024-09-14T09:10:38.808926+0000","last_active":"2024-09-14T09:10:43.905272+0000","last_peered":"2024-09-14T09:10:43.905272+0000","last_clean":"2024-09-14T09:10:43.905272+0000","last_became_active":"2024-09-14T09:10:38.807058+0000","last_became_peered":"2024-09-14T09:10:38.807058+0000","last_unstale":"2024-09-14T09:10:43.905272+0000","last_undegraded":"2024-09-14T09:10:43.905272+0000","last_fullsized":"2024-09-14T09:10:43.905272+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:21.481048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001015438,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":7244,"num_read_kb":25042,"num_write":1081,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.17","version":"152'859","reported_seq":72049,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907791+0000","last_change":"2024-09-14T09:10:37.809948+0000","last_active":"2024-09-14T09:10:43.907791+0000","last_peered":"2024-09-14T09:10:43.907791+0000","last_clean":"2024-09-14T09:10:43.907791+0000","last_became_active":"2024-09-14T09:10:37.807994+0000","last_became_peered":"2024-09-14T09:10:37.807994+0000","last_unstale":"2024-09-14T09:10:43.907791+0000","last_undegraded":"2024-09-14T09:10:43.907791+0000","last_fullsized":"2024-09-14T09:10:43.907791+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:21.137544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017200060000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":74396,"num_read_kb":113736,"num_write":1000,"num_write_kb":72684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":501,"num_bytes_recovered":30088824,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.16","version":"145'552","reported_seq":21625,"reported_epoch":170,"state":"remapped+peering","last_fresh":"2024-09-14T09:10:42.161524+0000","last_change":"2024-09-14T09:10:43.906125+0000","last_active":"2024-09-14T09:10:43.906125+0000","last_peered":"2024-09-14T09:10:42.161524+0000","last_clean":"2024-09-14T09:10:42.161524+0000","last_became_active":"2024-09-14T09:10:35.808145+0000","last_became_peered":"2024-09-14T09:10:35.808145+0000","last_unstale":"2024-09-14T09:10:42.161524+0000","last_undegraded":"2024-09-14T09:10:42.161524+0000","last_fullsized":"2024-09-14T09:10:42.161524+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00073203199999999997,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":21018,"num_read_kb":58767,"num_write":570,"num_write_kb":35397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":7392256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,5],"up_primary":2,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.15","version":"150'952","reported_seq":57761,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806425+0000","last_change":"2024-09-14T09:10:35.811768+0000","last_active":"2024-09-14T09:10:46.806425+0000","last_peered":"2024-09-14T09:10:46.806425+0000","last_clean":"2024-09-14T09:10:46.806425+0000","last_became_active":"2024-09-14T09:10:35.810160+0000","last_became_peered":"2024-09-14T09:10:35.810160+0000","last_unstale":"2024-09-14T09:10:46.806425+0000","last_undegraded":"2024-09-14T09:10:46.806425+0000","last_fullsized":"2024-09-14T09:10:46.806425+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:21:57.677481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068915899999999995,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":27804,"num_read_kb":68813,"num_write":785,"num_write_kb":21040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"152'650","reported_seq":6232,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.909090+0000","last_change":"2024-09-14T09:10:36.813886+0000","last_active":"2024-09-14T09:10:43.909090+0000","last_peered":"2024-09-14T09:10:43.909090+0000","last_clean":"2024-09-14T09:10:43.909090+0000","last_became_active":"2024-09-14T09:10:36.812242+0000","last_became_peered":"2024-09-14T09:10:36.812242+0000","last_unstale":"2024-09-14T09:10:43.909090+0000","last_undegraded":"2024-09-14T09:10:43.909090+0000","last_fullsized":"2024-09-14T09:10:43.909090+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:17.220451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067904769999999996,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":7788,"num_read_kb":24568,"num_write":614,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":4454614,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":174,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.909058+0000","last_change":"2024-09-14T09:10:36.818028+0000","last_active":"2024-09-14T09:10:43.909058+0000","last_peered":"2024-09-14T09:10:43.909058+0000","last_clean":"2024-09-14T09:10:43.909058+0000","last_became_active":"2024-09-14T09:10:36.817650+0000","last_became_peered":"2024-09-14T09:10:36.817650+0000","last_unstale":"2024-09-14T09:10:43.909058+0000","last_undegraded":"2024-09-14T09:10:43.909058+0000","last_fullsized":"2024-09-14T09:10:43.909058+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:05.095616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061552199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"155'693","reported_seq":5991,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.903209+0000","last_change":"2024-09-14T09:10:35.809230+0000","last_active":"2024-09-14T09:10:43.903209+0000","last_peered":"2024-09-14T09:10:43.903209+0000","last_clean":"2024-09-14T09:10:43.903209+0000","last_became_active":"2024-09-14T09:10:35.806954+0000","last_became_peered":"2024-09-14T09:10:35.806954+0000","last_unstale":"2024-09-14T09:10:43.903209+0000","last_undegraded":"2024-09-14T09:10:43.903209+0000","last_fullsized":"2024-09-14T09:10:43.903209+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:07.626647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010903849999999999,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":6998,"num_read_kb":15727,"num_write":528,"num_write_kb":3578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":341,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.903286+0000","last_change":"2024-09-14T09:10:33.814092+0000","last_active":"2024-09-14T09:10:43.903286+0000","last_peered":"2024-09-14T09:10:43.903286+0000","last_clean":"2024-09-14T09:10:43.903286+0000","last_became_active":"2024-09-14T09:10:33.813809+0000","last_became_peered":"2024-09-14T09:10:33.813809+0000","last_unstale":"2024-09-14T09:10:43.903286+0000","last_undegraded":"2024-09-14T09:10:43.903286+0000","last_fullsized":"2024-09-14T09:10:43.903286+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:55.810760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042190199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"150'724","reported_seq":8919,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.903279+0000","last_change":"2024-09-14T09:10:36.803816+0000","last_active":"2024-09-14T09:10:43.903279+0000","last_peered":"2024-09-14T09:10:43.903279+0000","last_clean":"2024-09-14T09:10:43.903279+0000","last_became_active":"2024-09-14T09:10:36.802005+0000","last_became_peered":"2024-09-14T09:10:36.802005+0000","last_unstale":"2024-09-14T09:10:43.903279+0000","last_undegraded":"2024-09-14T09:10:43.903279+0000","last_fullsized":"2024-09-14T09:10:43.903279+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:36.656797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064676800000000004,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":9017,"num_read_kb":43383,"num_write":832,"num_write_kb":5619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":174,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.908497+0000","last_change":"2024-09-14T09:10:36.805095+0000","last_active":"2024-09-14T09:10:43.908497+0000","last_peered":"2024-09-14T09:10:43.908497+0000","last_clean":"2024-09-14T09:10:43.908497+0000","last_became_active":"2024-09-14T09:10:36.804806+0000","last_became_peered":"2024-09-14T09:10:36.804806+0000","last_unstale":"2024-09-14T09:10:43.908497+0000","last_undegraded":"2024-09-14T09:10:43.908497+0000","last_fullsized":"2024-09-14T09:10:43.908497+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:45.011748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"146'1024","reported_seq":7035,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.903218+0000","last_change":"2024-09-14T09:10:34.807002+0000","last_active":"2024-09-14T09:10:43.903218+0000","last_peered":"2024-09-14T09:10:43.903218+0000","last_clean":"2024-09-14T09:10:43.903218+0000","last_became_active":"2024-09-14T09:10:34.805260+0000","last_became_peered":"2024-09-14T09:10:34.805260+0000","last_unstale":"2024-09-14T09:10:43.903218+0000","last_undegraded":"2024-09-14T09:10:43.903218+0000","last_fullsized":"2024-09-14T09:10:43.903218+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:21.009093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093108500000000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":7917,"num_read_kb":40050,"num_write":1441,"num_write_kb":11556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":306,"num_bytes_recovered":7127704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806176+0000","last_change":"2024-09-14T09:10:32.806891+0000","last_active":"2024-09-14T09:10:46.806176+0000","last_peered":"2024-09-14T09:10:46.806176+0000","last_clean":"2024-09-14T09:10:46.806176+0000","last_became_active":"2024-09-14T09:10:32.806571+0000","last_became_peered":"2024-09-14T09:10:32.806571+0000","last_unstale":"2024-09-14T09:10:46.806176+0000","last_undegraded":"2024-09-14T09:10:46.806176+0000","last_fullsized":"2024-09-14T09:10:46.806176+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:52:32.672580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"152'830","reported_seq":10428,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907618+0000","last_change":"2024-09-14T09:10:36.803840+0000","last_active":"2024-09-14T09:10:43.907618+0000","last_peered":"2024-09-14T09:10:43.907618+0000","last_clean":"2024-09-14T09:10:43.907618+0000","last_became_active":"2024-09-14T09:10:36.801544+0000","last_became_peered":"2024-09-14T09:10:36.801544+0000","last_unstale":"2024-09-14T09:10:43.907618+0000","last_undegraded":"2024-09-14T09:10:43.907618+0000","last_fullsized":"2024-09-14T09:10:43.907618+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:22.359490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001749932,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":11788,"num_read_kb":51374,"num_write":731,"num_write_kb":9360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":344,"num_bytes_recovered":2441232,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.3","version":"155'1550","reported_seq":11337,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805742+0000","last_change":"2024-09-14T09:10:37.810044+0000","last_active":"2024-09-14T09:10:46.805742+0000","last_peered":"2024-09-14T09:10:46.805742+0000","last_clean":"2024-09-14T09:10:46.805742+0000","last_became_active":"2024-09-14T09:10:37.808020+0000","last_became_peered":"2024-09-14T09:10:37.808020+0000","last_unstale":"2024-09-14T09:10:46.805742+0000","last_undegraded":"2024-09-14T09:10:46.805742+0000","last_fullsized":"2024-09-14T09:10:46.805742+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1550,"log_dups_size":0,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:37.794250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011665530000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":29,"num_read":16156,"num_read_kb":41503,"num_write":1957,"num_write_kb":7195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":2340129,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":333,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805453+0000","last_change":"2024-09-14T09:07:37.260986+0000","last_active":"2024-09-14T09:10:46.805453+0000","last_peered":"2024-09-14T09:10:46.805453+0000","last_clean":"2024-09-14T09:10:46.805453+0000","last_became_active":"2024-09-14T09:07:35.254256+0000","last_became_peered":"2024-09-14T09:07:35.254256+0000","last_unstale":"2024-09-14T09:10:46.805453+0000","last_undegraded":"2024-09-14T09:10:46.805453+0000","last_fullsized":"2024-09-14T09:10:46.805453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:07.063058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096898500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"152'477","reported_seq":10512,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907533+0000","last_change":"2024-09-14T09:10:34.810738+0000","last_active":"2024-09-14T09:10:43.907533+0000","last_peered":"2024-09-14T09:10:43.907533+0000","last_clean":"2024-09-14T09:10:43.907533+0000","last_became_active":"2024-09-14T09:10:34.808686+0000","last_became_peered":"2024-09-14T09:10:34.808686+0000","last_unstale":"2024-09-14T09:10:43.907533+0000","last_undegraded":"2024-09-14T09:10:43.907533+0000","last_fullsized":"2024-09-14T09:10:43.907533+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:03.253962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011386840000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":9617,"num_read_kb":58850,"num_write":533,"num_write_kb":14690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":275,"num_bytes_recovered":8152899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.905985+0000","last_change":"2024-09-14T09:10:38.806538+0000","last_active":"2024-09-14T09:10:43.905985+0000","last_peered":"2024-09-14T09:10:43.905985+0000","last_clean":"2024-09-14T09:10:43.905985+0000","last_became_active":"2024-09-14T09:10:38.806119+0000","last_became_peered":"2024-09-14T09:10:38.806119+0000","last_unstale":"2024-09-14T09:10:43.905985+0000","last_undegraded":"2024-09-14T09:10:43.905985+0000","last_fullsized":"2024-09-14T09:10:43.905985+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:44.063513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"155'780","reported_seq":7213,"reported_epoch":171,"state":"remapped+peering","last_fresh":"2024-09-14T09:10:42.902699+0000","last_change":"2024-09-14T09:10:43.903710+0000","last_active":"2024-09-14T09:10:42.902699+0000","last_peered":"2024-09-14T09:10:42.902098+0000","last_clean":"2024-09-14T09:10:42.902098+0000","last_became_active":"2024-09-14T09:10:34.807002+0000","last_became_peered":"2024-09-14T09:10:34.807002+0000","last_unstale":"2024-09-14T09:10:42.902699+0000","last_undegraded":"2024-09-14T09:10:42.902699+0000","last_fullsized":"2024-09-14T09:10:42.902699+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000844446,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":7624,"num_read_kb":31794,"num_write":893,"num_write_kb":10927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":230948,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":298,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.906718+0000","last_change":"2024-09-14T09:10:31.806103+0000","last_active":"2024-09-14T09:10:43.906718+0000","last_peered":"2024-09-14T09:10:43.906718+0000","last_clean":"2024-09-14T09:10:43.906718+0000","last_became_active":"2024-09-14T09:10:31.805768+0000","last_became_peered":"2024-09-14T09:10:31.805768+0000","last_unstale":"2024-09-14T09:10:43.906718+0000","last_undegraded":"2024-09-14T09:10:43.906718+0000","last_fullsized":"2024-09-14T09:10:43.906718+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:40.795499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"152'439","reported_seq":2380,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.905327+0000","last_change":"2024-09-14T09:10:38.807701+0000","last_active":"2024-09-14T09:10:43.905327+0000","last_peered":"2024-09-14T09:10:43.905327+0000","last_clean":"2024-09-14T09:10:43.905327+0000","last_became_active":"2024-09-14T09:10:38.805463+0000","last_became_peered":"2024-09-14T09:10:38.805463+0000","last_unstale":"2024-09-14T09:10:43.905327+0000","last_undegraded":"2024-09-14T09:10:43.905327+0000","last_fullsized":"2024-09-14T09:10:43.905327+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:08.537012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012021849999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":3112,"num_read_kb":25090,"num_write":394,"num_write_kb":10842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":1975296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":210,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.908812+0000","last_change":"2024-09-14T09:09:17.798249+0000","last_active":"2024-09-14T09:10:43.908812+0000","last_peered":"2024-09-14T09:10:43.908812+0000","last_clean":"2024-09-14T09:10:43.908812+0000","last_became_active":"2024-09-14T09:09:17.797925+0000","last_became_peered":"2024-09-14T09:09:17.797925+0000","last_unstale":"2024-09-14T09:10:43.908812+0000","last_undegraded":"2024-09-14T09:10:43.908812+0000","last_fullsized":"2024-09-14T09:10:43.908812+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:22.149422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":232,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907624+0000","last_change":"2024-09-14T09:10:31.813147+0000","last_active":"2024-09-14T09:10:43.907624+0000","last_peered":"2024-09-14T09:10:43.907624+0000","last_clean":"2024-09-14T09:10:43.907624+0000","last_became_active":"2024-09-14T09:10:31.808373+0000","last_became_peered":"2024-09-14T09:10:31.808373+0000","last_unstale":"2024-09-14T09:10:43.907624+0000","last_undegraded":"2024-09-14T09:10:43.907624+0000","last_fullsized":"2024-09-14T09:10:43.907624+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_clean_scrub_stamp":"2024-09-14T09:07:29.211432+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:57:57.332555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"151'696","reported_seq":10230,"reported_epoch":171,"state":"remapped+peering","last_fresh":"2024-09-14T09:10:42.902704+0000","last_change":"2024-09-14T09:10:43.903709+0000","last_active":"2024-09-14T09:10:42.902704+0000","last_peered":"2024-09-14T09:10:42.902212+0000","last_clean":"2024-09-14T09:10:42.902212+0000","last_became_active":"2024-09-14T09:10:36.803394+0000","last_became_peered":"2024-09-14T09:10:36.803394+0000","last_unstale":"2024-09-14T09:10:42.902704+0000","last_undegraded":"2024-09-14T09:10:42.902704+0000","last_fullsized":"2024-09-14T09:10:42.902704+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012882099999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":11028,"num_read_kb":52732,"num_write":579,"num_write_kb":14215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":296,"num_bytes_recovered":2555973,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.9","version":"155'535","reported_seq":7289,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805206+0000","last_change":"2024-09-14T09:10:36.806606+0000","last_active":"2024-09-14T09:10:46.805206+0000","last_peered":"2024-09-14T09:10:46.805206+0000","last_clean":"2024-09-14T09:10:46.805206+0000","last_became_active":"2024-09-14T09:10:36.804585+0000","last_became_peered":"2024-09-14T09:10:36.804585+0000","last_unstale":"2024-09-14T09:10:46.805206+0000","last_undegraded":"2024-09-14T09:10:46.805206+0000","last_fullsized":"2024-09-14T09:10:46.805206+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:37.635151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013332999999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":5991,"num_read_kb":50679,"num_write":476,"num_write_kb":15575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":3599888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"155'923","reported_seq":8217,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805303+0000","last_change":"2024-09-14T09:10:24.802207+0000","last_active":"2024-09-14T09:10:46.805303+0000","last_peered":"2024-09-14T09:10:46.805303+0000","last_clean":"2024-09-14T09:10:46.805303+0000","last_became_active":"2024-09-14T09:09:02.793112+0000","last_became_peered":"2024-09-14T09:09:02.793112+0000","last_unstale":"2024-09-14T09:10:46.805303+0000","last_undegraded":"2024-09-14T09:10:46.805303+0000","last_fullsized":"2024-09-14T09:10:46.805303+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:20.589668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001478858,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":9011,"num_read_kb":44883,"num_write":1107,"num_write_kb":15908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":9779638,"num_keys_recovered":46,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"155'481","reported_seq":5574,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.905387+0000","last_change":"2024-09-14T09:10:38.808915+0000","last_active":"2024-09-14T09:10:43.905387+0000","last_peered":"2024-09-14T09:10:43.905387+0000","last_clean":"2024-09-14T09:10:43.905387+0000","last_became_active":"2024-09-14T09:10:38.807014+0000","last_became_peered":"2024-09-14T09:10:38.807014+0000","last_unstale":"2024-09-14T09:10:43.905387+0000","last_undegraded":"2024-09-14T09:10:43.905387+0000","last_fullsized":"2024-09-14T09:10:43.905387+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:33.459042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060512200000000004,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":4794,"num_read_kb":18724,"num_write":499,"num_write_kb":6053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":540832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.c","version":"152'976","reported_seq":17838,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805312+0000","last_change":"2024-09-14T09:10:37.810417+0000","last_active":"2024-09-14T09:10:46.805312+0000","last_peered":"2024-09-14T09:10:46.805312+0000","last_clean":"2024-09-14T09:10:46.805312+0000","last_became_active":"2024-09-14T09:10:37.808431+0000","last_became_peered":"2024-09-14T09:10:37.808431+0000","last_unstale":"2024-09-14T09:10:46.805312+0000","last_undegraded":"2024-09-14T09:10:46.805312+0000","last_fullsized":"2024-09-14T09:10:46.805312+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":976,"log_dups_size":0,"ondisk_log_size":976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:01.165563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017008710000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":13865,"num_read_kb":46941,"num_write":938,"num_write_kb":9955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":415,"num_bytes_recovered":13533184,"num_keys_recovered":116,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"155'519","reported_seq":21759,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.908601+0000","last_change":"2024-09-14T09:10:35.815411+0000","last_active":"2024-09-14T09:10:43.908601+0000","last_peered":"2024-09-14T09:10:43.908601+0000","last_clean":"2024-09-14T09:10:43.908601+0000","last_became_active":"2024-09-14T09:10:35.813901+0000","last_became_peered":"2024-09-14T09:10:35.813901+0000","last_unstale":"2024-09-14T09:10:43.908601+0000","last_undegraded":"2024-09-14T09:10:43.908601+0000","last_fullsized":"2024-09-14T09:10:43.908601+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:37.344370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029838349999999998,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":21382,"num_read_kb":52622,"num_write":626,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":374,"num_bytes_recovered":16325120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.e","version":"151'564","reported_seq":4573,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.908526+0000","last_change":"2024-09-14T09:10:35.813746+0000","last_active":"2024-09-14T09:10:43.908526+0000","last_peered":"2024-09-14T09:10:43.908526+0000","last_clean":"2024-09-14T09:10:43.908526+0000","last_became_active":"2024-09-14T09:10:35.811599+0000","last_became_peered":"2024-09-14T09:10:35.811599+0000","last_unstale":"2024-09-14T09:10:43.908526+0000","last_undegraded":"2024-09-14T09:10:43.908526+0000","last_fullsized":"2024-09-14T09:10:43.908526+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:01.203388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001022088,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":5433,"num_read_kb":39557,"num_write":475,"num_write_kb":12186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":585,"num_bytes_recovered":15375904,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.f","version":"146'391","reported_seq":3667,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807738+0000","last_change":"2024-09-14T09:10:37.813721+0000","last_active":"2024-09-14T09:10:46.807738+0000","last_peered":"2024-09-14T09:10:46.807738+0000","last_clean":"2024-09-14T09:10:46.807738+0000","last_became_active":"2024-09-14T09:10:37.811679+0000","last_became_peered":"2024-09-14T09:10:37.811679+0000","last_unstale":"2024-09-14T09:10:46.807738+0000","last_undegraded":"2024-09-14T09:10:46.807738+0000","last_fullsized":"2024-09-14T09:10:46.807738+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:33:03.454799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010483549999999999,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":2165,"num_read_kb":13861,"num_write":340,"num_write_kb":3973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":1385641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"146'576","reported_seq":10517,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907738+0000","last_change":"2024-09-14T09:10:36.816638+0000","last_active":"2024-09-14T09:10:43.907738+0000","last_peered":"2024-09-14T09:10:43.907738+0000","last_clean":"2024-09-14T09:10:43.907738+0000","last_became_active":"2024-09-14T09:10:36.814772+0000","last_became_peered":"2024-09-14T09:10:36.814772+0000","last_unstale":"2024-09-14T09:10:43.907738+0000","last_undegraded":"2024-09-14T09:10:43.907738+0000","last_fullsized":"2024-09-14T09:10:43.907738+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:22.267528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024013369999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":9710,"num_read_kb":41453,"num_write":717,"num_write_kb":14547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":515,"num_bytes_recovered":6681771,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.11","version":"151'842","reported_seq":10949,"reported_epoch":170,"state":"remapped+peering","last_fresh":"2024-09-14T09:10:42.908037+0000","last_change":"2024-09-14T09:10:43.909151+0000","last_active":"2024-09-14T09:10:43.909151+0000","last_peered":"2024-09-14T09:10:42.908037+0000","last_clean":"2024-09-14T09:10:42.908037+0000","last_became_active":"2024-09-14T09:10:34.807844+0000","last_became_peered":"2024-09-14T09:10:34.807844+0000","last_unstale":"2024-09-14T09:10:42.908037+0000","last_undegraded":"2024-09-14T09:10:42.908037+0000","last_fullsized":"2024-09-14T09:10:42.908037+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001545701,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":12979,"num_read_kb":59033,"num_write":700,"num_write_kb":13832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":497,"num_bytes_recovered":10373286,"num_keys_recovered":102,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":2,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.12","version":"152'480","reported_seq":4972,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907726+0000","last_change":"2024-09-14T09:10:35.811341+0000","last_active":"2024-09-14T09:10:43.907726+0000","last_peered":"2024-09-14T09:10:43.907726+0000","last_clean":"2024-09-14T09:10:43.907726+0000","last_became_active":"2024-09-14T09:10:35.809716+0000","last_became_peered":"2024-09-14T09:10:35.809716+0000","last_unstale":"2024-09-14T09:10:43.907726+0000","last_undegraded":"2024-09-14T09:10:43.907726+0000","last_fullsized":"2024-09-14T09:10:43.907726+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:34.306889+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0036893669999999998,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3997,"num_read_kb":34359,"num_write":407,"num_write_kb":6924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":317,"num_bytes_recovered":2955870,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.13","version":"155'2202","reported_seq":9105,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.908715+0000","last_change":"2024-09-14T09:10:24.806079+0000","last_active":"2024-09-14T09:10:43.908715+0000","last_peered":"2024-09-14T09:10:43.908715+0000","last_clean":"2024-09-14T09:10:43.908715+0000","last_became_active":"2024-09-14T09:09:03.794283+0000","last_became_peered":"2024-09-14T09:09:03.794283+0000","last_unstale":"2024-09-14T09:10:43.908715+0000","last_undegraded":"2024-09-14T09:10:43.908715+0000","last_fullsized":"2024-09-14T09:10:43.908715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":2202,"log_dups_size":0,"ondisk_log_size":2202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:28.286762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013071960000000001,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":16728,"num_read_kb":45108,"num_write":3399,"num_write_kb":14849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":4151803,"num_keys_recovered":53,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":880,"num_object_clones":0,"num_object_copies":1760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":880,"num_whiteouts":876,"num_read":421320,"num_read_kb":1460227,"num_write":27245,"num_write_kb":494223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10427,"num_bytes_recovered":245332849,"num_keys_recovered":856,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12266,"internal_metadata":0},"log_size":24598,"ondisk_log_size":24598,"up":64,"acting":59,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":87,"seq":373662154772,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39200,"kb_used_data":1996,"kb_used_omap":24,"kb_used_meta":37159,"kb_avail":94332640,"statfs":{"total":96636764160,"available":96596623360,"internally_reserved":0,"allocated":2043904,"data_stored":861860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24922,"internal_metadata":38051494},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96244,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94275596,"statfs":{"total":96636764160,"available":96538210304,"internally_reserved":0,"allocated":2654208,"data_stored":1457519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607595,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51824,"kb_used_data":2580,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320016,"statfs":{"total":96636764160,"available":96583696384,"internally_reserved":0,"allocated":2641920,"data_stored":1452247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607597,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47092,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324748,"statfs":{"total":96636764160,"available":96588541952,"internally_reserved":0,"allocated":2060288,"data_stored":867151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607595,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95600,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94276240,"statfs":{"total":96636764160,"available":96538869760,"internally_reserved":0,"allocated":2056192,"data_stored":867132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":95812039},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640300,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73480,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298360,"statfs":{"total":96636764160,"available":96561520640,"internally_reserved":0,"allocated":2084864,"data_stored":877409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12266,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T09:10:47.362 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-14T09:10:47.708 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:10:47.708 INFO:teuthology.orchestra.run.smithi116.stdout:{"fsid":"c991ac1c-978d-48b3-a540-4d3d4755e125","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":210,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":175,"num_osds":6,"num_up_osds":6,"osd_up_since":1726304955,"num_in_osds":6,"osd_in_since":1726305031,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":36},{"state_name":"remapped+peering","count":5}],"num_pgs":41,"num_pools":3,"num_objects":884,"data_bytes":590406,"bytes_used":413102080,"bytes_avail":579407482880,"bytes_total":579820584960,"inactive_pgs_ratio":0.12195122241973877},"fsmap":{"epoch":1,"btime":"2024-09-14T09:07:16:982234+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-14T09:10:15.207364+0000","services":{}},"progress_events":{}} 2024-09-14T09:10:47.721 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-14T09:10:47.721 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T09:10:48.006 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:10:48.007 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T09:10:48.019 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":270,"stamp":"2024-09-14T09:10:47.213523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":884,"num_object_clones":0,"num_object_copies":1768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":884,"num_whiteouts":876,"num_read":421386,"num_read_kb":1460282,"num_write":27348,"num_write_kb":495853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10436,"num_bytes_recovered":247694321,"num_keys_recovered":856,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24673,"ondisk_log_size":24673,"up":82,"acting":77,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":403440,"kb_used_data":13224,"kb_used_omap":32,"kb_used_meta":390047,"kb_avail":565827600,"statfs":{"total":579820584960,"available":579407462400,"internally_reserved":0,"allocated":13541376,"data_stored":6383318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32895,"internal_metadata":399409025},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000714"},"pg_stats":[{"pgid":"3.1f","version":"155'762","reported_seq":6889,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907856+0000","last_change":"2024-09-14T09:10:34.813822+0000","last_active":"2024-09-14T09:10:43.907856+0000","last_peered":"2024-09-14T09:10:43.907856+0000","last_clean":"2024-09-14T09:10:43.907856+0000","last_became_active":"2024-09-14T09:10:34.812378+0000","last_became_peered":"2024-09-14T09:10:34.812378+0000","last_unstale":"2024-09-14T09:10:43.907856+0000","last_undegraded":"2024-09-14T09:10:43.907856+0000","last_fullsized":"2024-09-14T09:10:43.907856+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:30.774451+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0042793429999999997,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":6424,"num_read_kb":42400,"num_write":961,"num_write_kb":16264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":566,"num_bytes_recovered":18399808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.1e","version":"151'487","reported_seq":8287,"reported_epoch":171,"state":"remapped+peering","last_fresh":"2024-09-14T09:10:42.905308+0000","last_change":"2024-09-14T09:10:43.905969+0000","last_active":"2024-09-14T09:10:42.905308+0000","last_peered":"2024-09-14T09:10:42.161579+0000","last_clean":"2024-09-14T09:10:42.161579+0000","last_became_active":"2024-09-14T09:10:38.806696+0000","last_became_peered":"2024-09-14T09:10:38.806696+0000","last_unstale":"2024-09-14T09:10:42.905308+0000","last_undegraded":"2024-09-14T09:10:42.905308+0000","last_fullsized":"2024-09-14T09:10:42.905308+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001792068,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":7749,"num_read_kb":36057,"num_write":459,"num_write_kb":5529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":280,"num_bytes_recovered":7376960,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.1d","version":"155'678","reported_seq":7042,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907710+0000","last_change":"2024-09-14T09:10:36.808697+0000","last_active":"2024-09-14T09:10:43.907710+0000","last_peered":"2024-09-14T09:10:43.907710+0000","last_clean":"2024-09-14T09:10:43.907710+0000","last_became_active":"2024-09-14T09:10:36.806572+0000","last_became_peered":"2024-09-14T09:10:36.806572+0000","last_unstale":"2024-09-14T09:10:43.907710+0000","last_undegraded":"2024-09-14T09:10:43.907710+0000","last_fullsized":"2024-09-14T09:10:43.907710+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:14.168101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097120599999999996,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":10173,"num_read_kb":74789,"num_write":721,"num_write_kb":20037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":358,"num_bytes_recovered":31416461,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.1c","version":"155'783","reported_seq":6756,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.909160+0000","last_change":"2024-09-14T09:10:38.808376+0000","last_active":"2024-09-14T09:10:43.909160+0000","last_peered":"2024-09-14T09:10:43.909160+0000","last_clean":"2024-09-14T09:10:43.909160+0000","last_became_active":"2024-09-14T09:10:38.806707+0000","last_became_peered":"2024-09-14T09:10:38.806707+0000","last_unstale":"2024-09-14T09:10:43.909160+0000","last_undegraded":"2024-09-14T09:10:43.909160+0000","last_fullsized":"2024-09-14T09:10:43.909160+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:32.661615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017015209999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":7807,"num_read_kb":21023,"num_write":814,"num_write_kb":12470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":2849546,"num_keys_recovered":242,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.1b","version":"152'752","reported_seq":6445,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.905328+0000","last_change":"2024-09-14T09:10:36.810578+0000","last_active":"2024-09-14T09:10:43.905328+0000","last_peered":"2024-09-14T09:10:43.905328+0000","last_clean":"2024-09-14T09:10:43.905328+0000","last_became_active":"2024-09-14T09:10:36.808440+0000","last_became_peered":"2024-09-14T09:10:36.808440+0000","last_unstale":"2024-09-14T09:10:43.905328+0000","last_undegraded":"2024-09-14T09:10:43.905328+0000","last_fullsized":"2024-09-14T09:10:43.905328+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:32.467757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084872500000000004,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":7088,"num_read_kb":42687,"num_write":978,"num_write_kb":14384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":417,"num_bytes_recovered":16991946,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.1a","version":"155'1100","reported_seq":46320,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907702+0000","last_change":"2024-09-14T09:10:36.817314+0000","last_active":"2024-09-14T09:10:43.907702+0000","last_peered":"2024-09-14T09:10:43.907702+0000","last_clean":"2024-09-14T09:10:43.907702+0000","last_became_active":"2024-09-14T09:10:36.814993+0000","last_became_peered":"2024-09-14T09:10:36.814993+0000","last_unstale":"2024-09-14T09:10:43.907702+0000","last_undegraded":"2024-09-14T09:10:43.907702+0000","last_fullsized":"2024-09-14T09:10:43.907702+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1100,"log_dups_size":0,"ondisk_log_size":1100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:01.751040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002639925,"stat_sum":{"num_bytes":19,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":23,"num_read":46462,"num_read_kb":92242,"num_write":1032,"num_write_kb":40131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":432,"num_bytes_recovered":16835316,"num_keys_recovered":71,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.19","version":"150'528","reported_seq":8991,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.903195+0000","last_change":"2024-09-14T09:10:35.807979+0000","last_active":"2024-09-14T09:10:43.903195+0000","last_peered":"2024-09-14T09:10:43.903195+0000","last_clean":"2024-09-14T09:10:43.903195+0000","last_became_active":"2024-09-14T09:10:35.806694+0000","last_became_peered":"2024-09-14T09:10:35.806694+0000","last_unstale":"2024-09-14T09:10:43.903195+0000","last_undegraded":"2024-09-14T09:10:43.903195+0000","last_fullsized":"2024-09-14T09:10:43.903195+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:30.197773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081109400000000005,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":8055,"num_read_kb":52380,"num_write":658,"num_write_kb":14132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.18","version":"150'793","reported_seq":6492,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.905272+0000","last_change":"2024-09-14T09:10:38.808926+0000","last_active":"2024-09-14T09:10:43.905272+0000","last_peered":"2024-09-14T09:10:43.905272+0000","last_clean":"2024-09-14T09:10:43.905272+0000","last_became_active":"2024-09-14T09:10:38.807058+0000","last_became_peered":"2024-09-14T09:10:38.807058+0000","last_unstale":"2024-09-14T09:10:43.905272+0000","last_undegraded":"2024-09-14T09:10:43.905272+0000","last_fullsized":"2024-09-14T09:10:43.905272+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:21.481048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001015438,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":7244,"num_read_kb":25042,"num_write":1081,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.17","version":"152'859","reported_seq":72049,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907791+0000","last_change":"2024-09-14T09:10:37.809948+0000","last_active":"2024-09-14T09:10:43.907791+0000","last_peered":"2024-09-14T09:10:43.907791+0000","last_clean":"2024-09-14T09:10:43.907791+0000","last_became_active":"2024-09-14T09:10:37.807994+0000","last_became_peered":"2024-09-14T09:10:37.807994+0000","last_unstale":"2024-09-14T09:10:43.907791+0000","last_undegraded":"2024-09-14T09:10:43.907791+0000","last_fullsized":"2024-09-14T09:10:43.907791+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:21.137544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017200060000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":74396,"num_read_kb":113736,"num_write":1000,"num_write_kb":72684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":501,"num_bytes_recovered":30088824,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.16","version":"145'552","reported_seq":21625,"reported_epoch":170,"state":"remapped+peering","last_fresh":"2024-09-14T09:10:42.161524+0000","last_change":"2024-09-14T09:10:43.906125+0000","last_active":"2024-09-14T09:10:43.906125+0000","last_peered":"2024-09-14T09:10:42.161524+0000","last_clean":"2024-09-14T09:10:42.161524+0000","last_became_active":"2024-09-14T09:10:35.808145+0000","last_became_peered":"2024-09-14T09:10:35.808145+0000","last_unstale":"2024-09-14T09:10:42.161524+0000","last_undegraded":"2024-09-14T09:10:42.161524+0000","last_fullsized":"2024-09-14T09:10:42.161524+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00073203199999999997,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":21018,"num_read_kb":58767,"num_write":570,"num_write_kb":35397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":7392256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,5],"up_primary":2,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.15","version":"150'952","reported_seq":57761,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806425+0000","last_change":"2024-09-14T09:10:35.811768+0000","last_active":"2024-09-14T09:10:46.806425+0000","last_peered":"2024-09-14T09:10:46.806425+0000","last_clean":"2024-09-14T09:10:46.806425+0000","last_became_active":"2024-09-14T09:10:35.810160+0000","last_became_peered":"2024-09-14T09:10:35.810160+0000","last_unstale":"2024-09-14T09:10:46.806425+0000","last_undegraded":"2024-09-14T09:10:46.806425+0000","last_fullsized":"2024-09-14T09:10:46.806425+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:21:57.677481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068915899999999995,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":27804,"num_read_kb":68813,"num_write":785,"num_write_kb":21040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"152'650","reported_seq":6232,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.909090+0000","last_change":"2024-09-14T09:10:36.813886+0000","last_active":"2024-09-14T09:10:43.909090+0000","last_peered":"2024-09-14T09:10:43.909090+0000","last_clean":"2024-09-14T09:10:43.909090+0000","last_became_active":"2024-09-14T09:10:36.812242+0000","last_became_peered":"2024-09-14T09:10:36.812242+0000","last_unstale":"2024-09-14T09:10:43.909090+0000","last_undegraded":"2024-09-14T09:10:43.909090+0000","last_fullsized":"2024-09-14T09:10:43.909090+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:17.220451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067904769999999996,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":7788,"num_read_kb":24568,"num_write":614,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":4454614,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":174,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.909058+0000","last_change":"2024-09-14T09:10:36.818028+0000","last_active":"2024-09-14T09:10:43.909058+0000","last_peered":"2024-09-14T09:10:43.909058+0000","last_clean":"2024-09-14T09:10:43.909058+0000","last_became_active":"2024-09-14T09:10:36.817650+0000","last_became_peered":"2024-09-14T09:10:36.817650+0000","last_unstale":"2024-09-14T09:10:43.909058+0000","last_undegraded":"2024-09-14T09:10:43.909058+0000","last_fullsized":"2024-09-14T09:10:43.909058+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:05.095616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061552199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"155'693","reported_seq":5991,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.903209+0000","last_change":"2024-09-14T09:10:35.809230+0000","last_active":"2024-09-14T09:10:43.903209+0000","last_peered":"2024-09-14T09:10:43.903209+0000","last_clean":"2024-09-14T09:10:43.903209+0000","last_became_active":"2024-09-14T09:10:35.806954+0000","last_became_peered":"2024-09-14T09:10:35.806954+0000","last_unstale":"2024-09-14T09:10:43.903209+0000","last_undegraded":"2024-09-14T09:10:43.903209+0000","last_fullsized":"2024-09-14T09:10:43.903209+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:07.626647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010903849999999999,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":6998,"num_read_kb":15727,"num_write":528,"num_write_kb":3578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":341,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.903286+0000","last_change":"2024-09-14T09:10:33.814092+0000","last_active":"2024-09-14T09:10:43.903286+0000","last_peered":"2024-09-14T09:10:43.903286+0000","last_clean":"2024-09-14T09:10:43.903286+0000","last_became_active":"2024-09-14T09:10:33.813809+0000","last_became_peered":"2024-09-14T09:10:33.813809+0000","last_unstale":"2024-09-14T09:10:43.903286+0000","last_undegraded":"2024-09-14T09:10:43.903286+0000","last_fullsized":"2024-09-14T09:10:43.903286+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:55.810760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042190199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"150'724","reported_seq":8919,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.903279+0000","last_change":"2024-09-14T09:10:36.803816+0000","last_active":"2024-09-14T09:10:43.903279+0000","last_peered":"2024-09-14T09:10:43.903279+0000","last_clean":"2024-09-14T09:10:43.903279+0000","last_became_active":"2024-09-14T09:10:36.802005+0000","last_became_peered":"2024-09-14T09:10:36.802005+0000","last_unstale":"2024-09-14T09:10:43.903279+0000","last_undegraded":"2024-09-14T09:10:43.903279+0000","last_fullsized":"2024-09-14T09:10:43.903279+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:36.656797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064676800000000004,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":9017,"num_read_kb":43383,"num_write":832,"num_write_kb":5619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":174,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.908497+0000","last_change":"2024-09-14T09:10:36.805095+0000","last_active":"2024-09-14T09:10:43.908497+0000","last_peered":"2024-09-14T09:10:43.908497+0000","last_clean":"2024-09-14T09:10:43.908497+0000","last_became_active":"2024-09-14T09:10:36.804806+0000","last_became_peered":"2024-09-14T09:10:36.804806+0000","last_unstale":"2024-09-14T09:10:43.908497+0000","last_undegraded":"2024-09-14T09:10:43.908497+0000","last_fullsized":"2024-09-14T09:10:43.908497+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:45.011748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"146'1024","reported_seq":7035,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.903218+0000","last_change":"2024-09-14T09:10:34.807002+0000","last_active":"2024-09-14T09:10:43.903218+0000","last_peered":"2024-09-14T09:10:43.903218+0000","last_clean":"2024-09-14T09:10:43.903218+0000","last_became_active":"2024-09-14T09:10:34.805260+0000","last_became_peered":"2024-09-14T09:10:34.805260+0000","last_unstale":"2024-09-14T09:10:43.903218+0000","last_undegraded":"2024-09-14T09:10:43.903218+0000","last_fullsized":"2024-09-14T09:10:43.903218+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:21.009093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093108500000000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":7917,"num_read_kb":40050,"num_write":1441,"num_write_kb":11556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":306,"num_bytes_recovered":7127704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806176+0000","last_change":"2024-09-14T09:10:32.806891+0000","last_active":"2024-09-14T09:10:46.806176+0000","last_peered":"2024-09-14T09:10:46.806176+0000","last_clean":"2024-09-14T09:10:46.806176+0000","last_became_active":"2024-09-14T09:10:32.806571+0000","last_became_peered":"2024-09-14T09:10:32.806571+0000","last_unstale":"2024-09-14T09:10:46.806176+0000","last_undegraded":"2024-09-14T09:10:46.806176+0000","last_fullsized":"2024-09-14T09:10:46.806176+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:52:32.672580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"152'830","reported_seq":10428,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907618+0000","last_change":"2024-09-14T09:10:36.803840+0000","last_active":"2024-09-14T09:10:43.907618+0000","last_peered":"2024-09-14T09:10:43.907618+0000","last_clean":"2024-09-14T09:10:43.907618+0000","last_became_active":"2024-09-14T09:10:36.801544+0000","last_became_peered":"2024-09-14T09:10:36.801544+0000","last_unstale":"2024-09-14T09:10:43.907618+0000","last_undegraded":"2024-09-14T09:10:43.907618+0000","last_fullsized":"2024-09-14T09:10:43.907618+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:22.359490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001749932,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":11788,"num_read_kb":51374,"num_write":731,"num_write_kb":9360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":344,"num_bytes_recovered":2441232,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.3","version":"155'1550","reported_seq":11337,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805742+0000","last_change":"2024-09-14T09:10:37.810044+0000","last_active":"2024-09-14T09:10:46.805742+0000","last_peered":"2024-09-14T09:10:46.805742+0000","last_clean":"2024-09-14T09:10:46.805742+0000","last_became_active":"2024-09-14T09:10:37.808020+0000","last_became_peered":"2024-09-14T09:10:37.808020+0000","last_unstale":"2024-09-14T09:10:46.805742+0000","last_undegraded":"2024-09-14T09:10:46.805742+0000","last_fullsized":"2024-09-14T09:10:46.805742+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1550,"log_dups_size":0,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:37.794250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011665530000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":29,"num_read":16156,"num_read_kb":41503,"num_write":1957,"num_write_kb":7195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":2340129,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":333,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805453+0000","last_change":"2024-09-14T09:07:37.260986+0000","last_active":"2024-09-14T09:10:46.805453+0000","last_peered":"2024-09-14T09:10:46.805453+0000","last_clean":"2024-09-14T09:10:46.805453+0000","last_became_active":"2024-09-14T09:07:35.254256+0000","last_became_peered":"2024-09-14T09:07:35.254256+0000","last_unstale":"2024-09-14T09:10:46.805453+0000","last_undegraded":"2024-09-14T09:10:46.805453+0000","last_fullsized":"2024-09-14T09:10:46.805453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:07.063058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096898500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"152'477","reported_seq":10512,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907533+0000","last_change":"2024-09-14T09:10:34.810738+0000","last_active":"2024-09-14T09:10:43.907533+0000","last_peered":"2024-09-14T09:10:43.907533+0000","last_clean":"2024-09-14T09:10:43.907533+0000","last_became_active":"2024-09-14T09:10:34.808686+0000","last_became_peered":"2024-09-14T09:10:34.808686+0000","last_unstale":"2024-09-14T09:10:43.907533+0000","last_undegraded":"2024-09-14T09:10:43.907533+0000","last_fullsized":"2024-09-14T09:10:43.907533+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:03.253962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011386840000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":9617,"num_read_kb":58850,"num_write":533,"num_write_kb":14690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":275,"num_bytes_recovered":8152899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.905985+0000","last_change":"2024-09-14T09:10:38.806538+0000","last_active":"2024-09-14T09:10:43.905985+0000","last_peered":"2024-09-14T09:10:43.905985+0000","last_clean":"2024-09-14T09:10:43.905985+0000","last_became_active":"2024-09-14T09:10:38.806119+0000","last_became_peered":"2024-09-14T09:10:38.806119+0000","last_unstale":"2024-09-14T09:10:43.905985+0000","last_undegraded":"2024-09-14T09:10:43.905985+0000","last_fullsized":"2024-09-14T09:10:43.905985+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:44.063513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"155'780","reported_seq":7213,"reported_epoch":171,"state":"remapped+peering","last_fresh":"2024-09-14T09:10:42.902699+0000","last_change":"2024-09-14T09:10:43.903710+0000","last_active":"2024-09-14T09:10:42.902699+0000","last_peered":"2024-09-14T09:10:42.902098+0000","last_clean":"2024-09-14T09:10:42.902098+0000","last_became_active":"2024-09-14T09:10:34.807002+0000","last_became_peered":"2024-09-14T09:10:34.807002+0000","last_unstale":"2024-09-14T09:10:42.902699+0000","last_undegraded":"2024-09-14T09:10:42.902699+0000","last_fullsized":"2024-09-14T09:10:42.902699+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000844446,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":7624,"num_read_kb":31794,"num_write":893,"num_write_kb":10927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":230948,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":298,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.906718+0000","last_change":"2024-09-14T09:10:31.806103+0000","last_active":"2024-09-14T09:10:43.906718+0000","last_peered":"2024-09-14T09:10:43.906718+0000","last_clean":"2024-09-14T09:10:43.906718+0000","last_became_active":"2024-09-14T09:10:31.805768+0000","last_became_peered":"2024-09-14T09:10:31.805768+0000","last_unstale":"2024-09-14T09:10:43.906718+0000","last_undegraded":"2024-09-14T09:10:43.906718+0000","last_fullsized":"2024-09-14T09:10:43.906718+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:40.795499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"152'439","reported_seq":2380,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.905327+0000","last_change":"2024-09-14T09:10:38.807701+0000","last_active":"2024-09-14T09:10:43.905327+0000","last_peered":"2024-09-14T09:10:43.905327+0000","last_clean":"2024-09-14T09:10:43.905327+0000","last_became_active":"2024-09-14T09:10:38.805463+0000","last_became_peered":"2024-09-14T09:10:38.805463+0000","last_unstale":"2024-09-14T09:10:43.905327+0000","last_undegraded":"2024-09-14T09:10:43.905327+0000","last_fullsized":"2024-09-14T09:10:43.905327+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:08.537012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012021849999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":3112,"num_read_kb":25090,"num_write":394,"num_write_kb":10842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":1975296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":210,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.908812+0000","last_change":"2024-09-14T09:09:17.798249+0000","last_active":"2024-09-14T09:10:43.908812+0000","last_peered":"2024-09-14T09:10:43.908812+0000","last_clean":"2024-09-14T09:10:43.908812+0000","last_became_active":"2024-09-14T09:09:17.797925+0000","last_became_peered":"2024-09-14T09:09:17.797925+0000","last_unstale":"2024-09-14T09:10:43.908812+0000","last_undegraded":"2024-09-14T09:10:43.908812+0000","last_fullsized":"2024-09-14T09:10:43.908812+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:22.149422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":232,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907624+0000","last_change":"2024-09-14T09:10:31.813147+0000","last_active":"2024-09-14T09:10:43.907624+0000","last_peered":"2024-09-14T09:10:43.907624+0000","last_clean":"2024-09-14T09:10:43.907624+0000","last_became_active":"2024-09-14T09:10:31.808373+0000","last_became_peered":"2024-09-14T09:10:31.808373+0000","last_unstale":"2024-09-14T09:10:43.907624+0000","last_undegraded":"2024-09-14T09:10:43.907624+0000","last_fullsized":"2024-09-14T09:10:43.907624+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_clean_scrub_stamp":"2024-09-14T09:07:29.211432+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:57:57.332555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"151'696","reported_seq":10230,"reported_epoch":171,"state":"remapped+peering","last_fresh":"2024-09-14T09:10:42.902704+0000","last_change":"2024-09-14T09:10:43.903709+0000","last_active":"2024-09-14T09:10:42.902704+0000","last_peered":"2024-09-14T09:10:42.902212+0000","last_clean":"2024-09-14T09:10:42.902212+0000","last_became_active":"2024-09-14T09:10:36.803394+0000","last_became_peered":"2024-09-14T09:10:36.803394+0000","last_unstale":"2024-09-14T09:10:42.902704+0000","last_undegraded":"2024-09-14T09:10:42.902704+0000","last_fullsized":"2024-09-14T09:10:42.902704+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012882099999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":11028,"num_read_kb":52732,"num_write":579,"num_write_kb":14215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":296,"num_bytes_recovered":2555973,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.9","version":"155'535","reported_seq":7289,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805206+0000","last_change":"2024-09-14T09:10:36.806606+0000","last_active":"2024-09-14T09:10:46.805206+0000","last_peered":"2024-09-14T09:10:46.805206+0000","last_clean":"2024-09-14T09:10:46.805206+0000","last_became_active":"2024-09-14T09:10:36.804585+0000","last_became_peered":"2024-09-14T09:10:36.804585+0000","last_unstale":"2024-09-14T09:10:46.805206+0000","last_undegraded":"2024-09-14T09:10:46.805206+0000","last_fullsized":"2024-09-14T09:10:46.805206+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:37.635151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013332999999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":5991,"num_read_kb":50679,"num_write":476,"num_write_kb":15575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":3599888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"155'923","reported_seq":8217,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805303+0000","last_change":"2024-09-14T09:10:24.802207+0000","last_active":"2024-09-14T09:10:46.805303+0000","last_peered":"2024-09-14T09:10:46.805303+0000","last_clean":"2024-09-14T09:10:46.805303+0000","last_became_active":"2024-09-14T09:09:02.793112+0000","last_became_peered":"2024-09-14T09:09:02.793112+0000","last_unstale":"2024-09-14T09:10:46.805303+0000","last_undegraded":"2024-09-14T09:10:46.805303+0000","last_fullsized":"2024-09-14T09:10:46.805303+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:20.589668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001478858,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":9011,"num_read_kb":44883,"num_write":1107,"num_write_kb":15908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":9779638,"num_keys_recovered":46,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"155'481","reported_seq":5574,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.905387+0000","last_change":"2024-09-14T09:10:38.808915+0000","last_active":"2024-09-14T09:10:43.905387+0000","last_peered":"2024-09-14T09:10:43.905387+0000","last_clean":"2024-09-14T09:10:43.905387+0000","last_became_active":"2024-09-14T09:10:38.807014+0000","last_became_peered":"2024-09-14T09:10:38.807014+0000","last_unstale":"2024-09-14T09:10:43.905387+0000","last_undegraded":"2024-09-14T09:10:43.905387+0000","last_fullsized":"2024-09-14T09:10:43.905387+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:33.459042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060512200000000004,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":4794,"num_read_kb":18724,"num_write":499,"num_write_kb":6053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":540832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.c","version":"152'976","reported_seq":17838,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805312+0000","last_change":"2024-09-14T09:10:37.810417+0000","last_active":"2024-09-14T09:10:46.805312+0000","last_peered":"2024-09-14T09:10:46.805312+0000","last_clean":"2024-09-14T09:10:46.805312+0000","last_became_active":"2024-09-14T09:10:37.808431+0000","last_became_peered":"2024-09-14T09:10:37.808431+0000","last_unstale":"2024-09-14T09:10:46.805312+0000","last_undegraded":"2024-09-14T09:10:46.805312+0000","last_fullsized":"2024-09-14T09:10:46.805312+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":976,"log_dups_size":0,"ondisk_log_size":976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:01.165563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017008710000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":13865,"num_read_kb":46941,"num_write":938,"num_write_kb":9955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":415,"num_bytes_recovered":13533184,"num_keys_recovered":116,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"155'519","reported_seq":21759,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.908601+0000","last_change":"2024-09-14T09:10:35.815411+0000","last_active":"2024-09-14T09:10:43.908601+0000","last_peered":"2024-09-14T09:10:43.908601+0000","last_clean":"2024-09-14T09:10:43.908601+0000","last_became_active":"2024-09-14T09:10:35.813901+0000","last_became_peered":"2024-09-14T09:10:35.813901+0000","last_unstale":"2024-09-14T09:10:43.908601+0000","last_undegraded":"2024-09-14T09:10:43.908601+0000","last_fullsized":"2024-09-14T09:10:43.908601+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:37.344370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029838349999999998,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":21382,"num_read_kb":52622,"num_write":626,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":374,"num_bytes_recovered":16325120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.e","version":"151'564","reported_seq":4573,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.908526+0000","last_change":"2024-09-14T09:10:35.813746+0000","last_active":"2024-09-14T09:10:43.908526+0000","last_peered":"2024-09-14T09:10:43.908526+0000","last_clean":"2024-09-14T09:10:43.908526+0000","last_became_active":"2024-09-14T09:10:35.811599+0000","last_became_peered":"2024-09-14T09:10:35.811599+0000","last_unstale":"2024-09-14T09:10:43.908526+0000","last_undegraded":"2024-09-14T09:10:43.908526+0000","last_fullsized":"2024-09-14T09:10:43.908526+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:01.203388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001022088,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":5433,"num_read_kb":39557,"num_write":475,"num_write_kb":12186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":585,"num_bytes_recovered":15375904,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.f","version":"146'391","reported_seq":3667,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807738+0000","last_change":"2024-09-14T09:10:37.813721+0000","last_active":"2024-09-14T09:10:46.807738+0000","last_peered":"2024-09-14T09:10:46.807738+0000","last_clean":"2024-09-14T09:10:46.807738+0000","last_became_active":"2024-09-14T09:10:37.811679+0000","last_became_peered":"2024-09-14T09:10:37.811679+0000","last_unstale":"2024-09-14T09:10:46.807738+0000","last_undegraded":"2024-09-14T09:10:46.807738+0000","last_fullsized":"2024-09-14T09:10:46.807738+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:33:03.454799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010483549999999999,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":2165,"num_read_kb":13861,"num_write":340,"num_write_kb":3973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":1385641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"146'576","reported_seq":10517,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907738+0000","last_change":"2024-09-14T09:10:36.816638+0000","last_active":"2024-09-14T09:10:43.907738+0000","last_peered":"2024-09-14T09:10:43.907738+0000","last_clean":"2024-09-14T09:10:43.907738+0000","last_became_active":"2024-09-14T09:10:36.814772+0000","last_became_peered":"2024-09-14T09:10:36.814772+0000","last_unstale":"2024-09-14T09:10:43.907738+0000","last_undegraded":"2024-09-14T09:10:43.907738+0000","last_fullsized":"2024-09-14T09:10:43.907738+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:22.267528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024013369999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":9710,"num_read_kb":41453,"num_write":717,"num_write_kb":14547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":515,"num_bytes_recovered":6681771,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.11","version":"151'842","reported_seq":10949,"reported_epoch":170,"state":"remapped+peering","last_fresh":"2024-09-14T09:10:42.908037+0000","last_change":"2024-09-14T09:10:43.909151+0000","last_active":"2024-09-14T09:10:43.909151+0000","last_peered":"2024-09-14T09:10:42.908037+0000","last_clean":"2024-09-14T09:10:42.908037+0000","last_became_active":"2024-09-14T09:10:34.807844+0000","last_became_peered":"2024-09-14T09:10:34.807844+0000","last_unstale":"2024-09-14T09:10:42.908037+0000","last_undegraded":"2024-09-14T09:10:42.908037+0000","last_fullsized":"2024-09-14T09:10:42.908037+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001545701,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":12979,"num_read_kb":59033,"num_write":700,"num_write_kb":13832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":497,"num_bytes_recovered":10373286,"num_keys_recovered":102,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":2,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.12","version":"152'480","reported_seq":4972,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.907726+0000","last_change":"2024-09-14T09:10:35.811341+0000","last_active":"2024-09-14T09:10:43.907726+0000","last_peered":"2024-09-14T09:10:43.907726+0000","last_clean":"2024-09-14T09:10:43.907726+0000","last_became_active":"2024-09-14T09:10:35.809716+0000","last_became_peered":"2024-09-14T09:10:35.809716+0000","last_unstale":"2024-09-14T09:10:43.907726+0000","last_undegraded":"2024-09-14T09:10:43.907726+0000","last_fullsized":"2024-09-14T09:10:43.907726+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:34.306889+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0036893669999999998,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3997,"num_read_kb":34359,"num_write":407,"num_write_kb":6924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":317,"num_bytes_recovered":2955870,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.13","version":"155'2202","reported_seq":9105,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-09-14T09:10:43.908715+0000","last_change":"2024-09-14T09:10:24.806079+0000","last_active":"2024-09-14T09:10:43.908715+0000","last_peered":"2024-09-14T09:10:43.908715+0000","last_clean":"2024-09-14T09:10:43.908715+0000","last_became_active":"2024-09-14T09:09:03.794283+0000","last_became_peered":"2024-09-14T09:09:03.794283+0000","last_unstale":"2024-09-14T09:10:43.908715+0000","last_undegraded":"2024-09-14T09:10:43.908715+0000","last_fullsized":"2024-09-14T09:10:43.908715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":2202,"log_dups_size":0,"ondisk_log_size":2202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:28.286762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013071960000000001,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":16728,"num_read_kb":45108,"num_write":3399,"num_write_kb":14849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":4151803,"num_keys_recovered":53,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":880,"num_object_clones":0,"num_object_copies":1760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":880,"num_whiteouts":876,"num_read":421320,"num_read_kb":1460227,"num_write":27245,"num_write_kb":494223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10427,"num_bytes_recovered":245332849,"num_keys_recovered":856,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12266,"internal_metadata":0},"log_size":24598,"ondisk_log_size":24598,"up":64,"acting":59,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":87,"seq":373662154772,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39200,"kb_used_data":1996,"kb_used_omap":24,"kb_used_meta":37159,"kb_avail":94332640,"statfs":{"total":96636764160,"available":96596623360,"internally_reserved":0,"allocated":2043904,"data_stored":861860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24922,"internal_metadata":38051494},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96244,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94275596,"statfs":{"total":96636764160,"available":96538210304,"internally_reserved":0,"allocated":2654208,"data_stored":1457519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607595,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51824,"kb_used_data":2580,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320016,"statfs":{"total":96636764160,"available":96583696384,"internally_reserved":0,"allocated":2641920,"data_stored":1452247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607597,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47092,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324748,"statfs":{"total":96636764160,"available":96588541952,"internally_reserved":0,"allocated":2060288,"data_stored":867151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607595,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95600,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94276240,"statfs":{"total":96636764160,"available":96538869760,"internally_reserved":0,"allocated":2056192,"data_stored":867132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":95812039},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640300,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73480,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298360,"statfs":{"total":96636764160,"available":96561520640,"internally_reserved":0,"allocated":2084864,"data_stored":877409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12266,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T09:10:51.022 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T09:10:51.315 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:10:51.316 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T09:10:51.327 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-09-14T09:10:51.214325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":884,"num_object_clones":0,"num_object_copies":1768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":884,"num_whiteouts":876,"num_read":421386,"num_read_kb":1460282,"num_write":27348,"num_write_kb":495853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11108,"num_bytes_recovered":247694321,"num_keys_recovered":856,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24673,"ondisk_log_size":24673,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":411976,"kb_used_data":13428,"kb_used_omap":32,"kb_used_meta":398367,"kb_avail":565819064,"statfs":{"total":579820584960,"available":579398721536,"internally_reserved":0,"allocated":13750272,"data_stored":6470362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32895,"internal_metadata":407928705},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":672,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.303076"},"pg_stats":[{"pgid":"3.1f","version":"155'762","reported_seq":6895,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.800398+0000","last_change":"2024-09-14T09:10:34.813822+0000","last_active":"2024-09-14T09:10:46.800398+0000","last_peered":"2024-09-14T09:10:46.800398+0000","last_clean":"2024-09-14T09:10:46.800398+0000","last_became_active":"2024-09-14T09:10:34.812378+0000","last_became_peered":"2024-09-14T09:10:34.812378+0000","last_unstale":"2024-09-14T09:10:46.800398+0000","last_undegraded":"2024-09-14T09:10:46.800398+0000","last_fullsized":"2024-09-14T09:10:46.800398+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:30.774451+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0042793429999999997,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":6424,"num_read_kb":42400,"num_write":961,"num_write_kb":16264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":566,"num_bytes_recovered":18399808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"151'487","reported_seq":8533,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.809980+0000","last_change":"2024-09-14T09:10:46.809879+0000","last_active":"2024-09-14T09:10:46.809980+0000","last_peered":"2024-09-14T09:10:46.809980+0000","last_clean":"2024-09-14T09:10:46.809980+0000","last_became_active":"2024-09-14T09:10:46.808487+0000","last_became_peered":"2024-09-14T09:10:46.808487+0000","last_unstale":"2024-09-14T09:10:46.809980+0000","last_undegraded":"2024-09-14T09:10:46.809980+0000","last_fullsized":"2024-09-14T09:10:46.809980+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:16.236725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001792068,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":7749,"num_read_kb":36057,"num_write":459,"num_write_kb":5529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":7376960,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"155'678","reported_seq":7048,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.804472+0000","last_change":"2024-09-14T09:10:36.808697+0000","last_active":"2024-09-14T09:10:46.804472+0000","last_peered":"2024-09-14T09:10:46.804472+0000","last_clean":"2024-09-14T09:10:46.804472+0000","last_became_active":"2024-09-14T09:10:36.806572+0000","last_became_peered":"2024-09-14T09:10:36.806572+0000","last_unstale":"2024-09-14T09:10:46.804472+0000","last_undegraded":"2024-09-14T09:10:46.804472+0000","last_fullsized":"2024-09-14T09:10:46.804472+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:14.168101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097120599999999996,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":10173,"num_read_kb":74789,"num_write":721,"num_write_kb":20037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":358,"num_bytes_recovered":31416461,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"155'783","reported_seq":6762,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807290+0000","last_change":"2024-09-14T09:10:38.808376+0000","last_active":"2024-09-14T09:10:46.807290+0000","last_peered":"2024-09-14T09:10:46.807290+0000","last_clean":"2024-09-14T09:10:46.807290+0000","last_became_active":"2024-09-14T09:10:38.806707+0000","last_became_peered":"2024-09-14T09:10:38.806707+0000","last_unstale":"2024-09-14T09:10:46.807290+0000","last_undegraded":"2024-09-14T09:10:46.807290+0000","last_fullsized":"2024-09-14T09:10:46.807290+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:32.661615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017015209999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":7807,"num_read_kb":21023,"num_write":814,"num_write_kb":12470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":2849546,"num_keys_recovered":242,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"152'752","reported_seq":6451,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806513+0000","last_change":"2024-09-14T09:10:36.810578+0000","last_active":"2024-09-14T09:10:46.806513+0000","last_peered":"2024-09-14T09:10:46.806513+0000","last_clean":"2024-09-14T09:10:46.806513+0000","last_became_active":"2024-09-14T09:10:36.808440+0000","last_became_peered":"2024-09-14T09:10:36.808440+0000","last_unstale":"2024-09-14T09:10:46.806513+0000","last_undegraded":"2024-09-14T09:10:46.806513+0000","last_fullsized":"2024-09-14T09:10:46.806513+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:32.467757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084872500000000004,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":7088,"num_read_kb":42687,"num_write":978,"num_write_kb":14384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":417,"num_bytes_recovered":16991946,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"155'1100","reported_seq":46326,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806116+0000","last_change":"2024-09-14T09:10:36.817314+0000","last_active":"2024-09-14T09:10:46.806116+0000","last_peered":"2024-09-14T09:10:46.806116+0000","last_clean":"2024-09-14T09:10:46.806116+0000","last_became_active":"2024-09-14T09:10:36.814993+0000","last_became_peered":"2024-09-14T09:10:36.814993+0000","last_unstale":"2024-09-14T09:10:46.806116+0000","last_undegraded":"2024-09-14T09:10:46.806116+0000","last_fullsized":"2024-09-14T09:10:46.806116+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1100,"log_dups_size":0,"ondisk_log_size":1100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:01.751040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002639925,"stat_sum":{"num_bytes":19,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":23,"num_read":46462,"num_read_kb":92242,"num_write":1032,"num_write_kb":40131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":432,"num_bytes_recovered":16835316,"num_keys_recovered":71,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"150'528","reported_seq":8997,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806548+0000","last_change":"2024-09-14T09:10:35.807979+0000","last_active":"2024-09-14T09:10:46.806548+0000","last_peered":"2024-09-14T09:10:46.806548+0000","last_clean":"2024-09-14T09:10:46.806548+0000","last_became_active":"2024-09-14T09:10:35.806694+0000","last_became_peered":"2024-09-14T09:10:35.806694+0000","last_unstale":"2024-09-14T09:10:46.806548+0000","last_undegraded":"2024-09-14T09:10:46.806548+0000","last_fullsized":"2024-09-14T09:10:46.806548+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:30.197773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081109400000000005,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":8055,"num_read_kb":52380,"num_write":658,"num_write_kb":14132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"150'793","reported_seq":6498,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806101+0000","last_change":"2024-09-14T09:10:38.808926+0000","last_active":"2024-09-14T09:10:46.806101+0000","last_peered":"2024-09-14T09:10:46.806101+0000","last_clean":"2024-09-14T09:10:46.806101+0000","last_became_active":"2024-09-14T09:10:38.807058+0000","last_became_peered":"2024-09-14T09:10:38.807058+0000","last_unstale":"2024-09-14T09:10:46.806101+0000","last_undegraded":"2024-09-14T09:10:46.806101+0000","last_fullsized":"2024-09-14T09:10:46.806101+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:21.481048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001015438,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":7244,"num_read_kb":25042,"num_write":1081,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"152'859","reported_seq":72055,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.800329+0000","last_change":"2024-09-14T09:10:37.809948+0000","last_active":"2024-09-14T09:10:46.800329+0000","last_peered":"2024-09-14T09:10:46.800329+0000","last_clean":"2024-09-14T09:10:46.800329+0000","last_became_active":"2024-09-14T09:10:37.807994+0000","last_became_peered":"2024-09-14T09:10:37.807994+0000","last_unstale":"2024-09-14T09:10:46.800329+0000","last_undegraded":"2024-09-14T09:10:46.800329+0000","last_fullsized":"2024-09-14T09:10:46.800329+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:21.137544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017200060000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":74396,"num_read_kb":113736,"num_write":1000,"num_write_kb":72684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":501,"num_bytes_recovered":30088824,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"145'552","reported_seq":21638,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.810940+0000","last_change":"2024-09-14T09:10:46.810252+0000","last_active":"2024-09-14T09:10:46.810940+0000","last_peered":"2024-09-14T09:10:46.810940+0000","last_clean":"2024-09-14T09:10:46.810940+0000","last_became_active":"2024-09-14T09:10:46.808488+0000","last_became_peered":"2024-09-14T09:10:46.808488+0000","last_unstale":"2024-09-14T09:10:46.810940+0000","last_undegraded":"2024-09-14T09:10:46.810940+0000","last_fullsized":"2024-09-14T09:10:46.810940+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:21.120854+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00073203199999999997,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":21018,"num_read_kb":58767,"num_write":570,"num_write_kb":35397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":448,"num_bytes_recovered":7392256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"150'952","reported_seq":57761,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806425+0000","last_change":"2024-09-14T09:10:35.811768+0000","last_active":"2024-09-14T09:10:46.806425+0000","last_peered":"2024-09-14T09:10:46.806425+0000","last_clean":"2024-09-14T09:10:46.806425+0000","last_became_active":"2024-09-14T09:10:35.810160+0000","last_became_peered":"2024-09-14T09:10:35.810160+0000","last_unstale":"2024-09-14T09:10:46.806425+0000","last_undegraded":"2024-09-14T09:10:46.806425+0000","last_fullsized":"2024-09-14T09:10:46.806425+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:21:57.677481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068915899999999995,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":27804,"num_read_kb":68813,"num_write":785,"num_write_kb":21040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"152'650","reported_seq":6238,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807155+0000","last_change":"2024-09-14T09:10:36.813886+0000","last_active":"2024-09-14T09:10:46.807155+0000","last_peered":"2024-09-14T09:10:46.807155+0000","last_clean":"2024-09-14T09:10:46.807155+0000","last_became_active":"2024-09-14T09:10:36.812242+0000","last_became_peered":"2024-09-14T09:10:36.812242+0000","last_unstale":"2024-09-14T09:10:46.807155+0000","last_undegraded":"2024-09-14T09:10:46.807155+0000","last_fullsized":"2024-09-14T09:10:46.807155+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:17.220451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067904769999999996,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":7788,"num_read_kb":24568,"num_write":614,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":4454614,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":180,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806839+0000","last_change":"2024-09-14T09:10:36.818028+0000","last_active":"2024-09-14T09:10:46.806839+0000","last_peered":"2024-09-14T09:10:46.806839+0000","last_clean":"2024-09-14T09:10:46.806839+0000","last_became_active":"2024-09-14T09:10:36.817650+0000","last_became_peered":"2024-09-14T09:10:36.817650+0000","last_unstale":"2024-09-14T09:10:46.806839+0000","last_undegraded":"2024-09-14T09:10:46.806839+0000","last_fullsized":"2024-09-14T09:10:46.806839+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:05.095616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061552199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"155'693","reported_seq":5997,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806743+0000","last_change":"2024-09-14T09:10:35.809230+0000","last_active":"2024-09-14T09:10:46.806743+0000","last_peered":"2024-09-14T09:10:46.806743+0000","last_clean":"2024-09-14T09:10:46.806743+0000","last_became_active":"2024-09-14T09:10:35.806954+0000","last_became_peered":"2024-09-14T09:10:35.806954+0000","last_unstale":"2024-09-14T09:10:46.806743+0000","last_undegraded":"2024-09-14T09:10:46.806743+0000","last_fullsized":"2024-09-14T09:10:46.806743+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:07.626647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010903849999999999,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":6998,"num_read_kb":15727,"num_write":528,"num_write_kb":3578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":347,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806946+0000","last_change":"2024-09-14T09:10:33.814092+0000","last_active":"2024-09-14T09:10:46.806946+0000","last_peered":"2024-09-14T09:10:46.806946+0000","last_clean":"2024-09-14T09:10:46.806946+0000","last_became_active":"2024-09-14T09:10:33.813809+0000","last_became_peered":"2024-09-14T09:10:33.813809+0000","last_unstale":"2024-09-14T09:10:46.806946+0000","last_undegraded":"2024-09-14T09:10:46.806946+0000","last_fullsized":"2024-09-14T09:10:46.806946+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:55.810760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042190199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"150'724","reported_seq":8925,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807092+0000","last_change":"2024-09-14T09:10:36.803816+0000","last_active":"2024-09-14T09:10:46.807092+0000","last_peered":"2024-09-14T09:10:46.807092+0000","last_clean":"2024-09-14T09:10:46.807092+0000","last_became_active":"2024-09-14T09:10:36.802005+0000","last_became_peered":"2024-09-14T09:10:36.802005+0000","last_unstale":"2024-09-14T09:10:46.807092+0000","last_undegraded":"2024-09-14T09:10:46.807092+0000","last_fullsized":"2024-09-14T09:10:46.807092+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:36.656797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064676800000000004,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":9017,"num_read_kb":43383,"num_write":832,"num_write_kb":5619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":180,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806861+0000","last_change":"2024-09-14T09:10:36.805095+0000","last_active":"2024-09-14T09:10:46.806861+0000","last_peered":"2024-09-14T09:10:46.806861+0000","last_clean":"2024-09-14T09:10:46.806861+0000","last_became_active":"2024-09-14T09:10:36.804806+0000","last_became_peered":"2024-09-14T09:10:36.804806+0000","last_unstale":"2024-09-14T09:10:46.806861+0000","last_undegraded":"2024-09-14T09:10:46.806861+0000","last_fullsized":"2024-09-14T09:10:46.806861+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:45.011748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"146'1024","reported_seq":7041,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807250+0000","last_change":"2024-09-14T09:10:34.807002+0000","last_active":"2024-09-14T09:10:46.807250+0000","last_peered":"2024-09-14T09:10:46.807250+0000","last_clean":"2024-09-14T09:10:46.807250+0000","last_became_active":"2024-09-14T09:10:34.805260+0000","last_became_peered":"2024-09-14T09:10:34.805260+0000","last_unstale":"2024-09-14T09:10:46.807250+0000","last_undegraded":"2024-09-14T09:10:46.807250+0000","last_fullsized":"2024-09-14T09:10:46.807250+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:21.009093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093108500000000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":7917,"num_read_kb":40050,"num_write":1441,"num_write_kb":11556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":306,"num_bytes_recovered":7127704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806176+0000","last_change":"2024-09-14T09:10:32.806891+0000","last_active":"2024-09-14T09:10:46.806176+0000","last_peered":"2024-09-14T09:10:46.806176+0000","last_clean":"2024-09-14T09:10:46.806176+0000","last_became_active":"2024-09-14T09:10:32.806571+0000","last_became_peered":"2024-09-14T09:10:32.806571+0000","last_unstale":"2024-09-14T09:10:46.806176+0000","last_undegraded":"2024-09-14T09:10:46.806176+0000","last_fullsized":"2024-09-14T09:10:46.806176+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:52:32.672580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"152'830","reported_seq":10434,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.804148+0000","last_change":"2024-09-14T09:10:36.803840+0000","last_active":"2024-09-14T09:10:46.804148+0000","last_peered":"2024-09-14T09:10:46.804148+0000","last_clean":"2024-09-14T09:10:46.804148+0000","last_became_active":"2024-09-14T09:10:36.801544+0000","last_became_peered":"2024-09-14T09:10:36.801544+0000","last_unstale":"2024-09-14T09:10:46.804148+0000","last_undegraded":"2024-09-14T09:10:46.804148+0000","last_fullsized":"2024-09-14T09:10:46.804148+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:22.359490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001749932,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":11788,"num_read_kb":51374,"num_write":731,"num_write_kb":9360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":344,"num_bytes_recovered":2441232,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"155'1550","reported_seq":11337,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805742+0000","last_change":"2024-09-14T09:10:37.810044+0000","last_active":"2024-09-14T09:10:46.805742+0000","last_peered":"2024-09-14T09:10:46.805742+0000","last_clean":"2024-09-14T09:10:46.805742+0000","last_became_active":"2024-09-14T09:10:37.808020+0000","last_became_peered":"2024-09-14T09:10:37.808020+0000","last_unstale":"2024-09-14T09:10:46.805742+0000","last_undegraded":"2024-09-14T09:10:46.805742+0000","last_fullsized":"2024-09-14T09:10:46.805742+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1550,"log_dups_size":0,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:37.794250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011665530000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":29,"num_read":16156,"num_read_kb":41503,"num_write":1957,"num_write_kb":7195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":2340129,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":333,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805453+0000","last_change":"2024-09-14T09:07:37.260986+0000","last_active":"2024-09-14T09:10:46.805453+0000","last_peered":"2024-09-14T09:10:46.805453+0000","last_clean":"2024-09-14T09:10:46.805453+0000","last_became_active":"2024-09-14T09:07:35.254256+0000","last_became_peered":"2024-09-14T09:07:35.254256+0000","last_unstale":"2024-09-14T09:10:46.805453+0000","last_undegraded":"2024-09-14T09:10:46.805453+0000","last_fullsized":"2024-09-14T09:10:46.805453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:07.063058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096898500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"152'477","reported_seq":10518,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.800187+0000","last_change":"2024-09-14T09:10:34.810738+0000","last_active":"2024-09-14T09:10:46.800187+0000","last_peered":"2024-09-14T09:10:46.800187+0000","last_clean":"2024-09-14T09:10:46.800187+0000","last_became_active":"2024-09-14T09:10:34.808686+0000","last_became_peered":"2024-09-14T09:10:34.808686+0000","last_unstale":"2024-09-14T09:10:46.800187+0000","last_undegraded":"2024-09-14T09:10:46.800187+0000","last_fullsized":"2024-09-14T09:10:46.800187+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:03.253962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011386840000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":9617,"num_read_kb":58850,"num_write":533,"num_write_kb":14690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":275,"num_bytes_recovered":8152899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806365+0000","last_change":"2024-09-14T09:10:38.806538+0000","last_active":"2024-09-14T09:10:46.806365+0000","last_peered":"2024-09-14T09:10:46.806365+0000","last_clean":"2024-09-14T09:10:46.806365+0000","last_became_active":"2024-09-14T09:10:38.806119+0000","last_became_peered":"2024-09-14T09:10:38.806119+0000","last_unstale":"2024-09-14T09:10:46.806365+0000","last_undegraded":"2024-09-14T09:10:46.806365+0000","last_fullsized":"2024-09-14T09:10:46.806365+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:44.063513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"155'780","reported_seq":7525,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.810380+0000","last_change":"2024-09-14T09:10:46.810281+0000","last_active":"2024-09-14T09:10:46.810380+0000","last_peered":"2024-09-14T09:10:46.810380+0000","last_clean":"2024-09-14T09:10:46.810380+0000","last_became_active":"2024-09-14T09:10:46.808545+0000","last_became_peered":"2024-09-14T09:10:46.808545+0000","last_unstale":"2024-09-14T09:10:46.810380+0000","last_undegraded":"2024-09-14T09:10:46.810380+0000","last_fullsized":"2024-09-14T09:10:46.810380+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:14.999438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000844446,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":7624,"num_read_kb":31794,"num_write":893,"num_write_kb":10927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":490,"num_bytes_recovered":230948,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":304,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.804216+0000","last_change":"2024-09-14T09:10:31.806103+0000","last_active":"2024-09-14T09:10:46.804216+0000","last_peered":"2024-09-14T09:10:46.804216+0000","last_clean":"2024-09-14T09:10:46.804216+0000","last_became_active":"2024-09-14T09:10:31.805768+0000","last_became_peered":"2024-09-14T09:10:31.805768+0000","last_unstale":"2024-09-14T09:10:46.804216+0000","last_undegraded":"2024-09-14T09:10:46.804216+0000","last_fullsized":"2024-09-14T09:10:46.804216+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:40.795499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"152'439","reported_seq":2386,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806025+0000","last_change":"2024-09-14T09:10:38.807701+0000","last_active":"2024-09-14T09:10:46.806025+0000","last_peered":"2024-09-14T09:10:46.806025+0000","last_clean":"2024-09-14T09:10:46.806025+0000","last_became_active":"2024-09-14T09:10:38.805463+0000","last_became_peered":"2024-09-14T09:10:38.805463+0000","last_unstale":"2024-09-14T09:10:46.806025+0000","last_undegraded":"2024-09-14T09:10:46.806025+0000","last_fullsized":"2024-09-14T09:10:46.806025+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:08.537012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012021849999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":3112,"num_read_kb":25090,"num_write":394,"num_write_kb":10842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":1975296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":216,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806765+0000","last_change":"2024-09-14T09:09:17.798249+0000","last_active":"2024-09-14T09:10:46.806765+0000","last_peered":"2024-09-14T09:10:46.806765+0000","last_clean":"2024-09-14T09:10:46.806765+0000","last_became_active":"2024-09-14T09:09:17.797925+0000","last_became_peered":"2024-09-14T09:09:17.797925+0000","last_unstale":"2024-09-14T09:10:46.806765+0000","last_undegraded":"2024-09-14T09:10:46.806765+0000","last_fullsized":"2024-09-14T09:10:46.806765+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:22.149422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":238,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806055+0000","last_change":"2024-09-14T09:10:31.813147+0000","last_active":"2024-09-14T09:10:46.806055+0000","last_peered":"2024-09-14T09:10:46.806055+0000","last_clean":"2024-09-14T09:10:46.806055+0000","last_became_active":"2024-09-14T09:10:31.808373+0000","last_became_peered":"2024-09-14T09:10:31.808373+0000","last_unstale":"2024-09-14T09:10:46.806055+0000","last_undegraded":"2024-09-14T09:10:46.806055+0000","last_fullsized":"2024-09-14T09:10:46.806055+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_clean_scrub_stamp":"2024-09-14T09:07:29.211432+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:57:57.332555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"151'696","reported_seq":10500,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.809971+0000","last_change":"2024-09-14T09:10:46.809875+0000","last_active":"2024-09-14T09:10:46.809971+0000","last_peered":"2024-09-14T09:10:46.809971+0000","last_clean":"2024-09-14T09:10:46.809971+0000","last_became_active":"2024-09-14T09:10:46.808573+0000","last_became_peered":"2024-09-14T09:10:46.808573+0000","last_unstale":"2024-09-14T09:10:46.809971+0000","last_undegraded":"2024-09-14T09:10:46.809971+0000","last_fullsized":"2024-09-14T09:10:46.809971+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:13.945422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012882099999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":11028,"num_read_kb":52732,"num_write":579,"num_write_kb":14215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":2555973,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"155'535","reported_seq":7289,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805206+0000","last_change":"2024-09-14T09:10:36.806606+0000","last_active":"2024-09-14T09:10:46.805206+0000","last_peered":"2024-09-14T09:10:46.805206+0000","last_clean":"2024-09-14T09:10:46.805206+0000","last_became_active":"2024-09-14T09:10:36.804585+0000","last_became_peered":"2024-09-14T09:10:36.804585+0000","last_unstale":"2024-09-14T09:10:46.805206+0000","last_undegraded":"2024-09-14T09:10:46.805206+0000","last_fullsized":"2024-09-14T09:10:46.805206+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:37.635151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013332999999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":5991,"num_read_kb":50679,"num_write":476,"num_write_kb":15575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":3599888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"155'923","reported_seq":8217,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805303+0000","last_change":"2024-09-14T09:10:24.802207+0000","last_active":"2024-09-14T09:10:46.805303+0000","last_peered":"2024-09-14T09:10:46.805303+0000","last_clean":"2024-09-14T09:10:46.805303+0000","last_became_active":"2024-09-14T09:09:02.793112+0000","last_became_peered":"2024-09-14T09:09:02.793112+0000","last_unstale":"2024-09-14T09:10:46.805303+0000","last_undegraded":"2024-09-14T09:10:46.805303+0000","last_fullsized":"2024-09-14T09:10:46.805303+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:20.589668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001478858,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":9011,"num_read_kb":44883,"num_write":1107,"num_write_kb":15908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":9779638,"num_keys_recovered":46,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"155'481","reported_seq":5580,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806710+0000","last_change":"2024-09-14T09:10:38.808915+0000","last_active":"2024-09-14T09:10:46.806710+0000","last_peered":"2024-09-14T09:10:46.806710+0000","last_clean":"2024-09-14T09:10:46.806710+0000","last_became_active":"2024-09-14T09:10:38.807014+0000","last_became_peered":"2024-09-14T09:10:38.807014+0000","last_unstale":"2024-09-14T09:10:46.806710+0000","last_undegraded":"2024-09-14T09:10:46.806710+0000","last_fullsized":"2024-09-14T09:10:46.806710+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:33.459042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060512200000000004,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":4794,"num_read_kb":18724,"num_write":499,"num_write_kb":6053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":540832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"152'976","reported_seq":17838,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805312+0000","last_change":"2024-09-14T09:10:37.810417+0000","last_active":"2024-09-14T09:10:46.805312+0000","last_peered":"2024-09-14T09:10:46.805312+0000","last_clean":"2024-09-14T09:10:46.805312+0000","last_became_active":"2024-09-14T09:10:37.808431+0000","last_became_peered":"2024-09-14T09:10:37.808431+0000","last_unstale":"2024-09-14T09:10:46.805312+0000","last_undegraded":"2024-09-14T09:10:46.805312+0000","last_fullsized":"2024-09-14T09:10:46.805312+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":976,"log_dups_size":0,"ondisk_log_size":976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:01.165563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017008710000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":13865,"num_read_kb":46941,"num_write":938,"num_write_kb":9955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":415,"num_bytes_recovered":13533184,"num_keys_recovered":116,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"155'519","reported_seq":21765,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806976+0000","last_change":"2024-09-14T09:10:35.815411+0000","last_active":"2024-09-14T09:10:46.806976+0000","last_peered":"2024-09-14T09:10:46.806976+0000","last_clean":"2024-09-14T09:10:46.806976+0000","last_became_active":"2024-09-14T09:10:35.813901+0000","last_became_peered":"2024-09-14T09:10:35.813901+0000","last_unstale":"2024-09-14T09:10:46.806976+0000","last_undegraded":"2024-09-14T09:10:46.806976+0000","last_fullsized":"2024-09-14T09:10:46.806976+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:37.344370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029838349999999998,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":21382,"num_read_kb":52622,"num_write":626,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":374,"num_bytes_recovered":16325120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"151'564","reported_seq":4579,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.804529+0000","last_change":"2024-09-14T09:10:35.813746+0000","last_active":"2024-09-14T09:10:46.804529+0000","last_peered":"2024-09-14T09:10:46.804529+0000","last_clean":"2024-09-14T09:10:46.804529+0000","last_became_active":"2024-09-14T09:10:35.811599+0000","last_became_peered":"2024-09-14T09:10:35.811599+0000","last_unstale":"2024-09-14T09:10:46.804529+0000","last_undegraded":"2024-09-14T09:10:46.804529+0000","last_fullsized":"2024-09-14T09:10:46.804529+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:01.203388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001022088,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":5433,"num_read_kb":39557,"num_write":475,"num_write_kb":12186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":585,"num_bytes_recovered":15375904,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"146'391","reported_seq":3667,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807738+0000","last_change":"2024-09-14T09:10:37.813721+0000","last_active":"2024-09-14T09:10:46.807738+0000","last_peered":"2024-09-14T09:10:46.807738+0000","last_clean":"2024-09-14T09:10:46.807738+0000","last_became_active":"2024-09-14T09:10:37.811679+0000","last_became_peered":"2024-09-14T09:10:37.811679+0000","last_unstale":"2024-09-14T09:10:46.807738+0000","last_undegraded":"2024-09-14T09:10:46.807738+0000","last_fullsized":"2024-09-14T09:10:46.807738+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:33:03.454799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010483549999999999,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":2165,"num_read_kb":13861,"num_write":340,"num_write_kb":3973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":1385641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"146'576","reported_seq":10523,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806192+0000","last_change":"2024-09-14T09:10:36.816638+0000","last_active":"2024-09-14T09:10:46.806192+0000","last_peered":"2024-09-14T09:10:46.806192+0000","last_clean":"2024-09-14T09:10:46.806192+0000","last_became_active":"2024-09-14T09:10:36.814772+0000","last_became_peered":"2024-09-14T09:10:36.814772+0000","last_unstale":"2024-09-14T09:10:46.806192+0000","last_undegraded":"2024-09-14T09:10:46.806192+0000","last_fullsized":"2024-09-14T09:10:46.806192+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:22.267528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024013369999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":9710,"num_read_kb":41453,"num_write":717,"num_write_kb":14547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":515,"num_bytes_recovered":6681771,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"151'842","reported_seq":10962,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.811796+0000","last_change":"2024-09-14T09:10:46.811228+0000","last_active":"2024-09-14T09:10:46.811796+0000","last_peered":"2024-09-14T09:10:46.811796+0000","last_clean":"2024-09-14T09:10:46.811796+0000","last_became_active":"2024-09-14T09:10:46.808235+0000","last_became_peered":"2024-09-14T09:10:46.808235+0000","last_unstale":"2024-09-14T09:10:46.811796+0000","last_undegraded":"2024-09-14T09:10:46.811796+0000","last_fullsized":"2024-09-14T09:10:46.811796+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:50.657704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001545701,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":12979,"num_read_kb":59033,"num_write":700,"num_write_kb":13832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":649,"num_bytes_recovered":10373286,"num_keys_recovered":102,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"152'480","reported_seq":4978,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.800266+0000","last_change":"2024-09-14T09:10:35.811341+0000","last_active":"2024-09-14T09:10:46.800266+0000","last_peered":"2024-09-14T09:10:46.800266+0000","last_clean":"2024-09-14T09:10:46.800266+0000","last_became_active":"2024-09-14T09:10:35.809716+0000","last_became_peered":"2024-09-14T09:10:35.809716+0000","last_unstale":"2024-09-14T09:10:46.800266+0000","last_undegraded":"2024-09-14T09:10:46.800266+0000","last_fullsized":"2024-09-14T09:10:46.800266+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:34.306889+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0036893669999999998,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3997,"num_read_kb":34359,"num_write":407,"num_write_kb":6924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":317,"num_bytes_recovered":2955870,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"155'2202","reported_seq":9111,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806404+0000","last_change":"2024-09-14T09:10:24.806079+0000","last_active":"2024-09-14T09:10:46.806404+0000","last_peered":"2024-09-14T09:10:46.806404+0000","last_clean":"2024-09-14T09:10:46.806404+0000","last_became_active":"2024-09-14T09:09:03.794283+0000","last_became_peered":"2024-09-14T09:09:03.794283+0000","last_unstale":"2024-09-14T09:10:46.806404+0000","last_undegraded":"2024-09-14T09:10:46.806404+0000","last_fullsized":"2024-09-14T09:10:46.806404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":2202,"log_dups_size":0,"ondisk_log_size":2202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:28.286762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013071960000000001,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":16728,"num_read_kb":45108,"num_write":3399,"num_write_kb":14849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":4151803,"num_keys_recovered":53,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":880,"num_object_clones":0,"num_object_copies":1760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":880,"num_whiteouts":876,"num_read":421320,"num_read_kb":1460227,"num_write":27245,"num_write_kb":494223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11099,"num_bytes_recovered":245332849,"num_keys_recovered":856,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12266,"internal_metadata":0},"log_size":24598,"ondisk_log_size":24598,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":87,"seq":373662154773,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47572,"kb_used_data":2044,"kb_used_omap":24,"kb_used_meta":45479,"kb_avail":94324268,"statfs":{"total":96636764160,"available":96588050432,"internally_reserved":0,"allocated":2093056,"data_stored":882432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24922,"internal_metadata":46571174},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96292,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94275548,"statfs":{"total":96636764160,"available":96538161152,"internally_reserved":0,"allocated":2691072,"data_stored":1472819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607596,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51864,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319976,"statfs":{"total":96636764160,"available":96583655424,"internally_reserved":0,"allocated":2691072,"data_stored":1472819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607598,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47132,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324708,"statfs":{"total":96636764160,"available":96588500992,"internally_reserved":0,"allocated":2097152,"data_stored":882451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607596,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95636,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94276204,"statfs":{"total":96636764160,"available":96538832896,"internally_reserved":0,"allocated":2093056,"data_stored":882432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":95812039},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640300,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73480,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298360,"statfs":{"total":96636764160,"available":96561520640,"internally_reserved":0,"allocated":2084864,"data_stored":877409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12266,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T09:10:51.329 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-14T09:10:51.329 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-14T09:10:51.628 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-14T09:10:51.637 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T09:10:51.638 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T09:10:51.922 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:10:51.923 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T09:10:51.934 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-09-14T09:10:51.214325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":884,"num_object_clones":0,"num_object_copies":1768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":884,"num_whiteouts":876,"num_read":421386,"num_read_kb":1460282,"num_write":27348,"num_write_kb":495853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11108,"num_bytes_recovered":247694321,"num_keys_recovered":856,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24673,"ondisk_log_size":24673,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":411976,"kb_used_data":13428,"kb_used_omap":32,"kb_used_meta":398367,"kb_avail":565819064,"statfs":{"total":579820584960,"available":579398721536,"internally_reserved":0,"allocated":13750272,"data_stored":6470362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32895,"internal_metadata":407928705},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":672,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.303076"},"pg_stats":[{"pgid":"3.1f","version":"155'762","reported_seq":6895,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.800398+0000","last_change":"2024-09-14T09:10:34.813822+0000","last_active":"2024-09-14T09:10:46.800398+0000","last_peered":"2024-09-14T09:10:46.800398+0000","last_clean":"2024-09-14T09:10:46.800398+0000","last_became_active":"2024-09-14T09:10:34.812378+0000","last_became_peered":"2024-09-14T09:10:34.812378+0000","last_unstale":"2024-09-14T09:10:46.800398+0000","last_undegraded":"2024-09-14T09:10:46.800398+0000","last_fullsized":"2024-09-14T09:10:46.800398+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:30.774451+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0042793429999999997,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":6424,"num_read_kb":42400,"num_write":961,"num_write_kb":16264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":566,"num_bytes_recovered":18399808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"151'487","reported_seq":8533,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.809980+0000","last_change":"2024-09-14T09:10:46.809879+0000","last_active":"2024-09-14T09:10:46.809980+0000","last_peered":"2024-09-14T09:10:46.809980+0000","last_clean":"2024-09-14T09:10:46.809980+0000","last_became_active":"2024-09-14T09:10:46.808487+0000","last_became_peered":"2024-09-14T09:10:46.808487+0000","last_unstale":"2024-09-14T09:10:46.809980+0000","last_undegraded":"2024-09-14T09:10:46.809980+0000","last_fullsized":"2024-09-14T09:10:46.809980+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:16.236725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001792068,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":7749,"num_read_kb":36057,"num_write":459,"num_write_kb":5529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":7376960,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"155'678","reported_seq":7048,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.804472+0000","last_change":"2024-09-14T09:10:36.808697+0000","last_active":"2024-09-14T09:10:46.804472+0000","last_peered":"2024-09-14T09:10:46.804472+0000","last_clean":"2024-09-14T09:10:46.804472+0000","last_became_active":"2024-09-14T09:10:36.806572+0000","last_became_peered":"2024-09-14T09:10:36.806572+0000","last_unstale":"2024-09-14T09:10:46.804472+0000","last_undegraded":"2024-09-14T09:10:46.804472+0000","last_fullsized":"2024-09-14T09:10:46.804472+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:14.168101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097120599999999996,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":10173,"num_read_kb":74789,"num_write":721,"num_write_kb":20037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":358,"num_bytes_recovered":31416461,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"155'783","reported_seq":6762,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807290+0000","last_change":"2024-09-14T09:10:38.808376+0000","last_active":"2024-09-14T09:10:46.807290+0000","last_peered":"2024-09-14T09:10:46.807290+0000","last_clean":"2024-09-14T09:10:46.807290+0000","last_became_active":"2024-09-14T09:10:38.806707+0000","last_became_peered":"2024-09-14T09:10:38.806707+0000","last_unstale":"2024-09-14T09:10:46.807290+0000","last_undegraded":"2024-09-14T09:10:46.807290+0000","last_fullsized":"2024-09-14T09:10:46.807290+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:32.661615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017015209999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":7807,"num_read_kb":21023,"num_write":814,"num_write_kb":12470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":2849546,"num_keys_recovered":242,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"152'752","reported_seq":6451,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806513+0000","last_change":"2024-09-14T09:10:36.810578+0000","last_active":"2024-09-14T09:10:46.806513+0000","last_peered":"2024-09-14T09:10:46.806513+0000","last_clean":"2024-09-14T09:10:46.806513+0000","last_became_active":"2024-09-14T09:10:36.808440+0000","last_became_peered":"2024-09-14T09:10:36.808440+0000","last_unstale":"2024-09-14T09:10:46.806513+0000","last_undegraded":"2024-09-14T09:10:46.806513+0000","last_fullsized":"2024-09-14T09:10:46.806513+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:32.467757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084872500000000004,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":7088,"num_read_kb":42687,"num_write":978,"num_write_kb":14384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":417,"num_bytes_recovered":16991946,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"155'1100","reported_seq":46326,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806116+0000","last_change":"2024-09-14T09:10:36.817314+0000","last_active":"2024-09-14T09:10:46.806116+0000","last_peered":"2024-09-14T09:10:46.806116+0000","last_clean":"2024-09-14T09:10:46.806116+0000","last_became_active":"2024-09-14T09:10:36.814993+0000","last_became_peered":"2024-09-14T09:10:36.814993+0000","last_unstale":"2024-09-14T09:10:46.806116+0000","last_undegraded":"2024-09-14T09:10:46.806116+0000","last_fullsized":"2024-09-14T09:10:46.806116+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1100,"log_dups_size":0,"ondisk_log_size":1100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:01.751040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002639925,"stat_sum":{"num_bytes":19,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":23,"num_read":46462,"num_read_kb":92242,"num_write":1032,"num_write_kb":40131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":432,"num_bytes_recovered":16835316,"num_keys_recovered":71,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"150'528","reported_seq":8997,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806548+0000","last_change":"2024-09-14T09:10:35.807979+0000","last_active":"2024-09-14T09:10:46.806548+0000","last_peered":"2024-09-14T09:10:46.806548+0000","last_clean":"2024-09-14T09:10:46.806548+0000","last_became_active":"2024-09-14T09:10:35.806694+0000","last_became_peered":"2024-09-14T09:10:35.806694+0000","last_unstale":"2024-09-14T09:10:46.806548+0000","last_undegraded":"2024-09-14T09:10:46.806548+0000","last_fullsized":"2024-09-14T09:10:46.806548+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:30.197773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081109400000000005,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":8055,"num_read_kb":52380,"num_write":658,"num_write_kb":14132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"150'793","reported_seq":6498,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806101+0000","last_change":"2024-09-14T09:10:38.808926+0000","last_active":"2024-09-14T09:10:46.806101+0000","last_peered":"2024-09-14T09:10:46.806101+0000","last_clean":"2024-09-14T09:10:46.806101+0000","last_became_active":"2024-09-14T09:10:38.807058+0000","last_became_peered":"2024-09-14T09:10:38.807058+0000","last_unstale":"2024-09-14T09:10:46.806101+0000","last_undegraded":"2024-09-14T09:10:46.806101+0000","last_fullsized":"2024-09-14T09:10:46.806101+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:21.481048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001015438,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":7244,"num_read_kb":25042,"num_write":1081,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"152'859","reported_seq":72055,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.800329+0000","last_change":"2024-09-14T09:10:37.809948+0000","last_active":"2024-09-14T09:10:46.800329+0000","last_peered":"2024-09-14T09:10:46.800329+0000","last_clean":"2024-09-14T09:10:46.800329+0000","last_became_active":"2024-09-14T09:10:37.807994+0000","last_became_peered":"2024-09-14T09:10:37.807994+0000","last_unstale":"2024-09-14T09:10:46.800329+0000","last_undegraded":"2024-09-14T09:10:46.800329+0000","last_fullsized":"2024-09-14T09:10:46.800329+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:21.137544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017200060000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":74396,"num_read_kb":113736,"num_write":1000,"num_write_kb":72684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":501,"num_bytes_recovered":30088824,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"145'552","reported_seq":21638,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.810940+0000","last_change":"2024-09-14T09:10:46.810252+0000","last_active":"2024-09-14T09:10:46.810940+0000","last_peered":"2024-09-14T09:10:46.810940+0000","last_clean":"2024-09-14T09:10:46.810940+0000","last_became_active":"2024-09-14T09:10:46.808488+0000","last_became_peered":"2024-09-14T09:10:46.808488+0000","last_unstale":"2024-09-14T09:10:46.810940+0000","last_undegraded":"2024-09-14T09:10:46.810940+0000","last_fullsized":"2024-09-14T09:10:46.810940+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:21.120854+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00073203199999999997,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":21018,"num_read_kb":58767,"num_write":570,"num_write_kb":35397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":448,"num_bytes_recovered":7392256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"150'952","reported_seq":57761,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806425+0000","last_change":"2024-09-14T09:10:35.811768+0000","last_active":"2024-09-14T09:10:46.806425+0000","last_peered":"2024-09-14T09:10:46.806425+0000","last_clean":"2024-09-14T09:10:46.806425+0000","last_became_active":"2024-09-14T09:10:35.810160+0000","last_became_peered":"2024-09-14T09:10:35.810160+0000","last_unstale":"2024-09-14T09:10:46.806425+0000","last_undegraded":"2024-09-14T09:10:46.806425+0000","last_fullsized":"2024-09-14T09:10:46.806425+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:21:57.677481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068915899999999995,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":27804,"num_read_kb":68813,"num_write":785,"num_write_kb":21040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"152'650","reported_seq":6238,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807155+0000","last_change":"2024-09-14T09:10:36.813886+0000","last_active":"2024-09-14T09:10:46.807155+0000","last_peered":"2024-09-14T09:10:46.807155+0000","last_clean":"2024-09-14T09:10:46.807155+0000","last_became_active":"2024-09-14T09:10:36.812242+0000","last_became_peered":"2024-09-14T09:10:36.812242+0000","last_unstale":"2024-09-14T09:10:46.807155+0000","last_undegraded":"2024-09-14T09:10:46.807155+0000","last_fullsized":"2024-09-14T09:10:46.807155+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:17.220451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067904769999999996,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":7788,"num_read_kb":24568,"num_write":614,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":4454614,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":180,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806839+0000","last_change":"2024-09-14T09:10:36.818028+0000","last_active":"2024-09-14T09:10:46.806839+0000","last_peered":"2024-09-14T09:10:46.806839+0000","last_clean":"2024-09-14T09:10:46.806839+0000","last_became_active":"2024-09-14T09:10:36.817650+0000","last_became_peered":"2024-09-14T09:10:36.817650+0000","last_unstale":"2024-09-14T09:10:46.806839+0000","last_undegraded":"2024-09-14T09:10:46.806839+0000","last_fullsized":"2024-09-14T09:10:46.806839+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:05.095616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061552199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"155'693","reported_seq":5997,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806743+0000","last_change":"2024-09-14T09:10:35.809230+0000","last_active":"2024-09-14T09:10:46.806743+0000","last_peered":"2024-09-14T09:10:46.806743+0000","last_clean":"2024-09-14T09:10:46.806743+0000","last_became_active":"2024-09-14T09:10:35.806954+0000","last_became_peered":"2024-09-14T09:10:35.806954+0000","last_unstale":"2024-09-14T09:10:46.806743+0000","last_undegraded":"2024-09-14T09:10:46.806743+0000","last_fullsized":"2024-09-14T09:10:46.806743+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:07.626647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010903849999999999,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":6998,"num_read_kb":15727,"num_write":528,"num_write_kb":3578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":347,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806946+0000","last_change":"2024-09-14T09:10:33.814092+0000","last_active":"2024-09-14T09:10:46.806946+0000","last_peered":"2024-09-14T09:10:46.806946+0000","last_clean":"2024-09-14T09:10:46.806946+0000","last_became_active":"2024-09-14T09:10:33.813809+0000","last_became_peered":"2024-09-14T09:10:33.813809+0000","last_unstale":"2024-09-14T09:10:46.806946+0000","last_undegraded":"2024-09-14T09:10:46.806946+0000","last_fullsized":"2024-09-14T09:10:46.806946+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:55.810760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042190199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"150'724","reported_seq":8925,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807092+0000","last_change":"2024-09-14T09:10:36.803816+0000","last_active":"2024-09-14T09:10:46.807092+0000","last_peered":"2024-09-14T09:10:46.807092+0000","last_clean":"2024-09-14T09:10:46.807092+0000","last_became_active":"2024-09-14T09:10:36.802005+0000","last_became_peered":"2024-09-14T09:10:36.802005+0000","last_unstale":"2024-09-14T09:10:46.807092+0000","last_undegraded":"2024-09-14T09:10:46.807092+0000","last_fullsized":"2024-09-14T09:10:46.807092+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:36.656797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064676800000000004,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":9017,"num_read_kb":43383,"num_write":832,"num_write_kb":5619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":180,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806861+0000","last_change":"2024-09-14T09:10:36.805095+0000","last_active":"2024-09-14T09:10:46.806861+0000","last_peered":"2024-09-14T09:10:46.806861+0000","last_clean":"2024-09-14T09:10:46.806861+0000","last_became_active":"2024-09-14T09:10:36.804806+0000","last_became_peered":"2024-09-14T09:10:36.804806+0000","last_unstale":"2024-09-14T09:10:46.806861+0000","last_undegraded":"2024-09-14T09:10:46.806861+0000","last_fullsized":"2024-09-14T09:10:46.806861+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:45.011748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"146'1024","reported_seq":7041,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807250+0000","last_change":"2024-09-14T09:10:34.807002+0000","last_active":"2024-09-14T09:10:46.807250+0000","last_peered":"2024-09-14T09:10:46.807250+0000","last_clean":"2024-09-14T09:10:46.807250+0000","last_became_active":"2024-09-14T09:10:34.805260+0000","last_became_peered":"2024-09-14T09:10:34.805260+0000","last_unstale":"2024-09-14T09:10:46.807250+0000","last_undegraded":"2024-09-14T09:10:46.807250+0000","last_fullsized":"2024-09-14T09:10:46.807250+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:21.009093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093108500000000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":7917,"num_read_kb":40050,"num_write":1441,"num_write_kb":11556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":306,"num_bytes_recovered":7127704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806176+0000","last_change":"2024-09-14T09:10:32.806891+0000","last_active":"2024-09-14T09:10:46.806176+0000","last_peered":"2024-09-14T09:10:46.806176+0000","last_clean":"2024-09-14T09:10:46.806176+0000","last_became_active":"2024-09-14T09:10:32.806571+0000","last_became_peered":"2024-09-14T09:10:32.806571+0000","last_unstale":"2024-09-14T09:10:46.806176+0000","last_undegraded":"2024-09-14T09:10:46.806176+0000","last_fullsized":"2024-09-14T09:10:46.806176+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:52:32.672580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"152'830","reported_seq":10434,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.804148+0000","last_change":"2024-09-14T09:10:36.803840+0000","last_active":"2024-09-14T09:10:46.804148+0000","last_peered":"2024-09-14T09:10:46.804148+0000","last_clean":"2024-09-14T09:10:46.804148+0000","last_became_active":"2024-09-14T09:10:36.801544+0000","last_became_peered":"2024-09-14T09:10:36.801544+0000","last_unstale":"2024-09-14T09:10:46.804148+0000","last_undegraded":"2024-09-14T09:10:46.804148+0000","last_fullsized":"2024-09-14T09:10:46.804148+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:22.359490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001749932,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":11788,"num_read_kb":51374,"num_write":731,"num_write_kb":9360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":344,"num_bytes_recovered":2441232,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"155'1550","reported_seq":11337,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805742+0000","last_change":"2024-09-14T09:10:37.810044+0000","last_active":"2024-09-14T09:10:46.805742+0000","last_peered":"2024-09-14T09:10:46.805742+0000","last_clean":"2024-09-14T09:10:46.805742+0000","last_became_active":"2024-09-14T09:10:37.808020+0000","last_became_peered":"2024-09-14T09:10:37.808020+0000","last_unstale":"2024-09-14T09:10:46.805742+0000","last_undegraded":"2024-09-14T09:10:46.805742+0000","last_fullsized":"2024-09-14T09:10:46.805742+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1550,"log_dups_size":0,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:37.794250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011665530000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":29,"num_read":16156,"num_read_kb":41503,"num_write":1957,"num_write_kb":7195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":2340129,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":333,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805453+0000","last_change":"2024-09-14T09:07:37.260986+0000","last_active":"2024-09-14T09:10:46.805453+0000","last_peered":"2024-09-14T09:10:46.805453+0000","last_clean":"2024-09-14T09:10:46.805453+0000","last_became_active":"2024-09-14T09:07:35.254256+0000","last_became_peered":"2024-09-14T09:07:35.254256+0000","last_unstale":"2024-09-14T09:10:46.805453+0000","last_undegraded":"2024-09-14T09:10:46.805453+0000","last_fullsized":"2024-09-14T09:10:46.805453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:07.063058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096898500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"152'477","reported_seq":10518,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.800187+0000","last_change":"2024-09-14T09:10:34.810738+0000","last_active":"2024-09-14T09:10:46.800187+0000","last_peered":"2024-09-14T09:10:46.800187+0000","last_clean":"2024-09-14T09:10:46.800187+0000","last_became_active":"2024-09-14T09:10:34.808686+0000","last_became_peered":"2024-09-14T09:10:34.808686+0000","last_unstale":"2024-09-14T09:10:46.800187+0000","last_undegraded":"2024-09-14T09:10:46.800187+0000","last_fullsized":"2024-09-14T09:10:46.800187+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:03.253962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011386840000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":9617,"num_read_kb":58850,"num_write":533,"num_write_kb":14690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":275,"num_bytes_recovered":8152899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806365+0000","last_change":"2024-09-14T09:10:38.806538+0000","last_active":"2024-09-14T09:10:46.806365+0000","last_peered":"2024-09-14T09:10:46.806365+0000","last_clean":"2024-09-14T09:10:46.806365+0000","last_became_active":"2024-09-14T09:10:38.806119+0000","last_became_peered":"2024-09-14T09:10:38.806119+0000","last_unstale":"2024-09-14T09:10:46.806365+0000","last_undegraded":"2024-09-14T09:10:46.806365+0000","last_fullsized":"2024-09-14T09:10:46.806365+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:44.063513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"155'780","reported_seq":7525,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.810380+0000","last_change":"2024-09-14T09:10:46.810281+0000","last_active":"2024-09-14T09:10:46.810380+0000","last_peered":"2024-09-14T09:10:46.810380+0000","last_clean":"2024-09-14T09:10:46.810380+0000","last_became_active":"2024-09-14T09:10:46.808545+0000","last_became_peered":"2024-09-14T09:10:46.808545+0000","last_unstale":"2024-09-14T09:10:46.810380+0000","last_undegraded":"2024-09-14T09:10:46.810380+0000","last_fullsized":"2024-09-14T09:10:46.810380+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:14.999438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000844446,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":7624,"num_read_kb":31794,"num_write":893,"num_write_kb":10927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":490,"num_bytes_recovered":230948,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":304,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.804216+0000","last_change":"2024-09-14T09:10:31.806103+0000","last_active":"2024-09-14T09:10:46.804216+0000","last_peered":"2024-09-14T09:10:46.804216+0000","last_clean":"2024-09-14T09:10:46.804216+0000","last_became_active":"2024-09-14T09:10:31.805768+0000","last_became_peered":"2024-09-14T09:10:31.805768+0000","last_unstale":"2024-09-14T09:10:46.804216+0000","last_undegraded":"2024-09-14T09:10:46.804216+0000","last_fullsized":"2024-09-14T09:10:46.804216+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:40.795499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"152'439","reported_seq":2386,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806025+0000","last_change":"2024-09-14T09:10:38.807701+0000","last_active":"2024-09-14T09:10:46.806025+0000","last_peered":"2024-09-14T09:10:46.806025+0000","last_clean":"2024-09-14T09:10:46.806025+0000","last_became_active":"2024-09-14T09:10:38.805463+0000","last_became_peered":"2024-09-14T09:10:38.805463+0000","last_unstale":"2024-09-14T09:10:46.806025+0000","last_undegraded":"2024-09-14T09:10:46.806025+0000","last_fullsized":"2024-09-14T09:10:46.806025+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:08.537012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012021849999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":3112,"num_read_kb":25090,"num_write":394,"num_write_kb":10842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":1975296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":216,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806765+0000","last_change":"2024-09-14T09:09:17.798249+0000","last_active":"2024-09-14T09:10:46.806765+0000","last_peered":"2024-09-14T09:10:46.806765+0000","last_clean":"2024-09-14T09:10:46.806765+0000","last_became_active":"2024-09-14T09:09:17.797925+0000","last_became_peered":"2024-09-14T09:09:17.797925+0000","last_unstale":"2024-09-14T09:10:46.806765+0000","last_undegraded":"2024-09-14T09:10:46.806765+0000","last_fullsized":"2024-09-14T09:10:46.806765+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:22.149422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":238,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806055+0000","last_change":"2024-09-14T09:10:31.813147+0000","last_active":"2024-09-14T09:10:46.806055+0000","last_peered":"2024-09-14T09:10:46.806055+0000","last_clean":"2024-09-14T09:10:46.806055+0000","last_became_active":"2024-09-14T09:10:31.808373+0000","last_became_peered":"2024-09-14T09:10:31.808373+0000","last_unstale":"2024-09-14T09:10:46.806055+0000","last_undegraded":"2024-09-14T09:10:46.806055+0000","last_fullsized":"2024-09-14T09:10:46.806055+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_clean_scrub_stamp":"2024-09-14T09:07:29.211432+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:57:57.332555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"151'696","reported_seq":10500,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.809971+0000","last_change":"2024-09-14T09:10:46.809875+0000","last_active":"2024-09-14T09:10:46.809971+0000","last_peered":"2024-09-14T09:10:46.809971+0000","last_clean":"2024-09-14T09:10:46.809971+0000","last_became_active":"2024-09-14T09:10:46.808573+0000","last_became_peered":"2024-09-14T09:10:46.808573+0000","last_unstale":"2024-09-14T09:10:46.809971+0000","last_undegraded":"2024-09-14T09:10:46.809971+0000","last_fullsized":"2024-09-14T09:10:46.809971+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:13.945422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012882099999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":11028,"num_read_kb":52732,"num_write":579,"num_write_kb":14215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":2555973,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"155'535","reported_seq":7289,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805206+0000","last_change":"2024-09-14T09:10:36.806606+0000","last_active":"2024-09-14T09:10:46.805206+0000","last_peered":"2024-09-14T09:10:46.805206+0000","last_clean":"2024-09-14T09:10:46.805206+0000","last_became_active":"2024-09-14T09:10:36.804585+0000","last_became_peered":"2024-09-14T09:10:36.804585+0000","last_unstale":"2024-09-14T09:10:46.805206+0000","last_undegraded":"2024-09-14T09:10:46.805206+0000","last_fullsized":"2024-09-14T09:10:46.805206+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:37.635151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013332999999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":5991,"num_read_kb":50679,"num_write":476,"num_write_kb":15575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":3599888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"155'923","reported_seq":8217,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805303+0000","last_change":"2024-09-14T09:10:24.802207+0000","last_active":"2024-09-14T09:10:46.805303+0000","last_peered":"2024-09-14T09:10:46.805303+0000","last_clean":"2024-09-14T09:10:46.805303+0000","last_became_active":"2024-09-14T09:09:02.793112+0000","last_became_peered":"2024-09-14T09:09:02.793112+0000","last_unstale":"2024-09-14T09:10:46.805303+0000","last_undegraded":"2024-09-14T09:10:46.805303+0000","last_fullsized":"2024-09-14T09:10:46.805303+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:20.589668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001478858,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":9011,"num_read_kb":44883,"num_write":1107,"num_write_kb":15908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":9779638,"num_keys_recovered":46,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"155'481","reported_seq":5580,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806710+0000","last_change":"2024-09-14T09:10:38.808915+0000","last_active":"2024-09-14T09:10:46.806710+0000","last_peered":"2024-09-14T09:10:46.806710+0000","last_clean":"2024-09-14T09:10:46.806710+0000","last_became_active":"2024-09-14T09:10:38.807014+0000","last_became_peered":"2024-09-14T09:10:38.807014+0000","last_unstale":"2024-09-14T09:10:46.806710+0000","last_undegraded":"2024-09-14T09:10:46.806710+0000","last_fullsized":"2024-09-14T09:10:46.806710+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:33.459042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060512200000000004,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":4794,"num_read_kb":18724,"num_write":499,"num_write_kb":6053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":540832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"152'976","reported_seq":17838,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805312+0000","last_change":"2024-09-14T09:10:37.810417+0000","last_active":"2024-09-14T09:10:46.805312+0000","last_peered":"2024-09-14T09:10:46.805312+0000","last_clean":"2024-09-14T09:10:46.805312+0000","last_became_active":"2024-09-14T09:10:37.808431+0000","last_became_peered":"2024-09-14T09:10:37.808431+0000","last_unstale":"2024-09-14T09:10:46.805312+0000","last_undegraded":"2024-09-14T09:10:46.805312+0000","last_fullsized":"2024-09-14T09:10:46.805312+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":976,"log_dups_size":0,"ondisk_log_size":976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:01.165563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017008710000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":13865,"num_read_kb":46941,"num_write":938,"num_write_kb":9955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":415,"num_bytes_recovered":13533184,"num_keys_recovered":116,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"155'519","reported_seq":21765,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806976+0000","last_change":"2024-09-14T09:10:35.815411+0000","last_active":"2024-09-14T09:10:46.806976+0000","last_peered":"2024-09-14T09:10:46.806976+0000","last_clean":"2024-09-14T09:10:46.806976+0000","last_became_active":"2024-09-14T09:10:35.813901+0000","last_became_peered":"2024-09-14T09:10:35.813901+0000","last_unstale":"2024-09-14T09:10:46.806976+0000","last_undegraded":"2024-09-14T09:10:46.806976+0000","last_fullsized":"2024-09-14T09:10:46.806976+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:37.344370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029838349999999998,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":21382,"num_read_kb":52622,"num_write":626,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":374,"num_bytes_recovered":16325120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"151'564","reported_seq":4579,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.804529+0000","last_change":"2024-09-14T09:10:35.813746+0000","last_active":"2024-09-14T09:10:46.804529+0000","last_peered":"2024-09-14T09:10:46.804529+0000","last_clean":"2024-09-14T09:10:46.804529+0000","last_became_active":"2024-09-14T09:10:35.811599+0000","last_became_peered":"2024-09-14T09:10:35.811599+0000","last_unstale":"2024-09-14T09:10:46.804529+0000","last_undegraded":"2024-09-14T09:10:46.804529+0000","last_fullsized":"2024-09-14T09:10:46.804529+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:01.203388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001022088,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":5433,"num_read_kb":39557,"num_write":475,"num_write_kb":12186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":585,"num_bytes_recovered":15375904,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"146'391","reported_seq":3667,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807738+0000","last_change":"2024-09-14T09:10:37.813721+0000","last_active":"2024-09-14T09:10:46.807738+0000","last_peered":"2024-09-14T09:10:46.807738+0000","last_clean":"2024-09-14T09:10:46.807738+0000","last_became_active":"2024-09-14T09:10:37.811679+0000","last_became_peered":"2024-09-14T09:10:37.811679+0000","last_unstale":"2024-09-14T09:10:46.807738+0000","last_undegraded":"2024-09-14T09:10:46.807738+0000","last_fullsized":"2024-09-14T09:10:46.807738+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:33:03.454799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010483549999999999,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":2165,"num_read_kb":13861,"num_write":340,"num_write_kb":3973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":1385641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"146'576","reported_seq":10523,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806192+0000","last_change":"2024-09-14T09:10:36.816638+0000","last_active":"2024-09-14T09:10:46.806192+0000","last_peered":"2024-09-14T09:10:46.806192+0000","last_clean":"2024-09-14T09:10:46.806192+0000","last_became_active":"2024-09-14T09:10:36.814772+0000","last_became_peered":"2024-09-14T09:10:36.814772+0000","last_unstale":"2024-09-14T09:10:46.806192+0000","last_undegraded":"2024-09-14T09:10:46.806192+0000","last_fullsized":"2024-09-14T09:10:46.806192+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:22.267528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024013369999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":9710,"num_read_kb":41453,"num_write":717,"num_write_kb":14547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":515,"num_bytes_recovered":6681771,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"151'842","reported_seq":10962,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.811796+0000","last_change":"2024-09-14T09:10:46.811228+0000","last_active":"2024-09-14T09:10:46.811796+0000","last_peered":"2024-09-14T09:10:46.811796+0000","last_clean":"2024-09-14T09:10:46.811796+0000","last_became_active":"2024-09-14T09:10:46.808235+0000","last_became_peered":"2024-09-14T09:10:46.808235+0000","last_unstale":"2024-09-14T09:10:46.811796+0000","last_undegraded":"2024-09-14T09:10:46.811796+0000","last_fullsized":"2024-09-14T09:10:46.811796+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:50.657704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001545701,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":12979,"num_read_kb":59033,"num_write":700,"num_write_kb":13832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":649,"num_bytes_recovered":10373286,"num_keys_recovered":102,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"152'480","reported_seq":4978,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.800266+0000","last_change":"2024-09-14T09:10:35.811341+0000","last_active":"2024-09-14T09:10:46.800266+0000","last_peered":"2024-09-14T09:10:46.800266+0000","last_clean":"2024-09-14T09:10:46.800266+0000","last_became_active":"2024-09-14T09:10:35.809716+0000","last_became_peered":"2024-09-14T09:10:35.809716+0000","last_unstale":"2024-09-14T09:10:46.800266+0000","last_undegraded":"2024-09-14T09:10:46.800266+0000","last_fullsized":"2024-09-14T09:10:46.800266+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:34.306889+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0036893669999999998,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3997,"num_read_kb":34359,"num_write":407,"num_write_kb":6924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":317,"num_bytes_recovered":2955870,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"155'2202","reported_seq":9111,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806404+0000","last_change":"2024-09-14T09:10:24.806079+0000","last_active":"2024-09-14T09:10:46.806404+0000","last_peered":"2024-09-14T09:10:46.806404+0000","last_clean":"2024-09-14T09:10:46.806404+0000","last_became_active":"2024-09-14T09:09:03.794283+0000","last_became_peered":"2024-09-14T09:09:03.794283+0000","last_unstale":"2024-09-14T09:10:46.806404+0000","last_undegraded":"2024-09-14T09:10:46.806404+0000","last_fullsized":"2024-09-14T09:10:46.806404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":2202,"log_dups_size":0,"ondisk_log_size":2202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:28.286762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013071960000000001,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":16728,"num_read_kb":45108,"num_write":3399,"num_write_kb":14849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":4151803,"num_keys_recovered":53,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":880,"num_object_clones":0,"num_object_copies":1760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":880,"num_whiteouts":876,"num_read":421320,"num_read_kb":1460227,"num_write":27245,"num_write_kb":494223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11099,"num_bytes_recovered":245332849,"num_keys_recovered":856,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12266,"internal_metadata":0},"log_size":24598,"ondisk_log_size":24598,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":87,"seq":373662154773,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47572,"kb_used_data":2044,"kb_used_omap":24,"kb_used_meta":45479,"kb_avail":94324268,"statfs":{"total":96636764160,"available":96588050432,"internally_reserved":0,"allocated":2093056,"data_stored":882432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24922,"internal_metadata":46571174},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96292,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94275548,"statfs":{"total":96636764160,"available":96538161152,"internally_reserved":0,"allocated":2691072,"data_stored":1472819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607596,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51864,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319976,"statfs":{"total":96636764160,"available":96583655424,"internally_reserved":0,"allocated":2691072,"data_stored":1472819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607598,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47132,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324708,"statfs":{"total":96636764160,"available":96588500992,"internally_reserved":0,"allocated":2097152,"data_stored":882451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607596,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95636,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94276204,"statfs":{"total":96636764160,"available":96538832896,"internally_reserved":0,"allocated":2093056,"data_stored":882432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":95812039},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640300,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73480,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298360,"statfs":{"total":96636764160,"available":96561520640,"internally_reserved":0,"allocated":2084864,"data_stored":877409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12266,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T09:10:51.937 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T09:10:52.217 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:10:52.218 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T09:10:52.229 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-09-14T09:10:51.214325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":884,"num_object_clones":0,"num_object_copies":1768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":884,"num_whiteouts":876,"num_read":421386,"num_read_kb":1460282,"num_write":27348,"num_write_kb":495853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11108,"num_bytes_recovered":247694321,"num_keys_recovered":856,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24673,"ondisk_log_size":24673,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":411976,"kb_used_data":13428,"kb_used_omap":32,"kb_used_meta":398367,"kb_avail":565819064,"statfs":{"total":579820584960,"available":579398721536,"internally_reserved":0,"allocated":13750272,"data_stored":6470362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32895,"internal_metadata":407928705},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":672,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.303076"},"pg_stats":[{"pgid":"3.1f","version":"155'762","reported_seq":6895,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.800398+0000","last_change":"2024-09-14T09:10:34.813822+0000","last_active":"2024-09-14T09:10:46.800398+0000","last_peered":"2024-09-14T09:10:46.800398+0000","last_clean":"2024-09-14T09:10:46.800398+0000","last_became_active":"2024-09-14T09:10:34.812378+0000","last_became_peered":"2024-09-14T09:10:34.812378+0000","last_unstale":"2024-09-14T09:10:46.800398+0000","last_undegraded":"2024-09-14T09:10:46.800398+0000","last_fullsized":"2024-09-14T09:10:46.800398+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:30.774451+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0042793429999999997,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":6424,"num_read_kb":42400,"num_write":961,"num_write_kb":16264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":566,"num_bytes_recovered":18399808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"151'487","reported_seq":8533,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.809980+0000","last_change":"2024-09-14T09:10:46.809879+0000","last_active":"2024-09-14T09:10:46.809980+0000","last_peered":"2024-09-14T09:10:46.809980+0000","last_clean":"2024-09-14T09:10:46.809980+0000","last_became_active":"2024-09-14T09:10:46.808487+0000","last_became_peered":"2024-09-14T09:10:46.808487+0000","last_unstale":"2024-09-14T09:10:46.809980+0000","last_undegraded":"2024-09-14T09:10:46.809980+0000","last_fullsized":"2024-09-14T09:10:46.809980+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:16.236725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001792068,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":7749,"num_read_kb":36057,"num_write":459,"num_write_kb":5529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":7376960,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"155'678","reported_seq":7048,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.804472+0000","last_change":"2024-09-14T09:10:36.808697+0000","last_active":"2024-09-14T09:10:46.804472+0000","last_peered":"2024-09-14T09:10:46.804472+0000","last_clean":"2024-09-14T09:10:46.804472+0000","last_became_active":"2024-09-14T09:10:36.806572+0000","last_became_peered":"2024-09-14T09:10:36.806572+0000","last_unstale":"2024-09-14T09:10:46.804472+0000","last_undegraded":"2024-09-14T09:10:46.804472+0000","last_fullsized":"2024-09-14T09:10:46.804472+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:14.168101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097120599999999996,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":10173,"num_read_kb":74789,"num_write":721,"num_write_kb":20037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":358,"num_bytes_recovered":31416461,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"155'783","reported_seq":6762,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807290+0000","last_change":"2024-09-14T09:10:38.808376+0000","last_active":"2024-09-14T09:10:46.807290+0000","last_peered":"2024-09-14T09:10:46.807290+0000","last_clean":"2024-09-14T09:10:46.807290+0000","last_became_active":"2024-09-14T09:10:38.806707+0000","last_became_peered":"2024-09-14T09:10:38.806707+0000","last_unstale":"2024-09-14T09:10:46.807290+0000","last_undegraded":"2024-09-14T09:10:46.807290+0000","last_fullsized":"2024-09-14T09:10:46.807290+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:32.661615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017015209999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":7807,"num_read_kb":21023,"num_write":814,"num_write_kb":12470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":2849546,"num_keys_recovered":242,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"152'752","reported_seq":6451,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806513+0000","last_change":"2024-09-14T09:10:36.810578+0000","last_active":"2024-09-14T09:10:46.806513+0000","last_peered":"2024-09-14T09:10:46.806513+0000","last_clean":"2024-09-14T09:10:46.806513+0000","last_became_active":"2024-09-14T09:10:36.808440+0000","last_became_peered":"2024-09-14T09:10:36.808440+0000","last_unstale":"2024-09-14T09:10:46.806513+0000","last_undegraded":"2024-09-14T09:10:46.806513+0000","last_fullsized":"2024-09-14T09:10:46.806513+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:32.467757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084872500000000004,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":7088,"num_read_kb":42687,"num_write":978,"num_write_kb":14384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":417,"num_bytes_recovered":16991946,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"155'1100","reported_seq":46326,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806116+0000","last_change":"2024-09-14T09:10:36.817314+0000","last_active":"2024-09-14T09:10:46.806116+0000","last_peered":"2024-09-14T09:10:46.806116+0000","last_clean":"2024-09-14T09:10:46.806116+0000","last_became_active":"2024-09-14T09:10:36.814993+0000","last_became_peered":"2024-09-14T09:10:36.814993+0000","last_unstale":"2024-09-14T09:10:46.806116+0000","last_undegraded":"2024-09-14T09:10:46.806116+0000","last_fullsized":"2024-09-14T09:10:46.806116+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1100,"log_dups_size":0,"ondisk_log_size":1100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:01.751040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002639925,"stat_sum":{"num_bytes":19,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":23,"num_read":46462,"num_read_kb":92242,"num_write":1032,"num_write_kb":40131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":432,"num_bytes_recovered":16835316,"num_keys_recovered":71,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"150'528","reported_seq":8997,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806548+0000","last_change":"2024-09-14T09:10:35.807979+0000","last_active":"2024-09-14T09:10:46.806548+0000","last_peered":"2024-09-14T09:10:46.806548+0000","last_clean":"2024-09-14T09:10:46.806548+0000","last_became_active":"2024-09-14T09:10:35.806694+0000","last_became_peered":"2024-09-14T09:10:35.806694+0000","last_unstale":"2024-09-14T09:10:46.806548+0000","last_undegraded":"2024-09-14T09:10:46.806548+0000","last_fullsized":"2024-09-14T09:10:46.806548+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:30.197773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081109400000000005,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":8055,"num_read_kb":52380,"num_write":658,"num_write_kb":14132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"150'793","reported_seq":6498,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806101+0000","last_change":"2024-09-14T09:10:38.808926+0000","last_active":"2024-09-14T09:10:46.806101+0000","last_peered":"2024-09-14T09:10:46.806101+0000","last_clean":"2024-09-14T09:10:46.806101+0000","last_became_active":"2024-09-14T09:10:38.807058+0000","last_became_peered":"2024-09-14T09:10:38.807058+0000","last_unstale":"2024-09-14T09:10:46.806101+0000","last_undegraded":"2024-09-14T09:10:46.806101+0000","last_fullsized":"2024-09-14T09:10:46.806101+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:21.481048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001015438,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":7244,"num_read_kb":25042,"num_write":1081,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"152'859","reported_seq":72055,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.800329+0000","last_change":"2024-09-14T09:10:37.809948+0000","last_active":"2024-09-14T09:10:46.800329+0000","last_peered":"2024-09-14T09:10:46.800329+0000","last_clean":"2024-09-14T09:10:46.800329+0000","last_became_active":"2024-09-14T09:10:37.807994+0000","last_became_peered":"2024-09-14T09:10:37.807994+0000","last_unstale":"2024-09-14T09:10:46.800329+0000","last_undegraded":"2024-09-14T09:10:46.800329+0000","last_fullsized":"2024-09-14T09:10:46.800329+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:21.137544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017200060000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":74396,"num_read_kb":113736,"num_write":1000,"num_write_kb":72684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":501,"num_bytes_recovered":30088824,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"145'552","reported_seq":21638,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.810940+0000","last_change":"2024-09-14T09:10:46.810252+0000","last_active":"2024-09-14T09:10:46.810940+0000","last_peered":"2024-09-14T09:10:46.810940+0000","last_clean":"2024-09-14T09:10:46.810940+0000","last_became_active":"2024-09-14T09:10:46.808488+0000","last_became_peered":"2024-09-14T09:10:46.808488+0000","last_unstale":"2024-09-14T09:10:46.810940+0000","last_undegraded":"2024-09-14T09:10:46.810940+0000","last_fullsized":"2024-09-14T09:10:46.810940+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:21.120854+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00073203199999999997,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":21018,"num_read_kb":58767,"num_write":570,"num_write_kb":35397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":448,"num_bytes_recovered":7392256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"150'952","reported_seq":57761,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806425+0000","last_change":"2024-09-14T09:10:35.811768+0000","last_active":"2024-09-14T09:10:46.806425+0000","last_peered":"2024-09-14T09:10:46.806425+0000","last_clean":"2024-09-14T09:10:46.806425+0000","last_became_active":"2024-09-14T09:10:35.810160+0000","last_became_peered":"2024-09-14T09:10:35.810160+0000","last_unstale":"2024-09-14T09:10:46.806425+0000","last_undegraded":"2024-09-14T09:10:46.806425+0000","last_fullsized":"2024-09-14T09:10:46.806425+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:21:57.677481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068915899999999995,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":27804,"num_read_kb":68813,"num_write":785,"num_write_kb":21040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"152'650","reported_seq":6238,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807155+0000","last_change":"2024-09-14T09:10:36.813886+0000","last_active":"2024-09-14T09:10:46.807155+0000","last_peered":"2024-09-14T09:10:46.807155+0000","last_clean":"2024-09-14T09:10:46.807155+0000","last_became_active":"2024-09-14T09:10:36.812242+0000","last_became_peered":"2024-09-14T09:10:36.812242+0000","last_unstale":"2024-09-14T09:10:46.807155+0000","last_undegraded":"2024-09-14T09:10:46.807155+0000","last_fullsized":"2024-09-14T09:10:46.807155+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:17.220451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067904769999999996,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":7788,"num_read_kb":24568,"num_write":614,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":4454614,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":180,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806839+0000","last_change":"2024-09-14T09:10:36.818028+0000","last_active":"2024-09-14T09:10:46.806839+0000","last_peered":"2024-09-14T09:10:46.806839+0000","last_clean":"2024-09-14T09:10:46.806839+0000","last_became_active":"2024-09-14T09:10:36.817650+0000","last_became_peered":"2024-09-14T09:10:36.817650+0000","last_unstale":"2024-09-14T09:10:46.806839+0000","last_undegraded":"2024-09-14T09:10:46.806839+0000","last_fullsized":"2024-09-14T09:10:46.806839+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:05.095616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061552199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"155'693","reported_seq":5997,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806743+0000","last_change":"2024-09-14T09:10:35.809230+0000","last_active":"2024-09-14T09:10:46.806743+0000","last_peered":"2024-09-14T09:10:46.806743+0000","last_clean":"2024-09-14T09:10:46.806743+0000","last_became_active":"2024-09-14T09:10:35.806954+0000","last_became_peered":"2024-09-14T09:10:35.806954+0000","last_unstale":"2024-09-14T09:10:46.806743+0000","last_undegraded":"2024-09-14T09:10:46.806743+0000","last_fullsized":"2024-09-14T09:10:46.806743+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:07.626647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010903849999999999,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":6998,"num_read_kb":15727,"num_write":528,"num_write_kb":3578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":347,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806946+0000","last_change":"2024-09-14T09:10:33.814092+0000","last_active":"2024-09-14T09:10:46.806946+0000","last_peered":"2024-09-14T09:10:46.806946+0000","last_clean":"2024-09-14T09:10:46.806946+0000","last_became_active":"2024-09-14T09:10:33.813809+0000","last_became_peered":"2024-09-14T09:10:33.813809+0000","last_unstale":"2024-09-14T09:10:46.806946+0000","last_undegraded":"2024-09-14T09:10:46.806946+0000","last_fullsized":"2024-09-14T09:10:46.806946+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:55.810760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042190199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"150'724","reported_seq":8925,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807092+0000","last_change":"2024-09-14T09:10:36.803816+0000","last_active":"2024-09-14T09:10:46.807092+0000","last_peered":"2024-09-14T09:10:46.807092+0000","last_clean":"2024-09-14T09:10:46.807092+0000","last_became_active":"2024-09-14T09:10:36.802005+0000","last_became_peered":"2024-09-14T09:10:36.802005+0000","last_unstale":"2024-09-14T09:10:46.807092+0000","last_undegraded":"2024-09-14T09:10:46.807092+0000","last_fullsized":"2024-09-14T09:10:46.807092+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:36.656797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064676800000000004,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":9017,"num_read_kb":43383,"num_write":832,"num_write_kb":5619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":180,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806861+0000","last_change":"2024-09-14T09:10:36.805095+0000","last_active":"2024-09-14T09:10:46.806861+0000","last_peered":"2024-09-14T09:10:46.806861+0000","last_clean":"2024-09-14T09:10:46.806861+0000","last_became_active":"2024-09-14T09:10:36.804806+0000","last_became_peered":"2024-09-14T09:10:36.804806+0000","last_unstale":"2024-09-14T09:10:46.806861+0000","last_undegraded":"2024-09-14T09:10:46.806861+0000","last_fullsized":"2024-09-14T09:10:46.806861+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:45.011748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"146'1024","reported_seq":7041,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807250+0000","last_change":"2024-09-14T09:10:34.807002+0000","last_active":"2024-09-14T09:10:46.807250+0000","last_peered":"2024-09-14T09:10:46.807250+0000","last_clean":"2024-09-14T09:10:46.807250+0000","last_became_active":"2024-09-14T09:10:34.805260+0000","last_became_peered":"2024-09-14T09:10:34.805260+0000","last_unstale":"2024-09-14T09:10:46.807250+0000","last_undegraded":"2024-09-14T09:10:46.807250+0000","last_fullsized":"2024-09-14T09:10:46.807250+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:21.009093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093108500000000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":7917,"num_read_kb":40050,"num_write":1441,"num_write_kb":11556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":306,"num_bytes_recovered":7127704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806176+0000","last_change":"2024-09-14T09:10:32.806891+0000","last_active":"2024-09-14T09:10:46.806176+0000","last_peered":"2024-09-14T09:10:46.806176+0000","last_clean":"2024-09-14T09:10:46.806176+0000","last_became_active":"2024-09-14T09:10:32.806571+0000","last_became_peered":"2024-09-14T09:10:32.806571+0000","last_unstale":"2024-09-14T09:10:46.806176+0000","last_undegraded":"2024-09-14T09:10:46.806176+0000","last_fullsized":"2024-09-14T09:10:46.806176+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:52:32.672580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"152'830","reported_seq":10434,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.804148+0000","last_change":"2024-09-14T09:10:36.803840+0000","last_active":"2024-09-14T09:10:46.804148+0000","last_peered":"2024-09-14T09:10:46.804148+0000","last_clean":"2024-09-14T09:10:46.804148+0000","last_became_active":"2024-09-14T09:10:36.801544+0000","last_became_peered":"2024-09-14T09:10:36.801544+0000","last_unstale":"2024-09-14T09:10:46.804148+0000","last_undegraded":"2024-09-14T09:10:46.804148+0000","last_fullsized":"2024-09-14T09:10:46.804148+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:22.359490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001749932,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":11788,"num_read_kb":51374,"num_write":731,"num_write_kb":9360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":344,"num_bytes_recovered":2441232,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"155'1550","reported_seq":11337,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805742+0000","last_change":"2024-09-14T09:10:37.810044+0000","last_active":"2024-09-14T09:10:46.805742+0000","last_peered":"2024-09-14T09:10:46.805742+0000","last_clean":"2024-09-14T09:10:46.805742+0000","last_became_active":"2024-09-14T09:10:37.808020+0000","last_became_peered":"2024-09-14T09:10:37.808020+0000","last_unstale":"2024-09-14T09:10:46.805742+0000","last_undegraded":"2024-09-14T09:10:46.805742+0000","last_fullsized":"2024-09-14T09:10:46.805742+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1550,"log_dups_size":0,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:37.794250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011665530000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":29,"num_read":16156,"num_read_kb":41503,"num_write":1957,"num_write_kb":7195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":2340129,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":333,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805453+0000","last_change":"2024-09-14T09:07:37.260986+0000","last_active":"2024-09-14T09:10:46.805453+0000","last_peered":"2024-09-14T09:10:46.805453+0000","last_clean":"2024-09-14T09:10:46.805453+0000","last_became_active":"2024-09-14T09:07:35.254256+0000","last_became_peered":"2024-09-14T09:07:35.254256+0000","last_unstale":"2024-09-14T09:10:46.805453+0000","last_undegraded":"2024-09-14T09:10:46.805453+0000","last_fullsized":"2024-09-14T09:10:46.805453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:07.063058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096898500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"152'477","reported_seq":10518,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.800187+0000","last_change":"2024-09-14T09:10:34.810738+0000","last_active":"2024-09-14T09:10:46.800187+0000","last_peered":"2024-09-14T09:10:46.800187+0000","last_clean":"2024-09-14T09:10:46.800187+0000","last_became_active":"2024-09-14T09:10:34.808686+0000","last_became_peered":"2024-09-14T09:10:34.808686+0000","last_unstale":"2024-09-14T09:10:46.800187+0000","last_undegraded":"2024-09-14T09:10:46.800187+0000","last_fullsized":"2024-09-14T09:10:46.800187+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:03.253962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011386840000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":9617,"num_read_kb":58850,"num_write":533,"num_write_kb":14690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":275,"num_bytes_recovered":8152899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806365+0000","last_change":"2024-09-14T09:10:38.806538+0000","last_active":"2024-09-14T09:10:46.806365+0000","last_peered":"2024-09-14T09:10:46.806365+0000","last_clean":"2024-09-14T09:10:46.806365+0000","last_became_active":"2024-09-14T09:10:38.806119+0000","last_became_peered":"2024-09-14T09:10:38.806119+0000","last_unstale":"2024-09-14T09:10:46.806365+0000","last_undegraded":"2024-09-14T09:10:46.806365+0000","last_fullsized":"2024-09-14T09:10:46.806365+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:44.063513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"155'780","reported_seq":7525,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.810380+0000","last_change":"2024-09-14T09:10:46.810281+0000","last_active":"2024-09-14T09:10:46.810380+0000","last_peered":"2024-09-14T09:10:46.810380+0000","last_clean":"2024-09-14T09:10:46.810380+0000","last_became_active":"2024-09-14T09:10:46.808545+0000","last_became_peered":"2024-09-14T09:10:46.808545+0000","last_unstale":"2024-09-14T09:10:46.810380+0000","last_undegraded":"2024-09-14T09:10:46.810380+0000","last_fullsized":"2024-09-14T09:10:46.810380+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:14.999438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000844446,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":7624,"num_read_kb":31794,"num_write":893,"num_write_kb":10927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":490,"num_bytes_recovered":230948,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":304,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.804216+0000","last_change":"2024-09-14T09:10:31.806103+0000","last_active":"2024-09-14T09:10:46.804216+0000","last_peered":"2024-09-14T09:10:46.804216+0000","last_clean":"2024-09-14T09:10:46.804216+0000","last_became_active":"2024-09-14T09:10:31.805768+0000","last_became_peered":"2024-09-14T09:10:31.805768+0000","last_unstale":"2024-09-14T09:10:46.804216+0000","last_undegraded":"2024-09-14T09:10:46.804216+0000","last_fullsized":"2024-09-14T09:10:46.804216+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:40.795499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"152'439","reported_seq":2386,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806025+0000","last_change":"2024-09-14T09:10:38.807701+0000","last_active":"2024-09-14T09:10:46.806025+0000","last_peered":"2024-09-14T09:10:46.806025+0000","last_clean":"2024-09-14T09:10:46.806025+0000","last_became_active":"2024-09-14T09:10:38.805463+0000","last_became_peered":"2024-09-14T09:10:38.805463+0000","last_unstale":"2024-09-14T09:10:46.806025+0000","last_undegraded":"2024-09-14T09:10:46.806025+0000","last_fullsized":"2024-09-14T09:10:46.806025+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:08.537012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012021849999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":3112,"num_read_kb":25090,"num_write":394,"num_write_kb":10842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":1975296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":216,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806765+0000","last_change":"2024-09-14T09:09:17.798249+0000","last_active":"2024-09-14T09:10:46.806765+0000","last_peered":"2024-09-14T09:10:46.806765+0000","last_clean":"2024-09-14T09:10:46.806765+0000","last_became_active":"2024-09-14T09:09:17.797925+0000","last_became_peered":"2024-09-14T09:09:17.797925+0000","last_unstale":"2024-09-14T09:10:46.806765+0000","last_undegraded":"2024-09-14T09:10:46.806765+0000","last_fullsized":"2024-09-14T09:10:46.806765+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:22.149422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":238,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806055+0000","last_change":"2024-09-14T09:10:31.813147+0000","last_active":"2024-09-14T09:10:46.806055+0000","last_peered":"2024-09-14T09:10:46.806055+0000","last_clean":"2024-09-14T09:10:46.806055+0000","last_became_active":"2024-09-14T09:10:31.808373+0000","last_became_peered":"2024-09-14T09:10:31.808373+0000","last_unstale":"2024-09-14T09:10:46.806055+0000","last_undegraded":"2024-09-14T09:10:46.806055+0000","last_fullsized":"2024-09-14T09:10:46.806055+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_clean_scrub_stamp":"2024-09-14T09:07:29.211432+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:57:57.332555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"151'696","reported_seq":10500,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.809971+0000","last_change":"2024-09-14T09:10:46.809875+0000","last_active":"2024-09-14T09:10:46.809971+0000","last_peered":"2024-09-14T09:10:46.809971+0000","last_clean":"2024-09-14T09:10:46.809971+0000","last_became_active":"2024-09-14T09:10:46.808573+0000","last_became_peered":"2024-09-14T09:10:46.808573+0000","last_unstale":"2024-09-14T09:10:46.809971+0000","last_undegraded":"2024-09-14T09:10:46.809971+0000","last_fullsized":"2024-09-14T09:10:46.809971+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:13.945422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012882099999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":11028,"num_read_kb":52732,"num_write":579,"num_write_kb":14215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":2555973,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"155'535","reported_seq":7289,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805206+0000","last_change":"2024-09-14T09:10:36.806606+0000","last_active":"2024-09-14T09:10:46.805206+0000","last_peered":"2024-09-14T09:10:46.805206+0000","last_clean":"2024-09-14T09:10:46.805206+0000","last_became_active":"2024-09-14T09:10:36.804585+0000","last_became_peered":"2024-09-14T09:10:36.804585+0000","last_unstale":"2024-09-14T09:10:46.805206+0000","last_undegraded":"2024-09-14T09:10:46.805206+0000","last_fullsized":"2024-09-14T09:10:46.805206+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:37.635151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013332999999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":5991,"num_read_kb":50679,"num_write":476,"num_write_kb":15575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":3599888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"155'923","reported_seq":8217,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805303+0000","last_change":"2024-09-14T09:10:24.802207+0000","last_active":"2024-09-14T09:10:46.805303+0000","last_peered":"2024-09-14T09:10:46.805303+0000","last_clean":"2024-09-14T09:10:46.805303+0000","last_became_active":"2024-09-14T09:09:02.793112+0000","last_became_peered":"2024-09-14T09:09:02.793112+0000","last_unstale":"2024-09-14T09:10:46.805303+0000","last_undegraded":"2024-09-14T09:10:46.805303+0000","last_fullsized":"2024-09-14T09:10:46.805303+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:20.589668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001478858,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":9011,"num_read_kb":44883,"num_write":1107,"num_write_kb":15908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":9779638,"num_keys_recovered":46,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"155'481","reported_seq":5580,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806710+0000","last_change":"2024-09-14T09:10:38.808915+0000","last_active":"2024-09-14T09:10:46.806710+0000","last_peered":"2024-09-14T09:10:46.806710+0000","last_clean":"2024-09-14T09:10:46.806710+0000","last_became_active":"2024-09-14T09:10:38.807014+0000","last_became_peered":"2024-09-14T09:10:38.807014+0000","last_unstale":"2024-09-14T09:10:46.806710+0000","last_undegraded":"2024-09-14T09:10:46.806710+0000","last_fullsized":"2024-09-14T09:10:46.806710+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:33.459042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060512200000000004,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":4794,"num_read_kb":18724,"num_write":499,"num_write_kb":6053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":540832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"152'976","reported_seq":17838,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805312+0000","last_change":"2024-09-14T09:10:37.810417+0000","last_active":"2024-09-14T09:10:46.805312+0000","last_peered":"2024-09-14T09:10:46.805312+0000","last_clean":"2024-09-14T09:10:46.805312+0000","last_became_active":"2024-09-14T09:10:37.808431+0000","last_became_peered":"2024-09-14T09:10:37.808431+0000","last_unstale":"2024-09-14T09:10:46.805312+0000","last_undegraded":"2024-09-14T09:10:46.805312+0000","last_fullsized":"2024-09-14T09:10:46.805312+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":976,"log_dups_size":0,"ondisk_log_size":976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:01.165563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017008710000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":13865,"num_read_kb":46941,"num_write":938,"num_write_kb":9955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":415,"num_bytes_recovered":13533184,"num_keys_recovered":116,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"155'519","reported_seq":21765,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806976+0000","last_change":"2024-09-14T09:10:35.815411+0000","last_active":"2024-09-14T09:10:46.806976+0000","last_peered":"2024-09-14T09:10:46.806976+0000","last_clean":"2024-09-14T09:10:46.806976+0000","last_became_active":"2024-09-14T09:10:35.813901+0000","last_became_peered":"2024-09-14T09:10:35.813901+0000","last_unstale":"2024-09-14T09:10:46.806976+0000","last_undegraded":"2024-09-14T09:10:46.806976+0000","last_fullsized":"2024-09-14T09:10:46.806976+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:37.344370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029838349999999998,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":21382,"num_read_kb":52622,"num_write":626,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":374,"num_bytes_recovered":16325120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"151'564","reported_seq":4579,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.804529+0000","last_change":"2024-09-14T09:10:35.813746+0000","last_active":"2024-09-14T09:10:46.804529+0000","last_peered":"2024-09-14T09:10:46.804529+0000","last_clean":"2024-09-14T09:10:46.804529+0000","last_became_active":"2024-09-14T09:10:35.811599+0000","last_became_peered":"2024-09-14T09:10:35.811599+0000","last_unstale":"2024-09-14T09:10:46.804529+0000","last_undegraded":"2024-09-14T09:10:46.804529+0000","last_fullsized":"2024-09-14T09:10:46.804529+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:01.203388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001022088,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":5433,"num_read_kb":39557,"num_write":475,"num_write_kb":12186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":585,"num_bytes_recovered":15375904,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"146'391","reported_seq":3667,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807738+0000","last_change":"2024-09-14T09:10:37.813721+0000","last_active":"2024-09-14T09:10:46.807738+0000","last_peered":"2024-09-14T09:10:46.807738+0000","last_clean":"2024-09-14T09:10:46.807738+0000","last_became_active":"2024-09-14T09:10:37.811679+0000","last_became_peered":"2024-09-14T09:10:37.811679+0000","last_unstale":"2024-09-14T09:10:46.807738+0000","last_undegraded":"2024-09-14T09:10:46.807738+0000","last_fullsized":"2024-09-14T09:10:46.807738+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:33:03.454799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010483549999999999,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":2165,"num_read_kb":13861,"num_write":340,"num_write_kb":3973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":1385641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"146'576","reported_seq":10523,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806192+0000","last_change":"2024-09-14T09:10:36.816638+0000","last_active":"2024-09-14T09:10:46.806192+0000","last_peered":"2024-09-14T09:10:46.806192+0000","last_clean":"2024-09-14T09:10:46.806192+0000","last_became_active":"2024-09-14T09:10:36.814772+0000","last_became_peered":"2024-09-14T09:10:36.814772+0000","last_unstale":"2024-09-14T09:10:46.806192+0000","last_undegraded":"2024-09-14T09:10:46.806192+0000","last_fullsized":"2024-09-14T09:10:46.806192+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:22.267528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024013369999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":9710,"num_read_kb":41453,"num_write":717,"num_write_kb":14547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":515,"num_bytes_recovered":6681771,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"151'842","reported_seq":10962,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.811796+0000","last_change":"2024-09-14T09:10:46.811228+0000","last_active":"2024-09-14T09:10:46.811796+0000","last_peered":"2024-09-14T09:10:46.811796+0000","last_clean":"2024-09-14T09:10:46.811796+0000","last_became_active":"2024-09-14T09:10:46.808235+0000","last_became_peered":"2024-09-14T09:10:46.808235+0000","last_unstale":"2024-09-14T09:10:46.811796+0000","last_undegraded":"2024-09-14T09:10:46.811796+0000","last_fullsized":"2024-09-14T09:10:46.811796+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:50.657704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001545701,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":12979,"num_read_kb":59033,"num_write":700,"num_write_kb":13832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":649,"num_bytes_recovered":10373286,"num_keys_recovered":102,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"152'480","reported_seq":4978,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.800266+0000","last_change":"2024-09-14T09:10:35.811341+0000","last_active":"2024-09-14T09:10:46.800266+0000","last_peered":"2024-09-14T09:10:46.800266+0000","last_clean":"2024-09-14T09:10:46.800266+0000","last_became_active":"2024-09-14T09:10:35.809716+0000","last_became_peered":"2024-09-14T09:10:35.809716+0000","last_unstale":"2024-09-14T09:10:46.800266+0000","last_undegraded":"2024-09-14T09:10:46.800266+0000","last_fullsized":"2024-09-14T09:10:46.800266+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:34.306889+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0036893669999999998,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3997,"num_read_kb":34359,"num_write":407,"num_write_kb":6924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":317,"num_bytes_recovered":2955870,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"155'2202","reported_seq":9111,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806404+0000","last_change":"2024-09-14T09:10:24.806079+0000","last_active":"2024-09-14T09:10:46.806404+0000","last_peered":"2024-09-14T09:10:46.806404+0000","last_clean":"2024-09-14T09:10:46.806404+0000","last_became_active":"2024-09-14T09:09:03.794283+0000","last_became_peered":"2024-09-14T09:09:03.794283+0000","last_unstale":"2024-09-14T09:10:46.806404+0000","last_undegraded":"2024-09-14T09:10:46.806404+0000","last_fullsized":"2024-09-14T09:10:46.806404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":2202,"log_dups_size":0,"ondisk_log_size":2202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:28.286762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013071960000000001,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":16728,"num_read_kb":45108,"num_write":3399,"num_write_kb":14849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":4151803,"num_keys_recovered":53,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":880,"num_object_clones":0,"num_object_copies":1760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":880,"num_whiteouts":876,"num_read":421320,"num_read_kb":1460227,"num_write":27245,"num_write_kb":494223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11099,"num_bytes_recovered":245332849,"num_keys_recovered":856,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12266,"internal_metadata":0},"log_size":24598,"ondisk_log_size":24598,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":87,"seq":373662154773,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47572,"kb_used_data":2044,"kb_used_omap":24,"kb_used_meta":45479,"kb_avail":94324268,"statfs":{"total":96636764160,"available":96588050432,"internally_reserved":0,"allocated":2093056,"data_stored":882432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24922,"internal_metadata":46571174},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96292,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94275548,"statfs":{"total":96636764160,"available":96538161152,"internally_reserved":0,"allocated":2691072,"data_stored":1472819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607596,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51864,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319976,"statfs":{"total":96636764160,"available":96583655424,"internally_reserved":0,"allocated":2691072,"data_stored":1472819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607598,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47132,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324708,"statfs":{"total":96636764160,"available":96588500992,"internally_reserved":0,"allocated":2097152,"data_stored":882451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607596,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95636,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94276204,"statfs":{"total":96636764160,"available":96538832896,"internally_reserved":0,"allocated":2093056,"data_stored":882432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":95812039},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640300,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73480,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298360,"statfs":{"total":96636764160,"available":96561520640,"internally_reserved":0,"allocated":2084864,"data_stored":877409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12266,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T09:10:52.231 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T09:10:52.232 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T09:10:52.511 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:10:52.511 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T09:10:52.522 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-09-14T09:10:51.214325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":884,"num_object_clones":0,"num_object_copies":1768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":884,"num_whiteouts":876,"num_read":421386,"num_read_kb":1460282,"num_write":27348,"num_write_kb":495853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11108,"num_bytes_recovered":247694321,"num_keys_recovered":856,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24673,"ondisk_log_size":24673,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":411976,"kb_used_data":13428,"kb_used_omap":32,"kb_used_meta":398367,"kb_avail":565819064,"statfs":{"total":579820584960,"available":579398721536,"internally_reserved":0,"allocated":13750272,"data_stored":6470362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32895,"internal_metadata":407928705},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":672,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.303076"},"pg_stats":[{"pgid":"3.1f","version":"155'762","reported_seq":6895,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.800398+0000","last_change":"2024-09-14T09:10:34.813822+0000","last_active":"2024-09-14T09:10:46.800398+0000","last_peered":"2024-09-14T09:10:46.800398+0000","last_clean":"2024-09-14T09:10:46.800398+0000","last_became_active":"2024-09-14T09:10:34.812378+0000","last_became_peered":"2024-09-14T09:10:34.812378+0000","last_unstale":"2024-09-14T09:10:46.800398+0000","last_undegraded":"2024-09-14T09:10:46.800398+0000","last_fullsized":"2024-09-14T09:10:46.800398+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:30.774451+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0042793429999999997,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":6424,"num_read_kb":42400,"num_write":961,"num_write_kb":16264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":566,"num_bytes_recovered":18399808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"151'487","reported_seq":8533,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.809980+0000","last_change":"2024-09-14T09:10:46.809879+0000","last_active":"2024-09-14T09:10:46.809980+0000","last_peered":"2024-09-14T09:10:46.809980+0000","last_clean":"2024-09-14T09:10:46.809980+0000","last_became_active":"2024-09-14T09:10:46.808487+0000","last_became_peered":"2024-09-14T09:10:46.808487+0000","last_unstale":"2024-09-14T09:10:46.809980+0000","last_undegraded":"2024-09-14T09:10:46.809980+0000","last_fullsized":"2024-09-14T09:10:46.809980+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:16.236725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001792068,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":7749,"num_read_kb":36057,"num_write":459,"num_write_kb":5529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":7376960,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"155'678","reported_seq":7048,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.804472+0000","last_change":"2024-09-14T09:10:36.808697+0000","last_active":"2024-09-14T09:10:46.804472+0000","last_peered":"2024-09-14T09:10:46.804472+0000","last_clean":"2024-09-14T09:10:46.804472+0000","last_became_active":"2024-09-14T09:10:36.806572+0000","last_became_peered":"2024-09-14T09:10:36.806572+0000","last_unstale":"2024-09-14T09:10:46.804472+0000","last_undegraded":"2024-09-14T09:10:46.804472+0000","last_fullsized":"2024-09-14T09:10:46.804472+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:14.168101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097120599999999996,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":10173,"num_read_kb":74789,"num_write":721,"num_write_kb":20037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":358,"num_bytes_recovered":31416461,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"155'783","reported_seq":6762,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807290+0000","last_change":"2024-09-14T09:10:38.808376+0000","last_active":"2024-09-14T09:10:46.807290+0000","last_peered":"2024-09-14T09:10:46.807290+0000","last_clean":"2024-09-14T09:10:46.807290+0000","last_became_active":"2024-09-14T09:10:38.806707+0000","last_became_peered":"2024-09-14T09:10:38.806707+0000","last_unstale":"2024-09-14T09:10:46.807290+0000","last_undegraded":"2024-09-14T09:10:46.807290+0000","last_fullsized":"2024-09-14T09:10:46.807290+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:32.661615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017015209999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":7807,"num_read_kb":21023,"num_write":814,"num_write_kb":12470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":2849546,"num_keys_recovered":242,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"152'752","reported_seq":6451,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806513+0000","last_change":"2024-09-14T09:10:36.810578+0000","last_active":"2024-09-14T09:10:46.806513+0000","last_peered":"2024-09-14T09:10:46.806513+0000","last_clean":"2024-09-14T09:10:46.806513+0000","last_became_active":"2024-09-14T09:10:36.808440+0000","last_became_peered":"2024-09-14T09:10:36.808440+0000","last_unstale":"2024-09-14T09:10:46.806513+0000","last_undegraded":"2024-09-14T09:10:46.806513+0000","last_fullsized":"2024-09-14T09:10:46.806513+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:32.467757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084872500000000004,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":7088,"num_read_kb":42687,"num_write":978,"num_write_kb":14384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":417,"num_bytes_recovered":16991946,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"155'1100","reported_seq":46326,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806116+0000","last_change":"2024-09-14T09:10:36.817314+0000","last_active":"2024-09-14T09:10:46.806116+0000","last_peered":"2024-09-14T09:10:46.806116+0000","last_clean":"2024-09-14T09:10:46.806116+0000","last_became_active":"2024-09-14T09:10:36.814993+0000","last_became_peered":"2024-09-14T09:10:36.814993+0000","last_unstale":"2024-09-14T09:10:46.806116+0000","last_undegraded":"2024-09-14T09:10:46.806116+0000","last_fullsized":"2024-09-14T09:10:46.806116+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1100,"log_dups_size":0,"ondisk_log_size":1100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:01.751040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002639925,"stat_sum":{"num_bytes":19,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":23,"num_read":46462,"num_read_kb":92242,"num_write":1032,"num_write_kb":40131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":432,"num_bytes_recovered":16835316,"num_keys_recovered":71,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"150'528","reported_seq":8997,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806548+0000","last_change":"2024-09-14T09:10:35.807979+0000","last_active":"2024-09-14T09:10:46.806548+0000","last_peered":"2024-09-14T09:10:46.806548+0000","last_clean":"2024-09-14T09:10:46.806548+0000","last_became_active":"2024-09-14T09:10:35.806694+0000","last_became_peered":"2024-09-14T09:10:35.806694+0000","last_unstale":"2024-09-14T09:10:46.806548+0000","last_undegraded":"2024-09-14T09:10:46.806548+0000","last_fullsized":"2024-09-14T09:10:46.806548+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:30.197773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081109400000000005,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":8055,"num_read_kb":52380,"num_write":658,"num_write_kb":14132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"150'793","reported_seq":6498,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806101+0000","last_change":"2024-09-14T09:10:38.808926+0000","last_active":"2024-09-14T09:10:46.806101+0000","last_peered":"2024-09-14T09:10:46.806101+0000","last_clean":"2024-09-14T09:10:46.806101+0000","last_became_active":"2024-09-14T09:10:38.807058+0000","last_became_peered":"2024-09-14T09:10:38.807058+0000","last_unstale":"2024-09-14T09:10:46.806101+0000","last_undegraded":"2024-09-14T09:10:46.806101+0000","last_fullsized":"2024-09-14T09:10:46.806101+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:21.481048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001015438,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":7244,"num_read_kb":25042,"num_write":1081,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"152'859","reported_seq":72055,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.800329+0000","last_change":"2024-09-14T09:10:37.809948+0000","last_active":"2024-09-14T09:10:46.800329+0000","last_peered":"2024-09-14T09:10:46.800329+0000","last_clean":"2024-09-14T09:10:46.800329+0000","last_became_active":"2024-09-14T09:10:37.807994+0000","last_became_peered":"2024-09-14T09:10:37.807994+0000","last_unstale":"2024-09-14T09:10:46.800329+0000","last_undegraded":"2024-09-14T09:10:46.800329+0000","last_fullsized":"2024-09-14T09:10:46.800329+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:21.137544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017200060000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":74396,"num_read_kb":113736,"num_write":1000,"num_write_kb":72684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":501,"num_bytes_recovered":30088824,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"145'552","reported_seq":21638,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.810940+0000","last_change":"2024-09-14T09:10:46.810252+0000","last_active":"2024-09-14T09:10:46.810940+0000","last_peered":"2024-09-14T09:10:46.810940+0000","last_clean":"2024-09-14T09:10:46.810940+0000","last_became_active":"2024-09-14T09:10:46.808488+0000","last_became_peered":"2024-09-14T09:10:46.808488+0000","last_unstale":"2024-09-14T09:10:46.810940+0000","last_undegraded":"2024-09-14T09:10:46.810940+0000","last_fullsized":"2024-09-14T09:10:46.810940+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:21.120854+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00073203199999999997,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":21018,"num_read_kb":58767,"num_write":570,"num_write_kb":35397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":448,"num_bytes_recovered":7392256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"150'952","reported_seq":57761,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806425+0000","last_change":"2024-09-14T09:10:35.811768+0000","last_active":"2024-09-14T09:10:46.806425+0000","last_peered":"2024-09-14T09:10:46.806425+0000","last_clean":"2024-09-14T09:10:46.806425+0000","last_became_active":"2024-09-14T09:10:35.810160+0000","last_became_peered":"2024-09-14T09:10:35.810160+0000","last_unstale":"2024-09-14T09:10:46.806425+0000","last_undegraded":"2024-09-14T09:10:46.806425+0000","last_fullsized":"2024-09-14T09:10:46.806425+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:21:57.677481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068915899999999995,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":27804,"num_read_kb":68813,"num_write":785,"num_write_kb":21040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"152'650","reported_seq":6238,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807155+0000","last_change":"2024-09-14T09:10:36.813886+0000","last_active":"2024-09-14T09:10:46.807155+0000","last_peered":"2024-09-14T09:10:46.807155+0000","last_clean":"2024-09-14T09:10:46.807155+0000","last_became_active":"2024-09-14T09:10:36.812242+0000","last_became_peered":"2024-09-14T09:10:36.812242+0000","last_unstale":"2024-09-14T09:10:46.807155+0000","last_undegraded":"2024-09-14T09:10:46.807155+0000","last_fullsized":"2024-09-14T09:10:46.807155+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:17.220451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067904769999999996,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":7788,"num_read_kb":24568,"num_write":614,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":4454614,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":180,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806839+0000","last_change":"2024-09-14T09:10:36.818028+0000","last_active":"2024-09-14T09:10:46.806839+0000","last_peered":"2024-09-14T09:10:46.806839+0000","last_clean":"2024-09-14T09:10:46.806839+0000","last_became_active":"2024-09-14T09:10:36.817650+0000","last_became_peered":"2024-09-14T09:10:36.817650+0000","last_unstale":"2024-09-14T09:10:46.806839+0000","last_undegraded":"2024-09-14T09:10:46.806839+0000","last_fullsized":"2024-09-14T09:10:46.806839+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:05.095616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061552199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"155'693","reported_seq":5997,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806743+0000","last_change":"2024-09-14T09:10:35.809230+0000","last_active":"2024-09-14T09:10:46.806743+0000","last_peered":"2024-09-14T09:10:46.806743+0000","last_clean":"2024-09-14T09:10:46.806743+0000","last_became_active":"2024-09-14T09:10:35.806954+0000","last_became_peered":"2024-09-14T09:10:35.806954+0000","last_unstale":"2024-09-14T09:10:46.806743+0000","last_undegraded":"2024-09-14T09:10:46.806743+0000","last_fullsized":"2024-09-14T09:10:46.806743+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:07.626647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010903849999999999,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":6998,"num_read_kb":15727,"num_write":528,"num_write_kb":3578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":347,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806946+0000","last_change":"2024-09-14T09:10:33.814092+0000","last_active":"2024-09-14T09:10:46.806946+0000","last_peered":"2024-09-14T09:10:46.806946+0000","last_clean":"2024-09-14T09:10:46.806946+0000","last_became_active":"2024-09-14T09:10:33.813809+0000","last_became_peered":"2024-09-14T09:10:33.813809+0000","last_unstale":"2024-09-14T09:10:46.806946+0000","last_undegraded":"2024-09-14T09:10:46.806946+0000","last_fullsized":"2024-09-14T09:10:46.806946+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:55.810760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042190199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"150'724","reported_seq":8925,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807092+0000","last_change":"2024-09-14T09:10:36.803816+0000","last_active":"2024-09-14T09:10:46.807092+0000","last_peered":"2024-09-14T09:10:46.807092+0000","last_clean":"2024-09-14T09:10:46.807092+0000","last_became_active":"2024-09-14T09:10:36.802005+0000","last_became_peered":"2024-09-14T09:10:36.802005+0000","last_unstale":"2024-09-14T09:10:46.807092+0000","last_undegraded":"2024-09-14T09:10:46.807092+0000","last_fullsized":"2024-09-14T09:10:46.807092+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:36.656797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064676800000000004,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":9017,"num_read_kb":43383,"num_write":832,"num_write_kb":5619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":180,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806861+0000","last_change":"2024-09-14T09:10:36.805095+0000","last_active":"2024-09-14T09:10:46.806861+0000","last_peered":"2024-09-14T09:10:46.806861+0000","last_clean":"2024-09-14T09:10:46.806861+0000","last_became_active":"2024-09-14T09:10:36.804806+0000","last_became_peered":"2024-09-14T09:10:36.804806+0000","last_unstale":"2024-09-14T09:10:46.806861+0000","last_undegraded":"2024-09-14T09:10:46.806861+0000","last_fullsized":"2024-09-14T09:10:46.806861+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:45.011748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"146'1024","reported_seq":7041,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807250+0000","last_change":"2024-09-14T09:10:34.807002+0000","last_active":"2024-09-14T09:10:46.807250+0000","last_peered":"2024-09-14T09:10:46.807250+0000","last_clean":"2024-09-14T09:10:46.807250+0000","last_became_active":"2024-09-14T09:10:34.805260+0000","last_became_peered":"2024-09-14T09:10:34.805260+0000","last_unstale":"2024-09-14T09:10:46.807250+0000","last_undegraded":"2024-09-14T09:10:46.807250+0000","last_fullsized":"2024-09-14T09:10:46.807250+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:21.009093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093108500000000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":7917,"num_read_kb":40050,"num_write":1441,"num_write_kb":11556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":306,"num_bytes_recovered":7127704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806176+0000","last_change":"2024-09-14T09:10:32.806891+0000","last_active":"2024-09-14T09:10:46.806176+0000","last_peered":"2024-09-14T09:10:46.806176+0000","last_clean":"2024-09-14T09:10:46.806176+0000","last_became_active":"2024-09-14T09:10:32.806571+0000","last_became_peered":"2024-09-14T09:10:32.806571+0000","last_unstale":"2024-09-14T09:10:46.806176+0000","last_undegraded":"2024-09-14T09:10:46.806176+0000","last_fullsized":"2024-09-14T09:10:46.806176+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:52:32.672580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"152'830","reported_seq":10434,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.804148+0000","last_change":"2024-09-14T09:10:36.803840+0000","last_active":"2024-09-14T09:10:46.804148+0000","last_peered":"2024-09-14T09:10:46.804148+0000","last_clean":"2024-09-14T09:10:46.804148+0000","last_became_active":"2024-09-14T09:10:36.801544+0000","last_became_peered":"2024-09-14T09:10:36.801544+0000","last_unstale":"2024-09-14T09:10:46.804148+0000","last_undegraded":"2024-09-14T09:10:46.804148+0000","last_fullsized":"2024-09-14T09:10:46.804148+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:22.359490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001749932,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":11788,"num_read_kb":51374,"num_write":731,"num_write_kb":9360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":344,"num_bytes_recovered":2441232,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"155'1550","reported_seq":11337,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805742+0000","last_change":"2024-09-14T09:10:37.810044+0000","last_active":"2024-09-14T09:10:46.805742+0000","last_peered":"2024-09-14T09:10:46.805742+0000","last_clean":"2024-09-14T09:10:46.805742+0000","last_became_active":"2024-09-14T09:10:37.808020+0000","last_became_peered":"2024-09-14T09:10:37.808020+0000","last_unstale":"2024-09-14T09:10:46.805742+0000","last_undegraded":"2024-09-14T09:10:46.805742+0000","last_fullsized":"2024-09-14T09:10:46.805742+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1550,"log_dups_size":0,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:37.794250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011665530000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":29,"num_read":16156,"num_read_kb":41503,"num_write":1957,"num_write_kb":7195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":2340129,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":333,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805453+0000","last_change":"2024-09-14T09:07:37.260986+0000","last_active":"2024-09-14T09:10:46.805453+0000","last_peered":"2024-09-14T09:10:46.805453+0000","last_clean":"2024-09-14T09:10:46.805453+0000","last_became_active":"2024-09-14T09:07:35.254256+0000","last_became_peered":"2024-09-14T09:07:35.254256+0000","last_unstale":"2024-09-14T09:10:46.805453+0000","last_undegraded":"2024-09-14T09:10:46.805453+0000","last_fullsized":"2024-09-14T09:10:46.805453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:07.063058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096898500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"152'477","reported_seq":10518,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.800187+0000","last_change":"2024-09-14T09:10:34.810738+0000","last_active":"2024-09-14T09:10:46.800187+0000","last_peered":"2024-09-14T09:10:46.800187+0000","last_clean":"2024-09-14T09:10:46.800187+0000","last_became_active":"2024-09-14T09:10:34.808686+0000","last_became_peered":"2024-09-14T09:10:34.808686+0000","last_unstale":"2024-09-14T09:10:46.800187+0000","last_undegraded":"2024-09-14T09:10:46.800187+0000","last_fullsized":"2024-09-14T09:10:46.800187+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:03.253962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011386840000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":9617,"num_read_kb":58850,"num_write":533,"num_write_kb":14690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":275,"num_bytes_recovered":8152899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806365+0000","last_change":"2024-09-14T09:10:38.806538+0000","last_active":"2024-09-14T09:10:46.806365+0000","last_peered":"2024-09-14T09:10:46.806365+0000","last_clean":"2024-09-14T09:10:46.806365+0000","last_became_active":"2024-09-14T09:10:38.806119+0000","last_became_peered":"2024-09-14T09:10:38.806119+0000","last_unstale":"2024-09-14T09:10:46.806365+0000","last_undegraded":"2024-09-14T09:10:46.806365+0000","last_fullsized":"2024-09-14T09:10:46.806365+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:44.063513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"155'780","reported_seq":7525,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.810380+0000","last_change":"2024-09-14T09:10:46.810281+0000","last_active":"2024-09-14T09:10:46.810380+0000","last_peered":"2024-09-14T09:10:46.810380+0000","last_clean":"2024-09-14T09:10:46.810380+0000","last_became_active":"2024-09-14T09:10:46.808545+0000","last_became_peered":"2024-09-14T09:10:46.808545+0000","last_unstale":"2024-09-14T09:10:46.810380+0000","last_undegraded":"2024-09-14T09:10:46.810380+0000","last_fullsized":"2024-09-14T09:10:46.810380+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:14.999438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000844446,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":7624,"num_read_kb":31794,"num_write":893,"num_write_kb":10927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":490,"num_bytes_recovered":230948,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":304,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.804216+0000","last_change":"2024-09-14T09:10:31.806103+0000","last_active":"2024-09-14T09:10:46.804216+0000","last_peered":"2024-09-14T09:10:46.804216+0000","last_clean":"2024-09-14T09:10:46.804216+0000","last_became_active":"2024-09-14T09:10:31.805768+0000","last_became_peered":"2024-09-14T09:10:31.805768+0000","last_unstale":"2024-09-14T09:10:46.804216+0000","last_undegraded":"2024-09-14T09:10:46.804216+0000","last_fullsized":"2024-09-14T09:10:46.804216+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:40.795499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"152'439","reported_seq":2386,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806025+0000","last_change":"2024-09-14T09:10:38.807701+0000","last_active":"2024-09-14T09:10:46.806025+0000","last_peered":"2024-09-14T09:10:46.806025+0000","last_clean":"2024-09-14T09:10:46.806025+0000","last_became_active":"2024-09-14T09:10:38.805463+0000","last_became_peered":"2024-09-14T09:10:38.805463+0000","last_unstale":"2024-09-14T09:10:46.806025+0000","last_undegraded":"2024-09-14T09:10:46.806025+0000","last_fullsized":"2024-09-14T09:10:46.806025+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:08.537012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012021849999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":3112,"num_read_kb":25090,"num_write":394,"num_write_kb":10842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":1975296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":216,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806765+0000","last_change":"2024-09-14T09:09:17.798249+0000","last_active":"2024-09-14T09:10:46.806765+0000","last_peered":"2024-09-14T09:10:46.806765+0000","last_clean":"2024-09-14T09:10:46.806765+0000","last_became_active":"2024-09-14T09:09:17.797925+0000","last_became_peered":"2024-09-14T09:09:17.797925+0000","last_unstale":"2024-09-14T09:10:46.806765+0000","last_undegraded":"2024-09-14T09:10:46.806765+0000","last_fullsized":"2024-09-14T09:10:46.806765+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:22.149422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":238,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806055+0000","last_change":"2024-09-14T09:10:31.813147+0000","last_active":"2024-09-14T09:10:46.806055+0000","last_peered":"2024-09-14T09:10:46.806055+0000","last_clean":"2024-09-14T09:10:46.806055+0000","last_became_active":"2024-09-14T09:10:31.808373+0000","last_became_peered":"2024-09-14T09:10:31.808373+0000","last_unstale":"2024-09-14T09:10:46.806055+0000","last_undegraded":"2024-09-14T09:10:46.806055+0000","last_fullsized":"2024-09-14T09:10:46.806055+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_clean_scrub_stamp":"2024-09-14T09:07:29.211432+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:57:57.332555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"151'696","reported_seq":10500,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.809971+0000","last_change":"2024-09-14T09:10:46.809875+0000","last_active":"2024-09-14T09:10:46.809971+0000","last_peered":"2024-09-14T09:10:46.809971+0000","last_clean":"2024-09-14T09:10:46.809971+0000","last_became_active":"2024-09-14T09:10:46.808573+0000","last_became_peered":"2024-09-14T09:10:46.808573+0000","last_unstale":"2024-09-14T09:10:46.809971+0000","last_undegraded":"2024-09-14T09:10:46.809971+0000","last_fullsized":"2024-09-14T09:10:46.809971+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:13.945422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012882099999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":11028,"num_read_kb":52732,"num_write":579,"num_write_kb":14215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":2555973,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"155'535","reported_seq":7289,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805206+0000","last_change":"2024-09-14T09:10:36.806606+0000","last_active":"2024-09-14T09:10:46.805206+0000","last_peered":"2024-09-14T09:10:46.805206+0000","last_clean":"2024-09-14T09:10:46.805206+0000","last_became_active":"2024-09-14T09:10:36.804585+0000","last_became_peered":"2024-09-14T09:10:36.804585+0000","last_unstale":"2024-09-14T09:10:46.805206+0000","last_undegraded":"2024-09-14T09:10:46.805206+0000","last_fullsized":"2024-09-14T09:10:46.805206+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:37.635151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013332999999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":5991,"num_read_kb":50679,"num_write":476,"num_write_kb":15575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":3599888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"155'923","reported_seq":8217,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805303+0000","last_change":"2024-09-14T09:10:24.802207+0000","last_active":"2024-09-14T09:10:46.805303+0000","last_peered":"2024-09-14T09:10:46.805303+0000","last_clean":"2024-09-14T09:10:46.805303+0000","last_became_active":"2024-09-14T09:09:02.793112+0000","last_became_peered":"2024-09-14T09:09:02.793112+0000","last_unstale":"2024-09-14T09:10:46.805303+0000","last_undegraded":"2024-09-14T09:10:46.805303+0000","last_fullsized":"2024-09-14T09:10:46.805303+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:20.589668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001478858,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":9011,"num_read_kb":44883,"num_write":1107,"num_write_kb":15908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":9779638,"num_keys_recovered":46,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"155'481","reported_seq":5580,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806710+0000","last_change":"2024-09-14T09:10:38.808915+0000","last_active":"2024-09-14T09:10:46.806710+0000","last_peered":"2024-09-14T09:10:46.806710+0000","last_clean":"2024-09-14T09:10:46.806710+0000","last_became_active":"2024-09-14T09:10:38.807014+0000","last_became_peered":"2024-09-14T09:10:38.807014+0000","last_unstale":"2024-09-14T09:10:46.806710+0000","last_undegraded":"2024-09-14T09:10:46.806710+0000","last_fullsized":"2024-09-14T09:10:46.806710+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:33.459042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060512200000000004,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":4794,"num_read_kb":18724,"num_write":499,"num_write_kb":6053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":540832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"152'976","reported_seq":17838,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805312+0000","last_change":"2024-09-14T09:10:37.810417+0000","last_active":"2024-09-14T09:10:46.805312+0000","last_peered":"2024-09-14T09:10:46.805312+0000","last_clean":"2024-09-14T09:10:46.805312+0000","last_became_active":"2024-09-14T09:10:37.808431+0000","last_became_peered":"2024-09-14T09:10:37.808431+0000","last_unstale":"2024-09-14T09:10:46.805312+0000","last_undegraded":"2024-09-14T09:10:46.805312+0000","last_fullsized":"2024-09-14T09:10:46.805312+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":976,"log_dups_size":0,"ondisk_log_size":976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:01.165563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017008710000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":13865,"num_read_kb":46941,"num_write":938,"num_write_kb":9955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":415,"num_bytes_recovered":13533184,"num_keys_recovered":116,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"155'519","reported_seq":21765,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806976+0000","last_change":"2024-09-14T09:10:35.815411+0000","last_active":"2024-09-14T09:10:46.806976+0000","last_peered":"2024-09-14T09:10:46.806976+0000","last_clean":"2024-09-14T09:10:46.806976+0000","last_became_active":"2024-09-14T09:10:35.813901+0000","last_became_peered":"2024-09-14T09:10:35.813901+0000","last_unstale":"2024-09-14T09:10:46.806976+0000","last_undegraded":"2024-09-14T09:10:46.806976+0000","last_fullsized":"2024-09-14T09:10:46.806976+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:37.344370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029838349999999998,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":21382,"num_read_kb":52622,"num_write":626,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":374,"num_bytes_recovered":16325120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"151'564","reported_seq":4579,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.804529+0000","last_change":"2024-09-14T09:10:35.813746+0000","last_active":"2024-09-14T09:10:46.804529+0000","last_peered":"2024-09-14T09:10:46.804529+0000","last_clean":"2024-09-14T09:10:46.804529+0000","last_became_active":"2024-09-14T09:10:35.811599+0000","last_became_peered":"2024-09-14T09:10:35.811599+0000","last_unstale":"2024-09-14T09:10:46.804529+0000","last_undegraded":"2024-09-14T09:10:46.804529+0000","last_fullsized":"2024-09-14T09:10:46.804529+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:01.203388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001022088,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":5433,"num_read_kb":39557,"num_write":475,"num_write_kb":12186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":585,"num_bytes_recovered":15375904,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"146'391","reported_seq":3667,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807738+0000","last_change":"2024-09-14T09:10:37.813721+0000","last_active":"2024-09-14T09:10:46.807738+0000","last_peered":"2024-09-14T09:10:46.807738+0000","last_clean":"2024-09-14T09:10:46.807738+0000","last_became_active":"2024-09-14T09:10:37.811679+0000","last_became_peered":"2024-09-14T09:10:37.811679+0000","last_unstale":"2024-09-14T09:10:46.807738+0000","last_undegraded":"2024-09-14T09:10:46.807738+0000","last_fullsized":"2024-09-14T09:10:46.807738+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:33:03.454799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010483549999999999,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":2165,"num_read_kb":13861,"num_write":340,"num_write_kb":3973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":1385641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"146'576","reported_seq":10523,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806192+0000","last_change":"2024-09-14T09:10:36.816638+0000","last_active":"2024-09-14T09:10:46.806192+0000","last_peered":"2024-09-14T09:10:46.806192+0000","last_clean":"2024-09-14T09:10:46.806192+0000","last_became_active":"2024-09-14T09:10:36.814772+0000","last_became_peered":"2024-09-14T09:10:36.814772+0000","last_unstale":"2024-09-14T09:10:46.806192+0000","last_undegraded":"2024-09-14T09:10:46.806192+0000","last_fullsized":"2024-09-14T09:10:46.806192+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:22.267528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024013369999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":9710,"num_read_kb":41453,"num_write":717,"num_write_kb":14547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":515,"num_bytes_recovered":6681771,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"151'842","reported_seq":10962,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.811796+0000","last_change":"2024-09-14T09:10:46.811228+0000","last_active":"2024-09-14T09:10:46.811796+0000","last_peered":"2024-09-14T09:10:46.811796+0000","last_clean":"2024-09-14T09:10:46.811796+0000","last_became_active":"2024-09-14T09:10:46.808235+0000","last_became_peered":"2024-09-14T09:10:46.808235+0000","last_unstale":"2024-09-14T09:10:46.811796+0000","last_undegraded":"2024-09-14T09:10:46.811796+0000","last_fullsized":"2024-09-14T09:10:46.811796+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:50.657704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001545701,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":12979,"num_read_kb":59033,"num_write":700,"num_write_kb":13832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":649,"num_bytes_recovered":10373286,"num_keys_recovered":102,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"152'480","reported_seq":4978,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.800266+0000","last_change":"2024-09-14T09:10:35.811341+0000","last_active":"2024-09-14T09:10:46.800266+0000","last_peered":"2024-09-14T09:10:46.800266+0000","last_clean":"2024-09-14T09:10:46.800266+0000","last_became_active":"2024-09-14T09:10:35.809716+0000","last_became_peered":"2024-09-14T09:10:35.809716+0000","last_unstale":"2024-09-14T09:10:46.800266+0000","last_undegraded":"2024-09-14T09:10:46.800266+0000","last_fullsized":"2024-09-14T09:10:46.800266+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:34.306889+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0036893669999999998,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3997,"num_read_kb":34359,"num_write":407,"num_write_kb":6924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":317,"num_bytes_recovered":2955870,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"155'2202","reported_seq":9111,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806404+0000","last_change":"2024-09-14T09:10:24.806079+0000","last_active":"2024-09-14T09:10:46.806404+0000","last_peered":"2024-09-14T09:10:46.806404+0000","last_clean":"2024-09-14T09:10:46.806404+0000","last_became_active":"2024-09-14T09:09:03.794283+0000","last_became_peered":"2024-09-14T09:09:03.794283+0000","last_unstale":"2024-09-14T09:10:46.806404+0000","last_undegraded":"2024-09-14T09:10:46.806404+0000","last_fullsized":"2024-09-14T09:10:46.806404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":2202,"log_dups_size":0,"ondisk_log_size":2202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:28.286762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013071960000000001,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":16728,"num_read_kb":45108,"num_write":3399,"num_write_kb":14849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":4151803,"num_keys_recovered":53,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":880,"num_object_clones":0,"num_object_copies":1760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":880,"num_whiteouts":876,"num_read":421320,"num_read_kb":1460227,"num_write":27245,"num_write_kb":494223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11099,"num_bytes_recovered":245332849,"num_keys_recovered":856,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12266,"internal_metadata":0},"log_size":24598,"ondisk_log_size":24598,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":87,"seq":373662154773,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47572,"kb_used_data":2044,"kb_used_omap":24,"kb_used_meta":45479,"kb_avail":94324268,"statfs":{"total":96636764160,"available":96588050432,"internally_reserved":0,"allocated":2093056,"data_stored":882432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24922,"internal_metadata":46571174},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96292,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94275548,"statfs":{"total":96636764160,"available":96538161152,"internally_reserved":0,"allocated":2691072,"data_stored":1472819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607596,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51864,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319976,"statfs":{"total":96636764160,"available":96583655424,"internally_reserved":0,"allocated":2691072,"data_stored":1472819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607598,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47132,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324708,"statfs":{"total":96636764160,"available":96588500992,"internally_reserved":0,"allocated":2097152,"data_stored":882451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607596,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95636,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94276204,"statfs":{"total":96636764160,"available":96538832896,"internally_reserved":0,"allocated":2093056,"data_stored":882432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":95812039},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640300,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73480,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298360,"statfs":{"total":96636764160,"available":96561520640,"internally_reserved":0,"allocated":2084864,"data_stored":877409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12266,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T09:10:52.524 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T09:10:52.806 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:10:52.806 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":175,"fsid":"c991ac1c-978d-48b3-a540-4d3d4755e125","created":"2024-09-14T09:07:16.982473+0000","modified":"2024-09-14T09:10:46.796734+0000","last_up_change":"2024-09-14T09:09:15.843683+0000","last_in_change":"2024-09-14T09:10:31.794349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T09:07:29.194849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T09:07:33.684592+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-14T09:07:43.363542+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":43,"snap_epoch":153,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3c13086-1183-454b-8e62-3aec9b69cdf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6817","nonce":1856142608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6819","nonce":1856142608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6823","nonce":1856142608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":1856142608},{"type":"v1","addr":"172.21.15.116:6821","nonce":1856142608}]},"public_addr":"172.21.15.116:6817/1856142608","cluster_addr":"172.21.15.116:6819/1856142608","heartbeat_back_addr":"172.21.15.116:6823/1856142608","heartbeat_front_addr":"172.21.15.116:6821/1856142608","state":["exists","up"]},{"osd":1,"uuid":"8ee6a373-9d0d-4cd2-96f4-9673de96f546","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6801","nonce":3469105275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6803","nonce":3469105275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6807","nonce":3469105275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3469105275},{"type":"v1","addr":"172.21.15.116:6805","nonce":3469105275}]},"public_addr":"172.21.15.116:6801/3469105275","cluster_addr":"172.21.15.116:6803/3469105275","heartbeat_back_addr":"172.21.15.116:6807/3469105275","heartbeat_front_addr":"172.21.15.116:6805/3469105275","state":["exists","up"]},{"osd":2,"uuid":"958a9363-d751-49c3-9ec7-7330d377ee53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":67,"up_from":87,"up_thru":174,"down_at":68,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2050490698},{"type":"v1","addr":"172.21.15.116:6809","nonce":2050490698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2050490698},{"type":"v1","addr":"172.21.15.116:6811","nonce":2050490698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2050490698},{"type":"v1","addr":"172.21.15.116:6815","nonce":2050490698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2050490698},{"type":"v1","addr":"172.21.15.116:6813","nonce":2050490698}]},"public_addr":"172.21.15.116:6809/2050490698","cluster_addr":"172.21.15.116:6811/2050490698","heartbeat_back_addr":"172.21.15.116:6815/2050490698","heartbeat_front_addr":"172.21.15.116:6813/2050490698","state":["exists","up"]},{"osd":3,"uuid":"7fafd519-b2e9-498c-a409-f55cfe45a51a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6817","nonce":2855061278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6819","nonce":2855061278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6823","nonce":2855061278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2855061278},{"type":"v1","addr":"172.21.15.144:6821","nonce":2855061278}]},"public_addr":"172.21.15.144:6817/2855061278","cluster_addr":"172.21.15.144:6819/2855061278","heartbeat_back_addr":"172.21.15.144:6823/2855061278","heartbeat_front_addr":"172.21.15.144:6821/2855061278","state":["exists","up"]},{"osd":4,"uuid":"63d99552-5fea-4367-bf86-0addc8cceb98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6809","nonce":369903047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6811","nonce":369903047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6815","nonce":369903047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":369903047},{"type":"v1","addr":"172.21.15.144:6813","nonce":369903047}]},"public_addr":"172.21.15.144:6809/369903047","cluster_addr":"172.21.15.144:6811/369903047","heartbeat_back_addr":"172.21.15.144:6815/369903047","heartbeat_front_addr":"172.21.15.144:6813/369903047","state":["exists","up"]},{"osd":5,"uuid":"e4bcb224-662f-4530-b477-c0dd9c4ddbf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6801","nonce":2878111293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6803","nonce":2878111293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6807","nonce":2878111293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":2878111293},{"type":"v1","addr":"172.21.15.144:6805","nonce":2878111293}]},"public_addr":"172.21.15.144:6801/2878111293","cluster_addr":"172.21.15.144:6803/2878111293","heartbeat_back_addr":"172.21.15.144:6807/2878111293","heartbeat_front_addr":"172.21.15.144:6805/2878111293","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:24.757990+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.277795+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.290172+0000","dead_epoch":68},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.324594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:24.865136+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T09:07:25.020572+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.4","osds":[0,3]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":3,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T09:10:53.821 INFO:tasks.ceph:Scrubbing osd.0 2024-09-14T09:10:53.821 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-14T09:10:53.956 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:53.956 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T09:10:53.956 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:53.967 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-14T09:10:54.251 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 0 to deep-scrub 2024-09-14T09:10:54.264 INFO:tasks.ceph:Scrubbing osd.1 2024-09-14T09:10:54.265 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-14T09:10:54.384 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:54.385 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T09:10:54.385 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:54.395 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-14T09:10:54.677 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 1 to deep-scrub 2024-09-14T09:10:54.690 INFO:tasks.ceph:Scrubbing osd.2 2024-09-14T09:10:54.690 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-14T09:10:54.811 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:54.811 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T09:10:54.811 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:54.822 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-14T09:10:55.105 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 2 to deep-scrub 2024-09-14T09:10:55.119 INFO:tasks.ceph:Scrubbing osd.3 2024-09-14T09:10:55.119 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-14T09:10:55.240 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:55.240 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T09:10:55.241 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:55.251 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-14T09:10:55.533 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 3 to deep-scrub 2024-09-14T09:10:55.546 INFO:tasks.ceph:Scrubbing osd.4 2024-09-14T09:10:55.546 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-14T09:10:55.668 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:55.669 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T09:10:55.669 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:55.678 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-14T09:10:55.963 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 4 to deep-scrub 2024-09-14T09:10:55.976 INFO:tasks.ceph:Scrubbing osd.5 2024-09-14T09:10:55.976 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-14T09:10:56.097 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T09:10:56.097 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T09:10:56.097 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T09:10:56.107 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-14T09:10:56.395 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 5 to deep-scrub 2024-09-14T09:10:56.408 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T09:10:56.693 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:10:56.694 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T09:10:56.704 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":274,"stamp":"2024-09-14T09:10:55.215306+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":884,"num_object_clones":0,"num_object_copies":1768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":884,"num_whiteouts":876,"num_read":421386,"num_read_kb":1460282,"num_write":27348,"num_write_kb":495853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11108,"num_bytes_recovered":247694321,"num_keys_recovered":856,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24673,"ondisk_log_size":24673,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":411992,"kb_used_data":13440,"kb_used_omap":32,"kb_used_meta":398367,"kb_avail":565819048,"statfs":{"total":579820584960,"available":579398705152,"internally_reserved":0,"allocated":13762560,"data_stored":6475404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32895,"internal_metadata":407928705},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":672,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.289926"},"pg_stats":[{"pgid":"3.1f","version":"155'762","reported_seq":6895,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.800398+0000","last_change":"2024-09-14T09:10:34.813822+0000","last_active":"2024-09-14T09:10:46.800398+0000","last_peered":"2024-09-14T09:10:46.800398+0000","last_clean":"2024-09-14T09:10:46.800398+0000","last_became_active":"2024-09-14T09:10:34.812378+0000","last_became_peered":"2024-09-14T09:10:34.812378+0000","last_unstale":"2024-09-14T09:10:46.800398+0000","last_undegraded":"2024-09-14T09:10:46.800398+0000","last_fullsized":"2024-09-14T09:10:46.800398+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:30.774451+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0042793429999999997,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":6424,"num_read_kb":42400,"num_write":961,"num_write_kb":16264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":566,"num_bytes_recovered":18399808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"151'487","reported_seq":8533,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.809980+0000","last_change":"2024-09-14T09:10:46.809879+0000","last_active":"2024-09-14T09:10:46.809980+0000","last_peered":"2024-09-14T09:10:46.809980+0000","last_clean":"2024-09-14T09:10:46.809980+0000","last_became_active":"2024-09-14T09:10:46.808487+0000","last_became_peered":"2024-09-14T09:10:46.808487+0000","last_unstale":"2024-09-14T09:10:46.809980+0000","last_undegraded":"2024-09-14T09:10:46.809980+0000","last_fullsized":"2024-09-14T09:10:46.809980+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:16.236725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001792068,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":7749,"num_read_kb":36057,"num_write":459,"num_write_kb":5529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":7376960,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"155'678","reported_seq":7048,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.804472+0000","last_change":"2024-09-14T09:10:36.808697+0000","last_active":"2024-09-14T09:10:46.804472+0000","last_peered":"2024-09-14T09:10:46.804472+0000","last_clean":"2024-09-14T09:10:46.804472+0000","last_became_active":"2024-09-14T09:10:36.806572+0000","last_became_peered":"2024-09-14T09:10:36.806572+0000","last_unstale":"2024-09-14T09:10:46.804472+0000","last_undegraded":"2024-09-14T09:10:46.804472+0000","last_fullsized":"2024-09-14T09:10:46.804472+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:14.168101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097120599999999996,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":10173,"num_read_kb":74789,"num_write":721,"num_write_kb":20037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":358,"num_bytes_recovered":31416461,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"155'783","reported_seq":6762,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807290+0000","last_change":"2024-09-14T09:10:38.808376+0000","last_active":"2024-09-14T09:10:46.807290+0000","last_peered":"2024-09-14T09:10:46.807290+0000","last_clean":"2024-09-14T09:10:46.807290+0000","last_became_active":"2024-09-14T09:10:38.806707+0000","last_became_peered":"2024-09-14T09:10:38.806707+0000","last_unstale":"2024-09-14T09:10:46.807290+0000","last_undegraded":"2024-09-14T09:10:46.807290+0000","last_fullsized":"2024-09-14T09:10:46.807290+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:32.661615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017015209999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":7807,"num_read_kb":21023,"num_write":814,"num_write_kb":12470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":2849546,"num_keys_recovered":242,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"152'752","reported_seq":6451,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806513+0000","last_change":"2024-09-14T09:10:36.810578+0000","last_active":"2024-09-14T09:10:46.806513+0000","last_peered":"2024-09-14T09:10:46.806513+0000","last_clean":"2024-09-14T09:10:46.806513+0000","last_became_active":"2024-09-14T09:10:36.808440+0000","last_became_peered":"2024-09-14T09:10:36.808440+0000","last_unstale":"2024-09-14T09:10:46.806513+0000","last_undegraded":"2024-09-14T09:10:46.806513+0000","last_fullsized":"2024-09-14T09:10:46.806513+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:32.467757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084872500000000004,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":7088,"num_read_kb":42687,"num_write":978,"num_write_kb":14384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":417,"num_bytes_recovered":16991946,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"155'1100","reported_seq":46326,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806116+0000","last_change":"2024-09-14T09:10:36.817314+0000","last_active":"2024-09-14T09:10:46.806116+0000","last_peered":"2024-09-14T09:10:46.806116+0000","last_clean":"2024-09-14T09:10:46.806116+0000","last_became_active":"2024-09-14T09:10:36.814993+0000","last_became_peered":"2024-09-14T09:10:36.814993+0000","last_unstale":"2024-09-14T09:10:46.806116+0000","last_undegraded":"2024-09-14T09:10:46.806116+0000","last_fullsized":"2024-09-14T09:10:46.806116+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1100,"log_dups_size":0,"ondisk_log_size":1100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:01.751040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002639925,"stat_sum":{"num_bytes":19,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":23,"num_read":46462,"num_read_kb":92242,"num_write":1032,"num_write_kb":40131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":432,"num_bytes_recovered":16835316,"num_keys_recovered":71,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"150'528","reported_seq":8997,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806548+0000","last_change":"2024-09-14T09:10:35.807979+0000","last_active":"2024-09-14T09:10:46.806548+0000","last_peered":"2024-09-14T09:10:46.806548+0000","last_clean":"2024-09-14T09:10:46.806548+0000","last_became_active":"2024-09-14T09:10:35.806694+0000","last_became_peered":"2024-09-14T09:10:35.806694+0000","last_unstale":"2024-09-14T09:10:46.806548+0000","last_undegraded":"2024-09-14T09:10:46.806548+0000","last_fullsized":"2024-09-14T09:10:46.806548+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:30.197773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081109400000000005,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":8055,"num_read_kb":52380,"num_write":658,"num_write_kb":14132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"150'793","reported_seq":6498,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806101+0000","last_change":"2024-09-14T09:10:38.808926+0000","last_active":"2024-09-14T09:10:46.806101+0000","last_peered":"2024-09-14T09:10:46.806101+0000","last_clean":"2024-09-14T09:10:46.806101+0000","last_became_active":"2024-09-14T09:10:38.807058+0000","last_became_peered":"2024-09-14T09:10:38.807058+0000","last_unstale":"2024-09-14T09:10:46.806101+0000","last_undegraded":"2024-09-14T09:10:46.806101+0000","last_fullsized":"2024-09-14T09:10:46.806101+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:21.481048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001015438,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":7244,"num_read_kb":25042,"num_write":1081,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"152'859","reported_seq":72055,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.800329+0000","last_change":"2024-09-14T09:10:37.809948+0000","last_active":"2024-09-14T09:10:46.800329+0000","last_peered":"2024-09-14T09:10:46.800329+0000","last_clean":"2024-09-14T09:10:46.800329+0000","last_became_active":"2024-09-14T09:10:37.807994+0000","last_became_peered":"2024-09-14T09:10:37.807994+0000","last_unstale":"2024-09-14T09:10:46.800329+0000","last_undegraded":"2024-09-14T09:10:46.800329+0000","last_fullsized":"2024-09-14T09:10:46.800329+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:21.137544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017200060000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":74396,"num_read_kb":113736,"num_write":1000,"num_write_kb":72684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":501,"num_bytes_recovered":30088824,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"145'552","reported_seq":21638,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.810940+0000","last_change":"2024-09-14T09:10:46.810252+0000","last_active":"2024-09-14T09:10:46.810940+0000","last_peered":"2024-09-14T09:10:46.810940+0000","last_clean":"2024-09-14T09:10:46.810940+0000","last_became_active":"2024-09-14T09:10:46.808488+0000","last_became_peered":"2024-09-14T09:10:46.808488+0000","last_unstale":"2024-09-14T09:10:46.810940+0000","last_undegraded":"2024-09-14T09:10:46.810940+0000","last_fullsized":"2024-09-14T09:10:46.810940+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:21.120854+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00073203199999999997,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":21018,"num_read_kb":58767,"num_write":570,"num_write_kb":35397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":448,"num_bytes_recovered":7392256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"150'952","reported_seq":57761,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806425+0000","last_change":"2024-09-14T09:10:35.811768+0000","last_active":"2024-09-14T09:10:46.806425+0000","last_peered":"2024-09-14T09:10:46.806425+0000","last_clean":"2024-09-14T09:10:46.806425+0000","last_became_active":"2024-09-14T09:10:35.810160+0000","last_became_peered":"2024-09-14T09:10:35.810160+0000","last_unstale":"2024-09-14T09:10:46.806425+0000","last_undegraded":"2024-09-14T09:10:46.806425+0000","last_fullsized":"2024-09-14T09:10:46.806425+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:21:57.677481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068915899999999995,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":27804,"num_read_kb":68813,"num_write":785,"num_write_kb":21040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"152'650","reported_seq":6238,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807155+0000","last_change":"2024-09-14T09:10:36.813886+0000","last_active":"2024-09-14T09:10:46.807155+0000","last_peered":"2024-09-14T09:10:46.807155+0000","last_clean":"2024-09-14T09:10:46.807155+0000","last_became_active":"2024-09-14T09:10:36.812242+0000","last_became_peered":"2024-09-14T09:10:36.812242+0000","last_unstale":"2024-09-14T09:10:46.807155+0000","last_undegraded":"2024-09-14T09:10:46.807155+0000","last_fullsized":"2024-09-14T09:10:46.807155+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:17.220451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067904769999999996,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":7788,"num_read_kb":24568,"num_write":614,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":4454614,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":180,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806839+0000","last_change":"2024-09-14T09:10:36.818028+0000","last_active":"2024-09-14T09:10:46.806839+0000","last_peered":"2024-09-14T09:10:46.806839+0000","last_clean":"2024-09-14T09:10:46.806839+0000","last_became_active":"2024-09-14T09:10:36.817650+0000","last_became_peered":"2024-09-14T09:10:36.817650+0000","last_unstale":"2024-09-14T09:10:46.806839+0000","last_undegraded":"2024-09-14T09:10:46.806839+0000","last_fullsized":"2024-09-14T09:10:46.806839+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:05.095616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061552199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"155'693","reported_seq":5997,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806743+0000","last_change":"2024-09-14T09:10:35.809230+0000","last_active":"2024-09-14T09:10:46.806743+0000","last_peered":"2024-09-14T09:10:46.806743+0000","last_clean":"2024-09-14T09:10:46.806743+0000","last_became_active":"2024-09-14T09:10:35.806954+0000","last_became_peered":"2024-09-14T09:10:35.806954+0000","last_unstale":"2024-09-14T09:10:46.806743+0000","last_undegraded":"2024-09-14T09:10:46.806743+0000","last_fullsized":"2024-09-14T09:10:46.806743+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:07.626647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010903849999999999,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":6998,"num_read_kb":15727,"num_write":528,"num_write_kb":3578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":347,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806946+0000","last_change":"2024-09-14T09:10:33.814092+0000","last_active":"2024-09-14T09:10:46.806946+0000","last_peered":"2024-09-14T09:10:46.806946+0000","last_clean":"2024-09-14T09:10:46.806946+0000","last_became_active":"2024-09-14T09:10:33.813809+0000","last_became_peered":"2024-09-14T09:10:33.813809+0000","last_unstale":"2024-09-14T09:10:46.806946+0000","last_undegraded":"2024-09-14T09:10:46.806946+0000","last_fullsized":"2024-09-14T09:10:46.806946+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:55.810760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042190199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"150'724","reported_seq":8925,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807092+0000","last_change":"2024-09-14T09:10:36.803816+0000","last_active":"2024-09-14T09:10:46.807092+0000","last_peered":"2024-09-14T09:10:46.807092+0000","last_clean":"2024-09-14T09:10:46.807092+0000","last_became_active":"2024-09-14T09:10:36.802005+0000","last_became_peered":"2024-09-14T09:10:36.802005+0000","last_unstale":"2024-09-14T09:10:46.807092+0000","last_undegraded":"2024-09-14T09:10:46.807092+0000","last_fullsized":"2024-09-14T09:10:46.807092+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:36.656797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064676800000000004,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":9017,"num_read_kb":43383,"num_write":832,"num_write_kb":5619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":180,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806861+0000","last_change":"2024-09-14T09:10:36.805095+0000","last_active":"2024-09-14T09:10:46.806861+0000","last_peered":"2024-09-14T09:10:46.806861+0000","last_clean":"2024-09-14T09:10:46.806861+0000","last_became_active":"2024-09-14T09:10:36.804806+0000","last_became_peered":"2024-09-14T09:10:36.804806+0000","last_unstale":"2024-09-14T09:10:46.806861+0000","last_undegraded":"2024-09-14T09:10:46.806861+0000","last_fullsized":"2024-09-14T09:10:46.806861+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:45.011748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"146'1024","reported_seq":7041,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807250+0000","last_change":"2024-09-14T09:10:34.807002+0000","last_active":"2024-09-14T09:10:46.807250+0000","last_peered":"2024-09-14T09:10:46.807250+0000","last_clean":"2024-09-14T09:10:46.807250+0000","last_became_active":"2024-09-14T09:10:34.805260+0000","last_became_peered":"2024-09-14T09:10:34.805260+0000","last_unstale":"2024-09-14T09:10:46.807250+0000","last_undegraded":"2024-09-14T09:10:46.807250+0000","last_fullsized":"2024-09-14T09:10:46.807250+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:21.009093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093108500000000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":7917,"num_read_kb":40050,"num_write":1441,"num_write_kb":11556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":306,"num_bytes_recovered":7127704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806176+0000","last_change":"2024-09-14T09:10:32.806891+0000","last_active":"2024-09-14T09:10:46.806176+0000","last_peered":"2024-09-14T09:10:46.806176+0000","last_clean":"2024-09-14T09:10:46.806176+0000","last_became_active":"2024-09-14T09:10:32.806571+0000","last_became_peered":"2024-09-14T09:10:32.806571+0000","last_unstale":"2024-09-14T09:10:46.806176+0000","last_undegraded":"2024-09-14T09:10:46.806176+0000","last_fullsized":"2024-09-14T09:10:46.806176+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:52:32.672580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"152'830","reported_seq":10434,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.804148+0000","last_change":"2024-09-14T09:10:36.803840+0000","last_active":"2024-09-14T09:10:46.804148+0000","last_peered":"2024-09-14T09:10:46.804148+0000","last_clean":"2024-09-14T09:10:46.804148+0000","last_became_active":"2024-09-14T09:10:36.801544+0000","last_became_peered":"2024-09-14T09:10:36.801544+0000","last_unstale":"2024-09-14T09:10:46.804148+0000","last_undegraded":"2024-09-14T09:10:46.804148+0000","last_fullsized":"2024-09-14T09:10:46.804148+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:22.359490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001749932,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":11788,"num_read_kb":51374,"num_write":731,"num_write_kb":9360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":344,"num_bytes_recovered":2441232,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"155'1550","reported_seq":11337,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805742+0000","last_change":"2024-09-14T09:10:37.810044+0000","last_active":"2024-09-14T09:10:46.805742+0000","last_peered":"2024-09-14T09:10:46.805742+0000","last_clean":"2024-09-14T09:10:46.805742+0000","last_became_active":"2024-09-14T09:10:37.808020+0000","last_became_peered":"2024-09-14T09:10:37.808020+0000","last_unstale":"2024-09-14T09:10:46.805742+0000","last_undegraded":"2024-09-14T09:10:46.805742+0000","last_fullsized":"2024-09-14T09:10:46.805742+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":1550,"log_dups_size":0,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:37.794250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011665530000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":29,"num_read":16156,"num_read_kb":41503,"num_write":1957,"num_write_kb":7195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":2340129,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":333,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805453+0000","last_change":"2024-09-14T09:07:37.260986+0000","last_active":"2024-09-14T09:10:46.805453+0000","last_peered":"2024-09-14T09:10:46.805453+0000","last_clean":"2024-09-14T09:10:46.805453+0000","last_became_active":"2024-09-14T09:07:35.254256+0000","last_became_peered":"2024-09-14T09:07:35.254256+0000","last_unstale":"2024-09-14T09:10:46.805453+0000","last_undegraded":"2024-09-14T09:10:46.805453+0000","last_fullsized":"2024-09-14T09:10:46.805453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:07.063058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096898500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"152'477","reported_seq":10518,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.800187+0000","last_change":"2024-09-14T09:10:34.810738+0000","last_active":"2024-09-14T09:10:46.800187+0000","last_peered":"2024-09-14T09:10:46.800187+0000","last_clean":"2024-09-14T09:10:46.800187+0000","last_became_active":"2024-09-14T09:10:34.808686+0000","last_became_peered":"2024-09-14T09:10:34.808686+0000","last_unstale":"2024-09-14T09:10:46.800187+0000","last_undegraded":"2024-09-14T09:10:46.800187+0000","last_fullsized":"2024-09-14T09:10:46.800187+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:03.253962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011386840000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":9617,"num_read_kb":58850,"num_write":533,"num_write_kb":14690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":275,"num_bytes_recovered":8152899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806365+0000","last_change":"2024-09-14T09:10:38.806538+0000","last_active":"2024-09-14T09:10:46.806365+0000","last_peered":"2024-09-14T09:10:46.806365+0000","last_clean":"2024-09-14T09:10:46.806365+0000","last_became_active":"2024-09-14T09:10:38.806119+0000","last_became_peered":"2024-09-14T09:10:38.806119+0000","last_unstale":"2024-09-14T09:10:46.806365+0000","last_undegraded":"2024-09-14T09:10:46.806365+0000","last_fullsized":"2024-09-14T09:10:46.806365+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:44.063513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"155'780","reported_seq":7525,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.810380+0000","last_change":"2024-09-14T09:10:46.810281+0000","last_active":"2024-09-14T09:10:46.810380+0000","last_peered":"2024-09-14T09:10:46.810380+0000","last_clean":"2024-09-14T09:10:46.810380+0000","last_became_active":"2024-09-14T09:10:46.808545+0000","last_became_peered":"2024-09-14T09:10:46.808545+0000","last_unstale":"2024-09-14T09:10:46.810380+0000","last_undegraded":"2024-09-14T09:10:46.810380+0000","last_fullsized":"2024-09-14T09:10:46.810380+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:14.999438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000844446,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":7624,"num_read_kb":31794,"num_write":893,"num_write_kb":10927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":490,"num_bytes_recovered":230948,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":304,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.804216+0000","last_change":"2024-09-14T09:10:31.806103+0000","last_active":"2024-09-14T09:10:46.804216+0000","last_peered":"2024-09-14T09:10:46.804216+0000","last_clean":"2024-09-14T09:10:46.804216+0000","last_became_active":"2024-09-14T09:10:31.805768+0000","last_became_peered":"2024-09-14T09:10:31.805768+0000","last_unstale":"2024-09-14T09:10:46.804216+0000","last_undegraded":"2024-09-14T09:10:46.804216+0000","last_fullsized":"2024-09-14T09:10:46.804216+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:40.795499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"152'439","reported_seq":2386,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806025+0000","last_change":"2024-09-14T09:10:38.807701+0000","last_active":"2024-09-14T09:10:46.806025+0000","last_peered":"2024-09-14T09:10:46.806025+0000","last_clean":"2024-09-14T09:10:46.806025+0000","last_became_active":"2024-09-14T09:10:38.805463+0000","last_became_peered":"2024-09-14T09:10:38.805463+0000","last_unstale":"2024-09-14T09:10:46.806025+0000","last_undegraded":"2024-09-14T09:10:46.806025+0000","last_fullsized":"2024-09-14T09:10:46.806025+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:08.537012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012021849999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":3112,"num_read_kb":25090,"num_write":394,"num_write_kb":10842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":1975296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":216,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806765+0000","last_change":"2024-09-14T09:09:17.798249+0000","last_active":"2024-09-14T09:10:46.806765+0000","last_peered":"2024-09-14T09:10:46.806765+0000","last_clean":"2024-09-14T09:10:46.806765+0000","last_became_active":"2024-09-14T09:09:17.797925+0000","last_became_peered":"2024-09-14T09:09:17.797925+0000","last_unstale":"2024-09-14T09:10:46.806765+0000","last_undegraded":"2024-09-14T09:10:46.806765+0000","last_fullsized":"2024-09-14T09:10:46.806765+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:34.236582+0000","last_clean_scrub_stamp":"2024-09-14T09:07:34.236582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:22.149422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":238,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806055+0000","last_change":"2024-09-14T09:10:31.813147+0000","last_active":"2024-09-14T09:10:46.806055+0000","last_peered":"2024-09-14T09:10:46.806055+0000","last_clean":"2024-09-14T09:10:46.806055+0000","last_became_active":"2024-09-14T09:10:31.808373+0000","last_became_peered":"2024-09-14T09:10:31.808373+0000","last_unstale":"2024-09-14T09:10:46.806055+0000","last_undegraded":"2024-09-14T09:10:46.806055+0000","last_fullsized":"2024-09-14T09:10:46.806055+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:29.211432+0000","last_clean_scrub_stamp":"2024-09-14T09:07:29.211432+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:57:57.332555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"151'696","reported_seq":10500,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.809971+0000","last_change":"2024-09-14T09:10:46.809875+0000","last_active":"2024-09-14T09:10:46.809971+0000","last_peered":"2024-09-14T09:10:46.809971+0000","last_clean":"2024-09-14T09:10:46.809971+0000","last_became_active":"2024-09-14T09:10:46.808573+0000","last_became_peered":"2024-09-14T09:10:46.808573+0000","last_unstale":"2024-09-14T09:10:46.809971+0000","last_undegraded":"2024-09-14T09:10:46.809971+0000","last_fullsized":"2024-09-14T09:10:46.809971+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:13.945422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012882099999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":11028,"num_read_kb":52732,"num_write":579,"num_write_kb":14215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":2555973,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"155'535","reported_seq":7289,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805206+0000","last_change":"2024-09-14T09:10:36.806606+0000","last_active":"2024-09-14T09:10:46.805206+0000","last_peered":"2024-09-14T09:10:46.805206+0000","last_clean":"2024-09-14T09:10:46.805206+0000","last_became_active":"2024-09-14T09:10:36.804585+0000","last_became_peered":"2024-09-14T09:10:36.804585+0000","last_unstale":"2024-09-14T09:10:46.805206+0000","last_undegraded":"2024-09-14T09:10:46.805206+0000","last_fullsized":"2024-09-14T09:10:46.805206+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:37.635151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013332999999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":5991,"num_read_kb":50679,"num_write":476,"num_write_kb":15575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":3599888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"155'923","reported_seq":8217,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805303+0000","last_change":"2024-09-14T09:10:24.802207+0000","last_active":"2024-09-14T09:10:46.805303+0000","last_peered":"2024-09-14T09:10:46.805303+0000","last_clean":"2024-09-14T09:10:46.805303+0000","last_became_active":"2024-09-14T09:09:02.793112+0000","last_became_peered":"2024-09-14T09:09:02.793112+0000","last_unstale":"2024-09-14T09:10:46.805303+0000","last_undegraded":"2024-09-14T09:10:46.805303+0000","last_fullsized":"2024-09-14T09:10:46.805303+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:20.589668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001478858,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":9011,"num_read_kb":44883,"num_write":1107,"num_write_kb":15908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":9779638,"num_keys_recovered":46,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"155'481","reported_seq":5580,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806710+0000","last_change":"2024-09-14T09:10:38.808915+0000","last_active":"2024-09-14T09:10:46.806710+0000","last_peered":"2024-09-14T09:10:46.806710+0000","last_clean":"2024-09-14T09:10:46.806710+0000","last_became_active":"2024-09-14T09:10:38.807014+0000","last_became_peered":"2024-09-14T09:10:38.807014+0000","last_unstale":"2024-09-14T09:10:46.806710+0000","last_undegraded":"2024-09-14T09:10:46.806710+0000","last_fullsized":"2024-09-14T09:10:46.806710+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:41:33.459042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060512200000000004,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":4794,"num_read_kb":18724,"num_write":499,"num_write_kb":6053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":540832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"152'976","reported_seq":17838,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.805312+0000","last_change":"2024-09-14T09:10:37.810417+0000","last_active":"2024-09-14T09:10:46.805312+0000","last_peered":"2024-09-14T09:10:46.805312+0000","last_clean":"2024-09-14T09:10:46.805312+0000","last_became_active":"2024-09-14T09:10:37.808431+0000","last_became_peered":"2024-09-14T09:10:37.808431+0000","last_unstale":"2024-09-14T09:10:46.805312+0000","last_undegraded":"2024-09-14T09:10:46.805312+0000","last_fullsized":"2024-09-14T09:10:46.805312+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":976,"log_dups_size":0,"ondisk_log_size":976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:01.165563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017008710000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":13865,"num_read_kb":46941,"num_write":938,"num_write_kb":9955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":415,"num_bytes_recovered":13533184,"num_keys_recovered":116,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"155'519","reported_seq":21765,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806976+0000","last_change":"2024-09-14T09:10:35.815411+0000","last_active":"2024-09-14T09:10:46.806976+0000","last_peered":"2024-09-14T09:10:46.806976+0000","last_clean":"2024-09-14T09:10:46.806976+0000","last_became_active":"2024-09-14T09:10:35.813901+0000","last_became_peered":"2024-09-14T09:10:35.813901+0000","last_unstale":"2024-09-14T09:10:46.806976+0000","last_undegraded":"2024-09-14T09:10:46.806976+0000","last_fullsized":"2024-09-14T09:10:46.806976+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:37.344370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029838349999999998,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":21382,"num_read_kb":52622,"num_write":626,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":374,"num_bytes_recovered":16325120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"151'564","reported_seq":4579,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.804529+0000","last_change":"2024-09-14T09:10:35.813746+0000","last_active":"2024-09-14T09:10:46.804529+0000","last_peered":"2024-09-14T09:10:46.804529+0000","last_clean":"2024-09-14T09:10:46.804529+0000","last_became_active":"2024-09-14T09:10:35.811599+0000","last_became_peered":"2024-09-14T09:10:35.811599+0000","last_unstale":"2024-09-14T09:10:46.804529+0000","last_undegraded":"2024-09-14T09:10:46.804529+0000","last_fullsized":"2024-09-14T09:10:46.804529+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:01.203388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001022088,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":5433,"num_read_kb":39557,"num_write":475,"num_write_kb":12186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":585,"num_bytes_recovered":15375904,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"146'391","reported_seq":3667,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.807738+0000","last_change":"2024-09-14T09:10:37.813721+0000","last_active":"2024-09-14T09:10:46.807738+0000","last_peered":"2024-09-14T09:10:46.807738+0000","last_clean":"2024-09-14T09:10:46.807738+0000","last_became_active":"2024-09-14T09:10:37.811679+0000","last_became_peered":"2024-09-14T09:10:37.811679+0000","last_unstale":"2024-09-14T09:10:46.807738+0000","last_undegraded":"2024-09-14T09:10:46.807738+0000","last_fullsized":"2024-09-14T09:10:46.807738+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:33:03.454799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010483549999999999,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":2165,"num_read_kb":13861,"num_write":340,"num_write_kb":3973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":1385641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"146'576","reported_seq":10523,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806192+0000","last_change":"2024-09-14T09:10:36.816638+0000","last_active":"2024-09-14T09:10:46.806192+0000","last_peered":"2024-09-14T09:10:46.806192+0000","last_clean":"2024-09-14T09:10:46.806192+0000","last_became_active":"2024-09-14T09:10:36.814772+0000","last_became_peered":"2024-09-14T09:10:36.814772+0000","last_unstale":"2024-09-14T09:10:46.806192+0000","last_undegraded":"2024-09-14T09:10:46.806192+0000","last_fullsized":"2024-09-14T09:10:46.806192+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:22.267528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024013369999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":9710,"num_read_kb":41453,"num_write":717,"num_write_kb":14547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":515,"num_bytes_recovered":6681771,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"151'842","reported_seq":10962,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.811796+0000","last_change":"2024-09-14T09:10:46.811228+0000","last_active":"2024-09-14T09:10:46.811796+0000","last_peered":"2024-09-14T09:10:46.811796+0000","last_clean":"2024-09-14T09:10:46.811796+0000","last_became_active":"2024-09-14T09:10:46.808235+0000","last_became_peered":"2024-09-14T09:10:46.808235+0000","last_unstale":"2024-09-14T09:10:46.811796+0000","last_undegraded":"2024-09-14T09:10:46.811796+0000","last_fullsized":"2024-09-14T09:10:46.811796+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:50.657704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001545701,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":12979,"num_read_kb":59033,"num_write":700,"num_write_kb":13832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":649,"num_bytes_recovered":10373286,"num_keys_recovered":102,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"152'480","reported_seq":4978,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.800266+0000","last_change":"2024-09-14T09:10:35.811341+0000","last_active":"2024-09-14T09:10:46.800266+0000","last_peered":"2024-09-14T09:10:46.800266+0000","last_clean":"2024-09-14T09:10:46.800266+0000","last_became_active":"2024-09-14T09:10:35.809716+0000","last_became_peered":"2024-09-14T09:10:35.809716+0000","last_unstale":"2024-09-14T09:10:46.800266+0000","last_undegraded":"2024-09-14T09:10:46.800266+0000","last_fullsized":"2024-09-14T09:10:46.800266+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:34.306889+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0036893669999999998,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3997,"num_read_kb":34359,"num_write":407,"num_write_kb":6924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":317,"num_bytes_recovered":2955870,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"155'2202","reported_seq":9111,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:46.806404+0000","last_change":"2024-09-14T09:10:24.806079+0000","last_active":"2024-09-14T09:10:46.806404+0000","last_peered":"2024-09-14T09:10:46.806404+0000","last_clean":"2024-09-14T09:10:46.806404+0000","last_became_active":"2024-09-14T09:09:03.794283+0000","last_became_peered":"2024-09-14T09:09:03.794283+0000","last_unstale":"2024-09-14T09:10:46.806404+0000","last_undegraded":"2024-09-14T09:10:46.806404+0000","last_fullsized":"2024-09-14T09:10:46.806404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:07:44.271930+0000","last_clean_scrub_stamp":"2024-09-14T09:07:44.271930+0000","objects_scrubbed":0,"log_size":2202,"log_dups_size":0,"ondisk_log_size":2202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:28.286762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013071960000000001,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":16728,"num_read_kb":45108,"num_write":3399,"num_write_kb":14849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":4151803,"num_keys_recovered":53,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":880,"num_object_clones":0,"num_object_copies":1760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":880,"num_whiteouts":876,"num_read":421320,"num_read_kb":1460227,"num_write":27245,"num_write_kb":494223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11099,"num_bytes_recovered":245332849,"num_keys_recovered":856,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12266,"internal_metadata":0},"log_size":24598,"ondisk_log_size":24598,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":87,"seq":373662154774,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47572,"kb_used_data":2044,"kb_used_omap":24,"kb_used_meta":45479,"kb_avail":94324268,"statfs":{"total":96636764160,"available":96588050432,"internally_reserved":0,"allocated":2093056,"data_stored":882432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24922,"internal_metadata":46571174},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96292,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94275548,"statfs":{"total":96636764160,"available":96538161152,"internally_reserved":0,"allocated":2691072,"data_stored":1472819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607597,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51864,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319976,"statfs":{"total":96636764160,"available":96583655424,"internally_reserved":0,"allocated":2691072,"data_stored":1472819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607599,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47132,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324708,"statfs":{"total":96636764160,"available":96588500992,"internally_reserved":0,"allocated":2097152,"data_stored":882451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607597,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95636,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94276204,"statfs":{"total":96636764160,"available":96538832896,"internally_reserved":0,"allocated":2093056,"data_stored":882432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":95812039},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640301,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73496,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298344,"statfs":{"total":96636764160,"available":96561504256,"internally_reserved":0,"allocated":2097152,"data_stored":882451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12266,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T09:10:56.709 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.709 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.709 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.709 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.709 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.709 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.709 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.710 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.710 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.710 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.710 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.710 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.710 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-14T09:07:34.236582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.710 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.710 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-14T09:07:34.236582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.710 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.710 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-14T09:07:34.236582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.711 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.711 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-14T09:07:34.236582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.711 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.711 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.711 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-14T09:07:34.236582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.711 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.711 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-14T09:07:34.236582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.711 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.711 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-14T09:07:34.236582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.711 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.711 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-14T09:07:34.236582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.712 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-14T09:07:29.211432+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.712 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.712 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.712 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.712 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.712 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.712 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.712 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.712 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.712 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.713 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.713 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.713 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-14T09:07:44.271930+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=7, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=9, tm_min=10, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T09:10:56.713 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T09:11:16.716 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T09:11:17.013 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T09:11:17.014 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T09:11:17.025 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-14T09:11:15.219490+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":884,"num_object_clones":0,"num_object_copies":1768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":884,"num_whiteouts":876,"num_read":421386,"num_read_kb":1460282,"num_write":27348,"num_write_kb":495853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11108,"num_bytes_recovered":247694321,"num_keys_recovered":856,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25556,"ondisk_log_size":25556,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":399456,"kb_used_data":13440,"kb_used_omap":32,"kb_used_meta":385887,"kb_avail":565831584,"statfs":{"total":579820584960,"available":579411542016,"internally_reserved":0,"allocated":13762560,"data_stored":6475404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32895,"internal_metadata":395149185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002305"},"pg_stats":[{"pgid":"3.1f","version":"175'788","reported_seq":6930,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:59.886883+0000","last_change":"2024-09-14T09:10:59.886883+0000","last_active":"2024-09-14T09:10:59.886883+0000","last_peered":"2024-09-14T09:10:59.886883+0000","last_clean":"2024-09-14T09:10:59.886883+0000","last_became_active":"2024-09-14T09:10:34.812378+0000","last_became_peered":"2024-09-14T09:10:34.812378+0000","last_unstale":"2024-09-14T09:10:59.886883+0000","last_undegraded":"2024-09-14T09:10:59.886883+0000","last_fullsized":"2024-09-14T09:10:59.886883+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'788","last_scrub_stamp":"2024-09-14T09:10:59.886807+0000","last_deep_scrub":"175'788","last_deep_scrub_stamp":"2024-09-14T09:10:59.886807+0000","last_clean_scrub_stamp":"2024-09-14T09:10:59.886807+0000","objects_scrubbed":26,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:45.270538+0000","scrub_duration":17,"objects_trimmed":1,"snaptrim_duration":0.0042793429999999997,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":6424,"num_read_kb":42400,"num_write":961,"num_write_kb":16264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":566,"num_bytes_recovered":18399808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"175'516","reported_seq":8571,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:11:01.504527+0000","last_change":"2024-09-14T09:11:01.504527+0000","last_active":"2024-09-14T09:11:01.504527+0000","last_peered":"2024-09-14T09:11:01.504527+0000","last_clean":"2024-09-14T09:11:01.504527+0000","last_became_active":"2024-09-14T09:10:46.808487+0000","last_became_peered":"2024-09-14T09:10:46.808487+0000","last_unstale":"2024-09-14T09:11:01.504527+0000","last_undegraded":"2024-09-14T09:11:01.504527+0000","last_fullsized":"2024-09-14T09:11:01.504527+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'516","last_scrub_stamp":"2024-09-14T09:11:01.504436+0000","last_deep_scrub":"175'516","last_deep_scrub_stamp":"2024-09-14T09:11:01.504436+0000","last_clean_scrub_stamp":"2024-09-14T09:11:01.504436+0000","objects_scrubbed":29,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:14.719263+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0.001792068,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":7749,"num_read_kb":36057,"num_write":459,"num_write_kb":5529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":7376960,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"175'700","reported_seq":7079,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:59.866986+0000","last_change":"2024-09-14T09:10:59.866986+0000","last_active":"2024-09-14T09:10:59.866986+0000","last_peered":"2024-09-14T09:10:59.866986+0000","last_clean":"2024-09-14T09:10:59.866986+0000","last_became_active":"2024-09-14T09:10:36.806572+0000","last_became_peered":"2024-09-14T09:10:36.806572+0000","last_unstale":"2024-09-14T09:10:59.866986+0000","last_undegraded":"2024-09-14T09:10:59.866986+0000","last_fullsized":"2024-09-14T09:10:59.866986+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'700","last_scrub_stamp":"2024-09-14T09:10:59.866845+0000","last_deep_scrub":"175'700","last_deep_scrub_stamp":"2024-09-14T09:10:59.866845+0000","last_clean_scrub_stamp":"2024-09-14T09:10:59.866845+0000","objects_scrubbed":22,"log_size":700,"log_dups_size":0,"ondisk_log_size":700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:02:04.960843+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0.00097120599999999996,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":10173,"num_read_kb":74789,"num_write":721,"num_write_kb":20037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":358,"num_bytes_recovered":31416461,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"175'819","reported_seq":6807,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:11:04.299957+0000","last_change":"2024-09-14T09:11:04.299957+0000","last_active":"2024-09-14T09:11:04.299957+0000","last_peered":"2024-09-14T09:11:04.299957+0000","last_clean":"2024-09-14T09:11:04.299957+0000","last_became_active":"2024-09-14T09:10:38.806707+0000","last_became_peered":"2024-09-14T09:10:38.806707+0000","last_unstale":"2024-09-14T09:11:04.299957+0000","last_undegraded":"2024-09-14T09:11:04.299957+0000","last_fullsized":"2024-09-14T09:11:04.299957+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'819","last_scrub_stamp":"2024-09-14T09:11:04.299835+0000","last_deep_scrub":"175'819","last_deep_scrub_stamp":"2024-09-14T09:11:04.299835+0000","last_clean_scrub_stamp":"2024-09-14T09:11:04.299835+0000","objects_scrubbed":36,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:13.832044+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0.0017015209999999999,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":7807,"num_read_kb":21023,"num_write":814,"num_write_kb":12470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":2849546,"num_keys_recovered":242,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"175'774","reported_seq":6481,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:11:00.486668+0000","last_change":"2024-09-14T09:11:00.486668+0000","last_active":"2024-09-14T09:11:00.486668+0000","last_peered":"2024-09-14T09:11:00.486668+0000","last_clean":"2024-09-14T09:11:00.486668+0000","last_became_active":"2024-09-14T09:10:36.808440+0000","last_became_peered":"2024-09-14T09:10:36.808440+0000","last_unstale":"2024-09-14T09:11:00.486668+0000","last_undegraded":"2024-09-14T09:11:00.486668+0000","last_fullsized":"2024-09-14T09:11:00.486668+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'774","last_scrub_stamp":"2024-09-14T09:11:00.486555+0000","last_deep_scrub":"175'774","last_deep_scrub_stamp":"2024-09-14T09:11:00.486555+0000","last_clean_scrub_stamp":"2024-09-14T09:11:00.486555+0000","objects_scrubbed":22,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:22.905968+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0.00084872500000000004,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":7088,"num_read_kb":42687,"num_write":978,"num_write_kb":14384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":417,"num_bytes_recovered":16991946,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"175'1124","reported_seq":46358,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:11:03.261454+0000","last_change":"2024-09-14T09:11:03.261454+0000","last_active":"2024-09-14T09:11:03.261454+0000","last_peered":"2024-09-14T09:11:03.261454+0000","last_clean":"2024-09-14T09:11:03.261454+0000","last_became_active":"2024-09-14T09:10:36.814993+0000","last_became_peered":"2024-09-14T09:10:36.814993+0000","last_unstale":"2024-09-14T09:11:03.261454+0000","last_undegraded":"2024-09-14T09:11:03.261454+0000","last_fullsized":"2024-09-14T09:11:03.261454+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'1124","last_scrub_stamp":"2024-09-14T09:11:03.261333+0000","last_deep_scrub":"175'1124","last_deep_scrub_stamp":"2024-09-14T09:11:03.261333+0000","last_clean_scrub_stamp":"2024-09-14T09:11:03.261333+0000","objects_scrubbed":24,"log_size":1124,"log_dups_size":0,"ondisk_log_size":1124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:46:07.501810+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0.002639925,"stat_sum":{"num_bytes":19,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":23,"num_read":46462,"num_read_kb":92242,"num_write":1032,"num_write_kb":40131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":432,"num_bytes_recovered":16835316,"num_keys_recovered":71,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"175'558","reported_seq":9036,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:11:01.483372+0000","last_change":"2024-09-14T09:11:01.483372+0000","last_active":"2024-09-14T09:11:01.483372+0000","last_peered":"2024-09-14T09:11:01.483372+0000","last_clean":"2024-09-14T09:11:01.483372+0000","last_became_active":"2024-09-14T09:10:35.806694+0000","last_became_peered":"2024-09-14T09:10:35.806694+0000","last_unstale":"2024-09-14T09:11:01.483372+0000","last_undegraded":"2024-09-14T09:11:01.483372+0000","last_fullsized":"2024-09-14T09:11:01.483372+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'558","last_scrub_stamp":"2024-09-14T09:11:01.483290+0000","last_deep_scrub":"175'558","last_deep_scrub_stamp":"2024-09-14T09:11:01.483290+0000","last_clean_scrub_stamp":"2024-09-14T09:11:01.483290+0000","objects_scrubbed":30,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:11:26.356489+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0.00081109400000000005,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":8055,"num_read_kb":52380,"num_write":658,"num_write_kb":14132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"175'814","reported_seq":6527,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:59.477270+0000","last_change":"2024-09-14T09:10:59.477270+0000","last_active":"2024-09-14T09:10:59.477270+0000","last_peered":"2024-09-14T09:10:59.477270+0000","last_clean":"2024-09-14T09:10:59.477270+0000","last_became_active":"2024-09-14T09:10:38.807058+0000","last_became_peered":"2024-09-14T09:10:38.807058+0000","last_unstale":"2024-09-14T09:10:59.477270+0000","last_undegraded":"2024-09-14T09:10:59.477270+0000","last_fullsized":"2024-09-14T09:10:59.477270+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'814","last_scrub_stamp":"2024-09-14T09:10:59.477150+0000","last_deep_scrub":"175'814","last_deep_scrub_stamp":"2024-09-14T09:10:59.477150+0000","last_clean_scrub_stamp":"2024-09-14T09:10:59.477150+0000","objects_scrubbed":21,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:48.586247+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0.001015438,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":7244,"num_read_kb":25042,"num_write":1081,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"175'886","reported_seq":72091,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:57.853156+0000","last_change":"2024-09-14T09:10:57.853156+0000","last_active":"2024-09-14T09:10:57.853156+0000","last_peered":"2024-09-14T09:10:57.853156+0000","last_clean":"2024-09-14T09:10:57.853156+0000","last_became_active":"2024-09-14T09:10:37.807994+0000","last_became_peered":"2024-09-14T09:10:37.807994+0000","last_unstale":"2024-09-14T09:10:57.853156+0000","last_undegraded":"2024-09-14T09:10:57.853156+0000","last_fullsized":"2024-09-14T09:10:57.853156+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'886","last_scrub_stamp":"2024-09-14T09:10:57.853074+0000","last_deep_scrub":"175'886","last_deep_scrub_stamp":"2024-09-14T09:10:57.853074+0000","last_clean_scrub_stamp":"2024-09-14T09:10:57.853074+0000","objects_scrubbed":27,"log_size":886,"log_dups_size":0,"ondisk_log_size":886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:57.610079+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0.0017200060000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":74396,"num_read_kb":113736,"num_write":1000,"num_write_kb":72684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":501,"num_bytes_recovered":30088824,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"175'579","reported_seq":21674,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:58.889162+0000","last_change":"2024-09-14T09:10:58.889162+0000","last_active":"2024-09-14T09:10:58.889162+0000","last_peered":"2024-09-14T09:10:58.889162+0000","last_clean":"2024-09-14T09:10:58.889162+0000","last_became_active":"2024-09-14T09:10:46.808488+0000","last_became_peered":"2024-09-14T09:10:46.808488+0000","last_unstale":"2024-09-14T09:10:58.889162+0000","last_undegraded":"2024-09-14T09:10:58.889162+0000","last_fullsized":"2024-09-14T09:10:58.889162+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'579","last_scrub_stamp":"2024-09-14T09:10:58.889040+0000","last_deep_scrub":"175'579","last_deep_scrub_stamp":"2024-09-14T09:10:58.889040+0000","last_clean_scrub_stamp":"2024-09-14T09:10:58.889040+0000","objects_scrubbed":27,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:01.500351+0000","scrub_duration":20,"objects_trimmed":2,"snaptrim_duration":0.00073203199999999997,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":21018,"num_read_kb":58767,"num_write":570,"num_write_kb":35397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":448,"num_bytes_recovered":7392256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"175'978","reported_seq":57796,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:11:01.599011+0000","last_change":"2024-09-14T09:11:01.599011+0000","last_active":"2024-09-14T09:11:01.599011+0000","last_peered":"2024-09-14T09:11:01.599011+0000","last_clean":"2024-09-14T09:11:01.599011+0000","last_became_active":"2024-09-14T09:10:35.810160+0000","last_became_peered":"2024-09-14T09:10:35.810160+0000","last_unstale":"2024-09-14T09:11:01.599011+0000","last_undegraded":"2024-09-14T09:11:01.599011+0000","last_fullsized":"2024-09-14T09:11:01.599011+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'978","last_scrub_stamp":"2024-09-14T09:11:01.598915+0000","last_deep_scrub":"175'978","last_deep_scrub_stamp":"2024-09-14T09:11:01.598915+0000","last_clean_scrub_stamp":"2024-09-14T09:11:01.598915+0000","objects_scrubbed":26,"log_size":978,"log_dups_size":0,"ondisk_log_size":978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:30.653025+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0.00068915899999999995,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":27804,"num_read_kb":68813,"num_write":785,"num_write_kb":21040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"175'675","reported_seq":6272,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:11:02.231286+0000","last_change":"2024-09-14T09:11:02.231286+0000","last_active":"2024-09-14T09:11:02.231286+0000","last_peered":"2024-09-14T09:11:02.231286+0000","last_clean":"2024-09-14T09:11:02.231286+0000","last_became_active":"2024-09-14T09:10:36.812242+0000","last_became_peered":"2024-09-14T09:10:36.812242+0000","last_unstale":"2024-09-14T09:11:02.231286+0000","last_undegraded":"2024-09-14T09:11:02.231286+0000","last_fullsized":"2024-09-14T09:11:02.231286+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'675","last_scrub_stamp":"2024-09-14T09:11:02.231203+0000","last_deep_scrub":"175'675","last_deep_scrub_stamp":"2024-09-14T09:11:02.231203+0000","last_clean_scrub_stamp":"2024-09-14T09:11:02.231203+0000","objects_scrubbed":25,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:40.816594+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0.0067904769999999996,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":7788,"num_read_kb":24568,"num_write":614,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":4454614,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":189,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:59.179021+0000","last_change":"2024-09-14T09:10:59.178948+0000","last_active":"2024-09-14T09:10:59.179021+0000","last_peered":"2024-09-14T09:10:59.179021+0000","last_clean":"2024-09-14T09:10:59.179021+0000","last_became_active":"2024-09-14T09:10:36.817650+0000","last_became_peered":"2024-09-14T09:10:36.817650+0000","last_unstale":"2024-09-14T09:10:59.179021+0000","last_undegraded":"2024-09-14T09:10:59.179021+0000","last_fullsized":"2024-09-14T09:10:59.179021+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:10:59.178857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:10:59.178857+0000","last_clean_scrub_stamp":"2024-09-14T09:10:59.178857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:05.146813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061552199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"175'727","reported_seq":6040,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:59.398750+0000","last_change":"2024-09-14T09:10:59.398750+0000","last_active":"2024-09-14T09:10:59.398750+0000","last_peered":"2024-09-14T09:10:59.398750+0000","last_clean":"2024-09-14T09:10:59.398750+0000","last_became_active":"2024-09-14T09:10:35.806954+0000","last_became_peered":"2024-09-14T09:10:35.806954+0000","last_unstale":"2024-09-14T09:10:59.398750+0000","last_undegraded":"2024-09-14T09:10:59.398750+0000","last_fullsized":"2024-09-14T09:10:59.398750+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'727","last_scrub_stamp":"2024-09-14T09:10:59.398632+0000","last_deep_scrub":"175'727","last_deep_scrub_stamp":"2024-09-14T09:10:59.398632+0000","last_clean_scrub_stamp":"2024-09-14T09:10:59.398632+0000","objects_scrubbed":34,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:06.733178+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0.0010903849999999999,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":6998,"num_read_kb":15727,"num_write":528,"num_write_kb":3578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":355,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:58.345093+0000","last_change":"2024-09-14T09:10:58.345093+0000","last_active":"2024-09-14T09:10:58.345093+0000","last_peered":"2024-09-14T09:10:58.345093+0000","last_clean":"2024-09-14T09:10:58.345093+0000","last_became_active":"2024-09-14T09:10:33.813809+0000","last_became_peered":"2024-09-14T09:10:33.813809+0000","last_unstale":"2024-09-14T09:10:58.345093+0000","last_undegraded":"2024-09-14T09:10:58.345093+0000","last_fullsized":"2024-09-14T09:10:58.345093+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:10:58.344986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:10:58.344986+0000","last_clean_scrub_stamp":"2024-09-14T09:10:58.344986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:12.714195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042190199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"175'749","reported_seq":8959,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:11:00.435161+0000","last_change":"2024-09-14T09:11:00.435161+0000","last_active":"2024-09-14T09:11:00.435161+0000","last_peered":"2024-09-14T09:11:00.435161+0000","last_clean":"2024-09-14T09:11:00.435161+0000","last_became_active":"2024-09-14T09:10:36.802005+0000","last_became_peered":"2024-09-14T09:10:36.802005+0000","last_unstale":"2024-09-14T09:11:00.435161+0000","last_undegraded":"2024-09-14T09:11:00.435161+0000","last_fullsized":"2024-09-14T09:11:00.435161+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'749","last_scrub_stamp":"2024-09-14T09:11:00.435072+0000","last_deep_scrub":"175'749","last_deep_scrub_stamp":"2024-09-14T09:11:00.435072+0000","last_clean_scrub_stamp":"2024-09-14T09:11:00.435072+0000","objects_scrubbed":25,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:23.060289+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0.00064676800000000004,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":9017,"num_read_kb":43383,"num_write":832,"num_write_kb":5619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":189,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:11:00.138147+0000","last_change":"2024-09-14T09:11:00.138075+0000","last_active":"2024-09-14T09:11:00.138147+0000","last_peered":"2024-09-14T09:11:00.138147+0000","last_clean":"2024-09-14T09:11:00.138147+0000","last_became_active":"2024-09-14T09:10:36.804806+0000","last_became_peered":"2024-09-14T09:10:36.804806+0000","last_unstale":"2024-09-14T09:11:00.138147+0000","last_undegraded":"2024-09-14T09:11:00.138147+0000","last_fullsized":"2024-09-14T09:11:00.138147+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:11:00.137938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:11:00.137938+0000","last_clean_scrub_stamp":"2024-09-14T09:11:00.137938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:33.931986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"175'1057","reported_seq":7083,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:57.402265+0000","last_change":"2024-09-14T09:10:57.402265+0000","last_active":"2024-09-14T09:10:57.402265+0000","last_peered":"2024-09-14T09:10:57.402265+0000","last_clean":"2024-09-14T09:10:57.402265+0000","last_became_active":"2024-09-14T09:10:34.805260+0000","last_became_peered":"2024-09-14T09:10:34.805260+0000","last_unstale":"2024-09-14T09:10:57.402265+0000","last_undegraded":"2024-09-14T09:10:57.402265+0000","last_fullsized":"2024-09-14T09:10:57.402265+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'1057","last_scrub_stamp":"2024-09-14T09:10:57.402177+0000","last_deep_scrub":"175'1057","last_deep_scrub_stamp":"2024-09-14T09:10:57.402177+0000","last_clean_scrub_stamp":"2024-09-14T09:10:57.402177+0000","objects_scrubbed":33,"log_size":1057,"log_dups_size":0,"ondisk_log_size":1057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:32.343707+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0.00093108500000000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":7917,"num_read_kb":40050,"num_write":1441,"num_write_kb":11556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":306,"num_bytes_recovered":7127704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:54.623576+0000","last_change":"2024-09-14T09:10:54.623576+0000","last_active":"2024-09-14T09:10:54.623576+0000","last_peered":"2024-09-14T09:10:54.623576+0000","last_clean":"2024-09-14T09:10:54.623576+0000","last_became_active":"2024-09-14T09:10:32.806571+0000","last_became_peered":"2024-09-14T09:10:32.806571+0000","last_unstale":"2024-09-14T09:10:54.623576+0000","last_undegraded":"2024-09-14T09:10:54.623576+0000","last_fullsized":"2024-09-14T09:10:54.623576+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:10:54.623508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:10:54.623508+0000","last_clean_scrub_stamp":"2024-09-14T09:10:54.623508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:02.882733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"175'858","reported_seq":10471,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:57.843656+0000","last_change":"2024-09-14T09:10:57.843656+0000","last_active":"2024-09-14T09:10:57.843656+0000","last_peered":"2024-09-14T09:10:57.843656+0000","last_clean":"2024-09-14T09:10:57.843656+0000","last_became_active":"2024-09-14T09:10:36.801544+0000","last_became_peered":"2024-09-14T09:10:36.801544+0000","last_unstale":"2024-09-14T09:10:57.843656+0000","last_undegraded":"2024-09-14T09:10:57.843656+0000","last_fullsized":"2024-09-14T09:10:57.843656+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'858","last_scrub_stamp":"2024-09-14T09:10:57.843574+0000","last_deep_scrub":"175'858","last_deep_scrub_stamp":"2024-09-14T09:10:57.843574+0000","last_clean_scrub_stamp":"2024-09-14T09:10:57.843574+0000","objects_scrubbed":28,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:14.680851+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0.001749932,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":11788,"num_read_kb":51374,"num_write":731,"num_write_kb":9360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":344,"num_bytes_recovered":2441232,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"175'1579","reported_seq":11375,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:56.631495+0000","last_change":"2024-09-14T09:10:56.631495+0000","last_active":"2024-09-14T09:10:56.631495+0000","last_peered":"2024-09-14T09:10:56.631495+0000","last_clean":"2024-09-14T09:10:56.631495+0000","last_became_active":"2024-09-14T09:10:37.808020+0000","last_became_peered":"2024-09-14T09:10:37.808020+0000","last_unstale":"2024-09-14T09:10:56.631495+0000","last_undegraded":"2024-09-14T09:10:56.631495+0000","last_fullsized":"2024-09-14T09:10:56.631495+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'1579","last_scrub_stamp":"2024-09-14T09:10:56.631423+0000","last_deep_scrub":"175'1579","last_deep_scrub_stamp":"2024-09-14T09:10:56.631423+0000","last_clean_scrub_stamp":"2024-09-14T09:10:56.631423+0000","objects_scrubbed":30,"log_size":1579,"log_dups_size":0,"ondisk_log_size":1579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:35.752498+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0.0011665530000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":29,"num_read":16156,"num_read_kb":41503,"num_write":1957,"num_write_kb":7195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":2340129,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"175'3","reported_seq":342,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:55.631315+0000","last_change":"2024-09-14T09:10:55.631315+0000","last_active":"2024-09-14T09:10:55.631315+0000","last_peered":"2024-09-14T09:10:55.631315+0000","last_clean":"2024-09-14T09:10:55.631315+0000","last_became_active":"2024-09-14T09:07:35.254256+0000","last_became_peered":"2024-09-14T09:07:35.254256+0000","last_unstale":"2024-09-14T09:10:55.631315+0000","last_undegraded":"2024-09-14T09:10:55.631315+0000","last_fullsized":"2024-09-14T09:10:55.631315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'3","last_scrub_stamp":"2024-09-14T09:10:55.631252+0000","last_deep_scrub":"175'3","last_deep_scrub_stamp":"2024-09-14T09:10:55.631252+0000","last_clean_scrub_stamp":"2024-09-14T09:10:55.631252+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:06:55.875027+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00096898500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"175'494","reported_seq":10543,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:56.876985+0000","last_change":"2024-09-14T09:10:56.876985+0000","last_active":"2024-09-14T09:10:56.876985+0000","last_peered":"2024-09-14T09:10:56.876985+0000","last_clean":"2024-09-14T09:10:56.876985+0000","last_became_active":"2024-09-14T09:10:34.808686+0000","last_became_peered":"2024-09-14T09:10:34.808686+0000","last_unstale":"2024-09-14T09:10:56.876985+0000","last_undegraded":"2024-09-14T09:10:56.876985+0000","last_fullsized":"2024-09-14T09:10:56.876985+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'494","last_scrub_stamp":"2024-09-14T09:10:56.876845+0000","last_deep_scrub":"175'494","last_deep_scrub_stamp":"2024-09-14T09:10:56.876845+0000","last_clean_scrub_stamp":"2024-09-14T09:10:56.876845+0000","objects_scrubbed":17,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:35:08.545495+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.0011386840000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":9617,"num_read_kb":58850,"num_write":533,"num_write_kb":14690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":275,"num_bytes_recovered":8152899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:56.452936+0000","last_change":"2024-09-14T09:10:56.452936+0000","last_active":"2024-09-14T09:10:56.452936+0000","last_peered":"2024-09-14T09:10:56.452936+0000","last_clean":"2024-09-14T09:10:56.452936+0000","last_became_active":"2024-09-14T09:10:38.806119+0000","last_became_peered":"2024-09-14T09:10:38.806119+0000","last_unstale":"2024-09-14T09:10:56.452936+0000","last_undegraded":"2024-09-14T09:10:56.452936+0000","last_fullsized":"2024-09-14T09:10:56.452936+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:10:56.452851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:10:56.452851+0000","last_clean_scrub_stamp":"2024-09-14T09:10:56.452851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:57.450907+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"175'799","reported_seq":7552,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:56.338452+0000","last_change":"2024-09-14T09:10:56.338452+0000","last_active":"2024-09-14T09:10:56.338452+0000","last_peered":"2024-09-14T09:10:56.338452+0000","last_clean":"2024-09-14T09:10:56.338452+0000","last_became_active":"2024-09-14T09:10:46.808545+0000","last_became_peered":"2024-09-14T09:10:46.808545+0000","last_unstale":"2024-09-14T09:10:56.338452+0000","last_undegraded":"2024-09-14T09:10:56.338452+0000","last_fullsized":"2024-09-14T09:10:56.338452+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'799","last_scrub_stamp":"2024-09-14T09:10:56.338361+0000","last_deep_scrub":"175'799","last_deep_scrub_stamp":"2024-09-14T09:10:56.338361+0000","last_clean_scrub_stamp":"2024-09-14T09:10:56.338361+0000","objects_scrubbed":19,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:17:36.258800+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.000844446,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":7624,"num_read_kb":31794,"num_write":893,"num_write_kb":10927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":490,"num_bytes_recovered":230948,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":313,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:55.784818+0000","last_change":"2024-09-14T09:10:55.784742+0000","last_active":"2024-09-14T09:10:55.784818+0000","last_peered":"2024-09-14T09:10:55.784818+0000","last_clean":"2024-09-14T09:10:55.784818+0000","last_became_active":"2024-09-14T09:10:31.805768+0000","last_became_peered":"2024-09-14T09:10:31.805768+0000","last_unstale":"2024-09-14T09:10:55.784818+0000","last_undegraded":"2024-09-14T09:10:55.784818+0000","last_fullsized":"2024-09-14T09:10:55.784818+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T09:10:55.784627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T09:10:55.784627+0000","last_clean_scrub_stamp":"2024-09-14T09:10:55.784627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:22.599448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"175'468","reported_seq":2424,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:57.471778+0000","last_change":"2024-09-14T09:10:57.471778+0000","last_active":"2024-09-14T09:10:57.471778+0000","last_peered":"2024-09-14T09:10:57.471778+0000","last_clean":"2024-09-14T09:10:57.471778+0000","last_became_active":"2024-09-14T09:10:38.805463+0000","last_became_peered":"2024-09-14T09:10:38.805463+0000","last_unstale":"2024-09-14T09:10:57.471778+0000","last_undegraded":"2024-09-14T09:10:57.471778+0000","last_fullsized":"2024-09-14T09:10:57.471778+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'468","last_scrub_stamp":"2024-09-14T09:10:57.471690+0000","last_deep_scrub":"175'468","last_deep_scrub_stamp":"2024-09-14T09:10:57.471690+0000","last_clean_scrub_stamp":"2024-09-14T09:10:57.471690+0000","objects_scrubbed":29,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:26:09.987047+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0.0012021849999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":3112,"num_read_kb":25090,"num_write":394,"num_write_kb":10842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":1975296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"175'2","reported_seq":226,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:55.155191+0000","last_change":"2024-09-14T09:10:55.155143+0000","last_active":"2024-09-14T09:10:55.155191+0000","last_peered":"2024-09-14T09:10:55.155191+0000","last_clean":"2024-09-14T09:10:55.155191+0000","last_became_active":"2024-09-14T09:09:17.797925+0000","last_became_peered":"2024-09-14T09:09:17.797925+0000","last_unstale":"2024-09-14T09:10:55.155191+0000","last_undegraded":"2024-09-14T09:10:55.155191+0000","last_fullsized":"2024-09-14T09:10:55.155191+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'2","last_scrub_stamp":"2024-09-14T09:10:55.155069+0000","last_deep_scrub":"175'2","last_deep_scrub_stamp":"2024-09-14T09:10:55.155069+0000","last_clean_scrub_stamp":"2024-09-14T09:10:55.155069+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:16:27.785572+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"175'74","reported_seq":249,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:56.179360+0000","last_change":"2024-09-14T09:10:56.179313+0000","last_active":"2024-09-14T09:10:56.179360+0000","last_peered":"2024-09-14T09:10:56.179360+0000","last_clean":"2024-09-14T09:10:56.179360+0000","last_became_active":"2024-09-14T09:10:31.808373+0000","last_became_peered":"2024-09-14T09:10:31.808373+0000","last_unstale":"2024-09-14T09:10:56.179360+0000","last_undegraded":"2024-09-14T09:10:56.179360+0000","last_fullsized":"2024-09-14T09:10:56.179360+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'74","last_scrub_stamp":"2024-09-14T09:10:56.179237+0000","last_deep_scrub":"175'74","last_deep_scrub_stamp":"2024-09-14T09:10:56.179237+0000","last_clean_scrub_stamp":"2024-09-14T09:10:56.179237+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:13.806703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"175'724","reported_seq":10537,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:11:02.485957+0000","last_change":"2024-09-14T09:11:02.485957+0000","last_active":"2024-09-14T09:11:02.485957+0000","last_peered":"2024-09-14T09:11:02.485957+0000","last_clean":"2024-09-14T09:11:02.485957+0000","last_became_active":"2024-09-14T09:10:46.808573+0000","last_became_peered":"2024-09-14T09:10:46.808573+0000","last_unstale":"2024-09-14T09:11:02.485957+0000","last_undegraded":"2024-09-14T09:11:02.485957+0000","last_fullsized":"2024-09-14T09:11:02.485957+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'724","last_scrub_stamp":"2024-09-14T09:11:02.485857+0000","last_deep_scrub":"175'724","last_deep_scrub_stamp":"2024-09-14T09:11:02.485857+0000","last_clean_scrub_stamp":"2024-09-14T09:11:02.485857+0000","objects_scrubbed":28,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:08.578175+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0.0012882099999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":11028,"num_read_kb":52732,"num_write":579,"num_write_kb":14215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":2555973,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"175'565","reported_seq":7328,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:57.606842+0000","last_change":"2024-09-14T09:10:57.606842+0000","last_active":"2024-09-14T09:10:57.606842+0000","last_peered":"2024-09-14T09:10:57.606842+0000","last_clean":"2024-09-14T09:10:57.606842+0000","last_became_active":"2024-09-14T09:10:36.804585+0000","last_became_peered":"2024-09-14T09:10:36.804585+0000","last_unstale":"2024-09-14T09:10:57.606842+0000","last_undegraded":"2024-09-14T09:10:57.606842+0000","last_fullsized":"2024-09-14T09:10:57.606842+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'565","last_scrub_stamp":"2024-09-14T09:10:57.606739+0000","last_deep_scrub":"175'565","last_deep_scrub_stamp":"2024-09-14T09:10:57.606739+0000","last_clean_scrub_stamp":"2024-09-14T09:10:57.606739+0000","objects_scrubbed":30,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:37.238444+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0.0013332999999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":5991,"num_read_kb":50679,"num_write":476,"num_write_kb":15575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":3599888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"175'959","reported_seq":8262,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:58.592191+0000","last_change":"2024-09-14T09:10:58.592191+0000","last_active":"2024-09-14T09:10:58.592191+0000","last_peered":"2024-09-14T09:10:58.592191+0000","last_clean":"2024-09-14T09:10:58.592191+0000","last_became_active":"2024-09-14T09:09:02.793112+0000","last_became_peered":"2024-09-14T09:09:02.793112+0000","last_unstale":"2024-09-14T09:10:58.592191+0000","last_undegraded":"2024-09-14T09:10:58.592191+0000","last_fullsized":"2024-09-14T09:10:58.592191+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'959","last_scrub_stamp":"2024-09-14T09:10:58.592112+0000","last_deep_scrub":"175'959","last_deep_scrub_stamp":"2024-09-14T09:10:58.592112+0000","last_clean_scrub_stamp":"2024-09-14T09:10:58.592112+0000","objects_scrubbed":36,"log_size":959,"log_dups_size":0,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:00.272054+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0.001478858,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":9011,"num_read_kb":44883,"num_write":1107,"num_write_kb":15908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":9779638,"num_keys_recovered":46,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"175'509","reported_seq":5617,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:58.473304+0000","last_change":"2024-09-14T09:10:58.473304+0000","last_active":"2024-09-14T09:10:58.473304+0000","last_peered":"2024-09-14T09:10:58.473304+0000","last_clean":"2024-09-14T09:10:58.473304+0000","last_became_active":"2024-09-14T09:10:38.807014+0000","last_became_peered":"2024-09-14T09:10:38.807014+0000","last_unstale":"2024-09-14T09:10:58.473304+0000","last_undegraded":"2024-09-14T09:10:58.473304+0000","last_fullsized":"2024-09-14T09:10:58.473304+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'509","last_scrub_stamp":"2024-09-14T09:10:58.473217+0000","last_deep_scrub":"175'509","last_deep_scrub_stamp":"2024-09-14T09:10:58.473217+0000","last_clean_scrub_stamp":"2024-09-14T09:10:58.473217+0000","objects_scrubbed":28,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:52:53.754265+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0.00060512200000000004,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":4794,"num_read_kb":18724,"num_write":499,"num_write_kb":6053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":540832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"175'1003","reported_seq":17874,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:59.586070+0000","last_change":"2024-09-14T09:10:59.586070+0000","last_active":"2024-09-14T09:10:59.586070+0000","last_peered":"2024-09-14T09:10:59.586070+0000","last_clean":"2024-09-14T09:10:59.586070+0000","last_became_active":"2024-09-14T09:10:37.808431+0000","last_became_peered":"2024-09-14T09:10:37.808431+0000","last_unstale":"2024-09-14T09:10:59.586070+0000","last_undegraded":"2024-09-14T09:10:59.586070+0000","last_fullsized":"2024-09-14T09:10:59.586070+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'1003","last_scrub_stamp":"2024-09-14T09:10:59.585989+0000","last_deep_scrub":"175'1003","last_deep_scrub_stamp":"2024-09-14T09:10:59.585989+0000","last_clean_scrub_stamp":"2024-09-14T09:10:59.585989+0000","objects_scrubbed":27,"log_size":1003,"log_dups_size":0,"ondisk_log_size":1003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:37.999450+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0.0017008710000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":13865,"num_read_kb":46941,"num_write":938,"num_write_kb":9955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":415,"num_bytes_recovered":13533184,"num_keys_recovered":116,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"175'550","reported_seq":21806,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:57.179220+0000","last_change":"2024-09-14T09:10:57.179163+0000","last_active":"2024-09-14T09:10:57.179220+0000","last_peered":"2024-09-14T09:10:57.179220+0000","last_clean":"2024-09-14T09:10:57.179220+0000","last_became_active":"2024-09-14T09:10:35.813901+0000","last_became_peered":"2024-09-14T09:10:35.813901+0000","last_unstale":"2024-09-14T09:10:57.179220+0000","last_undegraded":"2024-09-14T09:10:57.179220+0000","last_fullsized":"2024-09-14T09:10:57.179220+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'550","last_scrub_stamp":"2024-09-14T09:10:57.179089+0000","last_deep_scrub":"175'550","last_deep_scrub_stamp":"2024-09-14T09:10:57.179089+0000","last_clean_scrub_stamp":"2024-09-14T09:10:57.179089+0000","objects_scrubbed":31,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:56.514083+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0.0029838349999999998,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":21382,"num_read_kb":52622,"num_write":626,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":374,"num_bytes_recovered":16325120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"175'597","reported_seq":4621,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:56.814016+0000","last_change":"2024-09-14T09:10:56.814016+0000","last_active":"2024-09-14T09:10:56.814016+0000","last_peered":"2024-09-14T09:10:56.814016+0000","last_clean":"2024-09-14T09:10:56.814016+0000","last_became_active":"2024-09-14T09:10:35.811599+0000","last_became_peered":"2024-09-14T09:10:35.811599+0000","last_unstale":"2024-09-14T09:10:56.814016+0000","last_undegraded":"2024-09-14T09:10:56.814016+0000","last_fullsized":"2024-09-14T09:10:56.814016+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'597","last_scrub_stamp":"2024-09-14T09:10:56.813927+0000","last_deep_scrub":"175'597","last_deep_scrub_stamp":"2024-09-14T09:10:56.813927+0000","last_clean_scrub_stamp":"2024-09-14T09:10:56.813927+0000","objects_scrubbed":33,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:22.888853+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0.001022088,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":5433,"num_read_kb":39557,"num_write":475,"num_write_kb":12186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":585,"num_bytes_recovered":15375904,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"175'417","reported_seq":3702,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:11:00.562926+0000","last_change":"2024-09-14T09:11:00.562926+0000","last_active":"2024-09-14T09:11:00.562926+0000","last_peered":"2024-09-14T09:11:00.562926+0000","last_clean":"2024-09-14T09:11:00.562926+0000","last_became_active":"2024-09-14T09:10:37.811679+0000","last_became_peered":"2024-09-14T09:10:37.811679+0000","last_unstale":"2024-09-14T09:11:00.562926+0000","last_undegraded":"2024-09-14T09:11:00.562926+0000","last_fullsized":"2024-09-14T09:11:00.562926+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'417","last_scrub_stamp":"2024-09-14T09:11:00.562843+0000","last_deep_scrub":"175'417","last_deep_scrub_stamp":"2024-09-14T09:11:00.562843+0000","last_clean_scrub_stamp":"2024-09-14T09:11:00.562843+0000","objects_scrubbed":26,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:53.039236+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0.0010483549999999999,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":2165,"num_read_kb":13861,"num_write":340,"num_write_kb":3973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":331,"num_bytes_recovered":1385641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"175'606","reported_seq":10562,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:58.225581+0000","last_change":"2024-09-14T09:10:58.225581+0000","last_active":"2024-09-14T09:10:58.225581+0000","last_peered":"2024-09-14T09:10:58.225581+0000","last_clean":"2024-09-14T09:10:58.225581+0000","last_became_active":"2024-09-14T09:10:36.814772+0000","last_became_peered":"2024-09-14T09:10:36.814772+0000","last_unstale":"2024-09-14T09:10:58.225581+0000","last_undegraded":"2024-09-14T09:10:58.225581+0000","last_fullsized":"2024-09-14T09:10:58.225581+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'606","last_scrub_stamp":"2024-09-14T09:10:58.225499+0000","last_deep_scrub":"175'606","last_deep_scrub_stamp":"2024-09-14T09:10:58.225499+0000","last_clean_scrub_stamp":"2024-09-14T09:10:58.225499+0000","objects_scrubbed":30,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:17.738844+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0.0024013369999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":9710,"num_read_kb":41453,"num_write":717,"num_write_kb":14547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":515,"num_bytes_recovered":6681771,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"175'871","reported_seq":11000,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:11:00.864352+0000","last_change":"2024-09-14T09:11:00.864352+0000","last_active":"2024-09-14T09:11:00.864352+0000","last_peered":"2024-09-14T09:11:00.864352+0000","last_clean":"2024-09-14T09:11:00.864352+0000","last_became_active":"2024-09-14T09:10:46.808235+0000","last_became_peered":"2024-09-14T09:10:46.808235+0000","last_unstale":"2024-09-14T09:11:00.864352+0000","last_undegraded":"2024-09-14T09:11:00.864352+0000","last_fullsized":"2024-09-14T09:11:00.864352+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'871","last_scrub_stamp":"2024-09-14T09:11:00.864272+0000","last_deep_scrub":"175'871","last_deep_scrub_stamp":"2024-09-14T09:11:00.864272+0000","last_clean_scrub_stamp":"2024-09-14T09:11:00.864272+0000","objects_scrubbed":29,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:26.939528+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0.001545701,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":12979,"num_read_kb":59033,"num_write":700,"num_write_kb":13832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":649,"num_bytes_recovered":10373286,"num_keys_recovered":102,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"175'513","reported_seq":5020,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:10:58.891236+0000","last_change":"2024-09-14T09:10:58.891236+0000","last_active":"2024-09-14T09:10:58.891236+0000","last_peered":"2024-09-14T09:10:58.891236+0000","last_clean":"2024-09-14T09:10:58.891236+0000","last_became_active":"2024-09-14T09:10:35.809716+0000","last_became_peered":"2024-09-14T09:10:35.809716+0000","last_unstale":"2024-09-14T09:10:58.891236+0000","last_undegraded":"2024-09-14T09:10:58.891236+0000","last_fullsized":"2024-09-14T09:10:58.891236+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'513","last_scrub_stamp":"2024-09-14T09:10:58.891152+0000","last_deep_scrub":"175'513","last_deep_scrub_stamp":"2024-09-14T09:10:58.891152+0000","last_clean_scrub_stamp":"2024-09-14T09:10:58.891152+0000","objects_scrubbed":33,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:26.165380+0000","scrub_duration":23,"objects_trimmed":2,"snaptrim_duration":0.0036893669999999998,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3997,"num_read_kb":34359,"num_write":407,"num_write_kb":6924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":317,"num_bytes_recovered":2955870,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"175'2221","reported_seq":9138,"reported_epoch":175,"state":"active+clean","last_fresh":"2024-09-14T09:11:01.191216+0000","last_change":"2024-09-14T09:11:01.191216+0000","last_active":"2024-09-14T09:11:01.191216+0000","last_peered":"2024-09-14T09:11:01.191216+0000","last_clean":"2024-09-14T09:11:01.191216+0000","last_became_active":"2024-09-14T09:09:03.794283+0000","last_became_peered":"2024-09-14T09:09:03.794283+0000","last_unstale":"2024-09-14T09:11:01.191216+0000","last_undegraded":"2024-09-14T09:11:01.191216+0000","last_fullsized":"2024-09-14T09:11:01.191216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'2221","last_scrub_stamp":"2024-09-14T09:11:01.191094+0000","last_deep_scrub":"175'2221","last_deep_scrub_stamp":"2024-09-14T09:11:01.191094+0000","last_clean_scrub_stamp":"2024-09-14T09:11:01.191094+0000","objects_scrubbed":19,"log_size":2221,"log_dups_size":0,"ondisk_log_size":2221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:45:58.050823+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0.0013071960000000001,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":16728,"num_read_kb":45108,"num_write":3399,"num_write_kb":14849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":4151803,"num_keys_recovered":53,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":880,"num_object_clones":0,"num_object_copies":1760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":880,"num_whiteouts":876,"num_read":421320,"num_read_kb":1460227,"num_write":27245,"num_write_kb":494223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11099,"num_bytes_recovered":245332849,"num_keys_recovered":856,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12266,"internal_metadata":0},"log_size":25477,"ondisk_log_size":25477,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":87,"seq":373662154778,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30924,"kb_used_data":2044,"kb_used_omap":24,"kb_used_meta":28839,"kb_avail":94340916,"statfs":{"total":96636764160,"available":96605097984,"internally_reserved":0,"allocated":2093056,"data_stored":882432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24922,"internal_metadata":29531814},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96276,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94275564,"statfs":{"total":96636764160,"available":96538177536,"internally_reserved":0,"allocated":2691072,"data_stored":1472819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607601,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51860,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319980,"statfs":{"total":96636764160,"available":96583659520,"internally_reserved":0,"allocated":2691072,"data_stored":1472819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607603,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47120,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324720,"statfs":{"total":96636764160,"available":96588513280,"internally_reserved":0,"allocated":2097152,"data_stored":882451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607601,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95628,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94276212,"statfs":{"total":96636764160,"available":96538841088,"internally_reserved":0,"allocated":2093056,"data_stored":882432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":95812039},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640305,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77648,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94294192,"statfs":{"total":96636764160,"available":96557252608,"internally_reserved":0,"allocated":2097152,"data_stored":882451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12266,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T09:11:17.028 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-14T09:11:17.332 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-14T09:11:17.333 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-14T09:11:17.333 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T09:11:17.333 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T09:11:17.369 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T09:11:17.369 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-14T09:11:17.369 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T09:11:17.443 INFO:tasks.ceph.osd.1:Stopped 2024-09-14T09:11:17.444 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-14T09:11:17.444 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T09:11:17.523 INFO:tasks.ceph.osd.2:Stopped 2024-09-14T09:11:17.524 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-14T09:11:17.524 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T09:11:17.569 INFO:tasks.ceph.osd.3:Stopped 2024-09-14T09:11:17.606 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-14T09:11:17.606 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T09:11:17.642 INFO:tasks.ceph.osd.4:Stopped 2024-09-14T09:11:17.642 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-14T09:11:17.642 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T09:11:17.721 INFO:tasks.ceph.osd.5:Stopped 2024-09-14T09:11:17.722 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T09:11:17.722 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-14T09:11:17.722 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T09:11:17.795 INFO:tasks.ceph.mgr.x:Stopped 2024-09-14T09:11:17.795 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T09:11:17.795 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-14T09:11:17.795 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T09:11:17.806 INFO:tasks.ceph.mon.a:Stopped 2024-09-14T09:11:17.806 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-14T09:11:17.806 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T09:11:17.857 INFO:tasks.ceph.mon.c:Stopped 2024-09-14T09:11:17.858 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-14T09:11:17.858 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T09:11:17.871 INFO:tasks.ceph.mon.b:Stopped 2024-09-14T09:11:17.871 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T09:11:17.871 DEBUG:teuthology.orchestra.run.smithi116:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-14T09:11:17.935 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T09:11:17.935 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-14T09:11:18.284 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T09:11:18.284 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-14T09:11:18.362 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T09:11:18.362 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-14T09:11:18.424 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-14T09:11:18.424 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-14T09:11:18.588 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-14T09:11:18.588 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-14T09:11:18.651 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-14T09:11:18.651 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-14T09:11:18.699 INFO:tasks.ceph:Archiving mon data... 2024-09-14T09:11:18.700 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900520/data/mon.a.tgz 2024-09-14T09:11:18.700 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2024-09-14T09:11:18.716 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.5ylzEjprwk 2024-09-14T09:11:18.717 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.5ylzEjprwk 2024-09-14T09:11:18.866 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.5ylzEjprwk 2024-09-14T09:11:18.949 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.5ylzEjprwk is 359KB 2024-09-14T09:11:19.045 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.5ylzEjprwk 2024-09-14T09:11:19.060 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900520/data/mon.c.tgz 2024-09-14T09:11:19.060 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2024-09-14T09:11:19.114 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.BXb1pMKtsG 2024-09-14T09:11:19.114 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.BXb1pMKtsG 2024-09-14T09:11:19.278 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.BXb1pMKtsG 2024-09-14T09:11:19.360 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.BXb1pMKtsG is 479KB 2024-09-14T09:11:19.430 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.BXb1pMKtsG 2024-09-14T09:11:19.445 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900520/data/mon.b.tgz 2024-09-14T09:11:19.445 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2024-09-14T09:11:19.464 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.2FDje5hsHk 2024-09-14T09:11:19.465 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.2FDje5hsHk 2024-09-14T09:11:19.654 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.2FDje5hsHk 2024-09-14T09:11:19.738 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.2FDje5hsHk is 479KB 2024-09-14T09:11:19.834 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.2FDje5hsHk 2024-09-14T09:11:19.849 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T09:11:19.850 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T09:11:19.852 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T09:11:19.891 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T09:11:19.940 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T09:11:19.968 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T09:11:19.986 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T09:11:19.987 INFO:tasks.ceph:Archiving crash dumps... 2024-09-14T09:11:19.988 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900520/remote/smithi116/crash 2024-09-14T09:11:19.989 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T09:11:20.014 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900520/remote/smithi144/crash 2024-09-14T09:11:20.015 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T09:11:20.039 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900520/remote/smithi148/crash 2024-09-14T09:11:20.040 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T09:11:20.087 INFO:tasks.ceph:Compressing logs... 2024-09-14T09:11:20.088 DEBUG:teuthology.orchestra.run.smithi116:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T09:11:20.090 DEBUG:teuthology.orchestra.run.smithi144:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T09:11:20.092 DEBUG:teuthology.orchestra.run.smithi148:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T09:11:20.127 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31642.log 2024-09-14T09:11:20.128 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31562.log 2024-09-14T09:11:20.128 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31722.log 2024-09-14T09:11:20.128 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.31642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31642.log.gz 2024-09-14T09:11:20.128 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.31562.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-14T09:11:20.128 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31562.log.gz 2024-09-14T09:11:20.128 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.31722.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T09:11:20.128 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31722.log.gz 2024-09-14T09:11:20.128 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31762.log 2024-09-14T09:11:20.128 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31682.log 2024-09-14T09:11:20.128 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.31762.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-14T09:11:20.128 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31762.log.gz 2024-09-14T09:11:20.128 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.31682.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T09:11:20.128 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31682.log.gz 2024-09-14T09:11:20.128 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-14T09:11:20.129 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-14T09:11:20.129 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-mgr.x.log: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T09:11:20.129 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-14T09:11:20.129 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31602.log 2024-09-14T09:11:20.129 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.3.log: 84.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T09:11:20.129 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.31602.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31602.log.gz 2024-09-14T09:11:20.174 INFO:teuthology.orchestra.run.smithi144.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-14T09:11:20.240 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28382.log 2024-09-14T09:11:20.240 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28215.log 2024-09-14T09:11:20.240 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27211.log 2024-09-14T09:11:20.240 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28382.log.gz 2024-09-14T09:11:20.240 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29996.log 2024-09-14T09:11:20.240 INFO:teuthology.orchestra.run.smithi148.stderr: 55.5% -- replaced with /var/log/ceph/ceph-client.admin.28215.log.gz 2024-09-14T09:11:20.241 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28882.log 2024-09-14T09:11:20.241 INFO:teuthology.orchestra.run.smithi148.stderr: 56.7% -- replaced with /var/log/ceph/ceph-client.admin.27211.log.gz 2024-09-14T09:11:20.241 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28355.log 2024-09-14T09:11:20.241 INFO:teuthology.orchestra.run.smithi148.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.29996.log.gz 2024-09-14T09:11:20.241 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27996.log 2024-09-14T09:11:20.241 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28882.log.gz 2024-09-14T09:11:20.241 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28663.log 2024-09-14T09:11:20.241 INFO:teuthology.orchestra.run.smithi148.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.28355.log.gz 2024-09-14T09:11:20.241 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29715.log 2024-09-14T09:11:20.241 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27996.log.gz 2024-09-14T09:11:20.241 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29126.log 2024-09-14T09:11:20.241 INFO:teuthology.orchestra.run.smithi148.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.28663.log.gz 2024-09-14T09:11:20.241 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29724.log 2024-09-14T09:11:20.242 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29715.log.gz 2024-09-14T09:11:20.242 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29889.log 2024-09-14T09:11:20.242 INFO:teuthology.orchestra.run.smithi148.stderr: 54.6% -- replaced with /var/log/ceph/ceph-client.admin.29126.log.gz 2024-09-14T09:11:20.242 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28812.log 2024-09-14T09:11:20.242 INFO:teuthology.orchestra.run.smithi148.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.29724.log.gz 2024-09-14T09:11:20.242 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27576.log 2024-09-14T09:11:20.242 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29889.log.gz 2024-09-14T09:11:20.242 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30039.log 2024-09-14T09:11:20.242 INFO:teuthology.orchestra.run.smithi148.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.28812.log.gz 2024-09-14T09:11:20.242 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29224.log 2024-09-14T09:11:20.242 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27576.log.gz 2024-09-14T09:11:20.242 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.30039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28873.log 2024-09-14T09:11:20.242 INFO:teuthology.orchestra.run.smithi148.stderr: 25.9% -- replaced with /var/log/ceph/ceph-client.admin.30039.log.gz 2024-09-14T09:11:20.243 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28425.log 2024-09-14T09:11:20.243 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29224.log.gz 2024-09-14T09:11:20.243 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28102.log 2024-09-14T09:11:20.243 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28873.log.gz 2024-09-14T09:11:20.243 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27436.log 2024-09-14T09:11:20.243 INFO:teuthology.orchestra.run.smithi148.stderr: 57.3% -- replaced with /var/log/ceph/ceph-client.admin.28425.log.gz 2024-09-14T09:11:20.243 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27926.log 2024-09-14T09:11:20.243 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28102.log.gz 2024-09-14T09:11:20.243 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29163.log 2024-09-14T09:11:20.243 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27436.log.gz 2024-09-14T09:11:20.243 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28032.log 2024-09-14T09:11:20.243 INFO:teuthology.orchestra.run.smithi148.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.27926.log.gz 2024-09-14T09:11:20.243 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29609.log 2024-09-14T09:11:20.243 INFO:teuthology.orchestra.run.smithi148.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.29163.log.gz 2024-09-14T09:11:20.244 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28522.log 2024-09-14T09:11:20.244 INFO:teuthology.orchestra.run.smithi148.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.28032.log.gz 2024-09-14T09:11:20.244 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29478.log 2024-09-14T09:11:20.244 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29609.log.gz 2024-09-14T09:11:20.244 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29188.log 2024-09-14T09:11:20.244 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28522.log.gz 2024-09-14T09:11:20.244 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29197.log 2024-09-14T09:11:20.244 INFO:teuthology.orchestra.run.smithi148.stderr: 25.9% -- replaced with /var/log/ceph/ceph-client.admin.29478.log.gz 2024-09-14T09:11:20.244 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28907.log 2024-09-14T09:11:20.244 INFO:teuthology.orchestra.run.smithi148.stderr: 18.4% -- replaced with /var/log/ceph/ceph-client.admin.29188.log.gz 2024-09-14T09:11:20.244 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30066.log 2024-09-14T09:11:20.244 INFO:teuthology.orchestra.run.smithi148.stderr: 57.6% -- replaced with /var/log/ceph/ceph-client.admin.29197.log.gz 2024-09-14T09:11:20.244 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29819.log 2024-09-14T09:11:20.245 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28907.log.gz 2024-09-14T09:11:20.245 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.30066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29435.log 2024-09-14T09:11:20.245 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.30066.log.gz 2024-09-14T09:11:20.245 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29548.log 2024-09-14T09:11:20.245 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29819.log.gz 2024-09-14T09:11:20.245 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29294.log 2024-09-14T09:11:20.245 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29435.log.gz 2024-09-14T09:11:20.245 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29083.log 2024-09-14T09:11:20.245 INFO:teuthology.orchestra.run.smithi148.stderr: 54.0% -- replaced with /var/log/ceph/ceph-client.admin.29548.log.gz 2024-09-14T09:11:20.245 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28803.log 2024-09-14T09:11:20.245 INFO:teuthology.orchestra.run.smithi148.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.29294.log.gz 2024-09-14T09:11:20.245 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29864.log 2024-09-14T09:11:20.245 INFO:teuthology.orchestra.run.smithi148.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.29083.log.gz 2024-09-14T09:11:20.245 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30136.log 2024-09-14T09:11:20.246 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28803.log.gz 2024-09-14T09:11:20.246 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27472.log 2024-09-14T09:11:20.246 INFO:teuthology.orchestra.run.smithi148.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29864.log.gz 2024-09-14T09:11:20.246 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.30136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28977.log 2024-09-14T09:11:20.246 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.30136.log.gz 2024-09-14T09:11:20.246 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27612.log 2024-09-14T09:11:20.246 INFO:teuthology.orchestra.run.smithi148.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.27472.log.gz 2024-09-14T09:11:20.246 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29154.log 2024-09-14T09:11:20.246 INFO:teuthology.orchestra.run.smithi148.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.28977.log.gz 2024-09-14T09:11:20.246 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28416.log 2024-09-14T09:11:20.246 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27612.log.gz 2024-09-14T09:11:20.246 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29505.log 2024-09-14T09:11:20.246 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29154.log.gz 2024-09-14T09:11:20.246 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27621.log 2024-09-14T09:11:20.246 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28416.log.gz 2024-09-14T09:11:20.247 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28495.log 2024-09-14T09:11:20.247 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29505.log.gz 2024-09-14T09:11:20.247 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29056.log 2024-09-14T09:11:20.247 INFO:teuthology.orchestra.run.smithi148.stderr: 73.8% -- replaced with /var/log/ceph/ceph-client.admin.27621.log.gz 2024-09-14T09:11:20.247 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28206.log 2024-09-14T09:11:20.247 INFO:teuthology.orchestra.run.smithi148.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.28495.log.gz 2024-09-14T09:11:20.247 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28635.log 2024-09-14T09:11:20.247 INFO:teuthology.orchestra.run.smithi148.stderr: 52.8% -- replaced with /var/log/ceph/ceph-client.admin.29056.log.gz 2024-09-14T09:11:20.247 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27515.log 2024-09-14T09:11:20.247 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28206.log.gz 2024-09-14T09:11:20.247 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29374.log 2024-09-14T09:11:20.247 INFO:teuthology.orchestra.run.smithi148.stderr: 54.9% -- replaced with /var/log/ceph/ceph-client.admin.28635.log.gz 2024-09-14T09:11:20.247 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27725.log 2024-09-14T09:11:20.248 INFO:teuthology.orchestra.run.smithi148.stderr: 57.5% -- replaced with /var/log/ceph/ceph-client.admin.27515.log.gz 2024-09-14T09:11:20.248 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28943.log 2024-09-14T09:11:20.248 INFO:teuthology.orchestra.run.smithi148.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.29374.log.gz 2024-09-14T09:11:20.248 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28672.log 2024-09-14T09:11:20.248 INFO:teuthology.orchestra.run.smithi148.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.27725.log.gz 2024-09-14T09:11:20.248 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28626.log 2024-09-14T09:11:20.248 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28943.log.gz 2024-09-14T09:11:20.248 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27411.log 2024-09-14T09:11:20.248 INFO:teuthology.orchestra.run.smithi148.stderr: 94.8% -- replaced with /var/log/ceph/ceph-client.admin.28672.log.gz 2024-09-14T09:11:20.248 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30100.log 2024-09-14T09:11:20.248 INFO:teuthology.orchestra.run.smithi148.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.28626.log.gz 2024-09-14T09:11:20.248 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27786.log 2024-09-14T09:11:20.248 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.30100.log: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.27411.log.gz 2024-09-14T09:11:20.249 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29959.log 2024-09-14T09:11:20.249 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.30100.log.gz 2024-09-14T09:11:20.249 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29898.log 2024-09-14T09:11:20.249 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27786.log.gz 2024-09-14T09:11:20.249 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27752.log 2024-09-14T09:11:20.249 INFO:teuthology.orchestra.run.smithi148.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.29959.log.gz 2024-09-14T09:11:20.249 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29539.log 2024-09-14T09:11:20.249 INFO:teuthology.orchestra.run.smithi148.stderr: 53.1% -- replaced with /var/log/ceph/ceph-client.admin.29898.log.gz 2024-09-14T09:11:20.249 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28916.log 2024-09-14T09:11:20.249 INFO:teuthology.orchestra.run.smithi148.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.27752.log.gz 2024-09-14T09:11:20.249 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27831.log 2024-09-14T09:11:20.249 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29539.log.gz 2024-09-14T09:11:20.249 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30075.log 2024-09-14T09:11:20.250 INFO:teuthology.orchestra.run.smithi148.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.28916.log.gz 2024-09-14T09:11:20.250 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29575.log 2024-09-14T09:11:20.250 INFO:teuthology.orchestra.run.smithi148.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.27831.log.gz 2024-09-14T09:11:20.250 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.30075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28846.log 2024-09-14T09:11:20.250 INFO:teuthology.orchestra.run.smithi148.stderr: 58.0% -- replaced with /var/log/ceph/ceph-client.admin.30075.log.gz 2024-09-14T09:11:20.250 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29575.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29575.log.gz 2024-09-14T09:11:20.250 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27551.log 2024-09-14T09:11:20.250 INFO:teuthology.orchestra.run.smithi148.stderr: 53.2% -- replaced with /var/log/ceph/ceph-client.admin.28846.log.gz 2024-09-14T09:11:20.250 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27901.log 2024-09-14T09:11:20.250 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29047.log 2024-09-14T09:11:20.250 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28066.log 2024-09-14T09:11:20.250 INFO:teuthology.orchestra.run.smithi148.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.27551.log.gz 2024-09-14T09:11:20.250 INFO:teuthology.orchestra.run.smithi148.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.27901.log.gz 2024-09-14T09:11:20.250 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30005.log 2024-09-14T09:11:20.251 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29047.log.gz 2024-09-14T09:11:20.251 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27962.log 2024-09-14T09:11:20.251 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28066.log.gz 2024-09-14T09:11:20.251 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.30005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.27169.log 2024-09-14T09:11:20.251 INFO:teuthology.orchestra.run.smithi148.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.30005.log.gz 2024-09-14T09:11:20.251 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27716.log 2024-09-14T09:11:20.251 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27962.log.gz 2024-09-14T09:11:20.251 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.27169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27506.log 2024-09-14T09:11:20.251 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27716.log: 94.0% -- replaced with /var/log/ceph/ceph-client.0.27169.log.gz 2024-09-14T09:11:20.251 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29469.log 2024-09-14T09:11:20.251 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27716.log.gz 2024-09-14T09:11:20.251 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29618.log 2024-09-14T09:11:20.251 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27506.log.gz 2024-09-14T09:11:20.251 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28172.log 2024-09-14T09:11:20.252 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29469.log.gz 2024-09-14T09:11:20.252 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30109.log 2024-09-14T09:11:20.252 INFO:teuthology.orchestra.run.smithi148.stderr: 25.9% -- replaced with /var/log/ceph/ceph-client.admin.29618.log.gz 2024-09-14T09:11:20.252 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28486.log 2024-09-14T09:11:20.252 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28172.log.gz 2024-09-14T09:11:20.252 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.30109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27585.log 2024-09-14T09:11:20.252 INFO:teuthology.orchestra.run.smithi148.stderr: 53.7% -- replaced with /var/log/ceph/ceph-client.admin.30109.log.gz 2024-09-14T09:11:20.252 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30145.log 2024-09-14T09:11:20.252 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28486.log.gz 2024-09-14T09:11:20.252 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28565.log 2024-09-14T09:11:20.252 INFO:teuthology.orchestra.run.smithi148.stderr: 74.9% -- replaced with /var/log/ceph/ceph-client.admin.27585.log.gz 2024-09-14T09:11:20.252 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.30145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28592.log 2024-09-14T09:11:20.252 INFO:teuthology.orchestra.run.smithi148.stderr: 55.0% -- replaced with /var/log/ceph/ceph-client.admin.30145.log.gz 2024-09-14T09:11:20.252 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27340.log 2024-09-14T09:11:20.253 INFO:teuthology.orchestra.run.smithi148.stderr: 57.8% -- replaced with /var/log/ceph/ceph-client.admin.28565.log.gz 2024-09-14T09:11:20.253 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28075.log 2024-09-14T09:11:20.253 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28592.log.gz 2024-09-14T09:11:20.253 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27542.log 2024-09-14T09:11:20.253 INFO:teuthology.orchestra.run.smithi148.stderr: 53.4% -- replaced with /var/log/ceph/ceph-client.admin.27340.log.gz 2024-09-14T09:11:20.253 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29688.log 2024-09-14T09:11:20.253 INFO:teuthology.orchestra.run.smithi148.stderr: 35.9% -- replaced with /var/log/ceph/ceph-client.admin.28075.log.gz 2024-09-14T09:11:20.253 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27296.log 2024-09-14T09:11:20.253 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27542.log.gz 2024-09-14T09:11:20.253 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27856.log 2024-09-14T09:11:20.253 INFO:teuthology.orchestra.run.smithi148.stderr: 54.6% -- replaced with /var/log/ceph/ceph-client.admin.29688.log.gz 2024-09-14T09:11:20.253 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27795.log 2024-09-14T09:11:20.253 INFO:teuthology.orchestra.run.smithi148.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.27296.log.gz 2024-09-14T09:11:20.254 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28837.log 2024-09-14T09:11:20.254 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27856.log.gz 2024-09-14T09:11:20.254 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27365.log 2024-09-14T09:11:20.254 INFO:teuthology.orchestra.run.smithi148.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.27795.log.gz 2024-09-14T09:11:20.254 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27374.log 2024-09-14T09:11:20.254 INFO:teuthology.orchestra.run.smithi148.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.28837.log.gz 2024-09-14T09:11:20.254 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28697.log 2024-09-14T09:11:20.254 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27365.log.gz 2024-09-14T09:11:20.254 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29794.log 2024-09-14T09:11:20.254 INFO:teuthology.orchestra.run.smithi148.stderr: 54.4% -- replaced with /var/log/ceph/ceph-client.admin.27374.log.gz 2024-09-14T09:11:20.254 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29828.log 2024-09-14T09:11:20.254 INFO:teuthology.orchestra.run.smithi148.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.28697.log.gz 2024-09-14T09:11:20.254 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29785.log 2024-09-14T09:11:20.254 INFO:teuthology.orchestra.run.smithi148.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.29794.log.gz 2024-09-14T09:11:20.255 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27761.log 2024-09-14T09:11:20.255 INFO:teuthology.orchestra.run.smithi148.stderr: 52.5% -- replaced with /var/log/ceph/ceph-client.admin.29828.log.gz 2024-09-14T09:11:20.255 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28346.log 2024-09-14T09:11:20.255 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29785.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29785.log.gz 2024-09-14T09:11:20.255 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29399.log 2024-09-14T09:11:20.255 INFO:teuthology.orchestra.run.smithi148.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.27761.log.gz 2024-09-14T09:11:20.255 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27646.log 2024-09-14T09:11:20.255 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28346.log.gz 2024-09-14T09:11:20.255 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27481.log 2024-09-14T09:11:20.255 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29399.log.gz 2024-09-14T09:11:20.255 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29514.log 2024-09-14T09:11:20.255 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27646.log.gz 2024-09-14T09:11:20.255 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27865.log 2024-09-14T09:11:20.255 INFO:teuthology.orchestra.run.smithi148.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.27481.log.gz 2024-09-14T09:11:20.256 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27331.log 2024-09-14T09:11:20.256 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29514.log.gz 2024-09-14T09:11:20.256 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28136.log 2024-09-14T09:11:20.256 INFO:teuthology.orchestra.run.smithi148.stderr: 52.4% -- replaced with /var/log/ceph/ceph-client.admin.27865.log.gz 2024-09-14T09:11:20.256 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27822.log 2024-09-14T09:11:20.256 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27331.log.gz 2024-09-14T09:11:20.256 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29444.log 2024-09-14T09:11:20.256 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28136.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28136.log.gz 2024-09-14T09:11:20.256 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28005.log 2024-09-14T09:11:20.256 INFO:teuthology.orchestra.run.smithi148.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.27822.log.gz 2024-09-14T09:11:20.256 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29258.log 2024-09-14T09:11:20.256 INFO:teuthology.orchestra.run.smithi148.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.29444.log.gz 2024-09-14T09:11:20.256 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27682.log 2024-09-14T09:11:20.256 INFO:teuthology.orchestra.run.smithi148.stderr: 57.6% -- replaced with /var/log/ceph/ceph-client.admin.28005.log.gz 2024-09-14T09:11:20.257 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27935.log 2024-09-14T09:11:20.257 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29258.log.gz 2024-09-14T09:11:20.257 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29855.log 2024-09-14T09:11:20.257 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27682.log.gz 2024-09-14T09:11:20.257 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29022.log 2024-09-14T09:11:20.257 INFO:teuthology.orchestra.run.smithi148.stderr: 53.7% -- replaced with /var/log/ceph/ceph-client.admin.27935.log.gz 2024-09-14T09:11:20.257 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28767.log 2024-09-14T09:11:20.257 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29855.log.gz 2024-09-14T09:11:20.257 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28285.log 2024-09-14T09:11:20.257 INFO:teuthology.orchestra.run.smithi148.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.29022.log.gz 2024-09-14T09:11:20.257 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29092.log 2024-09-14T09:11:20.257 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28767.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28767.log.gz 2024-09-14T09:11:20.257 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29758.log 2024-09-14T09:11:20.258 INFO:teuthology.orchestra.run.smithi148.stderr: 53.6% -- replaced with /var/log/ceph/ceph-client.admin.28285.log.gz 2024-09-14T09:11:20.258 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28601.log 2024-09-14T09:11:20.258 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28242.log 2024-09-14T09:11:20.258 INFO:teuthology.orchestra.run.smithi148.stderr: 96.1% -- replaced with /var/log/ceph/ceph-client.admin.29092.log.gz 2024-09-14T09:11:20.258 INFO:teuthology.orchestra.run.smithi148.stderr: 25.9% -- replaced with /var/log/ceph/ceph-client.admin.29758.log.gz 2024-09-14T09:11:20.258 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28452.log 2024-09-14T09:11:20.258 INFO:teuthology.orchestra.run.smithi148.stderr: 53.7% -- replaced with /var/log/ceph/ceph-client.admin.28601.log.gz 2024-09-14T09:11:20.258 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29013.log 2024-09-14T09:11:20.258 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28242.log.gz 2024-09-14T09:11:20.258 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28742.log 2024-09-14T09:11:20.258 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28452.log.gz 2024-09-14T09:11:20.258 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27402.log 2024-09-14T09:11:20.258 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29013.log: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.29013.log.gz 2024-09-14T09:11:20.258 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28733.log 2024-09-14T09:11:20.259 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27971.log 2024-09-14T09:11:20.259 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27402.log.gz 2024-09-14T09:11:20.259 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28776.log 2024-09-14T09:11:20.259 INFO:teuthology.orchestra.run.smithi148.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.28742.log.gz 2024-09-14T09:11:20.259 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28733.log.gz 2024-09-14T09:11:20.259 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28251.log 2024-09-14T09:11:20.259 INFO:teuthology.orchestra.run.smithi148.stderr: 54.0% -- replaced with /var/log/ceph/ceph-client.admin.27971.log.gz 2024-09-14T09:11:20.259 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28952.log 2024-09-14T09:11:20.259 INFO:teuthology.orchestra.run.smithi148.stderr: 24.7% -- replaced with /var/log/ceph/ceph-client.admin.28776.log.gz 2024-09-14T09:11:20.259 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29925.log 2024-09-14T09:11:20.259 INFO:teuthology.orchestra.run.smithi148.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.28251.log.gz 2024-09-14T09:11:20.259 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29584.log 2024-09-14T09:11:20.259 INFO:teuthology.orchestra.run.smithi148.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.28952.log.gz 2024-09-14T09:11:20.259 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5/var/log/ceph/ceph-client.admin.29925.log: --verbose -- /var/log/ceph/ceph-client.admin.28461.log 2024-09-14T09:11:20.260 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29925.log.gz 2024-09-14T09:11:20.260 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29408.log 2024-09-14T09:11:20.260 INFO:teuthology.orchestra.run.smithi148.stderr: 53.2% -- replaced with /var/log/ceph/ceph-client.admin.29584.log.gz 2024-09-14T09:11:20.260 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29679.log 2024-09-14T09:11:20.260 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28461.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.28461.log.gz 2024-09-14T09:11:20.260 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.29408.log: -- /var/log/ceph/ceph-client.admin.29337.log 2024-09-14T09:11:20.260 INFO:teuthology.orchestra.run.smithi148.stderr: 52.9% -- replaced with /var/log/ceph/ceph-client.admin.29408.log.gz 2024-09-14T09:11:20.260 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28706.log 2024-09-14T09:11:20.260 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29679.log.gz 2024-09-14T09:11:20.260 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27892.log 2024-09-14T09:11:20.260 INFO:teuthology.orchestra.run.smithi148.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.29337.log.gz 2024-09-14T09:11:20.260 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28276.log 2024-09-14T09:11:20.260 INFO:teuthology.orchestra.run.smithi148.stderr: 57.7% -- replaced with /var/log/ceph/ceph-client.admin.28706.log.gz 2024-09-14T09:11:20.260 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27691.log 2024-09-14T09:11:20.261 INFO:teuthology.orchestra.run.smithi148.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.27892.log.gz 2024-09-14T09:11:20.261 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28111.log 2024-09-14T09:11:20.261 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28276.log.gz 2024-09-14T09:11:20.261 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30030.log 2024-09-14T09:11:20.261 INFO:teuthology.orchestra.run.smithi148.stderr: 67.0% -- replaced with /var/log/ceph/ceph-client.admin.27691.log.gz 2024-09-14T09:11:20.261 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27445.log 2024-09-14T09:11:20.261 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.30030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29968.log 2024-09-14T09:11:20.261 INFO:teuthology.orchestra.run.smithi148.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.30030.log.gz 2024-09-14T09:11:20.261 INFO:teuthology.orchestra.run.smithi148.stderr: 96.4% -- replaced with /var/log/ceph/ceph-client.admin.28111.log.gz 2024-09-14T09:11:20.261 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29654.log 2024-09-14T09:11:20.261 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27445.log: 25.3% -- replaced with /var/log/ceph/ceph-client.admin.27445.log.gz 2024-09-14T09:11:20.261 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28391.log 2024-09-14T09:11:20.262 INFO:teuthology.orchestra.run.smithi148.stderr: 73.2% -- replaced with /var/log/ceph/ceph-client.admin.29968.log.gz 2024-09-14T09:11:20.262 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28312.log 2024-09-14T09:11:20.262 INFO:teuthology.orchestra.run.smithi148.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.29654.log.gz 2024-09-14T09:11:20.262 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29645.log 2024-09-14T09:11:20.262 INFO:teuthology.orchestra.run.smithi148.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.28391.log.gz 2024-09-14T09:11:20.262 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29365.log 2024-09-14T09:11:20.262 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28312.log.gz 2024-09-14T09:11:20.262 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27305.log 2024-09-14T09:11:20.262 INFO:teuthology.orchestra.run.smithi148.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.29645.log.gz 2024-09-14T09:11:20.262 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27655.log 2024-09-14T09:11:20.262 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29365.log.gz 2024-09-14T09:11:20.262 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29934.log 2024-09-14T09:11:20.262 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27305.log: 53.6% -- replaced with /var/log/ceph/ceph-client.admin.27305.log.gz 2024-09-14T09:11:20.262 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29233.log 2024-09-14T09:11:20.263 INFO:teuthology.orchestra.run.smithi148.stderr: 51.6% -- replaced with /var/log/ceph/ceph-client.admin.27655.log.gz 2024-09-14T09:11:20.263 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29749.log 2024-09-14T09:11:20.263 INFO:teuthology.orchestra.run.smithi148.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.29934.log.gz 2024-09-14T09:11:20.263 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28041.log 2024-09-14T09:11:20.263 INFO:teuthology.orchestra.run.smithi148.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.29233.log.gz 2024-09-14T09:11:20.263 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28321.log 2024-09-14T09:11:20.263 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29749.log.gz 2024-09-14T09:11:20.263 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28181.log 2024-09-14T09:11:20.263 INFO:teuthology.orchestra.run.smithi148.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28041.log.gz 2024-09-14T09:11:20.263 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28986.log 2024-09-14T09:11:20.263 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29328.log 2024-09-14T09:11:20.263 INFO:teuthology.orchestra.run.smithi148.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.28321.log.gz 2024-09-14T09:11:20.263 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27202.log 2024-09-14T09:11:20.263 INFO:teuthology.orchestra.run.smithi148.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.28181.log.gz 2024-09-14T09:11:20.264 INFO:teuthology.orchestra.run.smithi148.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.28986.log.gz 2024-09-14T09:11:20.264 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28531.log 2024-09-14T09:11:20.264 INFO:teuthology.orchestra.run.smithi148.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.29328.log.gz 2024-09-14T09:11:20.264 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.27202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29117.log 2024-09-14T09:11:20.264 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27202.log.gz 2024-09-14T09:11:20.264 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28145.log 2024-09-14T09:11:20.264 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29117.log: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.28531.log.gz 2024-09-14T09:11:20.264 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28556.log 2024-09-14T09:11:20.264 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29117.log.gz 2024-09-14T09:11:20.264 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29267.log 2024-09-14T09:11:20.264 INFO:teuthology.orchestra.run.smithi148.stderr: 54.3% -- replaced with /var/log/ceph/ceph-client.admin.28145.log.gz 2024-09-14T09:11:20.264 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29303.log 2024-09-14T09:11:20.264 INFO:teuthology.orchestra.run.smithi148.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28556.log.gz 2024-09-14T09:11:20.264 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29267.log: 25.9% -- replaced with /var/log/ceph/ceph-client.admin.29267.log.gz 2024-09-14T09:11:20.265 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.29303.log: 94.8% -- replaced with /var/log/ceph/ceph-client.admin.29303.log.gz 2024-09-14T09:11:20.265 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-09-14T09:11:20.265 INFO:teuthology.orchestra.run.smithi148.stderr:real 0m0.064s 2024-09-14T09:11:20.265 INFO:teuthology.orchestra.run.smithi148.stderr:user 0m0.069s 2024-09-14T09:11:20.265 INFO:teuthology.orchestra.run.smithi148.stderr:sys 0m0.088s 2024-09-14T09:11:20.273 INFO:teuthology.orchestra.run.smithi144.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-14T09:11:20.314 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-14T09:11:20.315 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55144.log 2024-09-14T09:11:20.315 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51409.log 2024-09-14T09:11:20.315 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.55144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60226.log 2024-09-14T09:11:20.315 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55144.log.gz 2024-09-14T09:11:20.315 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48155.log 2024-09-14T09:11:20.315 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51409.log.gz 2024-09-14T09:11:20.315 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.60226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40437.log 2024-09-14T09:11:20.315 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60226.log.gz 2024-09-14T09:11:20.315 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59764.log 2024-09-14T09:11:20.315 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48155.log.gz 2024-09-14T09:11:20.315 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40887.log 2024-09-14T09:11:20.315 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40437.log.gz 2024-09-14T09:11:20.316 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.59764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59764.log.gzgzip 2024-09-14T09:11:20.316 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50109.log 2024-09-14T09:11:20.316 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58037.log 2024-09-14T09:11:20.316 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40887.log.gz 2024-09-14T09:11:20.316 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58294.log 2024-09-14T09:11:20.316 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50109.log.gz 2024-09-14T09:11:20.316 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39713.log 2024-09-14T09:11:20.316 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58037.log.gz 2024-09-14T09:11:20.316 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41355.log 2024-09-14T09:11:20.316 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58294.log.gz 2024-09-14T09:11:20.316 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39182.log 2024-09-14T09:11:20.316 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39713.log.gz 2024-09-14T09:11:20.316 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57607.log 2024-09-14T09:11:20.317 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41355.log.gz 2024-09-14T09:11:20.317 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52352.log 2024-09-14T09:11:20.317 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39182.log.gz 2024-09-14T09:11:20.317 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.57607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42533.log 2024-09-14T09:11:20.317 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57607.log.gz 2024-09-14T09:11:20.317 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.52352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57903.log 2024-09-14T09:11:20.317 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52352.log.gz 2024-09-14T09:11:20.317 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.42533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56740.log 2024-09-14T09:11:20.317 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42533.log.gz 2024-09-14T09:11:20.317 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.57903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46564.log 2024-09-14T09:11:20.317 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57903.log.gz 2024-09-14T09:11:20.317 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.56740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35113.log 2024-09-14T09:11:20.317 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56740.log.gz 2024-09-14T09:11:20.318 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.46564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57077.log 2024-09-14T09:11:20.318 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46564.log.gz 2024-09-14T09:11:20.318 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.35113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58588.log 2024-09-14T09:11:20.318 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35113.log.gz 2024-09-14T09:11:20.318 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.57077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42813.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57077.log.gz 2024-09-14T09:11:20.318 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-14T09:11:20.318 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53904.log 2024-09-14T09:11:20.318 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58588.log.gz 2024-09-14T09:11:20.318 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.42813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50618.log 2024-09-14T09:11:20.318 INFO:teuthology.orchestra.run.smithi116.stderr: 28.9% -- replaced with /var/log/ceph/ceph-client.admin.42813.log.gz 2024-09-14T09:11:20.318 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.53904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60016.log 2024-09-14T09:11:20.318 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53904.log.gz 2024-09-14T09:11:20.318 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50618.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.50618.log.gz 2024-09-14T09:11:20.319 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47042.log 2024-09-14T09:11:20.319 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.60016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58504.log 2024-09-14T09:11:20.319 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60016.log.gz 2024-09-14T09:11:20.319 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50344.log 2024-09-14T09:11:20.319 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47042.log.gz 2024-09-14T09:11:20.319 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57647.log 2024-09-14T09:11:20.319 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58504.log.gz 2024-09-14T09:11:20.319 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48107.log 2024-09-14T09:11:20.319 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50344.log.gz 2024-09-14T09:11:20.319 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.57647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40000.log 2024-09-14T09:11:20.319 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57647.log.gz 2024-09-14T09:11:20.319 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39417.log 2024-09-14T09:11:20.319 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48107.log.gz 2024-09-14T09:11:20.319 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40000.log.gz 2024-09-14T09:11:20.320 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-14T09:11:20.320 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39417.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.46083.log 2024-09-14T09:11:20.320 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39417.log.gz 2024-09-14T09:11:20.320 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43445.log 2024-09-14T09:11:20.320 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/objectstore_tool.46083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42297.log 2024-09-14T09:11:20.320 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43445.log.gz 2024-09-14T09:11:20.320 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58336.log 2024-09-14T09:11:20.320 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50282.log 2024-09-14T09:11:20.320 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.42297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42297.log.gz 2024-09-14T09:11:20.320 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58336.log: gzip 28.7% -- replaced with /var/log/ceph/ceph-client.admin.58336.log.gz -5 2024-09-14T09:11:20.320 INFO:teuthology.orchestra.run.smithi116.stderr: --verbose -- /var/log/ceph/ceph-client.admin.59189.log 2024-09-14T09:11:20.320 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56123.log 2024-09-14T09:11:20.320 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50282.log.gz 2024-09-14T09:11:20.321 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.59189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50672.log 2024-09-14T09:11:20.321 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59189.log.gz 2024-09-14T09:11:20.321 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.56123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56123.log.gz 2024-09-14T09:11:20.321 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31947.log 2024-09-14T09:11:20.321 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36658.log 2024-09-14T09:11:20.321 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50672.log.gz 2024-09-14T09:11:20.321 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31947.log.gz 2024-09-14T09:11:20.321 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37315.log 2024-09-14T09:11:20.321 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36910.log 2024-09-14T09:11:20.321 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.36658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36658.log.gz 2024-09-14T09:11:20.321 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.37315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47723.log 2024-09-14T09:11:20.321 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37315.log.gz 2024-09-14T09:11:20.321 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.36910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36910.log.gz 2024-09-14T09:11:20.321 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57465.log 2024-09-14T09:11:20.322 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59806.log 2024-09-14T09:11:20.322 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47723.log.gz 2024-09-14T09:11:20.322 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.57465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57465.log.gz 2024-09-14T09:11:20.322 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58714.log 2024-09-14T09:11:20.322 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56392.log 2024-09-14T09:11:20.322 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.59806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59806.log.gz 2024-09-14T09:11:20.322 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52767.log 2024-09-14T09:11:20.322 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58714.log.gz 2024-09-14T09:11:20.322 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.56392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56392.log.gz 2024-09-14T09:11:20.322 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52024.log 2024-09-14T09:11:20.322 INFO:teuthology.orchestra.run.smithi116.stderr: 94.9%/var/log/ceph/ceph-client.admin.52767.log: -- replaced with /var/log/ceph/objectstore_tool.46083.log.gz 2024-09-14T09:11:20.322 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47548.log 2024-09-14T09:11:20.322 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52767.log.gz 2024-09-14T09:11:20.323 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.52024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37273.log 2024-09-14T09:11:20.323 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52024.log.gz 2024-09-14T09:11:20.323 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47548.log.gz 2024-09-14T09:11:20.323 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48411.log 2024-09-14T09:11:20.323 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.37273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39672.log 2024-09-14T09:11:20.323 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37273.log.gz 2024-09-14T09:11:20.323 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53394.log 2024-09-14T09:11:20.323 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48411.log.gz 2024-09-14T09:11:20.323 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43660.log 0.0% 2024-09-14T09:11:20.323 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39672.log.gz 2024-09-14T09:11:20.323 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.53394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51545.log 2024-09-14T09:11:20.323 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53394.log.gz 2024-09-14T09:11:20.323 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58672.log 2024-09-14T09:11:20.324 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43660.log.gz 2024-09-14T09:11:20.324 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56011.log 2024-09-14T09:11:20.324 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51545.log.gz 2024-09-14T09:11:20.324 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58672.log.gz 2024-09-14T09:11:20.324 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51306.log 2024-09-14T09:11:20.324 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.56011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54691.log 2024-09-14T09:11:20.324 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56011.log.gz 2024-09-14T09:11:20.324 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56465.log 2024-09-14T09:11:20.324 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51306.log.gz 2024-09-14T09:11:20.324 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.54691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36340.log 2024-09-14T09:11:20.324 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54691.log.gz 2024-09-14T09:11:20.324 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.56465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41807.log 0.0% 2024-09-14T09:11:20.324 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56465.log.gz 2024-09-14T09:11:20.325 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.36340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43937.log 2024-09-14T09:11:20.325 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36340.log.gz 2024-09-14T09:11:20.325 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53536.log 2024-09-14T09:11:20.325 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41807.log.gz 2024-09-14T09:11:20.325 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59974.log 2024-09-14T09:11:20.325 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43937.log.gz 2024-09-14T09:11:20.325 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.53536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51346.log 2024-09-14T09:11:20.325 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53536.log.gz 2024-09-14T09:11:20.325 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.59974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41765.log 2024-09-14T09:11:20.325 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59974.log.gz 2024-09-14T09:11:20.325 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36909.log 2024-09-14T09:11:20.325 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51346.log.gz 2024-09-14T09:11:20.325 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60184.log 2024-09-14T09:11:20.325 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41765.log.gz 2024-09-14T09:11:20.326 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.36909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53057.log 2024-09-14T09:11:20.326 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36909.log.gz 2024-09-14T09:11:20.326 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.60184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40102.log 2024-09-14T09:11:20.326 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60184.log.gz 2024-09-14T09:11:20.326 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.53057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53057.log.gz 2024-09-14T09:11:20.326 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52077.log 2024-09-14T09:11:20.326 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58939.log 2024-09-14T09:11:20.326 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40102.log.gz 2024-09-14T09:11:20.326 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.52077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52077.log.gz 2024-09-14T09:11:20.326 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44808.log 2024-09-14T09:11:20.326 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37083.log 2024-09-14T09:11:20.326 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58939.log.gz 2024-09-14T09:11:20.326 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44808.log.gz 2024-09-14T09:11:20.326 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60436.log 2024-09-14T09:11:20.327 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.37083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55439.log 2024-09-14T09:11:20.327 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37083.log.gz 2024-09-14T09:11:20.327 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.60436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36656.log 2024-09-14T09:11:20.327 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60436.log.gz 2024-09-14T09:11:20.327 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.55439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60562.log 2024-09-14T09:11:20.327 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55439.log.gz 2024-09-14T09:11:20.327 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.36656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36656.log.gz 2024-09-14T09:11:20.327 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T09:11:20.327 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.60562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41122.log 2024-09-14T09:11:20.327 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60562.log.gz 2024-09-14T09:11:20.327 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55736.log 2024-09-14T09:11:20.327 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51606.log 2024-09-14T09:11:20.327 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41122.log.gz 2024-09-14T09:11:20.327 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37399.log 2024-09-14T09:11:20.328 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.55736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55736.log.gz 2024-09-14T09:11:20.328 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58546.log 2024-09-14T09:11:20.328 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51606.log.gz 2024-09-14T09:11:20.328 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.37399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37399.log.gz 2024-09-14T09:11:20.328 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58630.log 2024-09-14T09:11:20.328 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31648.log 2024-09-14T09:11:20.328 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58546.log.gz 2024-09-14T09:11:20.328 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60602.log 2024-09-14T09:11:20.328 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58630.log.gz 2024-09-14T09:11:20.328 INFO:teuthology.orchestra.run.smithi116.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T09:11:20.328 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31648.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.31648.log.gz --verbose 2024-09-14T09:11:20.328 INFO:teuthology.orchestra.run.smithi116.stderr: -- /var/log/ceph/ceph-client.admin.47935.log 2024-09-14T09:11:20.328 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.60602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43875.log 2024-09-14T09:11:20.328 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60602.log.gz 2024-09-14T09:11:20.329 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47935.log.gz 2024-09-14T09:11:20.329 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58163.log 2024-09-14T09:11:20.329 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39080.log 2024-09-14T09:11:20.329 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43875.log.gz 2024-09-14T09:11:20.329 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58163.log.gz 2024-09-14T09:11:20.329 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42082.log 2024-09-14T09:11:20.329 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58938.log 2024-09-14T09:11:20.329 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39080.log.gz 2024-09-14T09:11:20.329 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.42082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42082.log.gz 2024-09-14T09:11:20.329 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39550.log 2024-09-14T09:11:20.329 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54119.log 2024-09-14T09:11:20.329 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58938.log.gz 2024-09-14T09:11:20.329 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39550.log.gz 2024-09-14T09:11:20.329 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52534.log 2024-09-14T09:11:20.330 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37969.log 2024-09-14T09:11:20.330 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.54119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54119.log.gz 2024-09-14T09:11:20.330 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.52534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36654.log 2024-09-14T09:11:20.330 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52534.log.gz 2024-09-14T09:11:20.330 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.37969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38752.log 2024-09-14T09:11:20.330 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37969.log.gz 2024-09-14T09:11:20.330 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.36654.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.36654.log.gz 2024-09-14T09:11:20.330 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47314.log 2024-09-14T09:11:20.330 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36659.log 2024-09-14T09:11:20.330 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38752.log.gz 2024-09-14T09:11:20.330 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47314.log.gzgzip 2024-09-14T09:11:20.330 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44867.log 2024-09-14T09:11:20.330 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.36659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49151.log 2024-09-14T09:11:20.330 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36659.log.gz 2024-09-14T09:11:20.331 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44867.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.59404.log -- replaced with /var/log/ceph/ceph-client.admin.44867.log.gz 2024-09-14T09:11:20.331 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-14T09:11:20.331 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36475.log 2024-09-14T09:11:20.331 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49151.log.gz 2024-09-14T09:11:20.331 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.59404.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59404.log.gz -5 2024-09-14T09:11:20.331 INFO:teuthology.orchestra.run.smithi116.stderr: --verbose -- /var/log/ceph/ceph-client.admin.59722.log 2024-09-14T09:11:20.331 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43170.log 2024-09-14T09:11:20.331 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.36475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36475.log.gz 2024-09-14T09:11:20.331 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.59722.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59722.log.gz -5 2024-09-14T09:11:20.331 INFO:teuthology.orchestra.run.smithi116.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47681.log 2024-09-14T09:11:20.331 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37707.log 2024-09-14T09:11:20.331 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43170.log.gz 2024-09-14T09:11:20.331 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47681.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47681.log.gz -5 2024-09-14T09:11:20.331 INFO:teuthology.orchestra.run.smithi116.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48813.log 2024-09-14T09:11:20.332 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.37707.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.44553.log 2024-09-14T09:11:20.332 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37707.log.gz 2024-09-14T09:11:20.332 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48813.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48813.log.gz -5 2024-09-14T09:11:20.332 INFO:teuthology.orchestra.run.smithi116.stderr: --verbose -- /var/log/ceph/ceph-client.admin.57146.log 2024-09-14T09:11:20.332 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/objectstore_tool.44553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40204.log 2024-09-14T09:11:20.332 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.57146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58756.log 2024-09-14T09:11:20.332 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57146.log.gz 2024-09-14T09:11:20.332 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40204.log.gz 2024-09-14T09:11:20.332 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41880.log 2024-09-14T09:11:20.332 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54813.log 2024-09-14T09:11:20.332 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58756.log.gz 2024-09-14T09:11:20.333 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40592.log 2024-09-14T09:11:20.333 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41880.log.gz 2024-09-14T09:11:20.333 INFO:teuthology.orchestra.run.smithi116.stderr: 94.5% -- replaced with /var/log/ceph/objectstore_tool.44553.log.gz 2024-09-14T09:11:20.333 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.54813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54813.log.gzgzip 2024-09-14T09:11:20.333 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42637.log 2024-09-14T09:11:20.333 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60268.log 2024-09-14T09:11:20.333 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40592.log.gz 2024-09-14T09:11:20.333 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.42637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42637.log.gz 2024-09-14T09:11:20.333 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58462.log 2024-09-14T09:11:20.333 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.60268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44050.log 2024-09-14T09:11:20.333 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60268.log.gz 2024-09-14T09:11:20.333 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58462.log.gz 2024-09-14T09:11:20.333 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36259.log 2024-09-14T09:11:20.334 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60520.log 2024-09-14T09:11:20.334 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44050.log.gz 2024-09-14T09:11:20.334 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.36259.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.36851.log 2024-09-14T09:11:20.334 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36259.log.gz 2024-09-14T09:11:20.334 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.60520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36843.log 2024-09-14T09:11:20.334 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60520.log.gz 2024-09-14T09:11:20.334 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.36851.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-14T09:11:20.334 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36851.log.gz 2024-09-14T09:11:20.334 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.36843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59680.log 2024-09-14T09:11:20.334 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36843.log.gz 2024-09-14T09:11:20.334 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59193.log 2024-09-14T09:11:20.334 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.59680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59680.log.gz 2024-09-14T09:11:20.334 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38122.log 2024-09-14T09:11:20.335 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36841.log 2024-09-14T09:11:20.335 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.59193.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59193.log.gz 2024-09-14T09:11:20.335 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38122.log.gz 2024-09-14T09:11:20.335 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52944.log 2024-09-14T09:11:20.335 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59462.log 2024-09-14T09:11:20.335 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.36841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36841.log.gz 2024-09-14T09:11:20.335 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.52944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57332.log 2024-09-14T09:11:20.335 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52944.log.gz 2024-09-14T09:11:20.335 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.59462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48584.log 2024-09-14T09:11:20.335 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59462.log.gz 2024-09-14T09:11:20.335 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.57332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57332.log.gz 2024-09-14T09:11:20.335 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47163.log 2024-09-14T09:11:20.335 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55797.log 2024-09-14T09:11:20.335 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48584.log.gz 2024-09-14T09:11:20.336 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58935.log 2024-09-14T09:11:20.336 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47163.log.gz 2024-09-14T09:11:20.336 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.55797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55797.log.gz 2024-09-14T09:11:20.336 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41490.log 2024-09-14T09:11:20.336 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43487.log 2024-09-14T09:11:20.336 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58935.log.gz 2024-09-14T09:11:20.336 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44305.log 2024-09-14T09:11:20.336 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41490.log.gz 2024-09-14T09:11:20.336 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43487.log.gz 2024-09-14T09:11:20.336 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49974.log 2024-09-14T09:11:20.336 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51263.log 2024-09-14T09:11:20.336 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44305.log.gz 2024-09-14T09:11:20.336 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39947.log 2024-09-14T09:11:20.336 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49974.log.gz 2024-09-14T09:11:20.337 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51263.log.gzgzip 2024-09-14T09:11:20.337 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-14T09:11:20.337 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59132.log 2024-09-14T09:11:20.337 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39947.log.gz 2024-09-14T09:11:20.337 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57801.log 2024-09-14T09:11:20.337 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.59132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46044.log 2024-09-14T09:11:20.337 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59132.log.gz 2024-09-14T09:11:20.337 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.57801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59890.log 2024-09-14T09:11:20.337 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57801.log.gz 2024-09-14T09:11:20.337 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58252.log 2024-09-14T09:11:20.337 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.46044.log: /var/log/ceph/ceph-client.admin.59890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54241.log 2024-09-14T09:11:20.337 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59890.log.gz 2024-09-14T09:11:20.337 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46044.log.gz 2024-09-14T09:11:20.338 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58252.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.56955.log 2024-09-14T09:11:20.338 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58252.log.gz 2024-09-14T09:11:20.338 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.54241.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54241.log.gz 2024-09-14T09:11:20.338 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42955.log 2024-09-14T09:11:20.338 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.56955.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56955.log.gz 2024-09-14T09:11:20.338 INFO:teuthology.orchestra.run.smithi116.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54589.log 2024-09-14T09:11:20.338 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.42955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42955.log.gz 2024-09-14T09:11:20.338 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59364.log 2024-09-14T09:11:20.338 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.54589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54589.log.gz 2024-09-14T09:11:20.338 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38805.log 2024-09-14T09:11:20.338 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.59364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59364.log.gz 2024-09-14T09:11:20.338 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58378.log 2024-09-14T09:11:20.338 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38805.log.gz 2024-09-14T09:11:20.338 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58205.log 2024-09-14T09:11:20.339 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58378.log.gz 2024-09-14T09:11:20.339 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-14T09:11:20.339 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58205.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37063.log 2024-09-14T09:11:20.339 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58205.log.gz 2024-09-14T09:11:20.339 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37182.log 2024-09-14T09:11:20.339 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.37063.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37063.log.gz 2024-09-14T09:11:20.339 INFO:teuthology.orchestra.run.smithi116.stderr: --verbose -- /var/log/ceph/ceph-client.admin.59596.log 2024-09-14T09:11:20.339 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.37182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37182.log.gz 2024-09-14T09:11:20.339 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42532.log 2024-09-14T09:11:20.339 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.59596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59596.log.gz 2024-09-14T09:11:20.339 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58798.log 2024-09-14T09:11:20.339 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.42532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42532.log.gz 2024-09-14T09:11:20.339 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36315.log 2024-09-14T09:11:20.339 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58798.log.gz 2024-09-14T09:11:20.340 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58420.log 2024-09-14T09:11:20.340 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.36315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36315.log.gz 2024-09-14T09:11:20.340 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55622.log 2024-09-14T09:11:20.340 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58420.log.gz 2024-09-14T09:11:20.340 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37483.log 2024-09-14T09:11:20.340 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.55622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55622.log.gz 2024-09-14T09:11:20.340 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59128.log 2024-09-14T09:11:20.340 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.37483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37483.log.gz 2024-09-14T09:11:20.340 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42452.log 2024-09-14T09:11:20.340 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.59128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59128.log.gz 2024-09-14T09:11:20.340 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52646.log 2024-09-14T09:11:20.340 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.42452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42452.log.gz 2024-09-14T09:11:20.340 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50557.log 2024-09-14T09:11:20.341 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.52646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52646.log.gz 2024-09-14T09:11:20.341 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44406.log 2024-09-14T09:11:20.341 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50557.log.gz 2024-09-14T09:11:20.341 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51749.log 2024-09-14T09:11:20.341 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.44406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44406.log.gz 2024-09-14T09:11:20.341 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T09:11:20.341 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51749.log.gz 2024-09-14T09:11:20.341 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41215.log 2024-09-14T09:11:20.341 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54414.log 2024-09-14T09:11:20.341 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41215.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41215.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55325.log 2024-09-14T09:11:20.341 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-14T09:11:20.341 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38477.log 2024-09-14T09:11:20.341 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.55325.log: /var/log/ceph/ceph-client.admin.54414.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55325.log.gz 2024-09-14T09:11:20.342 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54414.log.gz 2024-09-14T09:11:20.342 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56270.log 2024-09-14T09:11:20.342 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38477.log: 91.5% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38477.log.gz 2024-09-14T09:11:20.342 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42135.log 2024-09-14T09:11:20.342 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T09:11:20.342 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50854.log 2024-09-14T09:11:20.342 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.56270.log: /var/log/ceph/ceph-client.admin.42135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54456.log 2024-09-14T09:11:20.342 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56270.log.gz 2024-09-14T09:11:20.342 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42135.log.gz 2024-09-14T09:11:20.342 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50854.log.gz 2024-09-14T09:11:20.342 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60394.log 2024-09-14T09:11:20.342 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37441.log 2024-09-14T09:11:20.342 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.54456.log: /var/log/ceph/ceph-client.admin.60394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31877.log 2024-09-14T09:11:20.342 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54456.log.gz 2024-09-14T09:11:20.343 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60394.log.gz 2024-09-14T09:11:20.343 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.37441.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37441.log.gz 2024-09-14T09:11:20.343 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44132.log 2024-09-14T09:11:20.343 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38518.log 2024-09-14T09:11:20.343 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31877.log: /var/log/ceph/ceph-client.admin.44132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39007.log 2024-09-14T09:11:20.343 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31877.log.gz 2024-09-14T09:11:20.343 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44132.log.gz 2024-09-14T09:11:20.343 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58079.log 2024-09-14T09:11:20.343 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38518.log.gz 2024-09-14T09:11:20.343 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59103.log 2024-09-14T09:11:20.343 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39007.log: /var/log/ceph/ceph-client.admin.58079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60058.log 2024-09-14T09:11:20.343 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39007.log.gz 2024-09-14T09:11:20.343 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58079.log.gz 2024-09-14T09:11:20.343 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.59103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59103.log.gz 2024-09-14T09:11:20.344 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37587.log 2024-09-14T09:11:20.344 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37183.log 2024-09-14T09:11:20.344 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.60058.log: /var/log/ceph/ceph-client.admin.37587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36517.log 2024-09-14T09:11:20.344 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37587.log.gz 2024-09-14T09:11:20.344 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60058.log.gz 2024-09-14T09:11:20.344 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.37183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37183.log.gz 2024-09-14T09:11:20.344 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55419.log 2024-09-14T09:11:20.344 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.36517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36517.log.gz 2024-09-14T09:11:20.344 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60100.log 2024-09-14T09:11:20.344 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.55419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55419.log.gz 2024-09-14T09:11:20.344 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36391.log 2024-09-14T09:11:20.344 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.60100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60100.log.gz 2024-09-14T09:11:20.344 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27265.log 2024-09-14T09:11:20.345 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.36391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36391.log.gz 2024-09-14T09:11:20.345 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50947.log 2024-09-14T09:11:20.345 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph.tmp-client.admin.27265.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27265.log.gz 2024-09-14T09:11:20.345 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38244.log 2024-09-14T09:11:20.345 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50947.log.gz 2024-09-14T09:11:20.345 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51790.log 2024-09-14T09:11:20.345 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38244.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38244.log.gz 2024-09-14T09:11:20.345 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40317.log 2024-09-14T09:11:20.345 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51790.log.gz 2024-09-14T09:11:20.345 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37357.log 2024-09-14T09:11:20.345 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40317.log.gz 2024-09-14T09:11:20.345 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56841.log 2024-09-14T09:11:20.345 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.37357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37357.log.gz 2024-09-14T09:11:20.346 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51483.log 2024-09-14T09:11:20.346 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.56841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56841.log.gz 2024-09-14T09:11:20.346 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58936.log 2024-09-14T09:11:20.346 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51483.log.gz 2024-09-14T09:11:20.346 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41512.log 2024-09-14T09:11:20.346 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58936.log.gz 2024-09-14T09:11:20.346 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51049.log 2024-09-14T09:11:20.346 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41512.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41512.log.gz 2024-09-14T09:11:20.346 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52647.log 2024-09-14T09:11:20.346 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51049.log.gz 2024-09-14T09:11:20.346 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54855.log 2024-09-14T09:11:20.346 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.52647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52647.log.gz 2024-09-14T09:11:20.346 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53688.log 2024-09-14T09:11:20.346 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.54855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54855.log.gz 2024-09-14T09:11:20.346 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49403.log 2024-09-14T09:11:20.347 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.53688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53688.log.gz 2024-09-14T09:11:20.347 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56647.log 2024-09-14T09:11:20.347 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49403.log.gz 2024-09-14T09:11:20.347 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39355.log 2024-09-14T09:11:20.347 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.56647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56647.log.gz 2024-09-14T09:11:20.347 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58099.log 2024-09-14T09:11:20.347 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39355.log.gz 2024-09-14T09:11:20.347 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36911.log 2024-09-14T09:11:20.347 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58099.log.gz 2024-09-14T09:11:20.347 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52279.log 2024-09-14T09:11:20.347 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.36911.log: 0.0%gzip -5 --verbose -- /var/log/ceph/objectstore_tool.45110.log 2024-09-14T09:11:20.347 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36911.log.gz 2024-09-14T09:11:20.347 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.52279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42697.log 2024-09-14T09:11:20.347 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52279.log.gz 2024-09-14T09:11:20.348 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60142.log 2024-09-14T09:11:20.348 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/objectstore_tool.45110.log: /var/log/ceph/ceph-client.admin.42697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45625.log 2024-09-14T09:11:20.348 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42697.log.gz 2024-09-14T09:11:20.348 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.60142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60142.log.gz 2024-09-14T09:11:20.348 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40632.log 2024-09-14T09:11:20.348 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47275.log 2024-09-14T09:11:20.348 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.45625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45625.log.gz 2024-09-14T09:11:20.348 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40632.log.gz 2024-09-14T09:11:20.348 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60352.log 2024-09-14T09:11:20.348 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47275.log.gz 2024-09-14T09:11:20.348 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42377.log 2024-09-14T09:11:20.348 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56124.log 2024-09-14T09:11:20.348 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.60352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60352.log.gz 2024-09-14T09:11:20.349 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.42377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42377.log.gz 2024-09-14T09:11:20.349 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59504.log 2024-09-14T09:11:20.349 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47894.log 2024-09-14T09:11:20.349 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.56124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56124.log.gz 2024-09-14T09:11:20.349 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.59504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59504.log.gz 2024-09-14T09:11:20.349 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56207.log 2024-09-14T09:11:20.349 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47894.log.gz 2024-09-14T09:11:20.349 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60478.log 2024-09-14T09:11:20.349 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53219.log 2024-09-14T09:11:20.349 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.56207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56207.log.gz 2024-09-14T09:11:20.349 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.60478.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54773.log 2024-09-14T09:11:20.349 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60478.log.gz 2024-09-14T09:11:20.349 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.53219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53219.log.gz 2024-09-14T09:11:20.350 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36653.log 2024-09-14T09:11:20.350 INFO:teuthology.orchestra.run.smithi116.stderr: 95.0% -- replaced with /var/log/ceph/objectstore_tool.45110.log.gz 2024-09-14T09:11:20.350 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.54773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54773.log.gz 2024-09-14T09:11:20.350 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60310.log 2024-09-14T09:11:20.350 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.36653.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36653.log.gz 2024-09-14T09:11:20.350 INFO:teuthology.orchestra.run.smithi116.stderr: --verbose -- /var/log/ceph/ceph-client.admin.59848.log 2024-09-14T09:11:20.350 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.60310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60310.log.gz 2024-09-14T09:11:20.350 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53292.log 2024-09-14T09:11:20.350 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.59848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59848.log.gz 2024-09-14T09:11:20.350 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42998.log 2024-09-14T09:11:20.350 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.53292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53292.log.gz 2024-09-14T09:11:20.350 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36657.log 2024-09-14T09:11:20.350 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.42998.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59932.log 2024-09-14T09:11:20.351 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42998.log.gz 2024-09-14T09:11:20.351 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.36657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51222.log 2024-09-14T09:11:20.351 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36657.log.gz 2024-09-14T09:11:20.351 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.59932.log: -- /var/log/ceph/ceph-client.admin.37709.log 2024-09-14T09:11:20.351 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59932.log.gz 2024-09-14T09:11:20.351 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.51222.log: -- /var/log/ceph/ceph-client.admin.59484.log 2024-09-14T09:11:20.351 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51222.log.gz 2024-09-14T09:11:20.351 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.37709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37709.log.gz 2024-09-14T09:11:20.351 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59194.log 2024-09-14T09:11:20.351 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.59484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59484.log.gz 2024-09-14T09:11:20.351 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47468.log 2024-09-14T09:11:20.351 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.59194.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59194.log.gz 2024-09-14T09:11:20.351 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55091.log 2024-09-14T09:11:20.351 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47468.log.gz 2024-09-14T09:11:20.352 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43283.log 2024-09-14T09:11:20.352 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.55091.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55091.log.gz 2024-09-14T09:11:20.352 INFO:teuthology.orchestra.run.smithi116.stderr: --verbose -- /var/log/ceph/ceph-client.admin.58940.log 2024-09-14T09:11:20.352 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43283.log.gz 2024-09-14T09:11:20.352 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50067.log 2024-09-14T09:11:20.352 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59344.log 2024-09-14T09:11:20.352 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58940.log.gz 2024-09-14T09:11:20.352 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59638.log 2024-09-14T09:11:20.352 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50067.log.gz 2024-09-14T09:11:20.352 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.59344.log: -- /var/log/ceph/ceph-client.admin.37710.log 2024-09-14T09:11:20.352 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59344.log.gz 2024-09-14T09:11:20.352 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.59638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59638.log.gz 2024-09-14T09:11:20.352 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37525.log 2024-09-14T09:11:20.353 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.37710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37710.log.gz 2024-09-14T09:11:20.353 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36433.log 2024-09-14T09:11:20.353 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.37525.log: gzip 0.0% -5 --verbose -- /var/log/ceph/objectstore_tool.44863.log 2024-09-14T09:11:20.353 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37525.log.gz 2024-09-14T09:11:20.353 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.36433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48320.log 2024-09-14T09:11:20.353 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36433.log.gz 2024-09-14T09:11:20.353 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43659.log 2024-09-14T09:11:20.353 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/objectstore_tool.44863.log: /var/log/ceph/ceph-client.admin.48320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48320.log.gzgzip 2024-09-14T09:11:20.353 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48768.log 2024-09-14T09:11:20.353 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.43659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43659.log.gz 2024-09-14T09:11:20.353 INFO:teuthology.orchestra.run.smithi116.stderr: 94.5% -- replaced with /var/log/ceph/objectstore_tool.44863.log.gz 2024-09-14T09:11:20.353 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53789.log 2024-09-14T09:11:20.353 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48768.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48768.log.gz 2024-09-14T09:11:20.354 INFO:teuthology.orchestra.run.smithi116.stderr: --verbose -- /var/log/ceph/ceph-client.admin.58934.log 2024-09-14T09:11:20.354 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.53789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53789.log.gz 2024-09-14T09:11:20.354 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37142.log 2024-09-14T09:11:20.354 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58934.log.gz 2024-09-14T09:11:20.354 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54045.log 2024-09-14T09:11:20.354 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.37142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37142.log.gz 2024-09-14T09:11:20.354 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40940.log 2024-09-14T09:11:20.354 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.54045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54045.log.gz 2024-09-14T09:11:20.354 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40940.log.gz 2024-09-14T09:11:20.354 INFO:teuthology.orchestra.run.smithi116.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-14T09:11:20.421 INFO:teuthology.orchestra.run.smithi116.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-14T09:11:24.630 INFO:teuthology.orchestra.run.smithi116.stderr: 95.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-14T09:11:24.636 INFO:teuthology.orchestra.run.smithi144.stderr: 95.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-14T09:11:28.259 INFO:teuthology.orchestra.run.smithi116.stderr: 96.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-14T09:11:29.116 INFO:teuthology.orchestra.run.smithi144.stderr: 95.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-14T09:11:29.899 INFO:teuthology.orchestra.run.smithi144.stderr: 96.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-14T09:11:29.901 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-14T09:11:29.901 INFO:teuthology.orchestra.run.smithi144.stderr:real 0m9.796s 2024-09-14T09:11:29.901 INFO:teuthology.orchestra.run.smithi144.stderr:user 0m22.536s 2024-09-14T09:11:29.901 INFO:teuthology.orchestra.run.smithi144.stderr:sys 0m0.958s 2024-09-14T09:11:30.609 INFO:teuthology.orchestra.run.smithi116.stderr: 95.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-14T09:11:30.611 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-14T09:11:30.611 INFO:teuthology.orchestra.run.smithi116.stderr:real 0m10.508s 2024-09-14T09:11:30.611 INFO:teuthology.orchestra.run.smithi116.stderr:user 0m22.679s 2024-09-14T09:11:30.611 INFO:teuthology.orchestra.run.smithi116.stderr:sys 0m1.030s 2024-09-14T09:11:30.612 INFO:tasks.ceph:Archiving logs... 2024-09-14T09:11:30.612 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900520/remote/smithi116/log 2024-09-14T09:11:30.613 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T09:11:33.640 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900520/remote/smithi144/log 2024-09-14T09:11:33.641 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T09:11:36.432 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900520/remote/smithi148/log 2024-09-14T09:11:36.433 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T09:11:36.589 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-14T09:11:36.606 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-14T09:11:36.607 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T09:11:36.609 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T09:11:36.612 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T09:11:36.713 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-14T09:11:36.721 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-14T09:11:36.722 DEBUG:teuthology.orchestra.run.smithi116:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T09:11:36.724 DEBUG:teuthology.orchestra.run.smithi144:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T09:11:36.726 DEBUG:teuthology.orchestra.run.smithi148:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T09:11:36.739 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2024-09-14T09:11:36.740 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: ntpq: command not found 2024-09-14T09:11:36.743 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-09-14T09:11:36.744 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T09:11:36.744 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-09-14T09:11:36.744 INFO:teuthology.orchestra.run.smithi116.stdout:^* hv01.front.sepia.ceph.com 3 6 377 38 +3170us[+3159us] +/- 66ms 2024-09-14T09:11:36.744 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 37 +818us[ +818us] +/- 54ms 2024-09-14T09:11:36.744 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 -5690us[-5690us] +/- 93ms 2024-09-14T09:11:36.744 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T09:11:36.745 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T09:11:36.745 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2024-09-14T09:11:36.745 INFO:teuthology.orchestra.run.smithi144.stdout:^* hv01.front.sepia.ceph.com 3 6 377 37 +3121us[+3196us] +/- 66ms 2024-09-14T09:11:36.745 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 38 +775us[ +850us] +/- 54ms 2024-09-14T09:11:36.745 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 -5742us[-5667us] +/- 93ms 2024-09-14T09:11:36.745 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T09:11:36.748 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T09:11:36.748 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-09-14T09:11:36.749 INFO:teuthology.orchestra.run.smithi148.stdout:^* hv01.front.sepia.ceph.com 3 6 377 38 +3190us[+3217us] +/- 66ms 2024-09-14T09:11:36.749 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 37 +830us[ +830us] +/- 54ms 2024-09-14T09:11:36.749 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 -5677us[-5650us] +/- 93ms 2024-09-14T09:11:36.749 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T09:11:36.749 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-14T09:11:36.757 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-14T09:11:36.758 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-14T09:11:36.769 DEBUG:teuthology.orchestra.run.smithi116:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T09:11:36.869 DEBUG:teuthology.orchestra.run.smithi144:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T09:11:36.948 DEBUG:teuthology.orchestra.run.smithi148:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T09:11:37.014 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T09:11:37.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T09:11:37.046 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T09:11:37.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T09:11:37.077 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T09:11:37.106 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T09:11:37.107 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-14T09:11:37.116 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-14T09:11:37.124 INFO:teuthology.task.internal:Duration was 663.299113 seconds 2024-09-14T09:11:37.125 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-14T09:11:37.134 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-14T09:11:37.135 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T09:11:37.137 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T09:11:37.140 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T09:11:37.175 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T09:11:37.179 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T09:11:37.189 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T09:11:37.511 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-14T09:11:37.511 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T09:11:37.511 DEBUG:teuthology.orchestra.run.smithi116:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T09:11:37.531 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi144.front.sepia.ceph.com 2024-09-14T09:11:37.531 DEBUG:teuthology.orchestra.run.smithi144:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T09:11:37.579 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi148.front.sepia.ceph.com 2024-09-14T09:11:37.580 DEBUG:teuthology.orchestra.run.smithi148:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T09:11:37.604 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-14T09:11:37.604 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T09:11:37.606 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T09:11:37.622 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T09:11:37.674 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-14T09:11:37.674 DEBUG:teuthology.orchestra.run.smithi116:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T09:11:37.677 DEBUG:teuthology.orchestra.run.smithi144:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T09:11:37.690 DEBUG:teuthology.orchestra.run.smithi148:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T09:11:37.821 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-14T09:11:37.830 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-14T09:11:37.830 DEBUG:teuthology.orchestra.run.smithi116:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T09:11:37.855 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T09:11:37.879 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T09:11:37.904 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-14T09:11:37.913 DEBUG:teuthology.orchestra.run.smithi116:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T09:11:37.915 DEBUG:teuthology.orchestra.run.smithi144:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T09:11:37.922 DEBUG:teuthology.orchestra.run.smithi148:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T09:11:37.936 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = core 2024-09-14T09:11:37.943 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = core 2024-09-14T09:11:37.967 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = core 2024-09-14T09:11:38.002 DEBUG:teuthology.orchestra.run.smithi116:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T09:11:38.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T09:11:38.044 DEBUG:teuthology.orchestra.run.smithi144:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T09:11:38.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T09:11:38.058 DEBUG:teuthology.orchestra.run.smithi148:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T09:11:38.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T09:11:38.073 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-14T09:11:38.082 INFO:teuthology.task.internal:Transferring archived files... 2024-09-14T09:11:38.083 DEBUG:teuthology.misc:Transferring archived files from smithi116:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900520/remote/smithi116 2024-09-14T09:11:38.083 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T09:11:38.117 DEBUG:teuthology.misc:Transferring archived files from smithi144:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900520/remote/smithi144 2024-09-14T09:11:38.117 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T09:11:38.150 DEBUG:teuthology.misc:Transferring archived files from smithi148:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900520/remote/smithi148 2024-09-14T09:11:38.151 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T09:11:38.188 INFO:teuthology.task.internal:Removing archive directory... 2024-09-14T09:11:38.188 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T09:11:38.190 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T09:11:38.192 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T09:11:38.236 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-14T09:11:38.247 INFO:teuthology.task.internal:Not uploading archives. 2024-09-14T09:11:38.247 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-14T09:11:38.259 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-14T09:11:38.259 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T09:11:38.261 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T09:11:38.264 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T09:11:38.274 INFO:teuthology.orchestra.run.smithi116.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 09:11 /home/ubuntu/cephtest 2024-09-14T09:11:38.276 INFO:teuthology.orchestra.run.smithi144.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 09:11 /home/ubuntu/cephtest 2024-09-14T09:11:38.291 INFO:teuthology.orchestra.run.smithi148.stdout: 266054 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 09:11 /home/ubuntu/cephtest 2024-09-14T09:11:38.292 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-14T09:11:38.305 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-14T09:11:38.337 INFO:teuthology.run:Summary data: description: rbd/device/{base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} duration: 663.2991127967834 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-14T09:11:38.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T09:11:38.421 INFO:teuthology.run:pass